climateprediction.net home page
Task 13183897

Task 13183897

Name hadam3p_eu_2ret_1971_1_007382523_1
Workunit 7579953
Created 1 Aug 2011, 3:35:09 UTC
Sent 1 Aug 2011, 4:15:07 UTC
Report deadline 13 Jul 2012, 9:35:07 UTC
Received 3 Sep 2011, 8:10:44 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1160009
Run time 5 days 19 hours 38 min 47 sec
CPU time 5 days 8 hours 3 min 16 sec
Validate state Workunit error - check skipped
Credit 2,386.39
Device peak FLOPS 2.44 GFLOPS
Application version UK Met Office HadAM3P-HadRM3P Europe v6.09
windows_intelx86
Stderr
<core_client_version>6.12.33</core_client_version>
<![CDATA[
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
21:03:12 (3720): No heartbeat from core client for 30 sec - exiting
21:03:13 (3720): No heartbeat from core client for 30 sec - exiting
21:03:14 (3720): No heartbeat from core client for 30 sec - exiting
21:03:15 (3720): No heartbeat from core client for 30 sec - exiting
21:03:16 (3720): No heartbeat from core client for 30 sec - exiting
21:03:17 (3720): No heartbeat from core client for 30 sec - exiting
21:03:18 (3720): No heartbeat from core client for 30 sec - exiting
21:03:19 (3720): No heartbeat from core client for 30 sec - exiting
21:03:20 (3720): No heartbeat from core client for 30 sec - exiting
21:03:21 (3720): No heartbeat from core client for 30 sec - exiting
21:03:23 (3720): No heartbeat from core client for 30 sec - exiting
21:03:24 (3720): No heartbeat from core client for 30 sec - exiting
21:03:25 (3720): No heartbeat from core client for 30 sec - exiting
21:03:26 (3720): No heartbeat from core client for 30 sec - exiting
21:03:27 (3720): No heartbeat from core client for 30 sec - exiting
21:03:28 (3720): No heartbeat from core client for 30 sec - exiting
21:03:29 (3720): No heartbeat from core client for 30 sec - exiting
21:03:30 (3720): No heartbeat from core client for 30 sec - exiting
21:03:31 (3720): No heartbeat from core client for 30 sec - exiting
21:03:32 (3720): No heartbeat from core client for 30 sec - exiting
21:03:33 (3720): No heartbeat from core client for 30 sec - exiting
21:03:35 (3720): No heartbeat from core client for 30 sec - exiting
21:03:36 (3720): No heartbeat from core client for 30 sec - exiting
21:03:37 (3720): No heartbeat from core client for 30 sec - exiting
21:03:38 (3720): No heartbeat from core client for 30 sec - exiting
21:03:39 (3720): No heartbeat from core client for 30 sec - exiting
21:03:40 (3720): No heartbeat from core client for 30 sec - exiting
21:03:41 (3720): No heartbeat from core client for 30 sec - exiting
21:03:42 (3720): No heartbeat from core client for 30 sec - exiting
21:03:43 (3720): No heartbeat from core client for 30 sec - exiting
21:03:44 (3720): No heartbeat from core client for 30 sec - exiting
21:03:46 (3720): No heartbeat from core client for 30 sec - exiting
21:03:47 (3720): No heartbeat from core client for 30 sec - exiting
21:03:48 (3720): No heartbeat from core client for 30 sec - exiting
21:03:49 (3720): No heartbeat from core client for 30 sec - exiting
21:03:50 (3720): No heartbeat from core client for 30 sec - exiting
21:03:51 (3720): No heartbeat from core client for 30 sec - exiting
21:03:52 (3720): No heartbeat from core client for 30 sec - exiting
21:03:53 (3720): No heartbeat from core client for 30 sec - exiting
21:03:54 (3720): No heartbeat from core client for 30 sec - exiting
21:03:55 (3720): No heartbeat from core client for 30 sec - exiting
21:03:56 (3720): No heartbeat from core client for 30 sec - exiting
21:03:58 (3720): No heartbeat from core client for 30 sec - exiting
21:03:59 (3720): No heartbeat from core client for 30 sec - exiting
21:04:00 (3720): No heartbeat from core client for 30 sec - exiting
21:04:01 (3720): No heartbeat from core client for 30 sec - exiting
21:04:02 (3720): No heartbeat from core client for 30 sec - exiting
21:04:03 (3720): No heartbeat from core client for 30 sec - exiting
21:04:04 (3720): No heartbeat from core client for 30 sec - exiting
21:04:05 (3720): No heartbeat from core client for 30 sec - exiting
21:04:06 (3720): No heartbeat from core client for 30 sec - exiting
21:04:07 (3720): No heartbeat from core client for 30 sec - exiting
21:04:08 (3720): No heartbeat from core client for 30 sec - exiting
21:04:10 (3720): No heartbeat from core client for 30 sec - exiting
21:04:11 (3720): No heartbeat from core client for 30 sec - exiting
21:04:12 (3720): No heartbeat from core client for 30 sec - exiting
21:04:13 (3720): No heartbeat from core client for 30 sec - exiting
21:04:14 (3720): No heartbeat from core client for 30 sec - exiting
21:04:15 (3720): No heartbeat from core client for 30 sec - exiting
21:04:16 (3720): No heartbeat from core client for 30 sec - exiting
21:04:17 (3720): No heartbeat from core client for 30 sec - exiting
21:04:18 (3720): No heartbeat from core client for 30 sec - exiting
21:04:19 (3720): No heartbeat from core client for 30 sec - exiting
21:04:20 (3720): No heartbeat from core client for 30 sec - exiting
21:04:22 (3720): No heartbeat from core client for 30 sec - exiting
21:04:23 (3720): No heartbeat from core client for 30 sec - exiting
21:04:24 (3720): No heartbeat from core client for 30 sec - exiting
21:04:25 (3720): No heartbeat from core client for 30 sec - exiting
21:04:26 (3720): No heartbeat from core client for 30 sec - exiting
21:04:27 (3720): No heartbeat from core client for 30 sec - exiting
21:04:28 (3720): No heartbeat from core client for 30 sec - exiting
21:04:29 (3720): No heartbeat from core client for 30 sec - exiting
21:04:30 (3720): No heartbeat from core client for 30 sec - exiting
21:04:31 (3720): No heartbeat from core client for 30 sec - exiting
21:04:32 (3720): No heartbeat from core client for 30 sec - exiting
21:04:34 (3720): No heartbeat from core client for 30 sec - exiting
21:04:35 (3720): No heartbeat from core client for 30 sec - exiting
21:04:36 (3720): No heartbeat from core client for 30 sec - exiting
21:04:37 (3720): No heartbeat from core client for 30 sec - exiting
21:04:38 (3720): No heartbeat from core client for 30 sec - exiting
21:04:39 (3720): No heartbeat from core client for 30 sec - exiting
21:04:40 (3720): No heartbeat from core client for 30 sec - exiting
21:04:41 (3720): No heartbeat from core client for 30 sec - exiting
21:04:42 (3720): No heartbeat from core client for 30 sec - exiting
21:04:43 (3720): No heartbeat from core client for 30 sec - exiting
21:04:44 (3720): No heartbeat from core client for 30 sec - exiting
21:04:46 (3720): No heartbeat from core client for 30 sec - exiting
21:04:47 (3720): No heartbeat from core client for 30 sec - exiting
21:04:48 (3720): No heartbeat from core client for 30 sec - exiting
21:04:49 (3720): No heartbeat from core client for 30 sec - exiting
21:04:50 (3720): No heartbeat from core client for 30 sec - exiting
21:04:51 (3720): No heartbeat from core client for 30 sec - exiting
21:04:52 (3720): No heartbeat from core client for 30 sec - exiting
21:04:53 (3720): No heartbeat from core client for 30 sec - exiting
21:04:54 (3720): No heartbeat from core client for 30 sec - exiting
21:04:55 (3720): No heartbeat from core client for 30 sec - exiting
21:04:56 (3720): No heartbeat from core client for 30 sec - exiting
21:04:58 (3720): No heartbeat from core client for 30 sec - exiting
21:04:59 (3720): No heartbeat from core client for 30 sec - exiting
21:05:00 (3720): No heartbeat from core client for 30 sec - exiting
21:05:01 (3720): No heartbeat from core client for 30 sec - exiting
21:05:02 (3720): No heartbeat from core client for 30 sec - exiting
21:05:03 (3720): No heartbeat from core client for 30 sec - exiting
21:05:04 (3720): No heartbeat from core client for 30 sec - exiting
21:05:05 (3720): No heartbeat from core client for 30 sec - exiting
21:05:06 (3720): No heartbeat from core client for 30 sec - exiting
21:05:07 (3720): No heartbeat from core client for 30 sec - exiting
21:05:08 (3720): No heartbeat from core client for 30 sec - exiting
21:05:10 (3720): No heartbeat from core client for 30 sec - exiting
21:05:11 (3720): No heartbeat from core client for 30 sec - exiting
21:05:12 (3720): No heartbeat from core client for 30 sec - exiting
21:05:13 (3720): No heartbeat from core client for 30 sec - exiting
21:05:14 (3720): No heartbeat from core client for 30 sec - exiting
21:05:15 (3720): No heartbeat from core client for 30 sec - exiting
21:05:16 (3720): No heartbeat from core client for 30 sec - exiting
21:05:17 (3720): No heartbeat from core client for 30 sec - exiting
21:05:18 (3720): No heartbeat from core client for 30 sec - exiting
21:05:19 (3720): No heartbeat from core client for 30 sec - exiting
21:05:21 (3720): No heartbeat from core client for 30 sec - exiting
21:05:22 (3720): No heartbeat from core client for 30 sec - exiting
21:05:23 (3720): No heartbeat from core client for 30 sec - exiting
21:05:24 (3720): No heartbeat from core client for 30 sec - exiting
21:05:25 (3720): No heartbeat from core client for 30 sec - exiting
21:05:26 (3720): No heartbeat from core client for 30 sec - exiting
21:05:27 (3720): No heartbeat from core client for 30 sec - exiting
21:05:28 (3720): No heartbeat from core client for 30 sec - exiting
21:05:29 (3720): No heartbeat from core client for 30 sec - exiting
21:05:30 (3720): No heartbeat from core client for 30 sec - exiting
21:05:31 (3720): No heartbeat from core client for 30 sec - exiting
21:05:33 (3720): No heartbeat from core client for 30 sec - exiting
21:05:34 (3720): No heartbeat from core client for 30 sec - exiting
21:05:35 (3720): No heartbeat from core client for 30 sec - exiting
21:05:36 (3720): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
08:15:05 (3820): No heartbeat from core client for 30 sec - exiting
08:15:06 (3820): No heartbeat from core client for 30 sec - exiting
08:15:07 (3820): No heartbeat from core client for 30 sec - exiting
08:15:08 (3820): No heartbeat from core client for 30 sec - exiting
08:15:09 (3820): No heartbeat from core client for 30 sec - exiting
08:15:10 (3820): No heartbeat from core client for 30 sec - exiting
08:15:11 (3820): No heartbeat from core client for 30 sec - exiting
08:15:12 (3820): No heartbeat from core client for 30 sec - exiting
08:15:13 (3820): No heartbeat from core client for 30 sec - exiting
08:15:15 (3820): No heartbeat from core client for 30 sec - exiting
08:15:16 (3820): No heartbeat from core client for 30 sec - exiting
08:15:17 (3820): No heartbeat from core client for 30 sec - exiting
08:15:18 (3820): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7324, selfPID=3516, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3344, selfPID=3632, iMonCtr=1
Model crash detected, will try to restart...
19:35:56 (3456): No heartbeat from core client for 30 sec - exiting
19:35:57 (3456): No heartbeat from core client for 30 sec - exiting
19:35:58 (3456): No heartbeat from core client for 30 sec - exiting
19:35:59 (3456): No heartbeat from core client for 30 sec - exiting
19:36:00 (3456): No heartbeat from core client for 30 sec - exiting
19:36:01 (3456): No heartbeat from core client for 30 sec - exiting
19:36:02 (3456): No heartbeat from core client for 30 sec - exiting
19:36:03 (3456): No heartbeat from core client for 30 sec - exiting
19:36:04 (3456): No heartbeat from core client for 30 sec - exiting
19:36:05 (3456): No heartbeat from core client for 30 sec - exiting
19:36:07 (3456): No heartbeat from core client for 30 sec - exiting
19:36:08 (3456): No heartbeat from core client for 30 sec - exiting
19:36:09 (3456): No heartbeat from core client for 30 sec - exiting
19:36:10 (3456): No heartbeat from core client for 30 sec - exiting
19:36:11 (3456): No heartbeat from core client for 30 sec - exiting
19:36:12 (3456): No heartbeat from core client for 30 sec - exiting
19:36:13 (3456): No heartbeat from core client for 30 sec - exiting
19:36:14 (3456): No heartbeat from core client for 30 sec - exiting
19:36:15 (3456): No heartbeat from core client for 30 sec - exiting
19:36:16 (3456): No heartbeat from core client for 30 sec - exiting
19:36:17 (3456): No heartbeat from core client for 30 sec - exiting
19:36:19 (3456): No heartbeat from core client for 30 sec - exiting
19:36:20 (3456): No heartbeat from core client for 30 sec - exiting
19:36:21 (3456): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4924, selfPID=7120, iMonCtr=1
Model crash detected, will try to restart...
17:54:24 (3644): No heartbeat from core client for 30 sec - exiting
17:54:25 (3644): No heartbeat from core client for 30 sec - exiting
17:54:26 (3644): No heartbeat from core client for 30 sec - exiting
17:54:27 (3644): No heartbeat from core client for 30 sec - exiting
17:54:29 (3644): No heartbeat from core client for 30 sec - exiting
17:54:30 (3644): No heartbeat from core client for 30 sec - exiting
17:54:31 (3644): No heartbeat from core client for 30 sec - exiting
17:54:32 (3644): No heartbeat from core client for 30 sec - exiting
17:54:33 (3644): No heartbeat from core client for 30 sec - exiting
17:54:34 (3644): No heartbeat from core client for 30 sec - exiting
17:54:35 (3644): No heartbeat from core client for 30 sec - exiting
17:54:36 (3644): No heartbeat from core client for 30 sec - exiting
17:54:37 (3644): No heartbeat from core client for 30 sec - exiting
17:54:38 (3644): No heartbeat from core client for 30 sec - exiting
17:54:39 (3644): No heartbeat from core client for 30 sec - exiting
17:54:41 (3644): No heartbeat from core client for 30 sec - exiting
17:54:42 (3644): No heartbeat from core client for 30 sec - exiting
17:54:43 (3644): No heartbeat from core client for 30 sec - exiting
17:54:44 (3644): No heartbeat from core client for 30 sec - exiting
17:54:45 (3644): No heartbeat from core client for 30 sec - exiting
17:54:46 (3644): No heartbeat from core client for 30 sec - exiting
17:54:47 (3644): No heartbeat from core client for 30 sec - exiting
17:54:48 (3644): No heartbeat from core client for 30 sec - exiting
17:54:49 (3644): No heartbeat from core client for 30 sec - exiting
17:54:50 (3644): No heartbeat from core client for 30 sec - exiting
17:54:51 (3644): No heartbeat from core client for 30 sec - exiting
17:54:53 (3644): No heartbeat from core client for 30 sec - exiting
17:54:54 (3644): No heartbeat from core client for 30 sec - exiting
17:54:55 (3644): No heartbeat from core client for 30 sec - exiting
17:54:56 (3644): No heartbeat from core client for 30 sec - exiting
17:54:57 (3644): No heartbeat from core client for 30 sec - exiting
17:54:58 (3644): No heartbeat from core client for 30 sec - exiting
17:54:59 (3644): No heartbeat from core client for 30 sec - exiting
17:55:00 (3644): No heartbeat from core client for 30 sec - exiting
17:55:01 (3644): No heartbeat from core client for 30 sec - exiting
17:55:02 (3644): No heartbeat from core client for 30 sec - exiting
17:55:03 (3644): No heartbeat from core client for 30 sec - exiting
17:55:05 (3644): No heartbeat from core client for 30 sec - exiting
17:55:06 (3644): No heartbeat from core client for 30 sec - exiting
17:55:07 (3644): No heartbeat from core client for 30 sec - exiting
17:55:08 (3644): No heartbeat from core client for 30 sec - exiting
17:55:09 (3644): No heartbeat from core client for 30 sec - exiting
17:55:10 (3644): No heartbeat from core client for 30 sec - exiting
17:55:11 (3644): No heartbeat from core client for 30 sec - exiting
17:55:12 (3644): No heartbeat from core client for 30 sec - exiting
17:55:13 (3644): No heartbeat from core client for 30 sec - exiting
17:55:14 (3644): No heartbeat from core client for 30 sec - exiting
17:55:15 (3644): No heartbeat from core client for 30 sec - exiting
17:55:17 (3644): No heartbeat from core client for 30 sec - exiting
17:55:18 (3644): No heartbeat from core client for 30 sec - exiting
17:55:19 (3644): No heartbeat from core client for 30 sec - exiting
17:55:20 (3644): No heartbeat from core client for 30 sec - exiting
17:55:21 (3644): No heartbeat from core client for 30 sec - exiting
17:55:22 (3644): No heartbeat from core client for 30 sec - exiting
17:55:23 (3644): No heartbeat from core client for 30 sec - exiting
17:55:24 (3644): No heartbeat from core client for 30 sec - exiting
17:55:25 (3644): No heartbeat from core client for 30 sec - exiting
17:55:26 (3644): No heartbeat from core client for 30 sec - exiting
17:55:27 (3644): No heartbeat from core client for 30 sec - exiting
17:55:29 (3644): No heartbeat from core client for 30 sec - exiting
17:55:30 (3644): No heartbeat from core client for 30 sec - exiting
17:55:31 (3644): No heartbeat from core client for 30 sec - exiting
17:55:32 (3644): No heartbeat from core client for 30 sec - exiting
17:55:33 (3644): No heartbeat from core client for 30 sec - exiting
17:55:34 (3644): No heartbeat from core client for 30 sec - exiting
17:55:35 (3644): No heartbeat from core client for 30 sec - exiting
17:55:36 (3644): No heartbeat from core client for 30 sec - exiting
17:55:37 (3644): No heartbeat from core client for 30 sec - exiting
17:55:38 (3644): No heartbeat from core client for 30 sec - exiting
17:55:40 (3644): No heartbeat from core client for 30 sec - exiting
17:55:41 (3644): No heartbeat from core client for 30 sec - exiting
17:55:42 (3644): No heartbeat from core client for 30 sec - exiting
17:55:43 (3644): No heartbeat from core client for 30 sec - exiting
17:55:44 (3644): No heartbeat from core client for 30 sec - exiting
17:55:45 (3644): No heartbeat from core client for 30 sec - exiting
17:55:46 (3644): No heartbeat from core client for 30 sec - exiting
17:55:47 (3644): No heartbeat from core client for 30 sec - exiting
17:55:48 (3644): No heartbeat from core client for 30 sec - exiting
17:55:49 (3644): No heartbeat from core client for 30 sec - exiting
17:55:50 (3644): No heartbeat from core client for 30 sec - exiting
17:55:52 (3644): No heartbeat from core client for 30 sec - exiting
17:55:53 (3644): No heartbeat from core client for 30 sec - exiting
17:55:54 (3644): No heartbeat from core client for 30 sec - exiting
17:55:55 (3644): No heartbeat from core client for 30 sec - exiting
17:55:56 (3644): No heartbeat from core client for 30 sec - exiting
17:55:57 (3644): No heartbeat from core client for 30 sec - exiting
17:55:58 (3644): No heartbeat from core client for 30 sec - exiting
17:55:59 (3644): No heartbeat from core client for 30 sec - exiting
17:56:00 (3644): No heartbeat from core client for 30 sec - exiting
17:56:01 (3644): No heartbeat from core client for 30 sec - exiting
17:56:02 (3644): No heartbeat from core client for 30 sec - exiting
17:56:04 (3644): No heartbeat from core client for 30 sec - exiting
17:56:05 (3644): No heartbeat from core client for 30 sec - exiting
17:56:06 (3644): No heartbeat from core client for 30 sec - exiting
17:56:07 (3644): No heartbeat from core client for 30 sec - exiting
17:56:08 (3644): No heartbeat from core client for 30 sec - exiting
17:56:09 (3644): No heartbeat from core client for 30 sec - exiting
17:56:10 (3644): No heartbeat from core client for 30 sec - exiting
17:56:11 (3644): No heartbeat from core client for 30 sec - exiting
17:56:12 (3644): No heartbeat from core client for 30 sec - exiting
17:56:13 (3644): No heartbeat from core client for 30 sec - exiting
17:56:14 (3644): No heartbeat from core client for 30 sec - exiting
17:56:16 (3644): No heartbeat from core client for 30 sec - exiting
17:56:17 (3644): No heartbeat from core client for 30 sec - exiting
17:56:18 (3644): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6184, selfPID=5104, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6448, selfPID=6448, iMonCtr=2
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3412, iMonCtr=2
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4084, iMonCtr=2
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2932, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8032, selfPID=8032, iMonCtr=2
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6700, selfPID=3136, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6860, selfPID=1628, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6348, selfPID=3400, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5660, selfPID=4088, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6592, selfPID=3132, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3408, selfPID=2988, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6384, selfPID=4052, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2224, selfPID=4908, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6320, selfPID=3676, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7016, selfPID=4044, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5164, selfPID=2972, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6040, selfPID=6560, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
18:49:14 (2348): No heartbeat from core client for 30 sec - exiting
18:49:15 (2348): No heartbeat from core client for 30 sec - exiting
18:49:16 (2348): No heartbeat from core client for 30 sec - exiting
18:49:17 (2348): No heartbeat from core client for 30 sec - exiting
18:49:18 (2348): No heartbeat from core client for 30 sec - exiting
18:49:20 (2348): No heartbeat from core client for 30 sec - exiting
18:49:21 (2348): No heartbeat from core client for 30 sec - exiting
18:49:22 (2348): No heartbeat from core client for 30 sec - exiting
18:49:23 (2348): No heartbeat from core client for 30 sec - exiting
18:49:24 (2348): No heartbeat from core client for 30 sec - exiting
18:49:25 (2348): No heartbeat from core client for 30 sec - exiting
18:49:26 (2348): No heartbeat from core client for 30 sec - exiting
18:49:27 (2348): No heartbeat from core client for 30 sec - exiting
18:49:28 (2348): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5880, selfPID=4076, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
17:07:35 (1452): No heartbeat from core client for 30 sec - exiting
17:07:36 (1452): No heartbeat from core client for 30 sec - exiting
17:07:37 (1452): No heartbeat from core client for 30 sec - exiting
17:07:38 (1452): No heartbeat from core client for 30 sec - exiting
17:07:39 (1452): No heartbeat from core client for 30 sec - exiting
17:07:40 (1452): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Leaving CPDN_Main::Monitor...
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
03 Sep 2011 07:11:09 1160009 13183897 hadam3p_eu_2ret_1971_1_007382523_1 138,336 460,211 3.3268
02 Sep 2011 07:17:27 1160009 13183897 hadam3p_eu_2ret_1971_1_007382523_1 126,816 424,380 3.3464
30 Aug 2011 23:53:53 1160009 13183897 hadam3p_eu_2ret_1971_1_007382523_1 115,296 388,679 3.3711
30 Aug 2011 01:18:47 1160009 13183897 hadam3p_eu_2ret_1971_1_007382523_1 103,776 350,092 3.3735
28 Aug 2011 05:13:00 1160009 13183897 hadam3p_eu_2ret_1971_1_007382523_1 92,256 312,952 3.3922
27 Aug 2011 04:00:40 1160009 13183897 hadam3p_eu_2ret_1971_1_007382523_1 80,736 272,786 3.3787
24 Aug 2011 23:44:02 1160009 13183897 hadam3p_eu_2ret_1971_1_007382523_1 69,216 230,462 3.3296
22 Aug 2011 08:18:54 1160009 13183897 hadam3p_eu_2ret_1971_1_007382523_1 57,696 190,206 3.2967
20 Aug 2011 22:51:25 1160009 13183897 hadam3p_eu_2ret_1971_1_007382523_1 46,176 153,134 3.3163
16 Aug 2011 21:48:15 1160009 13183897 hadam3p_eu_2ret_1971_1_007382523_1 34,656 114,729 3.3105
14 Aug 2011 00:05:00 1160009 13183897 hadam3p_eu_2ret_1971_1_007382523_1 23,136 76,793 3.3192
05 Aug 2011 06:30:06 1160009 13183897 hadam3p_eu_2ret_1971_1_007382523_1 11,616 38,340 3.3006


©2024 cpdn.org