climateprediction.net home page
Task 13806942

Task 13806942

Name hadcm3n_u10k_1980_40_007617217_1
Workunit 7795347
Created 22 Dec 2011, 4:30:34 UTC
Sent 22 Dec 2011, 10:09:22 UTC
Report deadline 22 Mar 2012, 17:36:33 UTC
Received 26 Jan 2012, 5:44:31 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1122757
Run time 27 days 21 hours 13 min 11 sec
CPU time 27 days 2 hours 18 min 56 sec
Validate state Invalid
Credit 6,531.84
Device peak FLOPS 1.69 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>6.12.34</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
10:29:24 (1072): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:46:48 (5732): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:59:16 (4788): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:54:10 (6488): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:54:30 (6488): No heartbeat from core client for 30 sec - exiting
01:54:31 (6488): No heartbeat from core client for 30 sec - exiting
01:54:32 (6488): No heartbeat from core client for 30 sec - exiting
01:54:33 (6488): No heartbeat from core client for 30 sec - exiting
01:54:34 (6488): No heartbeat from core client for 30 sec - exiting
01:54:35 (6488): No heartbeat from core client for 30 sec - exiting
01:54:37 (6488): No heartbeat from core client for 30 sec - exiting
01:54:38 (6488): No heartbeat from core client for 30 sec - exiting
01:54:39 (6488): No heartbeat from core client for 30 sec - exiting
01:54:40 (6488): No heartbeat from core client for 30 sec - exiting
01:54:41 (6488): No heartbeat from core client for 30 sec - exiting
01:54:42 (6488): No heartbeat from core client for 30 sec - exiting
01:54:43 (6488): No heartbeat from core client for 30 sec - exiting
01:54:44 (6488): No heartbeat from core client for 30 sec - exiting
01:54:45 (6488): No heartbeat from core client for 30 sec - exiting
01:54:46 (6488): No heartbeat from core client for 30 sec - exiting
01:54:47 (6488): No heartbeat from core client for 30 sec - exiting
01:54:49 (6488): No heartbeat from core client for 30 sec - exiting
01:54:50 (6488): No heartbeat from core client for 30 sec - exiting
01:54:51 (6488): No heartbeat from core client for 30 sec - exiting
02:02:33 (4260): No heartbeat from core client for 30 sec - exiting
02:02:42 (4260): No heartbeat from core client for 30 sec - exiting
02:02:43 (4260): No heartbeat from core client for 30 sec - exiting
02:02:44 (4260): No heartbeat from core client for 30 sec - exiting
02:02:45 (4260): No heartbeat from core client for 30 sec - exiting
02:02:46 (4260): No heartbeat from core client for 30 sec - exiting
02:02:47 (4260): No heartbeat from core client for 30 sec - exiting
02:02:48 (4260): No heartbeat from core client for 30 sec - exiting
02:02:49 (4260): No heartbeat from core client for 30 sec - exiting
02:02:51 (4260): No heartbeat from core client for 30 sec - exiting
02:02:52 (4260): No heartbeat from core client for 30 sec - exiting
02:02:53 (4260): No heartbeat from core client for 30 sec - exiting
02:02:54 (4260): No heartbeat from core client for 30 sec - exiting
02:02:55 (4260): No heartbeat from core client for 30 sec - exiting
02:02:56 (4260): No heartbeat from core client for 30 sec - exiting
02:02:57 (4260): No heartbeat from core client for 30 sec - exiting
02:02:58 (4260): No heartbeat from core client for 30 sec - exiting
02:02:59 (4260): No heartbeat from core client for 30 sec - exiting
02:03:00 (4260): No heartbeat from core client for 30 sec - exiting
02:03:01 (4260): No heartbeat from core client for 30 sec - exiting
02:03:03 (4260): No heartbeat from core client for 30 sec - exiting
02:03:04 (4260): No heartbeat from core client for 30 sec - exiting
02:03:05 (4260): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:06:25 (5872): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:06:26 (5872): No heartbeat from core client for 30 sec - exiting
02:06:27 (5872): No heartbeat from core client for 30 sec - exiting
02:06:28 (5872): No heartbeat from core client for 30 sec - exiting
02:08:26 (6332): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:08:31 (6332): No heartbeat from core client for 30 sec - exiting
02:08:32 (6332): No heartbeat from core client for 30 sec - exiting
02:08:33 (6332): No heartbeat from core client for 30 sec - exiting
02:09:20 (6760): No heartbeat from core client for 30 sec - exiting
02:09:33 (6760): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:09:34 (6760): No heartbeat from core client for 30 sec - exiting
02:09:35 (6760): No heartbeat from core client for 30 sec - exiting
02:09:36 (6760): No heartbeat from core client for 30 sec - exiting
02:09:37 (6760): No heartbeat from core client for 30 sec - exiting
02:09:38 (6760): No heartbeat from core client for 30 sec - exiting
02:09:39 (6760): No heartbeat from core client for 30 sec - exiting
02:10:22 (7068): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:12:05 (340): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:12:14 (340): No heartbeat from core client for 30 sec - exiting
02:12:15 (340): No heartbeat from core client for 30 sec - exiting
02:12:16 (340): No heartbeat from core client for 30 sec - exiting
02:16:31 (6156): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:16:40 (6156): No heartbeat from core client for 30 sec - exiting
02:16:41 (6156): No heartbeat from core client for 30 sec - exiting
02:16:42 (6156): No heartbeat from core client for 30 sec - exiting
02:16:43 (6156): No heartbeat from core client for 30 sec - exiting
02:16:44 (6156): No heartbeat from core client for 30 sec - exiting
02:16:45 (6156): No heartbeat from core client for 30 sec - exiting
02:16:46 (6156): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
04:29:41 (5276): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:29:58 (5276): No heartbeat from core client for 30 sec - exiting
04:29:59 (5276): No heartbeat from core client for 30 sec - exiting
04:30:00 (5276): No heartbeat from core client for 30 sec - exiting
04:30:01 (5276): No heartbeat from core client for 30 sec - exiting
04:30:03 (5276): No heartbeat from core client for 30 sec - exiting
04:30:04 (5276): No heartbeat from core client for 30 sec - exiting
04:30:05 (5276): No heartbeat from core client for 30 sec - exiting
04:30:06 (5276): No heartbeat from core client for 30 sec - exiting
04:30:07 (5276): No heartbeat from core client for 30 sec - exiting
04:30:08 (5276): No heartbeat from core client for 30 sec - exiting
04:30:09 (5276): No heartbeat from core client for 30 sec - exiting
04:30:10 (5276): No heartbeat from core client for 30 sec - exiting
04:30:11 (5276): No heartbeat from core client for 30 sec - exiting
04:30:12 (5276): No heartbeat from core client for 30 sec - exiting
04:30:13 (5276): No heartbeat from core client for 30 sec - exiting
04:30:15 (5276): No heartbeat from core client for 30 sec - exiting
04:30:16 (5276): No heartbeat from core client for 30 sec - exiting
04:30:17 (5276): No heartbeat from core client for 30 sec - exiting
04:30:18 (5276): No heartbeat from core client for 30 sec - exiting
04:30:19 (5276): No heartbeat from core client for 30 sec - exiting
04:30:20 (5276): No heartbeat from core client for 30 sec - exiting
04:30:21 (5276): No heartbeat from core client for 30 sec - exiting
04:30:22 (5276): No heartbeat from core client for 30 sec - exiting
04:30:23 (5276): No heartbeat from core client for 30 sec - exiting
04:30:24 (5276): No heartbeat from core client for 30 sec - exiting
04:30:26 (5276): No heartbeat from core client for 30 sec - exiting
04:30:27 (5276): No heartbeat from core client for 30 sec - exiting
04:30:28 (5276): No heartbeat from core client for 30 sec - exiting
04:30:29 (5276): No heartbeat from core client for 30 sec - exiting
04:30:30 (5276): No heartbeat from core client for 30 sec - exiting
04:30:31 (5276): No heartbeat from core client for 30 sec - exiting
04:30:32 (5276): No heartbeat from core client for 30 sec - exiting
04:30:33 (5276): No heartbeat from core client for 30 sec - exiting
04:30:34 (5276): No heartbeat from core client for 30 sec - exiting
04:30:35 (5276): No heartbeat from core client for 30 sec - exiting
04:30:36 (5276): No heartbeat from core client for 30 sec - exiting
04:30:38 (5276): No heartbeat from core client for 30 sec - exiting
04:30:39 (5276): No heartbeat from core client for 30 sec - exiting
04:30:40 (5276): No heartbeat from core client for 30 sec - exiting
04:30:41 (5276): No heartbeat from core client for 30 sec - exiting
04:30:42 (5276): No heartbeat from core client for 30 sec - exiting
04:30:43 (5276): No heartbeat from core client for 30 sec - exiting
04:30:44 (5276): No heartbeat from core client for 30 sec - exiting
04:30:45 (5276): No heartbeat from core client for 30 sec - exiting
04:30:46 (5276): No heartbeat from core client for 30 sec - exiting
04:30:47 (5276): No heartbeat from core client for 30 sec - exiting
04:30:48 (5276): No heartbeat from core client for 30 sec - exiting
04:30:50 (5276): No heartbeat from core client for 30 sec - exiting
04:30:51 (5276): No heartbeat from core client for 30 sec - exiting
04:30:52 (5276): No heartbeat from core client for 30 sec - exiting
04:30:53 (5276): No heartbeat from core client for 30 sec - exiting
04:30:54 (5276): No heartbeat from core client for 30 sec - exiting
04:30:55 (5276): No heartbeat from core client for 30 sec - exiting
04:30:56 (5276): No heartbeat from core client for 30 sec - exiting
04:30:57 (5276): No heartbeat from core client for 30 sec - exiting
04:30:58 (5276): No heartbeat from core client for 30 sec - exiting
04:30:59 (5276): No heartbeat from core client for 30 sec - exiting
04:31:00 (5276): No heartbeat from core client for 30 sec - exiting
04:31:02 (5276): No heartbeat from core client for 30 sec - exiting
04:31:03 (5276): No heartbeat from core client for 30 sec - exiting
04:31:04 (5276): No heartbeat from core client for 30 sec - exiting
04:31:05 (5276): No heartbeat from core client for 30 sec - exiting
04:31:06 (5276): No heartbeat from core client for 30 sec - exiting
04:31:07 (5276): No heartbeat from core client for 30 sec - exiting
04:31:08 (5276): No heartbeat from core client for 30 sec - exiting
04:31:09 (5276): No heartbeat from core client for 30 sec - exiting
04:31:10 (5276): No heartbeat from core client for 30 sec - exiting
04:31:11 (5276): No heartbeat from core client for 30 sec - exiting
04:31:12 (5276): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:49:46 (5460): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:51:44 (3648): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
22:06:21 (4632): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
22:35:37 (3220): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:35:42 (3220): No heartbeat from core client for 30 sec - exiting
22:35:43 (3220): No heartbeat from core client for 30 sec - exiting
22:35:44 (3220): No heartbeat from core client for 30 sec - exiting
22:35:46 (3220): No heartbeat from core client for 30 sec - exiting
22:35:47 (3220): No heartbeat from core client for 30 sec - exiting
22:36:22 (4664): No heartbeat from core client for 30 sec - exiting
22:36:24 (4664): No heartbeat from core client for 30 sec - exiting
22:36:25 (4664): No heartbeat from core client for 30 sec - exiting
22:36:26 (4664): No heartbeat from core client for 30 sec - exiting
22:36:27 (4664): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
02:21:47 (2572): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:22:03 (2572): No heartbeat from core client for 30 sec - exiting
02:22:04 (2572): No heartbeat from core client for 30 sec - exiting
02:22:05 (2572): No heartbeat from core client for 30 sec - exiting
02:22:06 (2572): No heartbeat from core client for 30 sec - exiting
02:22:07 (2572): No heartbeat from core client for 30 sec - exiting
02:22:08 (2572): No heartbeat from core client for 30 sec - exiting
02:22:09 (2572): No heartbeat from core client for 30 sec - exiting
02:22:10 (2572): No heartbeat from core client for 30 sec - exiting
02:22:12 (2572): No heartbeat from core client for 30 sec - exiting
02:22:13 (2572): No heartbeat from core client for 30 sec - exiting
02:22:14 (2572): No heartbeat from core client for 30 sec - exiting
02:22:15 (2572): No heartbeat from core client for 30 sec - exiting
02:22:16 (2572): No heartbeat from core client for 30 sec - exiting
02:22:17 (2572): No heartbeat from core client for 30 sec - exiting
02:22:18 (2572): No heartbeat from core client for 30 sec - exiting
02:27:32 (5496): No heartbeat from core client for 30 sec - exiting
02:27:33 (5496): No heartbeat from core client for 30 sec - exiting
02:27:34 (5496): No heartbeat from core client for 30 sec - exiting
02:27:35 (5496): No heartbeat from core client for 30 sec - exiting
02:27:36 (5496): No heartbeat from core client for 30 sec - exiting
02:27:37 (5496): No heartbeat from core client for 30 sec - exiting
02:27:38 (5496): No heartbeat from core client for 30 sec - exiting
02:27:39 (5496): No heartbeat from core client for 30 sec - exiting
02:27:40 (5496): No heartbeat from core client for 30 sec - exiting
02:27:41 (5496): No heartbeat from core client for 30 sec - exiting
02:27:43 (5496): No heartbeat from core client for 30 sec - exiting
02:27:44 (5496): No heartbeat from core client for 30 sec - exiting
02:27:45 (5496): No heartbeat from core client for 30 sec - exiting
02:27:46 (5496): No heartbeat from core client for 30 sec - exiting
02:27:47 (5496): No heartbeat from core client for 30 sec - exiting
02:27:48 (5496): No heartbeat from core client for 30 sec - exiting
02:27:49 (5496): No heartbeat from core client for 30 sec - exiting
02:27:50 (5496): No heartbeat from core client for 30 sec - exiting
02:27:51 (5496): No heartbeat from core client for 30 sec - exiting
02:27:52 (5496): No heartbeat from core client for 30 sec - exiting
02:27:53 (5496): No heartbeat from core client for 30 sec - exiting
02:27:55 (5496): No heartbeat from core client for 30 sec - exiting
02:27:56 (5496): No heartbeat from core client for 30 sec - exiting
02:27:57 (5496): No heartbeat from core client for 30 sec - exiting
02:27:58 (5496): No heartbeat from core client for 30 sec - exiting
02:27:59 (5496): No heartbeat from core client for 30 sec - exiting
02:28:00 (5496): No heartbeat from core client for 30 sec - exiting
02:28:01 (5496): No heartbeat from core client for 30 sec - exiting
02:28:02 (5496): No heartbeat from core client for 30 sec - exiting
02:28:03 (5496): No heartbeat from core client for 30 sec - exiting
02:28:04 (5496): No heartbeat from core client for 30 sec - exiting
02:28:05 (5496): No heartbeat from core client for 30 sec - exiting
02:28:07 (5496): No heartbeat from core client for 30 sec - exiting
02:28:08 (5496): No heartbeat from core client for 30 sec - exiting
02:28:09 (5496): No heartbeat from core client for 30 sec - exiting
02:28:10 (5496): No heartbeat from core client for 30 sec - exiting
02:28:11 (5496): No heartbeat from core client for 30 sec - exiting
02:28:12 (5496): No heartbeat from core client for 30 sec - exiting
02:28:13 (5496): No heartbeat from core client for 30 sec - exiting
02:28:14 (5496): No heartbeat from core client for 30 sec - exiting
02:28:15 (5496): No heartbeat from core client for 30 sec - exiting
02:28:16 (5496): No heartbeat from core client for 30 sec - exiting
02:28:17 (5496): No heartbeat from core client for 30 sec - exiting
02:28:19 (5496): No heartbeat from core client for 30 sec - exiting
02:28:20 (5496): No heartbeat from core client for 30 sec - exiting
02:28:21 (5496): No heartbeat from core client for 30 sec - exiting
02:28:55 (5496): No heartbeat from core client for 30 sec - exiting
02:28:56 (5496): No heartbeat from core client for 30 sec - exiting
02:28:57 (5496): No heartbeat from core client for 30 sec - exiting
02:28:58 (5496): No heartbeat from core client for 30 sec - exiting
02:28:59 (5496): No heartbeat from core client for 30 sec - exiting
02:29:00 (5496): No heartbeat from core client for 30 sec - exiting
02:29:01 (5496): No heartbeat from core client for 30 sec - exiting
02:29:02 (5496): No heartbeat from core client for 30 sec - exiting
02:29:03 (5496): No heartbeat from core client for 30 sec - exiting
02:29:04 (5496): No heartbeat from core client for 30 sec - exiting
02:29:06 (5496): No heartbeat from core client for 30 sec - exiting
02:29:07 (5496): No heartbeat from core client for 30 sec - exiting
02:29:08 (5496): No heartbeat from core client for 30 sec - exiting
02:29:09 (5496): No heartbeat from core client for 30 sec - exiting
02:29:10 (5496): No heartbeat from core client for 30 sec - exiting
02:29:11 (5496): No heartbeat from core client for 30 sec - exiting
02:29:12 (5496): No heartbeat from core client for 30 sec - exiting
02:29:13 (5496): No heartbeat from core client for 30 sec - exiting
02:29:14 (5496): No heartbeat from core client for 30 sec - exiting
02:29:15 (5496): No heartbeat from core client for 30 sec - exiting
02:29:16 (5496): No heartbeat from core client for 30 sec - exiting
02:29:18 (5496): No heartbeat from core client for 30 sec - exiting
02:29:19 (5496): No heartbeat from core client for 30 sec - exiting
02:29:20 (5496): No heartbeat from core client for 30 sec - exiting
02:29:21 (5496): No heartbeat from core client for 30 sec - exiting
02:29:22 (5496): No heartbeat from core client for 30 sec - exiting
02:29:23 (5496): No heartbeat from core client for 30 sec - exiting
02:29:24 (5496): No heartbeat from core client for 30 sec - exiting
02:29:25 (5496): No heartbeat from core client for 30 sec - exiting
02:29:26 (5496): No heartbeat from core client for 30 sec - exiting
02:29:27 (5496): No heartbeat from core client for 30 sec - exiting
02:29:28 (5496): No heartbeat from core client for 30 sec - exiting
02:29:30 (5496): No heartbeat from core client for 30 sec - exiting
02:29:31 (5496): No heartbeat from core client for 30 sec - exiting
02:29:32 (5496): No heartbeat from core client for 30 sec - exiting
02:29:33 (5496): No heartbeat from core client for 30 sec - exiting
02:29:34 (5496): No heartbeat from core client for 30 sec - exiting
02:29:35 (5496): No heartbeat from core client for 30 sec - exiting
02:29:36 (5496): No heartbeat from core client for 30 sec - exiting
02:29:37 (5496): No heartbeat from core client for 30 sec - exiting
02:29:38 (5496): No heartbeat from core client for 30 sec - exiting
02:29:39 (5496): No heartbeat from core client for 30 sec - exiting
02:29:40 (5496): No heartbeat from core client for 30 sec - exiting
02:29:42 (5496): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:31:52 (5428): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:32:09 (5428): No heartbeat from core client for 30 sec - exiting
02:32:10 (5428): No heartbeat from core client for 30 sec - exiting
02:32:11 (5428): No heartbeat from core client for 30 sec - exiting
02:32:12 (5428): No heartbeat from core client for 30 sec - exiting
02:32:13 (5428): No heartbeat from core client for 30 sec - exiting
02:32:15 (5428): No heartbeat from core client for 30 sec - exiting
02:32:16 (5428): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
CPDN Monitor - Quit request from BOINC...
20:27:07 (4224): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:27:40 (4224): No heartbeat from core client for 30 sec - exiting
20:27:41 (4224): No heartbeat from core client for 30 sec - exiting
20:27:43 (4224): No heartbeat from core client for 30 sec - exiting
20:27:44 (4224): No heartbeat from core client for 30 sec - exiting
20:27:45 (4224): No heartbeat from core client for 30 sec - exiting
20:27:46 (4224): No heartbeat from core client for 30 sec - exiting
20:27:47 (4224): No heartbeat from core client for 30 sec - exiting
20:27:48 (4224): No heartbeat from core client for 30 sec - exiting
20:27:49 (4224): No heartbeat from core client for 30 sec - exiting
20:27:50 (4224): No heartbeat from core client for 30 sec - exiting
20:27:51 (4224): No heartbeat from core client for 30 sec - exiting
20:32:50 (5124): No heartbeat from core client for 30 sec - exiting
20:32:51 (5124): No heartbeat from core client for 30 sec - exiting
20:32:52 (5124): No heartbeat from core client for 30 sec - exiting
20:32:53 (5124): No heartbeat from core client for 30 sec - exiting
20:32:54 (5124): No heartbeat from core client for 30 sec - exiting
20:32:55 (5124): No heartbeat from core client for 30 sec - exiting
20:32:56 (5124): No heartbeat from core client for 30 sec - exiting
20:32:57 (5124): No heartbeat from core client for 30 sec - exiting
20:32:58 (5124): No heartbeat from core client for 30 sec - exiting
20:32:59 (5124): No heartbeat from core client for 30 sec - exiting
20:33:01 (5124): No heartbeat from core client for 30 sec - exiting
20:33:02 (5124): No heartbeat from core client for 30 sec - exiting
20:33:03 (5124): No heartbeat from core client for 30 sec - exiting
20:33:04 (5124): No heartbeat from core client for 30 sec - exiting
20:33:05 (5124): No heartbeat from core client for 30 sec - exiting
20:33:06 (5124): No heartbeat from core client for 30 sec - exiting
20:33:07 (5124): No heartbeat from core client for 30 sec - exiting
20:33:08 (5124): No heartbeat from core client for 30 sec - exiting
20:33:09 (5124): No heartbeat from core client for 30 sec - exiting
20:33:10 (5124): No heartbeat from core client for 30 sec - exiting
20:33:11 (5124): No heartbeat from core client for 30 sec - exiting
20:33:13 (5124): No heartbeat from core client for 30 sec - exiting
20:33:14 (5124): No heartbeat from core client for 30 sec - exiting
20:33:15 (5124): No heartbeat from core client for 30 sec - exiting
20:33:16 (5124): No heartbeat from core client for 30 sec - exiting
20:33:17 (5124): No heartbeat from core client for 30 sec - exiting
20:33:18 (5124): No heartbeat from core client for 30 sec - exiting
20:33:19 (5124): No heartbeat from core client for 30 sec - exiting
20:33:20 (5124): No heartbeat from core client for 30 sec - exiting
20:33:21 (5124): No heartbeat from core client for 30 sec - exiting
20:33:22 (5124): No heartbeat from core client for 30 sec - exiting
20:33:23 (5124): No heartbeat from core client for 30 sec - exiting
20:33:25 (5124): No heartbeat from core client for 30 sec - exiting
20:33:26 (5124): No heartbeat from core client for 30 sec - exiting
20:33:27 (5124): No heartbeat from core client for 30 sec - exiting
20:33:28 (5124): No heartbeat from core client for 30 sec - exiting
20:33:29 (5124): No heartbeat from core client for 30 sec - exiting
20:33:30 (5124): No heartbeat from core client for 30 sec - exiting
20:33:31 (5124): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:35:55 (2372): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:37:39 (2232): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:38:41 (4376): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:38:42 (4376): No heartbeat from core client for 30 sec - exiting
20:38:43 (4376): No heartbeat from core client for 30 sec - exiting
20:38:45 (4376): No heartbeat from core client for 30 sec - exiting
20:39:57 (4276): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:39:58 (4276): No heartbeat from core client for 30 sec - exiting
20:39:59 (4276): No heartbeat from core client for 30 sec - exiting
20:40:00 (4276): No heartbeat from core client for 30 sec - exiting
20:41:08 (4848): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:41:09 (4848): No heartbeat from core client for 30 sec - exiting
20:41:10 (4848): No heartbeat from core client for 30 sec - exiting
20:41:11 (4848): No heartbeat from core client for 30 sec - exiting
20:42:19 (1088): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:43:31 (3052): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:43:32 (3052): No heartbeat from core client for 30 sec - exiting
20:43:33 (3052): No heartbeat from core client for 30 sec - exiting
20:43:34 (3052): No heartbeat from core client for 30 sec - exiting
21:30:38 (5344): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:59:49 (5712): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:15:39 (5588): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:53:25 (3216): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
02:03:38 (4044): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:26:29 (6420): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:30:46 (4440): No heartbeat from core client for 30 sec - exiting
05:30:47 (4440): No heartbeat from core client for 30 sec - exiting
05:30:48 (4440): No heartbeat from core client for 30 sec - exiting
05:30:49 (4440): No heartbeat from core client for 30 sec - exiting
05:30:50 (4440): No heartbeat from core client for 30 sec - exiting
05:30:52 (4440): No heartbeat from core client for 30 sec - exiting
05:30:53 (4440): No heartbeat from core client for 30 sec - exiting
05:30:54 (4440): No heartbeat from core client for 30 sec - exiting
05:30:55 (4440): No heartbeat from core client for 30 sec - exiting
05:30:56 (4440): No heartbeat from core client for 30 sec - exiting
05:30:57 (4440): No heartbeat from core client for 30 sec - exiting
05:30:58 (4440): No heartbeat from core client for 30 sec - exiting
05:30:59 (4440): No heartbeat from core client for 30 sec - exiting
05:31:00 (4440): No heartbeat from core client for 30 sec - exiting
05:31:01 (4440): No heartbeat from core client for 30 sec - exiting
05:31:02 (4440): No heartbeat from core client for 30 sec - exiting
05:31:04 (4440): No heartbeat from core client for 30 sec - exiting
05:31:05 (4440): No heartbeat from core client for 30 sec - exiting
05:31:06 (4440): No heartbeat from core client for 30 sec - exiting
05:31:07 (4440): No heartbeat from core client for 30 sec - exiting
05:31:08 (4440): No heartbeat from core client for 30 sec - exiting
05:31:09 (4440): No heartbeat from core client for 30 sec - exiting
05:31:10 (4440): No heartbeat from core client for 30 sec - exiting
05:31:11 (4440): No heartbeat from core client for 30 sec - exiting
05:31:12 (4440): No heartbeat from core client for 30 sec - exiting
05:31:13 (4440): No heartbeat from core client for 30 sec - exiting
05:31:15 (4440): No heartbeat from core client for 30 sec - exiting
05:31:16 (4440): No heartbeat from core client for 30 sec - exiting
05:31:17 (4440): No heartbeat from core client for 30 sec - exiting
05:31:18 (4440): No heartbeat from core client for 30 sec - exiting
05:31:19 (4440): No heartbeat from core client for 30 sec - exiting
05:31:20 (4440): No heartbeat from core client for 30 sec - exiting
05:31:21 (4440): No heartbeat from core client for 30 sec - exiting
05:31:22 (4440): No heartbeat from core client for 30 sec - exiting
05:31:23 (4440): No heartbeat from core client for 30 sec - exiting
05:31:24 (4440): No heartbeat from core client for 30 sec - exiting
05:31:25 (4440): No heartbeat from core client for 30 sec - exiting
05:31:27 (4440): No heartbeat from core client for 30 sec - exiting
05:31:28 (4440): No heartbeat from core client for 30 sec - exiting
05:31:29 (4440): No heartbeat from core client for 30 sec - exiting
05:31:30 (4440): No heartbeat from core client for 30 sec - exiting
05:31:31 (4440): No heartbeat from core client for 30 sec - exiting
05:31:32 (4440): No heartbeat from core client for 30 sec - exiting
05:31:33 (4440): No heartbeat from core client for 30 sec - exiting
05:31:34 (4440): No heartbeat from core client for 30 sec - exiting
05:31:35 (4440): No heartbeat from core client for 30 sec - exiting
05:31:36 (4440): No heartbeat from core client for 30 sec - exiting
05:31:37 (4440): No heartbeat from core client for 30 sec - exiting
05:31:39 (4440): No heartbeat from core client for 30 sec - exiting
05:31:40 (4440): No heartbeat from core client for 30 sec - exiting
05:31:41 (4440): No heartbeat from core client for 30 sec - exiting
05:31:42 (4440): No heartbeat from core client for 30 sec - exiting
05:31:43 (4440): No heartbeat from core client for 30 sec - exiting
05:31:44 (4440): No heartbeat from core client for 30 sec - exiting
05:31:45 (4440): No heartbeat from core client for 30 sec - exiting
05:31:46 (4440): No heartbeat from core client for 30 sec - exiting
05:31:47 (4440): No heartbeat from core client for 30 sec - exiting
05:32:21 (4440): No heartbeat from core client for 30 sec - exiting
05:32:22 (4440): No heartbeat from core client for 30 sec - exiting
05:32:23 (4440): No heartbeat from core client for 30 sec - exiting
05:32:24 (4440): No heartbeat from core client for 30 sec - exiting
05:32:26 (4440): No heartbeat from core client for 30 sec - exiting
05:32:27 (4440): No heartbeat from core client for 30 sec - exiting
05:32:28 (4440): No heartbeat from core client for 30 sec - exiting
05:32:29 (4440): No heartbeat from core client for 30 sec - exiting
05:32:30 (4440): No heartbeat from core client for 30 sec - exiting
05:32:31 (4440): No heartbeat from core client for 30 sec - exiting
05:32:32 (4440): No heartbeat from core client for 30 sec - exiting
05:32:33 (4440): No heartbeat from core client for 30 sec - exiting
05:32:34 (4440): No heartbeat from core client for 30 sec - exiting
05:32:35 (4440): No heartbeat from core client for 30 sec - exiting
05:32:36 (4440): No heartbeat from core client for 30 sec - exiting
05:32:38 (4440): No heartbeat from core client for 30 sec - exiting
05:32:39 (4440): No heartbeat from core client for 30 sec - exiting
05:32:40 (4440): No heartbeat from core client for 30 sec - exiting
05:32:41 (4440): No heartbeat from core client for 30 sec - exiting
05:32:42 (4440): No heartbeat from core client for 30 sec - exiting
05:32:43 (4440): No heartbeat from core client for 30 sec - exiting
05:32:44 (4440): No heartbeat from core client for 30 sec - exiting
05:32:45 (4440): No heartbeat from core client for 30 sec - exiting
05:32:46 (4440): No heartbeat from core client for 30 sec - exiting
05:32:47 (4440): No heartbeat from core client for 30 sec - exiting
05:32:48 (4440): No heartbeat from core client for 30 sec - exiting
05:32:50 (4440): No heartbeat from core client for 30 sec - exiting
05:32:51 (4440): No heartbeat from core client for 30 sec - exiting
05:32:52 (4440): No heartbeat from core client for 30 sec - exiting
05:32:53 (4440): No heartbeat from core client for 30 sec - exiting
05:32:54 (4440): No heartbeat from core client for 30 sec - exiting
05:32:55 (4440): No heartbeat from core client for 30 sec - exiting
05:32:56 (4440): No heartbeat from core client for 30 sec - exiting
05:32:57 (4440): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:58:42 (4428): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:04:38 (6536): No heartbeat from core client for 30 sec - exiting
02:04:39 (6536): No heartbeat from core client for 30 sec - exiting
02:04:40 (6536): No heartbeat from core client for 30 sec - exiting
02:04:41 (6536): No heartbeat from core client for 30 sec - exiting
02:04:42 (6536): No heartbeat from core client for 30 sec - exiting
02:04:43 (6536): No heartbeat from core client for 30 sec - exiting
02:04:45 (6536): No heartbeat from core client for 30 sec - exiting
02:04:46 (6536): No heartbeat from core client for 30 sec - exiting
02:04:47 (6536): No heartbeat from core client for 30 sec - exiting
02:04:48 (6536): No heartbeat from core client for 30 sec - exiting
02:04:49 (6536): No heartbeat from core client for 30 sec - exiting
02:04:50 (6536): No heartbeat from core client for 30 sec - exiting
02:04:51 (6536): No heartbeat from core client for 30 sec - exiting
02:04:56 (6536): No heartbeat from core client for 30 sec - exiting
02:04:57 (6536): No heartbeat from core client for 30 sec - exiting
02:04:58 (6536): No heartbeat from core client for 30 sec - exiting
02:04:59 (6536): No heartbeat from core client for 30 sec - exiting
02:05:05 (6536): No heartbeat from core client for 30 sec - exiting
02:05:06 (6536): No heartbeat from core client for 30 sec - exiting
02:05:07 (6536): No heartbeat from core client for 30 sec - exiting
02:05:08 (6536): No heartbeat from core client for 30 sec - exiting
02:05:13 (6536): No heartbeat from core client for 30 sec - exiting
02:05:14 (6536): No heartbeat from core client for 30 sec - exiting
02:05:15 (6536): No heartbeat from core client for 30 sec - exiting
02:05:16 (6536): No heartbeat from core client for 30 sec - exiting
02:05:21 (6536): No heartbeat from core client for 30 sec - exiting
02:05:23 (6536): No heartbeat from core client for 30 sec - exiting
02:05:24 (6536): No heartbeat from core client for 30 sec - exiting
02:05:25 (6536): No heartbeat from core client for 30 sec - exiting
02:05:26 (6536): No heartbeat from core client for 30 sec - exiting
02:05:27 (6536): No heartbeat from core client for 30 sec - exiting
02:05:28 (6536): No heartbeat from core client for 30 sec - exiting
02:05:29 (6536): No heartbeat from core client for 30 sec - exiting
02:05:34 (6536): No heartbeat from core client for 30 sec - exiting
02:05:35 (6536): No heartbeat from core client for 30 sec - exiting
02:05:36 (6536): No heartbeat from core client for 30 sec - exiting
02:05:37 (6536): No heartbeat from core client for 30 sec - exiting
02:05:38 (6536): No heartbeat from core client for 30 sec - exiting
02:05:40 (6536): No heartbeat from core client for 30 sec - exiting
02:05:41 (6536): No heartbeat from core client for 30 sec - exiting
02:05:42 (6536): No heartbeat from core client for 30 sec - exiting
02:05:47 (6536): No heartbeat from core client for 30 sec - exiting
02:05:48 (6536): No heartbeat from core client for 30 sec - exiting
02:05:49 (6536): No heartbeat from core client for 30 sec - exiting
02:05:50 (6536): No heartbeat from core client for 30 sec - exiting
02:05:51 (6536): No heartbeat from core client for 30 sec - exiting
02:05:52 (6536): No heartbeat from core client for 30 sec - exiting
02:05:53 (6536): No heartbeat from core client for 30 sec - exiting
02:05:54 (6536): No heartbeat from core client for 30 sec - exiting
02:05:59 (6536): No heartbeat from core client for 30 sec - exiting
02:06:00 (6536): No heartbeat from core client for 30 sec - exiting
02:06:02 (6536): No heartbeat from core client for 30 sec - exiting
02:06:03 (6536): No heartbeat from core client for 30 sec - exiting
02:06:04 (6536): No heartbeat from core client for 30 sec - exiting
02:06:05 (6536): No heartbeat from core client for 30 sec - exiting
02:06:06 (6536): No heartbeat from core client for 30 sec - exiting
02:06:07 (6536): No heartbeat from core client for 30 sec - exiting
02:06:08 (6536): No heartbeat from core client for 30 sec - exiting
02:06:09 (6536): No heartbeat from core client for 30 sec - exiting
02:06:10 (6536): No heartbeat from core client for 30 sec - exiting
02:06:11 (6536): No heartbeat from core client for 30 sec - exiting
02:06:16 (6536): No heartbeat from core client for 30 sec - exiting
02:06:17 (6536): No heartbeat from core client for 30 sec - exiting
02:06:53 (6536): No heartbeat from core client for 30 sec - exiting
02:06:54 (6536): No heartbeat from core client for 30 sec - exiting
02:06:58 (6536): No heartbeat from core client for 30 sec - exiting
02:06:59 (6536): No heartbeat from core client for 30 sec - exiting
02:07:00 (6536): No heartbeat from core client for 30 sec - exiting
02:07:01 (6536): No heartbeat from core client for 30 sec - exiting
02:07:02 (6536): No heartbeat from core client for 30 sec - exiting
02:07:03 (6536): No heartbeat from core client for 30 sec - exiting
02:07:04 (6536): No heartbeat from core client for 30 sec - exiting
02:07:05 (6536): No heartbeat from core client for 30 sec - exiting
02:07:10 (6536): No heartbeat from core client for 30 sec - exiting
02:07:14 (6536): No heartbeat from core client for 30 sec - exiting
02:07:15 (6536): No heartbeat from core client for 30 sec - exiting
02:07:16 (6536): No heartbeat from core client for 30 sec - exiting
02:07:18 (6536): No heartbeat from core client for 30 sec - exiting
02:07:19 (6536): No heartbeat from core client for 30 sec - exiting
02:07:20 (6536): No heartbeat from core client for 30 sec - exiting
02:07:21 (6536): No heartbeat from core client for 30 sec - exiting
02:07:22 (6536): No heartbeat from core client for 30 sec - exiting
02:07:27 (6536): No heartbeat from core client for 30 sec - exiting
02:07:28 (6536): No heartbeat from core client for 30 sec - exiting
02:07:29 (6536): No heartbeat from core client for 30 sec - exiting
02:07:30 (6536): No heartbeat from core client for 30 sec - exiting
02:07:31 (6536): No heartbeat from core client for 30 sec - exiting
02:07:32 (6536): No heartbeat from core client for 30 sec - exiting
02:07:33 (6536): No heartbeat from core client for 30 sec - exiting
02:07:34 (6536): No heartbeat from core client for 30 sec - exiting
02:07:35 (6536): No heartbeat from core client for 30 sec - exiting
02:07:36 (6536): No heartbeat from core client for 30 sec - exiting
02:07:38 (6536): No heartbeat from core client for 30 sec - exiting
02:07:39 (6536): No heartbeat from core client for 30 sec - exiting
02:07:40 (6536): No heartbeat from core client for 30 sec - exiting
02:07:41 (6536): No heartbeat from core client for 30 sec - exiting
02:07:42 (6536): No heartbeat from core client for 30 sec - exiting
02:07:43 (6536): No heartbeat from core client for 30 sec - exiting
02:07:44 (6536): No heartbeat from core client for 30 sec - exiting
02:07:45 (6536): No heartbeat from core client for 30 sec - exiting
02:07:46 (6536): No heartbeat from core client for 30 sec - exiting
02:07:47 (6536): No heartbeat from core client for 30 sec - exiting
02:07:48 (6536): No heartbeat from core client for 30 sec - exiting
02:07:50 (6536): No heartbeat from core client for 30 sec - exiting
02:07:51 (6536): No heartbeat from core client for 30 sec - exiting
02:07:52 (6536): No heartbeat from core client for 30 sec - exiting
02:07:53 (6536): No heartbeat from core client for 30 sec - exiting
02:07:54 (6536): No heartbeat from core client for 30 sec - exiting
02:07:55 (6536): No heartbeat from core client for 30 sec - exiting
02:07:56 (6536): No heartbeat from core client for 30 sec - exiting
02:07:57 (6536): No heartbeat from core client for 30 sec - exiting
02:07:58 (6536): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:11:33 (4424): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:11:42 (4424): No heartbeat from core client for 30 sec - exiting
02:11:43 (4424): No heartbeat from core client for 30 sec - exiting
02:11:44 (4424): No heartbeat from core client for 30 sec - exiting
02:11:45 (4424): No heartbeat from core client for 30 sec - exiting
02:11:47 (4424): No heartbeat from core client for 30 sec - exiting
02:11:48 (4424): No heartbeat from core client for 30 sec - exiting
02:11:49 (4424): No heartbeat from core client for 30 sec - exiting
02:11:50 (4424): No heartbeat from core client for 30 sec - exiting
02:11:51 (4424): No heartbeat from core client for 30 sec - exiting
02:11:52 (4424): No heartbeat from core client for 30 sec - exiting
02:12:45 (1152): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:13:11 (1152): No heartbeat from core client for 30 sec - exiting
02:13:12 (1152): No heartbeat from core client for 30 sec - exiting
02:13:13 (1152): No heartbeat from core client for 30 sec - exiting
02:15:06 (4376): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Ocean Restart file copy failed on u10kko.dak0c20
19:43:02 (4992): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:38:45 (4352): No heartbeat from core client for 30 sec - exiting
21:38:47 (4352): No heartbeat from core client for 30 sec - exiting
21:38:48 (4352): No heartbeat from core client for 30 sec - exiting
21:38:49 (4352): No heartbeat from core client for 30 sec - exiting
21:38:50 (4352): No heartbeat from core client for 30 sec - exiting
21:38:51 (4352): No heartbeat from core client for 30 sec - exiting
21:38:52 (4352): No heartbeat from core client for 30 sec - exiting
21:38:53 (4352): No heartbeat from core client for 30 sec - exiting
21:38:54 (4352): No heartbeat from core client for 30 sec - exiting
21:38:55 (4352): No heartbeat from core client for 30 sec - exiting
21:38:56 (4352): No heartbeat from core client for 30 sec - exiting
21:38:58 (4352): No heartbeat from core client for 30 sec - exiting
21:38:59 (4352): No heartbeat from core client for 30 sec - exiting
21:39:00 (4352): No heartbeat from core client for 30 sec - exiting
21:39:01 (4352): No heartbeat from core client for 30 sec - exiting
21:39:02 (4352): No heartbeat from core client for 30 sec - exiting
21:39:03 (4352): No heartbeat from core client for 30 sec - exiting
21:39:04 (4352): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4380, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4380, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4380, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4380, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4380, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4380, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
25 Jan 2012 05:53:04 1122757 13806942 hadcm3n_u10k_1980_40_007617217_1 544,320 2,259,800 4.1516
23 Jan 2012 19:18:21 1122757 13806942 hadcm3n_u10k_1980_40_007617217_1 518,400 2,139,136 4.1264
22 Jan 2012 04:10:18 1122757 13806942 hadcm3n_u10k_1980_40_007617217_1 492,480 2,006,664 4.0746
20 Jan 2012 09:34:59 1122757 13806942 hadcm3n_u10k_1980_40_007617217_1 466,560 1,855,929 3.9779
18 Jan 2012 22:19:16 1122757 13806942 hadcm3n_u10k_1980_40_007617217_1 440,640 1,731,027 3.9284
17 Jan 2012 17:10:25 1122757 13806942 hadcm3n_u10k_1980_40_007617217_1 414,720 1,628,144 3.9259
16 Jan 2012 10:50:10 1122757 13806942 hadcm3n_u10k_1980_40_007617217_1 388,800 1,520,681 3.9112
15 Jan 2012 00:08:38 1122757 13806942 hadcm3n_u10k_1980_40_007617217_1 362,880 1,401,400 3.8619
13 Jan 2012 18:25:18 1122757 13806942 hadcm3n_u10k_1980_40_007617217_1 336,960 1,296,714 3.8483
12 Jan 2012 11:49:03 1122757 13806942 hadcm3n_u10k_1980_40_007617217_1 311,040 1,189,944 3.8257
11 Jan 2012 03:27:44 1122757 13806942 hadcm3n_u10k_1980_40_007617217_1 285,120 1,081,686 3.7938
09 Jan 2012 18:37:48 1122757 13806942 hadcm3n_u10k_1980_40_007617217_1 259,200 969,843 3.7417
08 Jan 2012 08:59:55 1122757 13806942 hadcm3n_u10k_1980_40_007617217_1 233,280 854,080 3.6612
06 Jan 2012 21:29:38 1122757 13806942 hadcm3n_u10k_1980_40_007617217_1 207,360 743,839 3.5872
05 Jan 2012 13:05:36 1122757 13806942 hadcm3n_u10k_1980_40_007617217_1 181,440 632,189 3.4843
04 Jan 2012 06:05:32 1122757 13806942 hadcm3n_u10k_1980_40_007617217_1 155,520 523,740 3.3677
03 Jan 2012 00:29:11 1122757 13806942 hadcm3n_u10k_1980_40_007617217_1 129,600 416,015 3.2100
01 Jan 2012 22:57:27 1122757 13806942 hadcm3n_u10k_1980_40_007617217_1 103,680 330,281 3.1856
31 Dec 2011 21:44:44 1122757 13806942 hadcm3n_u10k_1980_40_007617217_1 77,760 244,288 3.1416
30 Dec 2011 23:13:44 1122757 13806942 hadcm3n_u10k_1980_40_007617217_1 51,840 163,730 3.1584


©2024 cpdn.org