climateprediction.net home page
Task 15657568

Task 15657568

Name hadcm3n_z95a_1960_40_008326707_0
Workunit 8477842
Created 11 Mar 2013, 6:22:51 UTC
Sent 11 Mar 2013, 6:24:50 UTC
Report deadline 10 Jun 2013, 13:52:01 UTC
Received 29 Mar 2013, 19:53:24 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1271154
Run time 12 days 1 hours 33 min 57 sec
CPU time 11 days 5 hours 40 min 57 sec
Validate state Invalid
Credit 5,598.72
Device peak FLOPS 3.30 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
16:58:19 (4136): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
16:58:20 (4136): No heartbeat from core client for 30 sec - exiting
16:58:21 (4136): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
17:24:17 (868): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
16:35:26 (2928): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
16:35:27 (2928): No heartbeat from core client for 30 sec - exiting
16:35:28 (2928): No heartbeat from core client for 30 sec - exiting
16:35:29 (2928): No heartbeat from core client for 30 sec - exiting
16:35:30 (2928): No heartbeat from core client for 30 sec - exiting
16:35:31 (2928): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
03:42:34 (7760): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5560, iMonCtr=1
Model crash detected, will try to restart...
07:38:56 (3028): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
10:17:59 (2060): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
21:35:58 (3312): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:36:03 (3312): No heartbeat from core client for 30 sec - exiting
21:36:04 (3312): No heartbeat from core client for 30 sec - exiting
21:36:05 (3312): No heartbeat from core client for 30 sec - exiting
21:36:06 (3312): No heartbeat from core client for 30 sec - exiting
21:37:15 (5888): No heartbeat from core client for 30 sec - exiting
21:37:17 (5888): No heartbeat from core client for 30 sec - exiting
21:37:18 (5888): No heartbeat from core client for 30 sec - exiting
21:37:20 (5888): No heartbeat from core client for 30 sec - exiting
21:37:21 (5888): No heartbeat from core client for 30 sec - exiting
21:37:22 (5888): No heartbeat from core client for 30 sec - exiting
21:37:24 (5888): No heartbeat from core client for 30 sec - exiting
21:37:27 (5888): No heartbeat from core client for 30 sec - exiting
21:37:30 (5888): No heartbeat from core client for 30 sec - exiting
21:37:31 (5888): No heartbeat from core client for 30 sec - exiting
21:37:34 (5888): No heartbeat from core client for 30 sec - exiting
21:37:35 (5888): No heartbeat from core client for 30 sec - exiting
21:37:37 (5888): No heartbeat from core client for 30 sec - exiting
21:37:39 (5888): No heartbeat from core client for 30 sec - exiting
21:37:40 (5888): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:37:41 (5888): No heartbeat from core client for 30 sec - exiting
21:54:32 (6456): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
23:09:23 (8012): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
21:00:45 (6052): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:00:46 (6052): No heartbeat from core client for 30 sec - exiting
21:00:47 (6052): No heartbeat from core client for 30 sec - exiting
21:00:48 (6052): No heartbeat from core client for 30 sec - exiting
21:00:49 (6052): No heartbeat from core client for 30 sec - exiting
21:00:51 (6052): No heartbeat from core client for 30 sec - exiting
21:00:52 (6052): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
09:17:55 (1240): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:02:09 (4772): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Called boinc_finish
15:01:30 (4636): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:22:15 (3108): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:22:16 (3108): No heartbeat from core client for 30 sec - exiting
18:22:17 (3108): No heartbeat from core client for 30 sec - exiting
18:22:18 (3108): No heartbeat from core client for 30 sec - exiting
18:22:19 (3108): No heartbeat from core client for 30 sec - exiting
18:22:20 (3108): No heartbeat from core client for 30 sec - exiting
18:22:21 (3108): No heartbeat from core client for 30 sec - exiting
18:22:22 (3108): No heartbeat from core client for 30 sec - exiting
18:22:23 (3108): No heartbeat from core client for 30 sec - exiting
18:22:24 (3108): No heartbeat from core client for 30 sec - exiting
18:22:25 (3108): No heartbeat from core client for 30 sec - exiting
18:33:25 (4756): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:33:26 (4756): No heartbeat from core client for 30 sec - exiting
18:33:27 (4756): No heartbeat from core client for 30 sec - exiting
18:33:28 (4756): No heartbeat from core client for 30 sec - exiting
18:33:29 (4756): No heartbeat from core client for 30 sec - exiting
18:33:30 (4756): No heartbeat from core client for 30 sec - exiting
18:33:31 (4756): No heartbeat from core client for 30 sec - exiting
18:33:32 (4756): No heartbeat from core client for 30 sec - exiting
18:33:33 (4756): No heartbeat from core client for 30 sec - exiting
18:33:34 (4756): No heartbeat from core client for 30 sec - exiting
18:33:35 (4756): No heartbeat from core client for 30 sec - exiting
18:58:11 (5488): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:04:59 (2288): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:05:01 (2288): No heartbeat from core client for 30 sec - exiting
19:18:56 (3212): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:18:58 (3212): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
11:45:55 (1704): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:49:01 (1688): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:49:02 (1688): No heartbeat from core client for 30 sec - exiting
11:49:03 (1688): No heartbeat from core client for 30 sec - exiting
11:49:04 (1688): No heartbeat from core client for 30 sec - exiting
11:49:05 (1688): No heartbeat from core client for 30 sec - exiting
11:51:24 (5548): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:51:27 (5548): No heartbeat from core client for 30 sec - exiting
11:52:19 (5772): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:59:17 (8124): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:04:04 (2648): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
20:58:44 (3756): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
20:58:45 (3756): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
21:27:50 (1104): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
21:27:54 (1104): No heartbeat from core client for 30 sec - exiting
22:12:56 (8632): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
19:11:57 (6864): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
11:44:01 (5888): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
12:32:35 (6900): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
15:29:22 (5436): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:55:49 (5148): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
16:24:03 (1644): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:24:05 (1644): No heartbeat from core client for 30 sec - exiting
16:24:06 (1644): No heartbeat from core client for 30 sec - exiting
16:24:07 (1644): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
21:36:38 (5104): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:36:39 (5104): No heartbeat from core client for 30 sec - exiting
21:36:40 (5104): No heartbeat from core client for 30 sec - exiting
21:36:41 (5104): No heartbeat from core client for 30 sec - exiting
21:36:42 (5104): No heartbeat from core client for 30 sec - exiting
21:36:43 (5104): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
13:21:04 (6996): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:21:05 (6996): No heartbeat from core client for 30 sec - exiting
13:21:06 (6996): No heartbeat from core client for 30 sec - exiting
13:21:07 (6996): No heartbeat from core client for 30 sec - exiting
13:21:08 (6996): No heartbeat from core client for 30 sec - exiting
13:21:09 (6996): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
11:40:34 (1788): No heartbeat from core client for 30 sec - exiting
11:40:35 (1788): No heartbeat from core client for 30 sec - exiting
11:40:36 (1788): No heartbeat from core client for 30 sec - exiting
11:40:37 (1788): No heartbeat from core client for 30 sec - exiting
11:40:38 (1788): No heartbeat from core client for 30 sec - exiting
11:40:39 (1788): No heartbeat from core client for 30 sec - exiting
11:40:40 (1788): No heartbeat from core client for 30 sec - exiting
11:40:41 (1788): No heartbeat from core client for 30 sec - exiting
11:40:42 (1788): No heartbeat from core client for 30 sec - exiting
11:40:43 (1788): No heartbeat from core client for 30 sec - exiting
11:40:44 (1788): No heartbeat from core client for 30 sec - exiting
11:40:45 (1788): No heartbeat from core client for 30 sec - exiting
11:40:46 (1788): No heartbeat from core client for 30 sec - exiting
11:40:47 (1788): No heartbeat from core client for 30 sec - exiting
11:40:48 (1788): No heartbeat from core client for 30 sec - exiting
11:40:49 (1788): No heartbeat from core client for 30 sec - exiting
11:40:50 (1788): No heartbeat from core client for 30 sec - exiting
11:40:51 (1788): No heartbeat from core client for 30 sec - exiting
11:40:52 (1788): No heartbeat from core client for 30 sec - exiting
11:40:53 (1788): No heartbeat from core client for 30 sec - exiting
11:40:54 (1788): No heartbeat from core client for 30 sec - exiting
11:40:55 (1788): No heartbeat from core client for 30 sec - exiting
11:40:56 (1788): No heartbeat from core client for 30 sec - exiting
11:40:57 (1788): No heartbeat from core client for 30 sec - exiting
11:40:58 (1788): No heartbeat from core client for 30 sec - exiting
11:40:59 (1788): No heartbeat from core client for 30 sec - exiting
11:41:00 (1788): No heartbeat from core client for 30 sec - exiting
11:41:01 (1788): No heartbeat from core client for 30 sec - exiting
11:41:02 (1788): No heartbeat from core client for 30 sec - exiting
11:41:03 (1788): No heartbeat from core client for 30 sec - exiting
11:41:04 (1788): No heartbeat from core client for 30 sec - exiting
11:41:05 (1788): No heartbeat from core client for 30 sec - exiting
11:41:06 (1788): No heartbeat from core client for 30 sec - exiting
11:41:07 (1788): No heartbeat from core client for 30 sec - exiting
11:41:08 (1788): No heartbeat from core client for 30 sec - exiting
11:41:09 (1788): No heartbeat from core client for 30 sec - exiting
11:41:10 (1788): No heartbeat from core client for 30 sec - exiting
11:41:11 (1788): No heartbeat from core client for 30 sec - exiting
11:41:12 (1788): No heartbeat from core client for 30 sec - exiting
11:41:13 (1788): No heartbeat from core client for 30 sec - exiting
11:41:14 (1788): No heartbeat from core client for 30 sec - exiting
11:41:15 (1788): No heartbeat from core client for 30 sec - exiting
11:41:16 (1788): No heartbeat from core client for 30 sec - exiting
11:41:17 (1788): No heartbeat from core client for 30 sec - exiting
11:41:18 (1788): No heartbeat from core client for 30 sec - exiting
11:41:19 (1788): No heartbeat from core client for 30 sec - exiting
11:41:20 (1788): No heartbeat from core client for 30 sec - exiting
11:41:21 (1788): No heartbeat from core client for 30 sec - exiting
11:41:22 (1788): No heartbeat from core client for 30 sec - exiting
11:41:23 (1788): No heartbeat from core client for 30 sec - exiting
11:41:24 (1788): No heartbeat from core client for 30 sec - exiting
11:41:25 (1788): No heartbeat from core client for 30 sec - exiting
11:41:26 (1788): No heartbeat from core client for 30 sec - exiting
11:41:27 (1788): No heartbeat from core client for 30 sec - exiting
11:41:28 (1788): No heartbeat from core client for 30 sec - exiting
11:41:29 (1788): No heartbeat from core client for 30 sec - exiting
11:41:30 (1788): No heartbeat from core client for 30 sec - exiting
11:41:31 (1788): No heartbeat from core client for 30 sec - exiting
11:41:32 (1788): No heartbeat from core client for 30 sec - exiting
11:41:33 (1788): No heartbeat from core client for 30 sec - exiting
11:41:34 (1788): No heartbeat from core client for 30 sec - exiting
11:41:35 (1788): No heartbeat from core client for 30 sec - exiting
11:41:36 (1788): No heartbeat from core client for 30 sec - exiting
11:41:37 (1788): No heartbeat from core client for 30 sec - exiting
11:41:38 (1788): No heartbeat from core client for 30 sec - exiting
11:41:39 (1788): No heartbeat from core client for 30 sec - exiting
11:41:40 (1788): No heartbeat from core client for 30 sec - exiting
11:41:41 (1788): No heartbeat from core client for 30 sec - exiting
11:41:42 (1788): No heartbeat from core client for 30 sec - exiting
11:41:43 (1788): No heartbeat from core client for 30 sec - exiting
11:41:44 (1788): No heartbeat from core client for 30 sec - exiting
11:41:45 (1788): No heartbeat from core client for 30 sec - exiting
11:41:46 (1788): No heartbeat from core client for 30 sec - exiting
11:41:47 (1788): No heartbeat from core client for 30 sec - exiting
11:41:48 (1788): No heartbeat from core client for 30 sec - exiting
11:41:49 (1788): No heartbeat from core client for 30 sec - exiting
11:41:50 (1788): No heartbeat from core client for 30 sec - exiting
11:41:51 (1788): No heartbeat from core client for 30 sec - exiting
11:41:52 (1788): No heartbeat from core client for 30 sec - exiting
11:41:53 (1788): No heartbeat from core client for 30 sec - exiting
11:41:54 (1788): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:41:55 (1788): No heartbeat from core client for 30 sec - exiting
11:41:56 (1788): No heartbeat from core client for 30 sec - exiting
11:41:57 (1788): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
12:52:44 (904): No heartbeat from core client for 30 sec - exiting
12:52:45 (904): No heartbeat from core client for 30 sec - exiting
12:52:46 (904): No heartbeat from core client for 30 sec - exiting
12:52:47 (904): No heartbeat from core client for 30 sec - exiting
12:52:48 (904): No heartbeat from core client for 30 sec - exiting
12:52:49 (904): No heartbeat from core client for 30 sec - exiting
12:52:50 (904): No heartbeat from core client for 30 sec - exiting
12:52:51 (904): No heartbeat from core client for 30 sec - exiting
12:52:52 (904): No heartbeat from core client for 30 sec - exiting
12:52:53 (904): No heartbeat from core client for 30 sec - exiting
12:52:54 (904): No heartbeat from core client for 30 sec - exiting
12:52:55 (904): No heartbeat from core client for 30 sec - exiting
12:52:56 (904): No heartbeat from core client for 30 sec - exiting
12:52:57 (904): No heartbeat from core client for 30 sec - exiting
12:52:58 (904): No heartbeat from core client for 30 sec - exiting
12:52:59 (904): No heartbeat from core client for 30 sec - exiting
12:53:00 (904): No heartbeat from core client for 30 sec - exiting
12:53:01 (904): No heartbeat from core client for 30 sec - exiting
12:53:02 (904): No heartbeat from core client for 30 sec - exiting
12:53:03 (904): No heartbeat from core client for 30 sec - exiting
12:53:04 (904): No heartbeat from core client for 30 sec - exiting
12:53:05 (904): No heartbeat from core client for 30 sec - exiting
12:53:06 (904): No heartbeat from core client for 30 sec - exiting
12:53:07 (904): No heartbeat from core client for 30 sec - exiting
12:53:08 (904): No heartbeat from core client for 30 sec - exiting
12:53:09 (904): No heartbeat from core client for 30 sec - exiting
12:53:10 (904): No heartbeat from core client for 30 sec - exiting
12:53:11 (904): No heartbeat from core client for 30 sec - exiting
12:53:12 (904): No heartbeat from core client for 30 sec - exiting
12:53:13 (904): No heartbeat from core client for 30 sec - exiting
12:53:14 (904): No heartbeat from core client for 30 sec - exiting
12:53:15 (904): No heartbeat from core client for 30 sec - exiting
12:53:16 (904): No heartbeat from core client for 30 sec - exiting
12:53:17 (904): No heartbeat from core client for 30 sec - exiting
12:53:18 (904): No heartbeat from core client for 30 sec - exiting
12:53:19 (904): No heartbeat from core client for 30 sec - exiting
12:53:20 (904): No heartbeat from core client for 30 sec - exiting
12:53:21 (904): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:17:12 (3560): No heartbeat from core client for 30 sec - exiting
13:17:13 (3560): No heartbeat from core client for 30 sec - exiting
13:17:14 (3560): No heartbeat from core client for 30 sec - exiting
13:17:15 (3560): No heartbeat from core client for 30 sec - exiting
13:17:16 (3560): No heartbeat from core client for 30 sec - exiting
13:17:17 (3560): No heartbeat from core client for 30 sec - exiting
13:17:18 (3560): No heartbeat from core client for 30 sec - exiting
13:17:19 (3560): No heartbeat from core client for 30 sec - exiting
13:17:20 (3560): No heartbeat from core client for 30 sec - exiting
13:17:21 (3560): No heartbeat from core client for 30 sec - exiting
13:17:22 (3560): No heartbeat from core client for 30 sec - exiting
13:17:23 (3560): No heartbeat from core client for 30 sec - exiting
13:17:24 (3560): No heartbeat from core client for 30 sec - exiting
13:17:25 (3560): No heartbeat from core client for 30 sec - exiting
13:17:26 (3560): No heartbeat from core client for 30 sec - exiting
13:17:27 (3560): No heartbeat from core client for 30 sec - exiting
13:17:28 (3560): No heartbeat from core client for 30 sec - exiting
13:17:29 (3560): No heartbeat from core client for 30 sec - exiting
13:17:30 (3560): No heartbeat from core client for 30 sec - exiting
13:17:31 (3560): No heartbeat from core client for 30 sec - exiting
13:17:32 (3560): No heartbeat from core client for 30 sec - exiting
13:17:33 (3560): No heartbeat from core client for 30 sec - exiting
13:17:34 (3560): No heartbeat from core client for 30 sec - exiting
13:17:35 (3560): No heartbeat from core client for 30 sec - exiting
13:17:36 (3560): No heartbeat from core client for 30 sec - exiting
13:17:37 (3560): No heartbeat from core client for 30 sec - exiting
13:17:38 (3560): No heartbeat from core client for 30 sec - exiting
13:17:39 (3560): No heartbeat from core client for 30 sec - exiting
13:17:40 (3560): No heartbeat from core client for 30 sec - exiting
13:17:41 (3560): No heartbeat from core client for 30 sec - exiting
13:17:42 (3560): No heartbeat from core client for 30 sec - exiting
13:17:43 (3560): No heartbeat from core client for 30 sec - exiting
13:17:44 (3560): No heartbeat from core client for 30 sec - exiting
13:17:45 (3560): No heartbeat from core client for 30 sec - exiting
13:17:46 (3560): No heartbeat from core client for 30 sec - exiting
13:17:47 (3560): No heartbeat from core client for 30 sec - exiting
13:17:48 (3560): No heartbeat from core client for 30 sec - exiting
13:17:49 (3560): No heartbeat from core client for 30 sec - exiting
13:17:50 (3560): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
BUFFIN: C I/O Error feof - Unit 41 - Return code = 16

Model crashed: READDUMP: BAD BUFFIN OF DATA                                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 41 - Return code = 16

Model crashed: READDUMP: BAD BUFFIN OF DATA                                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 41 - Return code = 16

Model crashed: READDUMP: BAD BUFFIN OF DATA                                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 41 - Return code = 16

Model crashed: READDUMP: BAD BUFFIN OF DATA                                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 41 - Return code = 16

Model crashed: READDUMP: BAD BUFFIN OF DATA                                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 41 - Return code = 16

Model crashed: READDUMP: BAD BUFFIN OF DATA                                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
20 Mar 2013 08:42:01 1271154 15657568 hadcm3n_z95a_1960_40_008326707_0 466,560 487,547 1.0450
19 Mar 2013 23:59:53 1271154 15657568 hadcm3n_z95a_1960_40_008326707_0 440,640 460,422 1.0449
19 Mar 2013 11:49:48 1271154 15657568 hadcm3n_z95a_1960_40_008326707_0 414,720 432,323 1.0424
18 Mar 2013 23:01:35 1271154 15657568 hadcm3n_z95a_1960_40_008326707_0 388,800 403,502 1.0378
18 Mar 2013 10:04:03 1271154 15657568 hadcm3n_z95a_1960_40_008326707_0 362,880 374,928 1.0332
18 Mar 2013 01:36:49 1271154 15657568 hadcm3n_z95a_1960_40_008326707_0 336,960 346,574 1.0285
17 Mar 2013 09:34:12 1271154 15657568 hadcm3n_z95a_1960_40_008326707_0 311,040 317,566 1.0210
17 Mar 2013 08:18:49 1271154 15657568 hadcm3n_z95a_1960_40_008326707_0 285,120 298,594 1.0473
16 Mar 2013 13:50:17 1271154 15657568 hadcm3n_z95a_1960_40_008326707_0 259,200 273,174 1.0539
16 Mar 2013 06:27:27 1271154 15657568 hadcm3n_z95a_1960_40_008326707_0 233,280 245,784 1.0536
15 Mar 2013 18:47:46 1271154 15657568 hadcm3n_z95a_1960_40_008326707_0 207,360 217,997 1.0513
15 Mar 2013 07:48:14 1271154 15657568 hadcm3n_z95a_1960_40_008326707_0 181,440 191,631 1.0562
14 Mar 2013 21:14:18 1271154 15657568 hadcm3n_z95a_1960_40_008326707_0 155,520 164,478 1.0576
14 Mar 2013 12:20:49 1271154 15657568 hadcm3n_z95a_1960_40_008326707_0 129,600 135,571 1.0461
14 Mar 2013 02:33:01 1271154 15657568 hadcm3n_z95a_1960_40_008326707_0 103,680 107,853 1.0402
13 Mar 2013 07:34:35 1271154 15657568 hadcm3n_z95a_1960_40_008326707_0 77,760 80,989 1.0415
12 Mar 2013 13:50:14 1271154 15657568 hadcm3n_z95a_1960_40_008326707_0 51,840 53,440 1.0309
12 Mar 2013 03:14:57 1271154 15657568 hadcm3n_z95a_1960_40_008326707_0 25,920 26,775 1.0330


©2024 climateprediction.net