climateprediction.net home page
Task 15597792

Task 15597792

Name hadcm3n_47yc_1940_40_008310480_0
Workunit 8461615
Created 8 Feb 2013, 1:01:49 UTC
Sent 9 Feb 2013, 3:30:16 UTC
Report deadline 11 May 2013, 10:57:27 UTC
Received 8 Mar 2013, 10:40:11 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1235408
Run time 13 days 18 hours 7 min 30 sec
CPU time 12 days 1 hours 12 min 19 sec
Validate state Invalid
Credit 10,264.32
Device peak FLOPS 3.43 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
11:07:17 (3836): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
14:06:25 (3538): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
12:15:23 (10247): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:15:26 (10247): No heartbeat from core client for 30 sec - exiting
12:15:27 (10247): No heartbeat from core client for 30 sec - exiting
12:15:28 (10247): No heartbeat from core client for 30 sec - exiting
12:15:29 (10247): No heartbeat from core client for 30 sec - exiting
12:15:30 (10247): No heartbeat from core client for 30 sec - exiting
12:15:31 (10247): No heartbeat from core client for 30 sec - exiting
12:15:32 (10247): No heartbeat from core client for 30 sec - exiting
12:15:33 (10247): No heartbeat from core client for 30 sec - exiting
12:16:39 (10268): No heartbeat from core client for 30 sec - exiting
12:16:48 (10268): No heartbeat from core client for 30 sec - exiting
12:16:49 (10268): No heartbeat from core client for 30 sec - exiting
12:16:50 (10268): No heartbeat from core client for 30 sec - exiting
12:16:51 (10268): No heartbeat from core client for 30 sec - exiting
12:16:52 (10268): No heartbeat from core client for 30 sec - exiting
12:16:53 (10268): No heartbeat from core client for 30 sec - exiting
12:16:54 (10268): No heartbeat from core client for 30 sec - exiting
12:16:55 (10268): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:18:02 (10283): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
11:06:16 (3992): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:08:50 (9067): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:23:05 (9139): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:45:54 (10109): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:37:54 (10632): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:39:04 (12220): No heartbeat from core client for 30 sec - exiting
15:39:05 (12220): No heartbeat from core client for 30 sec - exiting
15:39:06 (12220): No heartbeat from core client for 30 sec - exiting
15:39:08 (12220): No heartbeat from core client for 30 sec - exiting
15:39:09 (12220): No heartbeat from core client for 30 sec - exiting
15:39:10 (12220): No heartbeat from core client for 30 sec - exiting
15:39:11 (12220): No heartbeat from core client for 30 sec - exiting
15:39:12 (12220): No heartbeat from core client for 30 sec - exiting
15:39:13 (12220): No heartbeat from core client for 30 sec - exiting
15:39:14 (12220): No heartbeat from core client for 30 sec - exiting
15:39:15 (12220): No heartbeat from core client for 30 sec - exiting
15:39:16 (12220): No heartbeat from core client for 30 sec - exiting
15:39:17 (12220): No heartbeat from core client for 30 sec - exiting
15:39:18 (12220): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
11:20:13 (12236): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
09:09:58 (23115): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
07:44:17 (6647): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:44:20 (6647): No heartbeat from core client for 30 sec - exiting
07:44:21 (6647): No heartbeat from core client for 30 sec - exiting
07:44:22 (6647): No heartbeat from core client for 30 sec - exiting
07:44:23 (6647): No heartbeat from core client for 30 sec - exiting
07:44:24 (6647): No heartbeat from core client for 30 sec - exiting
07:44:25 (6647): No heartbeat from core client for 30 sec - exiting
07:44:37 (6647): No heartbeat from core client for 30 sec - exiting
07:44:38 (6647): No heartbeat from core client for 30 sec - exiting
07:44:39 (6647): No heartbeat from core client for 30 sec - exiting
07:44:40 (6647): No heartbeat from core client for 30 sec - exiting
07:44:41 (6647): No heartbeat from core client for 30 sec - exiting
07:44:42 (6647): No heartbeat from core client for 30 sec - exiting
07:44:43 (6647): No heartbeat from core client for 30 sec - exiting
07:44:44 (6647): No heartbeat from core client for 30 sec - exiting
07:44:45 (6647): No heartbeat from core client for 30 sec - exiting
07:44:46 (6647): No heartbeat from core client for 30 sec - exiting
07:44:47 (6647): No heartbeat from core client for 30 sec - exiting
07:44:48 (6647): No heartbeat from core client for 30 sec - exiting
07:44:49 (6647): No heartbeat from core client for 30 sec - exiting
07:44:50 (6647): No heartbeat from core client for 30 sec - exiting
07:44:51 (6647): No heartbeat from core client for 30 sec - exiting
07:44:52 (6647): No heartbeat from core client for 30 sec - exiting
07:44:53 (6647): No heartbeat from core client for 30 sec - exiting
07:44:54 (6647): No heartbeat from core client for 30 sec - exiting
07:46:35 (7685): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:47:16 (7696): No heartbeat from core client for 30 sec - exiting
07:47:23 (7696): No heartbeat from core client for 30 sec - exiting
07:47:24 (7696): No heartbeat from core client for 30 sec - exiting
07:47:25 (7696): No heartbeat from core client for 30 sec - exiting
07:47:26 (7696): No heartbeat from core client for 30 sec - exiting
07:47:27 (7696): No heartbeat from core client for 30 sec - exiting
07:47:28 (7696): No heartbeat from core client for 30 sec - exiting
07:47:29 (7696): No heartbeat from core client for 30 sec - exiting
07:47:30 (7696): No heartbeat from core client for 30 sec - exiting
07:47:31 (7696): No heartbeat from core client for 30 sec - exiting
07:47:32 (7696): No heartbeat from core client for 30 sec - exiting
07:47:33 (7696): No heartbeat from core client for 30 sec - exiting
07:47:34 (7696): No heartbeat from core client for 30 sec - exiting
07:47:35 (7696): No heartbeat from core client for 30 sec - exiting
07:47:36 (7696): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:47:37 (7696): No heartbeat from core client for 30 sec - exiting
07:47:38 (7696): No heartbeat from core client for 30 sec - exiting
07:49:11 (7712): No heartbeat from core client for 30 sec - exiting
07:49:27 (7712): No heartbeat from core client for 30 sec - exiting
07:49:28 (7712): No heartbeat from core client for 30 sec - exiting
07:49:29 (7712): No heartbeat from core client for 30 sec - exiting
07:49:30 (7712): No heartbeat from core client for 30 sec - exiting
07:49:31 (7712): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:54:16 (7720): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:49:18 (7829): No heartbeat from core client for 30 sec - exiting
08:49:26 (7829): No heartbeat from core client for 30 sec - exiting
08:49:27 (7829): No heartbeat from core client for 30 sec - exiting
08:49:28 (7829): No heartbeat from core client for 30 sec - exiting
08:49:29 (7829): No heartbeat from core client for 30 sec - exiting
08:49:30 (7829): No heartbeat from core client for 30 sec - exiting
08:49:31 (7829): No heartbeat from core client for 30 sec - exiting
08:49:32 (7829): No heartbeat from core client for 30 sec - exiting
08:49:33 (7829): No heartbeat from core client for 30 sec - exiting
08:49:34 (7829): No heartbeat from core client for 30 sec - exiting
08:49:35 (7829): No heartbeat from core client for 30 sec - exiting
08:49:36 (7829): No heartbeat from core client for 30 sec - exiting
08:49:37 (7829): No heartbeat from core client for 30 sec - exiting
08:49:38 (7829): No heartbeat from core client for 30 sec - exiting
08:49:39 (7829): No heartbeat from core client for 30 sec - exiting
08:49:40 (7829): No heartbeat from core client for 30 sec - exiting
08:49:41 (7829): No heartbeat from core client for 30 sec - exiting
08:49:42 (7829): No heartbeat from core client for 30 sec - exiting
08:49:43 (7829): No heartbeat from core client for 30 sec - exiting
08:49:44 (7829): No heartbeat from core client for 30 sec - exiting
08:49:45 (7829): No heartbeat from core client for 30 sec - exiting
08:49:46 (7829): No heartbeat from core client for 30 sec - exiting
08:49:47 (7829): No heartbeat from core client for 30 sec - exiting
08:49:48 (7829): No heartbeat from core client for 30 sec - exiting
08:49:49 (7829): No heartbeat from core client for 30 sec - exiting
08:49:50 (7829): No heartbeat from core client for 30 sec - exiting
08:49:51 (7829): No heartbeat from core client for 30 sec - exiting
08:49:52 (7829): No heartbeat from core client for 30 sec - exiting
08:49:53 (7829): No heartbeat from core client for 30 sec - exiting
08:49:54 (7829): No heartbeat from core client for 30 sec - exiting
08:49:55 (7829): No heartbeat from core client for 30 sec - exiting
08:49:56 (7829): No heartbeat from core client for 30 sec - exiting
08:49:58 (7829): No heartbeat from core client for 30 sec - exiting
08:49:59 (7829): No heartbeat from core client for 30 sec - exiting
08:50:00 (7829): No heartbeat from core client for 30 sec - exiting
08:50:01 (7829): No heartbeat from core client for 30 sec - exiting
08:50:02 (7829): No heartbeat from core client for 30 sec - exiting
08:50:05 (7829): No heartbeat from core client for 30 sec - exiting
08:50:06 (7829): No heartbeat from core client for 30 sec - exiting
08:50:07 (7829): No heartbeat from core client for 30 sec - exiting
08:50:08 (7829): No heartbeat from core client for 30 sec - exiting
08:50:09 (7829): No heartbeat from core client for 30 sec - exiting
08:50:10 (7829): No heartbeat from core client for 30 sec - exiting
08:50:11 (7829): No heartbeat from core client for 30 sec - exiting
08:50:12 (7829): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:50:51 (8054): No heartbeat from core client for 30 sec - exiting
08:50:52 (8054): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:50:53 (8054): No heartbeat from core client for 30 sec - exiting
09:10:41 (8061): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
09:12:32 (8120): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:13:51 (8120): No heartbeat from core client for 30 sec - exiting
09:13:52 (8120): No heartbeat from core client for 30 sec - exiting
09:16:12 (8228): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
09:25:04 (8309): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:25:22 (8309): No heartbeat from core client for 30 sec - exiting

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
09:30:15 (8612): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:30:21 (8612): No heartbeat from core client for 30 sec - exiting
09:30:22 (8612): No heartbeat from core client for 30 sec - exiting

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
09:41:19 (8695): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:45:12 (8865): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
10:01:49 (8925): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
10:12:00 (9341): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:14:22 (9384): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:14:33 (9384): No heartbeat from core client for 30 sec - exiting
10:14:34 (9384): No heartbeat from core client for 30 sec - exiting
10:14:35 (9384): No heartbeat from core client for 30 sec - exiting
10:14:36 (9384): No heartbeat from core client for 30 sec - exiting
10:14:38 (9384): No heartbeat from core client for 30 sec - exiting
10:14:39 (9384): No heartbeat from core client for 30 sec - exiting
10:14:40 (9384): No heartbeat from core client for 30 sec - exiting
10:14:41 (9384): No heartbeat from core client for 30 sec - exiting
10:14:43 (9384): No heartbeat from core client for 30 sec - exiting
10:14:44 (9384): No heartbeat from core client for 30 sec - exiting
10:14:45 (9384): No heartbeat from core client for 30 sec - exiting
10:14:46 (9384): No heartbeat from core client for 30 sec - exiting
10:14:47 (9384): No heartbeat from core client for 30 sec - exiting
10:15:52 (9471): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:17:56 (9535): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:18:44 (9573): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:21:41 (9673): No heartbeat from core client for 30 sec - exiting
10:21:45 (9673): No heartbeat from core client for 30 sec - exiting
10:21:46 (9673): No heartbeat from core client for 30 sec - exiting
10:21:47 (9673): No heartbeat from core client for 30 sec - exiting
10:21:48 (9673): No heartbeat from core client for 30 sec - exiting
10:21:49 (9673): No heartbeat from core client for 30 sec - exiting
10:21:50 (9673): No heartbeat from core client for 30 sec - exiting
10:21:51 (9673): No heartbeat from core client for 30 sec - exiting
10:22:05 (9673): No heartbeat from core client for 30 sec - exiting
10:22:06 (9673): No heartbeat from core client for 30 sec - exiting
10:22:07 (9673): No heartbeat from core client for 30 sec - exiting
10:22:08 (9673): No heartbeat from core client for 30 sec - exiting
10:22:14 (9673): No heartbeat from core client for 30 sec - exiting
10:22:15 (9673): No heartbeat from core client for 30 sec - exiting
10:22:16 (9673): No heartbeat from core client for 30 sec - exiting
10:22:17 (9673): No heartbeat from core client for 30 sec - exiting
10:22:18 (9673): No heartbeat from core client for 30 sec - exiting
10:22:19 (9673): No heartbeat from core client for 30 sec - exiting
10:22:31 (9673): No heartbeat from core client for 30 sec - exiting
10:22:32 (9673): No heartbeat from core client for 30 sec - exiting
10:22:33 (9673): No heartbeat from core client for 30 sec - exiting
10:22:34 (9673): No heartbeat from core client for 30 sec - exiting
10:22:35 (9673): No heartbeat from core client for 30 sec - exiting
10:22:36 (9673): No heartbeat from core client for 30 sec - exiting
10:22:37 (9673): No heartbeat from core client for 30 sec - exiting
10:22:38 (9673): No heartbeat from core client for 30 sec - exiting
10:22:39 (9673): No heartbeat from core client for 30 sec - exiting
10:22:40 (9673): No heartbeat from core client for 30 sec - exiting
10:22:41 (9673): No heartbeat from core client for 30 sec - exiting
10:22:42 (9673): No heartbeat from core client for 30 sec - exiting
10:22:43 (9673): No heartbeat from core client for 30 sec - exiting
10:22:44 (9673): No heartbeat from core client for 30 sec - exiting
10:22:45 (9673): No heartbeat from core client for 30 sec - exiting
10:22:46 (9673): No heartbeat from core client for 30 sec - exiting
10:22:47 (9673): No heartbeat from core client for 30 sec - exiting
10:22:48 (9673): No heartbeat from core client for 30 sec - exiting
10:22:49 (9673): No heartbeat from core client for 30 sec - exiting
10:22:50 (9673): No heartbeat from core client for 30 sec - exiting
10:22:51 (9673): No heartbeat from core client for 30 sec - exiting
10:22:52 (9673): No heartbeat from core client for 30 sec - exiting
10:22:53 (9673): No heartbeat from core client for 30 sec - exiting
10:22:54 (9673): No heartbeat from core client for 30 sec - exiting
10:22:55 (9673): No heartbeat from core client for 30 sec - exiting
10:22:56 (9673): No heartbeat from core client for 30 sec - exiting
10:22:57 (9673): No heartbeat from core client for 30 sec - exiting
10:22:58 (9673): No heartbeat from core client for 30 sec - exiting
10:22:59 (9673): No heartbeat from core client for 30 sec - exiting
10:23:00 (9673): No heartbeat from core client for 30 sec - exiting
10:23:01 (9673): No heartbeat from core client for 30 sec - exiting
10:23:02 (9673): No heartbeat from core client for 30 sec - exiting
10:23:04 (9673): No heartbeat from core client for 30 sec - exiting
10:23:05 (9673): No heartbeat from core client for 30 sec - exiting
10:23:06 (9673): No heartbeat from core client for 30 sec - exiting
10:23:07 (9673): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:23:08 (9673): No heartbeat from core client for 30 sec - exiting
10:24:08 (9806): No heartbeat from core client for 30 sec - exiting
10:24:21 (9806): No heartbeat from core client for 30 sec - exiting
10:24:22 (9806): No heartbeat from core client for 30 sec - exiting
10:24:23 (9806): No heartbeat from core client for 30 sec - exiting
10:24:24 (9806): No heartbeat from core client for 30 sec - exiting
10:24:25 (9806): No heartbeat from core client for 30 sec - exiting
10:24:26 (9806): No heartbeat from core client for 30 sec - exiting
10:24:27 (9806): No heartbeat from core client for 30 sec - exiting
10:24:28 (9806): No heartbeat from core client for 30 sec - exiting
10:24:29 (9806): No heartbeat from core client for 30 sec - exiting
10:24:30 (9806): No heartbeat from core client for 30 sec - exiting
10:24:31 (9806): No heartbeat from core client for 30 sec - exiting
10:24:32 (9806): No heartbeat from core client for 30 sec - exiting
10:24:33 (9806): No heartbeat from core client for 30 sec - exiting
10:24:34 (9806): No heartbeat from core client for 30 sec - exiting
10:24:35 (9806): No heartbeat from core client for 30 sec - exiting
10:24:36 (9806): No heartbeat from core client for 30 sec - exiting
10:24:38 (9806): No heartbeat from core client for 30 sec - exiting
10:24:39 (9806): No heartbeat from core client for 30 sec - exiting
10:24:40 (9806): No heartbeat from core client for 30 sec - exiting
10:24:41 (9806): No heartbeat from core client for 30 sec - exiting
10:24:42 (9806): No heartbeat from core client for 30 sec - exiting
10:24:43 (9806): No heartbeat from core client for 30 sec - exiting
10:24:44 (9806): No heartbeat from core client for 30 sec - exiting
10:24:45 (9806): No heartbeat from core client for 30 sec - exiting
10:24:46 (9806): No heartbeat from core client for 30 sec - exiting
10:24:52 (9806): No heartbeat from core client for 30 sec - exiting
10:24:53 (9806): No heartbeat from core client for 30 sec - exiting
10:24:54 (9806): No heartbeat from core client for 30 sec - exiting
10:24:55 (9806): No heartbeat from core client for 30 sec - exiting
10:24:56 (9806): No heartbeat from core client for 30 sec - exiting
10:24:57 (9806): No heartbeat from core client for 30 sec - exiting
10:24:58 (9806): No heartbeat from core client for 30 sec - exiting
10:24:59 (9806): No heartbeat from core client for 30 sec - exiting
10:25:00 (9806): No heartbeat from core client for 30 sec - exiting
10:25:01 (9806): No heartbeat from core client for 30 sec - exiting
10:25:02 (9806): No heartbeat from core client for 30 sec - exiting
10:25:03 (9806): No heartbeat from core client for 30 sec - exiting
10:25:04 (9806): No heartbeat from core client for 30 sec - exiting
10:25:05 (9806): No heartbeat from core client for 30 sec - exiting
10:25:06 (9806): No heartbeat from core client for 30 sec - exiting
10:25:07 (9806): No heartbeat from core client for 30 sec - exiting
10:25:08 (9806): No heartbeat from core client for 30 sec - exiting
10:25:09 (9806): No heartbeat from core client for 30 sec - exiting
10:25:10 (9806): No heartbeat from core client for 30 sec - exiting
10:25:11 (9806): No heartbeat from core client for 30 sec - exiting
10:25:12 (9806): No heartbeat from core client for 30 sec - exiting
10:25:13 (9806): No heartbeat from core client for 30 sec - exiting
10:25:14 (9806): No heartbeat from core client for 30 sec - exiting
10:25:15 (9806): No heartbeat from core client for 30 sec - exiting
10:25:16 (9806): No heartbeat from core client for 30 sec - exiting
10:25:17 (9806): No heartbeat from core client for 30 sec - exiting
10:25:18 (9806): No heartbeat from core client for 30 sec - exiting
10:25:19 (9806): No heartbeat from core client for 30 sec - exiting
10:25:20 (9806): No heartbeat from core client for 30 sec - exiting
10:25:21 (9806): No heartbeat from core client for 30 sec - exiting
10:25:22 (9806): No heartbeat from core client for 30 sec - exiting
10:25:24 (9806): No heartbeat from core client for 30 sec - exiting
10:25:25 (9806): No heartbeat from core client for 30 sec - exiting
10:25:26 (9806): No heartbeat from core client for 30 sec - exiting
10:25:27 (9806): No heartbeat from core client for 30 sec - exiting
10:25:28 (9806): No heartbeat from core client for 30 sec - exiting
10:25:29 (9806): No heartbeat from core client for 30 sec - exiting
10:25:30 (9806): No heartbeat from core client for 30 sec - exiting
10:25:31 (9806): No heartbeat from core client for 30 sec - exiting
10:25:32 (9806): No heartbeat from core client for 30 sec - exiting
10:25:33 (9806): No heartbeat from core client for 30 sec - exiting
10:25:34 (9806): No heartbeat from core client for 30 sec - exiting
10:25:35 (9806): No heartbeat from core client for 30 sec - exiting
10:25:36 (9806): No heartbeat from core client for 30 sec - exiting
10:25:37 (9806): No heartbeat from core client for 30 sec - exiting
10:25:38 (9806): No heartbeat from core client for 30 sec - exiting
10:25:39 (9806): No heartbeat from core client for 30 sec - exiting
10:25:40 (9806): No heartbeat from core client for 30 sec - exiting
10:25:41 (9806): No heartbeat from core client for 30 sec - exiting
10:25:42 (9806): No heartbeat from core client for 30 sec - exiting
10:25:43 (9806): No heartbeat from core client for 30 sec - exiting
10:25:44 (9806): No heartbeat from core client for 30 sec - exiting
10:25:45 (9806): No heartbeat from core client for 30 sec - exiting
10:25:46 (9806): No heartbeat from core client for 30 sec - exiting
10:25:47 (9806): No heartbeat from core client for 30 sec - exiting
10:25:48 (9806): No heartbeat from core client for 30 sec - exiting
10:25:49 (9806): No heartbeat from core client for 30 sec - exiting
10:25:50 (9806): No heartbeat from core client for 30 sec - exiting
10:25:51 (9806): No heartbeat from core client for 30 sec - exiting
10:25:52 (9806): No heartbeat from core client for 30 sec - exiting
10:25:53 (9806): No heartbeat from core client for 30 sec - exiting
10:25:54 (9806): No heartbeat from core client for 30 sec - exiting
10:25:55 (9806): No heartbeat from core client for 30 sec - exiting
10:25:56 (9806): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:31:23 (9996): No heartbeat from core client for 30 sec - exiting
10:31:25 (9996): No heartbeat from core client for 30 sec - exiting
10:31:26 (9996): No heartbeat from core client for 30 sec - exiting
10:31:27 (9996): No heartbeat from core client for 30 sec - exiting
10:31:28 (9996): No heartbeat from core client for 30 sec - exiting
10:31:29 (9996): No heartbeat from core client for 30 sec - exiting
10:31:30 (9996): No heartbeat from core client for 30 sec - exiting
10:31:31 (9996): No heartbeat from core client for 30 sec - exiting
10:31:34 (9996): No heartbeat from core client for 30 sec - exiting
10:31:35 (9996): No heartbeat from core client for 30 sec - exiting
10:31:36 (9996): No heartbeat from core client for 30 sec - exiting
10:31:37 (9996): No heartbeat from core client for 30 sec - exiting
10:31:38 (9996): No heartbeat from core client for 30 sec - exiting
10:31:39 (9996): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:35:46 (10043): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:38:46 (10160): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:39:25 (10214): No heartbeat from core client for 30 sec - exiting
10:39:27 (10214): No heartbeat from core client for 30 sec - exiting
10:39:28 (10214): No heartbeat from core client for 30 sec - exiting
10:39:29 (10214): No heartbeat from core client for 30 sec - exiting
10:39:30 (10214): No heartbeat from core client for 30 sec - exiting
10:39:31 (10214): No heartbeat from core client for 30 sec - exiting
10:39:32 (10214): No heartbeat from core client for 30 sec - exiting
10:39:33 (10214): No heartbeat from core client for 30 sec - exiting
10:39:34 (10214): No heartbeat from core client for 30 sec - exiting
10:39:35 (10214): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:40:27 (10221): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
10:53:02 (10231): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
11:03:07 (10326): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:03:11 (10326): No heartbeat from core client for 30 sec - exiting
11:03:12 (10326): No heartbeat from core client for 30 sec - exiting
11:03:13 (10326): No heartbeat from core client for 30 sec - exiting
11:03:14 (10326): No heartbeat from core client for 30 sec - exiting
11:03:15 (10326): No heartbeat from core client for 30 sec - exiting
11:03:18 (10326): No heartbeat from core client for 30 sec - exiting
11:03:19 (10326): No heartbeat from core client for 30 sec - exiting
11:03:20 (10326): No heartbeat from core client for 30 sec - exiting
11:03:21 (10326): No heartbeat from core client for 30 sec - exiting
11:03:22 (10326): No heartbeat from core client for 30 sec - exiting

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
11:08:01 (10599): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:08:10 (10599): No heartbeat from core client for 30 sec - exiting
11:08:11 (10599): No heartbeat from core client for 30 sec - exiting
11:08:12 (10599): No heartbeat from core client for 30 sec - exiting
11:08:13 (10599): No heartbeat from core client for 30 sec - exiting
11:08:14 (10599): No heartbeat from core client for 30 sec - exiting
11:08:15 (10599): No heartbeat from core client for 30 sec - exiting
11:08:16 (10599): No heartbeat from core client for 30 sec - exiting
11:08:17 (10599): No heartbeat from core client for 30 sec - exiting
11:08:18 (10599): No heartbeat from core client for 30 sec - exiting
11:08:19 (10599): No heartbeat from core client for 30 sec - exiting
11:08:20 (10599): No heartbeat from core client for 30 sec - exiting
11:08:21 (10599): No heartbeat from core client for 30 sec - exiting
11:08:22 (10599): No heartbeat from core client for 30 sec - exiting
11:08:25 (10599): No heartbeat from core client for 30 sec - exiting
11:08:26 (10599): No heartbeat from core client for 30 sec - exiting
11:08:27 (10599): No heartbeat from core client for 30 sec - exiting
11:08:28 (10599): No heartbeat from core client for 30 sec - exiting
11:08:29 (10599): No heartbeat from core client for 30 sec - exiting
11:08:30 (10599): No heartbeat from core client for 30 sec - exiting
11:08:31 (10599): No heartbeat from core client for 30 sec - exiting
11:08:32 (10599): No heartbeat from core client for 30 sec - exiting
11:08:33 (10599): No heartbeat from core client for 30 sec - exiting
11:08:34 (10599): No heartbeat from core client for 30 sec - exiting
11:08:35 (10599): No heartbeat from core client for 30 sec - exiting
11:11:38 (10756): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:12:49 (10844): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:19:07 (10938): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:19:10 (10938): No heartbeat from core client for 30 sec - exiting
11:19:11 (10938): No heartbeat from core client for 30 sec - exiting
11:19:12 (10938): No heartbeat from core client for 30 sec - exiting
11:19:13 (10938): No heartbeat from core client for 30 sec - exiting
11:19:14 (10938): No heartbeat from core client for 30 sec - exiting
11:19:15 (10938): No heartbeat from core client for 30 sec - exiting
11:19:16 (10938): No heartbeat from core client for 30 sec - exiting
11:19:17 (10938): No heartbeat from core client for 30 sec - exiting
11:19:18 (10938): No heartbeat from core client for 30 sec - exiting
11:19:19 (10938): No heartbeat from core client for 30 sec - exiting
11:19:20 (10938): No heartbeat from core client for 30 sec - exiting
11:19:21 (10938): No heartbeat from core client for 30 sec - exiting
11:19:22 (10938): No heartbeat from core client for 30 sec - exiting
11:19:23 (10938): No heartbeat from core client for 30 sec - exiting
11:19:24 (10938): No heartbeat from core client for 30 sec - exiting
11:19:25 (10938): No heartbeat from core client for 30 sec - exiting
11:19:26 (10938): No heartbeat from core client for 30 sec - exiting
11:19:27 (10938): No heartbeat from core client for 30 sec - exiting
11:19:28 (10938): No heartbeat from core client for 30 sec - exiting
11:19:31 (10938): No heartbeat from core client for 30 sec - exiting
11:19:32 (10938): No heartbeat from core client for 30 sec - exiting
11:19:33 (10938): No heartbeat from core client for 30 sec - exiting
11:21:16 (11224): No heartbeat from core client for 30 sec - exiting
11:21:31 (11224): No heartbeat from core client for 30 sec - exiting
11:21:32 (11224): No heartbeat from core client for 30 sec - exiting
11:21:33 (11224): No heartbeat from core client for 30 sec - exiting
11:21:34 (11224): No heartbeat from core client for 30 sec - exiting
11:21:35 (11224): No heartbeat from core client for 30 sec - exiting
11:21:36 (11224): No heartbeat from core client for 30 sec - exiting
11:21:37 (11224): No heartbeat from core client for 30 sec - exiting
11:21:38 (11224): No heartbeat from core client for 30 sec - exiting
11:21:39 (11224): No heartbeat from core client for 30 sec - exiting
11:21:40 (11224): No heartbeat from core client for 30 sec - exiting
11:21:41 (11224): No heartbeat from core client for 30 sec - exiting
11:21:42 (11224): No heartbeat from core client for 30 sec - exiting
11:21:43 (11224): No heartbeat from core client for 30 sec - exiting
11:21:44 (11224): No heartbeat from core client for 30 sec - exiting
11:21:45 (11224): No heartbeat from core client for 30 sec - exiting
11:21:46 (11224): No heartbeat from core client for 30 sec - exiting
11:21:47 (11224): No heartbeat from core client for 30 sec - exiting
11:21:48 (11224): No heartbeat from core client for 30 sec - exiting
11:21:49 (11224): No heartbeat from core client for 30 sec - exiting
11:21:50 (11224): No heartbeat from core client for 30 sec - exiting
11:21:52 (11224): No heartbeat from core client for 30 sec - exiting
11:21:53 (11224): No heartbeat from core client for 30 sec - exiting
11:21:54 (11224): No heartbeat from core client for 30 sec - exiting
11:21:55 (11224): No heartbeat from core client for 30 sec - exiting
11:21:56 (11224): No heartbeat from core client for 30 sec - exiting
11:21:57 (11224): No heartbeat from core client for 30 sec - exiting
11:21:58 (11224): No heartbeat from core client for 30 sec - exiting
11:21:59 (11224): No heartbeat from core client for 30 sec - exiting
11:22:00 (11224): No heartbeat from core client for 30 sec - exiting
11:22:01 (11224): No heartbeat from core client for 30 sec - exiting
11:22:02 (11224): No heartbeat from core client for 30 sec - exiting
11:22:03 (11224): No heartbeat from core client for 30 sec - exiting
11:22:04 (11224): No heartbeat from core client for 30 sec - exiting
11:22:05 (11224): No heartbeat from core client for 30 sec - exiting
11:22:06 (11224): No heartbeat from core client for 30 sec - exiting
11:22:07 (11224): No heartbeat from core client for 30 sec - exiting
11:22:08 (11224): No heartbeat from core client for 30 sec - exiting
11:22:09 (11224): No heartbeat from core client for 30 sec - exiting
11:22:10 (11224): No heartbeat from core client for 30 sec - exiting
11:22:11 (11224): No heartbeat from core client for 30 sec - exiting
11:22:12 (11224): No heartbeat from core client for 30 sec - exiting
11:22:13 (11224): No heartbeat from core client for 30 sec - exiting
11:22:14 (11224): No heartbeat from core client for 30 sec - exiting
11:22:15 (11224): No heartbeat from core client for 30 sec - exiting
11:22:16 (11224): No heartbeat from core client for 30 sec - exiting
11:22:17 (11224): No heartbeat from core client for 30 sec - exiting
11:22:18 (11224): No heartbeat from core client for 30 sec - exiting
11:22:19 (11224): No heartbeat from core client for 30 sec - exiting
11:22:20 (11224): No heartbeat from core client for 30 sec - exiting
11:22:21 (11224): No heartbeat from core client for 30 sec - exiting
11:22:22 (11224): No heartbeat from core client for 30 sec - exiting
11:22:23 (11224): No heartbeat from core client for 30 sec - exiting
11:22:24 (11224): No heartbeat from core client for 30 sec - exiting
11:22:25 (11224): No heartbeat from core client for 30 sec - exiting
11:22:26 (11224): No heartbeat from core client for 30 sec - exiting
11:22:27 (11224): No heartbeat from core client for 30 sec - exiting
11:22:28 (11224): No heartbeat from core client for 30 sec - exiting
11:22:29 (11224): No heartbeat from core client for 30 sec - exiting
11:22:30 (11224): No heartbeat from core client for 30 sec - exiting
11:22:31 (11224): No heartbeat from core client for 30 sec - exiting
11:22:32 (11224): No heartbeat from core client for 30 sec - exiting
11:22:33 (11224): No heartbeat from core client for 30 sec - exiting
11:22:34 (11224): No heartbeat from core client for 30 sec - exiting
11:22:35 (11224): No heartbeat from core client for 30 sec - exiting
11:22:36 (11224): No heartbeat from core client for 30 sec - exiting
11:22:37 (11224): No heartbeat from core client for 30 sec - exiting
11:22:38 (11224): No heartbeat from core client for 30 sec - exiting
11:22:39 (11224): No heartbeat from core client for 30 sec - exiting
11:22:40 (11224): No heartbeat from core client for 30 sec - exiting
11:22:41 (11224): No heartbeat from core client for 30 sec - exiting
11:22:42 (11224): No heartbeat from core client for 30 sec - exiting
11:22:43 (11224): No heartbeat from core client for 30 sec - exiting
11:22:45 (11224): No heartbeat from core client for 30 sec - exiting
11:22:46 (11224): No heartbeat from core client for 30 sec - exiting
11:22:47 (11224): No heartbeat from core client for 30 sec - exiting
11:22:48 (11224): No heartbeat from core client for 30 sec - exiting
11:22:49 (11224): No heartbeat from core client for 30 sec - exiting
11:22:50 (11224): No heartbeat from core client for 30 sec - exiting
11:22:51 (11224): No heartbeat from core client for 30 sec - exiting
11:22:52 (11224): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
11:28:49 (11321): No heartbeat from core client for 30 sec - exiting
11:30:17 (1902): No heartbeat from core client for 30 sec - exiting
11:30:18 (1902): No heartbeat from core client for 30 sec - exiting
11:30:19 (1902): No heartbeat from core client for 30 sec - exiting
11:30:20 (1902): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
07 Mar 2013 07:55:25 1235408 15597792 hadcm3n_47yc_1940_40_008310480_0 855,360 1,039,043 1.2147
05 Mar 2013 23:23:34 1235408 15597792 hadcm3n_47yc_1940_40_008310480_0 829,440 1,007,937 1.2152
04 Mar 2013 16:25:50 1235408 15597792 hadcm3n_47yc_1940_40_008310480_0 803,520 977,112 1.2160
04 Mar 2013 03:47:05 1235408 15597792 hadcm3n_47yc_1940_40_008310480_0 777,600 946,547 1.2173
03 Mar 2013 15:10:32 1235408 15597792 hadcm3n_47yc_1940_40_008310480_0 751,680 915,743 1.2183
03 Mar 2013 02:29:22 1235408 15597792 hadcm3n_47yc_1940_40_008310480_0 725,760 884,971 1.2194
02 Mar 2013 14:15:26 1235408 15597792 hadcm3n_47yc_1940_40_008310480_0 699,840 854,552 1.2211
01 Mar 2013 12:13:16 1235408 15597792 hadcm3n_47yc_1940_40_008310480_0 673,920 824,829 1.2239
01 Mar 2013 00:55:34 1235408 15597792 hadcm3n_47yc_1940_40_008310480_0 648,000 795,406 1.2275
24 Feb 2013 19:44:26 1235408 15597792 hadcm3n_47yc_1940_40_008310480_0 622,080 766,099 1.2315
24 Feb 2013 11:06:20 1235408 15597792 hadcm3n_47yc_1940_40_008310480_0 596,160 736,946 1.2362
24 Feb 2013 02:32:58 1235408 15597792 hadcm3n_47yc_1940_40_008310480_0 570,240 707,688 1.2410
23 Feb 2013 18:01:53 1235408 15597792 hadcm3n_47yc_1940_40_008310480_0 544,320 678,383 1.2463
23 Feb 2013 09:27:15 1235408 15597792 hadcm3n_47yc_1940_40_008310480_0 518,400 649,084 1.2521
23 Feb 2013 00:40:22 1235408 15597792 hadcm3n_47yc_1940_40_008310480_0 492,480 619,214 1.2573
22 Feb 2013 16:00:40 1235408 15597792 hadcm3n_47yc_1940_40_008310480_0 466,560 589,800 1.2641
21 Feb 2013 03:58:37 1235408 15597792 hadcm3n_47yc_1940_40_008310480_0 440,640 558,146 1.2667
18 Feb 2013 22:20:43 1235408 15597792 hadcm3n_47yc_1940_40_008310480_0 414,720 525,927 1.2681
18 Feb 2013 12:14:02 1235408 15597792 hadcm3n_47yc_1940_40_008310480_0 388,800 491,503 1.2642
18 Feb 2013 02:06:47 1235408 15597792 hadcm3n_47yc_1940_40_008310480_0 362,880 456,929 1.2592


©2024 climateprediction.net