climateprediction.net home page
Task 15639969

Task 15639969

Name hadcm3n_o283_2140_40_008269576_2
Workunit 8424700
Created 25 Feb 2013, 19:20:02 UTC
Sent 25 Feb 2013, 19:27:24 UTC
Report deadline 28 May 2013, 2:54:35 UTC
Received 1 Apr 2013, 11:56:34 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1271392
Run time 19 days 2 hours 54 min 45 sec
CPU time 18 days 8 hours 21 min 32 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 2.85 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.12.33</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:11:55 (1761): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
12:05:42 (1834): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
10:44:30 (5181): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	10:05:39 PM	No files match the supplied pattern.
MainError:	10:05:39 PM	No files match the supplied pattern.
MainError:	11:47:00 AM	No files match the supplied pattern.
MainError:	11:47:00 AM	No files match the supplied pattern.
MainError:	01:26:30 AM	No files match the supplied pattern.
MainError:	01:26:30 AM	No files match the supplied pattern.
09:45:19 (3348): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:46:43 (10930): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
MainError:	08:27:08 PM	No files match the supplied pattern.
MainError:	08:27:08 PM	No files match the supplied pattern.
MainError:	09:57:41 AM	No files match the supplied pattern.
MainError:	09:57:41 AM	No files match the supplied pattern.
MainError:	12:21:07 AM	No files match the supplied pattern.
MainError:	12:21:07 AM	No files match the supplied pattern.
MainError:	02:28:31 PM	No files match the supplied pattern.
MainError:	02:28:31 PM	No files match the supplied pattern.
MainError:	04:41:15 AM	No files match the supplied pattern.
MainError:	04:41:15 AM	No files match the supplied pattern.
MainError:	07:11:29 PM	No files match the supplied pattern.
MainError:	07:11:29 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	06:51:16 PM	No files match the supplied pattern.
MainError:	06:51:16 PM	No files match the supplied pattern.
Error converting file to netcdf: dataout/o283ka.ph11c10
Error converting file to netcdf: dataout/o283ka.pg11c10
Error converting file to netcdf: dataout/o283ka.pe11c10
MainError:	08:42:17 AM	No files match the supplied pattern.
MainError:	08:42:17 AM	No files match the supplied pattern.
11:26:54 (11021): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1
11:28:16 (17427): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1
11:35:18 (17518): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1
11:41:03 (17613): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1
11:42:29 (17751): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
01 Apr 2013 08:44:24 1271392 15639969 hadcm3n_o283_2140_40_008269576_2 777,600 1,582,507 2.0351
31 Mar 2013 18:51:52 1271392 15639969 hadcm3n_o283_2140_40_008269576_2 751,680 1,533,488 2.0401
30 Mar 2013 19:17:47 1271392 15639969 hadcm3n_o283_2140_40_008269576_2 725,760 1,483,075 2.0435
30 Mar 2013 04:43:08 1271392 15639969 hadcm3n_o283_2140_40_008269576_2 699,840 1,431,786 2.0459
29 Mar 2013 14:30:27 1271392 15639969 hadcm3n_o283_2140_40_008269576_2 673,920 1,381,505 2.0500
29 Mar 2013 00:21:24 1271392 15639969 hadcm3n_o283_2140_40_008269576_2 648,000 1,331,444 2.0547
28 Mar 2013 09:59:04 1271392 15639969 hadcm3n_o283_2140_40_008269576_2 622,080 1,280,463 2.0584
27 Mar 2013 20:31:31 1271392 15639969 hadcm3n_o283_2140_40_008269576_2 596,160 1,232,596 2.0676
27 Mar 2013 01:29:28 1271392 15639969 hadcm3n_o283_2140_40_008269576_2 570,240 1,184,384 2.0770
26 Mar 2013 11:47:12 1271392 15639969 hadcm3n_o283_2140_40_008269576_2 544,320 1,136,019 2.0870
25 Mar 2013 22:06:43 1271392 15639969 hadcm3n_o283_2140_40_008269576_2 518,400 1,087,333 2.0975
24 Mar 2013 12:43:17 1271392 15639969 hadcm3n_o283_2140_40_008269576_2 492,480 1,035,302 2.1022
23 Mar 2013 11:09:12 1271392 15639969 hadcm3n_o283_2140_40_008269576_2 466,560 982,915 2.1067
22 Mar 2013 03:07:13 1271392 15639969 hadcm3n_o283_2140_40_008269576_2 440,640 929,374 2.1091
12 Mar 2013 08:21:24 1271392 15639969 hadcm3n_o283_2140_40_008269576_2 414,720 875,400 2.1108
10 Mar 2013 12:37:28 1271392 15639969 hadcm3n_o283_2140_40_008269576_2 388,800 819,959 2.1089
09 Mar 2013 20:37:21 1271392 15639969 hadcm3n_o283_2140_40_008269576_2 362,880 763,857 2.1050
09 Mar 2013 03:36:08 1271392 15639969 hadcm3n_o283_2140_40_008269576_2 336,960 707,038 2.0983
08 Mar 2013 10:57:14 1271392 15639969 hadcm3n_o283_2140_40_008269576_2 311,040 649,278 2.0874
07 Mar 2013 18:45:27 1271392 15639969 hadcm3n_o283_2140_40_008269576_2 285,120 592,318 2.0774


©2024 climateprediction.net