climateprediction.net home page
Task 15504095

Task 15504095

Name hadcm3n_o6d5_2140_40_008270455_1
Workunit 8425579
Created 24 Dec 2012, 4:24:26 UTC
Sent 24 Dec 2012, 4:48:18 UTC
Report deadline 25 Mar 2013, 12:15:29 UTC
Received 14 Jan 2013, 9:58:39 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1186899
Run time 15 days 15 hours 53 min 23 sec
CPU time 14 days 3 hours 54 min 27 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 2.84 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	06:22:57 AM	No files match the supplied pattern.
MainError:	06:22:57 AM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	08:55:23 PM	No files match the supplied pattern.
MainError:	08:55:23 PM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
20:40:28 (16664): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:54:59 (7680): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	02:18:59 PM	No files match the supplied pattern.
MainError:	02:18:59 PM	No files match the supplied pattern.
MainError:	02:02:53 PM	No files match the supplied pattern.
MainError:	02:02:53 PM	No files match the supplied pattern.
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=29088, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	02:13:21 PM	No files match the supplied pattern.
MainError:	02:13:21 PM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	05:58:24 AM	No files match the supplied pattern.
MainError:	05:58:24 AM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	10:42:25 PM	No files match the supplied pattern.
MainError:	10:42:25 PM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
MainError:	12:33:28 AM	No files match the supplied pattern.
MainError:	12:33:28 AM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	06:29:56 AM	No files match the supplied pattern.
MainError:	06:29:56 AM	No files match the supplied pattern.
MainError:	07:43:58 PM	No files match the supplied pattern.
MainError:	07:43:58 PM	No files match the supplied pattern.
Error converting file to netcdf: dataout/o6d5ka.ph11c10
Error converting file to netcdf: dataout/o6d5ka.pg11c10
Error converting file to netcdf: dataout/o6d5ka.pe11c10
MainError:	08:36:13 AM	No files match the supplied pattern.
MainError:	08:36:13 AM	No files match the supplied pattern.
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Jan 2013 08:38:45 1186899 15504095 hadcm3n_o6d5_2140_40_008270455_1 777,600 1,328,529 1.7085
13 Jan 2013 19:47:19 1186899 15504095 hadcm3n_o6d5_2140_40_008270455_1 751,680 1,282,448 1.7061
13 Jan 2013 06:49:09 1186899 15504095 hadcm3n_o6d5_2140_40_008270455_1 725,760 1,235,160 1.7019
12 Jan 2013 12:35:06 1186899 15504095 hadcm3n_o6d5_2140_40_008270455_1 699,840 1,187,373 1.6966
11 Jan 2013 22:47:10 1186899 15504095 hadcm3n_o6d5_2140_40_008270455_1 673,920 1,138,666 1.6896
11 Jan 2013 05:58:50 1186899 15504095 hadcm3n_o6d5_2140_40_008270455_1 648,000 1,090,575 1.6830
10 Jan 2013 14:15:28 1186899 15504095 hadcm3n_o6d5_2140_40_008270455_1 622,080 1,042,556 1.6759
10 Jan 2013 00:02:07 1186899 15504095 hadcm3n_o6d5_2140_40_008270455_1 596,160 994,190 1.6677
08 Jan 2013 14:20:31 1186899 15504095 hadcm3n_o6d5_2140_40_008270455_1 570,240 950,338 1.6666
06 Jan 2013 20:57:21 1186899 15504095 hadcm3n_o6d5_2140_40_008270455_1 544,320 902,566 1.6582
06 Jan 2013 06:25:39 1186899 15504095 hadcm3n_o6d5_2140_40_008270455_1 518,400 854,749 1.6488
05 Jan 2013 16:31:01 1186899 15504095 hadcm3n_o6d5_2140_40_008270455_1 492,480 807,372 1.6394
05 Jan 2013 01:34:09 1186899 15504095 hadcm3n_o6d5_2140_40_008270455_1 466,560 759,672 1.6282
04 Jan 2013 07:45:02 1186899 15504095 hadcm3n_o6d5_2140_40_008270455_1 440,640 713,367 1.6189
03 Jan 2013 21:57:25 1186899 15504095 hadcm3n_o6d5_2140_40_008270455_1 414,720 675,486 1.6288
03 Jan 2013 11:41:34 1186899 15504095 hadcm3n_o6d5_2140_40_008270455_1 388,800 641,623 1.6503
03 Jan 2013 02:04:26 1186899 15504095 hadcm3n_o6d5_2140_40_008270455_1 362,880 607,100 1.6730
02 Jan 2013 17:12:15 1186899 15504095 hadcm3n_o6d5_2140_40_008270455_1 336,960 573,043 1.7006
02 Jan 2013 07:19:46 1186899 15504095 hadcm3n_o6d5_2140_40_008270455_1 311,040 539,928 1.7359
01 Jan 2013 22:02:27 1186899 15504095 hadcm3n_o6d5_2140_40_008270455_1 285,120 506,711 1.7772


©2024 climateprediction.net