climateprediction.net home page
Task 15605859

Task 15605859

Name hadcm3n_o2r6_2140_40_008282354_3
Workunit 8433489
Created 12 Feb 2013, 9:46:14 UTC
Sent 12 Feb 2013, 9:46:33 UTC
Report deadline 14 May 2013, 17:13:44 UTC
Received 17 Mar 2013, 12:55:24 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1034303
Run time 14 days 21 hours 24 min 6 sec
CPU time 12 days 20 hours 50 min 17 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 2.53 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>6.10.60</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
15:43:03 (2300): No heartbeat from core client for 30 sec - exiting
15:43:04 (2300): No heartbeat from core client for 30 sec - exiting
15:43:05 (2300): No heartbeat from core client for 30 sec - exiting
15:43:07 (2300): No heartbeat from core client for 30 sec - exiting
15:43:08 (2300): No heartbeat from core client for 30 sec - exiting
15:43:09 (2300): No heartbeat from core client for 30 sec - exiting
15:43:10 (2300): No heartbeat from core client for 30 sec - exiting
15:43:11 (2300): No heartbeat from core client for 30 sec - exiting
15:43:12 (2300): No heartbeat from core client for 30 sec - exiting
15:43:13 (2300): No heartbeat from core client for 30 sec - exiting
15:43:14 (2300): No heartbeat from core client for 30 sec - exiting
15:43:15 (2300): No heartbeat from core client for 30 sec - exiting
15:43:16 (2300): No heartbeat from core client for 30 sec - exiting
15:43:17 (2300): No heartbeat from core client for 30 sec - exiting
15:43:18 (2300): No heartbeat from core client for 30 sec - exiting
15:43:19 (2300): No heartbeat from core client for 30 sec - exiting
15:43:20 (2300): No heartbeat from core client for 30 sec - exiting
15:43:21 (2300): No heartbeat from core client for 30 sec - exiting
15:43:22 (2300): No heartbeat from core client for 30 sec - exiting
15:43:23 (2300): No heartbeat from core client for 30 sec - exiting
15:43:24 (2300): No heartbeat from core client for 30 sec - exiting
15:43:25 (2300): No heartbeat from core client for 30 sec - exiting
15:43:26 (2300): No heartbeat from core client for 30 sec - exiting
15:43:27 (2300): No heartbeat from core client for 30 sec - exiting
15:43:28 (2300): No heartbeat from core client for 30 sec - exiting
15:43:29 (2300): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Error converting file to netcdf: dataout/o2r6ko.pjz3c10
Error converting file to netcdf: dataout/o2r6ko.piz3c10
Error converting file to netcdf: dataout/o2r6ko.pfz3c10
Error converting file to netcdf: dataout/o2r6ka.phz3c10
Error converting file to netcdf: dataout/o2r6ka.pgz3c10
Error converting file to netcdf: dataout/o2r6ka.pez3c10
Error converting file to netcdf: dataout/o2r6ka.pdz3c10
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	01:32:37 AM	No files match the supplied pattern.
MainError:	01:32:37 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	01:58:08 AM	No files match the supplied pattern.
MainError:	01:58:08 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	07:40:48 AM	No files match the supplied pattern.
MainError:	07:40:48 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	04:52:45 AM	No files match the supplied pattern.
MainError:	04:52:45 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	07:28:26 AM	No files match the supplied pattern.
MainError:	07:28:26 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	02:21:00 PM	No files match the supplied pattern.
MainError:	02:21:00 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	04:33:44 PM	No files match the supplied pattern.
MainError:	04:33:44 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	12:05:23 AM	No files match the supplied pattern.
MainError:	12:05:23 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	04:11:02 PM	No files match the supplied pattern.
MainError:	04:11:02 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	05:25:29 PM	No files match the supplied pattern.
MainError:	05:25:29 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: dataout/o2r6ka.ph11c10
Error converting file to netcdf: dataout/o2r6ka.pg11c10
Error converting file to netcdf: dataout/o2r6ka.pe11c10
MainError:	11:58:44 AM	No files match the supplied pattern.
MainError:	11:58:44 AM	No files match the supplied pattern.
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
16 Mar 2013 11:59:20 1034303 15605859 hadcm3n_o2r6_2140_40_008282354_3 777,600 1,198,324 1.5411
15 Mar 2013 17:26:31 1034303 15605859 hadcm3n_o2r6_2140_40_008282354_3 751,680 1,156,053 1.5380
14 Mar 2013 16:15:45 1034303 15605859 hadcm3n_o2r6_2140_40_008282354_3 725,760 1,117,844 1.5402
13 Mar 2013 12:05:45 1034303 15605859 hadcm3n_o2r6_2140_40_008282354_3 699,840 1,078,634 1.5413
12 Mar 2013 16:35:47 1034303 15605859 hadcm3n_o2r6_2140_40_008282354_3 673,920 1,038,400 1.5408
11 Mar 2013 14:45:31 1034303 15605859 hadcm3n_o2r6_2140_40_008282354_3 648,000 998,176 1.5404
10 Mar 2013 07:31:08 1034303 15605859 hadcm3n_o2r6_2140_40_008282354_3 622,080 957,099 1.5385
09 Mar 2013 04:56:24 1034303 15605859 hadcm3n_o2r6_2140_40_008282354_3 596,160 916,599 1.5375
08 Mar 2013 07:41:09 1034303 15605859 hadcm3n_o2r6_2140_40_008282354_3 570,240 877,678 1.5391
07 Mar 2013 02:02:55 1034303 15605859 hadcm3n_o2r6_2140_40_008282354_3 544,320 839,028 1.5414
06 Mar 2013 01:34:09 1034303 15605859 hadcm3n_o2r6_2140_40_008282354_3 518,400 800,283 1.5438
05 Mar 2013 03:54:30 1034303 15605859 hadcm3n_o2r6_2140_40_008282354_3 492,480 761,937 1.5471
04 Mar 2013 01:26:13 1034303 15605859 hadcm3n_o2r6_2140_40_008282354_3 466,560 721,883 1.5472
03 Mar 2013 02:39:24 1034303 15605859 hadcm3n_o2r6_2140_40_008282354_3 440,640 681,972 1.5477
02 Mar 2013 04:11:13 1034303 15605859 hadcm3n_o2r6_2140_40_008282354_3 414,720 641,148 1.5460
01 Mar 2013 00:30:28 1034303 15605859 hadcm3n_o2r6_2140_40_008282354_3 388,800 601,785 1.5478
28 Feb 2013 02:46:11 1034303 15605859 hadcm3n_o2r6_2140_40_008282354_3 362,880 562,133 1.5491
26 Feb 2013 22:49:15 1034303 15605859 hadcm3n_o2r6_2140_40_008282354_3 336,960 520,714 1.5453
25 Feb 2013 22:36:38 1034303 15605859 hadcm3n_o2r6_2140_40_008282354_3 311,040 481,059 1.5466
25 Feb 2013 02:02:17 1034303 15605859 hadcm3n_o2r6_2140_40_008282354_3 285,120 441,071 1.5470


©2024 cpdn.org