climateprediction.net home page
Task 15789110

Task 15789110

Name hadcm3n_o4oe_2140_40_008269371_3
Workunit 8424495
Created 18 May 2013, 11:58:56 UTC
Sent 18 May 2013, 11:59:04 UTC
Report deadline 17 Aug 2013, 19:26:15 UTC
Received 6 Jun 2013, 12:02:17 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1192587
Run time 16 days 14 hours 17 min 21 sec
CPU time 5 days 23 hours 41 min 54 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 3.33 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>6.10.60</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
00:55:29 (2540): No heartbeat from core client for 30 sec - exiting
00:55:30 (2540): No heartbeat from core client for 30 sec - exiting
00:55:31 (2540): No heartbeat from core client for 30 sec - exiting
00:55:32 (2540): No heartbeat from core client for 30 sec - exiting
00:55:33 (2540): No heartbeat from core client for 30 sec - exiting
00:55:34 (2540): No heartbeat from core client for 30 sec - exiting
00:55:35 (2540): No heartbeat from core client for 30 sec - exiting
00:55:36 (2540): No heartbeat from core client for 30 sec - exiting
00:55:37 (2540): No heartbeat from core client for 30 sec - exiting
00:55:38 (2540): No heartbeat from core client for 30 sec - exiting
00:55:39 (2540): No heartbeat from core client for 30 sec - exiting
00:55:40 (2540): No heartbeat from core client for 30 sec - exiting
00:55:41 (2540): No heartbeat from core client for 30 sec - exiting
00:55:42 (2540): No heartbeat from core client for 30 sec - exiting
00:55:43 (2540): No heartbeat from core client for 30 sec - exiting
00:55:44 (2540): No heartbeat from core client for 30 sec - exiting
00:55:45 (2540): No heartbeat from core client for 30 sec - exiting
00:55:46 (2540): No heartbeat from core client for 30 sec - exiting
00:55:47 (2540): No heartbeat from core client for 30 sec - exiting
00:55:48 (2540): No heartbeat from core client for 30 sec - exiting
00:55:49 (2540): No heartbeat from core client for 30 sec - exiting
00:55:50 (2540): No heartbeat from core client for 30 sec - exiting
00:55:51 (2540): No heartbeat from core client for 30 sec - exiting
00:55:52 (2540): No heartbeat from core client for 30 sec - exiting
00:55:53 (2540): No heartbeat from core client for 30 sec - exiting
00:55:54 (2540): No heartbeat from core client for 30 sec - exiting
00:55:55 (2540): No heartbeat from core client for 30 sec - exiting
00:55:56 (2540): No heartbeat from core client for 30 sec - exiting
00:55:57 (2540): No heartbeat from core client for 30 sec - exiting
00:55:58 (2540): No heartbeat from core client for 30 sec - exiting
00:55:59 (2540): No heartbeat from core client for 30 sec - exiting
00:56:00 (2540): No heartbeat from core client for 30 sec - exiting
00:56:01 (2540): No heartbeat from core client for 30 sec - exiting
00:56:02 (2540): No heartbeat from core client for 30 sec - exiting
00:56:03 (2540): No heartbeat from core client for 30 sec - exiting
00:56:04 (2540): No heartbeat from core client for 30 sec - exiting
00:56:05 (2540): No heartbeat from core client for 30 sec - exiting
00:56:06 (2540): No heartbeat from core client for 30 sec - exiting
00:56:07 (2540): No heartbeat from core client for 30 sec - exiting
00:56:08 (2540): No heartbeat from core client for 30 sec - exiting
00:56:09 (2540): No heartbeat from core client for 30 sec - exiting
00:56:10 (2540): No heartbeat from core client for 30 sec - exiting
00:56:11 (2540): No heartbeat from core client for 30 sec - exiting
00:56:12 (2540): No heartbeat from core client for 30 sec - exiting
00:56:13 (2540): No heartbeat from core client for 30 sec - exiting
00:56:14 (2540): No heartbeat from core client for 30 sec - exiting
00:56:15 (2540): No heartbeat from core client for 30 sec - exiting
00:56:16 (2540): No heartbeat from core client for 30 sec - exiting
00:56:17 (2540): No heartbeat from core client for 30 sec - exiting
00:56:18 (2540): No heartbeat from core client for 30 sec - exiting
00:56:19 (2540): No heartbeat from core client for 30 sec - exiting
00:56:20 (2540): No heartbeat from core client for 30 sec - exiting
00:56:21 (2540): No heartbeat from core client for 30 sec - exiting
00:56:22 (2540): No heartbeat from core client for 30 sec - exiting
00:56:23 (2540): No heartbeat from core client for 30 sec - exiting
00:56:24 (2540): No heartbeat from core client for 30 sec - exiting
00:56:25 (2540): No heartbeat from core client for 30 sec - exiting
00:56:26 (2540): No heartbeat from core client for 30 sec - exiting
00:56:27 (2540): No heartbeat from core client for 30 sec - exiting
00:56:28 (2540): No heartbeat from core client for 30 sec - exiting
00:56:29 (2540): No heartbeat from core client for 30 sec - exiting
00:56:30 (2540): No heartbeat from core client for 30 sec - exiting
00:56:31 (2540): No heartbeat from core client for 30 sec - exiting
00:56:32 (2540): No heartbeat from core client for 30 sec - exiting
00:56:33 (2540): No heartbeat from core client for 30 sec - exiting
00:56:34 (2540): No heartbeat from core client for 30 sec - exiting
00:56:35 (2540): No heartbeat from core client for 30 sec - exiting
00:56:36 (2540): No heartbeat from core client for 30 sec - exiting
00:56:37 (2540): No heartbeat from core client for 30 sec - exiting
00:56:38 (2540): No heartbeat from core client for 30 sec - exiting
00:56:39 (2540): No heartbeat from core client for 30 sec - exiting
00:56:40 (2540): No heartbeat from core client for 30 sec - exiting
00:56:41 (2540): No heartbeat from core client for 30 sec - exiting
00:56:42 (2540): No heartbeat from core client for 30 sec - exiting
00:56:43 (2540): No heartbeat from core client for 30 sec - exiting
00:56:44 (2540): No heartbeat from core client for 30 sec - exiting
00:56:45 (2540): No heartbeat from core client for 30 sec - exiting
00:56:46 (2540): No heartbeat from core client for 30 sec - exiting
00:56:47 (2540): No heartbeat from core client for 30 sec - exiting
00:56:48 (2540): No heartbeat from core client for 30 sec - exiting
00:56:49 (2540): No heartbeat from core client for 30 sec - exiting
00:56:50 (2540): No heartbeat from core client for 30 sec - exiting
00:56:51 (2540): No heartbeat from core client for 30 sec - exiting
00:56:52 (2540): No heartbeat from core client for 30 sec - exiting
00:56:53 (2540): No heartbeat from core client for 30 sec - exiting
00:56:54 (2540): No heartbeat from core client for 30 sec - exiting
00:56:55 (2540): No heartbeat from core client for 30 sec - exiting
00:56:56 (2540): No heartbeat from core client for 30 sec - exiting
00:56:57 (2540): No heartbeat from core client for 30 sec - exiting
00:56:58 (2540): No heartbeat from core client for 30 sec - exiting
00:56:59 (2540): No heartbeat from core client for 30 sec - exiting
00:57:00 (2540): No heartbeat from core client for 30 sec - exiting
00:57:01 (2540): No heartbeat from core client for 30 sec - exiting
00:57:02 (2540): No heartbeat from core client for 30 sec - exiting
00:57:03 (2540): No heartbeat from core client for 30 sec - exiting
00:57:04 (2540): No heartbeat from core client for 30 sec - exiting
00:57:05 (2540): No heartbeat from core client for 30 sec - exiting
00:57:06 (2540): No heartbeat from core client for 30 sec - exiting
00:57:07 (2540): No heartbeat from core client for 30 sec - exiting
00:57:08 (2540): No heartbeat from core client for 30 sec - exiting
00:57:09 (2540): No heartbeat from core client for 30 sec - exiting
00:57:10 (2540): No heartbeat from core client for 30 sec - exiting
00:57:11 (2540): No heartbeat from core client for 30 sec - exiting
00:57:12 (2540): No heartbeat from core client for 30 sec - exiting
00:57:13 (2540): No heartbeat from core client for 30 sec - exiting
00:57:14 (2540): No heartbeat from core client for 30 sec - exiting
00:57:15 (2540): No heartbeat from core client for 30 sec - exiting
00:57:16 (2540): No heartbeat from core client for 30 sec - exiting
00:57:17 (2540): No heartbeat from core client for 30 sec - exiting
00:57:18 (2540): No heartbeat from core client for 30 sec - exiting
00:57:19 (2540): No heartbeat from core client for 30 sec - exiting
00:57:20 (2540): No heartbeat from core client for 30 sec - exiting
00:57:21 (2540): No heartbeat from core client for 30 sec - exiting
00:57:22 (2540): No heartbeat from core client for 30 sec - exiting
00:57:23 (2540): No heartbeat from core client for 30 sec - exiting
00:57:24 (2540): No heartbeat from core client for 30 sec - exiting
00:57:25 (2540): No heartbeat from core client for 30 sec - exiting
00:57:26 (2540): No heartbeat from core client for 30 sec - exiting
00:57:27 (2540): No heartbeat from core client for 30 sec - exiting
00:57:28 (2540): No heartbeat from core client for 30 sec - exiting
00:57:29 (2540): No heartbeat from core client for 30 sec - exiting
00:57:30 (2540): No heartbeat from core client for 30 sec - exiting
00:57:31 (2540): No heartbeat from core client for 30 sec - exiting
00:57:32 (2540): No heartbeat from core client for 30 sec - exiting
00:57:33 (2540): No heartbeat from core client for 30 sec - exiting
00:57:34 (2540): No heartbeat from core client for 30 sec - exiting
00:57:35 (2540): No heartbeat from core client for 30 sec - exiting
00:57:36 (2540): No heartbeat from core client for 30 sec - exiting
00:57:37 (2540): No heartbeat from core client for 30 sec - exiting
00:57:38 (2540): No heartbeat from core client for 30 sec - exiting
00:57:39 (2540): No heartbeat from core client for 30 sec - exiting
00:57:40 (2540): No heartbeat from core client for 30 sec - exiting
00:57:41 (2540): No heartbeat from core client for 30 sec - exiting
00:57:42 (2540): No heartbeat from core client for 30 sec - exiting
00:57:43 (2540): No heartbeat from core client for 30 sec - exiting
00:57:44 (2540): No heartbeat from core client for 30 sec - exiting
00:57:45 (2540): No heartbeat from core client for 30 sec - exiting
00:57:46 (2540): No heartbeat from core client for 30 sec - exiting
00:57:47 (2540): No heartbeat from core client for 30 sec - exiting
00:57:48 (2540): No heartbeat from core client for 30 sec - exiting
00:57:49 (2540): No heartbeat from core client for 30 sec - exiting
00:57:50 (2540): No heartbeat from core client for 30 sec - exiting
00:57:51 (2540): No heartbeat from core client for 30 sec - exiting
00:57:52 (2540): No heartbeat from core client for 30 sec - exiting
00:57:53 (2540): No heartbeat from core client for 30 sec - exiting
00:57:54 (2540): No heartbeat from core client for 30 sec - exiting
00:57:55 (2540): No heartbeat from core client for 30 sec - exiting
00:57:56 (2540): No heartbeat from core client for 30 sec - exiting
00:57:57 (2540): No heartbeat from core client for 30 sec - exiting
00:57:58 (2540): No heartbeat from core client for 30 sec - exiting
00:57:59 (2540): No heartbeat from core client for 30 sec - exiting
00:58:00 (2540): No heartbeat from core client for 30 sec - exiting
00:58:01 (2540): No heartbeat from core client for 30 sec - exiting
00:58:02 (2540): No heartbeat from core client for 30 sec - exiting
00:58:03 (2540): No heartbeat from core client for 30 sec - exiting
00:58:04 (2540): No heartbeat from core client for 30 sec - exiting
00:58:05 (2540): No heartbeat from core client for 30 sec - exiting
00:58:06 (2540): No heartbeat from core client for 30 sec - exiting
00:58:07 (2540): No heartbeat from core client for 30 sec - exiting
00:58:08 (2540): No heartbeat from core client for 30 sec - exiting
00:58:09 (2540): No heartbeat from core client for 30 sec - exiting
00:58:10 (2540): No heartbeat from core client for 30 sec - exiting
00:58:11 (2540): No heartbeat from core client for 30 sec - exiting
00:58:12 (2540): No heartbeat from core client for 30 sec - exiting
00:58:13 (2540): No heartbeat from core client for 30 sec - exiting
00:58:14 (2540): No heartbeat from core client for 30 sec - exiting
00:58:15 (2540): No heartbeat from core client for 30 sec - exiting
00:58:16 (2540): No heartbeat from core client for 30 sec - exiting
00:58:17 (2540): No heartbeat from core client for 30 sec - exiting
00:58:18 (2540): No heartbeat from core client for 30 sec - exiting
00:58:19 (2540): No heartbeat from core client for 30 sec - exiting
00:58:20 (2540): No heartbeat from core client for 30 sec - exiting
00:58:21 (2540): No heartbeat from core client for 30 sec - exiting
00:58:22 (2540): No heartbeat from core client for 30 sec - exiting
00:58:23 (2540): No heartbeat from core client for 30 sec - exiting
00:58:24 (2540): No heartbeat from core client for 30 sec - exiting
00:58:25 (2540): No heartbeat from core client for 30 sec - exiting
00:58:26 (2540): No heartbeat from core client for 30 sec - exiting
00:58:27 (2540): No heartbeat from core client for 30 sec - exiting
00:58:28 (2540): No heartbeat from core client for 30 sec - exiting
00:58:29 (2540): No heartbeat from core client for 30 sec - exiting
00:58:30 (2540): No heartbeat from core client for 30 sec - exiting
00:58:31 (2540): No heartbeat from core client for 30 sec - exiting
00:58:32 (2540): No heartbeat from core client for 30 sec - exiting
00:58:33 (2540): No heartbeat from core client for 30 sec - exiting
00:58:34 (2540): No heartbeat from core client for 30 sec - exiting
00:58:35 (2540): No heartbeat from core client for 30 sec - exiting
00:58:36 (2540): No heartbeat from core client for 30 sec - exiting
00:58:37 (2540): No heartbeat from core client for 30 sec - exiting
00:58:38 (2540): No heartbeat from core client for 30 sec - exiting
00:58:39 (2540): No heartbeat from core client for 30 sec - exiting
00:58:40 (2540): No heartbeat from core client for 30 sec - exiting
00:58:41 (2540): No heartbeat from core client for 30 sec - exiting
00:58:42 (2540): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	08:51:45 PM	No files match the supplied pattern.
MainError:	08:51:45 PM	No files match the supplied pattern.
MainError:	07:41:54 AM	No files match the supplied pattern.
MainError:	07:41:54 AM	No files match the supplied pattern.
MainError:	06:34:40 PM	No files match the supplied pattern.
MainError:	06:34:40 PM	No files match the supplied pattern.
MainError:	05:36:40 AM	No files match the supplied pattern.
MainError:	05:36:40 AM	No files match the supplied pattern.
MainError:	04:34:19 PM	No files match the supplied pattern.
MainError:	04:34:19 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	03:23:19 AM	No files match the supplied pattern.
MainError:	03:23:19 AM	No files match the supplied pattern.
MainError:	02:27:14 PM	No files match the supplied pattern.
MainError:	02:27:14 PM	No files match the supplied pattern.
MainError:	01:31:23 AM	No files match the supplied pattern.
MainError:	01:31:23 AM	No files match the supplied pattern.
MainError:	12:28:17 AM	No files match the supplied pattern.
MainError:	12:28:17 AM	No files match the supplied pattern.
MainError:	11:22:36 PM	No files match the supplied pattern.
MainError:	11:22:36 PM	No files match the supplied pattern.
Error converting file to netcdf: dataout/o4oeka.ph11c10
Error converting file to netcdf: dataout/o4oeka.pg11c10
Error converting file to netcdf: dataout/o4oeka.pe11c10
MainError:	10:16:32 AM	No files match the supplied pattern.
MainError:	10:16:32 AM	No files match the supplied pattern.
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
06 Jun 2013 11:02:14 1192587 15789110 hadcm3n_o4oe_2140_40_008269371_3 777,600 1,138,755 1.4644
06 Jun 2013 00:12:28 1192587 15789110 hadcm3n_o4oe_2140_40_008269371_3 751,680 1,099,964 1.4633
05 Jun 2013 13:17:20 1192587 15789110 hadcm3n_o4oe_2140_40_008269371_3 725,760 1,061,338 1.4624
05 Jun 2013 02:12:33 1192587 15789110 hadcm3n_o4oe_2140_40_008269371_3 699,840 1,022,745 1.4614
04 Jun 2013 15:12:43 1192587 15789110 hadcm3n_o4oe_2140_40_008269371_3 673,920 984,108 1.4603
04 Jun 2013 04:02:24 1192587 15789110 hadcm3n_o4oe_2140_40_008269371_3 648,000 945,481 1.4591
03 Jun 2013 17:13:39 1192587 15789110 hadcm3n_o4oe_2140_40_008269371_3 622,080 906,964 1.4580
03 Jun 2013 06:11:23 1192587 15789110 hadcm3n_o4oe_2140_40_008269371_3 596,160 868,373 1.4566
02 Jun 2013 19:00:53 1192587 15789110 hadcm3n_o4oe_2140_40_008269371_3 570,240 829,682 1.4550
02 Jun 2013 08:03:29 1192587 15789110 hadcm3n_o4oe_2140_40_008269371_3 544,320 791,030 1.4532
01 Jun 2013 20:58:59 1192587 15789110 hadcm3n_o4oe_2140_40_008269371_3 518,400 752,406 1.4514
01 Jun 2013 09:59:42 1192587 15789110 hadcm3n_o4oe_2140_40_008269371_3 492,480 713,809 1.4494
31 May 2013 22:55:23 1192587 15789110 hadcm3n_o4oe_2140_40_008269371_3 466,560 675,181 1.4471
31 May 2013 12:52:52 1192587 15789110 hadcm3n_o4oe_2140_40_008269371_3 440,640 636,591 1.4447
31 May 2013 01:53:35 1192587 15789110 hadcm3n_o4oe_2140_40_008269371_3 414,720 597,914 1.4417
30 May 2013 15:13:10 1192587 15789110 hadcm3n_o4oe_2140_40_008269371_3 388,800 559,340 1.4386
30 May 2013 03:26:47 1192587 15789110 hadcm3n_o4oe_2140_40_008269371_3 362,880 520,721 1.4350
29 May 2013 07:17:29 1192587 15789110 hadcm3n_o4oe_2140_40_008269371_3 336,960 482,415 1.4317
28 May 2013 20:11:35 1192587 15789110 hadcm3n_o4oe_2140_40_008269371_3 311,040 444,080 1.4277
28 May 2013 10:24:15 1192587 15789110 hadcm3n_o4oe_2140_40_008269371_3 285,120 405,807 1.4233


©2024 climateprediction.net