climateprediction.net home page
Task 15718695

Task 15718695

Name hadcm3n_o4kx_2140_40_008269313_2
Workunit 8424437
Created 9 Apr 2013, 11:46:11 UTC
Sent 9 Apr 2013, 11:46:21 UTC
Report deadline 9 Jul 2013, 19:13:32 UTC
Received 20 May 2013, 8:39:08 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1179428
Run time 14 days 10 hours 19 min 42 sec
CPU time 14 days 4 hours 52 min 14 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 2.31 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:47:59 (2556): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:48:50 (3348): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:38:38 (3600): No heartbeat from core client for 30 sec - exiting
12:38:39 (3600): No heartbeat from core client for 30 sec - exiting
12:38:40 (3600): No heartbeat from core client for 30 sec - exiting
12:38:41 (3600): No heartbeat from core client for 30 sec - exiting
12:38:43 (3600): No heartbeat from core client for 30 sec - exiting
12:38:44 (3600): No heartbeat from core client for 30 sec - exiting
12:38:45 (3600): No heartbeat from core client for 30 sec - exiting
12:38:46 (3600): No heartbeat from core client for 30 sec - exiting
12:38:47 (3600): No heartbeat from core client for 30 sec - exiting
12:38:48 (3600): No heartbeat from core client for 30 sec - exiting
12:38:49 (3600): No heartbeat from core client for 30 sec - exiting
12:38:50 (3600): No heartbeat from core client for 30 sec - exiting
12:38:51 (3600): No heartbeat from core client for 30 sec - exiting
12:38:52 (3600): No heartbeat from core client for 30 sec - exiting
12:38:53 (3600): No heartbeat from core client for 30 sec - exiting
12:38:55 (3600): No heartbeat from core client for 30 sec - exiting
12:38:56 (3600): No heartbeat from core client for 30 sec - exiting
12:38:57 (3600): No heartbeat from core client for 30 sec - exiting
12:38:58 (3600): No heartbeat from core client for 30 sec - exiting
12:38:59 (3600): No heartbeat from core client for 30 sec - exiting
12:39:00 (3600): No heartbeat from core client for 30 sec - exiting
12:39:01 (3600): No heartbeat from core client for 30 sec - exiting
12:39:02 (3600): No heartbeat from core client for 30 sec - exiting
12:39:03 (3600): No heartbeat from core client for 30 sec - exiting
12:39:04 (3600): No heartbeat from core client for 30 sec - exiting
12:39:06 (3600): No heartbeat from core client for 30 sec - exiting
12:39:07 (3600): No heartbeat from core client for 30 sec - exiting
12:39:08 (3600): No heartbeat from core client for 30 sec - exiting
12:39:09 (3600): No heartbeat from core client for 30 sec - exiting
12:39:10 (3600): No heartbeat from core client for 30 sec - exiting
12:39:11 (3600): No heartbeat from core client for 30 sec - exiting
12:39:12 (3600): No heartbeat from core client for 30 sec - exiting
12:39:13 (3600): No heartbeat from core client for 30 sec - exiting
12:39:14 (3600): No heartbeat from core client for 30 sec - exiting
12:39:15 (3600): No heartbeat from core client for 30 sec - exiting
12:39:16 (3600): No heartbeat from core client for 30 sec - exiting
12:39:18 (3600): No heartbeat from core client for 30 sec - exiting
12:39:19 (3600): No heartbeat from core client for 30 sec - exiting
12:39:20 (3600): No heartbeat from core client for 30 sec - exiting
12:39:21 (3600): No heartbeat from core client for 30 sec - exiting
12:39:22 (3600): No heartbeat from core client for 30 sec - exiting
12:39:23 (3600): No heartbeat from core client for 30 sec - exiting
12:39:24 (3600): No heartbeat from core client for 30 sec - exiting
12:39:25 (3600): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:39:26 (3600): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	10:05:41 AM	No files match the supplied pattern.
MainError:	10:05:41 AM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	11:09:19 AM	No files match the supplied pattern.
MainError:	11:09:19 AM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	08:40:01 AM	No files match the supplied pattern.
MainError:	08:40:01 AM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	12:50:31 AM	No files match the supplied pattern.
MainError:	12:50:31 AM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
15:18:05 (2652): No heartbeat from core client for 30 sec - exiting
15:18:06 (2652): No heartbeat from core client for 30 sec - exiting
15:18:07 (2652): No heartbeat from core client for 30 sec - exiting
15:18:08 (2652): No heartbeat from core client for 30 sec - exiting
15:18:09 (2652): No heartbeat from core client for 30 sec - exiting
15:18:10 (2652): No heartbeat from core client for 30 sec - exiting
15:18:11 (2652): No heartbeat from core client for 30 sec - exiting
15:18:12 (2652): No heartbeat from core client for 30 sec - exiting
15:18:13 (2652): No heartbeat from core client for 30 sec - exiting
15:18:15 (2652): No heartbeat from core client for 30 sec - exiting
15:18:16 (2652): No heartbeat from core client for 30 sec - exiting
15:18:17 (2652): No heartbeat from core client for 30 sec - exiting
15:18:18 (2652): No heartbeat from core client for 30 sec - exiting
15:18:19 (2652): No heartbeat from core client for 30 sec - exiting
15:18:20 (2652): No heartbeat from core client for 30 sec - exiting
15:18:21 (2652): No heartbeat from core client for 30 sec - exiting
15:18:22 (2652): No heartbeat from core client for 30 sec - exiting
15:18:23 (2652): No heartbeat from core client for 30 sec - exiting
15:18:24 (2652): No heartbeat from core client for 30 sec - exiting
15:18:26 (2652): No heartbeat from core client for 30 sec - exiting
15:18:27 (2652): No heartbeat from core client for 30 sec - exiting
15:18:28 (2652): No heartbeat from core client for 30 sec - exiting
15:18:29 (2652): No heartbeat from core client for 30 sec - exiting
15:18:30 (2652): No heartbeat from core client for 30 sec - exiting
15:18:31 (2652): No heartbeat from core client for 30 sec - exiting
15:18:32 (2652): No heartbeat from core client for 30 sec - exiting
15:18:33 (2652): No heartbeat from core client for 30 sec - exiting
15:18:34 (2652): No heartbeat from core client for 30 sec - exiting
15:18:35 (2652): No heartbeat from core client for 30 sec - exiting
15:18:36 (2652): No heartbeat from core client for 30 sec - exiting
15:18:38 (2652): No heartbeat from core client for 30 sec - exiting
15:18:39 (2652): No heartbeat from core client for 30 sec - exiting
15:18:40 (2652): No heartbeat from core client for 30 sec - exiting
15:18:41 (2652): No heartbeat from core client for 30 sec - exiting
15:18:42 (2652): No heartbeat from core client for 30 sec - exiting
15:18:43 (2652): No heartbeat from core client for 30 sec - exiting
15:18:44 (2652): No heartbeat from core client for 30 sec - exiting
15:18:45 (2652): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	06:53:07 AM	No files match the supplied pattern.
MainError:	06:53:07 AM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	08:18:53 AM	No files match the supplied pattern.
MainError:	08:18:53 AM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	11:16:23 AM	No files match the supplied pattern.
MainError:	11:16:23 AM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	04:18:56 PM	No files match the supplied pattern.
MainError:	04:18:56 PM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	04:52:42 PM	No files match the supplied pattern.
MainError:	04:52:42 PM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	02:57:47 PM	No files match the supplied pattern.
MainError:	02:57:47 PM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: dataout/o4kxka.ph11c10
Error converting file to netcdf: dataout/o4kxka.pg11c10
Error converting file to netcdf: dataout/o4kxka.pe11c10
MainError:	07:43:37 AM	No files match the supplied pattern.
MainError:	07:43:37 AM	No files match the supplied pattern.
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
19 May 2013 07:46:51 1179428 15718695 hadcm3n_o4kx_2140_40_008269313_2 777,600 1,227,076 1.5780
17 May 2013 15:02:47 1179428 15718695 hadcm3n_o4kx_2140_40_008269313_2 751,680 1,185,746 1.5775
16 May 2013 16:57:04 1179428 15718695 hadcm3n_o4kx_2140_40_008269313_2 725,760 1,145,193 1.5779
15 May 2013 16:23:20 1179428 15718695 hadcm3n_o4kx_2140_40_008269313_2 699,840 1,104,999 1.5789
14 May 2013 11:19:38 1179428 15718695 hadcm3n_o4kx_2140_40_008269313_2 673,920 1,064,151 1.5790
13 May 2013 08:23:34 1179428 15718695 hadcm3n_o4kx_2140_40_008269313_2 648,000 1,024,171 1.5805
12 May 2013 06:55:26 1179428 15718695 hadcm3n_o4kx_2140_40_008269313_2 622,080 983,622 1.5812
10 May 2013 12:53:02 1179428 15718695 hadcm3n_o4kx_2140_40_008269313_2 596,160 943,743 1.5830
09 May 2013 08:41:04 1179428 15718695 hadcm3n_o4kx_2140_40_008269313_2 570,240 902,849 1.5833
07 May 2013 11:12:16 1179428 15718695 hadcm3n_o4kx_2140_40_008269313_2 544,320 862,152 1.5839
06 May 2013 10:08:47 1179428 15718695 hadcm3n_o4kx_2140_40_008269313_2 518,400 820,809 1.5834
04 May 2013 12:16:54 1179428 15718695 hadcm3n_o4kx_2140_40_008269313_2 492,480 778,917 1.5816
03 May 2013 09:43:59 1179428 15718695 hadcm3n_o4kx_2140_40_008269313_2 466,560 737,507 1.5807
02 May 2013 05:44:57 1179428 15718695 hadcm3n_o4kx_2140_40_008269313_2 440,640 696,733 1.5812
30 Apr 2013 14:40:30 1179428 15718695 hadcm3n_o4kx_2140_40_008269313_2 414,720 655,733 1.5811
29 Apr 2013 10:23:13 1179428 15718695 hadcm3n_o4kx_2140_40_008269313_2 388,800 614,759 1.5812
28 Apr 2013 07:05:39 1179428 15718695 hadcm3n_o4kx_2140_40_008269313_2 362,880 573,648 1.5808
26 Apr 2013 10:33:31 1179428 15718695 hadcm3n_o4kx_2140_40_008269313_2 336,960 532,415 1.5801
25 Apr 2013 10:12:38 1179428 15718695 hadcm3n_o4kx_2140_40_008269313_2 311,040 490,637 1.5774
24 Apr 2013 11:25:59 1179428 15718695 hadcm3n_o4kx_2140_40_008269313_2 285,120 448,398 1.5727


©2024 climateprediction.net