climateprediction.net home page
Task 16600630

Task 16600630

Name hadcm3n_8e39_1980_40_008727680_1
Workunit 8873658
Created 27 Apr 2014, 5:30:10 UTC
Sent 27 Apr 2014, 6:16:35 UTC
Report deadline 27 Jul 2014, 13:43:46 UTC
Received 14 Jul 2014, 7:17:05 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1290358
Run time 25 days 10 hours 49 min 45 sec
CPU time 25 days 0 hours 35 min 29 sec
Validate state Invalid
Credit 12,441.60
Device peak FLOPS 2.40 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.2.42</core_client_version>
<![CDATA[
<message>
The device does not recognize the command.
 (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:10:24 (5540): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:53:53 (5820): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:42:04 (5900): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:13:31 (5588): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:40:21 (6352): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
21:44:23 (6216): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:30:00 (2572): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
11:15:29 (6744): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:31:02 (4992): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:17:47 (7436): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:55:04 (4808): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:32:40 (4728): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
12:34:11 (7600): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:03:34 (6868): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
05:05:48 (4816): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
18:29:20 (4524): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:31:45 (2160): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:32:32 (8296): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
01:06:59 (4328): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:58:54 (6132): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
08:29:47 (5976): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
04:23:53 (5332): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
17:29:14 (6140): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:29:49 (3892): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:30:46 (5856): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:58:03 (5924): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
08:22:45 (6112): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
08:39:28 (6916): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
18:56:00 (4656): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:28:27 (6092): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
08:08:21 (5324): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
08:33:50 (6336): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:36:06 (6076): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
BUFFIN: C I/O Error feof - Unit 60 - Return code = 16
BUFFIN: C I/O Error feof - Unit 61 - Return code = 16
BUFFIN: C I/O Error feof - Unit 62 - Return code = 16
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Error converting file to netcdf: dataout/8e39ko.pjm0c10
Error converting file to netcdf: dataout/8e39ko.pim0c10
Error converting file to netcdf: dataout/8e39ko.pfm0c10
Error converting file to netcdf: dataout/8e39ko.pcm0c10
Error converting file to netcdf: dataout/8e39ko.pbm0c10
Error converting file to netcdf: dataout/8e39ko.pam0c10
Error converting file to netcdf: dataout/8e39ka.phm0c10
Error converting file to netcdf: dataout/8e39ka.pgm0c10
Error converting file to netcdf: dataout/8e39ka.pem0c10
Error converting file to netcdf: dataout/8e39ka.pdm0c10
BUFFIN: C I/O Error feof - Unit 60 - Return code = 16
BUFFIN: C I/O Error feof - Unit 61 - Return code = 16
BUFFIN: C I/O Error feof - Unit 62 - Return code = 16
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Error converting file to netcdf: dataout/8e39ko.pjm0c10
Error converting file to netcdf: dataout/8e39ko.pim0c10
Error converting file to netcdf: dataout/8e39ko.pfm0c10
Error converting file to netcdf: dataout/8e39ko.pcm0c10
Error converting file to netcdf: dataout/8e39ko.pbm0c10
Error converting file to netcdf: dataout/8e39ko.pam0c10
Error converting file to netcdf: dataout/8e39ka.phm0c10
Error converting file to netcdf: dataout/8e39ka.pgm0c10
Error converting file to netcdf: dataout/8e39ka.pem0c10
Error converting file to netcdf: dataout/8e39ka.pdm0c10
08:15:35 (6492): No heartbeat from core client for 30 sec - exiting
08:15:36 (6492): No heartbeat from core client for 30 sec - exiting
08:15:37 (6492): No heartbeat from core client for 30 sec - exiting
08:15:38 (6492): No heartbeat from core client for 30 sec - exiting
08:15:39 (6492): No heartbeat from core client for 30 sec - exiting
08:15:41 (6492): No heartbeat from core client for 30 sec - exiting
08:15:42 (6492): No heartbeat from core client for 30 sec - exiting
08:15:43 (6492): No heartbeat from core client for 30 sec - exiting
08:15:44 (6492): No heartbeat from core client for 30 sec - exiting
08:15:45 (6492): No heartbeat from core client for 30 sec - exiting
08:15:46 (6492): No heartbeat from core client for 30 sec - exiting
08:15:47 (6492): No heartbeat from core client for 30 sec - exiting
08:15:48 (6492): No heartbeat from core client for 30 sec - exiting
08:15:49 (6492): No heartbeat from core client for 30 sec - exiting
08:15:50 (6492): No heartbeat from core client for 30 sec - exiting
08:15:51 (6492): No heartbeat from core client for 30 sec - exiting
08:15:53 (6492): No heartbeat from core client for 30 sec - exiting
08:15:54 (6492): No heartbeat from core client for 30 sec - exiting
08:15:55 (6492): No heartbeat from core client for 30 sec - exiting
08:15:56 (6492): No heartbeat from core client for 30 sec - exiting
08:15:57 (6492): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_8e39_1980_40_008727680/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_8e39_1980_40_008727680/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_8e39_1980_40_008727680/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_8e39_1980_40_008727680/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_8e39_1980_40_008727680/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_8e39_1980_40_008727680/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_8e39_1980_40_008727680/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_8e39_1980_40_008727680/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_8e39_1980_40_008727680/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_8e39_1980_40_008727680/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_8e39_1980_40_008727680/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_8e39_1980_40_008727680/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Jul 2014 06:19:50 1290358 16600630 hadcm3n_8e39_1980_40_008727680_1 1,036,800 2,162,164 2.0854
24 Jun 2014 09:42:34 1290358 16600630 hadcm3n_8e39_1980_40_008727680_1 1,010,880 2,107,877 2.0852
23 Jun 2014 17:59:49 1290358 16600630 hadcm3n_8e39_1980_40_008727680_1 984,960 2,055,130 2.0865
16 Jun 2014 17:19:13 1290358 16600630 hadcm3n_8e39_1980_40_008727680_1 959,040 2,002,789 2.0883
10 Jun 2014 09:04:20 1290358 16600630 hadcm3n_8e39_1980_40_008727680_1 933,120 1,948,397 2.0880
10 Jun 2014 09:03:28 1290358 16600630 hadcm3n_8e39_1980_40_008727680_1 907,200 1,894,068 2.0878
10 Jun 2014 09:02:35 1290358 16600630 hadcm3n_8e39_1980_40_008727680_1 881,280 1,842,709 2.0909
10 Jun 2014 09:01:35 1290358 16600630 hadcm3n_8e39_1980_40_008727680_1 855,360 1,789,279 2.0918
10 Jun 2014 07:11:18 1290358 16600630 hadcm3n_8e39_1980_40_008727680_1 829,440 1,733,696 2.0902
08 Jun 2014 15:06:26 1290358 16600630 hadcm3n_8e39_1980_40_008727680_1 803,520 1,679,865 2.0906
06 Jun 2014 10:38:04 1290358 16600630 hadcm3n_8e39_1980_40_008727680_1 777,600 1,624,133 2.0886
05 Jun 2014 18:34:38 1290358 16600630 hadcm3n_8e39_1980_40_008727680_1 751,680 1,567,900 2.0859
03 Jun 2014 16:53:08 1290358 16600630 hadcm3n_8e39_1980_40_008727680_1 725,760 1,511,596 2.0828
01 Jun 2014 14:09:58 1290358 16600630 hadcm3n_8e39_1980_40_008727680_1 699,840 1,456,415 2.0811
31 May 2014 21:56:05 1290358 16600630 hadcm3n_8e39_1980_40_008727680_1 673,920 1,400,737 2.0785
31 May 2014 06:10:56 1290358 16600630 hadcm3n_8e39_1980_40_008727680_1 648,000 1,346,699 2.0782
30 May 2014 15:19:26 1290358 16600630 hadcm3n_8e39_1980_40_008727680_1 622,080 1,296,625 2.0843
26 May 2014 18:04:13 1290358 16600630 hadcm3n_8e39_1980_40_008727680_1 596,160 1,248,338 2.0940
24 May 2014 23:19:42 1290358 16600630 hadcm3n_8e39_1980_40_008727680_1 570,240 1,199,989 2.1044
24 May 2014 09:31:41 1290358 16600630 hadcm3n_8e39_1980_40_008727680_1 544,320 1,151,210 2.1150


©2024 climateprediction.net