climateprediction.net home page
Task 12995098

Task 12995098

Name hadcm3n_o0gt_1940_40_007301541_1
Workunit 7498965
Created 22 Jun 2011, 13:48:43 UTC
Sent 22 Jun 2011, 13:48:49 UTC
Report deadline 21 Sep 2011, 21:16:00 UTC
Received 15 Jul 2011, 16:12:47 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1081394
Run time 11 days 23 hours 58 min 56 sec
CPU time 10 days 16 hours 18 min 56 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.83 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.12.33</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
17:41:10 (16250): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:47:25 (16377): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
06:02:40 (22045): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:03:24 (22730): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:04:46 (22852): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:05:34 (22925): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:13:39 (23002): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:59:19 (23610): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:08:47 (27054): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:11:34 (28143): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:12:13 (28215): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:13:14 (28735): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:17:33 (29789): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:22:13 (30163): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:43:52 (30562): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:44:32 (32188): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:02:41 (32330): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:05:37 (1224): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
17:19:47 (14716): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:21:38 (15288): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:22:26 (28893): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:23:47 (29017): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:25:11 (29126): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:32:46 (29234): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:39:40 (29753): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:14:28 (30281): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:35:39 (1394): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:40:40 (2037): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:02:46 (6882): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
03:43:06 (22421): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_o0gt_1940_40_007301541/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_o0gt_1940_40_007301541/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_o0gt_1940_40_007301541/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_o0gt_1940_40_007301541/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_o0gt_1940_40_007301541/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_o0gt_1940_40_007301541/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_o0gt_1940_40_007301541/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_o0gt_1940_40_007301541/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_o0gt_1940_40_007301541/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_o0gt_1940_40_007301541/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_o0gt_1940_40_007301541/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_o0gt_1940_40_007301541/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_o0gt_1940_40_007301541/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_o0gt_1940_40_007301541/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
25 Jul 2011 14:12:42 1081394 12995098 hadcm3n_o0gt_1940_40_007301541_1 518,400 922,752 1.7800
10 Jul 2011 22:19:43 1081394 12995098 hadcm3n_o0gt_1940_40_007301541_1 492,480 878,644 1.7841
09 Jul 2011 22:07:33 1081394 12995098 hadcm3n_o0gt_1940_40_007301541_1 466,560 833,866 1.7873
09 Jul 2011 08:20:12 1081394 12995098 hadcm3n_o0gt_1940_40_007301541_1 440,640 789,356 1.7914
08 Jul 2011 22:05:18 1081394 12995098 hadcm3n_o0gt_1940_40_007301541_1 414,720 744,738 1.7958
05 Jul 2011 19:15:34 1081394 12995098 hadcm3n_o0gt_1940_40_007301541_1 388,800 700,315 1.8012
05 Jul 2011 03:52:04 1081394 12995098 hadcm3n_o0gt_1940_40_007301541_1 362,880 655,796 1.8072
04 Jul 2011 13:52:08 1081394 12995098 hadcm3n_o0gt_1940_40_007301541_1 336,960 610,797 1.8127
03 Jul 2011 18:38:18 1081394 12995098 hadcm3n_o0gt_1940_40_007301541_1 311,040 565,891 1.8194
03 Jul 2011 01:01:44 1081394 12995098 hadcm3n_o0gt_1940_40_007301541_1 285,120 519,998 1.8238
29 Jun 2011 10:39:43 1081394 12995098 hadcm3n_o0gt_1940_40_007301541_1 259,200 474,228 1.8296
28 Jun 2011 18:45:02 1081394 12995098 hadcm3n_o0gt_1940_40_007301541_1 233,280 426,994 1.8304
28 Jun 2011 03:40:11 1081394 12995098 hadcm3n_o0gt_1940_40_007301541_1 207,360 379,592 1.8306
27 Jun 2011 13:00:12 1081394 12995098 hadcm3n_o0gt_1940_40_007301541_1 181,440 332,113 1.8304
26 Jun 2011 22:20:49 1081394 12995098 hadcm3n_o0gt_1940_40_007301541_1 155,520 284,074 1.8266
26 Jun 2011 06:28:30 1081394 12995098 hadcm3n_o0gt_1940_40_007301541_1 129,600 235,730 1.8189
25 Jun 2011 11:08:55 1081394 12995098 hadcm3n_o0gt_1940_40_007301541_1 103,680 187,896 1.8123
24 Jun 2011 14:34:20 1081394 12995098 hadcm3n_o0gt_1940_40_007301541_1 77,760 140,348 1.8049
23 Jun 2011 21:49:22 1081394 12995098 hadcm3n_o0gt_1940_40_007301541_1 51,840 93,383 1.8014
23 Jun 2011 06:26:24 1081394 12995098 hadcm3n_o0gt_1940_40_007301541_1 25,920 47,187 1.8205


©2024 climateprediction.net