climateprediction.net home page
Task 13516648

Task 13516648

Name hadcm3n_0041_1900_40_007486342_2
Workunit 7683817
Created 25 Oct 2011, 15:25:41 UTC
Sent 25 Oct 2011, 15:26:00 UTC
Report deadline 24 Jan 2012, 22:53:11 UTC
Received 5 Nov 2011, 10:53:23 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1129554
Run time 10 days 19 hours 13 min 27 sec
CPU time 5 days 14 hours 38 min 3 sec
Validate state Invalid
Credit 4,043.52
Device peak FLOPS 1.88 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.10.59</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
01:32:43 (13154): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:42:50 (29859): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so: cannot open shared object file: No such file or directory
Suspended CPDN Monitor - Suspend request from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so: cannot open shared object file: No such file or directory
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so: cannot open shared object file: No such file or directory
OPEN:  File Creation Failed: Permission denied
OPEN:  Unable to Open File dataout/0041ka.dab46e0 for Read/Write

Model crashed: DUMPCTL : Fail to open output dump - may already exist                                                                                                                                                                                                          tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_0041_1900_40_007486342/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_0041_1900_40_007486342/jobs/xabnk.namelists after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_0041_1900_40_007486342/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_0041_1900_40_007486342/dataout/ocean_restart.day after 11 attempts
Could not change to slots dir /var/lib/boinc-client/slots/0
12:52:17 (29982): Can't open init data file - running in standalone mode
execl(/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu, 127875) failed!
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=29982, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_0041_1900_40_007486342/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_0041_1900_40_007486342/jobs/xabnk.namelists after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_0041_1900_40_007486342/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_0041_1900_40_007486342/dataout/ocean_restart.day after 11 attempts
Could not change to slots dir /var/lib/boinc-client/slots/0
12:52:25 (29982): Can't open init data file - running in standalone mode
execl(/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu, 127875) failed!
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=29982, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_0041_1900_40_007486342/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_0041_1900_40_007486342/jobs/xabnk.namelists after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_0041_1900_40_007486342/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_0041_1900_40_007486342/dataout/ocean_restart.day after 11 attempts
Could not change to slots dir /var/lib/boinc-client/slots/0
12:52:33 (29982): Can't open init data file - running in standalone mode
execl(/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu, 127875) failed!
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=29982, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_0041_1900_40_007486342/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_0041_1900_40_007486342/jobs/xabnk.namelists after 11 attempts
Could not change to slots dir /var/lib/boinc-client/slots/0
12:52:40 (29982): Can't open init data file - running in standalone mode
execl(/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu, 127875) failed!
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=29982, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu after 11 attempts
execl(/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu, 127875) failed!
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=29982, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
05 Nov 2011 01:10:26 1129554 13516648 hadcm3n_0041_1900_40_007486342_2 336,960 449,606 1.3343
04 Nov 2011 06:51:56 1129554 13516648 hadcm3n_0041_1900_40_007486342_2 311,040 383,914 1.2343
03 Nov 2011 12:38:32 1129554 13516648 hadcm3n_0041_1900_40_007486342_2 285,120 318,342 1.1165
02 Nov 2011 18:48:11 1129554 13516648 hadcm3n_0041_1900_40_007486342_2 259,200 252,463 0.9740
02 Nov 2011 00:42:18 1129554 13516648 hadcm3n_0041_1900_40_007486342_2 233,280 185,753 0.7963
01 Nov 2011 05:29:57 1129554 13516648 hadcm3n_0041_1900_40_007486342_2 207,360 119,639 0.5770
31 Oct 2011 19:43:52 1129554 13516648 hadcm3n_0041_1900_40_007486342_2 181,440 51,181 0.2821
31 Oct 2011 19:15:40 1129554 13516648 hadcm3n_0041_1900_40_007486342_2 155,520 49,148 0.3160
31 Oct 2011 18:46:40 1129554 13516648 hadcm3n_0041_1900_40_007486342_2 129,600 358,529 2.7664
31 Oct 2011 18:19:22 1129554 13516648 hadcm3n_0041_1900_40_007486342_2 103,680 286,209 2.7605
31 Oct 2011 17:25:37 1129554 13516648 hadcm3n_0041_1900_40_007486342_2 77,760 214,460 2.7580
31 Oct 2011 16:58:01 1129554 13516648 hadcm3n_0041_1900_40_007486342_2 51,840 142,177 2.7426
31 Oct 2011 15:57:15 1129554 13516648 hadcm3n_0041_1900_40_007486342_2 25,920 70,502 2.7200


©2024 climateprediction.net