Task 15929738

Name	hadcm3n_o2m3_1980_40_008407948_0
Workunit	8558804
Created	20 Aug 2013, 13:35:16 UTC
Sent	20 Aug 2013, 13:44:14 UTC
Report deadline	19 Nov 2013, 21:11:25 UTC
Received	10 Oct 2013, 10:12:33 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1137733
Run time	8 days 11 hours 40 min 40 sec
CPU time	7 days 22 hours 43 min 19 sec
Validate state	Invalid
Credit	9,020.16
Device peak FLOPS	3.27 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> Das Gerät erkennt den Befehl nicht. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4180, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5032, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3108, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5008, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5792, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3540, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4816, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CSuspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4408, iMonCtr=1 Model crash detected, will try to restart... Skipping gmts_generator due to netcdf error 13 - Permission denied 15:58:55 (4004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:58:56 (4004): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4420, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4164, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4192, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4264, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4264, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4264, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4264, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4264, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4264, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2m3_1980_40_008407948/dataout/atmos_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4264, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2m3_1980_40_008407948/dataout/atmos_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4264, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2m3_1980_40_008407948/dataout/atmos_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4264, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2m3_1980_40_008407948/dataout/atmos_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4264, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2m3_1980_40_008407948/dataout/atmos_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4264, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2m3_1980_40_008407948/dataout/atmos_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4264, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Oct 2013 10:43:46	1137733	15929738	hadcm3n_o2m3_1980_40_008407948_0	751,680	673,290	0.8957
04 Oct 2013 13:19:33	1137733	15929738	hadcm3n_o2m3_1980_40_008407948_0	725,760	650,018	0.8956
02 Oct 2013 08:34:19	1137733	15929738	hadcm3n_o2m3_1980_40_008407948_0	699,840	626,533	0.8953
01 Oct 2013 08:55:50	1137733	15929738	hadcm3n_o2m3_1980_40_008407948_0	673,920	603,476	0.8955
30 Sep 2013 09:20:35	1137733	15929738	hadcm3n_o2m3_1980_40_008407948_0	648,000	580,316	0.8955
26 Sep 2013 08:42:11	1137733	15929738	hadcm3n_o2m3_1980_40_008407948_0	622,080	557,342	0.8959
25 Sep 2013 09:13:54	1137733	15929738	hadcm3n_o2m3_1980_40_008407948_0	596,160	533,645	0.8951
20 Sep 2013 13:11:15	1137733	15929738	hadcm3n_o2m3_1980_40_008407948_0	570,240	510,532	0.8953
20 Sep 2013 06:18:23	1137733	15929738	hadcm3n_o2m3_1980_40_008407948_0	544,320	487,159	0.8950
19 Sep 2013 23:50:56	1137733	15929738	hadcm3n_o2m3_1980_40_008407948_0	518,400	463,937	0.8949
19 Sep 2013 17:07:19	1137733	15929738	hadcm3n_o2m3_1980_40_008407948_0	492,480	440,744	0.8949
19 Sep 2013 10:37:47	1137733	15929738	hadcm3n_o2m3_1980_40_008407948_0	466,560	417,874	0.8956
18 Sep 2013 09:13:19	1137733	15929738	hadcm3n_o2m3_1980_40_008407948_0	440,640	394,776	0.8959
17 Sep 2013 09:37:29	1137733	15929738	hadcm3n_o2m3_1980_40_008407948_0	414,720	371,399	0.8955
12 Sep 2013 11:45:18	1137733	15929738	hadcm3n_o2m3_1980_40_008407948_0	388,800	348,446	0.8962
11 Sep 2013 08:51:10	1137733	15929738	hadcm3n_o2m3_1980_40_008407948_0	362,880	325,233	0.8963
09 Sep 2013 14:31:20	1137733	15929738	hadcm3n_o2m3_1980_40_008407948_0	336,960	302,041	0.8964
06 Sep 2013 14:23:47	1137733	15929738	hadcm3n_o2m3_1980_40_008407948_0	311,040	278,671	0.8959
05 Sep 2013 15:10:41	1137733	15929738	hadcm3n_o2m3_1980_40_008407948_0	285,120	255,471	0.8960
04 Sep 2013 12:13:02	1137733	15929738	hadcm3n_o2m3_1980_40_008407948_0	259,200	232,460	0.8968