Task 14924595

Name	hadcm3n_yjcy_1980_40_007684164_3
Workunit	7839251
Created	17 Jul 2012, 1:12:13 UTC
Sent	17 Jul 2012, 1:12:35 UTC
Report deadline	16 Oct 2012, 8:39:46 UTC
Received	21 Aug 2012, 2:49:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1197348
Run time	20 days 5 hours 49 min 50 sec
CPU time	13 days 6 hours 58 min 31 sec
Validate state	Invalid
Credit	10,264.32
Device peak FLOPS	3.40 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:59:26 (10508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4828, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5772, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5692, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4980, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4980, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4980, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4604, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3100, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13492, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13492, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13492, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13492, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_yjcy_1980_40_007684164/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_yjcy_1980_40_007684164/dataout/ocean_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2632, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_yjcy_1980_40_007684164/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_yjcy_1980_40_007684164/dataout/ocean_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2632, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_yjcy_1980_40_007684164/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_yjcy_1980_40_007684164/dataout/ocean_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2632, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_yjcy_1980_40_007684164/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_yjcy_1980_40_007684164/dataout/ocean_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2632, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_yjcy_1980_40_007684164/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_yjcy_1980_40_007684164/dataout/ocean_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2632, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_yjcy_1980_40_007684164/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_yjcy_1980_40_007684164/dataout/ocean_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2632, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Aug 2012 11:15:25	1197348	14924595	hadcm3n_yjcy_1980_40_007684164_3	855,360	1,136,220	1.3284
17 Aug 2012 03:38:54	1197348	14924595	hadcm3n_yjcy_1980_40_007684164_3	829,440	1,115,122	1.3444
16 Aug 2012 21:37:19	1197348	14924595	hadcm3n_yjcy_1980_40_007684164_3	803,520	1,093,554	1.3610
16 Aug 2012 14:52:08	1197348	14924595	hadcm3n_yjcy_1980_40_007684164_3	777,600	1,071,954	1.3785
16 Aug 2012 09:06:02	1197348	14924595	hadcm3n_yjcy_1980_40_007684164_3	751,680	1,050,400	1.3974
16 Aug 2012 02:19:27	1197348	14924595	hadcm3n_yjcy_1980_40_007684164_3	725,760	1,028,829	1.4176
15 Aug 2012 20:07:15	1197348	14924595	hadcm3n_yjcy_1980_40_007684164_3	699,840	1,007,299	1.4393
15 Aug 2012 14:01:00	1197348	14924595	hadcm3n_yjcy_1980_40_007684164_3	673,920	985,762	1.4627
15 Aug 2012 08:09:53	1197348	14924595	hadcm3n_yjcy_1980_40_007684164_3	648,000	964,184	1.4879
14 Aug 2012 23:58:10	1197348	14924595	hadcm3n_yjcy_1980_40_007684164_3	622,080	942,612	1.5153
14 Aug 2012 16:55:44	1197348	14924595	hadcm3n_yjcy_1980_40_007684164_3	596,160	920,940	1.5448
14 Aug 2012 08:21:23	1197348	14924595	hadcm3n_yjcy_1980_40_007684164_3	570,240	899,245	1.5770
01 Aug 2012 00:23:46	1197348	14924595	hadcm3n_yjcy_1980_40_007684164_3	544,320	437,897	0.8045
31 Jul 2012 16:09:46	1197348	14924595	hadcm3n_yjcy_1980_40_007684164_3	518,400	416,909	0.8042
31 Jul 2012 07:57:23	1197348	14924595	hadcm3n_yjcy_1980_40_007684164_3	492,480	395,934	0.8040
31 Jul 2012 00:35:47	1197348	14924595	hadcm3n_yjcy_1980_40_007684164_3	466,560	374,822	0.8034
30 Jul 2012 15:38:09	1197348	14924595	hadcm3n_yjcy_1980_40_007684164_3	440,640	353,720	0.8027
29 Jul 2012 15:45:44	1197348	14924595	hadcm3n_yjcy_1980_40_007684164_3	414,720	332,984	0.8029
29 Jul 2012 05:53:53	1197348	14924595	hadcm3n_yjcy_1980_40_007684164_3	388,800	312,151	0.8029
28 Jul 2012 11:04:30	1197348	14924595	hadcm3n_yjcy_1980_40_007684164_3	362,880	290,860	0.8015