Task 15903528

Name	hadcm3n_o2j3_2020_40_008403689_0
Workunit	8554545
Created	23 Jul 2013, 15:57:12 UTC
Sent	24 Jul 2013, 4:18:36 UTC
Report deadline	23 Oct 2013, 11:45:47 UTC
Received	28 Aug 2013, 0:55:38 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1099480
Run time	6 days 12 hours 42 min 12 sec
CPU time	5 days 18 hours 36 min 56 sec
Validate state	Invalid
Credit	3,421.44
Device peak FLOPS	2.77 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... forrtl: Not enough storage is available to process this command. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6004, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5256, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5388, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6080, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4588, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6540, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6540, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6540, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5648, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Aug 2013 07:07:47	1099480	15903528	hadcm3n_o2j3_2020_40_008403689_0	285,120	458,286	1.6073
22 Aug 2013 04:28:06	1099480	15903528	hadcm3n_o2j3_2020_40_008403689_0	259,200	410,435	1.5835
21 Aug 2013 04:20:42	1099480	15903528	hadcm3n_o2j3_2020_40_008403689_0	233,280	363,598	1.5586
15 Aug 2013 03:08:42	1099480	15903528	hadcm3n_o2j3_2020_40_008403689_0	207,360	317,662	1.5319
14 Aug 2013 23:52:19	1099480	15903528	hadcm3n_o2j3_2020_40_008403689_0	181,440	277,740	1.5308
14 Aug 2013 23:52:19	1099480	15903528	hadcm3n_o2j3_2020_40_008403689_0	155,520	239,922	1.5427
14 Aug 2013 23:52:19	1099480	15903528	hadcm3n_o2j3_2020_40_008403689_0	129,600	201,512	1.5549
14 Aug 2013 23:52:18	1099480	15903528	hadcm3n_o2j3_2020_40_008403689_0	103,680	162,782	1.5700
30 Jul 2013 10:06:34	1099480	15903528	hadcm3n_o2j3_2020_40_008403689_0	77,760	119,947	1.5425
30 Jul 2013 10:06:33	1099480	15903528	hadcm3n_o2j3_2020_40_008403689_0	51,840	79,109	1.5260
26 Jul 2013 06:41:41	1099480	15903528	hadcm3n_o2j3_2020_40_008403689_0	25,920	31,754	1.2251