Task 15810127

Name	hadcm3n_o193_1940_40_008379230_0
Workunit	8530089
Created	31 May 2013, 17:23:39 UTC
Sent	18 Jun 2013, 18:45:43 UTC
Report deadline	18 Sep 2013, 2:12:54 UTC
Received	18 Jul 2013, 22:43:26 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1229307
Run time	6 days 13 hours 44 min 9 sec
CPU time	6 days 12 hours 50 min 7 sec
Validate state	Invalid
Credit	3,732.48
Device peak FLOPS	1.99 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7536, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2128, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5808, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5432, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1676, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7572, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:36:01 (9052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:43 (1564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:38:31 (6064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:13:08 (6112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:14:13 (1420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:15:21 (1588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:16:25 (4736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:17:27 (11684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:18:21 (2608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6440, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6440, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6440, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6440, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6440, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6440, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jul 2013 14:37:06	1229307	15810127	hadcm3n_o193_1940_40_008379230_0	311,040	528,085	1.6978
23 Jul 2013 14:37:06	1229307	15810127	hadcm3n_o193_1940_40_008379230_0	285,120	481,305	1.6881
23 Jul 2013 14:37:06	1229307	15810127	hadcm3n_o193_1940_40_008379230_0	259,200	432,965	1.6704
23 Jul 2013 14:37:06	1229307	15810127	hadcm3n_o193_1940_40_008379230_0	233,280	387,487	1.6610
23 Jul 2013 14:37:06	1229307	15810127	hadcm3n_o193_1940_40_008379230_0	207,360	342,712	1.6527
23 Jul 2013 14:37:06	1229307	15810127	hadcm3n_o193_1940_40_008379230_0	181,440	299,030	1.6481
23 Jul 2013 14:37:06	1229307	15810127	hadcm3n_o193_1940_40_008379230_0	155,520	255,497	1.6429
06 Jul 2013 04:29:01	1229307	15810127	hadcm3n_o193_1940_40_008379230_0	129,600	213,363	1.6463
28 Jun 2013 10:14:08	1229307	15810127	hadcm3n_o193_1940_40_008379230_0	103,680	170,917	1.6485
23 Jun 2013 17:00:58	1229307	15810127	hadcm3n_o193_1940_40_008379230_0	77,760	128,458	1.6520
21 Jun 2013 04:51:36	1229307	15810127	hadcm3n_o193_1940_40_008379230_0	51,840	86,248	1.6637
20 Jun 2013 17:08:29	1229307	15810127	hadcm3n_o193_1940_40_008379230_0	25,920	44,067	1.7001