Task 15808572

Name	hadcm3n_n16h_1960_40_008378705_0
Workunit	8529564
Created	30 May 2013, 21:36:46 UTC
Sent	30 May 2013, 22:03:23 UTC
Report deadline	30 Aug 2013, 5:30:34 UTC
Received	7 Jun 2013, 11:05:22 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1244094
Run time	5 days 21 hours 42 min 7 sec
CPU time	5 days 17 hours 17 min 42 sec
Validate state	Invalid
Credit	3,421.44
Device peak FLOPS	2.68 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:41:04 (2528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:26:37 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:38:15 (6656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:38:17 (6656): No heartbeat from core client for 30 sec - exiting 22:38:19 (6656): No heartbeat from core client for 30 sec - exiting 23:33:18 (1148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:33:20 (1148): No heartbeat from core client for 30 sec - exiting 23:33:23 (1148): No heartbeat from core client for 30 sec - exiting 23:33:26 (1148): No heartbeat from core client for 30 sec - exiting 23:33:28 (1148): No heartbeat from core client for 30 sec - exiting 03:31:35 (4688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:31:36 (4688): No heartbeat from core client for 30 sec - exiting 03:31:38 (4688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:38:38 (5504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:38:40 (5504): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6036, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6036, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6036, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6036, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6036, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6036, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Jun 2013 10:06:04	1244094	15808572	hadcm3n_n16h_1960_40_008378705_0	285,120	492,401	1.7270
06 Jun 2013 13:40:04	1244094	15808572	hadcm3n_n16h_1960_40_008378705_0	259,200	447,197	1.7253
06 Jun 2013 00:22:33	1244094	15808572	hadcm3n_n16h_1960_40_008378705_0	233,280	401,504	1.7211
05 Jun 2013 04:13:28	1244094	15808572	hadcm3n_n16h_1960_40_008378705_0	207,360	357,315	1.7232
04 Jun 2013 07:39:21	1244094	15808572	hadcm3n_n16h_1960_40_008378705_0	181,440	312,596	1.7229
03 Jun 2013 10:55:25	1244094	15808572	hadcm3n_n16h_1960_40_008378705_0	155,520	267,821	1.7221
02 Jun 2013 22:04:18	1244094	15808572	hadcm3n_n16h_1960_40_008378705_0	129,600	223,317	1.7231
02 Jun 2013 09:34:00	1244094	15808572	hadcm3n_n16h_1960_40_008378705_0	103,680	178,943	1.7259
01 Jun 2013 20:53:54	1244094	15808572	hadcm3n_n16h_1960_40_008378705_0	77,760	134,608	1.7311
01 Jun 2013 08:13:35	1244094	15808572	hadcm3n_n16h_1960_40_008378705_0	51,840	90,325	1.7424
31 May 2013 11:37:23	1244094	15808572	hadcm3n_n16h_1960_40_008378705_0	25,920	45,762	1.7655