Task 15797724

Name	hadcm3n_4fyg_2020_40_008371844_0
Workunit	8522703
Created	26 May 2013, 21:23:04 UTC
Sent	26 May 2013, 21:25:35 UTC
Report deadline	26 Aug 2013, 4:52:46 UTC
Received	9 Jul 2013, 2:07:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1266669
Run time	10 days 9 hours 0 min 8 sec
CPU time	10 days 0 hours 19 min 36 sec
Validate state	Invalid
Credit	5,598.72
Device peak FLOPS	2.52 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:26:20 (2376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:46:15 (3060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:03:54 (2328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2308, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2620, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:55:30 (4212): No heartbeat from core client for 30 sec - exiting 16:55:31 (4212): No heartbeat from core client for 30 sec - exiting 16:55:32 (4212): No heartbeat from core client for 30 sec - exiting 16:55:33 (4212): No heartbeat from core client for 30 sec - exiting 16:55:34 (4212): No heartbeat from core client for 30 sec - exiting 16:55:35 (4212): No heartbeat from core client for 30 sec - exiting 16:55:36 (4212): No heartbeat from core client for 30 sec - exiting 16:55:37 (4212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3012, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3012, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3012, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3012, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3012, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3012, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Jul 2013 15:09:13	1266669	15797724	hadcm3n_4fyg_2020_40_008371844_0	466,560	828,214	1.7752
06 Jul 2013 05:12:31	1266669	15797724	hadcm3n_4fyg_2020_40_008371844_0	440,640	782,013	1.7747
06 Jul 2013 04:28:03	1266669	15797724	hadcm3n_4fyg_2020_40_008371844_0	414,720	736,181	1.7751
04 Jul 2013 14:05:05	1266669	15797724	hadcm3n_4fyg_2020_40_008371844_0	388,800	689,585	1.7736
02 Jul 2013 10:15:25	1266669	15797724	hadcm3n_4fyg_2020_40_008371844_0	362,880	643,473	1.7732
27 Jun 2013 23:58:51	1266669	15797724	hadcm3n_4fyg_2020_40_008371844_0	336,960	596,930	1.7715
22 Jun 2013 20:19:50	1266669	15797724	hadcm3n_4fyg_2020_40_008371844_0	311,040	550,724	1.7706
21 Jun 2013 00:59:33	1266669	15797724	hadcm3n_4fyg_2020_40_008371844_0	285,120	504,245	1.7685
17 Jun 2013 23:44:11	1266669	15797724	hadcm3n_4fyg_2020_40_008371844_0	259,200	457,485	1.7650
13 Jun 2013 01:31:05	1266669	15797724	hadcm3n_4fyg_2020_40_008371844_0	233,280	411,023	1.7619
10 Jun 2013 01:09:37	1266669	15797724	hadcm3n_4fyg_2020_40_008371844_0	207,360	365,262	1.7615
09 Jun 2013 02:17:07	1266669	15797724	hadcm3n_4fyg_2020_40_008371844_0	181,440	319,270	1.7596
07 Jun 2013 22:58:47	1266669	15797724	hadcm3n_4fyg_2020_40_008371844_0	155,520	273,378	1.7578
03 Jun 2013 02:13:19	1266669	15797724	hadcm3n_4fyg_2020_40_008371844_0	129,600	227,606	1.7562
01 Jun 2013 19:52:58	1266669	15797724	hadcm3n_4fyg_2020_40_008371844_0	103,680	182,543	1.7606
31 May 2013 17:52:24	1266669	15797724	hadcm3n_4fyg_2020_40_008371844_0	77,760	137,231	1.7648
31 May 2013 05:19:50	1266669	15797724	hadcm3n_4fyg_2020_40_008371844_0	51,840	92,273	1.7800
27 May 2013 21:38:48	1266669	15797724	hadcm3n_4fyg_2020_40_008371844_0	25,920	46,752	1.8037