Task 16018575

Name	hadcm3n_o56n_2020_40_008375448_4
Workunit	8526307
Created	16 Sep 2013, 0:51:57 UTC
Sent	16 Sep 2013, 1:07:46 UTC
Report deadline	16 Dec 2013, 8:34:57 UTC
Received	23 Oct 2013, 14:14:00 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-2 (0xFFFFFFFE) Unknown error code
Computer ID	1271022
Run time	17 days 15 hours 6 min 50 sec
CPU time	15 days 8 hours 41 min 25 sec
Validate state	Invalid
Credit	11,197.44
Device peak FLOPS	2.65 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code -2 (0xfffffffe) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 06:53:03 (5276): No heartbeat from core client for 30 sec - exiting 06:53:04 (5276): No heartbeat from core client for 30 sec - exiting 06:53:05 (5276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:58:17 (5772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:01:13 (6368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:01:14 (6368): No heartbeat from core client for 30 sec - exiting 23:01:15 (6368): No heartbeat from core client for 30 sec - exiting 23:01:16 (6368): No heartbeat from core client for 30 sec - exiting 23:01:17 (6368): No heartbeat from core client for 30 sec - exiting 23:01:18 (6368): No heartbeat from core client for 30 sec - exiting 23:01:19 (6368): No heartbeat from core client for 30 sec - exiting 23:01:20 (6368): No heartbeat from core client for 30 sec - exiting 23:01:21 (6368): No heartbeat from core client for 30 sec - exiting 23:01:22 (6368): No heartbeat from core client for 30 sec - exiting 23:01:23 (6368): No heartbeat from core client for 30 sec - exiting 23:11:14 (6052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:03:56 (6204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7044, iMonCtr=1 Model crash detected, will try to restart... 11:02:33 (6308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:00:48 (3968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:00:49 (3968): No heartbeat from core client for 30 sec - exiting 23:00:50 (3968): No heartbeat from core client for 30 sec - exiting 23:00:51 (3968): No heartbeat from core client for 30 sec - exiting 23:00:52 (3968): No heartbeat from core client for 30 sec - exiting 23:00:53 (3968): No heartbeat from core client for 30 sec - exiting 23:00:54 (3968): No heartbeat from core client for 30 sec - exiting 23:00:55 (3968): No heartbeat from core client for 30 sec - exiting 23:00:56 (3968): No heartbeat from core client for 30 sec - exiting 23:00:57 (3968): No heartbeat from core client for 30 sec - exiting 23:00:58 (3968): No heartbeat from core client for 30 sec - exiting Controller:: CPDN proCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:04:23 (5400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5692, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 11:03:17 (5412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5896, iMonCtr=1 Model crash detected, will try to restart... 08:55:33 (5852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4324, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4312, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1936, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:27:14 (1196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:03:17 (5768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:26:24 (5612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:33:07 (3376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:47:06 (5772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:01:49 (5872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6140, iMonCtr=1 Model crash detected, will try to restart... 11:02:47 (5144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:25:18 (2980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6020, iMonCtr=1 Model crash detected, will try to restart... 11:02:43 (5448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:02:44 (5448): No heartbeat from core client for 30 sec - exiting 11:02:45 (5448): No heartbeat from core client for 30 sec - exiting 11:02:46 (5448): No heartbeat from core client for 30 sec - exiting 11:02:47 (5448): No heartbeat from core client for 30 sec - exiting 11:02:48 (5448): No heartbeat from core client for 30 sec - exiting 11:02:49 (5448): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:00:41 (4904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:05:16 (5620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:07:00 (6908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:08:22 (7440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6296, iMonCtr=1 Model crash detected, will try to restart... Could not launch model process. Last Error=1455 Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Oct 2013 01:08:25	1271022	16018575	hadcm3n_o56n_2020_40_008375448_4	933,120	1,324,683	1.4196
22 Oct 2013 02:10:28	1271022	16018575	hadcm3n_o56n_2020_40_008375448_4	907,200	1,287,377	1.4191
20 Oct 2013 23:39:57	1271022	16018575	hadcm3n_o56n_2020_40_008375448_4	881,280	1,250,702	1.4192
19 Oct 2013 23:24:50	1271022	16018575	hadcm3n_o56n_2020_40_008375448_4	855,360	1,214,430	1.4198
18 Oct 2013 23:36:48	1271022	16018575	hadcm3n_o56n_2020_40_008375448_4	829,440	1,177,465	1.4196
17 Oct 2013 23:46:19	1271022	16018575	hadcm3n_o56n_2020_40_008375448_4	803,520	1,140,492	1.4194
17 Oct 2013 00:03:57	1271022	16018575	hadcm3n_o56n_2020_40_008375448_4	777,600	1,104,195	1.4200
15 Oct 2013 23:50:12	1271022	16018575	hadcm3n_o56n_2020_40_008375448_4	751,680	1,067,831	1.4206
14 Oct 2013 22:24:44	1271022	16018575	hadcm3n_o56n_2020_40_008375448_4	725,760	1,031,611	1.4214
13 Oct 2013 22:47:01	1271022	16018575	hadcm3n_o56n_2020_40_008375448_4	699,840	995,033	1.4218
12 Oct 2013 23:04:57	1271022	16018575	hadcm3n_o56n_2020_40_008375448_4	673,920	958,099	1.4217
11 Oct 2013 23:14:54	1271022	16018575	hadcm3n_o56n_2020_40_008375448_4	648,000	920,750	1.4209
10 Oct 2013 02:57:57	1271022	16018575	hadcm3n_o56n_2020_40_008375448_4	622,080	883,805	1.4207
09 Oct 2013 03:00:17	1271022	16018575	hadcm3n_o56n_2020_40_008375448_4	596,160	846,782	1.4204
08 Oct 2013 03:00:37	1271022	16018575	hadcm3n_o56n_2020_40_008375448_4	570,240	809,565	1.4197
07 Oct 2013 15:05:26	1271022	16018575	hadcm3n_o56n_2020_40_008375448_4	544,320	772,476	1.4192
06 Oct 2013 16:01:53	1271022	16018575	hadcm3n_o56n_2020_40_008375448_4	518,400	736,675	1.4211
05 Oct 2013 16:15:15	1271022	16018575	hadcm3n_o56n_2020_40_008375448_4	492,480	699,813	1.4210
04 Oct 2013 18:37:19	1271022	16018575	hadcm3n_o56n_2020_40_008375448_4	466,560	662,699	1.4204
03 Oct 2013 20:35:00	1271022	16018575	hadcm3n_o56n_2020_40_008375448_4	440,640	625,295	1.4191