Task 16202467

Name	hadcm3n_o98f_1900_40_008467090_1
Workunit	8617929
Created	6 Jan 2014, 13:48:28 UTC
Sent	6 Jan 2014, 13:48:32 UTC
Report deadline	7 Apr 2014, 21:15:43 UTC
Received	18 Feb 2014, 12:37:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1065549
Run time	26 days 17 hours 42 min 42 sec
CPU time	19 days 3 hours 32 min 51 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.01 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8540, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7680, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4268, iMonCtr=1 Model crash detected, will try to restart... 16:34:58 (1760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6644, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6644, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6644, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish 02:27:39 (1392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:03:59 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:04:00 (3140): No heartbeat from core client for 30 sec - exiting 04:04:01 (3140): No heartbeat from core client for 30 sec - exiting 04:04:02 (3140): No heartbeat from core client for 30 sec - exiting 04:04:03 (3140): No heartbeat from core client for 30 sec - exiting 04:04:04 (3140): No heartbeat from core client for 30 sec - exiting 04:04:05 (3140): No heartbeat from core client for 30 sec - exiting 04:04:06 (3140): No heartbeat from core client for 30 sec - exiting 04:04:08 (3140): No heartbeat from core client for 30 sec - exiting 04:04:09 (3140): No heartbeat from core client for 30 sec - exiting 04:04:10 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Feb 2014 12:38:57	1065549	16202467	hadcm3n_o98f_1900_40_008467090_1	518,400	1,654,366	3.1913
18 Feb 2014 12:01:44	1065549	16202467	hadcm3n_o98f_1900_40_008467090_1	492,480	1,583,195	3.2147
16 Feb 2014 02:22:42	1065549	16202467	hadcm3n_o98f_1900_40_008467090_1	466,560	1,511,957	3.2406
15 Feb 2014 01:10:41	1065549	16202467	hadcm3n_o98f_1900_40_008467090_1	440,640	1,436,295	3.2596
14 Feb 2014 03:25:00	1065549	16202467	hadcm3n_o98f_1900_40_008467090_1	414,720	1,365,214	3.2919
13 Feb 2014 03:06:36	1065549	16202467	hadcm3n_o98f_1900_40_008467090_1	388,800	1,295,931	3.3332
12 Feb 2014 04:00:48	1065549	16202467	hadcm3n_o98f_1900_40_008467090_1	362,880	1,223,424	3.3714
10 Feb 2014 22:14:03	1065549	16202467	hadcm3n_o98f_1900_40_008467090_1	336,960	1,148,698	3.4090
09 Feb 2014 21:19:54	1065549	16202467	hadcm3n_o98f_1900_40_008467090_1	311,040	1,077,843	3.4653
08 Feb 2014 22:48:40	1065549	16202467	hadcm3n_o98f_1900_40_008467090_1	285,120	1,004,042	3.5215
08 Feb 2014 02:04:24	1065549	16202467	hadcm3n_o98f_1900_40_008467090_1	259,200	931,430	3.5935
04 Feb 2014 23:49:16	1065549	16202467	hadcm3n_o98f_1900_40_008467090_1	233,280	855,225	3.6661
03 Feb 2014 08:36:07	1065549	16202467	hadcm3n_o98f_1900_40_008467090_1	207,360	776,418	3.7443
01 Feb 2014 12:12:39	1065549	16202467	hadcm3n_o98f_1900_40_008467090_1	181,440	698,282	3.8486
30 Jan 2014 21:45:00	1065549	16202467	hadcm3n_o98f_1900_40_008467090_1	155,520	627,811	4.0369
30 Jan 2014 21:45:00	1065549	16202467	hadcm3n_o98f_1900_40_008467090_1	129,600	558,162	4.3068
27 Jan 2014 02:41:34	1065549	16202467	hadcm3n_o98f_1900_40_008467090_1	103,680	488,198	4.7087
18 Jan 2014 05:56:25	1065549	16202467	hadcm3n_o98f_1900_40_008467090_1	77,760	206,652	2.6576
14 Jan 2014 00:34:58	1065549	16202467	hadcm3n_o98f_1900_40_008467090_1	51,840	134,876	2.6018
09 Jan 2014 08:27:03	1065549	16202467	hadcm3n_o98f_1900_40_008467090_1	25,920	67,090	2.5883