Task 15561417

Name	hadcm3n_39ns_1940_40_008265974_1
Workunit	8421098
Created	30 Jan 2013, 16:40:00 UTC
Sent	30 Jan 2013, 16:40:07 UTC
Report deadline	2 May 2013, 0:07:18 UTC
Received	1 Apr 2013, 16:36:12 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1263389
Run time	10 days 19 hours 35 min 41 sec
CPU time	10 days 14 hours 30 min 8 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.79 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:32:20 (5072): No heartbeat from core client for 30 sec - exiting 12:32:21 (5072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:54:16 (5096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4664, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4596, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:59:38 (4600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:13:24 (5680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:36:08 (4620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:43:19 (4124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5616, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:18:51 (4740): No heartbeat from core client for 30 sec - exiting 13:18:53 (4740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:18:54 (4740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:50:09 (5048): No heartbeat from core client for 30 sec - exiting 09:50:10 (5048): No heartbeat from core client for 30 sec - exiting 09:50:12 (5048): No heartbeat from core client for 30 sec - exiting 09:50:13 (5048): No heartbeat from core client for 30 sec - exiting 09:50:14 (5048): No heartbeat from core client for 30 sec - exiting 09:50:15 (5048): No heartbeat from core client for 30 sec - exiting 09:50:16 (5048): No heartbeat from core client for 30 sec - exiting 09:50:17 (5048): No heartbeat from core client for 30 sec - exiting 09:50:18 (5048): No heartbeat from core client for 30 sec - exiting 09:50:19 (5048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:51:40 (4376): No heartbeat from core client for 30 sec - exiting 12:51:43 (4376): No heartbeat from core client for 30 sec - exiting 12:51:44 (4376): No heartbeat from core client for 30 sec - exiting 12:51:45 (4376): No heartbeat from core client for 30 sec - exiting 12:51:46 (4376): No heartbeat from core client for 30 sec - exiting 12:51:47 (4376): No heartbeat from core client for 30 sec - exiting 12:51:48 (4376): No heartbeat from core client for 30 sec - exiting 12:51:49 (4376): No heartbeat from core client for 30 sec - exiting 12:51:50 (4376): No heartbeat from core client for 30 sec - exiting 12:51:51 (4376): No heartbeat from core client for 30 sec - exiting 12:51:52 (4376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4992, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Apr 2013 16:41:16	1263389	15561417	hadcm3n_39ns_1940_40_008265974_1	777,600	916,207	1.1782
01 Apr 2013 16:36:16	1263389	15561417	hadcm3n_39ns_1940_40_008265974_1	751,680	886,345	1.1792
01 Apr 2013 16:36:16	1263389	15561417	hadcm3n_39ns_1940_40_008265974_1	725,760	857,065	1.1809
01 Apr 2013 16:36:16	1263389	15561417	hadcm3n_39ns_1940_40_008265974_1	699,840	831,707	1.1884
01 Apr 2013 16:36:16	1263389	15561417	hadcm3n_39ns_1940_40_008265974_1	673,920	805,463	1.1952
01 Apr 2013 16:36:16	1263389	15561417	hadcm3n_39ns_1940_40_008265974_1	648,000	776,865	1.1989
01 Apr 2013 16:36:16	1263389	15561417	hadcm3n_39ns_1940_40_008265974_1	622,080	746,345	1.1998
01 Apr 2013 16:36:16	1263389	15561417	hadcm3n_39ns_1940_40_008265974_1	596,160	715,954	1.2009
24 Mar 2013 07:56:53	1263389	15561417	hadcm3n_39ns_1940_40_008265974_1	570,240	683,917	1.1993
18 Mar 2013 11:14:24	1263389	15561417	hadcm3n_39ns_1940_40_008265974_1	544,320	649,116	1.1925
15 Mar 2013 02:01:38	1263389	15561417	hadcm3n_39ns_1940_40_008265974_1	518,400	617,324	1.1908
13 Mar 2013 19:48:06	1263389	15561417	hadcm3n_39ns_1940_40_008265974_1	492,480	585,625	1.1891
11 Mar 2013 19:50:48	1263389	15561417	hadcm3n_39ns_1940_40_008265974_1	466,560	553,938	1.1873
10 Mar 2013 15:15:30	1263389	15561417	hadcm3n_39ns_1940_40_008265974_1	440,640	522,703	1.1862
07 Mar 2013 19:14:59	1263389	15561417	hadcm3n_39ns_1940_40_008265974_1	414,720	491,182	1.1844
03 Mar 2013 19:40:30	1263389	15561417	hadcm3n_39ns_1940_40_008265974_1	388,800	457,774	1.1774
28 Feb 2013 18:59:27	1263389	15561417	hadcm3n_39ns_1940_40_008265974_1	362,880	424,573	1.1700
26 Feb 2013 16:46:07	1263389	15561417	hadcm3n_39ns_1940_40_008265974_1	336,960	391,698	1.1624
23 Feb 2013 23:46:39	1263389	15561417	hadcm3n_39ns_1940_40_008265974_1	311,040	360,420	1.1588
23 Feb 2013 15:30:41	1263389	15561417	hadcm3n_39ns_1940_40_008265974_1	285,120	330,956	1.1608