Task 15926362

Name	hadcm3n_4i86_1980_40_008369717_1
Workunit	8520576
Created	19 Aug 2013, 22:38:25 UTC
Sent	19 Aug 2013, 22:38:56 UTC
Report deadline	19 Nov 2013, 6:06:07 UTC
Received	22 Oct 2013, 21:15:49 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1275135
Run time	30 days 6 hours 37 min 9 sec
CPU time	27 days 12 hours 0 min 42 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.23 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:16:36 (3288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:16:09 (1652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3824, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2516, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2516, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2516, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4556, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4556, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4556, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:23:36 (5576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:09:14 (6112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:42:34 (5736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x772D3AC3 read attempt to address 0x40E7E9C7 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x772D7383 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_4i86_1980_40_008369717/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Oct 2013 17:55:01	1275135	15926362	hadcm3n_4i86_1980_40_008369717_1	1,036,800	2,375,387	2.2911
22 Oct 2013 03:56:20	1275135	15926362	hadcm3n_4i86_1980_40_008369717_1	1,010,880	2,330,845	2.3058
21 Oct 2013 14:17:17	1275135	15926362	hadcm3n_4i86_1980_40_008369717_1	984,960	2,286,331	2.3212
21 Oct 2013 00:25:24	1275135	15926362	hadcm3n_4i86_1980_40_008369717_1	959,040	2,241,787	2.3375
20 Oct 2013 10:20:08	1275135	15926362	hadcm3n_4i86_1980_40_008369717_1	933,120	2,197,376	2.3549
19 Oct 2013 20:23:52	1275135	15926362	hadcm3n_4i86_1980_40_008369717_1	907,200	2,152,869	2.3731
19 Oct 2013 06:34:47	1275135	15926362	hadcm3n_4i86_1980_40_008369717_1	881,280	2,109,240	2.3934
18 Oct 2013 17:44:30	1275135	15926362	hadcm3n_4i86_1980_40_008369717_1	855,360	2,065,634	2.4149
18 Oct 2013 04:59:19	1275135	15926362	hadcm3n_4i86_1980_40_008369717_1	829,440	2,022,146	2.4380
17 Oct 2013 15:56:24	1275135	15926362	hadcm3n_4i86_1980_40_008369717_1	803,520	1,978,787	2.4626
17 Oct 2013 02:30:21	1275135	15926362	hadcm3n_4i86_1980_40_008369717_1	777,600	1,935,092	2.4885
16 Oct 2013 13:32:23	1275135	15926362	hadcm3n_4i86_1980_40_008369717_1	751,680	1,891,516	2.5164
16 Oct 2013 00:56:12	1275135	15926362	hadcm3n_4i86_1980_40_008369717_1	725,760	1,848,483	2.5470
15 Oct 2013 11:22:16	1275135	15926362	hadcm3n_4i86_1980_40_008369717_1	699,840	1,804,453	2.5784
14 Oct 2013 21:59:27	1275135	15926362	hadcm3n_4i86_1980_40_008369717_1	673,920	1,760,453	2.6123
14 Oct 2013 08:47:01	1275135	15926362	hadcm3n_4i86_1980_40_008369717_1	648,000	1,716,527	2.6490
13 Oct 2013 19:40:17	1275135	15926362	hadcm3n_4i86_1980_40_008369717_1	622,080	1,672,641	2.6888
13 Oct 2013 06:53:35	1275135	15926362	hadcm3n_4i86_1980_40_008369717_1	596,160	1,629,082	2.7326
12 Oct 2013 18:02:50	1275135	15926362	hadcm3n_4i86_1980_40_008369717_1	570,240	1,585,360	2.7802
12 Oct 2013 05:08:33	1275135	15926362	hadcm3n_4i86_1980_40_008369717_1	544,320	1,541,616	2.8322