Task 16085519

Name	hadcm3n_3j89_2020_40_008367647_4
Workunit	8518506
Created	25 Nov 2013, 22:22:39 UTC
Sent	25 Nov 2013, 23:06:34 UTC
Report deadline	25 Feb 2014, 6:33:45 UTC
Received	2 Jan 2014, 11:14:33 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1286177
Run time	27 days 2 hours 11 min 39 sec
CPU time	26 days 5 hours 19 min
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.66 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5840, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:05:31 (5668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5448, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5504, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4656, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4656, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4828, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77513FA9 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... 05:15:03 (4036): No heartbeat from core client for 30 sec - exiting 05:15:04 (4036): No heartbeat from core client for 30 sec - exiting 05:15:05 (4036): No heartbeat from core client for 30 sec - exiting 05:15:06 (4036): No heartbeat from core client for 30 sec - exiting 05:15:07 (4036): No heartbeat from core client for 30 sec - exiting 05:15:08 (4036): No heartbeat from core client for 30 sec - exiting 05:15:09 (4036): No heartbeat from core client for 30 sec - exiting 05:15:11 (4036): No heartbeat from core client for 30 sec - exiting 05:15:12 (4036): No heartbeat from core client for 30 sec - exiting 05:15:13 (4036): No heartbeat from core client for 30 sec - exiting 05:15:14 (4036): No heartbeat from core client for 30 sec - exiting 05:15:15 (4036): No heartbeat from core client for 30 sec - exiting 05:15:16 (4036): No heartbeat from core client for 30 sec - exiting 05:15:17 (4036): No heartbeat from core client for 30 sec - exiting 05:15:18 (4036): No heartbeat from core client for 30 sec - exiting 05:15:19 (4036): No heartbeat from core client for 30 sec - exiting 05:15:20 (4036): No heartbeat from core client for 30 sec - exiting 05:15:21 (4036): No heartbeat from core client for 30 sec - exiting 05:15:23 (4036): No heartbeat from core client for 30 sec - exiting 05:15:24 (4036): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77E37383 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_3j89_2020_40_008367647/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Dec 2013 10:15:07	1286177	16085519	hadcm3n_3j89_2020_40_008367647_4	1,036,800	2,264,693	2.1843
30 Dec 2013 17:40:44	1286177	16085519	hadcm3n_3j89_2020_40_008367647_4	1,010,880	2,207,505	2.1837
30 Dec 2013 00:54:57	1286177	16085519	hadcm3n_3j89_2020_40_008367647_4	984,960	2,150,205	2.1830
27 Dec 2013 22:13:05	1286177	16085519	hadcm3n_3j89_2020_40_008367647_4	959,040	2,092,144	2.1815
26 Dec 2013 21:34:09	1286177	16085519	hadcm3n_3j89_2020_40_008367647_4	933,120	2,034,297	2.1801
26 Dec 2013 04:57:56	1286177	16085519	hadcm3n_3j89_2020_40_008367647_4	907,200	1,976,409	2.1786
25 Dec 2013 04:34:39	1286177	16085519	hadcm3n_3j89_2020_40_008367647_4	881,280	1,918,964	2.1775
24 Dec 2013 11:49:19	1286177	16085519	hadcm3n_3j89_2020_40_008367647_4	855,360	1,861,011	2.1757
23 Dec 2013 19:19:57	1286177	16085519	hadcm3n_3j89_2020_40_008367647_4	829,440	1,803,433	2.1743
22 Dec 2013 16:09:59	1286177	16085519	hadcm3n_3j89_2020_40_008367647_4	803,520	1,745,188	2.1719
21 Dec 2013 17:05:17	1286177	16085519	hadcm3n_3j89_2020_40_008367647_4	777,600	1,687,344	2.1699
20 Dec 2013 23:29:09	1286177	16085519	hadcm3n_3j89_2020_40_008367647_4	751,680	1,629,522	2.1678
20 Dec 2013 06:40:25	1286177	16085519	hadcm3n_3j89_2020_40_008367647_4	725,760	1,571,257	2.1650
19 Dec 2013 13:44:49	1286177	16085519	hadcm3n_3j89_2020_40_008367647_4	699,840	1,512,738	2.1615
18 Dec 2013 21:06:45	1286177	16085519	hadcm3n_3j89_2020_40_008367647_4	673,920	1,454,907	2.1589
17 Dec 2013 18:36:51	1286177	16085519	hadcm3n_3j89_2020_40_008367647_4	648,000	1,397,266	2.1563
17 Dec 2013 01:58:57	1286177	16085519	hadcm3n_3j89_2020_40_008367647_4	622,080	1,339,307	2.1529
16 Dec 2013 09:19:06	1286177	16085519	hadcm3n_3j89_2020_40_008367647_4	596,160	1,281,353	2.1493
15 Dec 2013 16:27:41	1286177	16085519	hadcm3n_3j89_2020_40_008367647_4	570,240	1,223,858	2.1462
14 Dec 2013 23:43:54	1286177	16085519	hadcm3n_3j89_2020_40_008367647_4	544,320	1,165,773	2.1417