Task 16607683

Name	hadcm3n_ode2_1900_40_008472477_4
Workunit	8623316
Created	2 May 2014, 18:18:03 UTC
Sent	2 May 2014, 20:20:13 UTC
Report deadline	2 Aug 2014, 3:47:24 UTC
Received	14 Aug 2014, 15:00:24 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	459222
Run time	10 days 10 hours 33 min 25 sec
CPU time	9 days 20 hours 33 min 36 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	3.29 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 19:04:56 (4868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:04:57 (4868): No heartbeat from core client for 30 sec - exiting 18:14:10 (1468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:54:46 (1256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:09:46 (13408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:28:17 (11572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:32:39 (7912): No heartbeat from core client for 30 sec - exiting 18:32:40 (7912): No heartbeat from core client for 30 sec - exiting 18:32:41 (7912): No heartbeat from core client for 30 sec - exiting 18:32:42 (7912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:50:32 (10796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:12:20 (15448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=17824, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10828, iMonCtr=1 Model crash detected, will try to restart... 17:43:17 (2300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:43:18 (2300): No heartbeat from core client for 30 sec - exiting 17:43:19 (2300): No heartbeat from core client for 30 sec - exiting 17:43:20 (2300): No heartbeat from core client for 30 sec - exiting 18:01:54 (14252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:01:55 (14252): No heartbeat from core client for 30 sec - exiting 18:01:56 (14252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:04:23 (11280): No heartbeat from core client for 30 sec - exiting 22:04:25 (11280): No heartbeat from core client for 30 sec - exiting 22:04:26 (11280): No heartbeat from core client for 30 sec - exiting 22:04:27 (11280): No heartbeat from core client for 30 sec - exiting 22:04:28 (11280): No heartbeat from core client for 30 sec - exiting 22:04:29 (11280): No heartbeat from core client for 30 sec - exiting 22:04:30 (11280): No heartbeat from core client for 30 sec - exiting 22:04:31 (11280): No heartbeat from core client for 30 sec - exiting 22:04:32 (11280): No heartbeat from core client for 30 sec - exiting 22:04:33 (11280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77D07383 read attempt to address 0x40BAF8C4 Engaging BOINC Windows Runtime Debugger... 19:20:47 (3732): No heartbeat from core client for 30 sec - exiting 19:20:48 (3732): No heartbeat from core client for 30 sec - exiting 19:20:49 (3732): No heartbeat from core client for 30 sec - exiting 19:20:50 (3732): No heartbeat from core client for 30 sec - exiting 19:20:51 (3732): No heartbeat from core client for 30 sec - exiting 19:20:52 (3732): No heartbeat from core client for 30 sec - exiting 19:20:53 (3732): No heartbeat from core client for 30 sec - exiting 19:20:54 (3732): No heartbeat from core client for 30 sec - exiting 19:20:55 (3732): No heartbeat from core client for 30 sec - exiting 19:20:56 (3732): No heartbeat from core client for 30 sec - exiting 19:20:57 (3732): No heartbeat from core client for 30 sec - exiting 19:20:58 (3732): No heartbeat from core client for 30 sec - exiting 19:20:59 (3732): No heartbeat from core client for 30 sec - exiting 19:21:00 (3732): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77D03AC3 read attempt to address 0x40BAF8CC Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_ode2_1900_40_008472477/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Aug 2014 15:06:06	459222	16607683	hadcm3n_ode2_1900_40_008472477_4	1,036,800	851,328	0.8211
14 Aug 2014 15:06:06	459222	16607683	hadcm3n_ode2_1900_40_008472477_4	1,010,880	830,055	0.8211
06 Aug 2014 21:00:11	459222	16607683	hadcm3n_ode2_1900_40_008472477_4	984,960	810,119	0.8225
06 Aug 2014 15:41:19	459222	16607683	hadcm3n_ode2_1900_40_008472477_4	959,040	788,407	0.8221
06 Aug 2014 15:41:19	459222	16607683	hadcm3n_ode2_1900_40_008472477_4	933,120	766,753	0.8217
06 Aug 2014 15:41:19	459222	16607683	hadcm3n_ode2_1900_40_008472477_4	907,200	748,081	0.8246
06 Aug 2014 15:41:19	459222	16607683	hadcm3n_ode2_1900_40_008472477_4	881,280	726,877	0.8248
21 Jun 2014 18:11:58	459222	16607683	hadcm3n_ode2_1900_40_008472477_4	855,360	705,886	0.8253
21 Jun 2014 12:06:05	459222	16607683	hadcm3n_ode2_1900_40_008472477_4	829,440	684,582	0.8254
20 Jun 2014 18:03:13	459222	16607683	hadcm3n_ode2_1900_40_008472477_4	803,520	662,418	0.8244
19 Jun 2014 17:43:22	459222	16607683	hadcm3n_ode2_1900_40_008472477_4	777,600	639,762	0.8227
18 Jun 2014 15:28:04	459222	16607683	hadcm3n_ode2_1900_40_008472477_4	751,680	615,820	0.8193
16 Jun 2014 17:34:14	459222	16607683	hadcm3n_ode2_1900_40_008472477_4	725,760	593,584	0.8179
12 Jun 2014 17:50:35	459222	16607683	hadcm3n_ode2_1900_40_008472477_4	699,840	567,004	0.8102
11 Jun 2014 16:02:45	459222	16607683	hadcm3n_ode2_1900_40_008472477_4	673,920	545,461	0.8094
10 Jun 2014 09:03:45	459222	16607683	hadcm3n_ode2_1900_40_008472477_4	648,000	525,839	0.8115
10 Jun 2014 09:02:19	459222	16607683	hadcm3n_ode2_1900_40_008472477_4	622,080	505,946	0.8133
05 Jun 2014 19:04:42	459222	16607683	hadcm3n_ode2_1900_40_008472477_4	596,160	484,786	0.8132
04 Jun 2014 15:37:10	459222	16607683	hadcm3n_ode2_1900_40_008472477_4	570,240	459,963	0.8066
02 Jun 2014 16:42:22	459222	16607683	hadcm3n_ode2_1900_40_008472477_4	544,320	436,472	0.8019