Task 13269207

Name	hadcm3n_ydz6_1940_40_007413457_1
Workunit	7611087
Created	17 Aug 2011, 7:44:45 UTC
Sent	18 Aug 2011, 5:18:31 UTC
Report deadline	17 Nov 2011, 12:45:42 UTC
Received	10 Oct 2011, 13:45:42 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1160773
Run time	16 days 9 hours 42 min 3 sec
CPU time	15 days 13 hours 16 min 8 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.90 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:34:37 (5500): No heartbeat from core client for 30 sec - exiting 20:34:38 (5500): No heartbeat from core client for 30 sec - exiting 20:34:39 (5500): No heartbeat from core client for 30 sec - exiting 20:34:40 (5500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:38:34 (9388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:42:50 (4620): No heartbeat from core client for 30 sec - exiting 06:42:51 (4620): No heartbeat from core client for 30 sec - exiting 06:42:52 (4620): No heartbeat from core client for 30 sec - exiting 06:42:53 (4620): No heartbeat from core client for 30 sec - exiting 06:42:54 (4620): No heartbeat from core client for 30 sec - exiting 06:42:55 (4620): No heartbeat from core client for 30 sec - exiting 06:42:56 (4620): No heartbeat from core client for 30 sec - exiting 06:42:57 (4620): No heartbeat from core client for 30 sec - exiting 06:42:58 (4620): No heartbeat from core client for 30 sec - exiting 06:42:59 (4620): No heartbeat from core client for 30 sec - exiting 06:43:00 (4620): No heartbeat from core client for 30 sec - exiting 06:43:01 (4620): No heartbeat from core client for 30 sec - exiting 06:43:02 (4620): No heartbeat from core client for 30 sec - exiting 06:43:03 (4620): No heartbeat from core client for 30 sec - exiting 06:43:04 (4620): No heartbeat from core client for 30 sec - exiting 06:43:05 (4620): No heartbeat from core client for 30 sec - exiting 06:43:06 (4620): No heartbeat from core client for 30 sec - exiting 06:43:07 (4620): No heartbeat from core client for 30 sec - exiting 06:43:08 (4620): No heartbeat from core client for 30 sec - exiting 06:43:09 (4620): No heartbeat from core client for 30 sec - exiting 06:43:10 (4620): No heartbeat from core client for 30 sec - exiting 06:43:11 (4620): No heartbeat from core client for 30 sec - exiting 06:43:12 (4620): No heartbeat from core client for 30 sec - exiting 06:43:13 (4620): No heartbeat from core client for 30 sec - exiting 06:43:14 (4620): No heartbeat from core client for 30 sec - exiting 06:43:15 (4620): No heartbeat from core client for 30 sec - exiting 06:43:16 (4620): No heartbeat from core client for 30 sec - exiting 06:43:17 (4620): No heartbeat from core client for 30 sec - exiting 06:43:18 (4620): No heartbeat from core client for 30 sec - exiting 06:43:19 (4620): No heartbeat from core client for 30 sec - exiting 06:43:20 (4620): No heartbeat from core client for 30 sec - exiting 06:43:21 (4620): No heartbeat from core client for 30 sec - exiting 06:43:22 (4620): No heartbeat from core client for 30 sec - exiting 06:43:23 (4620): No heartbeat from core client for 30 sec - exiting 06:43:24 (4620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:43:25 (4620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:15:31 (4628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:40:39 (4292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3872, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5344, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:26:52 (5264): No heartbeat from core client for 30 sec - exiting 17:26:53 (5264): No heartbeat from core client for 30 sec - exiting 17:26:54 (5264): No heartbeat from core client for 30 sec - exiting 17:26:55 (5264): No heartbeat from core client for 30 sec - exiting 17:26:56 (5264): No heartbeat from core client for 30 sec - exiting 17:26:57 (5264): No heartbeat from core client for 30 sec - exiting 17:26:58 (5264): No heartbeat from core client for 30 sec - exiting 17:26:59 (5264): No heartbeat from core client for 30 sec - exiting 17:27:00 (5264): No heartbeat from core client for 30 sec - exiting 17:27:01 (5264): No heartbeat from core client for 30 sec - exiting 17:27:02 (5264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:36:06 (3292): No heartbeat from core client for 30 sec - exiting 19:36:08 (3292): No heartbeat from core client for 30 sec - exiting 19:36:09 (3292): No heartbeat from core client for 30 sec - exiting 19:36:10 (3292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77CE7363 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_ydz6_1940_40_007413457/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Oct 2011 11:53:23	1160773	13269207	hadcm3n_ydz6_1940_40_007413457_1	777,600	1,343,759	1.7281
07 Oct 2011 10:58:09	1160773	13269207	hadcm3n_ydz6_1940_40_007413457_1	751,680	1,297,955	1.7267
04 Oct 2011 01:39:56	1160773	13269207	hadcm3n_ydz6_1940_40_007413457_1	725,760	1,252,023	1.7251
29 Sep 2011 11:17:42	1160773	13269207	hadcm3n_ydz6_1940_40_007413457_1	699,840	1,207,481	1.7254
28 Sep 2011 21:48:51	1160773	13269207	hadcm3n_ydz6_1940_40_007413457_1	673,920	1,162,751	1.7254
28 Sep 2011 08:20:12	1160773	13269207	hadcm3n_ydz6_1940_40_007413457_1	648,000	1,119,230	1.7272
22 Sep 2011 15:59:55	1160773	13269207	hadcm3n_ydz6_1940_40_007413457_1	622,080	1,075,187	1.7284
22 Sep 2011 01:33:05	1160773	13269207	hadcm3n_ydz6_1940_40_007413457_1	596,160	1,030,561	1.7287
17 Sep 2011 14:48:20	1160773	13269207	hadcm3n_ydz6_1940_40_007413457_1	570,240	985,412	1.7281
15 Sep 2011 10:40:31	1160773	13269207	hadcm3n_ydz6_1940_40_007413457_1	544,320	940,501	1.7278
14 Sep 2011 18:36:47	1160773	13269207	hadcm3n_ydz6_1940_40_007413457_1	518,400	895,612	1.7276
11 Sep 2011 20:44:11	1160773	13269207	hadcm3n_ydz6_1940_40_007413457_1	492,480	850,831	1.7276
11 Sep 2011 02:41:56	1160773	13269207	hadcm3n_ydz6_1940_40_007413457_1	466,560	806,467	1.7285
10 Sep 2011 15:06:33	1160773	13269207	hadcm3n_ydz6_1940_40_007413457_1	440,640	762,372	1.7301
09 Sep 2011 09:12:41	1160773	13269207	hadcm3n_ydz6_1940_40_007413457_1	414,720	717,989	1.7313
08 Sep 2011 15:26:36	1160773	13269207	hadcm3n_ydz6_1940_40_007413457_1	388,800	673,715	1.7328
08 Sep 2011 00:36:19	1160773	13269207	hadcm3n_ydz6_1940_40_007413457_1	362,880	628,403	1.7317
06 Sep 2011 22:27:37	1160773	13269207	hadcm3n_ydz6_1940_40_007413457_1	336,960	583,946	1.7330
06 Sep 2011 05:29:56	1160773	13269207	hadcm3n_ydz6_1940_40_007413457_1	311,040	539,035	1.7330
05 Sep 2011 05:25:34	1160773	13269207	hadcm3n_ydz6_1940_40_007413457_1	285,120	493,805	1.7319