Task 13409759

Name	hadcm3n_u4xl_1980_40_007459541_0
Workunit	7657044
Created	22 Sep 2011, 19:46:58 UTC
Sent	24 Sep 2011, 22:20:37 UTC
Report deadline	25 Dec 2011, 5:47:48 UTC
Received	28 Oct 2011, 20:59:33 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1100678
Run time	5 days 6 hours 15 min 6 sec
CPU time	4 days 22 hours 22 min 19 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.24 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6820, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:18:58 (3536): No heartbeat from core client for 30 sec - exiting 07:19:02 (3536): No heartbeat from core client for 30 sec - exiting 07:19:03 (3536): No heartbeat from core client for 30 sec - exiting 07:19:04 (3536): No heartbeat from core client for 30 sec - exiting 07:19:05 (3536): No heartbeat from core client for 30 sec - exiting 07:19:06 (3536): No heartbeat from core client for 30 sec - exiting 07:19:07 (3536): No heartbeat from core client for 30 sec - exiting 07:19:08 (3536): No heartbeat from core client for 30 sec - exiting 07:19:09 (3536): No heartbeat from core client for 30 sec - exiting 07:19:10 (3536): No heartbeat from core client for 30 sec - exiting 07:19:11 (3536): No heartbeat from core client for 30 sec - exiting 07:19:12 (3536): No heartbeat from core client for 30 sec - exiting 07:19:13 (3536): No heartbeat from core client for 30 sec - exiting 07:19:14 (3536): No heartbeat from core client for 30 sec - exiting 07:19:15 (3536): No heartbeat from core client for 30 sec - exiting 07:19:16 (3536): No heartbeat from core client for 30 sec - exiting 07:19:17 (3536): No heartbeat from core client for 30 sec - exiting 07:19:18 (3536): No heartbeat from core client for 30 sec - exiting 07:19:19 (3536): No heartbeat from core client for 30 sec - exiting 07:19:20 (3536): No heartbeat from core client for 30 sec - exiting 07:19:21 (3536): No heartbeat from core client for 30 sec - exiting 07:19:22 (3536): No heartbeat from core client for 30 sec - exiting 07:19:23 (3536): No heartbeat from core client for 30 sec - exiting 07:19:24 (3536): No heartbeat from core client for 30 sec - exiting 07:19:25 (3536): No heartbeat from core client for 30 sec - exiting 07:19:26 (3536): No heartbeat from core client for 30 sec - exiting 07:19:27 (3536): No heartbeat from core client for 30 sec - exiting 07:19:28 (3536): No heartbeat from core client for 30 sec - exiting 07:19:29 (3536): No heartbeat from core client for 30 sec - exiting 07:19:30 (3536): No heartbeat from core client for 30 sec - exiting 07:19:31 (3536): No heartbeat from core client for 30 sec - exiting 07:19:32 (3536): No heartbeat from core client for 30 sec - exiting 07:19:33 (3536): No heartbeat from core client for 30 sec - exiting 07:19:34 (3536): No heartbeat from core client for 30 sec - exiting 07:19:35 (3536): No heartbeat from core client for 30 sec - exiting 07:19:36 (3536): No heartbeat from core client for 30 sec - exiting 07:19:37 (3536): No heartbeat from core client for 30 sec - exiting 07:19:38 (3536): No heartbeat from core client for 30 sec - exiting 07:19:39 (3536): No heartbeat from core client for 30 sec - exiting 07:19:40 (3536): No heartbeat from core client for 30 sec - exiting 07:19:41 (3536): No heartbeat from core client for 30 sec - exiting 07:19:42 (3536): No heartbeat from core client for 30 sec - exiting 07:19:43 (3536): No heartbeat from core client for 30 sec - exiting 07:19:44 (3536): No heartbeat from core client for 30 sec - exiting 07:19:45 (3536): No heartbeat from core client for 30 sec - exiting 07:19:46 (3536): No heartbeat from core client for 30 sec - exiting 07:19:47 (3536): No heartbeat from core client for 30 sec - exiting 07:19:48 (3536): No heartbeat from core client for 30 sec - exiting 07:19:49 (3536): No heartbeat from core client for 30 sec - exiting 07:19:50 (3536): No heartbeat from core client for 30 sec - exiting 07:19:51 (3536): No heartbeat from core client for 30 sec - exiting 07:19:52 (3536): No heartbeat from core client for 30 sec - exiting 07:19:53 (3536): No heartbeat from core client for 30 sec - exiting 07:19:54 (3536): No heartbeat from core client for 30 sec - exiting 07:19:55 (3536): No heartbeat from core client for 30 sec - exiting 07:19:56 (3536): No heartbeat from core client for 30 sec - exiting 07:19:57 (3536): No heartbeat from core client for 30 sec - exiting 07:19:58 (3536): No heartbeat from core client for 30 sec - exiting 07:19:59 (3536): No heartbeat from core client for 30 sec - exiting 07:20:00 (3536): No heartbeat from core client for 30 sec - exiting 07:20:01 (3536): No heartbeat from core client for 30 sec - exiting 07:20:02 (3536): No heartbeat from core client for 30 sec - exiting 07:20:03 (3536): No heartbeat from core client for 30 sec - exiting 07:20:04 (3536): No heartbeat from core client for 30 sec - exiting 07:20:05 (3536): No heartbeat from core client for 30 sec - exiting 07:20:06 (3536): No heartbeat from core client for 30 sec - exiting 07:20:07 (3536): No heartbeat from core client for 30 sec - exiting 07:20:08 (3536): No heartbeat from core client for 30 sec - exiting 07:20:09 (3536): No heartbeat from core client for 30 sec - exiting 07:20:10 (3536): No heartbeat from core client for 30 sec - exiting 07:20:11 (3536): No heartbeat from core client for 30 sec - exiting 07:20:12 (3536): No heartbeat from core client for 30 sec - exiting 07:20:13 (3536): No heartbeat from core client for 30 sec - exiting 07:20:14 (3536): No heartbeat from core client for 30 sec - exiting 07:20:15 (3536): No heartbeat from core client for 30 sec - exiting 07:20:16 (3536): No heartbeat from core client for 30 sec - exiting 07:20:17 (3536): No heartbeat from core client for 30 sec - exiting 07:20:18 (3536): No heartbeat from core client for 30 sec - exiting 07:20:19 (3536): No heartbeat from core client for 30 sec - exiting 07:20:20 (3536): No heartbeat from core client for 30 sec - exiting 07:20:21 (3536): No heartbeat from core client for 30 sec - exiting 07:20:22 (3536): No heartbeat from core client for 30 sec - exiting 07:20:23 (3536): No heartbeat from core client for 30 sec - exiting 07:20:24 (3536): No heartbeat from core client for 30 sec - exiting 07:20:25 (3536): No heartbeat from core client for 30 sec - exiting 07:20:26 (3536): No heartbeat from core client for 30 sec - exiting 07:20:27 (3536): No heartbeat from core client for 30 sec - exiting 07:20:28 (3536): No heartbeat from core client for 30 sec - exiting 07:20:29 (3536): No heartbeat from core client for 30 sec - exiting 07:20:30 (3536): No heartbeat from core client for 30 sec - exiting 07:20:31 (3536): No heartbeat from core client for 30 sec - exiting 07:20:32 (3536): No heartbeat from core client for 30 sec - exiting 07:20:33 (3536): No heartbeat from core client for 30 sec - exiting 07:20:34 (3536): No heartbeat from core client for 30 sec - exiting 07:20:35 (3536): No heartbeat from core client for 30 sec - exiting 07:20:36 (3536): No heartbeat from core client for 30 sec - exiting 07:20:37 (3536): No heartbeat from core client for 30 sec - exiting 07:20:38 (3536): No heartbeat from core client for 30 sec - exiting 07:20:39 (3536): No heartbeat from core client for 30 sec - exiting 07:20:40 (3536): No heartbeat from core client for 30 sec - exiting 07:20:41 (3536): No heartbeat from core client for 30 sec - exiting 07:20:42 (3536): No heartbeat from core client for 30 sec - exiting 07:20:43 (3536): No heartbeat from core client for 30 sec - exiting 07:20:44 (3536): No heartbeat from core client for 30 sec - exiting 07:20:45 (3536): No heartbeat from core client for 30 sec - exiting 07:20:46 (3536): No heartbeat from core client for 30 sec - exiting 07:20:47 (3536): No heartbeat from core client for 30 sec - exiting 07:20:48 (3536): No heartbeat from core client for 30 sec - exiting 07:20:49 (3536): No heartbeat from core client for 30 sec - exiting 07:20:50 (3536): No heartbeat from core client for 30 sec - exiting 07:20:51 (3536): No heartbeat from core client for 30 sec - exiting 07:20:52 (3536): No heartbeat from core client for 30 sec - exiting 07:20:53 (3536): No heartbeat from core client for 30 sec - exiting 07:20:54 (3536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77BD5F1B read attempt to address 0x40423186 Engaging BOINC Windows Runtime Debugger... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5960, selfPID=5960, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77BD5F1B read attempt to address 0x40423186 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_u4xl_1980_40_007459541/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Oct 2011 17:29:31	1100678	13409759	hadcm3n_u4xl_1980_40_007459541_0	259,200	397,148	1.5322
17 Oct 2011 16:15:44	1100678	13409759	hadcm3n_u4xl_1980_40_007459541_0	233,280	358,189	1.5354
17 Oct 2011 00:58:52	1100678	13409759	hadcm3n_u4xl_1980_40_007459541_0	207,360	318,578	1.5364
15 Oct 2011 10:43:42	1100678	13409759	hadcm3n_u4xl_1980_40_007459541_0	181,440	278,871	1.5370
14 Oct 2011 16:47:32	1100678	13409759	hadcm3n_u4xl_1980_40_007459541_0	155,520	239,134	1.5376
03 Oct 2011 15:21:14	1100678	13409759	hadcm3n_u4xl_1980_40_007459541_0	129,600	199,591	1.5401
02 Oct 2011 02:05:28	1100678	13409759	hadcm3n_u4xl_1980_40_007459541_0	103,680	159,639	1.5397
01 Oct 2011 14:23:38	1100678	13409759	hadcm3n_u4xl_1980_40_007459541_0	77,760	119,361	1.5350
01 Oct 2011 02:42:38	1100678	13409759	hadcm3n_u4xl_1980_40_007459541_0	51,840	79,350	1.5307
25 Sep 2011 11:12:15	1100678	13409759	hadcm3n_u4xl_1980_40_007459541_0	25,920	39,541	1.5255