Task 13302252

Name	hadcm3n_p2fr_1940_40_007420043_2
Workunit	7617678
Created	26 Aug 2011, 19:02:58 UTC
Sent	26 Aug 2011, 19:08:48 UTC
Report deadline	26 Nov 2011, 2:35:59 UTC
Received	14 Sep 2011, 3:33:40 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1092138
Run time	10 days 2 hours 27 min 32 sec
CPU time	9 days 20 hours 38 min 4 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.59 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:19:53 (2372): No heartbeat from core client for 30 sec - exiting 15:19:54 (2372): No heartbeat from core client for 30 sec - exiting 15:19:55 (2372): No heartbeat from core client for 30 sec - exiting 15:19:56 (2372): No heartbeat from core client for 30 sec - exiting 15:19:57 (2372): No heartbeat from core client for 30 sec - exiting 15:19:58 (2372): No heartbeat from core client for 30 sec - exiting 15:19:59 (2372): No heartbeat from core client for 30 sec - exiting 15:20:00 (2372): No heartbeat from core client for 30 sec - exiting 15:20:01 (2372): No heartbeat from core client for 30 sec - exiting 15:20:02 (2372): No heartbeat from core client for 30 sec - exiting 15:20:03 (2372): No heartbeat from core client for 30 sec - exiting 15:20:04 (2372): No heartbeat from core client for 30 sec - exiting 15:20:05 (2372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:00:42 (3488): No heartbeat from core client for 30 sec - exiting 07:00:43 (3488): No heartbeat from core client for 30 sec - exiting 07:00:44 (3488): No heartbeat from core client for 30 sec - exiting 07:00:45 (3488): No heartbeat from core client for 30 sec - exiting 07:00:46 (3488): No heartbeat from core client for 30 sec - exiting 07:00:47 (3488): No heartbeat from core client for 30 sec - exiting 07:00:48 (3488): No heartbeat from core client for 30 sec - exiting 07:00:49 (3488): No heartbeat from core client for 30 sec - exiting 07:00:50 (3488): No heartbeat from core client for 30 sec - exiting 07:00:51 (3488): No heartbeat from core client for 30 sec - exiting 07:00:52 (3488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:27:56 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:17:14 (5232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 02:22:35 (3792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:47:47 (3772): No heartbeat from core client for 30 sec - exiting 02:47:48 (3772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 03:09:18 (5904): No heartbeat from core client for 30 sec - exiting 03:09:19 (5904): No heartbeat from core client for 30 sec - exiting 03:09:20 (5904): No heartbeat from core client for 30 sec - exiting 03:09:21 (5904): No heartbeat from core client for 30 sec - exiting 03:09:22 (5904): No heartbeat from core client for 30 sec - exiting 03:09:23 (5904): No heartbeat from core client for 30 sec - exiting 03:09:25 (5904): No heartbeat from core client for 30 sec - exiting 03:09:26 (5904): No heartbeat from core client for 30 sec - exiting 03:09:27 (5904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 03:13:25 (5564): No heartbeat from core client for 30 sec - exiting 03:13:26 (5564): No heartbeat from core client for 30 sec - exiting 03:13:27 (5564): No heartbeat from core client for 30 sec - exiting 03:13:28 (5564): No heartbeat from core client for 30 sec - exiting 03:13:29 (5564): No heartbeat from core client for 30 sec - exiting 03:13:31 (5564): No heartbeat from core client for 30 sec - exiting 03:13:32 (5564): No heartbeat from core client for 30 sec - exiting 03:13:33 (5564): No heartbeat from core client for 30 sec - exiting 03:13:34 (5564): No heartbeat from core client for 30 sec - exiting 03:13:35 (5564): No heartbeat from core client for 30 sec - exiting 03:13:36 (5564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:02:45 (5524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:50:56 (4776): No heartbeat from core client for 30 sec - exiting 20:50:57 (4776): No heartbeat from core client for 30 sec - exiting 20:50:58 (4776): No heartbeat from core client for 30 sec - exiting 20:50:59 (4776): No heartbeat from core client for 30 sec - exiting 20:51:00 (4776): No heartbeat from core client for 30 sec - exiting 20:51:01 (4776): No heartbeat from core client for 30 sec - exiting 20:51:02 (4776): No heartbeat from core client for 30 sec - exiting 20:51:04 (4776): No heartbeat from core client for 30 sec - exiting 20:51:04 (4776): No heartbeat from core client for 30 sec - exiting 20:51:05 (4776): No heartbeat from core client for 30 sec - exiting 20:51:07 (4776): No heartbeat from core client for 30 sec - exiting 20:51:08 (4776): No heartbeat from core client for 30 sec - exiting 20:51:09 (4776): No heartbeat from core client for 30 sec - exiting 20:51:10 (4776): No heartbeat from core client for 30 sec - exiting 20:51:11 (4776): No heartbeat from core client for 30 sec - exiting 20:51:12 (4776): No heartbeat from core client for 30 sec - exiting 20:51:13 (4776): No heartbeat from core client for 30 sec - exiting 20:51:14 (4776): No heartbeat from core client for 30 sec - exiting 20:51:15 (4776): No heartbeat from core client for 30 sec - exiting 20:51:16 (4776): No heartbeat from core client for 30 sec - exiting 20:51:17 (4776): No heartbeat from core client for 30 sec - exiting 20:51:18 (4776): No heartbeat from core client for 30 sec - exiting 20:51:19 (4776): No heartbeat from core client for 30 sec - exiting 20:51:20 (4776): No heartbeat from core client for 30 sec - exiting 20:51:21 (4776): No heartbeat from core client for 30 sec - exiting 20:51:22 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:28:26 (5904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:23:11 (4572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:13:24 (4288): No heartbeat from core client for 30 sec - exiting 03:13:25 (4288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:06:23 (3652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:14:38 (5760): No heartbeat from core client for 30 sec - exiting 09:14:39 (5760): No heartbeat from core client for 30 sec - exiting 09:14:40 (5760): No heartbeat from core client for 30 sec - exiting 09:14:41 (5760): No heartbeat from core client for 30 sec - exiting 09:14:42 (5760): No heartbeat from core client for 30 sec - exiting 09:14:43 (5760): No heartbeat from core client for 30 sec - exiting 09:14:44 (5760): No heartbeat from core client for 30 sec - exiting 09:14:45 (5760): No heartbeat from core client for 30 sec - exiting 09:14:46 (5760): No heartbeat from core client for 30 sec - exiting 09:14:47 (5760): No heartbeat from core client for 30 sec - exiting 09:14:48 (5760): No heartbeat from core client for 30 sec - exiting 09:14:49 (5760): No heartbeat from core client for 30 sec - exiting 09:14:50 (5760): No heartbeat from core client for 30 sec - exiting 09:14:51 (5760): No heartbeat from core client for 30 sec - exiting 09:14:52 (5760): No heartbeat from core client for 30 sec - exiting 09:14:53 (5760): No heartbeat from core client for 30 sec - exiting 09:14:54 (5760): No heartbeat from core client for 30 sec - exiting 09:14:55 (5760): No heartbeat from core client for 30 sec - exiting 09:14:56 (5760): No heartbeat from core client for 30 sec - exiting 09:14:57 (5760): No heartbeat from core client for 30 sec - exiting 09:14:58 (5760): No heartbeat from core client for 30 sec - exiting 09:14:59 (5760): No heartbeat from core client for 30 sec - exiting 09:15:00 (5760): No heartbeat from core client for 30 sec - exiting 09:15:01 (5760): No heartbeat from core client for 30 sec - exiting 09:15:02 (5760): No heartbeat from core client for 30 sec - exiting 09:15:03 (5760): No heartbeat from core client for 30 sec - exiting 09:15:04 (5760): No heartbeat from core client for 30 sec - exiting 09:15:05 (5760): No heartbeat from core client for 30 sec - exiting 09:15:06 (5760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:21:53 (1964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:52:25 (3336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76E76E0F read attempt to address 0x40359EBE Engaging BOINC Windows Runtime Debugger... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5928, selfPID=5928, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76E76E0F read attempt to address 0x40359EBE Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_p2fr_1940_40_007420043/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Sep 2011 01:33:38	1092138	13302252	hadcm3n_p2fr_1940_40_007420043_2	259,200	846,543	3.2660
11 Sep 2011 19:20:05	1092138	13302252	hadcm3n_p2fr_1940_40_007420043_2	233,280	761,374	3.2638
10 Sep 2011 14:34:49	1092138	13302252	hadcm3n_p2fr_1940_40_007420043_2	207,360	677,686	3.2682
08 Sep 2011 00:46:34	1092138	13302252	hadcm3n_p2fr_1940_40_007420043_2	181,440	593,055	3.2686
06 Sep 2011 15:20:58	1092138	13302252	hadcm3n_p2fr_1940_40_007420043_2	155,520	508,848	3.2719
04 Sep 2011 18:13:55	1092138	13302252	hadcm3n_p2fr_1940_40_007420043_2	129,600	425,365	3.2821
02 Sep 2011 04:58:41	1092138	13302252	hadcm3n_p2fr_1940_40_007420043_2	103,680	342,035	3.2989
31 Aug 2011 20:00:45	1092138	13302252	hadcm3n_p2fr_1940_40_007420043_2	77,760	257,131	3.3067
30 Aug 2011 13:03:40	1092138	13302252	hadcm3n_p2fr_1940_40_007420043_2	51,840	172,376	3.3252
28 Aug 2011 02:23:41	1092138	13302252	hadcm3n_p2fr_1940_40_007420043_2	25,920	86,089	3.3213