Task 13391877

Name	hadcm3n_t29x_1940_40_007447257_3
Workunit	7644760
Created	16 Sep 2011, 12:38:25 UTC
Sent	16 Sep 2011, 12:44:05 UTC
Report deadline	16 Dec 2011, 20:11:16 UTC
Received	14 Oct 2011, 14:29:27 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1154533
Run time	8 days 4 hours 44 min 42 sec
CPU time	7 days 21 hours 53 min 38 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.89 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:26:43 (5872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 02:35:28 (6496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:16:05 (7248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:31:17 (4036): No heartbeat from core client for 30 sec - exiting 13:31:18 (4036): No heartbeat from core client for 30 sec - exiting 13:31:19 (4036): No heartbeat from core client for 30 sec - exiting 13:31:20 (4036): No heartbeat from core client for 30 sec - exiting 13:31:21 (4036): No heartbeat from core client for 30 sec - exiting 13:31:22 (4036): No heartbeat from core client for 30 sec - exiting 13:31:23 (4036): No heartbeat from core client for 30 sec - exiting 13:31:24 (4036): No heartbeat from core client for 30 sec - exiting 13:31:25 (4036): No heartbeat from core client for 30 sec - exiting 13:31:26 (4036): No heartbeat from core client for 30 sec - exiting 13:31:27 (4036): No heartbeat from core client for 30 sec - exiting 13:31:28 (4036): No heartbeat from core client for 30 sec - exiting 13:31:29 (4036): No heartbeat from core client for 30 sec - exiting 13:31:30 (4036): No heartbeat from core client for 30 sec - exiting 13:31:31 (4036): No heartbeat from core client for 30 sec - exiting 13:31:32 (4036): No heartbeat from core client for 30 sec - exiting 13:31:33 (4036): No heartbeat from core client for 30 sec - exiting 13:31:34 (4036): No heartbeat from core client for 30 sec - exiting 13:31:35 (4036): No heartbeat from core client for 30 sec - exiting 13:31:36 (4036): No heartbeat from core client for 30 sec - exiting 13:31:37 (4036): No heartbeat from core client for 30 sec - exiting 13:31:38 (4036): No heartbeat from core client for 30 sec - exiting 13:31:39 (4036): No heartbeat from core client for 30 sec - exiting 13:31:40 (4036): No heartbeat from core client for 30 sec - exiting 13:31:41 (4036): No heartbeat from core client for 30 sec - exiting 13:31:42 (4036): No heartbeat from core client for 30 sec - exiting 13:31:43 (4036): No heartbeat from core client for 30 sec - exiting 13:31:44 (4036): No heartbeat from core client for 30 sec - exiting 13:31:45 (4036): No heartbeat from core client for 30 sec - exiting 13:31:46 (4036): No heartbeat from core client for 30 sec - exiting 13:31:47 (4036): No heartbeat from core client for 30 sec - exiting 13:31:48 (4036): No heartbeat from core client for 30 sec - exiting 13:31:49 (4036): No heartbeat from core client for 30 sec - exiting 13:31:50 (4036): No heartbeat from core client for 30 sec - exiting 13:31:51 (4036): No heartbeat from core client for 30 sec - exiting 13:31:52 (4036): No heartbeat from core client for 30 sec - exiting 13:31:53 (4036): No heartbeat from core client for 30 sec - exiting 13:31:54 (4036): No heartbeat from core client for 30 sec - exiting 13:31:55 (4036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:56:08 (3412): No heartbeat from core client for 30 sec - exiting 03:56:09 (3412): No heartbeat from core client for 30 sec - exiting 03:56:10 (3412): No heartbeat from core client for 30 sec - exiting 03:56:11 (3412): No heartbeat from core client for 30 sec - exiting 03:56:12 (3412): No heartbeat from core client for 30 sec - exiting 03:56:13 (3412): No heartbeat from core client for 30 sec - exiting 03:56:14 (3412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:21:51 (11148): No heartbeat from core client for 30 sec - exiting 21:21:52 (11148): No heartbeat from core client for 30 sec - exiting 21:21:53 (11148): No heartbeat from core client for 30 sec - exiting 21:21:54 (11148): No heartbeat from core client for 30 sec - exiting 21:21:55 (11148): No heartbeat from core client for 30 sec - exiting 21:21:56 (11148): No heartbeat from core client for 30 sec - exiting 21:21:57 (11148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:11:08 (1300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77453A93 read attempt to address 0x40E4ACE7 Engaging BOINC Windows Runtime Debugger... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7348, selfPID=7348, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77453A93 read attempt to address 0x40E4ACE7 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_t29x_1940_40_007447257/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77453772 read attempt to address 0x40E4ACE7 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77453A93 read attempt to address 0x40E4ACE7 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_t29x_1940_40_007447257/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77453772 read attempt to address 0x40E4ACE7 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77453A93 read attempt to address 0x40E4ACE7 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_t29x_1940_40_007447257/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77453772 read attempt to address 0x40E4ACE7 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77453A93 read attempt to address 0x40E4ACE7 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_t29x_1940_40_007447257/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77453772 read attempt to address 0x40E4ACE7 Engaging BOINC Windows Runtime Debugger... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Oct 2011 01:22:39	1154533	13391877	hadcm3n_t29x_1940_40_007447257_3	518,400	677,604	1.3071
13 Oct 2011 09:45:56	1154533	13391877	hadcm3n_t29x_1940_40_007447257_3	492,480	647,477	1.3147
12 Oct 2011 19:27:32	1154533	13391877	hadcm3n_t29x_1940_40_007447257_3	466,560	617,379	1.3233
12 Oct 2011 08:40:08	1154533	13391877	hadcm3n_t29x_1940_40_007447257_3	440,640	586,924	1.3320
11 Oct 2011 16:38:39	1154533	13391877	hadcm3n_t29x_1940_40_007447257_3	414,720	556,516	1.3419
11 Oct 2011 07:30:07	1154533	13391877	hadcm3n_t29x_1940_40_007447257_3	388,800	526,406	1.3539
10 Oct 2011 21:48:48	1154533	13391877	hadcm3n_t29x_1940_40_007447257_3	362,880	496,251	1.3675
10 Oct 2011 12:59:43	1154533	13391877	hadcm3n_t29x_1940_40_007447257_3	336,960	465,870	1.3826
10 Oct 2011 02:43:05	1154533	13391877	hadcm3n_t29x_1940_40_007447257_3	311,040	435,498	1.4001
09 Oct 2011 17:27:33	1154533	13391877	hadcm3n_t29x_1940_40_007447257_3	285,120	405,129	1.4209
09 Oct 2011 08:01:01	1154533	13391877	hadcm3n_t29x_1940_40_007447257_3	259,200	374,843	1.4462
08 Oct 2011 22:52:42	1154533	13391877	hadcm3n_t29x_1940_40_007447257_3	233,280	344,653	1.4774
08 Oct 2011 13:09:12	1154533	13391877	hadcm3n_t29x_1940_40_007447257_3	207,360	314,346	1.5159
08 Oct 2011 02:46:27	1154533	13391877	hadcm3n_t29x_1940_40_007447257_3	181,440	284,207	1.5664
07 Oct 2011 12:43:57	1154533	13391877	hadcm3n_t29x_1940_40_007447257_3	155,520	254,262	1.6349
07 Oct 2011 02:58:57	1154533	13391877	hadcm3n_t29x_1940_40_007447257_3	129,600	223,945	1.7280
06 Oct 2011 06:40:57	1154533	13391877	hadcm3n_t29x_1940_40_007447257_3	103,680	183,059	1.7656
05 Oct 2011 10:47:12	1154533	13391877	hadcm3n_t29x_1940_40_007447257_3	77,760	137,762	1.7716
02 Oct 2011 18:53:36	1154533	13391877	hadcm3n_t29x_1940_40_007447257_3	51,840	92,459	1.7835
25 Sep 2011 17:17:08	1154533	13391877	hadcm3n_t29x_1940_40_007447257_3	25,920	46,732	1.8029