Task 13350679

Name	hadcm3n_o6vg_1940_40_007444117_1
Workunit	7641620
Created	9 Sep 2011, 1:35:48 UTC
Sent	9 Sep 2011, 1:40:38 UTC
Report deadline	9 Dec 2011, 9:07:49 UTC
Received	18 Sep 2011, 5:02:56 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1090356
Run time	3 days 16 hours 13 min
CPU time	3 days 11 hours 59 min 43 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.42 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:43:35 (3136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:02:08 (3748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:02:09 (3748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:21:21 (4412): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 14:21:22 (4412): No heartbeat from core client for 30 sec - exiting 14:21:23 (4412): No heartbeat from core client for 30 sec - exiting 14:21:24 (4412): No heartbeat from core client for 30 sec - exiting 14:21:25 (4412): No heartbeat from core client for 30 sec - exiting 14:21:26 (4412): No heartbeat from core client for 30 sec - exiting 14:21:27 (4412): No heartbeat from core client for 30 sec - exiting 14:21:28 (4412): No heartbeat from core client for 30 sec - exiting 14:21:29 (4412): No heartbeat from core client for 30 sec - exiting 14:21:30 (4412): No heartbeat from core client for 30 sec - exiting 14:21:32 (4412): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 14:27:26 (3992): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 14:27:27 (3992): No heartbeat from core client for 30 sec - exiting 14:27:28 (3992): No heartbeat from core client for 30 sec - exiting 14:27:29 (3992): No heartbeat from core client for 30 sec - exiting 14:27:30 (3992): No heartbeat from core client for 30 sec - exiting 14:27:31 (3992): No heartbeat from core client for 30 sec - exiting 14:27:32 (3992): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:48:56 (6100): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 14:48:57 (6100): No heartbeat from core client for 30 sec - exiting 14:48:58 (6100): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:34:37 (1644): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 15:34:38 (1644): No heartbeat from core client for 30 sec - exiting 15:34:39 (1644): No heartbeat from core client for 30 sec - exiting 15:34:41 (1644): No heartbeat from core client for 30 sec - exiting 15:34:42 (1644): No heartbeat from core client for 30 sec - exiting 15:34:43 (1644): No heartbeat from core client for 30 sec - exiting 15:34:44 (1644): No heartbeat from core client for 30 sec - exiting 15:34:45 (1644): No heartbeat from core client for 30 sec - exiting 15:34:46 (1644): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:43:46 (4336): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 15:43:47 (4336): No heartbeat from core client for 30 sec - exiting 15:43:48 (4336): No heartbeat from core client for 30 sec - exiting 15:43:49 (4336): No heartbeat from core client for 30 sec - exiting 15:43:51 (4336): No heartbeat from core client for 30 sec - exiting 15:43:52 (4336): No heartbeat from core client for 30 sec - exiting 15:43:53 (4336): No heartbeat from core client for 30 sec - exiting 15:43:54 (4336): No heartbeat from core client for 30 sec - exiting 15:43:55 (4336): No heartbeat from core client for 30 sec - exiting 15:43:56 (4336): No heartbeat from core client for 30 sec - exiting 15:43:57 (4336): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:12:22 (5048): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:24:33 (4112): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 17:24:35 (4112): No heartbeat from core client for 30 sec - exiting 17:24:36 (4112): No heartbeat from core client for 30 sec - exiting 17:24:37 (4112): No heartbeat from core client for 30 sec - exiting 17:24:38 (4112): No heartbeat from core client for 30 sec - exiting 17:24:39 (4112): No heartbeat from core client for 30 sec - exiting 17:24:40 (4112): No heartbeat from core client for 30 sec - exiting 17:24:41 (4112): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:24:16 (4032): No heartbeat from core client for 30 sec - exiting 03:24:17 (4032): No heartbeat from core client for 30 sec - exiting 03:24:18 (4032): No heartbeat from core client for 30 sec - exiting 03:24:19 (4032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=388, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x777E3A93 read attempt to address 0x40A6854F Engaging BOINC Windows Runtime Debugger... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4016, selfPID=4016, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x777E7353 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file D:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o6vg_1940_40_007444117/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Sep 2011 06:49:19	1090356	13350679	hadcm3n_o6vg_1940_40_007444117_1	259,200	282,457	1.0897
16 Sep 2011 09:33:58	1090356	13350679	hadcm3n_o6vg_1940_40_007444117_1	233,280	254,684	1.0918
15 Sep 2011 15:31:39	1090356	13350679	hadcm3n_o6vg_1940_40_007444117_1	207,360	226,944	1.0944
15 Sep 2011 06:21:45	1090356	13350679	hadcm3n_o6vg_1940_40_007444117_1	181,440	199,494	1.0995
13 Sep 2011 07:58:26	1090356	13350679	hadcm3n_o6vg_1940_40_007444117_1	155,520	171,058	1.0999
12 Sep 2011 08:39:40	1090356	13350679	hadcm3n_o6vg_1940_40_007444117_1	129,600	143,738	1.1091
11 Sep 2011 17:21:51	1090356	13350679	hadcm3n_o6vg_1940_40_007444117_1	103,680	114,298	1.1024
11 Sep 2011 08:31:11	1090356	13350679	hadcm3n_o6vg_1940_40_007444117_1	77,760	85,944	1.1052
10 Sep 2011 12:46:42	1090356	13350679	hadcm3n_o6vg_1940_40_007444117_1	51,840	58,247	1.1236
10 Sep 2011 04:33:59	1090356	13350679	hadcm3n_o6vg_1940_40_007444117_1	25,920	29,711	1.1463