Task 12736179

Name	hadcm3n_o1o7_1900_40_007197498_0
Workunit	7395778
Created	28 Mar 2011, 14:01:02 UTC
Sent	1 Apr 2011, 14:37:02 UTC
Report deadline	1 Jul 2011, 22:04:13 UTC
Received	28 Apr 2011, 5:56:06 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1064102
Run time	10 days 1 hours 32 min 9 sec
CPU time	9 days 7 hours 46 min 54 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	0.57 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:22:43 (6064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:50:01 (4004): No heartbeat from core client for 30 sec - exiting 07:50:02 (4004): No heartbeat from core client for 30 sec - exiting 07:50:03 (4004): No heartbeat from core client for 30 sec - exiting 07:50:04 (4004): No heartbeat from core client for 30 sec - exiting 07:50:05 (4004): No heartbeat from core client for 30 sec - exiting 07:50:06 (4004): No heartbeat from core client for 30 sec - exiting 07:50:07 (4004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:26:12 (3788): No heartbeat from core client for 30 sec - exiting 16:26:13 (3788): No heartbeat from core client for 30 sec - exiting 16:26:14 (3788): No heartbeat from core client for 30 sec - exiting 16:26:15 (3788): No heartbeat from core client for 30 sec - exiting 16:26:16 (3788): No heartbeat from core client for 30 sec - exiting 16:26:17 (3788): No heartbeat from core client for 30 sec - exiting 16:26:18 (3788): No heartbeat from core client for 30 sec - exiting 16:26:19 (3788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:27:04 (2848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6944, iMonCtr=1 Model crash detected, will try to restart... 07:37:56 (2344): No heartbeat from core client for 30 sec - exiting 07:37:57 (2344): No heartbeat from core client for 30 sec - exiting 07:37:58 (2344): No heartbeat from core client for 30 sec - exiting 07:37:59 (2344): No heartbeat from core client for 30 sec - exiting 07:38:00 (2344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:49:39 (7108): No heartbeat from core client for 30 sec - exiting 07:49:40 (7108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:38:32 (3352): No heartbeat from core client for 30 sec - exiting 07:38:33 (3352): No heartbeat from core client for 30 sec - exiting 07:38:34 (3352): No heartbeat from core client for 30 sec - exiting 07:38:35 (3352): No heartbeat from core client for 30 sec - exiting 07:38:36 (3352): No heartbeat from core client for 30 sec - exiting 07:38:37 (3352): No heartbeat from core client for 30 sec - exiting 07:38:38 (3352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1960, iMonCtr=1 Model crash detected, will try to restart... 07:59:32 (5388): No heartbeat from core client for 30 sec - exiting 07:59:33 (5388): No heartbeat from core client for 30 sec - exiting 07:59:34 (5388): No heartbeat from core client for 30 sec - exiting 07:59:35 (5388): No heartbeat from core client for 30 sec - exiting 07:59:36 (5388): No heartbeat from core client for 30 sec - exiting 07:59:37 (5388): No heartbeat from core client for 30 sec - exiting 07:59:38 (5388): No heartbeat from core client for 30 sec - exiting 07:59:39 (5388): No heartbeat from core client for 30 sec - exiting 07:59:40 (5388): No heartbeat from core client for 30 sec - exiting 07:59:41 (5388): No heartbeat from core client for 30 sec - exiting 07:59:42 (5388): No heartbeat from core client for 30 sec - exiting 07:59:43 (5388): No heartbeat from core client for 30 sec - exiting 07:59:44 (5388): No heartbeat from core client for 30 sec - exiting 07:59:45 (5388): No heartbeat from core client for 30 sec - exiting 07:59:46 (5388): No heartbeat from core client for 30 sec - exiting 07:59:47 (5388): No heartbeat from core client for 30 sec - exiting 07:59:48 (5388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:36:15 (5552): No heartbeat from core client for 30 sec - exiting 03:36:16 (5552): No heartbeat from core client for 30 sec - exiting 03:36:17 (5552): No heartbeat from core client for 30 sec - exiting 03:36:18 (5552): No heartbeat from core client for 30 sec - exiting 03:36:19 (5552): No heartbeat from core client for 30 sec - exiting 03:36:20 (5552): No heartbeat from core client for 30 sec - exiting 03:36:21 (5552): No heartbeat from core client for 30 sec - exiting 03:36:22 (5552): No heartbeat from core client for 30 sec - exiting 03:36:23 (5552): No heartbeat from core client for 30 sec - exiting 03:36:24 (5552): No heartbeat from core client for 30 sec - exiting 03:36:25 (5552): No heartbeat from core client for 30 sec - exiting 03:36:26 (5552): No heartbeat from core client for 30 sec - exiting 03:36:27 (5552): No heartbeat from core client for 30 sec - exiting 03:36:28 (5552): No heartbeat from core client for 30 sec - exiting 03:36:29 (5552): No heartbeat from core client for 30 sec - exiting 03:36:30 (5552): No heartbeat from core client for 30 sec - exiting 03:36:31 (5552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5032, iMonCtr=1 Model crash detected, will try to restart... 07:41:12 (4116): No heartbeat from core client for 30 sec - exiting 07:41:13 (4116): No heartbeat from core client for 30 sec - exiting 07:41:14 (4116): No heartbeat from core client for 30 sec - exiting 07:41:15 (4116): No heartbeat from core client for 30 sec - exiting 07:41:16 (4116): No heartbeat from core client for 30 sec - exiting 07:41:17 (4116): No heartbeat from core client for 30 sec - exiting 07:41:18 (4116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:10:55 (3756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x773B3A93 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o1o7_1900_40_007197498/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Apr 2011 23:57:18	1064102	12736179	hadcm3n_o1o7_1900_40_007197498_0	259,200	805,601	3.1080
20 Apr 2011 18:16:06	1064102	12736179	hadcm3n_o1o7_1900_40_007197498_0	233,280	720,657	3.0892
20 Apr 2011 18:16:06	1064102	12736179	hadcm3n_o1o7_1900_40_007197498_0	207,360	639,799	3.0855
13 Apr 2011 05:08:36	1064102	12736179	hadcm3n_o1o7_1900_40_007197498_0	181,440	561,210	3.0931
12 Apr 2011 05:12:05	1064102	12736179	hadcm3n_o1o7_1900_40_007197498_0	155,520	480,885	3.0921
10 Apr 2011 20:11:04	1064102	12736179	hadcm3n_o1o7_1900_40_007197498_0	129,600	398,612	3.0757
09 Apr 2011 19:53:59	1064102	12736179	hadcm3n_o1o7_1900_40_007197498_0	103,680	319,149	3.0782
08 Apr 2011 11:58:08	1064102	12736179	hadcm3n_o1o7_1900_40_007197498_0	77,760	240,622	3.0944
07 Apr 2011 03:57:42	1064102	12736179	hadcm3n_o1o7_1900_40_007197498_0	51,840	161,416	3.1137
06 Apr 2011 04:12:26	1064102	12736179	hadcm3n_o1o7_1900_40_007197498_0	25,920	82,105	3.1676