Task 15843632

Name	hadcm3n_o0uk_1980_40_008385087_2
Workunit	8535946
Created	15 Jun 2013, 8:24:24 UTC
Sent	15 Jun 2013, 9:04:44 UTC
Report deadline	14 Sep 2013, 16:31:55 UTC
Received	14 Sep 2013, 19:22:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	939489
Run time	23 days 14 hours 57 min 13 sec
CPU time	18 days 23 hours 45 min
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.05 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> 13:25:12 (4508): start_timer_thread(): CreateThread() failed, errno 0 12:12:49 (3332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:11:32 (1104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:09:49 (7508): start_timer_thread(): CreateThread() failed, errno 0 20:49:03 (5316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:11:37 (1092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CCPDN Monitor - Quit request from BOINC... 19:18:14 (2064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:03:07 (5596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:40:50 (3304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5284, iMonCtr=1 Model crash detected, will try to restart... 19:20:39 (1504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:08:11 (3172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:52:04 (1724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... C21:05:55 (4120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:04:00 (3880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:04:35 (5412): start_timer_thread(): CreateThread() failed, errno 0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5428, iMonCtr=1 Model crash detected, will try to restart... CCPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5920, iMonCtr=1 Model crash detected, will try to restart... 16:04:42 (564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:03:36 (2136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:15:59 (5420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:14:56 (4696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:44:28 (2364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:43:25 (5080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:46:49 (4552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:45:44 (1404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:44:47 (2348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:11:51 (3088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:10:41 (1612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4780, iMonCtr=1 Model crash detected, will try to restart... 12:16:52 (4940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:15:37 (2644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:14:31 (2508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:15:05 (5744): start_timer_thread(): CreateThread() failed, errno 0 14:41:38 (2548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:36:43 (5144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:05:54 (5196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:46:59 (3748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:09:42 (5556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:30:45 (7108): start_timer_thread(): CreateThread() failed, errno 0 19:56:34 (4872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6128, iMonCtr=1 Model crash detected, will try to r Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77996E9F read attempt to address 0x40A281D2 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77DD6E9F read attempt to address 0x40A281D2 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o0uk_1980_40_008385087/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Sep 2013 10:33:31	939489	15843632	hadcm3n_o0uk_1980_40_008385087_2	518,400	1,638,559	3.1608
07 Sep 2013 20:37:45	939489	15843632	hadcm3n_o0uk_1980_40_008385087_2	492,480	1,555,547	3.1586
31 Aug 2013 16:43:36	939489	15843632	hadcm3n_o0uk_1980_40_008385087_2	466,560	1,461,395	3.1323
25 Aug 2013 09:13:09	939489	15843632	hadcm3n_o0uk_1980_40_008385087_2	440,640	1,374,547	3.1194
23 Aug 2013 11:01:16	939489	15843632	hadcm3n_o0uk_1980_40_008385087_2	414,720	1,294,055	3.1203
20 Aug 2013 17:30:49	939489	15843632	hadcm3n_o0uk_1980_40_008385087_2	388,800	1,214,917	3.1248
18 Aug 2013 09:35:07	939489	15843632	hadcm3n_o0uk_1980_40_008385087_2	362,880	1,123,803	3.0969
15 Aug 2013 19:54:59	939489	15843632	hadcm3n_o0uk_1980_40_008385087_2	336,960	1,040,878	3.0890
14 Aug 2013 15:29:25	939489	15843632	hadcm3n_o0uk_1980_40_008385087_2	311,040	963,591	3.0980
14 Aug 2013 15:29:25	939489	15843632	hadcm3n_o0uk_1980_40_008385087_2	285,120	873,339	3.0631
14 Aug 2013 15:29:25	939489	15843632	hadcm3n_o0uk_1980_40_008385087_2	259,200	791,976	3.0555
14 Aug 2013 15:29:24	939489	15843632	hadcm3n_o0uk_1980_40_008385087_2	233,280	703,212	3.0145
14 Aug 2013 15:29:24	939489	15843632	hadcm3n_o0uk_1980_40_008385087_2	207,360	621,282	2.9962
14 Aug 2013 15:29:24	939489	15843632	hadcm3n_o0uk_1980_40_008385087_2	181,440	542,812	2.9917
23 Jul 2013 20:54:53	939489	15843632	hadcm3n_o0uk_1980_40_008385087_2	155,520	460,273	2.9596
23 Jul 2013 18:46:41	939489	15843632	hadcm3n_o0uk_1980_40_008385087_2	129,600	375,558	2.8978
06 Jul 2013 20:29:39	939489	15843632	hadcm3n_o0uk_1980_40_008385087_2	103,680	293,366	2.8295
06 Jul 2013 04:06:29	939489	15843632	hadcm3n_o0uk_1980_40_008385087_2	77,760	211,690	2.7224
02 Jul 2013 10:04:13	939489	15843632	hadcm3n_o0uk_1980_40_008385087_2	51,840	124,024	2.3924
22 Jun 2013 20:45:57	939489	15843632	hadcm3n_o0uk_1980_40_008385087_2	25,920	53,924	2.0804