Task 14366374

Name	hadcm3n_ye54_1980_40_007858412_1
Workunit	8013524
Created	5 Apr 2012, 18:40:19 UTC
Sent	5 Apr 2012, 18:50:44 UTC
Report deadline	6 Jul 2012, 2:17:55 UTC
Received	1 May 2012, 16:28:02 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1008879
Run time	6 days 11 hours 43 min 51 sec
CPU time	5 days 5 hours 55 min 22 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.04 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:09:28 (1752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:10:57 (4372): Can't acquire lockfile (32) - waiting 35s 16:11:13 (4500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:45:13 (5168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4728, iMonCtr=1 Model crash detected, will try to restart... 08:37:00 (3124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:04:57 (5136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:03:29 (584): No heartbeat from core client for 30 sec - exiting 21:03:30 (584): No heartbeat from core client for 30 sec - exiting 21:03:31 (584): No heartbeat from core client for 30 sec - exiting 21:03:32 (584): No heartbeat from core client for 30 sec - exiting 21:03:33 (584): No heartbeat from core client for 30 sec - exiting 21:03:34 (584): No heartbeat from core client for 30 sec - exiting 21:03:35 (584): No heartbeat from core client for 30 sec - exiting 21:03:36 (584): No heartbeat from core client for 30 sec - exiting 21:03:37 (584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:58:35 (2224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:32:25 (5608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:29:59 (4868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:44:18 (5304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:45:02 (3788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:12:03 (4716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2356, iMonCtr=1 Model crash detected, will try to restart... 16:33:02 (5892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5072, iMonCtr=1 Model crash detected, will try to restart... 17:03:52 (4960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:04:44 (2776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:51:14 (5012): No heartbeat from core client for 30 sec - exiting 08:51:15 (5012): No heartbeat from core client for 30 sec - exiting 08:51:16 (5012): No heartbeat from core client for 30 sec - exiting 08:51:17 (5012): No heartbeat from core client for 30 sec - exiting 08:51:18 (5012): No heartbeat from core client for 30 sec - exiting 08:51:19 (5012): No heartbeat from core client for 30 sec - exiting 08:51:20 (5012): No heartbeat from core client for 30 sec - exiting 08:51:21 (5012): No heartbeat from core client for 30 sec - exiting 08:51:22 (5012): No heartbeat from core client for 30 sec - exiting 08:51:23 (5012): No heartbeat from core client for 30 sec - exiting 08:51:24 (5012): No heartbeat from core client for 30 sec - exiting 08:51:25 (5012): No heartbeat from core client for 30 sec - exiting 08:51:26 (5012): No heartbeat from core client for 30 sec - exiting 08:51:27 (5012): No heartbeat from core client for 30 sec - exiting 08:51:28 (5012): No heartbeat from core client for 30 sec - exiting 08:51:29 (5012): No heartbeat from core client for 30 sec - exiting 08:51:30 (5012): No heartbeat from core client for 30 sec - exiting 08:51:31 (5012): No heartbeat from core client for 30 sec - exiting 08:51:32 (5012): No heartbeat from core client for 30 sec - exiting 08:51:33 (5012): No heartbeat from core client for 30 sec - exiting 08:51:34 (5012): No heartbeat from core client for 30 sec - exiting 08:51:35 (5012): No heartbeat from core client for 30 sec - exiting 08:51:36 (5012): No heartbeat from core client for 30 sec - exiting 08:51:37 (5012): No heartbeat from core client for 30 sec - exiting 08:51:38 (5012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:51:39 (5012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 11:19:20 (1744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:26:34 (4504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5520, iMonCtr=1 Model crash detected, will try to restart... 09:26:58 (3972): No heartbeat from core client for 30 sec - exiting 09:26:59 (3972): No heartbeat from core client for 30 sec - exiting 09:27:00 (3972): No heartbeat from core client for 30 sec - exiting 09:27:01 (3972): No heartbeat from core client for 30 sec - exiting 09:27:02 (3972): No heartbeat from core client for 30 sec - exiting 09:27:03 (3972): No heartbeat from core client for 30 sec - exiting 09:27:04 (3972): No heartbeat from core client for 30 sec - exiting 09:27:05 (3972): No heartbeat from core client for 30 sec - exiting 09:27:06 (3972): No heartbeat from core client for 30 sec - exiting 09:27:07 (3972): No heartbeat from core client for 30 sec - exiting 09:27:08 (3972): No heartbeat from core client for 30 sec - exiting 09:27:09 (3972): No heartbeat from core client for 30 sec - exiting 09:27:10 (3972): No heartbeat from core client for 30 sec - exiting 09:27:11 (3972): No heartbeat from core client for 30 sec - exiting 09:27:12 (3972): No heartbeat from core client for 30 sec - exiting 09:27:13 (3972): No heartbeat from core client for 30 sec - exiting 09:27:14 (3972): No heartbeat from core client for 30 sec - exiting 09:27:15 (3972): No heartbeat from core client for 30 sec - exiting 09:27:16 (3972): No heartbeat from core client for 30 sec - exiting 09:27:17 (3972): No heartbeat from core client for 30 sec - exiting 09:27:18 (3972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:27:19 (3972): No heartbeat from core client for 30 sec - exiting 09:27:20 (3972): No heartbeat from core client for 30 sec - exiting 09:27:21 (3972): No heartbeat from core client for 30 sec - exiting 09:27:22 (3972): No heartbeat from core client for 30 sec - exiting 09:27:23 (3972): No heartbeat from core client for 30 sec - exiting 09:27:24 (3972): No heartbeat from core client for 30 sec - exiting 09:27:25 (3972): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5800, iMonCtr=1 Model crash detected, will try to restart... 16:26:23 (5024): No heartbeat from core client for 30 sec - exiting 16:26:24 (5024): No heartbeat from core client for 30 sec - exiting 16:26:25 (5024): No heartbeat from core client for 30 sec - exiting 16:26:26 (5024): No heartbeat from core client for 30 sec - exiting 16:26:27 (5024): No heartbeat from core client for 30 sec - exiting 16:26:28 (5024): No heartbeat from core client for 30 sec - exiting 16:26:29 (5024): No heartbeat from core client for 30 sec - exiting 16:26:30 (5024): No heartbeat from core client for 30 sec - exiting 16:26:31 (5024): No heartbeat from core client for 30 sec - exiting 16:26:32 (5024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x777A8851 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_ye54_1980_40_007858412/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 May 2012 16:32:39	1008879	14366374	hadcm3n_ye54_1980_40_007858412_1	259,200	453,310	1.7489
29 Apr 2012 11:09:47	1008879	14366374	hadcm3n_ye54_1980_40_007858412_1	233,280	408,636	1.7517
28 Apr 2012 09:43:01	1008879	14366374	hadcm3n_ye54_1980_40_007858412_1	207,360	363,391	1.7525
25 Apr 2012 16:52:22	1008879	14366374	hadcm3n_ye54_1980_40_007858412_1	181,440	318,943	1.7578
22 Apr 2012 12:09:43	1008879	14366374	hadcm3n_ye54_1980_40_007858412_1	155,520	272,649	1.7531
19 Apr 2012 20:00:10	1008879	14366374	hadcm3n_ye54_1980_40_007858412_1	129,600	227,494	1.7554
16 Apr 2012 17:54:04	1008879	14366374	hadcm3n_ye54_1980_40_007858412_1	103,680	181,284	1.7485
13 Apr 2012 08:06:12	1008879	14366374	hadcm3n_ye54_1980_40_007858412_1	77,760	135,645	1.7444
10 Apr 2012 12:27:38	1008879	14366374	hadcm3n_ye54_1980_40_007858412_1	51,840	91,039	1.7562
08 Apr 2012 18:45:10	1008879	14366374	hadcm3n_ye54_1980_40_007858412_1	25,920	46,351	1.7882