Task 13566073

Name	hadcm3n_ylc6_1900_40_007525782_3
Workunit	7723257
Created	30 Oct 2011, 0:40:00 UTC
Sent	30 Oct 2011, 1:12:13 UTC
Report deadline	29 Jan 2012, 8:39:24 UTC
Received	19 Nov 2011, 5:26:24 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1161345
Run time	4 days 10 hours 32 min 9 sec
CPU time	4 days 7 hours 35 min 27 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.64 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4004, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:24:18 (3976): No heartbeat from core client for 30 sec - exiting 18:24:20 (3976): No heartbeat from core client for 30 sec - exiting 18:24:21 (3976): No heartbeat from core client for 30 sec - exiting 18:24:22 (3976): No heartbeat from core client for 30 sec - exiting 18:24:23 (3976): No heartbeat from core client for 30 sec - exiting 18:24:24 (3976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:33:09 (4900): No heartbeat from core client for 30 sec - exiting 10:33:10 (4900): No heartbeat from core client for 30 sec - exiting 10:33:12 (4900): No heartbeat from core client for 30 sec - exiting 10:33:13 (4900): No heartbeat from core client for 30 sec - exiting 10:33:14 (4900): No heartbeat from core client for 30 sec - exiting 10:33:15 (4900): No heartbeat from core client for 30 sec - exiting 10:33:16 (4900): No heartbeat from core client for 30 sec - exiting 10:33:17 (4900): No heartbeat from core client for 30 sec - exiting 10:33:18 (4900): No heartbeat from core client for 30 sec - exiting 10:33:19 (4900): No heartbeat from core client for 30 sec - exiting 10:33:20 (4900): No heartbeat from core client for 30 sec - exiting 10:33:21 (4900): No heartbeat from core client for 30 sec - exiting 10:33:22 (4900): No heartbeat from core client for 30 sec - exiting 10:33:24 (4900): No heartbeat from core client for 30 sec - exiting 10:33:25 (4900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:04:48 (3020): No heartbeat from core client for 30 sec - exiting 09:04:49 (3020): No heartbeat from core client for 30 sec - exiting 09:04:50 (3020): No heartbeat from core client for 30 sec - exiting 09:04:51 (3020): No heartbeat from core client for 30 sec - exiting 09:04:52 (3020): No heartbeat from core client for 30 sec - exiting 09:04:53 (3020): No heartbeat from core client for 30 sec - exiting 09:04:54 (3020): No heartbeat from core client for 30 sec - exiting 09:04:55 (3020): No heartbeat from core client for 30 sec - exiting 09:04:57 (3020): No heartbeat from core client for 30 sec - exiting 09:04:58 (3020): No heartbeat from core client for 30 sec - exiting 09:04:59 (3020): No heartbeat from core client for 30 sec - exiting 09:05:00 (3020): No heartbeat from core client for 30 sec - exiting 09:05:01 (3020): No heartbeat from core client for 30 sec - exiting 09:05:02 (3020): No heartbeat from core client for 30 sec - exiting 09:05:03 (3020): No heartbeat from core client for 30 sec - exiting 09:05:04 (3020): No heartbeat from core client for 30 sec - exiting 09:05:05 (3020): No heartbeat from core client for 30 sec - exiting 09:05:06 (3020): No heartbeat from core client for 30 sec - exiting 09:05:08 (3020): No heartbeat from core client for 30 sec - exiting 09:05:09 (3020): No heartbeat from core client for 30 sec - exiting 09:05:10 (3020): No heartbeat from core client for 30 sec - exiting 09:05:11 (3020): No heartbeat from core client for 30 sec - exiting 09:05:12 (3020): No heartbeat from core client for 30 sec - exiting 09:05:13 (3020): No heartbeat from core client for 30 sec - exiting 09:05:14 (3020): No heartbeat from core client for 30 sec - exiting 09:05:15 (3020): No heartbeat from core client for 30 sec - exiting 09:05:16 (3020): No heartbeat from core client for 30 sec - exiting 09:05:17 (3020): No heartbeat from core client for 30 sec - exiting 09:05:18 (3020): No heartbeat from core client for 30 sec - exiting 09:05:20 (3020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:06:28 (4972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:24:13 (4396): No heartbeat from core client for 30 sec - exiting 10:24:14 (4396): No heartbeat from core client for 30 sec - exiting 10:24:15 (4396): No heartbeat from core client for 30 sec - exiting 10:24:16 (4396): No heartbeat from core client for 30 sec - exiting 10:24:17 (4396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1540, iMonCtr=1 Model crash detected, will try to restart... 10:03:15 (3236): No heartbeat from core client for 30 sec - exiting 10:03:16 (3236): No heartbeat from core client for 30 sec - exiting 10:03:17 (3236): No heartbeat from core client for 30 sec - exiting 10:03:18 (3236): No heartbeat from core client for 30 sec - exiting 10:03:19 (3236): No heartbeat from core client for 30 sec - exiting 10:03:20 (3236): No heartbeat from core client for 30 sec - exiting 10:03:21 (3236): No heartbeat from core client for 30 sec - exiting 10:03:22 (3236): No heartbeat from core client for 30 sec - exiting 10:03:23 (3236): No heartbeat from core client for 30 sec - exiting 10:03:24 (3236): No heartbeat from core client for 30 sec - exiting 10:03:25 (3236): No heartbeat from core client for 30 sec - exiting 10:03:27 (3236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:57:35 (4188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:59:34 (4656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Cforrtl: Access is denied. CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4616, selfPID=4616, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CNo Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4212, selfPID=4212, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CWorker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Cforrtl: Access is denied. CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4196, selfPID=4196, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:02:13 (3988): No heartbeat from core client for 30 sec - exiting 18:02:15 (3988): No heartbeat from core client for 30 sec - exiting 18:02:16 (3988): No heartbeat from core client for 30 sec - exiting 18:02:17 (3988): No heartbeat from core client for 30 sec - exiting 18:02:18 (3988): No heartbeat from core client for 30 sec - exiting 18:02:19 (3988): No heartbeat from core client for 30 sec - exiting 18:02:20 (3988): No heartbeat from core client for 30 sec - exiting 18:02:21 (3988): No heartbeat from core client for 30 sec - exiting 18:02:22 (3988): No heartbeat from core client for 30 sec - exiting 18:02:23 (3988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Nov 2011 04:27:34	1161345	13566073	hadcm3n_ylc6_1900_40_007525782_3	259,200	372,922	1.4387
16 Nov 2011 06:59:01	1161345	13566073	hadcm3n_ylc6_1900_40_007525782_3	233,280	335,138	1.4366
16 Nov 2011 05:58:29	1161345	13566073	hadcm3n_ylc6_1900_40_007525782_3	207,360	297,942	1.4368
16 Nov 2011 05:58:29	1161345	13566073	hadcm3n_ylc6_1900_40_007525782_3	181,440	261,062	1.4388
16 Nov 2011 05:58:29	1161345	13566073	hadcm3n_ylc6_1900_40_007525782_3	155,520	224,066	1.4408
16 Nov 2011 05:58:29	1161345	13566073	hadcm3n_ylc6_1900_40_007525782_3	129,600	187,100	1.4437
16 Nov 2011 05:58:29	1161345	13566073	hadcm3n_ylc6_1900_40_007525782_3	103,680	150,049	1.4472
10 Nov 2011 07:52:24	1161345	13566073	hadcm3n_ylc6_1900_40_007525782_3	77,760	112,444	1.4460
09 Nov 2011 10:28:14	1161345	13566073	hadcm3n_ylc6_1900_40_007525782_3	51,840	75,443	1.4553
08 Nov 2011 05:19:24	1161345	13566073	hadcm3n_ylc6_1900_40_007525782_3	25,920	38,029	1.4672