Task 13195674

Name	hadcm3n_y9cd_1900_40_007344967_2
Workunit	7542397
Created	3 Aug 2011, 2:32:04 UTC
Sent	3 Aug 2011, 2:32:24 UTC
Report deadline	2 Nov 2011, 9:59:35 UTC
Received	27 Aug 2011, 21:41:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1101782
Run time	3 days 22 hours 36 min 35 sec
CPU time	3 days 16 hours 4 min 57 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.80 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 23:34:34 (6112): No heartbeat from core client for 30 sec - exiting 23:34:35 (6112): No heartbeat from core client for 30 sec - exiting 23:34:36 (6112): No heartbeat from core client for 30 sec - exiting 23:34:37 (6112): No heartbeat from core client for 30 sec - exiting 23:34:38 (6112): No heartbeat from core client for 30 sec - exiting 23:34:39 (6112): No heartbeat from core client for 30 sec - exiting 23:34:40 (6112): No heartbeat from core client for 30 sec - exiting 23:34:41 (6112): No heartbeat from core client for 30 sec - exiting 23:34:42 (6112): No heartbeat from core client for 30 sec - exiting 23:34:43 (6112): No heartbeat from core client for 30 sec - exiting 23:34:45 (6112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6832, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:24:40 (6072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:52:52 (2412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:13:07 (8488): Can't acquire lockfile (32) - waiting 35s 14:19:08 (10780): Can't acquire lockfile (32) - waiting 35s 14:19:28 (4204): Can't acquire lockfile (32) - waiting 35s 14:19:49 (8564): Can't acquire lockfile (32) - waiting 35s 14:20:09 (9776): Can't acquire lockfile (32) - waiting 35s 14:20:40 (7976): Can't acquire lockfile (32) - waiting 35s 14:21:00 (10600): Can't acquire lockfile (32) - waiting 35s 14:21:21 (9928): Can't acquire lockfile (32) - waiting 35s 14:21:44 (9936): Can't acquire lockfile (32) - waiting 35s 14:22:04 (9272): Can't acquire lockfile (32) - waiting 35s 14:22:24 (11520): Can't acquire lockfile (32) - waiting 35s 14:22:44 (11720): Can't acquire lockfile (32) - waiting 35s 14:23:03 (12000): Can't acquire lockfile (32) - waiting 35s 14:23:24 (12284): Can't acquire lockfile (32) - waiting 35s 14:23:45 (11672): Can't acquire lockfile (32) - waiting 35s 14:24:07 (10820): Can't acquire lockfile (32) - waiting 35s 14:24:26 (10144): Can't acquire lockfile (32) - waiting 35s 14:24:47 (10352): Can't acquire lockfile (32) - waiting 35s 14:25:07 (11180): Can't acquire lockfile (32) - waiting 35s 14:25:28 (12396): Can't acquire lockfile (32) - waiting 35s 14:25:49 (12624): Can't acquire lockfile (32) - waiting 35s 14:26:11 (12868): Can't acquire lockfile (32) - waiting 35s 14:26:33 (13108): Can't acquire lockfile (32) - waiting 35s 14:26:53 (11124): Can't acquire lockfile (32) - waiting 35s 14:27:28 (11124): Can't acquire lockfile (32) - exiting 14:27:28 (11124): Error: The process cannot access the file because it is being used by another process. (0x20) 14:58:34 (5284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:40:11 (6216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:40:12 (6216): No heartbeat from core client for 30 sec - exiting 17:40:13 (6216): No heartbeat from core client for 30 sec - exiting 17:40:14 (6216): No heartbeat from core client for 30 sec - exiting 17:40:15 (6216): No heartbeat from core client for 30 sec - exiting 17:40:16 (6216): No heartbeat from core client for 30 sec - exiting 17:40:17 (6216): No heartbeat from core client for 30 sec - exiting 17:40:18 (6216): No heartbeat from core client for 30 sec - exiting 17:40:19 (6216): No heartbeat from core client for 30 sec - exiting 17:40:20 (6216): No heartbeat from core client for 30 sec - exiting 17:40:21 (6216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:41:22 (7068): Can't acquire lockfile (32) - waiting 35s 22:04:38 (6052): No heartbeat from core client for 30 sec - exiting 22:04:39 (6052): No heartbeat from core client for 30 sec - exiting 22:04:40 (6052): No heartbeat from core client for 30 sec - exiting 22:04:41 (6052): No heartbeat from core client for 30 sec - exiting 22:04:42 (6052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:02:09 (9360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Aug 2011 21:40:58	1101782	13195674	hadcm3n_y9cd_1900_40_007344967_2	259,200	317,096	1.2234
27 Aug 2011 06:04:16	1101782	13195674	hadcm3n_y9cd_1900_40_007344967_2	233,280	291,252	1.2485
26 Aug 2011 23:05:37	1101782	13195674	hadcm3n_y9cd_1900_40_007344967_2	207,360	264,926	1.2776
26 Aug 2011 15:14:23	1101782	13195674	hadcm3n_y9cd_1900_40_007344967_2	181,440	236,294	1.3023
25 Aug 2011 22:33:32	1101782	13195674	hadcm3n_y9cd_1900_40_007344967_2	155,520	208,469	1.3405
24 Aug 2011 21:31:21	1101782	13195674	hadcm3n_y9cd_1900_40_007344967_2	129,600	181,653	1.4016
22 Aug 2011 20:57:50	1101782	13195674	hadcm3n_y9cd_1900_40_007344967_2	103,680	154,594	1.4911
22 Aug 2011 14:06:46	1101782	13195674	hadcm3n_y9cd_1900_40_007344967_2	77,760	127,172	1.6354
22 Aug 2011 02:41:33	1101782	13195674	hadcm3n_y9cd_1900_40_007344967_2	51,840	91,383	1.7628
13 Aug 2011 22:36:28	1101782	13195674	hadcm3n_y9cd_1900_40_007344967_2	25,920	44,383	1.7123