Task 15667075

Name	hadcm3n_4gaz_1980_40_008322602_3
Workunit	8473737
Created	14 Mar 2013, 8:47:18 UTC
Sent	14 Mar 2013, 8:47:38 UTC
Report deadline	13 Jun 2013, 16:14:49 UTC
Received	11 Jun 2013, 0:48:26 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1212761
Run time	21 days 13 hours 0 min 39 sec
CPU time	20 days 3 hours 10 min 40 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	3.04 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 14:48:28 (5224): No heartbeat from core client for 30 sec - exiting 14:48:29 (5224): No heartbeat from core client for 30 sec - exiting 14:48:30 (5224): No heartbeat from core client for 30 sec - exiting 14:48:31 (5224): No heartbeat from core client for 30 sec - exiting 14:48:32 (5224): No heartbeat from core client for 30 sec - exiting 14:48:33 (5224): No heartbeat from core client for 30 sec - exiting 14:48:34 (5224): No heartbeat from core client for 30 sec - exiting 14:48:35 (5224): No heartbeat from core client for 30 sec - exiting 14:48:36 (5224): No heartbeat from core client for 30 sec - exiting 14:48:37 (5224): No heartbeat from core client for 30 sec - exiting 14:48:38 (5224): No heartbeat from core client for 30 sec - exiting 14:48:39 (5224): No heartbeat from core client for 30 sec - exiting 14:48:40 (5224): No heartbeat from core client for 30 sec - exiting 14:48:41 (5224): No heartbeat from core client for 30 sec - exiting 14:48:42 (5224): No heartbeat from core client for 30 sec - exiting 14:48:43 (5224): No heartbeat from core client for 30 sec - exiting 14:48:44 (5224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:41:40 (6048): No heartbeat from core client for 30 sec - exiting 15:41:41 (6048): No heartbeat from core client for 30 sec - exiting 15:41:42 (6048): No heartbeat from core client for 30 sec - exiting 15:41:43 (6048): No heartbeat from core client for 30 sec - exiting 15:41:44 (6048): No heartbeat from core client for 30 sec - exiting 15:41:45 (6048): No heartbeat from core client for 30 sec - exiting 15:41:46 (6048): No heartbeat from core client for 30 sec - exiting 15:41:47 (6048): No heartbeat from core client for 30 sec - exiting 15:41:48 (6048): No heartbeat from core client for 30 sec - exiting 15:41:49 (6048): No heartbeat from core client for 30 sec - exiting 15:41:50 (6048): No heartbeat from core client for 30 sec - exiting 15:41:51 (6048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:52:34 (1912): Can't acquire lockfile (32) - waiting 35s 21:52:45 (6868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:12:09 (4056): No heartbeat from core client for 30 sec - exiting 22:12:10 (4056): No heartbeat from core client for 30 sec - exiting 22:12:11 (4056): No heartbeat from core client for 30 sec - exiting 22:12:12 (4056): No heartbeat from core client for 30 sec - exiting 22:12:13 (4056): No heartbeat from core client for 30 sec - exiting 22:12:14 (4056): No heartbeat from core client for 30 sec - exiting 22:12:15 (4056): No heartbeat from core client for 30 sec - exiting 22:12:16 (4056): No heartbeat from core client for 30 sec - exiting 22:12:17 (4056): No heartbeat from core client for 30 sec - exiting 22:12:18 (4056): No heartbeat from core client for 30 sec - exiting 22:12:19 (4056): No heartbeat from core client for 30 sec - exiting 22:12:20 (4056): No heartbeat from core client for 30 sec - exiting 22:12:21 (4056): No heartbeat from core client for 30 sec - exiting 22:12:22 (4056): No heartbeat from core client for 30 sec - exiting 22:12:23 (4056): No heartbeat from core client for 30 sec - exiting 22:12:24 (4056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5776, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6952, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:27:11 (5372): No heartbeat from core client for 30 sec - exiting 11:27:12 (5372): No heartbeat from core client for 30 sec - exiting 11:27:13 (5372): No heartbeat from core client for 30 sec - exiting 11:27:14 (5372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Jun 2013 10:23:29	1212761	15667075	hadcm3n_4gaz_1980_40_008322602_3	1,036,800	1,739,434	1.6777
09 Jun 2013 16:43:10	1212761	15667075	hadcm3n_4gaz_1980_40_008322602_3	1,010,880	1,698,242	1.6800
08 Jun 2013 15:26:30	1212761	15667075	hadcm3n_4gaz_1980_40_008322602_3	984,960	1,658,094	1.6834
07 Jun 2013 21:42:40	1212761	15667075	hadcm3n_4gaz_1980_40_008322602_3	959,040	1,617,598	1.6867
07 Jun 2013 09:25:48	1212761	15667075	hadcm3n_4gaz_1980_40_008322602_3	933,120	1,577,148	1.6902
06 Jun 2013 11:17:32	1212761	15667075	hadcm3n_4gaz_1980_40_008322602_3	907,200	1,535,898	1.6930
05 Jun 2013 18:36:12	1212761	15667075	hadcm3n_4gaz_1980_40_008322602_3	881,280	1,494,947	1.6963
05 Jun 2013 04:53:43	1212761	15667075	hadcm3n_4gaz_1980_40_008322602_3	855,360	1,454,261	1.7002
03 Jun 2013 18:54:24	1212761	15667075	hadcm3n_4gaz_1980_40_008322602_3	829,440	1,412,532	1.7030
02 Jun 2013 17:02:01	1212761	15667075	hadcm3n_4gaz_1980_40_008322602_3	803,520	1,371,207	1.7065
01 Jun 2013 09:24:30	1212761	15667075	hadcm3n_4gaz_1980_40_008322602_3	777,600	1,329,637	1.7099
31 May 2013 04:59:42	1212761	15667075	hadcm3n_4gaz_1980_40_008322602_3	751,680	1,288,623	1.7143
30 May 2013 17:28:03	1212761	15667075	hadcm3n_4gaz_1980_40_008322602_3	725,760	1,247,752	1.7192
30 May 2013 05:32:57	1212761	15667075	hadcm3n_4gaz_1980_40_008322602_3	699,840	1,206,691	1.7242
15 May 2013 17:33:54	1212761	15667075	hadcm3n_4gaz_1980_40_008322602_3	673,920	1,162,325	1.7247
15 May 2013 04:03:53	1212761	15667075	hadcm3n_4gaz_1980_40_008322602_3	648,000	1,117,272	1.7242
14 May 2013 14:40:48	1212761	15667075	hadcm3n_4gaz_1980_40_008322602_3	622,080	1,072,308	1.7237
14 May 2013 01:20:55	1212761	15667075	hadcm3n_4gaz_1980_40_008322602_3	596,160	1,027,327	1.7232
13 May 2013 11:20:40	1212761	15667075	hadcm3n_4gaz_1980_40_008322602_3	570,240	982,352	1.7227
12 May 2013 20:16:50	1212761	15667075	hadcm3n_4gaz_1980_40_008322602_3	544,320	937,441	1.7222