Task 15996296

Name	hadcm3n_83ct_1980_40_008462288_0
Workunit	8613144
Created	30 Aug 2013, 22:39:00 UTC
Sent	30 Aug 2013, 22:46:48 UTC
Report deadline	30 Nov 2013, 6:13:59 UTC
Received	14 Oct 2013, 22:00:47 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1242385
Run time	25 days 15 hours 44 min 43 sec
CPU time	24 days 23 hours 35 min 58 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	0.93 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <stderr_txt> 08:29:01 (1808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4580, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5728, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5728, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1228, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1228, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 14:01:45 (5580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:01:46 (5580): No heartbeat from core client for 30 sec - exiting 14:01:47 (5580): No heartbeat from core client for 30 sec - exiting 14:01:48 (5580): No heartbeat from core client for 30 sec - exiting 14:01:49 (5580): No heartbeat from core client for 30 sec - exiting 14:01:50 (5580): No heartbeat from core client for 30 sec - exiting 14:01:51 (5580): No heartbeat from core client for 30 sec - exiting 14:01:52 (5580): No heartbeat from core client for 30 sec - exiting 14:01:53 (5580): No heartbeat from core client for 30 sec - exiting 14:01:54 (5580): No heartbeat from core client for 30 sec - exiting 14:01:55 (5580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 09:29:18 (7116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:30:33 (4580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:35:47 (7308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:58:22 (4556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:37:52 (6912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:27:20 (2808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:57:32 (5484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:12:14 (5180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:12 (3256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:03:23 (7160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:29:32 (6284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:59:55 (5300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:00:51 (5536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:03:45 (8832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:03:46 (8832): No heartbeat from core client for 30 sec - exiting 14:03:47 (8832): No heartbeat from core client for 30 sec - exiting 14:03:48 (8832): No heartbeat from core client for 30 sec - exiting 14:03:49 (8832): No heartbeat from core client for 30 sec - exiting 14:03:50 (8832): No heartbeat from core client for 30 sec - exiting 14:03:51 (8832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:31:27 (6476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... 09:36:29 (7456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:31:39 (6964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:01:52 (6876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:34:25 (5032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6240, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 08:30:51 (6016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3112, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:28:35 (7040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:35:50 (3192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:02:02 (2692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5264, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:33:09 (2448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:33:10 (2448): No heartbeat from core client for 30 sec - exiting 09:33:11 (2448): No heartbeat from core client for 30 sec - exiting 09:33:12 (2448): No heartbeat from core client for 30 sec - exiting 09:33:13 (2448): No heartbeat from core client for 30 sec - exiting 09:33:14 (2448): No heartbeat from core client for 30 sec - exiting 09:33:15 (2448): No heartbeat from core client for 30 sec - exiting 09:33:16 (2448): No heartbeat from core client for 30 sec - exiting 09:33:17 (2448): No heartbeat from core client for 30 sec - exiting 09:33:18 (2448): No heartbeat from core client for 30 sec - exiting 09:33:19 (2448): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5600, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7036, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6084, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6084, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4368, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4368, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 09:38:25 (5032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:38:26 (5032): No heartbeat from core client for 30 sec - exiting 09:38:27 (5032): No heartbeat from core client for 30 sec - exiting 09:38:28 (5032): No heartbeat from core client for 30 sec - exiting 09:38:29 (5032): No heartbeat from core client for 30 sec - exiting 09:38:30 (5032): No heartbeat from core client for 30 sec - exiting 09:38:31 (5032): No heartbeat from core client for 30 sec - exiting 09:38:32 (5032): No heartbeat from core client for 30 sec - exiting 09:38:33 (5032): No heartbeat from core client for 30 sec - exiting 09:38:34 (5032): No heartbeat from core client for 30 sec - exiting 09:38:35 (5032): No heartbeat from core client for 30 sec - exiting 14:13:40 (3704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Oct 2013 19:52:55	1242385	15996296	hadcm3n_83ct_1980_40_008462288_0	1,036,800	2,157,941	2.0813
05 Oct 2013 15:44:23	1242385	15996296	hadcm3n_83ct_1980_40_008462288_0	1,010,880	2,096,886	2.0743
04 Oct 2013 15:48:18	1242385	15996296	hadcm3n_83ct_1980_40_008462288_0	984,960	2,037,261	2.0684
03 Oct 2013 04:39:18	1242385	15996296	hadcm3n_83ct_1980_40_008462288_0	959,040	1,983,212	2.0679
02 Oct 2013 10:31:24	1242385	15996296	hadcm3n_83ct_1980_40_008462288_0	933,120	1,928,848	2.0671
01 Oct 2013 17:00:37	1242385	15996296	hadcm3n_83ct_1980_40_008462288_0	907,200	1,871,599	2.0631
30 Sep 2013 23:01:18	1242385	15996296	hadcm3n_83ct_1980_40_008462288_0	881,280	1,812,477	2.0566
30 Sep 2013 05:13:31	1242385	15996296	hadcm3n_83ct_1980_40_008462288_0	855,360	1,754,394	2.0511
29 Sep 2013 12:50:27	1242385	15996296	hadcm3n_83ct_1980_40_008462288_0	829,440	1,696,887	2.0458
28 Sep 2013 19:44:34	1242385	15996296	hadcm3n_83ct_1980_40_008462288_0	803,520	1,637,436	2.0378
28 Sep 2013 03:12:19	1242385	15996296	hadcm3n_83ct_1980_40_008462288_0	777,600	1,579,471	2.0312
27 Sep 2013 08:16:59	1242385	15996296	hadcm3n_83ct_1980_40_008462288_0	751,680	1,519,357	2.0213
26 Sep 2013 15:39:24	1242385	15996296	hadcm3n_83ct_1980_40_008462288_0	725,760	1,464,929	2.0185
25 Sep 2013 22:17:59	1242385	15996296	hadcm3n_83ct_1980_40_008462288_0	699,840	1,408,724	2.0129
25 Sep 2013 09:21:33	1242385	15996296	hadcm3n_83ct_1980_40_008462288_0	673,920	1,356,578	2.0130
24 Sep 2013 00:04:37	1242385	15996296	hadcm3n_83ct_1980_40_008462288_0	648,000	1,304,919	2.0138
23 Sep 2013 10:09:03	1242385	15996296	hadcm3n_83ct_1980_40_008462288_0	622,080	1,255,519	2.0183
23 Sep 2013 10:09:03	1242385	15996296	hadcm3n_83ct_1980_40_008462288_0	596,160	1,204,243	2.0200
22 Sep 2013 01:28:18	1242385	15996296	hadcm3n_83ct_1980_40_008462288_0	570,240	1,153,151	2.0222
21 Sep 2013 11:11:06	1242385	15996296	hadcm3n_83ct_1980_40_008462288_0	544,320	1,102,462	2.0254