Task 15914279

Name	hadcm3n_zjve_1960_40_008361895_1
Workunit	8512754
Created	14 Aug 2013, 11:38:28 UTC
Sent	14 Aug 2013, 16:56:36 UTC
Report deadline	14 Nov 2013, 0:23:47 UTC
Received	21 Sep 2013, 4:54:16 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1242385
Run time	25 days 4 hours 38 min 53 sec
CPU time	24 days 13 hours 21 min 37 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.17 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 08:34:18 (6480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:02:12 (8112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:02:13 (8112): No heartbeat from core client for 30 sec - exiting 13:02:14 (8112): No heartbeat from core client for 30 sec - exiting 13:02:15 (8112): No heartbeat from core client for 30 sec - exiting 13:02:16 (8112): No heartbeat from core client for 30 sec - exiting 13:02:17 (8112): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5292, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6168, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6168, iMonCtr=1 Model crash detected, will try to restart... 08:42:18 (3500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:01:57 (6548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7684, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:59:16 (6296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:59:17 (6296): No heartbeat from core client for 30 sec - exiting 13:59:18 (6296): No heartbeat from core client for 30 sec - exiting 13:59:19 (6296): No heartbeat from core client for 30 sec - exiting 13:59:20 (6296): No heartbeat from core client for 30 sec - exiting 13:59:21 (6296): No heartbeat from core client for 30 sec - exiting 13:59:22 (6296): No heartbeat from core client for 30 sec - exiting 13:59:23 (6296): No heartbeat from core client for 30 sec - exiting 13:59:24 (6296): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:56:56 (6332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:56:19 (1148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:56:20 (1148): No heartbeat from core client for 30 sec - exiting 09:56:21 (1148): No heartbeat from core client for 30 sec - exiting 09:56:22 (1148): No heartbeat from core client for 30 sec - exiting 09:56:23 (1148): No heartbeat from core client for 30 sec - exiting 09:56:24 (1148): No heartbeat from core client for 30 sec - exiting 09:56:25 (1148): No heartbeat from core client for 30 sec - exiting 09:56:26 (1148): No heartbeat from core client for 30 sec - exiting 09:56:27 (1148): No heartbeat from core client for 30 sec - exiting 09:56:28 (1148): No heartbeat from core client for 30 sec - exiting 09:56:29 (1148): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:04:31 (5452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:04:32 (5452): No heartbeat from core client for 30 sec - exiting 14:04:33 (5452): No heartbeat from core client for 30 sec - exiting 14:04:34 (5452): No heartbeat from core client for 30 sec - exiting 14:04:35 (5452): No heartbeat from core client for 30 sec - exiting 14:04:36 (5452): No heartbeat from core client for 30 sec - exiting 14:04:37 (5452): No heartbeat from core client for 30 sec - exiting 14:04:38 (5452): No heartbeat from core client for 30 sec - exiting 14:04:39 (5452): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:28:01 (5252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:28:02 (5252): No heartbeat from core client for 30 sec - exiting 07:28:03 (5252): No heartbeat from core client for 30 sec - exiting 07:28:04 (5252): No heartbeat from core client for 30 sec - exiting 07:28:05 (5252): No heartbeat from core client for 30 sec - exiting 07:28:06 (5252): No heartbeat from core client for 30 sec - exiting 07:28:07 (5252): No heartbeat from core client for 30 sec - exiting 07:28:08 (5252): No heartbeat from core client for 30 sec - exiting 07:28:09 (5252): No heartbeat from core client for 30 sec - exiting 07:28:10 (5252): No heartbeat from core client for 30 sec - exiting 07:28:11 (5252): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... 08:19:36 (7192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:19:37 (7192): No heartbeat from core client for 30 sec - exiting 08:19:38 (7192): No heartbeat from core client for 30 sec - exiting 08:19:39 (7192): No heartbeat from core client for 30 sec - exiting 08:19:40 (7192): No heartbeat from core client for 30 sec - exiting 08:19:41 (7192): No heartbeat from core client for 30 sec - exiting 08:19:42 (7192): No heartbeat from core client for 30 sec - exiting 08:19:43 (7192): No heartbeat from core client for 30 sec - exiting 08:19:44 (7192): No heartbeat from core client for 30 sec - exiting 08:19:45 (7192): No heartbeat from core client for 30 sec - exiting 08:19:46 (7192): No heartbeat from core client for 30 sec - exiting 08:28:51 (2172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3492, iMonCtr=1 Model crash detected, will try to restart... 13:01:57 (5968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:04:26 (9160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8084, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:02:20 (7000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6700, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6700, iMonCtr=1 Model crash detected, will try to restart... 13:01:47 (6112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:02:04 (7068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:02:05 (7068): No heartbeat from core client for 30 sec - exiting 14:02:06 (7068): No heartbeat from core client for 30 sec - exiting 14:02:07 (7068): No heartbeat from core client for 30 sec - exiting 14:02:08 (7068): No heartbeat from core client for 30 sec - exiting 14:02:09 (7068): No heartbeat from core client for 30 sec - exiting 14:02:10 (7068): No heartbeat from core client for 30 sec - exiting 14:02:11 (7068): No heartbeat from core client for 30 sec - exiting 14:02:12 (7068): No heartbeat from core client for 30 sec - exiting 14:02:13 (7068): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:30:43 (6756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:44:57 (2912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:49 (2308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:29:01 (2456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5748, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5748, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4792, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4792, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 14:01:44 (5412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:29:17 (7096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:30:33 (292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:35:47 (7300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:58:21 (2764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:37:52 (7368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:37:53 (7368): No heartbeat from core client for 30 sec - exiting 10:37:54 (7368): No heartbeat from core client for 30 sec - exiting 10:37:55 (7368): No heartbeat from core client for 30 sec - exiting 10:37:56 (7368): No heartbeat from core client for 30 sec - exiting 10:37:57 (7368): No heartbeat from core client for 30 sec - exiting 10:37:58 (7368): No heartbeat from core client for 30 sec - exiting 10:37:59 (7368): No heartbeat from core client for 30 sec - exiting 10:38:00 (7368): No heartbeat from core client for 30 sec - exiting 10:38:01 (7368): No heartbeat from core client for 30 sec - exiting 10:38:02 (7368): No heartbeat from core client for 30 sec - exiting 13:27:20 (7064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:57:33 (8868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8412, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:12:14 (5152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:12:15 (5152): No heartbeat from core client for 30 sec - exiting 11:12:16 (5152): No heartbeat from core client for 30 sec - exiting 11:12:17 (5152): No heartbeat from core client for 30 sec - exiting 11:12:18 (5152): No heartbeat from core client for 30 sec - exiting 11:12:19 (5152): No heartbeat from core client for 30 sec - exiting 11:12:20 (5152): No heartbeat from core client for 30 sec - exiting 11:12:21 (5152): No heartbeat from core client for 30 sec - exiting 11:12:22 (5152): No heartbeat from core client for 30 sec - exiting 11:12:23 (5152): No heartbeat from core client for 30 sec - exiting 11:12:24 (5152): No heartbeat from core client for 30 sec - exiting 13:00:11 (2984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:03:23 (7148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:29:33 (6292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:59:55 (5408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4456, iMonCtr=1 Model crash detected, will try to restart... 13:00:51 (7228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:03:45 (8824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:03:46 (8824): No heartbeat from core client for 30 sec - exiting 14:03:47 (8824): No heartbeat from core client for 30 sec - exiting 14:03:48 (8824): No heartbeat from core client for 30 sec - exiting 14:03:49 (8824): No heartbeat from core client for 30 sec - exiting 14:03:50 (8824): No heartbeat from core client for 30 sec - exiting 14:03:51 (8824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:31:27 (6468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:36:29 (1400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:36:30 (1400): No heartbeat from core client for 30 sec - exiting 09:36:31 (1400): No heartbeat from core client for 30 sec - exiting 09:36:32 (1400): No heartbeat from core client for 30 sec - exiting 09:36:33 (1400): No heartbeat from core client for 30 sec - exiting 09:36:34 (1400): No heartbeat from core client for 30 sec - exiting 09:36:35 (1400): No heartbeat from core client for 30 sec - exiting 09:36:36 (1400): No heartbeat from core client for 30 sec - exiting 09:36:37 (1400): No heartbeat from core client for 30 sec - exiting 09:36:38 (1400): No heartbeat from core client for 30 sec - exiting 09:36:39 (1400): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:31:39 (6956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6812, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 13:01:52 (5336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:34:26 (1728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Sep 2013 02:38:27	1242385	15914279	hadcm3n_zjve_1960_40_008361895_1	1,036,800	2,120,985	2.0457
16 Sep 2013 12:18:01	1242385	15914279	hadcm3n_zjve_1960_40_008361895_1	1,010,880	2,063,603	2.0414
15 Sep 2013 19:57:18	1242385	15914279	hadcm3n_zjve_1960_40_008361895_1	984,960	2,006,251	2.0369
15 Sep 2013 03:27:33	1242385	15914279	hadcm3n_zjve_1960_40_008361895_1	959,040	1,948,658	2.0319
14 Sep 2013 12:39:03	1242385	15914279	hadcm3n_zjve_1960_40_008361895_1	933,120	1,896,533	2.0325
13 Sep 2013 17:17:58	1242385	15914279	hadcm3n_zjve_1960_40_008361895_1	907,200	1,843,261	2.0318
13 Sep 2013 01:29:25	1242385	15914279	hadcm3n_zjve_1960_40_008361895_1	881,280	1,790,498	2.0317
12 Sep 2013 07:08:54	1242385	15914279	hadcm3n_zjve_1960_40_008361895_1	855,360	1,736,966	2.0307
11 Sep 2013 12:42:05	1242385	15914279	hadcm3n_zjve_1960_40_008361895_1	829,440	1,677,768	2.0228
09 Sep 2013 18:28:22	1242385	15914279	hadcm3n_zjve_1960_40_008361895_1	803,520	1,622,001	2.0186
06 Sep 2013 09:02:12	1242385	15914279	hadcm3n_zjve_1960_40_008361895_1	777,600	1,569,139	2.0179
05 Sep 2013 16:16:05	1242385	15914279	hadcm3n_zjve_1960_40_008361895_1	751,680	1,515,938	2.0167
05 Sep 2013 03:06:49	1242385	15914279	hadcm3n_zjve_1960_40_008361895_1	725,760	1,471,634	2.0277
04 Sep 2013 13:28:25	1242385	15914279	hadcm3n_zjve_1960_40_008361895_1	699,840	1,426,504	2.0383
03 Sep 2013 23:12:26	1242385	15914279	hadcm3n_zjve_1960_40_008361895_1	673,920	1,378,176	2.0450
03 Sep 2013 06:39:36	1242385	15914279	hadcm3n_zjve_1960_40_008361895_1	648,000	1,326,739	2.0474
02 Sep 2013 15:22:45	1242385	15914279	hadcm3n_zjve_1960_40_008361895_1	622,080	1,272,913	2.0462
02 Sep 2013 00:00:31	1242385	15914279	hadcm3n_zjve_1960_40_008361895_1	596,160	1,218,587	2.0441
01 Sep 2013 09:09:14	1242385	15914279	hadcm3n_zjve_1960_40_008361895_1	570,240	1,166,280	2.0452
31 Aug 2013 18:39:28	1242385	15914279	hadcm3n_zjve_1960_40_008361895_1	544,320	1,115,061	2.0485