Task 16161773

Name	hadcm3n_o40w_2020_40_008400781_4
Workunit	8551637
Created	27 Dec 2013, 7:21:57 UTC
Sent	27 Dec 2013, 7:22:08 UTC
Report deadline	28 Mar 2014, 14:49:19 UTC
Received	11 Jan 2014, 23:06:16 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1305576
Run time	12 days 4 hours 24 min 42 sec
CPU time	12 days 1 hours 13 min 26 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.42 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 18:50:08 (8124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:02:38 (9500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:27 (9232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:14:29 (8672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:30:24 (8540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:39:46 (10044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:49:16 (9104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:56:51 (1468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:08:37 (6304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:19:32 (9004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:24:13 (9932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:27:45 (4796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:31:40 (6200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:35:43 (8016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:36:23 (7040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:37:23 (368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:38:04 (10132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:38:45 (10048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:40:05 (8252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:43:05 (8604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:43:45 (9116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:46:50 (6004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:47:31 (8936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8436, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8436, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish 21:48:51 (8436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9744, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9744, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9744, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9744, iMonCtr=1 Model crash detected, will try to restart... 21:49:31 (9744): No heartbeat from core client for 30 sec - exiting Sorry, too many model crashes! :-( Called boinc_finish 21:49:32 (9744): No heartbeat from core client for 30 sec - exiting 21:49:33 (9744): No heartbeat from core client for 30 sec - exiting 21:50:55 (8828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6032, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Jan 2014 07:02:12	1305576	16161773	hadcm3n_o40w_2020_40_008400781_4	1,036,800	1,040,993	1.0040
11 Jan 2014 00:44:23	1305576	16161773	hadcm3n_o40w_2020_40_008400781_4	1,010,880	1,022,419	1.0114
10 Jan 2014 21:36:37	1305576	16161773	hadcm3n_o40w_2020_40_008400781_4	984,960	1,003,976	1.0193
10 Jan 2014 08:02:10	1305576	16161773	hadcm3n_o40w_2020_40_008400781_4	959,040	984,084	1.0261
10 Jan 2014 01:05:05	1305576	16161773	hadcm3n_o40w_2020_40_008400781_4	933,120	964,963	1.0341
09 Jan 2014 20:03:27	1305576	16161773	hadcm3n_o40w_2020_40_008400781_4	907,200	946,788	1.0436
09 Jan 2014 13:28:22	1305576	16161773	hadcm3n_o40w_2020_40_008400781_4	881,280	927,736	1.0527
09 Jan 2014 05:21:14	1305576	16161773	hadcm3n_o40w_2020_40_008400781_4	855,360	908,587	1.0622
08 Jan 2014 23:14:25	1305576	16161773	hadcm3n_o40w_2020_40_008400781_4	829,440	889,274	1.0721
08 Jan 2014 17:52:09	1305576	16161773	hadcm3n_o40w_2020_40_008400781_4	803,520	870,435	1.0833
08 Jan 2014 05:04:43	1305576	16161773	hadcm3n_o40w_2020_40_008400781_4	777,600	850,829	1.0942
07 Jan 2014 22:17:38	1305576	16161773	hadcm3n_o40w_2020_40_008400781_4	751,680	830,675	1.1051
07 Jan 2014 16:14:07	1305576	16161773	hadcm3n_o40w_2020_40_008400781_4	725,760	811,875	1.1187
07 Jan 2014 01:11:00	1305576	16161773	hadcm3n_o40w_2020_40_008400781_4	699,840	792,942	1.1330
06 Jan 2014 15:18:40	1305576	16161773	hadcm3n_o40w_2020_40_008400781_4	673,920	773,551	1.1478
06 Jan 2014 09:59:00	1305576	16161773	hadcm3n_o40w_2020_40_008400781_4	648,000	754,666	1.1646
05 Jan 2014 22:15:41	1305576	16161773	hadcm3n_o40w_2020_40_008400781_4	622,080	735,907	1.1830
05 Jan 2014 16:47:54	1305576	16161773	hadcm3n_o40w_2020_40_008400781_4	596,160	716,735	1.2023
05 Jan 2014 10:30:21	1305576	16161773	hadcm3n_o40w_2020_40_008400781_4	570,240	697,300	1.2228
05 Jan 2014 01:58:30	1305576	16161773	hadcm3n_o40w_2020_40_008400781_4	544,320	678,983	1.2474