Task 15841601

Name	hadcm3n_3lc2_1980_40_008335744_3
Workunit	8486605
Created	13 Jun 2013, 15:03:15 UTC
Sent	13 Jun 2013, 15:19:14 UTC
Report deadline	12 Sep 2013, 22:46:25 UTC
Received	18 Jul 2013, 12:19:17 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1242385
Run time	24 days 0 hours 30 min 11 sec
CPU time	23 days 9 hours 56 min 9 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	1.99 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <stderr_txt> 13:43:08 (8152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6540, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6540, iMonCtr=1 Model crash detected, will try to restart... 07:56:27 (6704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8972, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5568, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 08:04:47 (4360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:00:40 (7976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:41 (7976): No heartbeat from core client for 30 sec - exiting 13:00:42 (7976): No heartbeat from core client for 30 sec - exiting 13:00:43 (7976): No heartbeat from core client for 30 sec - exiting 13:00:44 (7976): No heartbeat from core client for 30 sec - exiting 13:00:45 (7976): No heartbeat from core client for 30 sec - exiting 13:00:46 (7976): No heartbeat from core client for 30 sec - exiting 13:00:47 (7976): No heartbeat from core client for 30 sec - exiting 13:00:48 (7976): No heartbeat from core client for 30 sec - exiting 13:00:49 (7976): No heartbeat from core client for 30 sec - exiting 13:00:50 (7976): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:02:32 (6488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:02:39 (5420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:02:40 (5420): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:00:02 (6700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6188, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6188, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6304, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6908, iMonCtr=1 Model crash detected, will try to restart... 09:40:17 (5896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:04:18 (2272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:08:38 (8852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:49:03 (4628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:07:02 (7680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:07:03 (7680): No heartbeat from core client for 30 sec - exiting 16:07:04 (7680): No heartbeat from core client for 30 sec - exiting 16:07:05 (7680): No heartbeat from core client for 30 sec - exiting 16:07:06 (7680): No heartbeat from core client for 30 sec - exiting 16:07:07 (7680): No heartbeat from core client for 30 sec - exiting 16:07:08 (7680): No heartbeat from core client for 30 sec - exiting 16:07:09 (7680): No heartbeat from core client for 30 sec - exiting 16:07:10 (7680): No heartbeat from core client for 30 sec - exiting 16:07:11 (7680): No heartbeat from core client for 30 sec - exiting 16:07:12 (7680): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:01:44 (5456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6708, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:58:30 (3820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:23:48 (5824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:02:25 (1912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1144, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 09:39:58 (1240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:39:59 (1240): No heartbeat from core client for 30 sec - exiting 09:40:00 (1240): No heartbeat from core client for 30 sec - exiting 09:40:01 (1240): No heartbeat from core client for 30 sec - exiting 09:40:02 (1240): No heartbeat from core client for 30 sec - exiting 09:40:03 (1240): No heartbeat from core client for 30 sec - exiting 09:40:04 (1240): No heartbeat from core client for 30 sec - exiting 09:40:05 (1240): No heartbeat from core client for 30 sec - exiting 09:40:06 (1240): No heartbeat from core client for 30 sec - exiting 09:40:07 (1240): No heartbeat from core client for 30 sec - exiting 09:40:08 (1240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5892, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 08:00:55 (1292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:23:21 (6128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:02:43 (5552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:32:05 (6336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:32:06 (6336): No heartbeat from core client for 30 sec - exiting 12:32:07 (6336): No heartbeat from core client for 30 sec - exiting 12:32:08 (6336): No heartbeat from core client for 30 sec - exiting 12:32:09 (6336): No heartbeat from core client for 30 sec - exiting 12:32:10 (6336): No heartbeat from core client for 30 sec - exiting 12:32:11 (6336): No heartbeat from core client for 30 sec - exiting 12:32:12 (6336): No heartbeat from core client for 30 sec - exiting 12:32:13 (6336): No heartbeat from core client for 30 sec - exiting 12:32:14 (6336): No heartbeat from core client for 30 sec - exiting 12:32:15 (6336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jul 2013 15:47:04	1242385	15841601	hadcm3n_3lc2_1980_40_008335744_3	1,036,800	2,022,295	1.9505
11 Jul 2013 08:51:11	1242385	15841601	hadcm3n_3lc2_1980_40_008335744_3	1,010,880	1,963,318	1.9422
10 Jul 2013 17:17:58	1242385	15841601	hadcm3n_3lc2_1980_40_008335744_3	984,960	1,913,276	1.9425
10 Jul 2013 01:18:48	1242385	15841601	hadcm3n_3lc2_1980_40_008335744_3	959,040	1,859,007	1.9384
09 Jul 2013 07:56:39	1242385	15841601	hadcm3n_3lc2_1980_40_008335744_3	933,120	1,801,619	1.9307
08 Jul 2013 12:33:21	1242385	15841601	hadcm3n_3lc2_1980_40_008335744_3	907,200	1,753,103	1.9324
07 Jul 2013 22:19:43	1242385	15841601	hadcm3n_3lc2_1980_40_008335744_3	881,280	1,703,984	1.9335
07 Jul 2013 08:20:55	1242385	15841601	hadcm3n_3lc2_1980_40_008335744_3	855,360	1,654,722	1.9345
06 Jul 2013 18:22:57	1242385	15841601	hadcm3n_3lc2_1980_40_008335744_3	829,440	1,604,934	1.9350
06 Jul 2013 05:43:52	1242385	15841601	hadcm3n_3lc2_1980_40_008335744_3	803,520	1,555,172	1.9354
06 Jul 2013 05:08:00	1242385	15841601	hadcm3n_3lc2_1980_40_008335744_3	777,600	1,504,860	1.9353
06 Jul 2013 04:20:51	1242385	15841601	hadcm3n_3lc2_1980_40_008335744_3	751,680	1,455,160	1.9359
04 Jul 2013 14:26:17	1242385	15841601	hadcm3n_3lc2_1980_40_008335744_3	725,760	1,406,527	1.9380
03 Jul 2013 19:07:02	1242385	15841601	hadcm3n_3lc2_1980_40_008335744_3	699,840	1,355,355	1.9367
03 Jul 2013 06:39:47	1242385	15841601	hadcm3n_3lc2_1980_40_008335744_3	673,920	1,309,305	1.9428
02 Jul 2013 18:02:03	1242385	15841601	hadcm3n_3lc2_1980_40_008335744_3	648,000	1,264,633	1.9516
02 Jul 2013 12:00:07	1242385	15841601	hadcm3n_3lc2_1980_40_008335744_3	622,080	1,219,379	1.9602
02 Jul 2013 10:41:48	1242385	15841601	hadcm3n_3lc2_1980_40_008335744_3	596,160	1,173,143	1.9678
02 Jul 2013 10:20:03	1242385	15841601	hadcm3n_3lc2_1980_40_008335744_3	570,240	1,128,302	1.9786
02 Jul 2013 09:57:53	1242385	15841601	hadcm3n_3lc2_1980_40_008335744_3	544,320	1,082,203	1.9882