Task 13639000

Name	hadcm3n_ymop_1980_40_007538850_3
Workunit	7736082
Created	16 Nov 2011, 13:33:14 UTC
Sent	16 Nov 2011, 13:36:52 UTC
Report deadline	15 Feb 2012, 21:04:03 UTC
Received	12 Jan 2012, 5:02:39 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	999576
Run time	32 days 21 hours 47 min 5 sec
CPU time	26 days 9 hours 13 min 37 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.26 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7244, iMonCtr=1 Model crash detected, will try to restart... 09:05:07 (7388): No heartbeat from core client for 30 sec - exiting 09:05:08 (7388): No heartbeat from core client for 30 sec - exiting 09:05:09 (7388): No heartbeat from core client for 30 sec - exiting 09:05:10 (7388): No heartbeat from core client for 30 sec - exiting 09:05:11 (7388): No heartbeat from core client for 30 sec - exiting 09:05:12 (7388): No heartbeat from core client for 30 sec - exiting 09:05:13 (7388): No heartbeat from core client for 30 sec - exiting 09:05:15 (7388): No heartbeat from core client for 30 sec - exiting 09:05:16 (7388): No heartbeat from core client for 30 sec - exiting 09:05:17 (7388): No heartbeat from core client for 30 sec - exiting 09:05:18 (7388): No heartbeat from core client for 30 sec - exiting 09:05:19 (7388): No heartbeat from core client for 30 sec - exiting 09:05:20 (7388): No heartbeat from core client for 30 sec - exiting 09:05:21 (7388): No heartbeat from core client for 30 sec - exiting 09:05:22 (7388): No heartbeat from core client for 30 sec - exiting 09:05:23 (7388): No heartbeat from core client for 30 sec - exiting 09:05:24 (7388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:53:58 (5284): No heartbeat from core client for 30 sec - exiting 11:53:59 (5284): No heartbeat from core client for 30 sec - exiting 11:54:00 (5284): No heartbeat from core client for 30 sec - exiting 11:54:01 (5284): No heartbeat from core client for 30 sec - exiting 11:54:02 (5284): No heartbeat from core client for 30 sec - exiting 11:54:03 (5284): No heartbeat from core client for 30 sec - exiting 11:54:04 (5284): No heartbeat from core client for 30 sec - exiting 11:54:05 (5284): No heartbeat from core client for 30 sec - exiting 11:54:06 (5284): No heartbeat from core client for 30 sec - exiting 11:54:07 (5284): No heartbeat from core client for 30 sec - exiting 11:54:08 (5284): No heartbeat from core client for 30 sec - exiting 11:54:09 (5284): No heartbeat from core client for 30 sec - exiting 11:54:10 (5284): No heartbeat from core client for 30 sec - exiting 11:54:11 (5284): No heartbeat from core client for 30 sec - exiting 11:54:12 (5284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:31:27 (8136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7728, iMonCtr=1 Model crash detected, will try to restart... 16:20:29 (4728): No heartbeat from core client for 30 sec - exiting 16:20:31 (4728): No heartbeat from core client for 30 sec - exiting 16:20:32 (4728): No heartbeat from core client for 30 sec - exiting 16:20:33 (4728): No heartbeat from core client for 30 sec - exiting 16:20:34 (4728): No heartbeat from core client for 30 sec - exiting 16:20:35 (4728): No heartbeat from core client for 30 sec - exiting 16:20:36 (4728): No heartbeat from core client for 30 sec - exiting 16:20:37 (4728): No heartbeat from core client for 30 sec - exiting 16:20:38 (4728): No heartbeat from core client for 30 sec - exiting 16:20:39 (4728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:20:40 (4728): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:53:14 (8060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:15 (8060): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 19:10:11 (1188): No heartbeat from core client for 30 sec - exiting 19:10:12 (1188): No heartbeat from core client for 30 sec - exiting 19:10:13 (1188): No heartbeat from core client for 30 sec - exiting 19:10:14 (1188): No heartbeat from core client for 30 sec - exiting 19:10:15 (1188): No heartbeat from core client for 30 sec - exiting 19:10:16 (1188): No heartbeat from core client for 30 sec - exiting 19:10:17 (1188): No heartbeat from core client for 30 sec - exiting 19:10:18 (1188): No heartbeat from core client for 30 sec - exiting 19:10:20 (1188): No heartbeat from core client for 30 sec - exiting 19:10:21 (1188): No heartbeat from core client for 30 sec - exiting 19:10:22 (1188): No heartbeat from core client for 30 sec - exiting 19:10:23 (1188): No heartbeat from core client for 30 sec - exiting 19:10:24 (1188): No heartbeat from core client for 30 sec - exiting 19:10:25 (1188): No heartbeat from core client for 30 sec - exiting 19:10:26 (1188): No heartbeat from core client for 30 sec - exiting 19:10:27 (1188): No heartbeat from core client for 30 sec - exiting 19:10:28 (1188): No heartbeat from core client for 30 sec - exiting 19:10:29 (1188): No heartbeat from core client for 30 sec - exiting 19:10:30 (1188): No heartbeat from core client for 30 sec - exiting 19:10:31 (1188): No heartbeat from core client for 30 sec - exiting 19:10:32 (1188): No heartbeat from core client for 30 sec - exiting 19:10:33 (1188): No heartbeat from core client for 30 sec - exiting 19:10:34 (1188): No heartbeat from core client for 30 sec - exiting 19:10:35 (1188): No heartbeat from core client for 30 sec - exiting 19:10:36 (1188): No heartbeat from core client for 30 sec - exiting 19:10:37 (1188): No heartbeat from core client for 30 sec - exiting 19:10:38 (1188): No heartbeat from core client for 30 sec - exiting 19:10:39 (1188): No heartbeat from core client for 30 sec - exiting 19:10:40 (1188): No heartbeat from core client for 30 sec - exiting 19:10:41 (1188): No heartbeat from core client for 30 sec - exiting 19:10:42 (1188): No heartbeat from core client for 30 sec - exiting 19:10:43 (1188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:21:45 (4312): No heartbeat from core client for 30 sec - exiting 22:21:47 (4312): No heartbeat from core client for 30 sec - exiting 22:21:48 (4312): No heartbeat from core client for 30 sec - exiting 22:21:49 (4312): No heartbeat from core client for 30 sec - exiting 22:21:50 (4312): No heartbeat from core client for 30 sec - exiting 22:21:51 (4312): No heartbeat from core client for 30 sec - exiting 22:21:52 (4312): No heartbeat from core client for 30 sec - exiting 22:21:53 (4312): No heartbeat from core client for 30 sec - exiting 22:21:54 (4312): No heartbeat from core client for 30 sec - exiting 22:21:55 (4312): No heartbeat from core client for 30 sec - exiting 22:21:56 (4312): No heartbeat from core client for 30 sec - exiting 22:21:57 (4312): No heartbeat from core client for 30 sec - exiting 22:21:58 (4312): No heartbeat from core client for 30 sec - exiting 22:21:59 (4312): No heartbeat from core client for 30 sec - exiting 22:22:00 (4312): No heartbeat from core client for 30 sec - exiting 22:22:01 (4312): No heartbeat from core client for 30 sec - exiting 22:22:02 (4312): No heartbeat from core client for 30 sec - exiting 22:22:03 (4312): No heartbeat from core client for 30 sec - exiting 22:22:04 (4312): No heartbeat from core client for 30 sec - exiting 22:22:05 (4312): No heartbeat from core client for 30 sec - exiting 22:22:06 (4312): No heartbeat from core client for 30 sec - exiting 22:22:07 (4312): No heartbeat from core client for 30 sec - exiting 22:22:08 (4312): No heartbeat from core client for 30 sec - exiting 22:22:09 (4312): No heartbeat from core client for 30 sec - exiting 22:22:10 (4312): No heartbeat from core client for 30 sec - exiting 22:22:11 (4312): No heartbeat from core client for 30 sec - exiting 22:22:12 (4312): No heartbeat from core client for 30 sec - exiting 22:22:13 (4312): No heartbeat from core client for 30 sec - exiting 22:22:14 (4312): No heartbeat from core client for 30 sec - exiting 22:22:15 (4312): No heartbeat from core client for 30 sec - exiting 22:22:16 (4312): No heartbeat from core client for 30 sec - exiting 22:22:17 (4312): No heartbeat from core client for 30 sec - exiting 22:22:18 (4312): No heartbeat from core client for 30 sec - exiting 22:22:19 (4312): No heartbeat from core client for 30 sec - exiting 22:22:20 (4312): No heartbeat from core client for 30 sec - exiting 22:22:21 (4312): No heartbeat from core client for 30 sec - exiting 22:22:22 (4312): No heartbeat from core client for 30 sec - exiting 22:22:23 (4312): No heartbeat from core client for 30 sec - exiting 22:22:24 (4312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:22:25 (4312): No heartbeat from core client for 30 sec - exiting 22:22:26 (4312): No heartbeat from core client for 30 sec - exiting 22:22:27 (4312): No heartbeat from core client for 30 sec - exiting 22:22:28 (4312): No heartbeat from core client for 30 sec - exiting 22:22:29 (4312): No heartbeat from core client for 30 sec - exiting 22:22:30 (4312): No heartbeat from core client for 30 sec - exiting 22:22:31 (4312): No heartbeat from core client for 30 sec - exiting 22:22:32 (4312): No heartbeat from core client for 30 sec - exiting 22:22:33 (4312): No heartbeat from core client for 30 sec - exiting 22:22:34 (4312): No heartbeat from core client for 30 sec - exiting BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/ymopko.pji3c10 Error converting file to netcdf: dataout/ymopko.pii3c10 Error converting file to netcdf: dataout/ymopko.pfi3c10 Error converting file to netcdf: dataout/ymopka.phi3c10 Error converting file to netcdf: dataout/ymopka.pgi3c10 Error converting file to netcdf: dataout/ymopka.pei3c10 Error converting file to netcdf: dataout/ymopka.pdi3c10 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:34:11 (6972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4944, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3792, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CSuspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4844, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:12:32 (3600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:12:33 (3600): No heartbeat from core client for 30 sec - exiting 09:12:34 (3600): No heartbeat from core client for 30 sec - exiting 14:16:14 (7916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:50:04 (4332): No heartbeat from core client for 30 sec - exiting 08:50:05 (4332): No heartbeat from core client for 30 sec - exiting 08:50:06 (4332): No heartbeat from core client for 30 sec - exiting 08:50:08 (4332): No heartbeat from core client for 30 sec - exiting 08:50:09 (4332): No heartbeat from core client for 30 sec - exiting 08:50:10 (4332): No heartbeat from core client for 30 sec - exiting 08:50:11 (4332): No heartbeat from core client for 30 sec - exiting 08:50:12 (4332): No heartbeat from core client for 30 sec - exiting 08:50:13 (4332): No heartbeat from core client for 30 sec - exiting 08:50:14 (4332): No heartbeat from core client for 30 sec - exiting 08:50:15 (4332): No heartbeat from core client for 30 sec - exiting 08:50:16 (4332): No heartbeat from core client for 30 sec - exiting 08:50:17 (4332): No heartbeat from core client for 30 sec - exiting 08:50:18 (4332): No heartbeat from core client for 30 sec - exiting 08:50:19 (4332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:04:18 (6180): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5508, iMonCtr=1 Model crash detected, will try to restart... 08:52:55 (4632): No heartbeat from core client for 30 sec - exiting 08:52:56 (4632): No heartbeat from core client for 30 sec - exiting 08:52:58 (4632): No heartbeat from core client for 30 sec - exiting 08:52:59 (4632): No heartbeat from core client for 30 sec - exiting 08:53:00 (4632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:24:56 (7420): No heartbeat from core client for 30 sec - exiting 08:24:57 (7420): No heartbeat from core client for 30 sec - exiting 08:24:58 (7420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:39:57 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:39:36 (2296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:29:48 (7212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:09:23 (3356): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 03:09:24 (3356): No heartbeat from core client for 30 sec - exiting 04:46:27 (7912): No heartbeat from core client for 30 sec - exiting 04:46:28 (7912): No heartbeat from core client for 30 sec - exiting 04:46:29 (7912): No heartbeat from core client for 30 sec - exiting 04:46:30 (7912): No heartbeat from core client for 30 sec - exiting 04:46:31 (7912): No heartbeat from core client for 30 sec - exiting 04:46:32 (7912): No heartbeat from core client for 30 sec - exiting 04:46:33 (7912): No heartbeat from core client for 30 sec - exiting 04:46:34 (7912): No heartbeat from core client for 30 sec - exiting 04:46:35 (7912): No heartbeat from core client for 30 sec - exiting 04:46:36 (7912): No heartbeat from core client for 30 sec - exiting 04:46:37 (7912): No heartbeat from core client for 30 sec - exiting 04:46:38 (7912): No heartbeat from core client for 30 sec - exiting 04:46:39 (7912): No heartbeat from core client for 30 sec - exiting 04:46:40 (7912): No heartbeat from core client for 30 sec - exiting 04:46:41 (7912): No heartbeat from core client for 30 sec - exiting 04:46:42 (7912): No heartbeat from core client for 30 sec - exiting 04:46:43 (7912): No heartbeat from core client for 30 sec - exiting 04:46:44 (7912): No heartbeat from core client for 30 sec - exiting 04:46:45 (7912): No heartbeat from core client for 30 sec - exiting 04:46:46 (7912): No heartbeat from core client for 30 sec - exiting 04:46:47 (7912): No heartbeat from core client for 30 sec - exiting 04:46:48 (7912): No heartbeat from core client for 30 sec - exiting 04:46:49 (7912): No heartbeat from core client for 30 sec - exiting 04:46:50 (7912): No heartbeat from core client for 30 sec - exiting 04:46:51 (7912): No heartbeat from core client for 30 sec - exiting 04:46:52 (7912): No heartbeat from core client for 30 sec - exiting 04:46:53 (7912): No heartbeat from core client for 30 sec - exiting 04:46:54 (7912): No heartbeat from core client for 30 sec - exiting 04:46:55 (7912): No heartbeat from core client for 30 sec - exiting 04:46:56 (7912): No heartbeat from core client for 30 sec - exiting 04:46:57 (7912): No heartbeat from core client for 30 sec - exiting 04:46:58 (7912): No heartbeat from core client for 30 sec - exiting 04:46:59 (7912): No heartbeat from core client for 30 sec - exiting 04:47:00 (7912): No heartbeat from core client for 30 sec - exiting 04:47:01 (7912): No heartbeat from core client for 30 sec - exiting 04:47:02 (7912): No heartbeat from core client for 30 sec - exiting 04:47:03 (7912): No heartbeat from core client for 30 sec - exiting 04:47:04 (7912): No heartbeat from core client for 30 sec - exiting 04:47:05 (7912): No heartbeat from core client for 30 sec - exiting 04:47:06 (7912): No heartbeat from core client for 30 sec - exiting 04:47:07 (7912): No heartbeat from core client for 30 sec - exiting 04:47:08 (7912): No heartbeat from core client for 30 sec - exiting 04:47:09 (7912): No heartbeat from core client for 30 sec - exiting 04:47:10 (7912): No heartbeat from core client for 30 sec - exiting 04:47:11 (7912): No heartbeat from core client for 30 sec - exiting 04:47:12 (7912): No heartbeat from core client for 30 sec - exiting 04:47:13 (7912): No heartbeat from core client for 30 sec - exiting 04:47:14 (7912): No heartbeat from core client for 30 sec - exiting 04:47:15 (7912): No heartbeat from core client for 30 sec - exiting 04:47:16 (7912): No heartbeat from core client for 30 sec - exiting 04:47:17 (7912): No heartbeat from core client for 30 sec - exiting 04:47:18 (7912): No heartbeat from core client for 30 sec - exiting 04:47:19 (7912): No heartbeat from core client for 30 sec - exiting 04:47:20 (7912): No heartbeat from core client for 30 sec - exiting 04:47:21 (7912): No heartbeat from core client for 30 sec - exiting 04:47:22 (7912): No heartbeat from core client for 30 sec - exiting 04:47:23 (7912): No heartbeat from core client for 30 sec - exiting 04:47:24 (7912): No heartbeat from core client for 30 sec - exiting 04:47:25 (7912): No heartbeat from core client for 30 sec - exiting 04:47:26 (7912): No heartbeat from core client for 30 sec - exiting 04:47:27 (7912): No heartbeat from core client for 30 sec - exiting 04:47:28 (7912): No heartbeat from core client for 30 sec - exiting 04:47:29 (7912): No heartbeat from core client for 30 sec - exiting 04:47:30 (7912): No heartbeat from core client for 30 sec - exiting 04:47:31 (7912): No heartbeat from core client for 30 sec - exiting 04:47:32 (7912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:00:32 (6868): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 08:00:33 (6868): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 18:17:57 (1344): No heartbeat from core client for 30 sec - exiting 18:17:59 (1344): No heartbeat from core client for 30 sec - exiting 18:18:00 (1344): No heartbeat from core client for 30 sec - exiting 18:18:01 (1344): No heartbeat from core client for 30 sec - exiting 18:18:02 (1344): No heartbeat from core client for 30 sec - exiting 18:18:03 (1344): No heartbeat from core client for 30 sec - exiting 18:18:04 (1344): No heartbeat from core client for 30 sec - exiting 18:18:05 (1344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:18:06 (1344): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:18:00 (4280): No heartbeat from core client for 30 sec - exiting 09:18:02 (4280): No heartbeat from core client for 30 sec - exiting 09:18:03 (4280): No heartbeat from core client for 30 sec - exiting 09:18:04 (4280): No heartbeat from core client for 30 sec - exiting 09:18:05 (4280): No heartbeat from core client for 30 sec - exiting 09:18:06 (4280): No heartbeat from core client for 30 sec - exiting 09:18:07 (4280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:19:50 (5124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:19:51 (5124): No heartbeat from core client for 30 sec - exiting 09:19:52 (5124): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:28:57 (5008): No heartbeat from core client for 30 sec - exiting 21:28:58 (5008): No heartbeat from core client for 30 sec - exiting 21:28:59 (5008): No heartbeat from core client for 30 sec - exiting 21:29:00 (5008): No heartbeat from core client for 30 sec - exiting 21:29:01 (5008): No heartbeat from core client for 30 sec - exiting 21:29:02 (5008): No heartbeat from core client for 30 sec - exiting 21:29:03 (5008): No heartbeat from core client for 30 sec - exiting 21:29:04 (5008): No heartbeat from core client for 30 sec - exiting 21:29:05 (5008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:29:06 (5008): No heartbeat from core client for 30 sec - exiting 21:29:07 (5008): No heartbeat from core client for 30 sec - exiting 21:29:08 (5008): No heartbeat from core client for 30 sec - exiting 21:29:09 (5008): No heartbeat from core client for 30 sec - exiting 21:29:10 (5008): No heartbeat from core client for 30 sec - exiting 21:29:11 (5008): No heartbeat from core client for 30 sec - exiting 21:29:12 (5008): No heartbeat from core client for 30 sec - exiting 21:29:13 (5008): No heartbeat from core client for 30 sec - exiting 21:29:14 (5008): No heartbeat from core client for 30 sec - exiting 21:29:15 (5008): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7468, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 10:16:51 (3956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3868, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Jan 2012 04:12:55	999576	13639000	hadcm3n_ymop_1980_40_007538850_3	1,036,800	2,278,869	2.1980
10 Jan 2012 00:11:22	999576	13639000	hadcm3n_ymop_1980_40_007538850_3	1,010,880	2,223,074	2.1991
09 Jan 2012 00:41:21	999576	13639000	hadcm3n_ymop_1980_40_007538850_3	984,960	2,164,573	2.1976
06 Jan 2012 13:49:19	999576	13639000	hadcm3n_ymop_1980_40_007538850_3	959,040	2,105,950	2.1959
04 Jan 2012 05:30:24	999576	13639000	hadcm3n_ymop_1980_40_007538850_3	933,120	2,045,436	2.1920
01 Jan 2012 03:16:15	999576	13639000	hadcm3n_ymop_1980_40_007538850_3	907,200	1,987,416	2.1907
30 Dec 2011 07:54:45	999576	13639000	hadcm3n_ymop_1980_40_007538850_3	881,280	1,926,102	2.1856
28 Dec 2011 07:54:31	999576	13639000	hadcm3n_ymop_1980_40_007538850_3	855,360	1,861,803	2.1766
27 Dec 2011 02:31:01	999576	13639000	hadcm3n_ymop_1980_40_007538850_3	829,440	1,801,779	2.1723
25 Dec 2011 19:05:25	999576	13639000	hadcm3n_ymop_1980_40_007538850_3	803,520	1,739,831	2.1653
23 Dec 2011 11:36:52	999576	13639000	hadcm3n_ymop_1980_40_007538850_3	777,600	1,678,736	2.1589
22 Dec 2011 00:25:51	999576	13639000	hadcm3n_ymop_1980_40_007538850_3	751,680	1,619,240	2.1542
20 Dec 2011 22:30:08	999576	13639000	hadcm3n_ymop_1980_40_007538850_3	725,760	1,558,252	2.1471
20 Dec 2011 07:02:25	999576	13639000	hadcm3n_ymop_1980_40_007538850_3	699,840	1,502,685	2.1472
18 Dec 2011 19:22:48	999576	13639000	hadcm3n_ymop_1980_40_007538850_3	673,920	1,445,985	2.1456
17 Dec 2011 08:53:57	999576	13639000	hadcm3n_ymop_1980_40_007538850_3	648,000	1,385,232	2.1377
16 Dec 2011 10:36:57	999576	13639000	hadcm3n_ymop_1980_40_007538850_3	622,080	1,322,335	2.1257
14 Dec 2011 05:46:45	999576	13639000	hadcm3n_ymop_1980_40_007538850_3	596,160	1,259,607	2.1129
12 Dec 2011 03:47:07	999576	13639000	hadcm3n_ymop_1980_40_007538850_3	570,240	1,194,460	2.0947
11 Dec 2011 19:03:13	999576	13639000	hadcm3n_ymop_1980_40_007538850_3	544,320	1,136,879	2.0886