Task 14037479

Name	hadcm3n_u7oe_1980_40_007743099_3
Workunit	7898207
Created	31 Jan 2012, 9:10:36 UTC
Sent	31 Jan 2012, 9:36:53 UTC
Report deadline	1 May 2012, 17:04:04 UTC
Received	7 Feb 2012, 7:50:39 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1176858
Run time	2 days 8 hours 9 min 54 sec
CPU time	2 days 1 hours 18 min
Validate state	Invalid
Credit	1,244.16
Device peak FLOPS	2.82 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> Enheten gjenkjenner ikke kommandoen. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5436, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5712, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3324, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:46:55 (11288): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 22:46:56 (11288): No heartbeat from core client for 30 sec - exiting 22:46:57 (11288): No heartbeat from core client for 30 sec - exiting 22:46:58 (11288): No heartbeat from core client for 30 sec - exiting 22:46:59 (11288): No heartbeat from core client for 30 sec - exiting 22:47:00 (11288): No heartbeat from core client for 30 sec - exiting 22:47:01 (11288): No heartbeat from core client for 30 sec - exiting 22:47:02 (11288): No heartbeat from core client for 30 sec - exiting 22:47:03 (11288): No heartbeat from core client for 30 sec - exiting 22:47:04 (11288): No heartbeat from core client for 30 sec - exiting 22:47:05 (11288): No heartbeat from core client for 30 sec - exiting 22:47:06 (11288): No heartbeat from core client for 30 sec - exiting 22:47:07 (11288): No heartbeat from core client for 30 sec - exiting 22:47:08 (11288): No heartbeat from core client for 30 sec - exiting 22:47:19 (11288): No heartbeat from core client for 30 sec - exiting 22:47:20 (11288): No heartbeat from core client for 30 sec - exiting 22:47:21 (11288): No heartbeat from core client for 30 sec - exiting 22:47:22 (11288): No heartbeat from core client for 30 sec - exiting 22:47:23 (11288): No heartbeat from core client for 30 sec - exiting 22:47:24 (11288): No heartbeat from core client for 30 sec - exiting 22:47:25 (11288): No heartbeat from core client for 30 sec - exiting 23:10:18 (12136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:25:01 (6364): No heartbeat from core client for 30 sec - exiting 23:25:02 (6364): No heartbeat from core client for 30 sec - exiting 23:25:03 (6364): No heartbeat from core client for 30 sec - exiting 23:25:04 (6364): No heartbeat from core client for 30 sec - exiting 23:25:05 (6364): No heartbeat from core client for 30 sec - exiting 23:25:06 (6364): No heartbeat from core client for 30 sec - exiting 23:25:07 (6364): No heartbeat from core client for 30 sec - exiting 23:25:08 (6364): No heartbeat from core client for 30 sec - exiting 23:25:09 (6364): No heartbeat from core client for 30 sec - exiting 23:25:10 (6364): No heartbeat from core client for 30 sec - exiting 23:25:11 (6364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:25:12 (6364): No heartbeat from core client for 30 sec - exiting 23:25:13 (6364): No heartbeat from core client for 30 sec - exiting 23:25:14 (6364): No heartbeat from core client for 30 sec - exiting 23:25:15 (6364): No heartbeat from core client for 30 sec - exiting 23:25:16 (6364): No heartbeat from core client for 30 sec - exiting 23:25:17 (6364): No heartbeat from core client for 30 sec - exiting 23:25:18 (6364): No heartbeat from core client for 30 sec - exiting 23:25:19 (6364): No heartbeat from core client for 30 sec - exiting 23:25:20 (6364): No heartbeat from core client for 30 sec - exiting 23:25:21 (6364): No heartbeat from core client for 30 sec - exiting 23:30:16 (10676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:30:38 (10676): No heartbeat from core client for 30 sec - exiting 23:30:39 (10676): No heartbeat from core client for 30 sec - exiting 23:30:40 (10676): No heartbeat from core client for 30 sec - exiting 23:30:41 (10676): No heartbeat from core client for 30 sec - exiting 23:30:42 (10676): No heartbeat from core client for 30 sec - exiting 23:30:43 (10676): No heartbeat from core client for 30 sec - exiting 23:30:44 (10676): No heartbeat from core client for 30 sec - exiting 23:30:45 (10676): No heartbeat from core client for 30 sec - exiting 23:30:46 (10676): No heartbeat from core client for 30 sec - exiting 23:30:47 (10676): No heartbeat from core client for 30 sec - exiting 23:33:14 (9856): No heartbeat from core client for 30 sec - exiting 23:37:28 (9856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:46:54 (6688): No heartbeat from core client for 30 sec - exiting 23:46:55 (6688): No heartbeat from core client for 30 sec - exiting 23:46:56 (6688): No heartbeat from core client for 30 sec - exiting 23:46:57 (6688): No heartbeat from core client for 30 sec - exiting 23:46:58 (6688): No heartbeat from core client for 30 sec - exiting 23:46:59 (6688): No heartbeat from core client for 30 sec - exiting 23:47:00 (6688): No heartbeat from core client for 30 sec - exiting 23:47:01 (6688): No heartbeat from core client for 30 sec - exiting 23:47:02 (6688): No heartbeat from core client for 30 sec - exiting 23:47:03 (6688): No heartbeat from core client for 30 sec - exiting 23:47:04 (6688): No heartbeat from core client for 30 sec - exiting 23:47:05 (6688): No heartbeat from core client for 30 sec - exiting 23:47:06 (6688): No heartbeat from core client for 30 sec - exiting 23:47:07 (6688): No heartbeat from core client for 30 sec - exiting 23:47:08 (6688): No heartbeat from core client for 30 sec - exiting 23:47:09 (6688): No heartbeat from core client for 30 sec - exiting 23:47:10 (6688): No heartbeat from core client for 30 sec - exiting 23:47:11 (6688): No heartbeat from core client for 30 sec - exiting 23:47:12 (6688): No heartbeat from core client for 30 sec - exiting 23:47:13 (6688): No heartbeat from core client for 30 sec - exiting 23:47:14 (6688): No heartbeat from core client for 30 sec - exiting 23:47:15 (6688): No heartbeat from core client for 30 sec - exiting 23:47:16 (6688): No heartbeat from core client for 30 sec - exiting 23:47:17 (6688): No heartbeat from core client for 30 sec - exiting 23:47:18 (6688): No heartbeat from core client for 30 sec - exiting 23:47:19 (6688): No heartbeat from core client for 30 sec - exiting 23:47:20 (6688): No heartbeat from core client for 30 sec - exiting 23:47:21 (6688): No heartbeat from core client for 30 sec - exiting 23:47:22 (6688): No heartbeat from core client for 30 sec - exiting 23:47:23 (6688): No heartbeat from core client for 30 sec - exiting 23:47:24 (6688): No heartbeat from core client for 30 sec - exiting 23:47:25 (6688): No heartbeat from core client for 30 sec - exiting 23:47:26 (6688): No heartbeat from core client for 30 sec - exiting 23:47:27 (6688): No heartbeat from core client for 30 sec - exiting 23:47:28 (6688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:47:29 (6688): No heartbeat from core client for 30 sec - exiting 23:47:30 (6688): No heartbeat from core client for 30 sec - exiting 23:47:31 (6688): No heartbeat from core client for 30 sec - exiting 23:47:32 (6688): No heartbeat from core client for 30 sec - exiting 23:47:33 (6688): No heartbeat from core client for 30 sec - exiting 23:47:34 (6688): No heartbeat from core client for 30 sec - exiting 23:47:35 (6688): No heartbeat from core client for 30 sec - exiting 23:47:36 (6688): No heartbeat from core client for 30 sec - exiting 23:47:37 (6688): No heartbeat from core client for 30 sec - exiting 23:51:29 (10772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:53:05 (9192): No heartbeat from core client for 30 sec - exiting 23:53:16 (9192): No heartbeat from core client for 30 sec - exiting 23:53:17 (9192): No heartbeat from core client for 30 sec - exiting 23:53:18 (9192): No heartbeat from core client for 30 sec - exiting 23:53:19 (9192): No heartbeat from core client for 30 sec - exiting 23:53:20 (9192): No heartbeat from core client for 30 sec - exiting 23:53:21 (9192): No heartbeat from core client for 30 sec - exiting 23:53:22 (9192): No heartbeat from core client for 30 sec - exiting 23:53:23 (9192): No heartbeat from core client for 30 sec - exiting 23:53:24 (9192): No heartbeat from core client for 30 sec - exiting 23:53:25 (9192): No heartbeat from core client for 30 sec - exiting 23:53:26 (9192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:53:37 (9192): No heartbeat from core client for 30 sec - exiting 00:00:59 (4460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:05:42 (11832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:05:43 (11832): No heartbeat from core client for 30 sec - exiting 00:18:42 (4856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 00:23:08 (10196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:23:09 (10196): No heartbeat from core client for 30 sec - exiting 00:23:10 (10196): No heartbeat from core client for 30 sec - exiting 00:23:11 (10196): No heartbeat from core client for 30 sec - exiting 00:23:12 (10196): No heartbeat from core client for 30 sec - exiting 00:23:13 (10196): No heartbeat from core client for 30 sec - exiting 00:23:14 (10196): No heartbeat from core client for 30 sec - exiting 00:23:15 (10196): No heartbeat from core client for 30 sec - exiting 00:23:16 (10196): No heartbeat from core client for 30 sec - exiting 00:23:17 (10196): No heartbeat from core client for 30 sec - exiting 00:23:18 (10196): No heartbeat from core client for 30 sec - exiting 00:35:54 (10288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:38:12 (11496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:38:24 (11496): No heartbeat from core client for 30 sec - exiting 00:38:34 (11496): No heartbeat from core client for 30 sec - exiting 00:46:24 (5832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:47:09 (5832): No heartbeat from core client for 30 sec - exiting 00:47:10 (5832): No heartbeat from core client for 30 sec - exiting 00:47:11 (5832): No heartbeat from core client for 30 sec - exiting 00:47:12 (5832): No heartbeat from core client for 30 sec - exiting 00:47:13 (5832): No heartbeat from core client for 30 sec - exiting 00:47:14 (5832): No heartbeat from core client for 30 sec - exiting 00:47:15 (5832): No heartbeat from core client for 30 sec - exiting 00:47:16 (5832): No heartbeat from core client for 30 sec - exiting 00:47:17 (5832): No heartbeat from core client for 30 sec - exiting 00:47:18 (5832): No heartbeat from core client for 30 sec - exiting 00:54:07 (6216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:56:46 (7904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:58:52 (6516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:58:53 (6516): No heartbeat from core client for 30 sec - exiting 00:58:54 (6516): No heartbeat from core client for 30 sec - exiting 00:58:55 (6516): No heartbeat from core client for 30 sec - exiting 00:58:56 (6516): No heartbeat from core client for 30 sec - exiting 00:58:57 (6516): No heartbeat from core client for 30 sec - exiting 00:58:58 (6516): No heartbeat from core client for 30 sec - exiting 00:58:59 (6516): No heartbeat from core client for 30 sec - exiting 00:59:00 (6516): No heartbeat from core client for 30 sec - exiting 00:59:01 (6516): No heartbeat from core client for 30 sec - exiting 00:59:02 (6516): No heartbeat from core client for 30 sec - exiting 01:03:46 (11248): No heartbeat from core client for 30 sec - exiting 01:03:47 (11248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:06:35 (8868): No heartbeat from core client for 30 sec - exiting 01:06:36 (8868): No heartbeat from core client for 30 sec - exiting 01:06:37 (8868): No heartbeat from core client for 30 sec - exiting 01:06:38 (8868): No heartbeat from core client for 30 sec - exiting 01:06:39 (8868): No heartbeat from core client for 30 sec - exiting 01:06:40 (8868): No heartbeat from core client for 30 sec - exiting 01:06:41 (8868): No heartbeat from core client for 30 sec - exiting 01:06:42 (8868): No heartbeat from core client for 30 sec - exiting 01:06:43 (8868): No heartbeat from core client for 30 sec - exiting 01:06:44 (8868): No heartbeat from core client for 30 sec - exiting 01:06:45 (8868): No heartbeat from core client for 30 sec - exiting 01:06:46 (8868): No heartbeat from core client for 30 sec - exiting 01:06:47 (8868): No heartbeat from core client for 30 sec - exiting 01:06:48 (8868): No heartbeat from core client for 30 sec - exiting 01:06:49 (8868): No heartbeat from core client for 30 sec - exiting 01:06:50 (8868): No heartbeat from core client for 30 sec - exiting 01:06:51 (8868): No heartbeat from core client for 30 sec - exiting 01:06:52 (8868): No heartbeat from core client for 30 sec - exiting 01:06:53 (8868): No heartbeat from core client for 30 sec - exiting 01:06:54 (8868): No heartbeat from core client for 30 sec - exiting 01:06:55 (8868): No heartbeat from core client for 30 sec - exiting 01:06:56 (8868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:10:27 (6716): No heartbeat from core client for 30 sec - exiting 01:10:39 (6716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:10:40 (6716): No heartbeat from core client for 30 sec - exiting 01:10:41 (6716): No heartbeat from core client for 30 sec - exiting 01:10:42 (6716): No heartbeat from core client for 30 sec - exiting 01:10:43 (6716): No heartbeat from core client for 30 sec - exiting 01:10:44 (6716): No heartbeat from core client for 30 sec - exiting 01:10:45 (6716): No heartbeat from core client for 30 sec - exiting 01:10:46 (6716): No heartbeat from core client for 30 sec - exiting 01:10:47 (6716): No heartbeat from core client for 30 sec - exiting 01:10:48 (6716): No heartbeat from core client for 30 sec - exiting 01:10:49 (6716): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 01:20:16 (11764): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 01:38:08 (9236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:41:41 (6712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:52:33 (11180): No heartbeat from core client for 30 sec - exiting 01:52:35 (11180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:52:36 (11180): No heartbeat from core client for 30 sec - exiting 01:52:37 (11180): No heartbeat from core client for 30 sec - exiting 01:52:38 (11180): No heartbeat from core client for 30 sec - exiting 01:52:39 (11180): No heartbeat from core client for 30 sec - exiting 01:52:40 (11180): No heartbeat from core client for 30 sec - exiting 01:52:41 (11180): No heartbeat from core client for 30 sec - exiting 01:52:42 (11180): No heartbeat from core client for 30 sec - exiting 01:52:43 (11180): No heartbeat from core client for 30 sec - exiting 01:52:44 (11180): No heartbeat from core client for 30 sec - exiting 01:54:06 (8284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:54:07 (8284): No heartbeat from core client for 30 sec - exiting 02:05:10 (9444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:09:33 (11216): No heartbeat from core client for 30 sec - exiting 02:09:45 (11216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:09:46 (11216): No heartbeat from core client for 30 sec - exiting 02:09:47 (11216): No heartbeat from core client for 30 sec - exiting 02:09:48 (11216): No heartbeat from core client for 30 sec - exiting 02:09:49 (11216): No heartbeat from core client for 30 sec - exiting 02:09:50 (11216): No heartbeat from core client for 30 sec - exiting 02:09:51 (11216): No heartbeat from core client for 30 sec - exiting 02:09:52 (11216): No heartbeat from core client for 30 sec - exiting 02:09:53 (11216): No heartbeat from core client for 30 sec - exiting 02:09:54 (11216): No heartbeat from core client for 30 sec - exiting 02:09:55 (11216): No heartbeat from core client for 30 sec - exiting 02:13:46 (11164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:24:38 (8864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:25:00 (8864): No heartbeat from core client for 30 sec - exiting 02:28:07 (10304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:31:39 (11324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:34:41 (9556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:34:42 (9556): No heartbeat from core client for 30 sec - exiting 02:34:43 (9556): No heartbeat from core client for 30 sec - exiting 02:34:44 (9556): No heartbeat from core client for 30 sec - exiting 02:34:45 (9556): No heartbeat from core client for 30 sec - exiting 02:34:46 (9556): No heartbeat from core client for 30 sec - exiting 02:34:47 (9556): No heartbeat from core client for 30 sec - exiting 02:34:48 (9556): No heartbeat from core client for 30 sec - exiting 02:34:49 (9556): No heartbeat from core client for 30 sec - exiting 02:34:50 (9556): No heartbeat from core client for 30 sec - exiting 02:34:51 (9556): No heartbeat from core client for 30 sec - exiting 02:38:29 (4512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:44:17 (8984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:44:29 (8984): No heartbeat from core client for 30 sec - exiting 02:44:30 (8984): No heartbeat from core client for 30 sec - exiting 02:44:31 (8984): No heartbeat from core client for 30 sec - exiting 02:44:32 (8984): No heartbeat from core client for 30 sec - exiting 02:44:33 (8984): No heartbeat from core client for 30 sec - exiting 02:44:34 (8984): No heartbeat from core client for 30 sec - exiting 02:44:35 (8984): No heartbeat from core client for 30 sec - exiting 02:44:36 (8984): No heartbeat from core client for 30 sec - exiting 02:44:37 (8984): No heartbeat from core client for 30 sec - exiting 02:44:38 (8984): No heartbeat from core client for 30 sec - exiting 03:00:46 (8756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:12:00 (8400): No heartbeat from core client for 30 sec - exiting 03:12:42 (8400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:12:43 (8400): No heartbeat from core client for 30 sec - exiting 03:12:44 (8400): No heartbeat from core client for 30 sec - exiting 03:12:45 (8400): No heartbeat from core client for 30 sec - exiting 03:12:46 (8400): No heartbeat from core client for 30 sec - exiting 03:12:47 (8400): No heartbeat from core client for 30 sec - exiting 03:12:48 (8400): No heartbeat from core client for 30 sec - exiting 03:12:49 (8400): No heartbeat from core client for 30 sec - exiting 03:12:50 (8400): No heartbeat from core client for 30 sec - exiting 03:12:51 (8400): No heartbeat from core client for 30 sec - exiting 03:12:52 (8400): No heartbeat from core client for 30 sec - exiting 03:15:09 (7068): No heartbeat from core client for 30 sec - exiting 03:15:10 (7068): No heartbeat from core client for 30 sec - exiting 03:15:11 (7068): No heartbeat from core client for 30 sec - exiting 03:15:12 (7068): No heartbeat from core client for 30 sec - exiting 03:15:13 (7068): No heartbeat from core client for 30 sec - exiting 03:15:14 (7068): No heartbeat from core client for 30 sec - exiting 03:15:15 (7068): No heartbeat from core client for 30 sec - exiting 03:15:16 (7068): No heartbeat from core client for 30 sec - exiting 03:15:17 (7068): No heartbeat from core client for 30 sec - exiting 03:15:18 (7068): No heartbeat from core client for 30 sec - exiting 03:15:19 (7068): No heartbeat from core client for 30 sec - exiting 03:15:20 (7068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:15:21 (7068): No heartbeat from core client for 30 sec - exiting 03:18:50 (10668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:18:51 (10668): No heartbeat from core client for 30 sec - exiting 03:18:52 (10668): No heartbeat from core client for 30 sec - exiting 03:18:53 (10668): No heartbeat from core client for 30 sec - exiting 03:18:54 (10668): No heartbeat from core client for 30 sec - exiting 03:18:55 (10668): No heartbeat from core client for 30 sec - exiting 03:18:56 (10668): No heartbeat from core client for 30 sec - exiting 03:18:57 (10668): No heartbeat from core client for 30 sec - exiting 03:18:58 (10668): No heartbeat from core client for 30 sec - exiting 03:18:59 (10668): No heartbeat from core client for 30 sec - exiting 03:19:00 (10668): No heartbeat from core client for 30 sec - exiting 03:29:21 (9324): No heartbeat from core client for 30 sec - exiting 03:29:22 (9324): No heartbeat from core client for 30 sec - exiting 03:29:34 (9324): No heartbeat from core client for 30 sec - exiting 03:29:35 (9324): No heartbeat from core client for 30 sec - exiting 03:29:36 (9324): No heartbeat from core client for 30 sec - exiting 03:29:37 (9324): No heartbeat from core client for 30 sec - exiting 03:29:38 (9324): No heartbeat from core client for 30 sec - exiting 03:29:39 (9324): No heartbeat from core client for 30 sec - exiting 03:29:40 (9324): No heartbeat from core client for 30 sec - exiting 03:29:41 (9324): No heartbeat from core client for 30 sec - exiting 03:29:42 (9324): No heartbeat from core client for 30 sec - exiting 03:29:43 (9324): No heartbeat from core client for 30 sec - exiting 03:29:54 (9324): No heartbeat from core client for 30 sec - exiting 03:29:55 (9324): No heartbeat from core client for 30 sec - exiting 03:29:56 (9324): No heartbeat from core client for 30 sec - exiting 03:29:57 (9324): No heartbeat from core client for 30 sec - exiting 03:29:58 (9324): No heartbeat from core client for 30 sec - exiting 03:29:59 (9324): No heartbeat from core client for 30 sec - exiting 03:30:00 (9324): No heartbeat from core client for 30 sec - exiting 03:30:01 (9324): No heartbeat from core client for 30 sec - exiting 03:30:02 (9324): No heartbeat from core client for 30 sec - exiting 03:30:03 (9324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:30:04 (9324): No heartbeat from core client for 30 sec - exiting 03:30:05 (9324): No heartbeat from core client for 30 sec - exiting 03:30:06 (9324): No heartbeat from core client for 30 sec - exiting 03:30:07 (9324): No heartbeat from core client for 30 sec - exiting 03:30:08 (9324): No heartbeat from core client for 30 sec - exiting 03:30:09 (9324): No heartbeat from core client for 30 sec - exiting 03:30:10 (9324): No heartbeat from core client for 30 sec - exiting 03:30:11 (9324): No heartbeat from core client for 30 sec - exiting 03:30:12 (9324): No heartbeat from core client for 30 sec - exiting 03:30:13 (9324): No heartbeat from core client for 30 sec - exiting 03:34:17 (8988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:44:37 (11084): No heartbeat from core client for 30 sec - exiting 03:44:38 (11084): No heartbeat from core client for 30 sec - exiting 03:44:39 (11084): No heartbeat from core client for 30 sec - exiting 03:44:40 (11084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:44:52 (11084): No heartbeat from core client for 30 sec - exiting 03:44:53 (11084): No heartbeat from core client for 30 sec - exiting 03:51:10 (6348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:20:05 (9776): No heartbeat from core client for 30 sec - exiting 04:20:16 (9776): No heartbeat from core client for 30 sec - exiting 04:20:17 (9776): No heartbeat from core client for 30 sec - exiting 04:20:18 (9776): No heartbeat from core client for 30 sec - exiting 04:20:19 (9776): No heartbeat from core client for 30 sec - exiting 04:20:20 (9776): No heartbeat from core client for 30 sec - exiting 04:20:21 (9776): No heartbeat from core client for 30 sec - exiting 04:20:22 (9776): No heartbeat from core client for 30 sec - exiting 04:20:23 (9776): No heartbeat from core client for 30 sec - exiting 04:20:24 (9776): No heartbeat from core client for 30 sec - exiting 04:20:25 (9776): No heartbeat from core client for 30 sec - exiting 04:20:26 (9776): No heartbeat from core client for 30 sec - exiting 04:20:27 (9776): No heartbeat from core client for 30 sec - exiting 04:20:28 (9776): No heartbeat from core client for 30 sec - exiting 04:20:29 (9776): No heartbeat from core client for 30 sec - exiting 04:20:30 (9776): No heartbeat from core client for 30 sec - exiting 04:20:31 (9776): No heartbeat from core client for 30 sec - exiting 04:20:32 (9776): No heartbeat from core client for 30 sec - exiting 04:20:33 (9776): No heartbeat from core client for 30 sec - exiting 04:20:34 (9776): No heartbeat from core client for 30 sec - exiting 04:20:35 (9776): No heartbeat from core client for 30 sec - exiting 04:20:36 (9776): No heartbeat from core client for 30 sec - exiting 04:20:37 (9776): No heartbeat from core client for 30 sec - exiting 04:20:38 (9776): No heartbeat from core client for 30 sec - exiting 04:20:39 (9776): No heartbeat from core client for 30 sec - exiting 04:20:40 (9776): No heartbeat from core client for 30 sec - exiting 04:20:41 (9776): No heartbeat from core client for 30 sec - exiting 04:20:42 (9776): No heartbeat from core client for 30 sec - exiting 04:20:43 (9776): No heartbeat from core client for 30 sec - exiting 04:20:44 (9776): No heartbeat from core client for 30 sec - exiting 04:20:45 (9776): No heartbeat from core client for 30 sec - exiting 04:20:46 (9776): No heartbeat from core client for 30 sec - exiting 04:20:57 (9776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:21:09 (9776): No heartbeat from core client for 30 sec - exiting 04:21:10 (9776): No heartbeat from core client for 30 sec - exiting 04:21:11 (9776): No heartbeat from core client for 30 sec - exiting 04:21:12 (9776): No heartbeat from core client for 30 sec - exiting 04:21:13 (9776): No heartbeat from core client for 30 sec - exiting 04:21:14 (9776): No heartbeat from core client for 30 sec - exiting 04:21:15 (9776): No heartbeat from core client for 30 sec - exiting 04:21:16 (9776): No heartbeat from core client for 30 sec - exiting 04:21:17 (9776): No heartbeat from core client for 30 sec - exiting 04:21:18 (9776): No heartbeat from core client for 30 sec - exiting 04:33:45 (11712): No heartbeat from core client for 30 sec - exiting 04:33:47 (11712): No heartbeat from core client for 30 sec - exiting 04:33:48 (11712): No heartbeat from core client for 30 sec - exiting 04:33:49 (11712): No heartbeat from core client for 30 sec - exiting 04:33:50 (11712): No heartbeat from core client for 30 sec - exiting 04:33:51 (11712): No heartbeat from core client for 30 sec - exiting 04:33:52 (11712): No heartbeat from core client for 30 sec - exiting 04:33:53 (11712): No heartbeat from core client for 30 sec - exiting 04:33:54 (11712): No heartbeat from core client for 30 sec - exiting 04:33:55 (11712): No heartbeat from core client for 30 sec - exiting 04:33:56 (11712): No heartbeat from core client for 30 sec - exiting 04:33:57 (11712): No heartbeat from core client for 30 sec - exiting 04:33:58 (11712): No heartbeat from core client for 30 sec - exiting 04:33:59 (11712): No heartbeat from core client for 30 sec - exiting 04:34:00 (11712): No heartbeat from core client for 30 sec - exiting 04:34:01 (11712): No heartbeat from core client for 30 sec - exiting 04:34:02 (11712): No heartbeat from core client for 30 sec - exiting 04:34:03 (11712): No heartbeat from core client for 30 sec - exiting 04:34:04 (11712): No heartbeat from core client for 30 sec - exiting 04:34:05 (11712): No heartbeat from core client for 30 sec - exiting 04:34:06 (11712): No heartbeat from core client for 30 sec - exiting 04:34:07 (11712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:34:59 (11712): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:42:52 (11788): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 04:53:56 (10484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:11:15 (11456): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy 2048 Atmos Hold Restart file rename failed on atmos_restart.hold Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy 2048 Suspended CPDN Monitor - Suspend request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy 2048 Atmos Hold Restart file rename failed on atmos_restart.hold Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy 2048 Atmos Hold Restart file rename failed on atmos_restart.hold Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy 2048 Atmos Hold Restart file rename failed on atmos_restart.hold Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Feb 2012 15:03:38	1176858	14037479	hadcm3n_u7oe_1980_40_007743099_3	103,680	166,354	1.6045
05 Feb 2012 08:14:06	1176858	14037479	hadcm3n_u7oe_1980_40_007743099_3	77,760	125,198	1.6101
02 Feb 2012 22:06:24	1176858	14037479	hadcm3n_u7oe_1980_40_007743099_3	51,840	82,150	1.5847
02 Feb 2012 10:13:23	1176858	14037479	hadcm3n_u7oe_1980_40_007743099_3	25,920	42,983	1.6583