Task 18786578

Name	hadcm3s_b4p4_1998_2_010082690_0
Workunit	10062280
Created	11 Aug 2015, 11:05:30 UTC
Sent	11 Aug 2015, 16:39:57 UTC
Report deadline	11 Nov 2015, 0:07:08 UTC
Received	26 Aug 2015, 7:35:14 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1222800
Run time	15 hours 41 min 28 sec
CPU time	15 hours 41 min 28 sec
Validate state	Invalid
Credit	311.04
Device peak FLOPS	3.29 GFLOPS
Application version	UK Met Office HadCM3 short v7.24 windows_intelx86
Stderr	<core_client_version>7.6.6</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6448, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5368, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1708, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:53:40 (2160): BOINC client no longer exists - exiting 00:53:40 (2160): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:53:51 (4148): BOINC client no longer exists - exiting 00:53:51 (4148): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:54:01 (796): BOINC client no longer exists - exiting 00:54:01 (796): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:54:11 (1092): BOINC client no longer exists - exiting 00:54:11 (1092): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:54:21 (2244): BOINC client no longer exists - exiting 00:54:21 (2244): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:54:33 (6500): BOINC client no longer exists - exiting 00:54:33 (6500): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:54:43 (1200): BOINC client no longer exists - exiting 00:54:43 (1200): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:54:53 (524): BOINC client no longer exists - exiting 00:54:53 (524): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:55:03 (5904): BOINC client no longer exists - exiting 00:55:03 (5904): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:55:14 (2320): BOINC client no longer exists - exiting 00:55:14 (2320): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:55:24 (6212): BOINC client no longer exists - exiting 00:55:24 (6212): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:55:34 (7020): BOINC client no longer exists - exiting 00:55:34 (7020): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:55:45 (3500): BOINC client no longer exists - exiting 00:55:45 (3500): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:55:55 (4644): BOINC client no longer exists - exiting 00:55:55 (4644): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:56:05 (1492): BOINC client no longer exists - exiting 00:56:05 (1492): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:56:16 (5064): BOINC client no longer exists - exiting 00:56:16 (5064): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:56:26 (4352): BOINC client no longer exists - exiting 00:56:26 (4352): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:56:38 (1308): BOINC client no longer exists - exiting 00:56:38 (1308): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:56:48 (4648): BOINC client no longer exists - exiting 00:56:48 (4648): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:56:58 (6148): BOINC client no longer exists - exiting 00:56:58 (6148): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:57:08 (3248): BOINC client no longer exists - exiting 00:57:08 (3248): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:57:20 (6904): BOINC client no longer exists - exiting 00:57:20 (6904): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:57:31 (1760): BOINC client no longer exists - exiting 00:57:31 (1760): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:57:42 (4480): BOINC client no longer exists - exiting 00:57:42 (4480): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:57:53 (2120): BOINC client no longer exists - exiting 00:57:53 (2120): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:58:04 (4664): BOINC client no longer exists - exiting 00:58:04 (4664): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:58:14 (5836): BOINC client no longer exists - exiting 00:58:14 (5836): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:58:25 (5000): BOINC client no longer exists - exiting 00:58:25 (5000): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:58:36 (1392): BOINC client no longer exists - exiting 00:58:36 (1392): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:58:47 (5048): BOINC client no longer exists - exiting 00:58:47 (5048): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:58:58 (5036): BOINC client no longer exists - exiting 00:58:58 (5036): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:59:09 (5444): BOINC client no longer exists - exiting 00:59:09 (5444): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:59:20 (4140): BOINC client no longer exists - exiting 00:59:20 (4140): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:59:31 (6820): BOINC client no longer exists - exiting 00:59:31 (6820): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:59:42 (7008): BOINC client no longer exists - exiting 00:59:42 (7008): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:59:54 (3716): BOINC client no longer exists - exiting 00:59:54 (3716): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:00:05 (5092): BOINC client no longer exists - exiting 01:00:05 (5092): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:00:15 (928): BOINC client no longer exists - exiting 01:00:15 (928): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:00:25 (4492): BOINC client no longer exists - exiting 01:00:25 (4492): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:00:36 (3184): BOINC client no longer exists - exiting 01:00:36 (3184): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:00:47 (6260): BOINC client no longer exists - exiting 01:00:47 (6260): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:00:59 (2244): BOINC client no longer exists - exiting 01:00:59 (2244): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:01:11 (6184): BOINC client no longer exists - exiting 01:01:11 (6184): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:01:22 (7064): BOINC client no longer exists - exiting 01:01:22 (7064): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:01:33 (3368): BOINC client no longer exists - exiting 01:01:33 (3368): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:01:44 (5672): BOINC client no longer exists - exiting 01:01:44 (5672): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:01:55 (6032): BOINC client no longer exists - exiting 01:01:55 (6032): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:02:07 (3708): BOINC client no longer exists - exiting 01:02:07 (3708): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:02:18 (1584): BOINC client no longer exists - exiting 01:02:18 (1584): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:02:29 (4548): BOINC client no longer exists - exiting 01:02:29 (4548): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:02:40 (3824): BOINC client no longer exists - exiting 01:02:40 (3824): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:02:51 (1376): BOINC client no longer exists - exiting 01:02:51 (1376): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:03:03 (1100): BOINC client no longer exists - exiting 01:03:03 (1100): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:03:14 (6980): BOINC client no longer exists - exiting 01:03:14 (6980): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:03:26 (2852): BOINC client no longer exists - exiting 01:03:26 (2852): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:03:37 (6952): BOINC client no longer exists - exiting 01:03:37 (6952): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:03:48 (1492): BOINC client no longer exists - exiting 01:03:48 (1492): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:04:00 (3180): BOINC client no longer exists - exiting 01:04:00 (3180): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:04:11 (4332): BOINC client no longer exists - exiting 01:04:11 (4332): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:04:22 (1292): BOINC client no longer exists - exiting 01:04:22 (1292): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:04:33 (356): BOINC client no longer exists - exiting 01:04:33 (356): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:04:45 (7140): BOINC client no longer exists - exiting 01:04:45 (7140): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:04:56 (3992): BOINC client no longer exists - exiting 01:04:56 (3992): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:05:07 (1760): BOINC client no longer exists - exiting 01:05:07 (1760): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:05:18 (6148): BOINC client no longer exists - exiting 01:05:18 (6148): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:05:30 (1168): BOINC client no longer exists - exiting 01:05:30 (1168): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:05:41 (6264): BOINC client no longer exists - exiting 01:05:41 (6264): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:05:53 (3056): BOINC client no longer exists - exiting 01:05:53 (3056): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:06:04 (1220): BOINC client no longer exists - exiting 01:06:04 (1220): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:06:15 (508): BOINC client no longer exists - exiting 01:06:15 (508): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:06:26 (5280): BOINC client no longer exists - exiting 01:06:26 (5280): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:06:37 (4332): BOINC client no longer exists - exiting 01:06:37 (4332): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:06:48 (4576): BOINC client no longer exists - exiting 01:06:48 (4576): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:07:00 (7000): BOINC client no longer exists - exiting 01:07:00 (7000): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:07:11 (4760): BOINC client no longer exists - exiting 01:07:11 (4760): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:07:22 (4488): BOINC client no longer exists - exiting 01:07:22 (4488): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:07:33 (3880): BOINC client no longer exists - exiting 01:07:33 (3880): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:07:44 (1340): BOINC client no longer exists - exiting 01:07:44 (1340): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:07:55 (6864): BOINC client no longer exists - exiting 01:07:55 (6864): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:08:07 (5508): BOINC client no longer exists - exiting 01:08:07 (5508): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:08:18 (6544): BOINC client no longer exists - exiting 01:08:18 (6544): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:08:29 (3644): BOINC client no longer exists - exiting 01:08:29 (3644): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:08:40 (6980): BOINC client no longer exists - exiting 01:08:40 (6980): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:08:51 (3476): BOINC client no longer exists - exiting 01:08:51 (3476): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:09:03 (5676): BOINC client no longer exists - exiting 01:09:03 (5676): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:09:14 (6700): BOINC client no longer exists - exiting 01:09:14 (6700): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:09:25 (3180): BOINC client no longer exists - exiting 01:09:25 (3180): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:09:36 (4968): BOINC client no longer exists - exiting 01:09:36 (4968): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:09:47 (5244): BOINC client no longer exists - exiting 01:09:47 (5244): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:09:59 (4576): BOINC client no longer exists - exiting 01:09:59 (4576): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:10:10 (7124): BOINC client no longer exists - exiting 01:10:10 (7124): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:10:21 (1484): BOINC client no longer exists - exiting 01:10:21 (1484): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:10:32 (3672): BOINC client no longer exists - exiting 01:10:32 (3672): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:10:43 (3884): BOINC client no longer exists - exiting 01:10:43 (3884): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:10:55 (5328): BOINC client no longer exists - exiting 01:10:55 (5328): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:11:06 (2824): BOINC client no longer exists - exiting 01:11:06 (2824): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:11:17 (5032): BOINC client no longer exists - exiting 01:11:17 (5032): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:11:28 (7040): BOINC client no longer exists - exiting 01:11:28 (7040): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:11:39 (6544): BOINC client no longer exists - exiting 01:11:39 (6544): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:11:50 (6600): BOINC client no longer exists - exiting 01:11:50 (6600): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:12:03 (6592): BOINC client no longer exists - exiting 01:12:03 (6592): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Aug 2015 00:00:18	1222800	18786578	hadcm3s_b4p4_1998_2_010082690_0	25,920	41,384	1.5966