Task 15258382

Name	hadam3p_pnw_36bt_1971_1_008192166_1
Workunit	8347290
Created	9 Sep 2012, 10:00:02 UTC
Sent	9 Sep 2012, 10:16:08 UTC
Report deadline	22 Aug 2013, 15:36:08 UTC
Received	30 Sep 2012, 2:16:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1215925
Run time	14 hours 37 min 53 sec
CPU time	14 hours 2 min 34 sec
Validate state	Invalid
Credit	502.98
Device peak FLOPS	3.62 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6248, selfPID=6248, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6428, selfPID=6428, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:17:02 (1624): No heartbeat from core client for 30 sec - exiting 09:17:03 (1624): No heartbeat from core client for 30 sec - exiting 09:17:04 (1624): No heartbeat from core client for 30 sec - exiting 09:17:06 (1624): No heartbeat from core client for 30 sec - exiting 09:17:07 (1624): No heartbeat from core client for 30 sec - exiting 09:17:08 (1624): No heartbeat from core client for 30 sec - exiting 09:17:09 (1624): No heartbeat from core client for 30 sec - exiting 09:17:10 (1624): No heartbeat from core client for 30 sec - exiting 09:17:11 (1624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5788, selfPID=5788, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 17:17:27 (6788): No heartbeat from core client for 30 sec - exiting 17:17:28 (6788): No heartbeat from core client for 30 sec - exiting 17:17:29 (6788): No heartbeat from core client for 30 sec - exiting 17:17:30 (6788): No heartbeat from core client for 30 sec - exiting 17:17:31 (6788): No heartbeat from core client for 30 sec - exiting 17:17:33 (6788): No heartbeat from core client for 30 sec - exiting 17:17:34 (6788): No heartbeat from core client for 30 sec - exiting 17:17:35 (6788): No heartbeat from core client for 30 sec - exiting 17:17:36 (6788): No heartbeat from core client for 30 sec - exiting 17:17:37 (6788): No heartbeat from core client for 30 sec - exiting 17:17:38 (6788): No heartbeat from core client for 30 sec - exiting 17:17:39 (6788): No heartbeat from core client for 30 sec - exiting 17:17:40 (6788): No heartbeat from core client for 30 sec - exiting 17:17:41 (6788): No heartbeat from core client for 30 sec - exiting 17:17:42 (6788): No heartbeat from core client for 30 sec - exiting 17:17:43 (6788): No heartbeat from core client for 30 sec - exiting 17:17:45 (6788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:13:14 (3176): No heartbeat from core client for 30 sec - exiting 14:13:15 (3176): No heartbeat from core client for 30 sec - exiting 14:13:16 (3176): No heartbeat from core client for 30 sec - exiting 14:13:18 (3176): No heartbeat from core client for 30 sec - exiting 14:13:19 (3176): No heartbeat from core client for 30 sec - exiting 14:13:20 (3176): No heartbeat from core client for 30 sec - exiting 14:13:21 (3176): No heartbeat from core client for 30 sec - exiting 14:13:22 (3176): No heartbeat from core client for 30 sec - exiting 14:13:23 (3176): No heartbeat from core client for 30 sec - exiting 14:13:24 (3176): No heartbeat from core client for 30 sec - exiting 14:13:25 (3176): No heartbeat from core client for 30 sec - exiting 14:13:26 (3176): No heartbeat from core client for 30 sec - exiting 14:13:27 (3176): No heartbeat from core client for 30 sec - exiting 14:13:28 (3176): No heartbeat from core client for 30 sec - exiting 14:13:30 (3176): No heartbeat from core client for 30 sec - exiting 14:13:31 (3176): No heartbeat from core client for 30 sec - exiting 14:13:32 (3176): No heartbeat from core client for 30 sec - exiting 14:13:33 (3176): No heartbeat from core client for 30 sec - exiting 14:13:34 (3176): No heartbeat from core client for 30 sec - exiting 14:13:35 (3176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:18:10 (6784): No heartbeat from core client for 30 sec - exiting 16:18:11 (6784): No heartbeat from core client for 30 sec - exiting 16:18:12 (6784): No heartbeat from core client for 30 sec - exiting 16:18:13 (6784): No heartbeat from core client for 30 sec - exiting 16:18:14 (6784): No heartbeat from core client for 30 sec - exiting 16:18:15 (6784): No heartbeat from core client for 30 sec - exiting 16:18:16 (6784): No heartbeat from core client for 30 sec - exiting 16:18:17 (6784): No heartbeat from core client for 30 sec - exiting 16:18:18 (6784): No heartbeat from core client for 30 sec - exiting 16:18:19 (6784): No heartbeat from core client for 30 sec - exiting 16:18:20 (6784): No heartbeat from core client for 30 sec - exiting 16:18:21 (6784): No heartbeat from core client for 30 sec - exiting 16:18:22 (6784): No heartbeat from core client for 30 sec - exiting 16:18:23 (6784): No heartbeat from core client for 30 sec - exiting 16:18:24 (6784): No heartbeat from core client for 30 sec - exiting 16:18:25 (6784): No heartbeat from core client for 30 sec - exiting 16:18:26 (6784): No heartbeat from core client for 30 sec - exiting 16:18:27 (6784): No heartbeat from core client for 30 sec - exiting 16:18:28 (6784): No heartbeat from core client for 30 sec - exiting 16:18:29 (6784): No heartbeat from core client for 30 sec - exiting 16:18:30 (6784): No heartbeat from core client for 30 sec - exiting 16:18:31 (6784): No heartbeat from core client for 30 sec - exiting 16:18:32 (6784): No heartbeat from core client for 30 sec - exiting 16:18:33 (6784): No heartbeat from core client for 30 sec - exiting 16:18:34 (6784): No heartbeat from core client for 30 sec - exiting 16:18:35 (6784): No heartbeat from core client for 30 sec - exiting 16:18:36 (6784): No heartbeat from core client for 30 sec - exiting 16:18:37 (6784): No heartbeat from core client for 30 sec - exiting 16:18:38 (6784): No heartbeat from core client for 30 sec - exiting 16:18:39 (6784): No heartbeat from core client for 30 sec - exiting 16:18:40 (6784): No heartbeat from core client for 30 sec - exiting 16:18:41 (6784): No heartbeat from core client for 30 sec - exiting 16:18:42 (6784): No heartbeat from core client for 30 sec - exiting 16:18:43 (6784): No heartbeat from core client for 30 sec - exiting 16:18:44 (6784): No heartbeat from core client for 30 sec - exiting 16:18:45 (6784): No heartbeat from core client for 30 sec - exiting 16:18:46 (6784): No heartbeat from core client for 30 sec - exiting 16:18:47 (6784): No heartbeat from core client for 30 sec - exiting 16:18:48 (6784): No heartbeat from core client for 30 sec - exiting 16:18:49 (6784): No heartbeat from core client for 30 sec - exiting 16:18:50 (6784): No heartbeat from core client for 30 sec - exiting 16:18:51 (6784): No heartbeat from core client for 30 sec - exiting 16:18:52 (6784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:14:33 (6064): No heartbeat from core client for 30 sec - exiting 12:14:34 (6064): No heartbeat from core client for 30 sec - exiting 12:14:35 (6064): No heartbeat from core client for 30 sec - exiting 12:14:36 (6064): No heartbeat from core client for 30 sec - exiting 12:14:37 (6064): No heartbeat from core client for 30 sec - exiting 12:14:38 (6064): No heartbeat from core client for 30 sec - exiting 12:14:39 (6064): No heartbeat from core client for 30 sec - exiting 12:14:40 (6064): No heartbeat from core client for 30 sec - exiting 12:14:41 (6064): No heartbeat from core client for 30 sec - exiting 12:14:42 (6064): No heartbeat from core client for 30 sec - exiting 12:14:43 (6064): No heartbeat from core client for 30 sec - exiting 12:14:44 (6064): No heartbeat from core client for 30 sec - exiting 12:14:45 (6064): No heartbeat from core client for 30 sec - exiting 12:14:46 (6064): No heartbeat from core client for 30 sec - exiting 12:14:47 (6064): No heartbeat from core client for 30 sec - exiting 12:14:48 (6064): No heartbeat from core client for 30 sec - exiting 12:14:49 (6064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6264, selfPID=6264, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1528, selfPID=1528, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6396, selfPID=6396, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6800, selfPID=6800, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7596, selfPID=7596, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3960, selfPID=3960, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:58:17 (7628): No heartbeat from core client for 30 sec - exiting 23:58:18 (7628): No heartbeat from core client for 30 sec - exiting 23:58:19 (7628): No heartbeat from core client for 30 sec - exiting 23:58:20 (7628): No heartbeat from core client for 30 sec - exiting 23:58:21 (7628): No heartbeat from core client for 30 sec - exiting 23:58:22 (7628): No heartbeat from core client for 30 sec - exiting 23:58:23 (7628): No heartbeat from core client for 30 sec - exiting 23:58:24 (7628): No heartbeat from core client for 30 sec - exiting 23:58:25 (7628): No heartbeat from core client for 30 sec - exiting 23:58:26 (7628): No heartbeat from core client for 30 sec - exiting 23:58:27 (7628): No heartbeat from core client for 30 sec - exiting 23:58:28 (7628): No heartbeat from core client for 30 sec - exiting 23:58:29 (7628): No heartbeat from core client for 30 sec - exiting 23:58:30 (7628): No heartbeat from core client for 30 sec - exiting 23:58:31 (7628): No heartbeat from core client for 30 sec - exiting 23:58:32 (7628): No heartbeat from core client for 30 sec - exiting 23:58:33 (7628): No heartbeat from core client for 30 sec - exiting 23:58:34 (7628): No heartbeat from core client for 30 sec - exiting 23:58:35 (7628): No heartbeat from core client for 30 sec - exiting 23:58:36 (7628): No heartbeat from core client for 30 sec - exiting 23:58:37 (7628): No heartbeat from core client for 30 sec - exiting 23:58:38 (7628): No heartbeat from core client for 30 sec - exiting 23:58:39 (7628): No heartbeat from core client for 30 sec - exiting 23:58:40 (7628): No heartbeat from core client for 30 sec - exiting 23:58:41 (7628): No heartbeat from core client for 30 sec - exiting 23:58:42 (7628): No heartbeat from core client for 30 sec - exiting 23:58:43 (7628): No heartbeat from core client for 30 sec - exiting 23:58:44 (7628): No heartbeat from core client for 30 sec - exiting 23:58:45 (7628): No heartbeat from core client for 30 sec - exiting 23:58:46 (7628): No heartbeat from core client for 30 sec - exiting 23:58:47 (7628): No heartbeat from core client for 30 sec - exiting 23:58:48 (7628): No heartbeat from core client for 30 sec - exiting 23:58:49 (7628): No heartbeat from core client for 30 sec - exiting 23:58:50 (7628): No heartbeat from core client for 30 sec - exiting 23:58:51 (7628): No heartbeat from core client for 30 sec - exiting 23:58:52 (7628): No heartbeat from core client for 30 sec - exiting 23:58:53 (7628): No heartbeat from core client for 30 sec - exiting 23:58:54 (7628): No heartbeat from core client for 30 sec - exiting 23:58:55 (7628): No heartbeat from core client for 30 sec - exiting 23:58:56 (7628): No heartbeat from core client for 30 sec - exiting 23:58:57 (7628): No heartbeat from core client for 30 sec - exiting 23:58:58 (7628): No heartbeat from core client for 30 sec - exiting 23:58:59 (7628): No heartbeat from core client for 30 sec - exiting 23:59:00 (7628): No heartbeat from core client for 30 sec - exiting 23:59:01 (7628): No heartbeat from core client for 30 sec - exiting 23:59:02 (7628): No heartbeat from core client for 30 sec - exiting 23:59:03 (7628): No heartbeat from core client for 30 sec - exiting 23:59:04 (7628): No heartbeat from core client for 30 sec - exiting 23:59:05 (7628): No heartbeat from core client for 30 sec - exiting 23:59:06 (7628): No heartbeat from core client for 30 sec - exiting 23:59:07 (7628): No heartbeat from core client for 30 sec - exiting 23:59:08 (7628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3700, selfPID=3700, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 11:46:36 (4480): No heartbeat from core client for 30 sec - exiting 11:46:37 (4480): No heartbeat from core client for 30 sec - exiting 11:46:38 (4480): No heartbeat from core client for 30 sec - exiting 11:46:39 (4480): No heartbeat from core client for 30 sec - exiting 11:46:41 (4480): No heartbeat from core client for 30 sec - exiting 11:46:42 (4480): No heartbeat from core client for 30 sec - exiting 11:46:43 (4480): No heartbeat from core client for 30 sec - exiting 11:46:44 (4480): No heartbeat from core client for 30 sec - exiting 11:46:45 (4480): No heartbeat from core client for 30 sec - exiting 11:46:46 (4480): No heartbeat from core client for 30 sec - exiting 11:46:47 (4480): No heartbeat from core client for 30 sec - exiting 11:46:48 (4480): No heartbeat from core client for 30 sec - exiting 11:46:49 (4480): No heartbeat from core client for 30 sec - exiting 11:46:50 (4480): No heartbeat from core client for 30 sec - exiting 11:46:51 (4480): No heartbeat from core client for 30 sec - exiting 11:46:53 (4480): No heartbeat from core client for 30 sec - exiting 11:46:54 (4480): No heartbeat from core client for 30 sec - exiting 11:46:55 (4480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6516, selfPID=6516, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6664, selfPID=6664, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1088, selfPID=1088, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Sep 2012 17:38:33	1215925	15258382	hadam3p_pnw_36bt_1971_1_008192166_1	23,148	43,648	1.8856
29 Sep 2012 16:37:56	1215925	15258382	hadam3p_pnw_36bt_1971_1_008192166_1	23,139	43,415	1.8763
27 Sep 2012 22:38:52	1215925	15258382	hadam3p_pnw_36bt_1971_1_008192166_1	23,136	43,191	1.8668
25 Sep 2012 13:44:04	1215925	15258382	hadam3p_pnw_36bt_1971_1_008192166_1	11,616	21,513	1.8520