Task 16809939

Name	hadam3p_eu_e5fa_2013_1_008848817_1
Workunit	8994746
Created	15 Jul 2014, 23:45:31 UTC
Sent	16 Jul 2014, 0:06:21 UTC
Report deadline	28 Jun 2015, 5:26:21 UTC
Received	27 Aug 2014, 5:57:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-187 (0xFFFFFF45) ERR_RESULT_UPLOAD
Computer ID	1314952
Run time	3 days 4 hours 40 min 17 sec
CPU time	23 hours 53 min 49 sec
Validate state	Invalid
Credit	2,187.67
Device peak FLOPS	3.32 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> upload failure </message> <stderr_txt> 06:06:22 (13544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:11:31 (19420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=20492, selfPID=20492, iMonCtr=2 06:18:35 (21924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:40:43 (15572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:56:58 (12572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:18:30 (19296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:24:32 (23444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:24:40 (23444): No heartbeat from core client for 30 sec - exiting 07:24:41 (23444): No heartbeat from core client for 30 sec - exiting 07:24:42 (23444): No heartbeat from core client for 30 sec - exiting 07:24:43 (23444): No heartbeat from core client for 30 sec - exiting 07:24:44 (23444): No heartbeat from core client for 30 sec - exiting 07:45:54 (21424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=23056, selfPID=23056, iMonCtr=2 07:55:02 (22780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:22:10 (23280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:23:05 (26100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=24144, selfPID=24144, iMonCtr=2 11:24:49 (23440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=26180, selfPID=26180, iMonCtr=2 11:26:57 (26364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:34:33 (13972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:01:19 (17368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:38:37 (19868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:34:02 (21532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:34:06 (21532): No heartbeat from core client for 30 sec - exiting 18:34:07 (21532): No heartbeat from core client for 30 sec - exiting 19:46:05 (18320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:46:06 (18320): No heartbeat from core client for 30 sec - exiting 19:46:07 (18320): No heartbeat from core client for 30 sec - exiting 19:46:08 (18320): No heartbeat from core client for 30 sec - exiting 19:46:09 (18320): No heartbeat from core client for 30 sec - exiting 19:46:10 (18320): No heartbeat from core client for 30 sec - exiting 19:46:11 (18320): No heartbeat from core client for 30 sec - exiting 19:46:12 (18320): No heartbeat from core client for 30 sec - exiting 19:46:13 (18320): No heartbeat from core client for 30 sec - exiting 19:46:14 (18320): No heartbeat from core client for 30 sec - exiting 19:46:15 (18320): No heartbeat from core client for 30 sec - exiting 21:34:56 (21524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:58:56 (24320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:32:42 (22488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:23:14 (23972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:02:11 (26720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:53:52 (23612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=20960, selfPID=20960, iMonCtr=2 06:11:48 (27696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=28600, selfPID=28600, iMonCtr=2 07:24:22 (26688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:32:02 (13204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:27:41 (29520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:28:27 (30344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:28:31 (30344): No heartbeat from core client for 30 sec - exiting 09:28:32 (30344): No heartbeat from core client for 30 sec - exiting 09:28:33 (30344): No heartbeat from core client for 30 sec - exiting 10:04:07 (28724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:04:12 (28724): No heartbeat from core client for 30 sec - exiting 10:04:13 (28724): No heartbeat from core client for 30 sec - exiting 10:04:14 (28724): No heartbeat from core client for 30 sec - exiting 10:04:15 (28724): No heartbeat from core client for 30 sec - exiting 10:04:16 (28724): No heartbeat from core client for 30 sec - exiting 10:04:17 (28724): No heartbeat from core client for 30 sec - exiting 10:04:18 (28724): No heartbeat from core client for 30 sec - exiting 10:32:42 (29812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=29604, selfPID=29604, iMonCtr=2 11:06:53 (26128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:14:50 (29804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=31528, selfPID=31528, iMonCtr=2 12:29:49 (31344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:43:34 (32652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:43:37 (32652): No heartbeat from core client for 30 sec - exiting 12:43:38 (32652): No heartbeat from core client for 30 sec - exiting 12:43:39 (32652): No heartbeat from core client for 30 sec - exiting 12:43:40 (32652): No heartbeat from core client for 30 sec - exiting 12:43:41 (32652): No heartbeat from core client for 30 sec - exiting 12:43:42 (32652): No heartbeat from core client for 30 sec - exiting 12:43:43 (32652): No heartbeat from core client for 30 sec - exiting 12:43:44 (32652): No heartbeat from core client for 30 sec - exiting 12:43:45 (32652): No heartbeat from core client for 30 sec - exiting 12:43:46 (32652): No heartbeat from core client for 30 sec - exiting 13:05:39 (32288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=31948, selfPID=31948, iMonCtr=2 13:16:18 (32492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:00:19 (23344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:35:24 (24376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:57:37 (31332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:05:02 (33620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:05:06 (33620): No heartbeat from core client for 30 sec - exiting 16:50:43 (32004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:55:01 (35696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:55:06 (35696): No heartbeat from core client for 30 sec - exiting 17:55:07 (35696): No heartbeat from core client for 30 sec - exiting 17:55:08 (35696): No heartbeat from core client for 30 sec - exiting 17:55:09 (35696): No heartbeat from core client for 30 sec - exiting 17:55:10 (35696): No heartbeat from core client for 30 sec - exiting 17:55:11 (35696): No heartbeat from core client for 30 sec - exiting 17:55:12 (35696): No heartbeat from core client for 30 sec - exiting 17:55:13 (35696): No heartbeat from core client for 30 sec - exiting 17:55:14 (35696): No heartbeat from core client for 30 sec - exiting 17:55:15 (35696): No heartbeat from core client for 30 sec - exiting 18:29:14 (36128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:29:15 (36128): No heartbeat from core client for 30 sec - exiting 18:36:56 (33160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:38:36 (35240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:14:48 (35472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:15:43 (35076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:47:16 (37028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:14:06 (36104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=34968, selfPID=34968, iMonCtr=2 23:44:37 (38180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:21:03 (7712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:21:12 (7712): No heartbeat from core client for 30 sec - exiting 07:21:13 (7712): No heartbeat from core client for 30 sec - exiting 07:23:37 (2120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:38:17 (7724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:39:57 (1764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:41:55 (9664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1984, selfPID=1984, iMonCtr=2 08:03:18 (8820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:06:07 (6652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:12:24 (10504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:46:08 (9780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:26:23 (2840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:26:31 (2840): No heartbeat from core client for 30 sec - exiting 09:26:32 (2840): No heartbeat from core client for 30 sec - exiting 09:26:33 (2840): No heartbeat from core client for 30 sec - exiting 09:26:34 (2840): No heartbeat from core client for 30 sec - exiting 09:26:35 (2840): No heartbeat from core client for 30 sec - exiting 09:26:36 (2840): No heartbeat from core client for 30 sec - exiting 09:26:37 (2840): No heartbeat from core client for 30 sec - exiting 09:26:38 (2840): No heartbeat from core client for 30 sec - exiting 09:30:22 (11172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:53:13 (10352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:53:16 (10352): No heartbeat from core client for 30 sec - exiting 09:53:17 (10352): No heartbeat from core client for 30 sec - exiting 09:53:18 (10352): No heartbeat from core client for 30 sec - exiting 09:53:19 (10352): No heartbeat from core client for 30 sec - exiting 09:53:20 (10352): No heartbeat from core client for 30 sec - exiting 09:53:21 (10352): No heartbeat from core client for 30 sec - exiting 10:10:26 (10248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:51:20 (11328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:59:41 (11756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:53:55 (9908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:20:27 (9932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12964, selfPID=12964, iMonCtr=2 14:33:34 (13932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6812, selfPID=6812, iMonCtr=2 15:27:49 (11536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:05:05 (11136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12060, selfPID=12060, iMonCtr=2 17:18:06 (13608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:18:12 (13608): No heartbeat from core client for 30 sec - exiting 19:09:59 (13484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:50:05 (14760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:19 (14616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14360, selfPID=14360, iMonCtr=2 21:14:25 (15108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:15 (13792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15676, selfPID=15676, iMonCtr=2 21:50:37 (14724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:17:10 (14556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:20:24 (15452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15428, selfPID=15428, iMonCtr=2 23:50:20 (17412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:50:52 (16996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:57:21 (18264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:57:28 (18264): No heartbeat from core client for 30 sec - exiting 03:41:48 (18284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:42:46 (14608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 32 Model crashed: Leaving CPDN_Main::Monitor... zip error: Output file write failure (write error on zip file) Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Aug 2014 09:25:38	1314952	16809939	hadam3p_eu_e5fa_2013_1_008848817_1	126,816	78,761	0.6211
29 Aug 2014 09:25:38	1314952	16809939	hadam3p_eu_e5fa_2013_1_008848817_1	115,296	58,378	0.5063
29 Aug 2014 09:25:38	1314952	16809939	hadam3p_eu_e5fa_2013_1_008848817_1	103,776	37,902	0.3652
29 Aug 2014 09:25:38	1314952	16809939	hadam3p_eu_e5fa_2013_1_008848817_1	92,256	17,732	0.1922
29 Aug 2014 09:25:38	1314952	16809939	hadam3p_eu_e5fa_2013_1_008848817_1	80,761	144,816	1.7931
29 Aug 2014 09:25:38	1314952	16809939	hadam3p_eu_e5fa_2013_1_008848817_1	80,736	144,491	1.7897
29 Aug 2014 09:25:38	1314952	16809939	hadam3p_eu_e5fa_2013_1_008848817_1	69,216	124,063	1.7924
29 Aug 2014 09:25:38	1314952	16809939	hadam3p_eu_e5fa_2013_1_008848817_1	57,696	103,406	1.7923
29 Aug 2014 09:25:38	1314952	16809939	hadam3p_eu_e5fa_2013_1_008848817_1	46,176	82,662	1.7902
29 Aug 2014 09:25:38	1314952	16809939	hadam3p_eu_e5fa_2013_1_008848817_1	34,656	61,845	1.7845
29 Aug 2014 09:25:38	1314952	16809939	hadam3p_eu_e5fa_2013_1_008848817_1	23,136	41,213	1.7813
29 Aug 2014 09:25:38	1314952	16809939	hadam3p_eu_e5fa_2013_1_008848817_1	11,616	20,658	1.7784