Task 14798790

Name	hadam3p_pnw_at1q_1990_1_008001891_0
Workunit	8157005
Created	19 Jun 2012, 13:45:59 UTC
Sent	19 Jun 2012, 13:46:14 UTC
Report deadline	1 Jun 2013, 19:06:14 UTC
Received	14 Jul 2012, 8:52:12 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1221854
Run time	3 days 19 hours 1 min 41 sec
CPU time	3 days 9 hours 26 min 48 sec
Validate state	Invalid
Credit	2,255.93
Device peak FLOPS	3.27 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 i686-apple-darwin
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:00:03 (96665): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:01:53 (25064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:03:05 (25811): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:14:09 (26868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:07:12 (57807): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:07:50 (58846): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:08:21 (59916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:23:25 (61023): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:23:32 (61023): No heartbeat from core client for 30 sec - exiting 04:14:25 (63424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:46:54 (73477): No heartbeat from core client for 30 sec - exiting 09:46:55 (73477): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:08:21 (26181): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:20:54 (36900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:09:32 (39767): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:09:33 (42191): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:09:43 (42191): No heartbeat from core client for 30 sec - exiting 23:09:21 (43247): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:42:11 (45871): No heartbeat from core client for 30 sec - exiting 23:42:12 (45871): No heartbeat from core client for 30 sec - exiting 23:42:13 (45871): No heartbeat from core client for 30 sec - exiting 23:42:14 (45871): No heartbeat from core client for 30 sec - exiting 23:42:15 (45871): No heartbeat from core client for 30 sec - exiting 23:42:16 (45871): No heartbeat from core client for 30 sec - exiting 23:42:18 (45871): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:08:29 (46682): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:37:49 (47301): No heartbeat from core client for 30 sec - exiting 00:37:51 (47301): No heartbeat from core client for 30 sec - exiting 00:37:52 (47301): No heartbeat from core client for 30 sec - exiting 00:37:53 (47301): No heartbeat from core client for 30 sec - exiting 00:37:54 (47301): No heartbeat from core client for 30 sec - exiting 00:37:55 (47301): No heartbeat from core client for 30 sec - exiting 00:37:56 (47301): No heartbeat from core client for 30 sec - exiting 00:37:57 (47301): No heartbeat from core client for 30 sec - exiting 00:37:58 (47301): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:56:00 (47681): No heartbeat from core client for 30 sec - exiting 00:56:02 (47681): No heartbeat from core client for 30 sec - exiting 00:56:03 (47681): No heartbeat from core client for 30 sec - exiting 00:56:05 (47681): No heartbeat from core client for 30 sec - exiting 00:56:06 (47681): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:56:07 (47681): No heartbeat from core client for 30 sec - exiting 00:56:08 (47681): No heartbeat from core client for 30 sec - exiting 00:56:09 (47681): No heartbeat from core client for 30 sec - exiting 00:56:10 (47681): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 01:17:59 (48528): No heartbeat from core client for 30 sec - exiting 01:18:01 (48528): No heartbeat from core client for 30 sec - exiting 01:18:02 (48528): No heartbeat from core client for 30 sec - exiting 01:18:03 (48528): No heartbeat from core client for 30 sec - exiting 01:18:04 (48528): No heartbeat from core client for 30 sec - exiting 01:18:05 (48528): No heartbeat from core client for 30 sec - exiting 01:18:06 (48528): No heartbeat from core client for 30 sec - exiting 01:18:07 (48528): No heartbeat from core client for 30 sec - exiting 01:18:08 (48528): No heartbeat from core client for 30 sec - exiting 01:18:09 (48528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 02:07:48 (48931): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:11:24 (49733): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:09:24 (50803): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:12:57 (16150): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:13:10 (17749): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:13:08 (18803): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:12:38 (19872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:11:25 (20913): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:25:13 (30639): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:06:38 (30664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:01:01 (7318): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:17:32 (17713): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:16:22 (46213): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:17:38 (73734): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:24:24 (77340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:16:50 (77376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:00:18 (9890): No heartbeat from core client for 30 sec - exiting 11:00:19 (9890): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:30:56 (20317): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:17:17 (64802): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:09:00 (79657): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:20:43 (19933): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:19:43 (20570): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:40:20 (22713): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:50:25 (24652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:18:16 (30747): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:50:59 (40511): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:54:08 (6770): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:52:11 (15480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:57:11 (15800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:03:58 (42823): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:00:35 (66116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:01:36 (77062): No heartbeat from core client for 30 sec - exiting 17:02:30 (77062): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... cpdnmonitor: error reading file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadam3p_pnw_at1q_1990_1_008001891/dataout/atmos_restart.day 20:06:37 (81574): No heartbeat from core client for 30 sec - exiting 20:06:38 (81574): No heartbeat from core client for 30 sec - exiting 20:06:39 (81574): No heartbeat from core client for 30 sec - exiting 20:06:40 (81574): No heartbeat from core client for 30 sec - exiting 20:06:41 (81574): No heartbeat from core client for 30 sec - exiting 20:06:42 (81574): No heartbeat from core client for 30 sec - exiting 20:06:43 (81574): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... cpdnmonitor: error reading file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadam3p_pnw_at1q_1990_1_008001891/dataout/atmos_restart.day 20:37:35 (81921): No heartbeat from core client for 30 sec - exiting 20:37:37 (81921): No heartbeat from core client for 30 sec - exiting 20:37:38 (81921): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... cpdnmonitor: error reading file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadam3p_pnw_at1q_1990_1_008001891/dataout/atmos_restart.day BUFFIN: Read Failed: Input/output error BUFFIN: C I/O Error ferror - Unit 21 - Return code = 1 Model crashed: READHEAD: I/O error tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_at1q_1990_1_008001891_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_at1q_1990_1_008001891_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_at1q_1990_1_008001891_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Jul 2012 01:08:32	1221854	14798790	hadam3p_pnw_at1q_1990_1_008001891_0	103,822	294,157	2.8333
14 Jul 2012 00:03:19	1221854	14798790	hadam3p_pnw_at1q_1990_1_008001891_0	103,776	293,634	2.8295
13 Jul 2012 08:29:27	1221854	14798790	hadam3p_pnw_at1q_1990_1_008001891_0	92,256	262,563	2.8460
12 Jul 2012 20:31:35	1221854	14798790	hadam3p_pnw_at1q_1990_1_008001891_0	80,736	232,427	2.8789
11 Jul 2012 11:19:16	1221854	14798790	hadam3p_pnw_at1q_1990_1_008001891_0	69,216	201,323	2.9086
06 Jul 2012 07:18:56	1221854	14798790	hadam3p_pnw_at1q_1990_1_008001891_0	57,696	169,197	2.9326
03 Jul 2012 12:33:44	1221854	14798790	hadam3p_pnw_at1q_1990_1_008001891_0	46,176	136,323	2.9522
30 Jun 2012 11:13:55	1221854	14798790	hadam3p_pnw_at1q_1990_1_008001891_0	34,656	101,839	2.9386
29 Jun 2012 02:27:37	1221854	14798790	hadam3p_pnw_at1q_1990_1_008001891_0	23,136	68,575	2.9640
22 Jun 2012 10:33:47	1221854	14798790	hadam3p_pnw_at1q_1990_1_008001891_0	11,616	35,375	3.0454