Task 17953877

Name	hadam3pm2_pegk_1991_10_009529037_0
Workunit	9610780
Created	13 Feb 2015, 16:48:25 UTC
Sent	20 Feb 2015, 21:29:30 UTC
Report deadline	3 Feb 2016, 2:49:30 UTC
Received	14 Mar 2015, 0:34:29 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1157390
Run time	20 days 17 hours 54 min 43 sec
CPU time	16 days 23 hours 11 min 42 sec
Validate state	Invalid
Credit	8,900.08
Device peak FLOPS	1.71 GFLOPS
Application version	UK Met Office HadAM3P (global only) with MOSES II landsurface scheme v7.03 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.27</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 06:12:19 (31549): No heartbeat from client for 30 sec - exiting 06:12:19 (31549): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:02:18 (3872): No heartbeat from client for 30 sec - exiting 03:02:18 (3872): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... oa.pc\|3dec.nc oa.pc\|4jan.nc oa.pc\|4feb.nc oa.pc\|4mar.nc oa.pc\|4apr.nc oa.pc\|4may.nc oa.pc\|4jun.nc oa.pc\|4jul.nc oa.pc\|4aug.nc oa.pc\|4sep.nc oa.pc\|4oct.nc oa.pc\|4nov.nc oa.pe\|3dec.nc oa.pe\|4jan.nc oa.pe\|4feb.nc oa.pe\|4mar.nc oa.pe\|4apr.nc oa.pe\|4may.nc oa.pe\|4jun.nc oa.pe\|4jul.nc oa.pe\|4aug.nc oa.pe\|4sep.nc oa.pe\|4oct.nc oa.pe\|4nov.nc oa.pc\|4dec.nc oa.pc\|5jan.nc oa.pc\|5feb.nc oa.pc\|5mar.nc oa.pc\|5apr.nc oa.pc\|5may.nc oa.pc\|5jun.nc oa.pc\|5jul.nc oa.pc\|5aug.nc oa.pc\|5sep.nc oa.pc\|5oct.nc oa.pc\|5nov.nc oa.pe\|4dec.nc oa.pe\|5jan.nc oa.pe\|5feb.nc oa.pe\|5mar.nc oa.pe\|5apr.nc oa.pe\|5may.nc oa.pe\|5jun.nc oa.pe\|5jul.nc oa.pe\|5aug.nc oa.pe\|5sep.nc oa.pe\|5oct.nc oa.pe\|5nov.nc 17:48:56 (5342): No heartbeat from client for 30 sec - exiting 17:48:56 (5342): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:25:02 (23048): No heartbeat from client for 30 sec - exiting 18:25:02 (23048): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:25:40 (25333): No heartbeat from client for 30 sec - exiting 18:25:40 (25333): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... oa.pc\|6dec.nc oa.pc\|7jan.nc oa.pc\|7feb.nc oa.pc\|7mar.nc oa.pc\|7apr.nc oa.pc\|7may.nc oa.pc\|7jun.nc oa.pc\|7jul.nc oa.pc\|7aug.nc oa.pc\|7sep.nc oa.pc\|7oct.nc oa.pc\|7nov.nc oa.pe\|6dec.nc oa.pe\|7jan.nc oa.pe\|7feb.nc oa.pe\|7mar.nc oa.pe\|7apr.nc oa.pe\|7may.nc oa.pe\|7jun.nc oa.pe\|7jul.nc oa.pe\|7aug.nc oa.pe\|7sep.nc oa.pe\|7oct.nc oa.pe\|7nov.nc 17:29:02 (25388): No heartbeat from client for 30 sec - exiting 17:29:02 (25388): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:30:50 (2404): No heartbeat from client for 30 sec - exiting 17:30:50 (2404): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:32:34 (2454): No heartbeat from client for 30 sec - exiting 17:32:34 (2454): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:33:51 (2498): No heartbeat from client for 30 sec - exiting 17:33:51 (2498): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:35:25 (2550): No heartbeat from client for 30 sec - exiting 17:35:25 (2550): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:36:25 (2596): No heartbeat from client for 30 sec - exiting 17:36:25 (2596): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:38:40 (2644): No heartbeat from client for 30 sec - exiting 17:38:40 (2644): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:40:23 (2696): No heartbeat from client for 30 sec - exiting 17:40:23 (2696): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:41:40 (2747): No heartbeat from client for 30 sec - exiting 17:41:40 (2747): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:43:49 (2797): No heartbeat from client for 30 sec - exiting 17:43:49 (2797): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:52:33 (2846): No heartbeat from client for 30 sec - exiting 18:52:33 (2846): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:53:45 (7804): No heartbeat from client for 30 sec - exiting 18:53:45 (7804): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:29:18 (7854): No heartbeat from client for 30 sec - exiting 02:29:18 (7854): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:30:16 (8637): No heartbeat from client for 30 sec - exiting 02:30:16 (8637): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:32:08 (8687): No heartbeat from client for 30 sec - exiting 02:32:08 (8687): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:33:04 (8739): No heartbeat from client for 30 sec - exiting 02:33:04 (8739): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:33:56 (8785): No heartbeat from client for 30 sec - exiting 02:33:56 (8785): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... oa.pc\|9dec.nc oa.pc\|0jan.nc oa.pc\|0feb.nc oa.pc\|0mar.nc oa.pc\|0apr.nc oa.pc\|0may.nc oa.pc\|0jun.nc oa.pc\|0jul.nc oa.pc\|0aug.nc oa.pc\|0sep.nc oa.pc\|0oct.nc oa.pc\|0nov.nc oa.pe\|9dec.nc oa.pe\|0jan.nc oa.pe\|0feb.nc oa.pe\|0mar.nc oa.pe\|0apr.nc oa.pe\|0may.nc oa.pe\|0jun.nc oa.pe\|0jul.nc oa.pe\|0aug.nc oa.pe\|0sep.nc oa.pe\|0oct.nc oa.pe\|0nov.nc Model crashed: æM Model crashed: § Model crashed: § Model crashed: § Model crashed: § Model crashed: § Sorry, too many model crashes! :-( 18:55:31 (8836): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Mar 2015 16:18:59	1157390	17953877	hadam3pm2_pegk_1991_10_009529037_0	308,228	1,751,240	5.6816
13 Mar 2015 12:02:03	1157390	17953877	hadam3pm2_pegk_1991_10_009529037_0	305,348	1,735,607	5.6840
13 Mar 2015 06:59:11	1157390	17953877	hadam3pm2_pegk_1991_10_009529037_0	302,468	1,719,954	5.6864
13 Mar 2015 02:53:41	1157390	17953877	hadam3pm2_pegk_1991_10_009529037_0	299,588	1,704,387	5.6891
12 Mar 2015 22:41:24	1157390	17953877	hadam3pm2_pegk_1991_10_009529037_0	296,708	1,688,762	5.6917
12 Mar 2015 18:30:08	1157390	17953877	hadam3pm2_pegk_1991_10_009529037_0	293,828	1,673,198	5.6945
12 Mar 2015 13:23:22	1157390	17953877	hadam3pm2_pegk_1991_10_009529037_0	290,948	1,657,608	5.6973
12 Mar 2015 09:18:21	1157390	17953877	hadam3pm2_pegk_1991_10_009529037_0	288,068	1,642,110	5.7004
12 Mar 2015 05:14:47	1157390	17953877	hadam3pm2_pegk_1991_10_009529037_0	285,188	1,626,437	5.7030
12 Mar 2015 01:12:30	1157390	17953877	hadam3pm2_pegk_1991_10_009529037_0	282,308	1,610,987	5.7065
11 Mar 2015 20:55:53	1157390	17953877	hadam3pm2_pegk_1991_10_009529037_0	279,428	1,595,566	5.7101
10 Mar 2015 16:33:18	1157390	17953877	hadam3pm2_pegk_1991_10_009529037_0	250,628	1,437,940	5.7373
10 Mar 2015 16:32:47	1157390	17953877	hadam3pm2_pegk_1991_10_009529037_0	247,748	1,420,061	5.7319
10 Mar 2015 16:32:23	1157390	17953877	hadam3pm2_pegk_1991_10_009529037_0	244,868	1,402,935	5.7294
10 Mar 2015 16:27:54	1157390	17953877	hadam3pm2_pegk_1991_10_009529037_0	218,948	1,255,017	5.7320
10 Mar 2015 16:27:15	1157390	17953877	hadam3pm2_pegk_1991_10_009529037_0	216,068	1,239,420	5.7362
10 Mar 2015 16:26:39	1157390	17953877	hadam3pm2_pegk_1991_10_009529037_0	213,188	1,223,821	5.7406
10 Mar 2015 16:26:04	1157390	17953877	hadam3pm2_pegk_1991_10_009529037_0	210,308	1,208,296	5.7454
10 Mar 2015 16:23:57	1157390	17953877	hadam3pm2_pegk_1991_10_009529037_0	204,548	1,177,212	5.7552
10 Mar 2015 16:23:09	1157390	17953877	hadam3pm2_pegk_1991_10_009529037_0	201,668	1,161,598	5.7600