Task 16606633

Name	hadam3pm2_e8bl_1991_10_008713828_1
Workunit	8860302
Created	1 May 2014, 21:41:56 UTC
Sent	2 May 2014, 3:12:21 UTC
Report deadline	14 Apr 2015, 8:32:21 UTC
Received	24 May 2014, 3:51:58 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1157390
Run time	19 days 23 hours 25 min 37 sec
CPU time	19 days 13 hours 15 min 1 sec
Validate state	Invalid
Credit	8,484.28
Device peak FLOPS	1.68 GFLOPS
Application version	UK Met Office HadAM3P (global only) with MOSES II landsurface scheme v7.03 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.27</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... oa.pc\|1dec.nc oa.pc\|2jan.nc oa.pc\|2feb.nc oa.pc\|2mar.nc oa.pc\|2apr.nc oa.pc\|2may.nc oa.pc\|2jun.nc oa.pc\|2jul.nc oa.pc\|2aug.nc oa.pc\|2sep.nc oa.pc\|2oct.nc oa.pc\|2nov.nc oa.pe\|1dec.nc oa.pe\|2jan.nc oa.pe\|2feb.nc oa.pe\|2mar.nc oa.pe\|2apr.nc oa.pe\|2may.nc oa.pe\|2jun.nc oa.pe\|2jul.nc oa.pe\|2aug.nc oa.pe\|2sep.nc oa.pe\|2oct.nc oa.pe\|2nov.nc Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:58:15 (21055): No heartbeat from client for 30 sec - exiting 18:58:15 (21055): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:53:25 (28153): No heartbeat from client for 30 sec - exiting 21:53:25 (28153): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:10:00 (28415): No heartbeat from client for 30 sec - exiting 17:10:00 (28415): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:11:12 (1434): No heartbeat from client for 30 sec - exiting 17:11:12 (1434): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:14:17 (1490): No heartbeat from client for 30 sec - exiting 17:14:17 (1490): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... oa.pc\|4dec.nc oa.pc\|5jan.nc oa.pc\|5feb.nc oa.pc\|5mar.nc oa.pc\|5apr.nc oa.pc\|5may.nc oa.pc\|5jun.nc oa.pc\|5jul.nc oa.pc\|5aug.nc oa.pc\|5sep.nc oa.pc\|5oct.nc oa.pc\|5nov.nc oa.pe\|4dec.nc oa.pe\|5jan.nc oa.pe\|5feb.nc oa.pe\|5mar.nc oa.pe\|5apr.nc oa.pe\|5may.nc oa.pe\|5jun.nc oa.pe\|5jul.nc oa.pe\|5aug.nc oa.pe\|5sep.nc oa.pe\|5oct.nc oa.pe\|5nov.nc CPDN Monitor - Quit request from BOINC... 20:35:49 (3839): No heartbeat from client for 30 sec - exiting 20:35:49 (3839): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:42:59 (13851): No heartbeat from client for 30 sec - exiting 20:42:59 (13851): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:44:07 (13906): No heartbeat from client for 30 sec - exiting 20:44:07 (13906): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:49:13 (13960): No heartbeat from client for 30 sec - exiting 15:49:13 (13960): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... oa.pc\|8dec.nc oa.pc\|9jan.nc oa.pc\|9feb.nc oa.pc\|9mar.nc oa.pc\|9apr.nc oa.pc\|9may.nc oa.pc\|9jun.nc oa.pc\|9jul.nc oa.pc\|9aug.nc oa.pc\|9sep.nc oa.pc\|9oct.nc oa.pc\|9nov.nc oa.pe\|8dec.nc oa.pe\|9jan.nc oa.pe\|9feb.nc oa.pe\|9mar.nc oa.pe\|9apr.nc oa.pe\|9may.nc oa.pe\|9jun.nc oa.pe\|9jul.nc oa.pe\|9aug.nc oa.pe\|9sep.nc oa.pe\|9oct.nc oa.pe\|9nov.nc 14:14:52 (16402): No heartbeat from client for 30 sec - exiting 14:14:52 (16402): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:12:54 (28307): No heartbeat from client for 30 sec - exiting 17:12:54 (28307): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:12:19 (32019): No heartbeat from client for 30 sec - exiting 09:12:19 (32019): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:16:15 (2032): No heartbeat from client for 30 sec - exiting 09:16:15 (2032): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:21:56 (2082): No heartbeat from client for 30 sec - exiting 11:21:56 (2082): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:54:23 (2464): No heartbeat from client for 30 sec - exiting 14:54:23 (2464): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:54:24 (2464): No heartbeat from client for 30 sec - exiting 14:54:24 (2464): timer handler: client dead, exiting 14:54:25 (2464): No heartbeat from client for 30 sec - exiting 14:54:25 (2464): timer handler: client dead, exiting Model crashed: æM Model crashed: æM Model crashed: æM Model crashed: æM Model crashed: æM Model crashed: æM Sorry, too many model crashes! :-( 22:14:26 (2928): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 May 2014 20:27:56	1157390	16606633	hadam3pm2_e8bl_1991_10_008713828_1	293,828	1,609,476	5.4776
22 May 2014 16:20:47	1157390	16606633	hadam3pm2_e8bl_1991_10_008713828_1	290,948	1,594,437	5.4801
22 May 2014 11:55:45	1157390	16606633	hadam3pm2_e8bl_1991_10_008713828_1	288,068	1,579,423	5.4828
22 May 2014 07:34:50	1157390	16606633	hadam3pm2_e8bl_1991_10_008713828_1	285,188	1,563,635	5.4828
22 May 2014 03:14:01	1157390	16606633	hadam3pm2_e8bl_1991_10_008713828_1	282,308	1,548,327	5.4845
21 May 2014 23:01:23	1157390	16606633	hadam3pm2_e8bl_1991_10_008713828_1	279,428	1,533,063	5.4864
21 May 2014 13:42:45	1157390	16606633	hadam3pm2_e8bl_1991_10_008713828_1	273,668	1,501,763	5.4875
21 May 2014 09:26:13	1157390	16606633	hadam3pm2_e8bl_1991_10_008713828_1	270,788	1,485,456	5.4857
21 May 2014 04:50:05	1157390	16606633	hadam3pm2_e8bl_1991_10_008713828_1	267,908	1,468,615	5.4818
20 May 2014 23:48:47	1157390	16606633	hadam3pm2_e8bl_1991_10_008713828_1	265,028	1,452,144	5.4792
20 May 2014 20:05:32	1157390	16606633	hadam3pm2_e8bl_1991_10_008713828_1	262,148	1,435,878	5.4774
20 May 2014 14:41:35	1157390	16606633	hadam3pm2_e8bl_1991_10_008713828_1	259,268	1,419,750	5.4760
20 May 2014 10:17:13	1157390	16606633	hadam3pm2_e8bl_1991_10_008713828_1	256,388	1,403,076	5.4725
20 May 2014 06:11:16	1157390	16606633	hadam3pm2_e8bl_1991_10_008713828_1	253,508	1,386,413	5.4689
20 May 2014 01:10:02	1157390	16606633	hadam3pm2_e8bl_1991_10_008713828_1	250,628	1,369,940	5.4660
19 May 2014 20:58:53	1157390	16606633	hadam3pm2_e8bl_1991_10_008713828_1	247,748	1,353,550	5.4634
19 May 2014 15:55:25	1157390	16606633	hadam3pm2_e8bl_1991_10_008713828_1	244,868	1,337,393	5.4617
17 May 2014 17:50:25	1157390	16606633	hadam3pm2_e8bl_1991_10_008713828_1	216,068	1,175,772	5.4417
17 May 2014 13:25:25	1157390	16606633	hadam3pm2_e8bl_1991_10_008713828_1	213,188	1,160,959	5.4457
17 May 2014 09:24:05	1157390	16606633	hadam3pm2_e8bl_1991_10_008713828_1	210,308	1,146,451	5.4513