Task 16573455

Name	hadam3pm2_e92o_1991_10_008714803_0
Workunit	8861277
Created	19 Apr 2014, 9:30:09 UTC
Sent	21 Apr 2014, 7:19:42 UTC
Report deadline	3 Apr 2015, 12:39:42 UTC
Received	19 May 2014, 11:13:22 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	861060
Run time	10 days 13 hours 42 min 47 sec
CPU time	9 days 15 hours 18 min 31 sec
Validate state	Invalid
Credit	8,317.96
Device peak FLOPS	2.63 GFLOPS
Application version	UK Met Office HadAM3P (global only) with MOSES II landsurface scheme v7.03 i686-pc-linux-gnu
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> 08:02:27 (9850): No heartbeat from client for 30 sec - exiting 08:02:27 (9850): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:07:19 (9883): No heartbeat from client for 30 sec - exiting 08:07:19 (9883): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:15:13 (10276): No heartbeat from client for 30 sec - exiting 08:15:14 (10276): timer handler: client dead, exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 08:15:15 (10276): No heartbeat from client for 30 sec - exiting 08:15:15 (10276): timer handler: client dead, exiting 08:15:16 (10276): No heartbeat from client for 30 sec - exiting 08:15:16 (10276): timer handler: client dead, exiting Suspended CPDN Monitor - Suspend request from BOINC... 03:58:04 (31108): No heartbeat from client for 30 sec - exiting 03:58:04 (31108): timer handler: client dead, exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:59:36 (24738): No heartbeat from client for 30 sec - exiting 07:59:36 (24738): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:16:56 (26985): No heartbeat from client for 30 sec - exiting 08:16:56 (26985): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:19:20 (27036): No heartbeat from client for 30 sec - exiting 08:19:20 (27036): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:22:01 (27184): No heartbeat from client for 30 sec - exiting 08:22:01 (27184): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:14:06 (27219): No heartbeat from client for 30 sec - exiting 08:14:06 (27219): timer handler: client dead, exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:36:33 (1183): No heartbeat from client for 30 sec - exiting 08:36:33 (1183): timer handler: client dead, exiting 08:36:34 (1183): No heartbeat from client for 30 sec - exiting 08:36:34 (1183): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:37:15 (1211): No heartbeat from client for 30 sec - exiting 08:37:15 (1211): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:38:37 (1321): No heartbeat from client for 30 sec - exiting 08:38:37 (1321): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:39:26 (1351): No heartbeat from client for 30 sec - exiting 08:39:26 (1351): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: æM Model crashed: æM Model crashed: æM Model crashed: æM Model crashed: æM Model crashed: æM Sorry, too many model crashes! :-( 05:21:04 (26220): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 May 2014 13:27:59	861060	16573455	hadam3pm2_e92o_1991_10_008714803_0	288,068	833,883	2.8947
18 May 2014 11:02:11	861060	16573455	hadam3pm2_e92o_1991_10_008714803_0	285,188	825,705	2.8953
18 May 2014 08:51:34	861060	16573455	hadam3pm2_e92o_1991_10_008714803_0	282,308	818,371	2.8989
18 May 2014 06:49:06	861060	16573455	hadam3pm2_e92o_1991_10_008714803_0	279,428	811,049	2.9025
17 May 2014 12:45:05	861060	16573455	hadam3pm2_e92o_1991_10_008714803_0	256,388	746,471	2.9115
17 May 2014 08:58:57	861060	16573455	hadam3pm2_e92o_1991_10_008714803_0	253,508	738,984	2.9150
17 May 2014 07:01:19	861060	16573455	hadam3pm2_e92o_1991_10_008714803_0	250,628	732,169	2.9213
17 May 2014 05:10:46	861060	16573455	hadam3pm2_e92o_1991_10_008714803_0	247,748	725,387	2.9279
17 May 2014 03:50:27	861060	16573455	hadam3pm2_e92o_1991_10_008714803_0	244,868	718,533	2.9344
16 May 2014 13:08:18	861060	16573455	hadam3pm2_e92o_1991_10_008714803_0	227,588	666,494	2.9285
16 May 2014 09:42:08	861060	16573455	hadam3pm2_e92o_1991_10_008714803_0	224,708	657,790	2.9273
16 May 2014 07:04:53	861060	16573455	hadam3pm2_e92o_1991_10_008714803_0	221,828	648,276	2.9224
16 May 2014 04:39:18	861060	16573455	hadam3pm2_e92o_1991_10_008714803_0	218,948	639,585	2.9212
16 May 2014 02:13:42	861060	16573455	hadam3pm2_e92o_1991_10_008714803_0	216,068	631,023	2.9205
15 May 2014 23:53:02	861060	16573455	hadam3pm2_e92o_1991_10_008714803_0	213,188	622,732	2.9210
15 May 2014 21:42:13	861060	16573455	hadam3pm2_e92o_1991_10_008714803_0	210,308	614,756	2.9231
15 May 2014 11:40:48	861060	16573455	hadam3pm2_e92o_1991_10_008714803_0	198,788	579,257	2.9139
15 May 2014 09:25:15	861060	16573455	hadam3pm2_e92o_1991_10_008714803_0	195,908	571,759	2.9185
15 May 2014 07:03:11	861060	16573455	hadam3pm2_e92o_1991_10_008714803_0	193,028	563,293	2.9182
15 May 2014 04:27:38	861060	16573455	hadam3pm2_e92o_1991_10_008714803_0	190,148	554,130	2.9142