Task 16572457

Name	hadam3pm2_e8b5_1991_10_008713812_0
Workunit	8860286
Created	19 Apr 2014, 9:22:03 UTC
Sent	1 May 2014, 15:48:37 UTC
Report deadline	13 Apr 2015, 21:08:37 UTC
Received	22 May 2014, 15:17:41 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1157390
Run time	19 days 21 hours 21 min 11 sec
CPU time	18 days 23 hours 24 min 40 sec
Validate state	Invalid
Credit	8,650.60
Device peak FLOPS	1.72 GFLOPS
Application version	UK Met Office HadAM3P (global only) with MOSES II landsurface scheme v7.03 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.27</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 21:18:39 (19307): No heartbeat from client for 30 sec - exiting 21:18:39 (19307): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:01:54 (20518): No heartbeat from client for 30 sec - exiting 22:01:54 (20518): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:01:55 (20518): No heartbeat from client for 30 sec - exiting 22:01:55 (20518): timer handler: client dead, exiting 22:01:56 (20518): No heartbeat from client for 30 sec - exiting 22:01:56 (20518): timer handler: client dead, exiting 22:01:57 (20518): No heartbeat from client for 30 sec - exiting 22:01:57 (20518): timer handler: client dead, exiting 22:01:58 (20518): No heartbeat from client for 30 sec - exiting 22:01:58 (20518): timer handler: client dead, exiting 22:01:59 (20518): No heartbeat from client for 30 sec - exiting 22:01:59 (20518): timer handler: client dead, exiting 22:02:00 (20518): No heartbeat from client for 30 sec - exiting 22:02:00 (20518): timer handler: client dead, exiting 22:02:01 (20518): No heartbeat from client for 30 sec - exiting 22:02:01 (20518): timer handler: client dead, exiting 22:02:02 (20518): No heartbeat from client for 30 sec - exiting 22:02:02 (20518): timer handler: client dead, exiting 22:02:03 (20518): No heartbeat from client for 30 sec - exiting 22:02:03 (20518): timer handler: client dead, exiting 22:02:04 (20518): No heartbeat from client for 30 sec - exiting 22:02:04 (20518): timer handler: client dead, exiting 22:02:05 (20518): No heartbeat from client for 30 sec - exiting 22:02:05 (20518): timer handler: client dead, exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:58:15 (20631): No heartbeat from client for 30 sec - exiting 18:58:15 (20631): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:53:25 (28176): No heartbeat from client for 30 sec - exiting 21:53:25 (28176): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... oa.pc\|3dec.nc oa.pc\|4jan.nc oa.pc\|4feb.nc oa.pc\|4mar.nc oa.pc\|4apr.nc oa.pc\|4may.nc oa.pc\|4jun.nc oa.pc\|4jul.nc oa.pc\|4aug.nc oa.pc\|4sep.nc oa.pc\|4oct.nc oa.pc\|4nov.nc oa.pe\|3dec.nc oa.pe\|4jan.nc oa.pe\|4feb.nc oa.pe\|4mar.nc oa.pe\|4apr.nc oa.pe\|4may.nc oa.pe\|4jun.nc oa.pe\|4jul.nc oa.pe\|4aug.nc oa.pe\|4sep.nc oa.pe\|4oct.nc oa.pe\|4nov.nc 17:10:00 (28423): No heartbeat from client for 30 sec - exiting 17:10:00 (28423): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:11:12 (1442): No heartbeat from client for 30 sec - exiting 17:11:12 (1442): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:14:18 (1498): No heartbeat from client for 30 sec - exiting 17:14:18 (1498): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... oa.pc\|5dec.nc oa.pc\|6jan.nc oa.pc\|6feb.nc oa.pc\|6mar.nc oa.pc\|6apr.nc oa.pc\|6may.nc oa.pc\|6jun.nc oa.pc\|6jul.nc oa.pc\|6aug.nc oa.pc\|6sep.nc oa.pc\|6oct.nc oa.pc\|6nov.nc oa.pe\|5dec.nc oa.pe\|6jan.nc oa.pe\|6feb.nc oa.pe\|6mar.nc oa.pe\|6apr.nc oa.pe\|6may.nc oa.pe\|6jun.nc oa.pe\|6jul.nc oa.pe\|6aug.nc oa.pe\|6sep.nc oa.pe\|6oct.nc oa.pe\|6nov.nc CPDN Monitor - Quit request from BOINC... 20:35:49 (3832): No heartbeat from client for 30 sec - exiting 20:35:49 (3832): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:42:59 (13837): No heartbeat from client for 30 sec - exiting 20:42:59 (13837): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:44:07 (13892): No heartbeat from client for 30 sec - exiting 20:44:07 (13892): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:49:13 (13946): No heartbeat from client for 30 sec - exiting 15:49:13 (13946): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... oa.pc\|8dec.nc oa.pc\|9jan.nc oa.pc\|9feb.nc oa.pc\|9mar.nc oa.pc\|9apr.nc oa.pc\|9may.nc oa.pc\|9jun.nc oa.pc\|9jul.nc oa.pc\|9aug.nc oa.pc\|9sep.nc oa.pc\|9oct.nc oa.pc\|9nov.nc oa.pe\|8dec.nc oa.pe\|9jan.nc oa.pe\|9feb.nc oa.pe\|9mar.nc oa.pe\|9apr.nc oa.pe\|9may.nc oa.pe\|9jun.nc oa.pe\|9jul.nc oa.pe\|9aug.nc oa.pe\|9sep.nc oa.pe\|9oct.nc oa.pe\|9nov.nc 14:14:51 (16416): No heartbeat from client for 30 sec - exiting 14:14:51 (16416): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: æM Model crashed: æM Model crashed: æM Model crashed: æM Model crashed: æM Model crashed: æM Sorry, too many model crashes! :-( 09:26:39 (28323): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 May 2014 15:46:58	1157390	16572457	hadam3pm2_e8b5_1991_10_008713812_0	299,588	1,627,172	5.4314
21 May 2014 11:41:43	1157390	16572457	hadam3pm2_e8b5_1991_10_008713812_0	296,708	1,610,519	5.4280
21 May 2014 06:20:31	1157390	16572457	hadam3pm2_e8b5_1991_10_008713812_0	293,828	1,594,447	5.4265
21 May 2014 01:49:22	1157390	16572457	hadam3pm2_e8b5_1991_10_008713812_0	290,948	1,577,810	5.4230
20 May 2014 21:05:53	1157390	16572457	hadam3pm2_e8b5_1991_10_008713812_0	288,068	1,561,355	5.4201
20 May 2014 16:33:28	1157390	16572457	hadam3pm2_e8b5_1991_10_008713812_0	285,188	1,544,935	5.4173
20 May 2014 12:15:18	1157390	16572457	hadam3pm2_e8b5_1991_10_008713812_0	282,308	1,528,266	5.4135
20 May 2014 08:16:46	1157390	16572457	hadam3pm2_e8b5_1991_10_008713812_0	279,428	1,512,128	5.4115
19 May 2014 22:04:14	1157390	16572457	hadam3pm2_e8b5_1991_10_008713812_0	273,668	1,478,941	5.4041
19 May 2014 17:27:06	1157390	16572457	hadam3pm2_e8b5_1991_10_008713812_0	270,788	1,462,302	5.4002
19 May 2014 12:49:38	1157390	16572457	hadam3pm2_e8b5_1991_10_008713812_0	267,908	1,445,669	5.3961
19 May 2014 08:13:22	1157390	16572457	hadam3pm2_e8b5_1991_10_008713812_0	265,028	1,429,108	5.3923
19 May 2014 03:57:20	1157390	16572457	hadam3pm2_e8b5_1991_10_008713812_0	262,148	1,412,739	5.3891
18 May 2014 23:51:11	1157390	16572457	hadam3pm2_e8b5_1991_10_008713812_0	259,268	1,396,452	5.3861
18 May 2014 18:33:50	1157390	16572457	hadam3pm2_e8b5_1991_10_008713812_0	256,388	1,380,336	5.3838
18 May 2014 14:19:59	1157390	16572457	hadam3pm2_e8b5_1991_10_008713812_0	253,508	1,364,032	5.3806
18 May 2014 09:26:46	1157390	16572457	hadam3pm2_e8b5_1991_10_008713812_0	250,628	1,347,783	5.3776
18 May 2014 04:58:42	1157390	16572457	hadam3pm2_e8b5_1991_10_008713812_0	247,748	1,331,751	5.3754
18 May 2014 00:27:40	1157390	16572457	hadam3pm2_e8b5_1991_10_008713812_0	244,868	1,315,432	5.3720
16 May 2014 22:20:02	1157390	16572457	hadam3pm2_e8b5_1991_10_008713812_0	227,588	1,224,068	5.3784