Task 11591559

Name	hadam3p_nf45_1975_2_006168079_5
Workunit	6434136
Created	24 Jun 2010, 22:42:47 UTC
Sent	24 Jun 2010, 23:20:28 UTC
Report deadline	7 Jun 2011, 4:40:28 UTC
Received	4 Aug 2010, 20:06:53 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1080690
Run time	16 days 8 hours 36 min 25 sec
CPU time	12 days 14 hours 46 min 28 sec
Validate state	Invalid
Credit	1,330.56
Device peak FLOPS	0.54 GFLOPS
Application version	UK Met Office HADAM3P v6.14 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.17</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (9477): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (9477): No heartbeat from core client for 30 sec - exiting (9477): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (20714): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (20714): No heartbeat from core client for 30 sec - exiting (20714): No heartbeat from core client for 30 sec - exiting (20714): No heartbeat from core client for 30 sec - exiting (21357): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (21357): No heartbeat from core client for 30 sec - exiting (22818): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... (23653): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (25303): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (25303): No heartbeat from core client for 30 sec - exiting (26051): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (1494): No heartbeat from core client for 30 sec - exiting (1494): No heartbeat from core client for 30 sec - exiting (1494): No heartbeat from core client for 30 sec - exiting (1494): No heartbeat from core client for 30 sec - exiting (1494): No heartbeat from core client for 30 sec - exiting (1494): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (1735): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (2190): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (2190): No heartbeat from core client for 30 sec - exiting (2575): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (3047): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (3189): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (3189): No heartbeat from core client for 30 sec - exiting (3189): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... (4312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... (5494): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6308): No heartbeat from core client for 30 sec - exiting (6308): No heartbeat from core client for 30 sec - exiting (6308): No heartbeat from core client for 30 sec - exiting (6308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6679): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6679): No heartbeat from core client for 30 sec - exiting (7780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7780): No heartbeat from core client for 30 sec - exiting (7780): No heartbeat from core client for 30 sec - exiting (7780): No heartbeat from core client for 30 sec - exiting (8583): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (8869): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (9684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (10502): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (10968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (11323): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (11323): No heartbeat from core client for 30 sec - exiting (11819): No heartbeat from core client for 30 sec - exiting (11819): No heartbeat from core client for 30 sec - exiting (11819): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (12109): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (12832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (13002): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (13108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (13108): No heartbeat from core client for 30 sec - exiting (13407): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13706, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13706, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13706, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13706, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13706, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13706, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( (13706): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Jul 2010 19:50:04	1080690	11591559	hadam3p_nf45_1975_2_006168079_5	46,080	1,052,024	22.8304
24 Jul 2010 11:13:32	1080690	11591559	hadam3p_nf45_1975_2_006168079_5	43,200	1,004,978	23.2634
22 Jul 2010 21:24:26	1080690	11591559	hadam3p_nf45_1975_2_006168079_5	40,320	956,967	23.7343
21 Jul 2010 08:25:40	1080690	11591559	hadam3p_nf45_1975_2_006168079_5	37,440	906,538	24.2131
06 Jul 2010 06:24:56	1080690	11591559	hadam3p_nf45_1975_2_006168079_5	34,560	841,983	24.3629
05 Jul 2010 07:24:57	1080690	11591559	hadam3p_nf45_1975_2_006168079_5	31,680	765,323	24.1579
04 Jul 2010 07:26:35	1080690	11591559	hadam3p_nf45_1975_2_006168079_5	28,800	686,987	23.8537
03 Jul 2010 06:15:57	1080690	11591559	hadam3p_nf45_1975_2_006168079_5	25,920	613,729	23.6778
02 Jul 2010 05:21:54	1080690	11591559	hadam3p_nf45_1975_2_006168079_5	23,040	536,569	23.2886
01 Jul 2010 06:34:13	1080690	11591559	hadam3p_nf45_1975_2_006168079_5	20,160	458,207	22.7285
30 Jun 2010 08:58:11	1080690	11591559	hadam3p_nf45_1975_2_006168079_5	17,280	383,471	22.1916
29 Jun 2010 14:41:04	1080690	11591559	hadam3p_nf45_1975_2_006168079_5	14,400	318,692	22.1314
28 Jun 2010 16:42:48	1080690	11591559	hadam3p_nf45_1975_2_006168079_5	11,520	255,539	22.1822
27 Jun 2010 19:00:09	1080690	11591559	hadam3p_nf45_1975_2_006168079_5	8,640	192,117	22.2358
26 Jun 2010 20:37:33	1080690	11591559	hadam3p_nf45_1975_2_006168079_5	5,760	128,767	22.3554
25 Jun 2010 22:41:19	1080690	11591559	hadam3p_nf45_1975_2_006168079_5	2,880	63,972	22.2125