Task 14847750

Name	hadcm3n_zdfm_1880_40_008026275_0
Workunit	8181389
Created	29 Jun 2012, 15:49:07 UTC
Sent	29 Jun 2012, 15:49:16 UTC
Report deadline	28 Sep 2012, 23:16:27 UTC
Received	7 Aug 2012, 0:54:34 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	825037
Run time	21 days 14 hours 3 min 23 sec
CPU time	14 days 3 hours 32 min 42 sec
Validate state	Invalid
Credit	12,130.56
Device peak FLOPS	2.35 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> 19:07:10 (4090): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Signal 1 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Signal 1 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 1 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Signal 1 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: REPLANCA: PP HEADERS ON ANCILLARY FILE DO NOT MATCH tmp/pipe_dummy 2048 Model crashed: REPLANCA: PP HEADERS ON ANCILLARY FILE DO NOT MATCH tmp/pipe_dummy 2048 Model crashed: REPLANCA: PP HEADERS ON ANCILLARY FILE DO NOT MATCH tmp/pipe_dummy 2048 Model crashed: REPLANCA: PP HEADERS ON ANCILLARY FILE DO NOT MATCH tmp/pipe_dummy 2048 Model crashed: REPLANCA: PP HEADERS ON ANCILLARY FILE DO NOT MATCH tmp/pipe_dummy 2048 Model crashed: REPLANCA: PP HEADERS ON ANCILLARY FILE DO NOT MATCH tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Aug 2012 14:29:40	825037	14847750	hadcm3n_zdfm_1880_40_008026275_0	1,010,880	1,657,371	1.6395
04 Aug 2012 20:34:08	825037	14847750	hadcm3n_zdfm_1880_40_008026275_0	984,960	1,615,184	1.6398
03 Aug 2012 15:52:31	825037	14847750	hadcm3n_zdfm_1880_40_008026275_0	959,040	1,572,898	1.6401
02 Aug 2012 14:17:41	825037	14847750	hadcm3n_zdfm_1880_40_008026275_0	933,120	1,531,123	1.6409
01 Aug 2012 01:03:56	825037	14847750	hadcm3n_zdfm_1880_40_008026275_0	907,200	1,488,882	1.6412
31 Jul 2012 08:47:32	825037	14847750	hadcm3n_zdfm_1880_40_008026275_0	881,280	1,446,662	1.6415
30 Jul 2012 18:15:18	825037	14847750	hadcm3n_zdfm_1880_40_008026275_0	855,360	1,403,759	1.6411
29 Jul 2012 23:19:54	825037	14847750	hadcm3n_zdfm_1880_40_008026275_0	829,440	1,360,986	1.6408
29 Jul 2012 09:39:28	825037	14847750	hadcm3n_zdfm_1880_40_008026275_0	803,520	1,317,560	1.6397
28 Jul 2012 20:06:05	825037	14847750	hadcm3n_zdfm_1880_40_008026275_0	777,600	1,274,178	1.6386
28 Jul 2012 07:18:52	825037	14847750	hadcm3n_zdfm_1880_40_008026275_0	751,680	1,230,858	1.6375
27 Jul 2012 05:54:32	825037	14847750	hadcm3n_zdfm_1880_40_008026275_0	725,760	1,187,536	1.6363
26 Jul 2012 16:37:45	825037	14847750	hadcm3n_zdfm_1880_40_008026275_0	699,840	1,144,423	1.6353
25 Jul 2012 10:47:38	825037	14847750	hadcm3n_zdfm_1880_40_008026275_0	673,920	1,101,733	1.6348
24 Jul 2012 14:05:20	825037	14847750	hadcm3n_zdfm_1880_40_008026275_0	648,000	1,059,831	1.6355
24 Jul 2012 01:02:25	825037	14847750	hadcm3n_zdfm_1880_40_008026275_0	622,080	1,017,259	1.6353
23 Jul 2012 11:48:27	825037	14847750	hadcm3n_zdfm_1880_40_008026275_0	596,160	974,975	1.6354
22 Jul 2012 22:50:20	825037	14847750	hadcm3n_zdfm_1880_40_008026275_0	570,240	932,708	1.6356
18 Jul 2012 11:19:38	825037	14847750	hadcm3n_zdfm_1880_40_008026275_0	544,320	890,749	1.6364
16 Jul 2012 08:51:28	825037	14847750	hadcm3n_zdfm_1880_40_008026275_0	518,400	849,029	1.6378