Task 12735782

Name	hadcm3n_o1ip_1900_40_007197300_0
Workunit	7395580
Created	28 Mar 2011, 14:00:30 UTC
Sent	1 Apr 2011, 17:34:01 UTC
Report deadline	2 Jul 2011, 1:01:12 UTC
Received	14 May 2011, 8:01:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1126771
Run time	14 days 15 hours 51 min 25 sec
CPU time	13 days 10 hours 46 min 22 sec
Validate state	Invalid
Credit	7,153.92
Device peak FLOPS	2.26 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.26</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:26:22 (3732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:25:23 (312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:24:21 (3716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2812, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2812, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 May 2011 03:33:35	1126771	12735782	hadcm3n_o1ip_1900_40_007197300_0	596,160	1,115,906	1.8718
11 May 2011 11:27:04	1126771	12735782	hadcm3n_o1ip_1900_40_007197300_0	570,240	1,067,372	1.8718
10 May 2011 13:40:11	1126771	12735782	hadcm3n_o1ip_1900_40_007197300_0	544,320	1,016,754	1.8679
09 May 2011 17:19:44	1126771	12735782	hadcm3n_o1ip_1900_40_007197300_0	518,400	966,872	1.8651
09 May 2011 00:04:48	1126771	12735782	hadcm3n_o1ip_1900_40_007197300_0	492,480	916,902	1.8618
08 May 2011 06:57:24	1126771	12735782	hadcm3n_o1ip_1900_40_007197300_0	466,560	867,979	1.8604
07 May 2011 16:12:44	1126771	12735782	hadcm3n_o1ip_1900_40_007197300_0	440,640	820,127	1.8612
07 May 2011 00:01:00	1126771	12735782	hadcm3n_o1ip_1900_40_007197300_0	414,720	771,929	1.8613
06 May 2011 09:50:50	1126771	12735782	hadcm3n_o1ip_1900_40_007197300_0	388,800	723,573	1.8610
05 May 2011 20:21:05	1126771	12735782	hadcm3n_o1ip_1900_40_007197300_0	362,880	675,786	1.8623
05 May 2011 05:18:50	1126771	12735782	hadcm3n_o1ip_1900_40_007197300_0	336,960	627,622	1.8626
04 May 2011 14:06:31	1126771	12735782	hadcm3n_o1ip_1900_40_007197300_0	311,040	579,183	1.8621
03 May 2011 22:40:00	1126771	12735782	hadcm3n_o1ip_1900_40_007197300_0	285,120	530,671	1.8612
03 May 2011 09:14:36	1126771	12735782	hadcm3n_o1ip_1900_40_007197300_0	259,200	482,780	1.8626
02 May 2011 19:20:35	1126771	12735782	hadcm3n_o1ip_1900_40_007197300_0	233,280	434,081	1.8608
02 May 2011 05:11:43	1126771	12735782	hadcm3n_o1ip_1900_40_007197300_0	207,360	385,677	1.8599
01 May 2011 14:19:09	1126771	12735782	hadcm3n_o1ip_1900_40_007197300_0	181,440	337,609	1.8607
30 Apr 2011 23:44:12	1126771	12735782	hadcm3n_o1ip_1900_40_007197300_0	155,520	289,785	1.8633
30 Apr 2011 09:24:57	1126771	12735782	hadcm3n_o1ip_1900_40_007197300_0	129,600	241,823	1.8659
29 Apr 2011 18:19:33	1126771	12735782	hadcm3n_o1ip_1900_40_007197300_0	103,680	193,593	1.8672