Task 15658121

Name	hadcm3n_38if_1980_40_008322381_2
Workunit	8473516
Created	11 Mar 2013, 17:54:26 UTC
Sent	11 Mar 2013, 17:54:30 UTC
Report deadline	11 Jun 2013, 1:21:41 UTC
Received	8 May 2013, 19:36:10 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1258591
Run time	10 days 9 hours 14 min 42 sec
CPU time	7 days 22 hours 35 min 34 sec
Validate state	Invalid
Credit	5,287.68
Device peak FLOPS	2.47 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 18:30:55 (332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4496, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 May 2013 17:36:31	1258591	15658121	hadcm3n_38if_1980_40_008322381_2	440,640	719,161	1.6321
08 May 2013 01:07:04	1258591	15658121	hadcm3n_38if_1980_40_008322381_2	414,720	678,016	1.6349
02 May 2013 05:09:49	1258591	15658121	hadcm3n_38if_1980_40_008322381_2	388,800	636,853	1.6380
01 May 2013 17:26:52	1258591	15658121	hadcm3n_38if_1980_40_008322381_2	362,880	595,722	1.6417
01 May 2013 05:32:57	1258591	15658121	hadcm3n_38if_1980_40_008322381_2	336,960	554,655	1.6461
30 Apr 2013 14:20:25	1258591	15658121	hadcm3n_38if_1980_40_008322381_2	311,040	513,069	1.6495
29 Apr 2013 20:51:00	1258591	15658121	hadcm3n_38if_1980_40_008322381_2	285,120	470,589	1.6505
16 Apr 2013 21:27:40	1258591	15658121	hadcm3n_38if_1980_40_008322381_2	259,200	426,756	1.6464
15 Apr 2013 00:27:43	1258591	15658121	hadcm3n_38if_1980_40_008322381_2	233,280	382,646	1.6403
12 Apr 2013 19:06:17	1258591	15658121	hadcm3n_38if_1980_40_008322381_2	207,360	340,572	1.6424
11 Apr 2013 15:15:30	1258591	15658121	hadcm3n_38if_1980_40_008322381_2	181,440	299,337	1.6498
26 Mar 2013 07:45:46	1258591	15658121	hadcm3n_38if_1980_40_008322381_2	155,520	256,207	1.6474
20 Mar 2013 01:25:15	1258591	15658121	hadcm3n_38if_1980_40_008322381_2	129,600	211,109	1.6289
18 Mar 2013 20:39:53	1258591	15658121	hadcm3n_38if_1980_40_008322381_2	103,680	170,071	1.6403
15 Mar 2013 00:46:13	1258591	15658121	hadcm3n_38if_1980_40_008322381_2	77,760	128,498	1.6525
14 Mar 2013 05:48:59	1258591	15658121	hadcm3n_38if_1980_40_008322381_2	51,840	85,890	1.6568
12 Mar 2013 20:49:58	1258591	15658121	hadcm3n_38if_1980_40_008322381_2	25,920	43,789	1.6894