Task 13345615

Name	hadcm3n_o30m_1900_40_007439572_3
Workunit	7637075
Created	8 Sep 2011, 10:57:45 UTC
Sent	8 Sep 2011, 10:57:47 UTC
Report deadline	8 Dec 2011, 18:24:58 UTC
Received	1 Dec 2011, 5:45:15 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1168300
Run time	71 days 14 hours 39 min 27 sec
CPU time	8 days 17 hours 40 min 32 sec
Validate state	Invalid
Credit	6,531.84
Device peak FLOPS	2.17 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4712, selfPID=4712, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=37520, iMonCtr=1 Model crash detected, will try to restart... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Nov 2011 02:39:06	1168300	13345615	hadcm3n_o30m_1900_40_007439572_3	544,320	1,010,967	1.8573
27 Nov 2011 16:22:43	1168300	13345615	hadcm3n_o30m_1900_40_007439572_3	518,400	962,771	1.8572
26 Nov 2011 07:59:22	1168300	13345615	hadcm3n_o30m_1900_40_007439572_3	492,480	914,921	1.8578
24 Nov 2011 22:33:01	1168300	13345615	hadcm3n_o30m_1900_40_007439572_3	466,560	866,885	1.8580
15 Nov 2011 19:23:17	1168300	13345615	hadcm3n_o30m_1900_40_007439572_3	440,640	818,229	1.8569
31 Oct 2011 18:37:50	1168300	13345615	hadcm3n_o30m_1900_40_007439572_3	414,720	769,320	1.8550
31 Oct 2011 13:33:38	1168300	13345615	hadcm3n_o30m_1900_40_007439572_3	388,800	720,860	1.8541
18 Oct 2011 06:59:23	1168300	13345615	hadcm3n_o30m_1900_40_007439572_3	362,880	674,171	1.8578
17 Oct 2011 04:52:27	1168300	13345615	hadcm3n_o30m_1900_40_007439572_3	336,960	625,554	1.8565
15 Oct 2011 22:48:06	1168300	13345615	hadcm3n_o30m_1900_40_007439572_3	311,040	576,053	1.8520
14 Oct 2011 17:45:22	1168300	13345615	hadcm3n_o30m_1900_40_007439572_3	285,120	526,954	1.8482
13 Oct 2011 12:54:48	1168300	13345615	hadcm3n_o30m_1900_40_007439572_3	259,200	478,595	1.8464
12 Oct 2011 07:49:23	1168300	13345615	hadcm3n_o30m_1900_40_007439572_3	233,280	430,032	1.8434
10 Oct 2011 01:37:14	1168300	13345615	hadcm3n_o30m_1900_40_007439572_3	207,360	379,846	1.8318
06 Oct 2011 19:14:00	1168300	13345615	hadcm3n_o30m_1900_40_007439572_3	181,440	335,688	1.8501
01 Oct 2011 21:36:07	1168300	13345615	hadcm3n_o30m_1900_40_007439572_3	155,520	286,679	1.8434
23 Sep 2011 20:01:38	1168300	13345615	hadcm3n_o30m_1900_40_007439572_3	129,600	238,523	1.8405
23 Sep 2011 03:06:33	1168300	13345615	hadcm3n_o30m_1900_40_007439572_3	103,680	192,266	1.8544
17 Sep 2011 01:36:36	1168300	13345615	hadcm3n_o30m_1900_40_007439572_3	77,760	143,200	1.8416
11 Sep 2011 07:50:31	1168300	13345615	hadcm3n_o30m_1900_40_007439572_3	51,840	96,380	1.8592