Task 13012759

Name	hadcm3n_t14m_1940_40_007311068_0
Workunit	7508498
Created	27 Jun 2011, 21:36:42 UTC
Sent	27 Jun 2011, 21:39:27 UTC
Report deadline	27 Sep 2011, 5:06:38 UTC
Received	15 Jul 2011, 16:42:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	998608
Run time	8 days 17 hours 55 min 48 sec
CPU time	8 days 9 hours 32 min 8 sec
Validate state	Invalid
Credit	6,531.84
Device peak FLOPS	3.18 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.26</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3972, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1856, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2011 14:19:57	998608	13012759	hadcm3n_t14m_1940_40_007311068_0	544,320	693,254	1.2736
25 Jul 2011 14:19:57	998608	13012759	hadcm3n_t14m_1940_40_007311068_0	518,400	660,279	1.2737
25 Jul 2011 14:19:57	998608	13012759	hadcm3n_t14m_1940_40_007311068_0	492,480	627,267	1.2737
25 Jul 2011 14:19:57	998608	13012759	hadcm3n_t14m_1940_40_007311068_0	466,560	594,782	1.2748
10 Jul 2011 23:30:06	998608	13012759	hadcm3n_t14m_1940_40_007311068_0	440,640	561,909	1.2752
10 Jul 2011 09:52:04	998608	13012759	hadcm3n_t14m_1940_40_007311068_0	414,720	529,530	1.2768
09 Jul 2011 15:07:31	998608	13012759	hadcm3n_t14m_1940_40_007311068_0	388,800	495,316	1.2740
08 Jul 2011 22:50:37	998608	13012759	hadcm3n_t14m_1940_40_007311068_0	362,880	461,173	1.2709
08 Jul 2011 02:56:38	998608	13012759	hadcm3n_t14m_1940_40_007311068_0	336,960	426,879	1.2669
07 Jul 2011 18:52:28	998608	13012759	hadcm3n_t14m_1940_40_007311068_0	311,040	392,943	1.2633
06 Jul 2011 02:28:28	998608	13012759	hadcm3n_t14m_1940_40_007311068_0	285,120	358,657	1.2579
05 Jul 2011 17:27:59	998608	13012759	hadcm3n_t14m_1940_40_007311068_0	259,200	325,542	1.2559
04 Jul 2011 12:01:11	998608	13012759	hadcm3n_t14m_1940_40_007311068_0	233,280	293,709	1.2590
02 Jul 2011 22:49:34	998608	13012759	hadcm3n_t14m_1940_40_007311068_0	207,360	260,937	1.2584
02 Jul 2011 05:53:58	998608	13012759	hadcm3n_t14m_1940_40_007311068_0	181,440	227,983	1.2565
01 Jul 2011 15:12:27	998608	13012759	hadcm3n_t14m_1940_40_007311068_0	155,520	195,555	1.2574
01 Jul 2011 01:00:27	998608	13012759	hadcm3n_t14m_1940_40_007311068_0	129,600	162,700	1.2554
30 Jun 2011 03:27:35	998608	13012759	hadcm3n_t14m_1940_40_007311068_0	103,680	129,276	1.2469
29 Jun 2011 11:04:52	998608	13012759	hadcm3n_t14m_1940_40_007311068_0	77,760	96,108	1.2360
28 Jun 2011 18:55:13	998608	13012759	hadcm3n_t14m_1940_40_007311068_0	51,840	63,304	1.2211