Task 15632698

Name	hadcm3n_38ku_1980_40_008318605_0
Workunit	8469740
Created	24 Feb 2013, 6:08:24 UTC
Sent	24 Feb 2013, 6:09:11 UTC
Report deadline	26 May 2013, 13:36:22 UTC
Received	6 Mar 2013, 22:49:35 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1193059
Run time	8 days 9 hours 56 min 19 sec
CPU time	8 days 6 hours 27 min 41 sec
Validate state	Invalid
Credit	4,976.64
Device peak FLOPS	3.08 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:53:32 (5764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:34 (5764): No heartbeat from core client for 30 sec - exiting 17:54:30 (7656): No heartbeat from core client for 30 sec - exiting 17:54:31 (7656): No heartbeat from core client for 30 sec - exiting 17:54:32 (7656): No heartbeat from core client for 30 sec - exiting 17:54:33 (7656): No heartbeat from core client for 30 sec - exiting 17:54:34 (7656): No heartbeat from core client for 30 sec - exiting 17:54:35 (7656): No heartbeat from core client for 30 sec - exiting 17:54:37 (7656): No heartbeat from core client for 30 sec - exiting 17:54:38 (7656): No heartbeat from core client for 30 sec - exiting 17:54:39 (7656): No heartbeat from core client for 30 sec - exiting 17:54:40 (7656): No heartbeat from core client for 30 sec - exiting 17:54:41 (7656): No heartbeat from core client for 30 sec - exiting 17:54:42 (7656): No heartbeat from core client for 30 sec - exiting 17:54:43 (7656): No heartbeat from core client for 30 sec - exiting 17:54:44 (7656): No heartbeat from core client for 30 sec - exiting 17:54:45 (7656): No heartbeat from core client for 30 sec - exiting 17:54:46 (7656): No heartbeat from core client for 30 sec - exiting 17:54:48 (7656): No heartbeat from core client for 30 sec - exiting 17:54:49 (7656): No heartbeat from core client for 30 sec - exiting 17:54:50 (7656): No heartbeat from core client for 30 sec - exiting 17:54:51 (7656): No heartbeat from core client for 30 sec - exiting 17:54:52 (7656): No heartbeat from core client for 30 sec - exiting 17:54:53 (7656): No heartbeat from core client for 30 sec - exiting 17:54:54 (7656): No heartbeat from core client for 30 sec - exiting 17:54:55 (7656): No heartbeat from core client for 30 sec - exiting 17:54:56 (7656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:55:34 (7748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5192, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6404, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1236, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:52:50 (5092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Mar 2013 11:36:25	1193059	15632698	hadcm3n_38ku_1980_40_008318605_0	414,720	693,089	1.6712
05 Mar 2013 20:51:55	1193059	15632698	hadcm3n_38ku_1980_40_008318605_0	388,800	655,517	1.6860
05 Mar 2013 08:45:53	1193059	15632698	hadcm3n_38ku_1980_40_008318605_0	362,880	616,902	1.7000
04 Mar 2013 05:32:31	1193059	15632698	hadcm3n_38ku_1980_40_008318605_0	336,960	575,339	1.7074
03 Mar 2013 16:20:47	1193059	15632698	hadcm3n_38ku_1980_40_008318605_0	311,040	527,777	1.6968
03 Mar 2013 03:44:44	1193059	15632698	hadcm3n_38ku_1980_40_008318605_0	285,120	479,718	1.6825
02 Mar 2013 13:35:17	1193059	15632698	hadcm3n_38ku_1980_40_008318605_0	259,200	431,543	1.6649
02 Mar 2013 00:44:48	1193059	15632698	hadcm3n_38ku_1980_40_008318605_0	233,280	385,333	1.6518
01 Mar 2013 12:43:23	1193059	15632698	hadcm3n_38ku_1980_40_008318605_0	207,360	338,753	1.6336
28 Feb 2013 23:05:01	1193059	15632698	hadcm3n_38ku_1980_40_008318605_0	181,440	291,418	1.6061
27 Feb 2013 02:40:25	1193059	15632698	hadcm3n_38ku_1980_40_008318605_0	155,520	241,479	1.5527
26 Feb 2013 15:00:42	1193059	15632698	hadcm3n_38ku_1980_40_008318605_0	129,600	200,736	1.5489
26 Feb 2013 03:38:38	1193059	15632698	hadcm3n_38ku_1980_40_008318605_0	103,680	160,737	1.5503
25 Feb 2013 16:22:07	1193059	15632698	hadcm3n_38ku_1980_40_008318605_0	77,760	120,267	1.5466
25 Feb 2013 04:58:26	1193059	15632698	hadcm3n_38ku_1980_40_008318605_0	51,840	79,738	1.5382
24 Feb 2013 17:27:20	1193059	15632698	hadcm3n_38ku_1980_40_008318605_0	25,920	39,078	1.5076