Task 12985935

Name	hadcm3n_h054_1940_40_007298052_2
Workunit	7495476
Created	19 Jun 2011, 22:35:37 UTC
Sent	19 Jun 2011, 22:35:37 UTC
Report deadline	19 Sep 2011, 6:02:48 UTC
Received	11 Jul 2011, 0:19:17 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1135676
Run time	10 days 8 hours 30 min 8 sec
CPU time	6 days 20 hours 14 min 46 sec
Validate state	Invalid
Credit	2,799.36
Device peak FLOPS	1.83 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4880, iMonCtr=1 Model crash detected, will try to restart... 11:15:43 (3456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:15:49 (3456): No heartbeat from core client for 30 sec - exiting 11:15:50 (3456): No heartbeat from core client for 30 sec - exiting 11:15:51 (3456): No heartbeat from core client for 30 sec - exiting 11:15:52 (3456): No heartbeat from core client for 30 sec - exiting 11:15:53 (3456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:28:05 (2700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:28:12 (2700): No heartbeat from core client for 30 sec - exiting 21:28:15 (2700): No heartbeat from core client for 30 sec - exiting 21:28:16 (2700): No heartbeat from core client for 30 sec - exiting 21:28:17 (2700): No heartbeat from core client for 30 sec - exiting 21:28:18 (2700): No heartbeat from core client for 30 sec - exiting 21:28:19 (2700): No heartbeat from core client for 30 sec - exiting 21:28:20 (2700): No heartbeat from core client for 30 sec - exiting 21:28:21 (2700): No heartbeat from core client for 30 sec - exiting 21:28:22 (2700): No heartbeat from core client for 30 sec - exiting 21:28:23 (2700): No heartbeat from core client for 30 sec - exiting 21:28:24 (2700): No heartbeat from core client for 30 sec - exiting 21:28:25 (2700): No heartbeat from core client for 30 sec - exiting 21:28:26 (2700): No heartbeat from core client for 30 sec - exiting 21:28:27 (2700): No heartbeat from core client for 30 sec - exiting 21:28:28 (2700): No heartbeat from core client for 30 sec - exiting 21:28:29 (2700): No heartbeat from core client for 30 sec - exiting 21:28:30 (2700): No heartbeat from core client for 30 sec - exiting 21:28:31 (2700): No heartbeat from core client for 30 sec - exiting 21:28:32 (2700): No heartbeat from core client for 30 sec - exiting 21:28:33 (2700): No heartbeat from core client for 30 sec - exiting 21:28:34 (2700): No heartbeat from core client for 30 sec - exiting 21:28:35 (2700): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4152, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4152, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Jul 2011 18:50:44	1135676	12985935	hadcm3n_h054_1940_40_007298052_2	233,280	630,410	2.7024
07 Jul 2011 15:40:28	1135676	12985935	hadcm3n_h054_1940_40_007298052_2	207,360	535,096	2.5805
04 Jul 2011 00:22:15	1135676	12985935	hadcm3n_h054_1940_40_007298052_2	181,440	461,942	2.5460
03 Jul 2011 00:41:03	1135676	12985935	hadcm3n_h054_1940_40_007298052_2	155,520	393,358	2.5293
30 Jun 2011 21:58:50	1135676	12985935	hadcm3n_h054_1940_40_007298052_2	129,600	305,786	2.3595
29 Jun 2011 02:16:10	1135676	12985935	hadcm3n_h054_1940_40_007298052_2	103,680	231,965	2.2373
26 Jun 2011 11:40:37	1135676	12985935	hadcm3n_h054_1940_40_007298052_2	77,760	168,818	2.1710
25 Jun 2011 18:18:35	1135676	12985935	hadcm3n_h054_1940_40_007298052_2	51,840	110,194	2.1257
24 Jun 2011 02:07:47	1135676	12985935	hadcm3n_h054_1940_40_007298052_2	25,920	55,205	2.1298