Task 13089530

Name	hadcm3n_t6e5_1940_40_007316606_2
Workunit	7514036
Created	6 Jul 2011, 2:54:59 UTC
Sent	6 Jul 2011, 2:55:07 UTC
Report deadline	5 Oct 2011, 10:22:18 UTC
Received	23 Jul 2011, 9:13:10 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1155560
Run time	7 days 8 hours 20 min 24 sec
CPU time	6 days 19 hours 59 min 45 sec
Validate state	Invalid
Credit	3,421.44
Device peak FLOPS	2.61 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.26</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:10:34 (8548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3292, selfPID=3292, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/t6e5ko.pje5c10 Error converting file to netcdf: dataout/t6e5ko.pie5c10 Error converting file to netcdf: dataout/t6e5ko.pfe5c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2011 19:51:19	1155560	13089530	hadcm3n_t6e5_1940_40_007316606_2	285,120	567,514	1.9904
25 Jul 2011 19:51:19	1155560	13089530	hadcm3n_t6e5_1940_40_007316606_2	259,200	515,408	1.9885
25 Jul 2011 19:51:19	1155560	13089530	hadcm3n_t6e5_1940_40_007316606_2	233,280	463,745	1.9879
25 Jul 2011 18:55:10	1155560	13089530	hadcm3n_t6e5_1940_40_007316606_2	207,360	404,929	1.9528
25 Jul 2011 18:14:34	1155560	13089530	hadcm3n_t6e5_1940_40_007316606_2	181,440	354,549	1.9541
25 Jul 2011 17:52:01	1155560	13089530	hadcm3n_t6e5_1940_40_007316606_2	155,520	307,797	1.9791
25 Jul 2011 17:30:30	1155560	13089530	hadcm3n_t6e5_1940_40_007316606_2	129,600	261,910	2.0209
25 Jul 2011 16:24:37	1155560	13089530	hadcm3n_t6e5_1940_40_007316606_2	103,680	212,533	2.0499
25 Jul 2011 15:55:14	1155560	13089530	hadcm3n_t6e5_1940_40_007316606_2	77,760	161,657	2.0789
25 Jul 2011 15:01:03	1155560	13089530	hadcm3n_t6e5_1940_40_007316606_2	51,840	111,613	2.1530
25 Jul 2011 14:06:07	1155560	13089530	hadcm3n_t6e5_1940_40_007316606_2	25,920	56,662	2.1860