Task 13006884

Name	hadcm3n_s0wn_1940_40_007298465_2
Workunit	7495889
Created	27 Jun 2011, 3:59:38 UTC
Sent	27 Jun 2011, 3:59:53 UTC
Report deadline	26 Sep 2011, 11:27:04 UTC
Received	5 Jul 2011, 23:52:58 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1155560
Run time	5 days 11 hours 50 min 28 sec
CPU time	5 days 0 hours 6 min 6 sec
Validate state	Invalid
Credit	2,799.36
Device peak FLOPS	2.61 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.26</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:11:51 (12320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:16:39 (13132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15336, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/s0wnko.pje5c10 Error converting file to netcdf: dataout/s0wnko.pie5c10 Error converting file to netcdf: dataout/s0wnko.pfe5c10 Error converting file to netcdf: dataout/s0wnka.phe5c10 Error converting file to netcdf: dataout/s0wnka.pge5c10 Error converting file to netcdf: dataout/s0wnka.pee5c10 Error converting file to netcdf: dataout/s0wnka.pde5c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Jul 2011 21:51:49	1155560	13006884	hadcm3n_s0wn_1940_40_007298465_2	233,280	438,704	1.8806
04 Jul 2011 13:31:55	1155560	13006884	hadcm3n_s0wn_1940_40_007298465_2	207,360	386,531	1.8641
03 Jul 2011 22:06:07	1155560	13006884	hadcm3n_s0wn_1940_40_007298465_2	181,440	336,657	1.8555
03 Jul 2011 03:53:56	1155560	13006884	hadcm3n_s0wn_1940_40_007298465_2	155,520	282,632	1.8173
02 Jul 2011 12:38:07	1155560	13006884	hadcm3n_s0wn_1940_40_007298465_2	129,600	235,140	1.8144
01 Jul 2011 20:37:45	1155560	13006884	hadcm3n_s0wn_1940_40_007298465_2	103,680	189,582	1.8285
01 Jul 2011 04:21:40	1155560	13006884	hadcm3n_s0wn_1940_40_007298465_2	77,760	143,475	1.8451
29 Jun 2011 19:18:55	1155560	13006884	hadcm3n_s0wn_1940_40_007298465_2	51,840	96,903	1.8693
29 Jun 2011 03:26:47	1155560	13006884	hadcm3n_s0wn_1940_40_007298465_2	25,920	49,671	1.9163