Task 13096769

Name	hadcm3n_yahl_1900_40_007346451_1
Workunit	7543881
Created	6 Jul 2011, 13:37:49 UTC
Sent	19 Jul 2011, 17:52:13 UTC
Report deadline	19 Oct 2011, 1:19:24 UTC
Received	11 Aug 2011, 12:41:07 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1153137
Run time	3 days 15 hours 3 min 59 sec
CPU time	3 days 2 hours 23 min 41 sec
Validate state	Invalid
Credit	1,866.24
Device peak FLOPS	3.00 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1468, selfPID=1468, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/yahlko.pja2c10 Error converting file to netcdf: dataout/yahlko.pia2c10 Error converting file to netcdf: dataout/yahlko.pfa2c10 Error converting file to netcdf: dataout/yahlka.pha2c10 Error converting file to netcdf: dataout/yahlka.pga2c10 Error converting file to netcdf: dataout/yahlka.pea2c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11196, selfPID=11196, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:14:58 (11280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:17:29 (1080): No heartbeat from core client for 30 sec - exiting 09:17:30 (1080): No heartbeat from core client for 30 sec - exiting 09:17:31 (1080): No heartbeat from core client for 30 sec - exiting 09:17:32 (1080): No heartbeat from core client for 30 sec - exiting 09:17:33 (1080): No heartbeat from core client for 30 sec - exiting 09:17:34 (1080): No heartbeat from core client for 30 sec - exiting 09:17:35 (1080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:22:40 (2168): No heartbeat from core client for 30 sec - exiting 09:22:41 (2168): No heartbeat from core client for 30 sec - exiting 09:22:42 (2168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:42:01 (4776): No heartbeat from core client for 30 sec - exiting 09:42:02 (4776): No heartbeat from core client for 30 sec - exiting 09:42:03 (4776): No heartbeat from core client for 30 sec - exiting 09:42:04 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:52:57 (5024): No heartbeat from core client for 30 sec - exiting 09:52:58 (5024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:57:40 (4296): No heartbeat from core client for 30 sec - exiting 09:57:41 (4296): No heartbeat from core client for 30 sec - exiting 09:57:42 (4296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:14:06 (4848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:25:15 (4832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:40:57 (4136): No heartbeat from core client for 30 sec - exiting 10:40:58 (4136): No heartbeat from core client for 30 sec - exiting 10:40:59 (4136): No heartbeat from core client for 30 sec - exiting 10:41:00 (4136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:55:50 (4240): No heartbeat from core client for 30 sec - exiting 10:55:51 (4240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3452, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3452, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3452, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3452, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6724, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 07:11:52 (4704): No heartbeat from core client for 30 sec - exiting 07:11:53 (4704): No heartbeat from core client for 30 sec - exiting 07:11:54 (4704): No heartbeat from core client for 30 sec - exiting 07:11:55 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4712, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Aug 2011 10:02:51	1153137	13096769	hadcm3n_yahl_1900_40_007346451_1	155,520	258,269	1.6607
09 Aug 2011 18:22:42	1153137	13096769	hadcm3n_yahl_1900_40_007346451_1	129,600	215,172	1.6603
09 Aug 2011 03:41:01	1153137	13096769	hadcm3n_yahl_1900_40_007346451_1	103,680	173,542	1.6738
28 Jul 2011 15:28:44	1153137	13096769	hadcm3n_yahl_1900_40_007346451_1	77,760	130,498	1.6782
28 Jul 2011 01:15:56	1153137	13096769	hadcm3n_yahl_1900_40_007346451_1	51,840	87,526	1.6884
26 Jul 2011 10:39:34	1153137	13096769	hadcm3n_yahl_1900_40_007346451_1	25,920	43,933	1.6949