Task 13349897

Name	hadcm3n_o4ie_1940_40_007443817_0
Workunit	7641320
Created	9 Sep 2011, 0:48:57 UTC
Sent	9 Sep 2011, 10:12:44 UTC
Report deadline	9 Dec 2011, 17:39:55 UTC
Received	29 Sep 2011, 13:38:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1160820
Run time	8 days 17 hours 35 min 4 sec
CPU time	7 days 2 hours 27 min 55 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.00 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:48:59 (1696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:49:00 (1696): No heartbeat from core client for 30 sec - exiting 13:49:01 (1696): No heartbeat from core client for 30 sec - exiting 13:49:02 (1696): No heartbeat from core client for 30 sec - exiting 13:49:03 (1696): No heartbeat from core client for 30 sec - exiting 13:49:04 (1696): No heartbeat from core client for 30 sec - exiting 11:38:43 (3516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:38:44 (3516): No heartbeat from core client for 30 sec - exiting 11:38:45 (3516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1964, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1964, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1964, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2608, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2608, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2608, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2608, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 20:37:30 (1888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:59:33 (2760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:59:34 (2760): No heartbeat from core client for 30 sec - exiting 09:59:35 (2760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 21:46:13 (4068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:51:03 (3840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:51:04 (3840): No heartbeat from core client for 30 sec - exiting 21:51:55 (3652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:57:57 (2568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o4ieko.pje8c10 Error converting file to netcdf: dataout/o4ieko.pie8c10 Error converting file to netcdf: dataout/o4ieko.pfe8c10 Error converting file to netcdf: dataout/o4ieka.phe8c10 Error converting file to netcdf: dataout/o4ieka.pge8c10 Error converting file to netcdf: dataout/o4ieka.pee8c10 Error converting file to netcdf: dataout/o4ieka.pde8c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Sep 2011 04:24:24	1160820	13349897	hadcm3n_o4ie_1940_40_007443817_0	259,200	613,669	2.3676
28 Sep 2011 08:10:01	1160820	13349897	hadcm3n_o4ie_1940_40_007443817_0	233,280	549,570	2.3558
27 Sep 2011 04:35:17	1160820	13349897	hadcm3n_o4ie_1940_40_007443817_0	207,360	485,375	2.3407
25 Sep 2011 16:20:23	1160820	13349897	hadcm3n_o4ie_1940_40_007443817_0	181,440	407,811	2.2476
22 Sep 2011 17:41:38	1160820	13349897	hadcm3n_o4ie_1940_40_007443817_0	155,520	345,003	2.2184
20 Sep 2011 17:50:30	1160820	13349897	hadcm3n_o4ie_1940_40_007443817_0	129,600	289,709	2.2354
16 Sep 2011 05:42:49	1160820	13349897	hadcm3n_o4ie_1940_40_007443817_0	103,680	233,825	2.2553
15 Sep 2011 07:07:51	1160820	13349897	hadcm3n_o4ie_1940_40_007443817_0	77,760	176,522	2.2701
14 Sep 2011 10:32:02	1160820	13349897	hadcm3n_o4ie_1940_40_007443817_0	51,840	117,698	2.2704
13 Sep 2011 16:01:48	1160820	13349897	hadcm3n_o4ie_1940_40_007443817_0	25,920	56,694	2.1873