Task 13014904

Name	hadcm3n_t0i4_1940_40_007310813_2
Workunit	7508243
Created	28 Jun 2011, 1:04:40 UTC
Sent	28 Jun 2011, 1:04:49 UTC
Report deadline	27 Sep 2011, 8:32:00 UTC
Received	26 Aug 2011, 4:17:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	870397
Run time	11 days 9 hours 3 min 43 sec
CPU time	11 days 9 hours 3 min 43 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.25 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.2.18</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4980, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5340, iMonCtr=1 Model crash detected, will try to restart... 09:17:56 (4708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:19:38 (5852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4416, iMonCtr=1 Model crash detected, will try to restart... 15:33:29 (6008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4172, iMonCtr=1 Model crash detected, will try to restart... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4516, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5328, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5968, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3512, iMonCtr=1 Model crash detected, will try to restart... 16:43:34 (5536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5528, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5160, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4440, iMonCtr=1 Model crash detected, will try to restart... 13:32:55 (4868): No heartbeat from core client for 30 sec - exiting 13:32:56 (4868): No heartbeat from core client for 30 sec - exiting 13:32:57 (4868): No heartbeat from core client for 30 sec - exiting 13:32:58 (4868): No heartbeat from core client for 30 sec - exiting 13:32:59 (4868): No heartbeat from core client for 30 sec - exiting 13:33:00 (4868): No heartbeat from core client for 30 sec - exiting 13:33:01 (4868): No heartbeat from core client for 30 sec - exiting 13:33:02 (4868): No heartbeat from core client for 30 sec - exiting 13:33:03 (4868): No heartbeat from core client for 30 sec - exiting 13:33:04 (4868): No heartbeat from core client for 30 sec - exiting 13:33:05 (4868): No heartbeat from core client for 30 sec - exiting 13:33:06 (4868): No heartbeat from core client for 30 sec - exiting 13:33:07 (4868): No heartbeat from core client for 30 sec - exiting 13:33:08 (4868): No heartbeat from core client for 30 sec - exiting 13:33:09 (4868): No heartbeat from core client for 30 sec - exiting 13:33:10 (4868): No heartbeat from core client for 30 sec - exiting 13:33:11 (4868): No heartbeat from core client for 30 sec - exiting 13:33:12 (4868): No heartbeat from core client for 30 sec - exiting 13:33:13 (4868): No heartbeat from core client for 30 sec - exiting 13:33:14 (4868): No heartbeat from core client for 30 sec - exiting 13:33:15 (4868): No heartbeat from core client for 30 sec - exiting 13:33:16 (4868): No heartbeat from core client for 30 sec - exiting 13:33:17 (4868): No heartbeat from core client for 30 sec - exiting 13:33:18 (4868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:45:46 (5260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4252, iMonCtr=1 Model crash detected, will try to restart... 08:54:59 (4420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CCPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6000, iMonCtr=1 Model crash detected, will try to restart... 08:00:00 (4488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:53:20 (5488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Aug 2011 04:16:48	870397	13014904	hadcm3n_t0i4_1940_40_007310813_2	518,400	983,017	1.8963
24 Aug 2011 01:56:54	870397	13014904	hadcm3n_t0i4_1940_40_007310813_2	492,480	933,766	1.8960
22 Aug 2011 03:06:49	870397	13014904	hadcm3n_t0i4_1940_40_007310813_2	466,560	884,575	1.8960
20 Aug 2011 04:58:46	870397	13014904	hadcm3n_t0i4_1940_40_007310813_2	440,640	835,953	1.8971
18 Aug 2011 02:01:54	870397	13014904	hadcm3n_t0i4_1940_40_007310813_2	414,720	787,476	1.8988
15 Aug 2011 02:28:15	870397	13014904	hadcm3n_t0i4_1940_40_007310813_2	388,800	737,793	1.8976
05 Aug 2011 08:28:31	870397	13014904	hadcm3n_t0i4_1940_40_007310813_2	362,880	688,341	1.8969
03 Aug 2011 06:08:15	870397	13014904	hadcm3n_t0i4_1940_40_007310813_2	336,960	638,217	1.8940
30 Jul 2011 09:44:31	870397	13014904	hadcm3n_t0i4_1940_40_007310813_2	311,040	588,060	1.8906
27 Jul 2011 02:16:02	870397	13014904	hadcm3n_t0i4_1940_40_007310813_2	285,120	539,371	1.8917
25 Jul 2011 20:28:26	870397	13014904	hadcm3n_t0i4_1940_40_007310813_2	259,200	490,764	1.8934
25 Jul 2011 20:19:39	870397	13014904	hadcm3n_t0i4_1940_40_007310813_2	233,280	439,769	1.8852
25 Jul 2011 14:55:53	870397	13014904	hadcm3n_t0i4_1940_40_007310813_2	207,360	389,060	1.8763
25 Jul 2011 14:55:53	870397	13014904	hadcm3n_t0i4_1940_40_007310813_2	181,440	338,745	1.8670
10 Jul 2011 19:48:16	870397	13014904	hadcm3n_t0i4_1940_40_007310813_2	155,520	291,098	1.8718
10 Jul 2011 06:41:00	870397	13014904	hadcm3n_t0i4_1940_40_007310813_2	129,600	244,582	1.8872
09 Jul 2011 18:02:53	870397	13014904	hadcm3n_t0i4_1940_40_007310813_2	103,680	198,108	1.9108
08 Jul 2011 07:58:37	870397	13014904	hadcm3n_t0i4_1940_40_007310813_2	77,760	148,977	1.9159
06 Jul 2011 01:23:12	870397	13014904	hadcm3n_t0i4_1940_40_007310813_2	51,840	99,458	1.9186
01 Jul 2011 08:43:49	870397	13014904	hadcm3n_t0i4_1940_40_007310813_2	25,920	50,303	1.9407