Task 12738789

Name	hadcm3n_o2od_1900_40_007198800_1
Workunit	7397080
Created	28 Mar 2011, 14:04:19 UTC
Sent	31 Mar 2011, 21:43:25 UTC
Report deadline	1 Jul 2011, 5:10:36 UTC
Received	30 May 2015, 18:49:12 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	952301
Run time	16 days 3 hours 4 min 22 sec
CPU time	15 days 5 hours 16 min 49 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.26 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 16:59:53 (1944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4928, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3976, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3312, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3312, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1308, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3900, iMonCtr=1 Model crash detected, will try to restart... 09:48:56 (3256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2140, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=132, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=132, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2148, iMonCtr=1 Model crash detected, will try to restart... 12:17:19 (796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3972, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 18:07:40 (4652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:14:10 (4360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:11:46 (3728): No heartbeat from core client for 30 sec - exiting 15:11:47 (3728): No heartbeat from core client for 30 sec - exiting 15:11:48 (3728): No heartbeat from core client for 30 sec - exiting 15:11:49 (3728): No heartbeat from core client for 30 sec - exiting 15:11:50 (3728): No heartbeat from core client for 30 sec - exiting 15:11:51 (3728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6108, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3820, iMonCtr=1 Model crash detected, will try to restart... 16:09:33 (3740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:23:09 (1544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3364, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1344, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4484, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4212, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4212, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4212, iMonCtr=1 Model crash detected, will try to restart... 15:14:51 (4972): No heartbeat from core client for 30 sec - exiting 15:14:52 (4972): No heartbeat from core client for 30 sec - exiting 15:14:53 (4972): No heartbeat from core client for 30 sec - exiting 15:14:54 (4972): No heartbeat from core client for 30 sec - exiting 15:14:55 (4972): No heartbeat from core client for 30 sec - exiting 15:14:56 (4972): No heartbeat from core client for 30 sec - exiting 15:14:57 (4972): No heartbeat from core client for 30 sec - exiting 15:14:58 (4972): No heartbeat from core client for 30 sec - exiting 15:14:59 (4972): No heartbeat from core client for 30 sec - exiting 15:15:00 (4972): No heartbeat from core client for 30 sec - exiting 15:15:01 (4972): No heartbeat from core client for 30 sec - exiting 15:15:02 (4972): No heartbeat from core client for 30 sec - exiting 15:15:03 (4972): No heartbeat from core client for 30 sec - exiting 15:15:04 (4972): No heartbeat from core client for 30 sec - exiting 15:15:05 (4972): No heartbeat from core client for 30 sec - exiting 15:15:06 (4972): No heartbeat from core client for 30 sec - exiting 15:15:07 (4972): No heartbeat from core client for 30 sec - exiting 15:15:08 (4972): No heartbeat from core client for 30 sec - exiting 15:15:09 (4972): No heartbeat from core client for 30 sec - exiting 15:15:10 (4972): No heartbeat from core client for 30 sec - exiting 15:15:11 (4972): No heartbeat from core client for 30 sec - exiting 15:15:12 (4972): No heartbeat from core client for 30 sec - exiting 15:15:13 (4972): No heartbeat from core client for 30 sec - exiting 15:15:14 (4972): No heartbeat from core client for 30 sec - exiting 15:15:15 (4972): No heartbeat from core client for 30 sec - exiting 15:15:16 (4972): No heartbeat from core client for 30 sec - exiting 15:15:17 (4972): No heartbeat from core client for 30 sec - exiting 15:15:18 (4972): No heartbeat from core client for 30 sec - exiting 15:15:19 (4972): No heartbeat from core client for 30 sec - exiting 15:15:20 (4972): No heartbeat from core client for 30 sec - exiting 15:15:21 (4972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4404, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:53:15 (4584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3368, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:16:36 (4732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1332, iMonCtr=1 Model crash detected, will try to restart... 08:40:22 (1904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:48:01 (4488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:53:19 (2964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:22:30 (4104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5740, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5740, iMonCtr=1 Model crash detected, will try to restart... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5044, selfPID=5044, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5720, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4380, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 May 2015 18:53:13	952301	12738789	hadcm3n_o2od_1900_40_007198800_1	777,600	1,314,993	1.6911
30 May 2015 18:53:13	952301	12738789	hadcm3n_o2od_1900_40_007198800_1	751,680	1,267,568	1.6863
30 May 2015 18:53:12	952301	12738789	hadcm3n_o2od_1900_40_007198800_1	725,760	1,220,158	1.6812
31 Mar 2015 23:49:41	952301	12738789	hadcm3n_o2od_1900_40_007198800_1	699,840	1,173,981	1.6775
15 Mar 2015 23:53:33	952301	12738789	hadcm3n_o2od_1900_40_007198800_1	673,920	1,129,739	1.6764
10 Mar 2015 16:30:32	952301	12738789	hadcm3n_o2od_1900_40_007198800_1	648,000	1,085,431	1.6750
02 Mar 2015 00:51:24	952301	12738789	hadcm3n_o2od_1900_40_007198800_1	622,080	1,042,733	1.6762
24 Jan 2015 15:36:02	952301	12738789	hadcm3n_o2od_1900_40_007198800_1	596,160	998,230	1.6744
19 Jan 2015 20:31:47	952301	12738789	hadcm3n_o2od_1900_40_007198800_1	570,240	955,028	1.6748
10 Jan 2015 20:41:49	952301	12738789	hadcm3n_o2od_1900_40_007198800_1	544,320	913,019	1.6774
04 May 2014 22:11:35	952301	12738789	hadcm3n_o2od_1900_40_007198800_1	518,400	871,348	1.6808
25 Mar 2013 23:12:19	952301	12738789	hadcm3n_o2od_1900_40_007198800_1	492,480	829,572	1.6845
17 Mar 2013 19:42:03	952301	12738789	hadcm3n_o2od_1900_40_007198800_1	466,560	785,228	1.6830
13 Mar 2013 19:42:14	952301	12738789	hadcm3n_o2od_1900_40_007198800_1	440,640	739,973	1.6793
08 Mar 2013 22:19:30	952301	12738789	hadcm3n_o2od_1900_40_007198800_1	414,720	694,761	1.6753
28 Feb 2013 22:14:39	952301	12738789	hadcm3n_o2od_1900_40_007198800_1	388,800	649,930	1.6716
25 Feb 2013 20:35:14	952301	12738789	hadcm3n_o2od_1900_40_007198800_1	362,880	603,962	1.6644
16 Feb 2013 23:04:58	952301	12738789	hadcm3n_o2od_1900_40_007198800_1	336,960	558,359	1.6570
10 Feb 2013 23:34:03	952301	12738789	hadcm3n_o2od_1900_40_007198800_1	311,040	512,878	1.6489
31 Jan 2013 23:14:41	952301	12738789	hadcm3n_o2od_1900_40_007198800_1	285,120	466,622	1.6366