Task 15914282

Name	hadcm3n_zfxz_1960_40_008361898_1
Workunit	8512757
Created	14 Aug 2013, 11:38:28 UTC
Sent	14 Aug 2013, 16:56:36 UTC
Report deadline	14 Nov 2013, 0:23:47 UTC
Received	24 Aug 2013, 8:15:34 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1242385
Run time	6 days 8 hours 50 min 1 sec
CPU time	6 days 4 hours 23 min 26 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.17 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> 14:07:18 (7200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:34:19 (6464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:02:11 (7528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:02:12 (7528): No heartbeat from core client for 30 sec - exiting 13:02:13 (7528): No heartbeat from core client for 30 sec - exiting 13:02:14 (7528): No heartbeat from core client for 30 sec - exiting 13:02:15 (7528): No heartbeat from core client for 30 sec - exiting 13:02:16 (7528): No heartbeat from core client for 30 sec - exiting 13:02:17 (7528): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6156, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6156, iMonCtr=1 Model crash detected, will try to restart... 08:42:18 (8068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:01:57 (7148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8384, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:59:16 (932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:59:17 (932): No heartbeat from core client for 30 sec - exiting 13:59:18 (932): No heartbeat from core client for 30 sec - exiting 13:59:19 (932): No heartbeat from core client for 30 sec - exiting 13:59:20 (932): No heartbeat from core client for 30 sec - exiting 13:59:21 (932): No heartbeat from core client for 30 sec - exiting 13:59:22 (932): No heartbeat from core client for 30 sec - exiting 13:59:23 (932): No heartbeat from core client for 30 sec - exiting 13:59:24 (932): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:56:57 (6320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:56:20 (6668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:56:21 (6668): No heartbeat from core client for 30 sec - exiting 09:56:22 (6668): No heartbeat from core client for 30 sec - exiting 09:56:23 (6668): No heartbeat from core client for 30 sec - exiting 09:56:24 (6668): No heartbeat from core client for 30 sec - exiting 09:56:25 (6668): No heartbeat from core client for 30 sec - exiting 09:56:26 (6668): No heartbeat from core client for 30 sec - exiting 09:56:27 (6668): No heartbeat from core client for 30 sec - exiting 09:56:28 (6668): No heartbeat from core client for 30 sec - exiting 09:56:29 (6668): No heartbeat from core client for 30 sec - exiting 09:56:30 (6668): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:04:31 (2332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:04:32 (2332): No heartbeat from core client for 30 sec - exiting 14:04:33 (2332): No heartbeat from core client for 30 sec - exiting 14:04:34 (2332): No heartbeat from core client for 30 sec - exiting 14:04:35 (2332): No heartbeat from core client for 30 sec - exiting 14:04:36 (2332): No heartbeat from core client for 30 sec - exiting 14:04:37 (2332): No heartbeat from core client for 30 sec - exiting 14:04:38 (2332): No heartbeat from core client for 30 sec - exiting 14:04:39 (2332): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:28:00 (5248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:19:36 (1936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:19:37 (1936): No heartbeat from core client for 30 sec - exiting 08:19:38 (1936): No heartbeat from core client for 30 sec - exiting 08:19:39 (1936): No heartbeat from core client for 30 sec - exiting 08:19:40 (1936): No heartbeat from core client for 30 sec - exiting 08:19:41 (1936): No heartbeat from core client for 30 sec - exiting 08:19:42 (1936): No heartbeat from core client for 30 sec - exiting 08:19:43 (1936): No heartbeat from core client for 30 sec - exiting 08:19:44 (1936): No heartbeat from core client for 30 sec - exiting 08:19:45 (1936): No heartbeat from core client for 30 sec - exiting 08:19:46 (1936): No heartbeat from core client for 30 sec - exiting 08:28:50 (1468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:01:57 (5988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:04:27 (4744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:04:28 (4744): No heartbeat from core client for 30 sec - exiting 14:04:29 (4744): No heartbeat from core client for 30 sec - exiting 14:04:30 (4744): No heartbeat from core client for 30 sec - exiting 14:04:31 (4744): No heartbeat from core client for 30 sec - exiting 14:04:32 (4744): No heartbeat from core client for 30 sec - exiting 14:04:33 (4744): No heartbeat from core client for 30 sec - exiting 14:04:34 (4744): No heartbeat from core client for 30 sec - exiting 14:04:35 (4744): No heartbeat from core client for 30 sec - exiting 14:04:36 (4744): No heartbeat from core client for 30 sec - exiting 14:04:37 (4744): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6756, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:02:20 (1772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Aug 2013 07:17:49	1242385	15914282	hadcm3n_zfxz_1960_40_008361898_1	259,200	534,204	2.0610
23 Aug 2013 13:27:20	1242385	15914282	hadcm3n_zfxz_1960_40_008361898_1	233,280	476,737	2.0436
23 Aug 2013 12:26:47	1242385	15914282	hadcm3n_zfxz_1960_40_008361898_1	207,360	425,682	2.0529
22 Aug 2013 05:13:22	1242385	15914282	hadcm3n_zfxz_1960_40_008361898_1	181,440	369,818	2.0382
21 Aug 2013 10:17:10	1242385	15914282	hadcm3n_zfxz_1960_40_008361898_1	155,520	314,162	2.0201
20 Aug 2013 17:00:38	1242385	15914282	hadcm3n_zfxz_1960_40_008361898_1	129,600	256,820	1.9816
20 Aug 2013 02:26:30	1242385	15914282	hadcm3n_zfxz_1960_40_008361898_1	103,680	207,853	2.0048
16 Aug 2013 17:51:30	1242385	15914282	hadcm3n_zfxz_1960_40_008361898_1	77,760	155,434	1.9989
16 Aug 2013 03:03:09	1242385	15914282	hadcm3n_zfxz_1960_40_008361898_1	51,840	105,956	2.0439
15 Aug 2013 10:31:10	1242385	15914282	hadcm3n_zfxz_1960_40_008361898_1	25,920	55,708	2.1492