Task 15458661

Name	hadcm3n_zi8x_1880_40_008253068_1
Workunit	8408192
Created	23 Nov 2012, 17:46:17 UTC
Sent	23 Nov 2012, 20:07:40 UTC
Report deadline	23 Feb 2013, 3:34:51 UTC
Received	9 Jan 2013, 20:32:41 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1098598
Run time	10 days 2 hours 37 min 26 sec
CPU time	10 days 1 hours 53 min 57 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.30 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:41:42 (3528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:36:42 (5024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:04:18 (4996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:11:00 (5340): No heartbeat from core client for 30 sec - exiting 23:11:01 (5340): No heartbeat from core client for 30 sec - exiting 23:11:02 (5340): No heartbeat from core client for 30 sec - exiting 23:11:04 (5340): No heartbeat from core client for 30 sec - exiting 23:11:05 (5340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:26:00 (4988): No heartbeat from core client for 30 sec - exiting 10:26:01 (4988): No heartbeat from core client for 30 sec - exiting 10:26:03 (4988): No heartbeat from core client for 30 sec - exiting 10:26:04 (4988): No heartbeat from core client for 30 sec - exiting 10:26:05 (4988): No heartbeat from core client for 30 sec - exiting 10:26:06 (4988): No heartbeat from core client for 30 sec - exiting 10:26:07 (4988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:26:08 (4988): No heartbeat from core client for 30 sec - exiting 19:29:48 (6072): No heartbeat from core client for 30 sec - exiting 19:29:49 (6072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3712, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:52:14 (4496): No heartbeat from core client for 30 sec - exiting 18:52:15 (4496): No heartbeat from core client for 30 sec - exiting 18:52:16 (4496): No heartbeat from core client for 30 sec - exiting 18:52:17 (4496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3644, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3644, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4268, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:56:37 (4372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:44:05 (4344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:59:42 (2080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:00:27 (5640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:28:01 (3348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:58:05 (392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:17:42 (5136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:15:36 (3728): No heartbeat from core client for 30 sec - exiting 17:15:37 (3728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:04:35 (4880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:48:52 (7776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:06:08 (3904): No heartbeat from core client for 30 sec - exiting 01:06:09 (3904): No heartbeat from core client for 30 sec - exiting 01:06:10 (3904): No heartbeat from core client for 30 sec - exiting 01:06:12 (3904): No heartbeat from core client for 30 sec - exiting 01:06:13 (3904): No heartbeat from core client for 30 sec - exiting 01:06:14 (3904): No heartbeat from core client for 30 sec - exiting 01:06:15 (3904): No heartbeat from core client for 30 sec - exiting 01:06:16 (3904): No heartbeat from core client for 30 sec - exiting 01:06:17 (3904): No heartbeat from core client for 30 sec - exiting 01:06:18 (3904): No heartbeat from core client for 30 sec - exiting 01:06:19 (3904): No heartbeat from core client for 30 sec - exiting 01:06:20 (3904): No heartbeat from core client for 30 sec - exiting 01:06:21 (3904): No heartbeat from core client for 30 sec - exiting 01:06:22 (3904): No heartbeat from core client for 30 sec - exiting 01:06:24 (3904): No heartbeat from core client for 30 sec - exiting 01:06:25 (3904): No heartbeat from core client for 30 sec - exiting 01:06:26 (3904): No heartbeat from core client for 30 sec - exiting 01:06:27 (3904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5268, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5268, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:52:19 (4396): No heartbeat from core client for 30 sec - exiting 10:52:20 (4396): No heartbeat from core client for 30 sec - exiting 10:52:21 (4396): No heartbeat from core client for 30 sec - exiting 10:52:22 (4396): No heartbeat from core client for 30 sec - exiting 10:52:23 (4396): No heartbeat from core client for 30 sec - exiting 10:52:24 (4396): No heartbeat from core client for 30 sec - exiting 10:52:25 (4396): No heartbeat from core client for 30 sec - exiting 10:52:26 (4396): No heartbeat from core client for 30 sec - exiting 10:52:28 (4396): No heartbeat from core client for 30 sec - exiting 10:52:29 (4396): No heartbeat from core client for 30 sec - exiting 10:52:30 (4396): No heartbeat from core client for 30 sec - exiting 10:52:31 (4396): No heartbeat from core client for 30 sec - exiting 10:52:32 (4396): No heartbeat from core client for 30 sec - exiting 10:52:33 (4396): No heartbeat from core client for 30 sec - exiting 10:52:34 (4396): No heartbeat from core client for 30 sec - exiting 10:52:35 (4396): No heartbeat from core client for 30 sec - exiting 10:52:36 (4396): No heartbeat from core client for 30 sec - exiting 10:52:37 (4396): No heartbeat from core client for 30 sec - exiting 10:52:38 (4396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:15:08 (5348): No heartbeat from core client for 30 sec - exiting 12:15:09 (5348): No heartbeat from core client for 30 sec - exiting 12:15:10 (5348): No heartbeat from core client for 30 sec - exiting 12:15:11 (5348): No heartbeat from core client for 30 sec - exiting 12:15:12 (5348): No heartbeat from core client for 30 sec - exiting 12:15:13 (5348): No heartbeat from core client for 30 sec - exiting 12:15:14 (5348): No heartbeat from core client for 30 sec - exiting 12:15:15 (5348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:15:16 (5348): No heartbeat from core client for 30 sec - exiting Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Jan 2013 12:25:04	1098598	15458661	hadcm3n_zi8x_1880_40_008253068_1	777,600	870,804	1.1199
08 Jan 2013 14:00:27	1098598	15458661	hadcm3n_zi8x_1880_40_008253068_1	751,680	841,880	1.1200
07 Jan 2013 14:06:15	1098598	15458661	hadcm3n_zi8x_1880_40_008253068_1	725,760	813,341	1.1207
06 Jan 2013 21:12:39	1098598	15458661	hadcm3n_zi8x_1880_40_008253068_1	699,840	784,559	1.1211
06 Jan 2013 13:07:01	1098598	15458661	hadcm3n_zi8x_1880_40_008253068_1	673,920	755,441	1.1210
04 Jan 2013 14:00:20	1098598	15458661	hadcm3n_zi8x_1880_40_008253068_1	648,000	726,508	1.1212
03 Jan 2013 13:55:34	1098598	15458661	hadcm3n_zi8x_1880_40_008253068_1	622,080	697,407	1.1211
31 Dec 2012 20:37:28	1098598	15458661	hadcm3n_zi8x_1880_40_008253068_1	596,160	668,367	1.1211
30 Dec 2012 14:30:40	1098598	15458661	hadcm3n_zi8x_1880_40_008253068_1	570,240	639,913	1.1222
29 Dec 2012 15:47:15	1098598	15458661	hadcm3n_zi8x_1880_40_008253068_1	544,320	611,018	1.1225
28 Dec 2012 21:32:09	1098598	15458661	hadcm3n_zi8x_1880_40_008253068_1	518,400	581,589	1.1219
27 Dec 2012 21:56:42	1098598	15458661	hadcm3n_zi8x_1880_40_008253068_1	492,480	551,894	1.1206
27 Dec 2012 11:55:05	1098598	15458661	hadcm3n_zi8x_1880_40_008253068_1	466,560	522,730	1.1204
26 Dec 2012 12:29:44	1098598	15458661	hadcm3n_zi8x_1880_40_008253068_1	440,640	493,823	1.1207
24 Dec 2012 21:49:34	1098598	15458661	hadcm3n_zi8x_1880_40_008253068_1	414,720	464,593	1.1203
24 Dec 2012 12:30:14	1098598	15458661	hadcm3n_zi8x_1880_40_008253068_1	388,800	435,449	1.1200
22 Dec 2012 22:00:26	1098598	15458661	hadcm3n_zi8x_1880_40_008253068_1	362,880	405,943	1.1187
22 Dec 2012 12:00:03	1098598	15458661	hadcm3n_zi8x_1880_40_008253068_1	336,960	376,640	1.1178
21 Dec 2012 16:32:28	1098598	15458661	hadcm3n_zi8x_1880_40_008253068_1	311,040	346,930	1.1154
19 Dec 2012 18:55:12	1098598	15458661	hadcm3n_zi8x_1880_40_008253068_1	285,120	317,878	1.1149