Task 15801299

Name	hadcm3n_n4f8_1880_40_008372929_0
Workunit	8523788
Created	29 May 2013, 17:54:43 UTC
Sent	29 May 2013, 17:58:16 UTC
Report deadline	29 Aug 2013, 1:25:27 UTC
Received	10 Jun 2013, 21:39:22 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1169487
Run time	4 days 11 hours 40 min 45 sec
CPU time	4 days 10 hours 55 min 21 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.40 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:26:09 (8052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:26:10 (8052): No heartbeat from core client for 30 sec - exiting 08:26:11 (8052): No heartbeat from core client for 30 sec - exiting 08:26:12 (8052): No heartbeat from core client for 30 sec - exiting 08:26:13 (8052): No heartbeat from core client for 30 sec - exiting 08:26:14 (8052): No heartbeat from core client for 30 sec - exiting 08:26:15 (8052): No heartbeat from core client for 30 sec - exiting 08:26:16 (8052): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:33:39 (7396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7668, iMonCtr=1 Model crash detected, will try to restart... 18:06:53 (320): No heartbeat from core client for 30 sec - exiting 18:06:54 (320): No heartbeat from core client for 30 sec - exiting 18:06:56 (320): No heartbeat from core client for 30 sec - exiting 18:06:57 (320): No heartbeat from core client for 30 sec - exiting 18:06:58 (320): No heartbeat from core client for 30 sec - exiting 18:06:59 (320): No heartbeat from core client for 30 sec - exiting 18:07:00 (320): No heartbeat from core client for 30 sec - exiting 18:07:01 (320): No heartbeat from core client for 30 sec - exiting 18:07:02 (320): No heartbeat from core client for 30 sec - exiting 18:07:03 (320): No heartbeat from core client for 30 sec - exiting 18:07:04 (320): No heartbeat from core client for 30 sec - exiting 18:07:05 (320): No heartbeat from core client for 30 sec - exiting 18:07:06 (320): No heartbeat from core client for 30 sec - exiting 18:07:07 (320): No heartbeat from core client for 30 sec - exiting 18:07:08 (320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:07:09 (320): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:45:22 (3468): No heartbeat from core client for 30 sec - exiting 07:45:23 (3468): No heartbeat from core client for 30 sec - exiting 07:45:24 (3468): No heartbeat from core client for 30 sec - exiting 07:45:25 (3468): No heartbeat from core client for 30 sec - exiting 07:45:26 (3468): No heartbeat from core client for 30 sec - exiting 07:45:27 (3468): No heartbeat from core client for 30 sec - exiting 07:45:28 (3468): No heartbeat from core client for 30 sec - exiting 07:45:29 (3468): No heartbeat from core client for 30 sec - exiting 07:45:30 (3468): No heartbeat from core client for 30 sec - exiting 07:45:31 (3468): No heartbeat from core client for 30 sec - exiting 07:45:32 (3468): No heartbeat from core client for 30 sec - exiting 07:45:33 (3468): No heartbeat from core client for 30 sec - exiting 07:45:34 (3468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:52:58 (3124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CSuspended CPDN Monitor - Suspend request from BOINC... 07:31:38 (7572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7648, iMonCtr=1 Model crash detected, will try to restart... 17:11:29 (2648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:39:27 (7208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Jun 2013 21:42:40	1169487	15801299	hadcm3n_n4f8_1880_40_008372929_0	518,400	384,917	0.7425
09 Jun 2013 20:40:55	1169487	15801299	hadcm3n_n4f8_1880_40_008372929_0	492,480	365,667	0.7425
09 Jun 2013 15:17:11	1169487	15801299	hadcm3n_n4f8_1880_40_008372929_0	466,560	346,274	0.7422
09 Jun 2013 10:00:07	1169487	15801299	hadcm3n_n4f8_1880_40_008372929_0	440,640	327,100	0.7423
08 Jun 2013 19:17:03	1169487	15801299	hadcm3n_n4f8_1880_40_008372929_0	414,720	307,761	0.7421
08 Jun 2013 08:58:44	1169487	15801299	hadcm3n_n4f8_1880_40_008372929_0	388,800	288,613	0.7423
07 Jun 2013 20:15:58	1169487	15801299	hadcm3n_n4f8_1880_40_008372929_0	362,880	269,213	0.7419
06 Jun 2013 20:54:04	1169487	15801299	hadcm3n_n4f8_1880_40_008372929_0	336,960	249,931	0.7417
05 Jun 2013 20:59:43	1169487	15801299	hadcm3n_n4f8_1880_40_008372929_0	311,040	230,681	0.7416
03 Jun 2013 23:03:58	1169487	15801299	hadcm3n_n4f8_1880_40_008372929_0	285,120	211,327	0.7412
02 Jun 2013 23:10:34	1169487	15801299	hadcm3n_n4f8_1880_40_008372929_0	259,200	192,017	0.7408
02 Jun 2013 18:09:02	1169487	15801299	hadcm3n_n4f8_1880_40_008372929_0	233,280	172,634	0.7400
01 Jun 2013 22:19:43	1169487	15801299	hadcm3n_n4f8_1880_40_008372929_0	207,360	153,502	0.7403
01 Jun 2013 16:58:01	1169487	15801299	hadcm3n_n4f8_1880_40_008372929_0	181,440	134,291	0.7401
01 Jun 2013 11:35:25	1169487	15801299	hadcm3n_n4f8_1880_40_008372929_0	155,520	115,103	0.7401
31 May 2013 20:31:11	1169487	15801299	hadcm3n_n4f8_1880_40_008372929_0	129,600	95,834	0.7395
31 May 2013 15:57:59	1169487	15801299	hadcm3n_n4f8_1880_40_008372929_0	103,680	76,667	0.7395
30 May 2013 21:36:09	1169487	15801299	hadcm3n_n4f8_1880_40_008372929_0	77,760	57,478	0.7392
30 May 2013 16:13:49	1169487	15801299	hadcm3n_n4f8_1880_40_008372929_0	51,840	38,298	0.7388
30 May 2013 11:35:35	1169487	15801299	hadcm3n_n4f8_1880_40_008372929_0	25,920	19,187	0.7402