Task 14032960

Name	hadcm3n_u5y9_1980_40_007743019_1
Workunit	7898127
Created	30 Jan 2012, 17:01:30 UTC
Sent	30 Jan 2012, 17:10:38 UTC
Report deadline	1 May 2012, 0:37:49 UTC
Received	29 Feb 2012, 3:42:06 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1193311
Run time	20 days 21 hours 34 min 41 sec
CPU time	18 days 13 hours 21 min 45 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.62 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:25:32 (4544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:25:35 (4544): No heartbeat from core client for 30 sec - exiting 04:25:36 (4544): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5728, iMonCtr=1 Model crash detected, will try to restart... 06:48:17 (5996): No heartbeat from core client for 30 sec - exiting 06:48:18 (5996): No heartbeat from core client for 30 sec - exiting 06:48:20 (5996): No heartbeat from core client for 30 sec - exiting 06:48:21 (5996): No heartbeat from core client for 30 sec - exiting 06:48:22 (5996): No heartbeat from core client for 30 sec - exiting 06:48:23 (5996): No heartbeat from core client for 30 sec - exiting 06:48:24 (5996): No heartbeat from core client for 30 sec - exiting 06:48:25 (5996): No heartbeat from core client for 30 sec - exiting 06:48:26 (5996): No heartbeat from core client for 30 sec - exiting 06:48:27 (5996): No heartbeat from core client for 30 sec - exiting 06:48:28 (5996): No heartbeat from core client for 30 sec - exiting 06:48:29 (5996): No heartbeat from core client for 30 sec - exiting 06:48:30 (5996): No heartbeat from core client for 30 sec - exiting 06:48:32 (5996): No heartbeat from core client for 30 sec - exiting 06:48:33 (5996): No heartbeat from core client for 30 sec - exiting 06:48:34 (5996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:35:59 (3476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:23:04 (6744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:14:32 (6700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:14:33 (6700): No heartbeat from core client for 30 sec - exiting 17:34:22 (6976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:35:20 (5832): No heartbeat from core client for 30 sec - exiting 17:35:21 (5832): No heartbeat from core client for 30 sec - exiting 17:35:22 (5832): No heartbeat from core client for 30 sec - exiting 17:35:23 (5832): No heartbeat from core client for 30 sec - exiting 17:35:24 (5832): No heartbeat from core client for 30 sec - exiting 17:35:25 (5832): No heartbeat from core client for 30 sec - exiting 17:35:26 (5832): No heartbeat from core client for 30 sec - exiting 17:35:27 (5832): No heartbeat from core client for 30 sec - exiting 17:35:28 (5832): No heartbeat from core client for 30 sec - exiting 17:35:29 (5832): No heartbeat from core client for 30 sec - exiting 17:35:30 (5832): No heartbeat from core client for 30 sec - exiting 17:35:31 (5832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2128, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2984, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2852, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2904, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:17:20 (6228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:21:18 (284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:57:45 (4800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:27:45 (7144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:58:58 (7600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:58:59 (7600): No heartbeat from core client for 30 sec - exiting 18:59:01 (7600): No heartbeat from core client for 30 sec - exiting 18:59:02 (7600): No heartbeat from core client for 30 sec - exiting 18:59:03 (7600): No heartbeat from core client for 30 sec - exiting 18:59:04 (7600): No heartbeat from core client for 30 sec - exiting 18:59:05 (7600): No heartbeat from core client for 30 sec - exiting 18:59:06 (7600): No heartbeat from core client for 30 sec - exiting 18:59:07 (7600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:41:49 (5300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:48:39 (5364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77D13AB3 read attempt to address 0x40D07468 Engaging BOINC Windows Runtime Debugger... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6824, selfPID=6824, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77D13AB3 read attempt to address 0x40D07468 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_u5y9_1980_40_007743019/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Feb 2012 15:51:59	1193311	14032960	hadcm3n_u5y9_1980_40_007743019_1	777,600	1,582,917	2.0356
27 Feb 2012 18:33:46	1193311	14032960	hadcm3n_u5y9_1980_40_007743019_1	751,680	1,529,542	2.0348
27 Feb 2012 00:42:52	1193311	14032960	hadcm3n_u5y9_1980_40_007743019_1	725,760	1,478,740	2.0375
25 Feb 2012 19:28:32	1193311	14032960	hadcm3n_u5y9_1980_40_007743019_1	699,840	1,425,818	2.0373
25 Feb 2012 00:06:00	1193311	14032960	hadcm3n_u5y9_1980_40_007743019_1	673,920	1,370,934	2.0343
24 Feb 2012 02:57:08	1193311	14032960	hadcm3n_u5y9_1980_40_007743019_1	648,000	1,318,432	2.0346
21 Feb 2012 11:30:39	1193311	14032960	hadcm3n_u5y9_1980_40_007743019_1	622,080	1,267,335	2.0373
19 Feb 2012 20:37:27	1193311	14032960	hadcm3n_u5y9_1980_40_007743019_1	596,160	1,214,784	2.0377
19 Feb 2012 01:54:00	1193311	14032960	hadcm3n_u5y9_1980_40_007743019_1	570,240	1,161,129	2.0362
18 Feb 2012 07:03:44	1193311	14032960	hadcm3n_u5y9_1980_40_007743019_1	544,320	1,108,678	2.0368
17 Feb 2012 12:19:43	1193311	14032960	hadcm3n_u5y9_1980_40_007743019_1	518,400	1,054,260	2.0337
16 Feb 2012 17:47:34	1193311	14032960	hadcm3n_u5y9_1980_40_007743019_1	492,480	999,246	2.0290
14 Feb 2012 02:36:48	1193311	14032960	hadcm3n_u5y9_1980_40_007743019_1	466,560	946,484	2.0286
13 Feb 2012 10:04:13	1193311	14032960	hadcm3n_u5y9_1980_40_007743019_1	440,640	894,776	2.0306
12 Feb 2012 17:41:43	1193311	14032960	hadcm3n_u5y9_1980_40_007743019_1	414,720	842,818	2.0323
12 Feb 2012 02:46:50	1193311	14032960	hadcm3n_u5y9_1980_40_007743019_1	388,800	791,754	2.0364
11 Feb 2012 10:15:26	1193311	14032960	hadcm3n_u5y9_1980_40_007743019_1	362,880	740,380	2.0403
10 Feb 2012 15:20:18	1193311	14032960	hadcm3n_u5y9_1980_40_007743019_1	336,960	689,280	2.0456
09 Feb 2012 23:13:09	1193311	14032960	hadcm3n_u5y9_1980_40_007743019_1	311,040	635,905	2.0444
09 Feb 2012 06:48:38	1193311	14032960	hadcm3n_u5y9_1980_40_007743019_1	285,120	582,298	2.0423