Task 15467926

Name	hadcm3n_zen9_1880_40_008246862_2
Workunit	8401986
Created	1 Dec 2012, 0:48:26 UTC
Sent	1 Dec 2012, 0:49:02 UTC
Report deadline	2 Mar 2013, 8:16:13 UTC
Received	17 Jan 2013, 11:14:11 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1284994
Run time	21 days 11 hours 27 min 46 sec
CPU time	18 days 9 hours 42 min 52 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.31 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.42</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2444, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5796, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1992, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4940, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4852, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2724, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=968, iMonCtr=1 Model crash detected, will try to restart... 21:07:11 (5000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2360, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1064, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x778C3F99 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_zen9_1880_40_008246862/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Jan 2013 11:10:03	1130983	15467926	hadcm3n_zen9_1880_40_008246862_2	777,600	1,590,164	2.0450
14 Jan 2013 08:53:48	1130983	15467926	hadcm3n_zen9_1880_40_008246862_2	751,680	1,552,686	2.0656
13 Jan 2013 04:23:47	1130983	15467926	hadcm3n_zen9_1880_40_008246862_2	725,760	1,515,493	2.0881
12 Jan 2013 06:03:50	1130983	15467926	hadcm3n_zen9_1880_40_008246862_2	699,840	1,478,244	2.1123
11 Jan 2013 06:13:52	1130983	15467926	hadcm3n_zen9_1880_40_008246862_2	673,920	1,441,037	2.1383
09 Jan 2013 10:10:27	1130983	15467926	hadcm3n_zen9_1880_40_008246862_2	648,000	1,402,350	2.1641
06 Jan 2013 06:40:41	1130983	15467926	hadcm3n_zen9_1880_40_008246862_2	622,080	1,363,986	2.1926
05 Jan 2013 07:05:25	1130983	15467926	hadcm3n_zen9_1880_40_008246862_2	596,160	1,325,906	2.2241
03 Jan 2013 21:11:49	1130983	15467926	hadcm3n_zen9_1880_40_008246862_2	570,240	1,287,435	2.2577
02 Jan 2013 23:33:52	1130983	15467926	hadcm3n_zen9_1880_40_008246862_2	544,320	1,249,556	2.2956
01 Jan 2013 15:40:58	1130983	15467926	hadcm3n_zen9_1880_40_008246862_2	518,400	1,211,394	2.3368
31 Dec 2012 23:39:20	1130983	15467926	hadcm3n_zen9_1880_40_008246862_2	492,480	1,175,454	2.3868
31 Dec 2012 11:50:00	1130983	15467926	hadcm3n_zen9_1880_40_008246862_2	466,560	1,136,112	2.4351
30 Dec 2012 12:10:10	1130983	15467926	hadcm3n_zen9_1880_40_008246862_2	440,640	1,097,909	2.4916
29 Dec 2012 23:01:55	1130983	15467926	hadcm3n_zen9_1880_40_008246862_2	414,720	1,058,664	2.5527
29 Dec 2012 07:50:10	1130983	15467926	hadcm3n_zen9_1880_40_008246862_2	388,800	1,019,258	2.6215
28 Dec 2012 08:24:20	1130983	15467926	hadcm3n_zen9_1880_40_008246862_2	362,880	980,506	2.7020
27 Dec 2012 19:38:48	1130983	15467926	hadcm3n_zen9_1880_40_008246862_2	336,960	941,608	2.7944
16 Dec 2012 10:44:56	1130983	15467926	hadcm3n_zen9_1880_40_008246862_2	311,040	450,736	1.4491
15 Dec 2012 22:32:13	1130983	15467926	hadcm3n_zen9_1880_40_008246862_2	285,120	414,641	1.4543