Task 15646103

Name	hadcm3n_4i6r_1980_40_008324151_0
Workunit	8475286
Created	2 Mar 2013, 5:37:02 UTC
Sent	2 Mar 2013, 5:39:59 UTC
Report deadline	1 Jun 2013, 13:07:10 UTC
Received	2 Apr 2013, 6:41:43 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1271682
Run time	28 days 6 hours 39 min 32 sec
CPU time	23 days 10 hours 44 min 1 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.09 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7848, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5284, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5284, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6388, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=756, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6328, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6424, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3848, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6692, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4468, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6264, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6628, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6436, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5964, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6296, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7848, iMonCtr=1 Model crash detected, will try to restart... 23:33:59 (4968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4376, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5480, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6960, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6928, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6116, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6532, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7536, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7536, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6504, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6564, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6756, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6288, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4840, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6028, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6272, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6296, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6752, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x772C2AB1 read attempt to address 0x40965099 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_4i6r_1980_40_008324151/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Apr 2013 05:42:28	1271682	15646103	hadcm3n_4i6r_1980_40_008324151_0	777,600	2,025,838	2.6052
01 Apr 2013 06:13:36	1271682	15646103	hadcm3n_4i6r_1980_40_008324151_0	751,680	1,957,313	2.6039
31 Mar 2013 07:18:44	1271682	15646103	hadcm3n_4i6r_1980_40_008324151_0	725,760	1,889,276	2.6032
30 Mar 2013 08:39:19	1271682	15646103	hadcm3n_4i6r_1980_40_008324151_0	699,840	1,821,930	2.6034
29 Mar 2013 07:00:05	1271682	15646103	hadcm3n_4i6r_1980_40_008324151_0	673,920	1,752,189	2.6000
28 Mar 2013 07:23:14	1271682	15646103	hadcm3n_4i6r_1980_40_008324151_0	648,000	1,684,046	2.5988
27 Mar 2013 06:41:34	1271682	15646103	hadcm3n_4i6r_1980_40_008324151_0	622,080	1,614,086	2.5947
26 Mar 2013 06:05:03	1271682	15646103	hadcm3n_4i6r_1980_40_008324151_0	596,160	1,546,774	2.5946
25 Mar 2013 06:41:44	1271682	15646103	hadcm3n_4i6r_1980_40_008324151_0	570,240	1,479,832	2.5951
24 Mar 2013 07:46:51	1271682	15646103	hadcm3n_4i6r_1980_40_008324151_0	544,320	1,411,935	2.5939
23 Mar 2013 10:44:03	1271682	15646103	hadcm3n_4i6r_1980_40_008324151_0	518,400	1,345,339	2.5952
22 Mar 2013 13:50:11	1271682	15646103	hadcm3n_4i6r_1980_40_008324151_0	492,480	1,278,928	2.5969
21 Mar 2013 16:55:48	1271682	15646103	hadcm3n_4i6r_1980_40_008324151_0	466,560	1,211,907	2.5975
20 Mar 2013 19:58:06	1271682	15646103	hadcm3n_4i6r_1980_40_008324151_0	440,640	1,145,079	2.5987
19 Mar 2013 22:54:37	1271682	15646103	hadcm3n_4i6r_1980_40_008324151_0	414,720	1,078,578	2.6007
19 Mar 2013 01:37:18	1271682	15646103	hadcm3n_4i6r_1980_40_008324151_0	388,800	1,011,841	2.6025
18 Mar 2013 02:06:57	1271682	15646103	hadcm3n_4i6r_1980_40_008324151_0	362,880	943,756	2.6007
17 Mar 2013 01:42:26	1271682	15646103	hadcm3n_4i6r_1980_40_008324151_0	336,960	874,917	2.5965
16 Mar 2013 03:41:32	1271682	15646103	hadcm3n_4i6r_1980_40_008324151_0	311,040	808,216	2.5984
15 Mar 2013 05:52:41	1271682	15646103	hadcm3n_4i6r_1980_40_008324151_0	285,120	771,931	2.7074