Task 15895447

Name	hadcm3n_4cis_1980_40_008325239_4
Workunit	8476374
Created	18 Jul 2013, 13:00:04 UTC
Sent	18 Jul 2013, 13:00:46 UTC
Report deadline	17 Oct 2013, 20:27:57 UTC
Received	13 Sep 2013, 6:31:09 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1145695
Run time	18 days 5 hours 3 min 3 sec
CPU time	16 days 22 hours 7 min 24 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.31 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4320, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4524, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5884, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6600, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4816, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4684, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4540, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4884, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4580, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4632, iMonCtr=1 Model crash detected, will try to restart... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6112, iMonCtr=1 Model crash detected, will try to restart... CSuspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5788, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5048, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3400, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4676, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3520, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1008, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7244, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5384, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77895F1B read attempt to address 0x40CD248C Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x775B5F1B read attempt to address 0x40CD248C Engaging BOINC Windows Runtime Debugger... Cannot serialize file D:\BOINC DATA/projects/climateprediction.net/hadcm3n_4cis_1980_40_008325239/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Sep 2013 07:39:07	1145695	15895447	hadcm3n_4cis_1980_40_008325239_4	518,400	1,421,682	2.7424
10 Sep 2013 13:15:44	1145695	15895447	hadcm3n_4cis_1980_40_008325239_4	492,480	1,352,198	2.7457
08 Sep 2013 11:02:50	1145695	15895447	hadcm3n_4cis_1980_40_008325239_4	466,560	1,283,039	2.7500
06 Sep 2013 17:04:54	1145695	15895447	hadcm3n_4cis_1980_40_008325239_4	440,640	1,211,937	2.7504
03 Sep 2013 16:53:54	1145695	15895447	hadcm3n_4cis_1980_40_008325239_4	414,720	1,139,329	2.7472
02 Sep 2013 06:53:20	1145695	15895447	hadcm3n_4cis_1980_40_008325239_4	388,800	1,068,083	2.7471
30 Aug 2013 13:52:53	1145695	15895447	hadcm3n_4cis_1980_40_008325239_4	362,880	997,915	2.7500
26 Aug 2013 19:46:42	1145695	15895447	hadcm3n_4cis_1980_40_008325239_4	336,960	927,260	2.7518
24 Aug 2013 20:00:41	1145695	15895447	hadcm3n_4cis_1980_40_008325239_4	311,040	857,807	2.7579
23 Aug 2013 12:47:02	1145695	15895447	hadcm3n_4cis_1980_40_008325239_4	285,120	786,960	2.7601
20 Aug 2013 20:31:39	1145695	15895447	hadcm3n_4cis_1980_40_008325239_4	259,200	715,577	2.7607
14 Aug 2013 15:29:27	1145695	15895447	hadcm3n_4cis_1980_40_008325239_4	233,280	645,144	2.7655
14 Aug 2013 15:29:27	1145695	15895447	hadcm3n_4cis_1980_40_008325239_4	207,360	575,628	2.7760
14 Aug 2013 15:29:27	1145695	15895447	hadcm3n_4cis_1980_40_008325239_4	181,440	504,489	2.7805
14 Aug 2013 15:29:27	1145695	15895447	hadcm3n_4cis_1980_40_008325239_4	155,520	435,086	2.7976
14 Aug 2013 15:29:27	1145695	15895447	hadcm3n_4cis_1980_40_008325239_4	129,600	364,576	2.8131
14 Aug 2013 15:29:27	1145695	15895447	hadcm3n_4cis_1980_40_008325239_4	103,680	294,062	2.8362
26 Jul 2013 11:33:08	1145695	15895447	hadcm3n_4cis_1980_40_008325239_4	77,760	221,913	2.8538
24 Jul 2013 11:55:02	1145695	15895447	hadcm3n_4cis_1980_40_008325239_4	51,840	148,601	2.8665
23 Jul 2013 21:22:18	1145695	15895447	hadcm3n_4cis_1980_40_008325239_4	25,920	75,411	2.9094