Task 15399647

Name	hadcm3n_100n_1940_40_008239256_1
Workunit	8394380
Created	26 Oct 2012, 16:18:08 UTC
Sent	26 Oct 2012, 16:18:14 UTC
Report deadline	25 Jan 2013, 23:45:25 UTC
Received	22 Dec 2012, 0:03:14 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1058020
Run time	32 days 16 hours 7 min 31 sec
CPU time	32 days 16 hours 7 min 31 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.18 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1080, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5528, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5676, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=632, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3184, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3464, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6268, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6348, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2496, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3252, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=996, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1244, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3952, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3468, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3032, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4772, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7731FF2B write attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x773971A8 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_100n_1940_40_008239256/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Dec 2012 13:01:53	1058020	15399647	hadcm3n_100n_1940_40_008239256_1	777,600	2,776,712	3.5709
18 Dec 2012 21:08:58	1058020	15399647	hadcm3n_100n_1940_40_008239256_1	751,680	2,671,921	3.5546
16 Dec 2012 19:39:23	1058020	15399647	hadcm3n_100n_1940_40_008239256_1	725,760	2,565,908	3.5355
15 Dec 2012 02:37:21	1058020	15399647	hadcm3n_100n_1940_40_008239256_1	699,840	2,463,577	3.5202
14 Dec 2012 13:21:13	1058020	15399647	hadcm3n_100n_1940_40_008239256_1	673,920	2,359,808	3.5016
14 Dec 2012 13:21:13	1058020	15399647	hadcm3n_100n_1940_40_008239256_1	648,000	2,247,766	3.4688
14 Dec 2012 13:21:13	1058020	15399647	hadcm3n_100n_1940_40_008239256_1	622,080	2,150,677	3.4572
14 Dec 2012 13:21:13	1058020	15399647	hadcm3n_100n_1940_40_008239256_1	596,160	2,046,513	3.4328
06 Dec 2012 05:02:41	1058020	15399647	hadcm3n_100n_1940_40_008239256_1	570,240	1,942,714	3.4068
04 Dec 2012 20:24:33	1058020	15399647	hadcm3n_100n_1940_40_008239256_1	544,320	1,852,271	3.4029
03 Dec 2012 00:32:46	1058020	15399647	hadcm3n_100n_1940_40_008239256_1	518,400	1,733,911	3.3447
01 Dec 2012 07:36:01	1058020	15399647	hadcm3n_100n_1940_40_008239256_1	492,480	1,628,144	3.3060
29 Nov 2012 18:02:26	1058020	15399647	hadcm3n_100n_1940_40_008239256_1	466,560	1,528,782	3.2767
27 Nov 2012 03:57:39	1058020	15399647	hadcm3n_100n_1940_40_008239256_1	440,640	1,421,979	3.2271
25 Nov 2012 00:03:26	1058020	15399647	hadcm3n_100n_1940_40_008239256_1	414,720	1,310,677	3.1604
23 Nov 2012 13:08:28	1058020	15399647	hadcm3n_100n_1940_40_008239256_1	388,800	1,216,732	3.1295
22 Nov 2012 12:38:12	1058020	15399647	hadcm3n_100n_1940_40_008239256_1	362,880	1,149,752	3.1684
21 Nov 2012 19:11:43	1058020	15399647	hadcm3n_100n_1940_40_008239256_1	336,960	1,087,104	3.2262
20 Nov 2012 19:45:54	1058020	15399647	hadcm3n_100n_1940_40_008239256_1	311,040	1,021,019	3.2826
19 Nov 2012 19:57:45	1058020	15399647	hadcm3n_100n_1940_40_008239256_1	285,120	950,585	3.3340