Task 14104245

Name	hadcm3n_t3ye_1940_40_007753329_3
Workunit	7908438
Created	17 Feb 2012, 7:21:34 UTC
Sent	17 Feb 2012, 7:21:40 UTC
Report deadline	18 May 2012, 14:48:51 UTC
Received	8 Apr 2012, 4:56:02 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1138128
Run time	17 days 23 hours 53 min 26 sec
CPU time	14 days 18 hours 54 min 28 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.33 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3828, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4288, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3724, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3732, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2588, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3748, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3968, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4060, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3252, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3936, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4284, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2508, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3708, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4384, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3472, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3396, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3500, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3096, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4056, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3032, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3284, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3948, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3544, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4028, iMonCtr=1 Model crash detected, will try to restart... CSuspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3760, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2536, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1244, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3872, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3740, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3212, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3576, iMonCtr=1 Model crash detected, will try to restart... CCController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3616, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3324, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4004, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3556, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3772, iMonCtr=1 Model crash detected, will try to restart... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3404, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77DA3AB3 read attempt to address 0x40D876A0 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77817373 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_t3ye_1940_40_007753329/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Apr 2012 13:27:09	1138128	14104245	hadcm3n_t3ye_1940_40_007753329_3	518,400	1,260,818	2.4321
04 Apr 2012 19:23:00	1138128	14104245	hadcm3n_t3ye_1940_40_007753329_3	492,480	1,198,028	2.4326
01 Apr 2012 17:09:49	1138128	14104245	hadcm3n_t3ye_1940_40_007753329_3	466,560	1,137,532	2.4381
30 Mar 2012 14:37:48	1138128	14104245	hadcm3n_t3ye_1940_40_007753329_3	440,640	1,078,296	2.4471
26 Mar 2012 18:16:56	1138128	14104245	hadcm3n_t3ye_1940_40_007753329_3	414,720	1,014,504	2.4462
24 Mar 2012 12:14:58	1138128	14104245	hadcm3n_t3ye_1940_40_007753329_3	388,800	950,798	2.4455
21 Mar 2012 17:41:41	1138128	14104245	hadcm3n_t3ye_1940_40_007753329_3	362,880	886,382	2.4426
18 Mar 2012 17:17:29	1138128	14104245	hadcm3n_t3ye_1940_40_007753329_3	336,960	822,781	2.4418
17 Mar 2012 10:31:04	1138128	14104245	hadcm3n_t3ye_1940_40_007753329_3	311,040	759,819	2.4428
15 Mar 2012 19:30:28	1138128	14104245	hadcm3n_t3ye_1940_40_007753329_3	285,120	696,508	2.4429
12 Mar 2012 14:44:50	1138128	14104245	hadcm3n_t3ye_1940_40_007753329_3	259,200	635,292	2.4510
10 Mar 2012 13:42:27	1138128	14104245	hadcm3n_t3ye_1940_40_007753329_3	233,280	568,248	2.4359
08 Mar 2012 21:08:51	1138128	14104245	hadcm3n_t3ye_1940_40_007753329_3	207,360	502,916	2.4253
05 Mar 2012 14:49:48	1138128	14104245	hadcm3n_t3ye_1940_40_007753329_3	181,440	441,105	2.4311
03 Mar 2012 11:42:56	1138128	14104245	hadcm3n_t3ye_1940_40_007753329_3	155,520	377,384	2.4266
29 Feb 2012 17:03:11	1138128	14104245	hadcm3n_t3ye_1940_40_007753329_3	129,600	309,275	2.3864
27 Feb 2012 11:24:29	1138128	14104245	hadcm3n_t3ye_1940_40_007753329_3	103,680	247,653	2.3886
25 Feb 2012 12:39:47	1138128	14104245	hadcm3n_t3ye_1940_40_007753329_3	77,760	185,902	2.3907
21 Feb 2012 19:40:45	1138128	14104245	hadcm3n_t3ye_1940_40_007753329_3	51,840	123,792	2.3880
19 Feb 2012 01:18:23	1138128	14104245	hadcm3n_t3ye_1940_40_007753329_3	25,920	62,655	2.4172