Task 13304677

Name	hadcm3n_o4t9_1980_40_007426714_2
Workunit	7624217
Created	27 Aug 2011, 1:15:30 UTC
Sent	27 Aug 2011, 1:25:44 UTC
Report deadline	26 Nov 2011, 8:52:55 UTC
Received	25 Sep 2011, 16:24:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1096036
Run time	15 days 11 hours 18 min 10 sec
CPU time	13 days 9 hours 18 min 12 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.39 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:01:03 (8156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5076, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4332, iMonCtr=1 Model crash detected, will try to restart... 07:39:24 (5528): No heartbeat from core client for 30 sec - exiting 07:39:25 (5528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:39:26 (5528): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5260, iMonCtr=1 Model crash detected, will try to restart... 23:44:09 (5816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6012, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5932, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5948, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4728, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5612, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5692, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x778A67A7 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o4t9_1980_40_007426714/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Sep 2011 10:35:42	1096036	13304677	hadcm3n_o4t9_1980_40_007426714_2	518,400	1,156,686	2.2313
22 Sep 2011 12:31:08	1096036	13304677	hadcm3n_o4t9_1980_40_007426714_2	492,480	1,099,940	2.2335
21 Sep 2011 13:55:27	1096036	13304677	hadcm3n_o4t9_1980_40_007426714_2	466,560	1,041,398	2.2321
20 Sep 2011 09:33:57	1096036	13304677	hadcm3n_o4t9_1980_40_007426714_2	440,640	981,757	2.2280
19 Sep 2011 10:04:03	1096036	13304677	hadcm3n_o4t9_1980_40_007426714_2	414,720	925,028	2.2305
18 Sep 2011 05:38:46	1096036	13304677	hadcm3n_o4t9_1980_40_007426714_2	388,800	867,909	2.2323
17 Sep 2011 12:52:27	1096036	13304677	hadcm3n_o4t9_1980_40_007426714_2	362,880	810,271	2.2329
16 Sep 2011 01:20:22	1096036	13304677	hadcm3n_o4t9_1980_40_007426714_2	336,960	751,735	2.2309
14 Sep 2011 21:05:11	1096036	13304677	hadcm3n_o4t9_1980_40_007426714_2	311,040	694,579	2.2331
13 Sep 2011 18:44:23	1096036	13304677	hadcm3n_o4t9_1980_40_007426714_2	285,120	637,380	2.2355
12 Sep 2011 20:50:08	1096036	13304677	hadcm3n_o4t9_1980_40_007426714_2	259,200	578,985	2.2337
11 Sep 2011 16:32:58	1096036	13304677	hadcm3n_o4t9_1980_40_007426714_2	233,280	519,706	2.2278
10 Sep 2011 23:41:52	1096036	13304677	hadcm3n_o4t9_1980_40_007426714_2	207,360	461,360	2.2249
09 Sep 2011 19:08:01	1096036	13304677	hadcm3n_o4t9_1980_40_007426714_2	181,440	402,860	2.2203
09 Sep 2011 01:40:40	1096036	13304677	hadcm3n_o4t9_1980_40_007426714_2	155,520	344,569	2.2156
08 Sep 2011 08:00:05	1096036	13304677	hadcm3n_o4t9_1980_40_007426714_2	129,600	287,282	2.2167
07 Sep 2011 09:37:34	1096036	13304677	hadcm3n_o4t9_1980_40_007426714_2	103,680	230,149	2.2198
06 Sep 2011 10:03:52	1096036	13304677	hadcm3n_o4t9_1980_40_007426714_2	77,760	171,066	2.1999
04 Sep 2011 19:52:00	1096036	13304677	hadcm3n_o4t9_1980_40_007426714_2	51,840	112,425	2.1687
03 Sep 2011 17:49:11	1096036	13304677	hadcm3n_o4t9_1980_40_007426714_2	25,920	55,319	2.1342