Task 13392316

Name	hadcm3n_t5xp_1940_40_007452751_4
Workunit	7650254
Created	16 Sep 2011, 19:05:13 UTC
Sent	16 Sep 2011, 19:26:45 UTC
Report deadline	17 Dec 2011, 2:53:56 UTC
Received	15 Nov 2011, 17:12:08 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1169666
Run time	7 days 10 hours 52 min 47 sec
CPU time	7 days 1 hours 42 min 2 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.06 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2852, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3600, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4288, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4288, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4312, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6056, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3816, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1148, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3716, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4088, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3444, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3176, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2948, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4600, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:18:39 (4448): No heartbeat from core client for 30 sec - exiting 21:18:40 (4448): No heartbeat from core client for 30 sec - exiting 21:18:41 (4448): No heartbeat from core client for 30 sec - exiting 21:18:42 (4448): No heartbeat from core client for 30 sec - exiting 21:18:44 (4448): No heartbeat from core client for 30 sec - exiting 21:18:45 (4448): No heartbeat from core client for 30 sec - exiting 21:18:46 (4448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77E83F79 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_t5xp_1940_40_007452751/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Nov 2011 17:37:00	1169666	13392316	hadcm3n_t5xp_1940_40_007452751_4	259,200	610,914	2.3569
17 Oct 2011 23:55:42	1169666	13392316	hadcm3n_t5xp_1940_40_007452751_4	233,280	550,019	2.3578
13 Oct 2011 16:33:35	1169666	13392316	hadcm3n_t5xp_1940_40_007452751_4	207,360	489,271	2.3595
07 Oct 2011 17:02:26	1169666	13392316	hadcm3n_t5xp_1940_40_007452751_4	181,440	427,900	2.3584
03 Oct 2011 20:09:00	1169666	13392316	hadcm3n_t5xp_1940_40_007452751_4	155,520	367,349	2.3621
30 Sep 2011 18:11:49	1169666	13392316	hadcm3n_t5xp_1940_40_007452751_4	129,600	306,445	2.3645
24 Sep 2011 20:55:31	1169666	13392316	hadcm3n_t5xp_1940_40_007452751_4	103,680	245,154	2.3645
23 Sep 2011 16:11:31	1169666	13392316	hadcm3n_t5xp_1940_40_007452751_4	77,760	184,131	2.3679
21 Sep 2011 18:26:34	1169666	13392316	hadcm3n_t5xp_1940_40_007452751_4	51,840	122,920	2.3711
17 Sep 2011 23:19:01	1169666	13392316	hadcm3n_t5xp_1940_40_007452751_4	25,920	61,557	2.3749