Task 15455400

Name	hadcm3n_zl9v_1880_40_008251899_0
Workunit	8407023
Created	22 Nov 2012, 20:12:06 UTC
Sent	22 Nov 2012, 20:21:31 UTC
Report deadline	22 Feb 2013, 3:48:42 UTC
Received	2 Jan 2013, 19:35:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1092573
Run time	6 days 14 hours 31 min 9 sec
CPU time	4 days 21 hours 10 min 21 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.79 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> 07:45:05 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:45:07 (4596): No heartbeat from core client for 30 sec - exiting 07:45:08 (4596): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5256, iMonCtr=1 Model crash detected, will try to restart... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4404, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4404, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4404, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4404, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4404, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5172, iMonCtr=1 Model crash detected, will try to restart... 19:22:00 (1548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4408, iMonCtr=1 Model crash detected, will try to restart... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4768, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5108, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:01:36 (4408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:01:37 (4408): No heartbeat from core client for 30 sec - exiting 21:01:38 (4408): No heartbeat from core client for 30 sec - exiting 21:01:39 (4408): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5260, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5080, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5076, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2932, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5688, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4752, iMonCtr=1 Model crash detected, will try to restart... 21:13:36 (4852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5048, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5504, iMonCtr=1 Model crash detected, will try to restart... 21:01:32 (4968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:01:33 (4968): No heartbeat from core client for 30 sec - exiting 21:01:34 (4968): No heartbeat from core client for 30 sec - exiting 21:01:35 (4968): No heartbeat from core client for 30 sec - exiting 21:01:36 (4968): No heartbeat from core client for 30 sec - exiting 21:01:37 (4968): No heartbeat from core client for 30 sec - exiting 21:01:38 (4968): No heartbeat from core client for 30 sec - exiting 21:01:39 (4968): No heartbeat from core client for 30 sec - exiting 21:01:40 (4968): No heartbeat from core client for 30 sec - exiting 21:01:41 (4968): No heartbeat from core client for 30 sec - exiting 21:01:42 (4968): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5740, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77C1C3EB write attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77A0E742 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_zl9v_1880_40_008251899/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Jan 2013 18:08:10	1092573	15455400	hadcm3n_zl9v_1880_40_008251899_0	259,200	413,083	1.5937
30 Dec 2012 17:36:41	1092573	15455400	hadcm3n_zl9v_1880_40_008251899_0	233,280	372,178	1.5954
27 Dec 2012 16:46:11	1092573	15455400	hadcm3n_zl9v_1880_40_008251899_0	207,360	330,337	1.5931
24 Dec 2012 14:05:44	1092573	15455400	hadcm3n_zl9v_1880_40_008251899_0	181,440	288,235	1.5886
19 Dec 2012 20:32:03	1092573	15455400	hadcm3n_zl9v_1880_40_008251899_0	155,520	246,660	1.5860
14 Dec 2012 17:34:43	1092573	15455400	hadcm3n_zl9v_1880_40_008251899_0	129,600	205,489	1.5856
03 Dec 2012 19:16:44	1092573	15455400	hadcm3n_zl9v_1880_40_008251899_0	103,680	164,473	1.5864
01 Dec 2012 18:08:12	1092573	15455400	hadcm3n_zl9v_1880_40_008251899_0	77,760	123,842	1.5926
28 Nov 2012 16:23:32	1092573	15455400	hadcm3n_zl9v_1880_40_008251899_0	51,840	82,282	1.5872
25 Nov 2012 19:40:12	1092573	15455400	hadcm3n_zl9v_1880_40_008251899_0	25,920	40,991	1.5814