Task 15644407

Name	hadcm3n_n333_1920_40_008321536_1
Workunit	8472671
Created	1 Mar 2013, 18:55:45 UTC
Sent	1 Mar 2013, 18:55:49 UTC
Report deadline	1 Jun 2013, 2:23:00 UTC
Received	16 Mar 2013, 9:52:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1181449
Run time	9 days 0 hours 11 min 9 sec
CPU time	8 days 17 hours 59 min 52 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.29 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5100, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5100, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5196, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4948, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4948, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4948, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4680, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:23:42 (6584): No heartbeat from core client for 30 sec - exiting 14:23:43 (6584): No heartbeat from core client for 30 sec - exiting 14:23:44 (6584): No heartbeat from core client for 30 sec - exiting 14:23:45 (6584): No heartbeat from core client for 30 sec - exiting 14:23:46 (6584): No heartbeat from core client for 30 sec - exiting 14:23:47 (6584): No heartbeat from core client for 30 sec - exiting 14:23:48 (6584): No heartbeat from core client for 30 sec - exiting 14:23:49 (6584): No heartbeat from core client for 30 sec - exiting 14:23:51 (6584): No heartbeat from core client for 30 sec - exiting 14:23:52 (6584): No heartbeat from core client for 30 sec - exiting 14:23:53 (6584): No heartbeat from core client for 30 sec - exiting 14:23:54 (6584): No heartbeat from core client for 30 sec - exiting 14:23:55 (6584): No heartbeat from core client for 30 sec - exiting 14:23:56 (6584): No heartbeat from core client for 30 sec - exiting 14:23:57 (6584): No heartbeat from core client for 30 sec - exiting 14:23:58 (6584): No heartbeat from core client for 30 sec - exiting 14:23:59 (6584): No heartbeat from core client for 30 sec - exiting 14:24:00 (6584): No heartbeat from core client for 30 sec - exiting 14:24:01 (6584): No heartbeat from core client for 30 sec - exiting 14:24:03 (6584): No heartbeat from core client for 30 sec - exiting 14:24:04 (6584): No heartbeat from core client for 30 sec - exiting 14:24:05 (6584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3452, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:46:11 (4580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:13:14 (5028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:22:06 (5476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77CE3AB3 read attempt to address 0x409274C7 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77043AB3 read attempt to address 0x409274C7 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_n333_1920_40_008321536/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Mar 2013 08:53:13	1181449	15644407	hadcm3n_n333_1920_40_008321536_1	518,400	753,713	1.4539
15 Mar 2013 12:34:30	1181449	15644407	hadcm3n_n333_1920_40_008321536_1	492,480	716,714	1.4553
14 Mar 2013 19:36:31	1181449	15644407	hadcm3n_n333_1920_40_008321536_1	466,560	681,225	1.4601
14 Mar 2013 09:14:58	1181449	15644407	hadcm3n_n333_1920_40_008321536_1	440,640	645,778	1.4655
13 Mar 2013 14:25:19	1181449	15644407	hadcm3n_n333_1920_40_008321536_1	414,720	608,747	1.4679
12 Mar 2013 21:15:21	1181449	15644407	hadcm3n_n333_1920_40_008321536_1	388,800	572,481	1.4724
12 Mar 2013 10:11:57	1181449	15644407	hadcm3n_n333_1920_40_008321536_1	362,880	538,155	1.4830
09 Mar 2013 23:59:27	1181449	15644407	hadcm3n_n333_1920_40_008321536_1	336,960	501,097	1.4871
09 Mar 2013 12:58:12	1181449	15644407	hadcm3n_n333_1920_40_008321536_1	311,040	462,707	1.4876
08 Mar 2013 16:10:50	1181449	15644407	hadcm3n_n333_1920_40_008321536_1	285,120	424,036	1.4872
07 Mar 2013 22:43:02	1181449	15644407	hadcm3n_n333_1920_40_008321536_1	259,200	385,450	1.4871
07 Mar 2013 11:36:49	1181449	15644407	hadcm3n_n333_1920_40_008321536_1	233,280	346,874	1.4869
06 Mar 2013 18:53:23	1181449	15644407	hadcm3n_n333_1920_40_008321536_1	207,360	308,506	1.4878
06 Mar 2013 07:50:36	1181449	15644407	hadcm3n_n333_1920_40_008321536_1	181,440	270,012	1.4882
05 Mar 2013 20:51:54	1181449	15644407	hadcm3n_n333_1920_40_008321536_1	155,520	231,292	1.4872
05 Mar 2013 09:56:12	1181449	15644407	hadcm3n_n333_1920_40_008321536_1	129,600	192,834	1.4879
04 Mar 2013 15:20:36	1181449	15644407	hadcm3n_n333_1920_40_008321536_1	103,680	153,978	1.4851
03 Mar 2013 20:58:01	1181449	15644407	hadcm3n_n333_1920_40_008321536_1	77,760	115,380	1.4838
03 Mar 2013 09:11:00	1181449	15644407	hadcm3n_n333_1920_40_008321536_1	51,840	76,887	1.4832
02 Mar 2013 14:50:34	1181449	15644407	hadcm3n_n333_1920_40_008321536_1	25,920	38,614	1.4897