Task 13315604

Name	hadcm3n_ykqv_1940_40_007432173_0
Workunit	7629676
Created	30 Aug 2011, 10:05:58 UTC
Sent	30 Aug 2011, 10:06:35 UTC
Report deadline	29 Nov 2011, 17:33:46 UTC
Received	14 Oct 2011, 16:11:31 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1166685
Run time	18 days 15 hours 4 min 16 sec
CPU time	17 days 8 hours 59 min 8 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.21 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3064, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3100, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:47:37 (3432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:53:44 (2552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:53:45 (2552): No heartbeat from core client for 30 sec - exiting 02:53:46 (2552): No heartbeat from core client for 30 sec - exiting 02:53:47 (2552): No heartbeat from core client for 30 sec - exiting 02:53:48 (2552): No heartbeat from core client for 30 sec - exiting 02:53:49 (2552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 forrtl: There is not enough space on the disk. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2248, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:28:25 (3536): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 23:28:26 (3536): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2968, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Oct 2011 10:15:24	1166685	13315604	hadcm3n_ykqv_1940_40_007432173_0	777,600	1,486,710	1.9119
09 Oct 2011 21:23:24	1166685	13315604	hadcm3n_ykqv_1940_40_007432173_0	751,680	1,438,968	1.9143
06 Oct 2011 21:38:10	1166685	13315604	hadcm3n_ykqv_1940_40_007432173_0	725,760	1,391,471	1.9173
06 Oct 2011 06:46:06	1166685	13315604	hadcm3n_ykqv_1940_40_007432173_0	699,840	1,343,178	1.9193
03 Oct 2011 21:20:49	1166685	13315604	hadcm3n_ykqv_1940_40_007432173_0	673,920	1,295,358	1.9221
03 Oct 2011 05:24:00	1166685	13315604	hadcm3n_ykqv_1940_40_007432173_0	648,000	1,245,137	1.9215
02 Oct 2011 12:38:58	1166685	13315604	hadcm3n_ykqv_1940_40_007432173_0	622,080	1,190,428	1.9136
01 Oct 2011 17:46:03	1166685	13315604	hadcm3n_ykqv_1940_40_007432173_0	596,160	1,135,353	1.9044
01 Oct 2011 01:11:20	1166685	13315604	hadcm3n_ykqv_1940_40_007432173_0	570,240	1,081,101	1.8959
30 Sep 2011 08:25:34	1166685	13315604	hadcm3n_ykqv_1940_40_007432173_0	544,320	1,027,223	1.8872
29 Sep 2011 15:11:29	1166685	13315604	hadcm3n_ykqv_1940_40_007432173_0	518,400	973,310	1.8775
28 Sep 2011 04:00:43	1166685	13315604	hadcm3n_ykqv_1940_40_007432173_0	492,480	919,246	1.8666
27 Sep 2011 09:58:55	1166685	13315604	hadcm3n_ykqv_1940_40_007432173_0	466,560	862,172	1.8479
26 Sep 2011 07:39:05	1166685	13315604	hadcm3n_ykqv_1940_40_007432173_0	440,640	808,322	1.8344
24 Sep 2011 18:13:11	1166685	13315604	hadcm3n_ykqv_1940_40_007432173_0	414,720	754,060	1.8182
24 Sep 2011 01:31:50	1166685	13315604	hadcm3n_ykqv_1940_40_007432173_0	388,800	700,701	1.8022
23 Sep 2011 05:34:13	1166685	13315604	hadcm3n_ykqv_1940_40_007432173_0	362,880	651,355	1.7950
23 Sep 2011 05:34:13	1166685	13315604	hadcm3n_ykqv_1940_40_007432173_0	336,960	604,073	1.7927
23 Sep 2011 05:34:13	1166685	13315604	hadcm3n_ykqv_1940_40_007432173_0	311,040	557,680	1.7930
23 Sep 2011 05:34:13	1166685	13315604	hadcm3n_ykqv_1940_40_007432173_0	285,120	511,869	1.7953