Task 13370568

Name	hadcm3n_o0ov_1940_40_007452002_1
Workunit	7649505
Created	10 Sep 2011, 12:24:27 UTC
Sent	11 Sep 2011, 18:10:16 UTC
Report deadline	12 Dec 2011, 1:37:27 UTC
Received	29 Nov 2011, 17:03:30 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	946571
Run time	12 days 2 hours 20 min 50 sec
CPU time	11 days 8 hours 33 min 17 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.05 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 forrtl: There is not enough space on the disk. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4140, iMonCtr=1 Model crash detected, will try to restart... forrtl: There is not enough space on the disk. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4140, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:00:15 (4588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:47:40 (4604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:58:50 (1576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:51:02 (1404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:09:50 (3072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:09:45 (4564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:37:21 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C9192F9 read attempt to address 0x01267CC0 Engaging BOINC Windows Runtime Debugger... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7C910F1E read attempt to address 0x4082AE16 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Nov 2011 12:06:32	946571	13370568	hadcm3n_o0ov_1940_40_007452002_1	518,400	980,036	1.8905
24 Nov 2011 14:18:07	946571	13370568	hadcm3n_o0ov_1940_40_007452002_1	492,480	930,788	1.8900
22 Nov 2011 16:55:56	946571	13370568	hadcm3n_o0ov_1940_40_007452002_1	466,560	881,401	1.8891
21 Nov 2011 11:09:07	946571	13370568	hadcm3n_o0ov_1940_40_007452002_1	440,640	831,666	1.8874
17 Nov 2011 08:53:24	946571	13370568	hadcm3n_o0ov_1940_40_007452002_1	414,720	782,118	1.8859
16 Nov 2011 08:29:50	946571	13370568	hadcm3n_o0ov_1940_40_007452002_1	388,800	732,452	1.8839
09 Nov 2011 13:00:17	946571	13370568	hadcm3n_o0ov_1940_40_007452002_1	362,880	683,076	1.8824
07 Nov 2011 15:32:35	946571	13370568	hadcm3n_o0ov_1940_40_007452002_1	336,960	633,830	1.8810
02 Nov 2011 13:20:12	946571	13370568	hadcm3n_o0ov_1940_40_007452002_1	311,040	583,913	1.8773
31 Oct 2011 20:02:32	946571	13370568	hadcm3n_o0ov_1940_40_007452002_1	285,120	533,794	1.8722
31 Oct 2011 17:32:59	946571	13370568	hadcm3n_o0ov_1940_40_007452002_1	259,200	484,494	1.8692
31 Oct 2011 15:55:29	946571	13370568	hadcm3n_o0ov_1940_40_007452002_1	233,280	435,137	1.8653
31 Oct 2011 13:25:11	946571	13370568	hadcm3n_o0ov_1940_40_007452002_1	207,360	385,913	1.8611
07 Oct 2011 08:20:23	946571	13370568	hadcm3n_o0ov_1940_40_007452002_1	181,440	336,744	1.8560
05 Oct 2011 10:57:21	946571	13370568	hadcm3n_o0ov_1940_40_007452002_1	155,520	287,402	1.8480
30 Sep 2011 11:53:59	946571	13370568	hadcm3n_o0ov_1940_40_007452002_1	129,600	247,852	1.9124
27 Sep 2011 14:18:14	946571	13370568	hadcm3n_o0ov_1940_40_007452002_1	103,680	198,593	1.9154
21 Sep 2011 07:35:40	946571	13370568	hadcm3n_o0ov_1940_40_007452002_1	77,760	149,057	1.9169
15 Sep 2011 10:13:43	946571	13370568	hadcm3n_o0ov_1940_40_007452002_1	51,840	99,530	1.9199
13 Sep 2011 13:19:04	946571	13370568	hadcm3n_o0ov_1940_40_007452002_1	25,920	49,914	1.9257