Task 15920904

Name	hadcm3n_4e8m_1980_40_008390438_2
Workunit	8541297
Created	14 Aug 2013, 20:49:40 UTC
Sent	14 Aug 2013, 20:52:09 UTC
Report deadline	14 Nov 2013, 4:19:20 UTC
Received	31 Oct 2013, 18:19:03 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	871746
Run time	18 days 19 hours 49 min 45 sec
CPU time	16 days 14 hours 55 min 35 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.48 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: 00:16:41 (3530): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... 10:17:56 (267): No heartbeat from core client for 30 sec - exiting 10:17:58 (267): No heartbeat from core client for 30 sec - exiting 10:17:59 (267): No heartbeat from core client for 30 sec - exiting 10:18:00 (267): No heartbeat from core client for 30 sec - exiting 10:18:01 (267): No heartbeat from core client for 30 sec - exiting 10:18:02 (267): No heartbeat from core client for 30 sec - exiting 10:18:03 (267): No heartbeat from core client for 30 sec - exiting 10:18:04 (267): No heartbeat from core client for 30 sec - exiting 10:18:05 (267): No heartbeat from core client for 30 sec - exiting 10:18:06 (267): No heartbeat from core client for 30 sec - exiting 10:18:07 (267): No heartbeat from core client for 30 sec - exiting 10:18:08 (267): No heartbeat from core client for 30 sec - exiting 10:18:09 (267): No heartbeat from core client for 30 sec - exiting 10:18:10 (267): No heartbeat from core client for 30 sec - exiting 10:18:11 (267): No heartbeat from core client for 30 sec - exiting 10:18:12 (267): No heartbeat from core client for 30 sec - exiting 10:18:13 (267): No heartbeat from core client for 30 sec - exiting 10:18:14 (267): No heartbeat from core client for 30 sec - exiting 10:18:15 (267): No heartbeat from core client for 30 sec - exiting 10:18:16 (267): No heartbeat from core client for 30 sec - exiting 10:18:17 (267): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(54860,0xa01f9540) malloc: * error for object 0x809e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54860,0xa01f9540) malloc: * error for object 0x809e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54860,0xa01f9540) malloc: * error for object 0x809e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54860,0xa01f9540) malloc: * error for object 0x809e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54860,0xa01f9540) malloc: * error for object 0x809e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54860,0xa01f9540) malloc: * error for object 0x809e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54860,0xa01f9540) malloc: * error for object 0x809e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54860,0xa01f9540) malloc: * error for object 0x809e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54860,0xa01f9540) malloc: * error for object 0x809e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54860,0xa01f9540) malloc: * error for object 0x809e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54860,0xa01f9540) malloc: * error for object 0x7048404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(54860,0xa01f9540) malloc: * error for object 0x7048400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:15:37 (314): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:35:39 (254): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:47:18 (2695): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:47:19 (2695): No heartbeat from core client for 30 sec - exiting 03:47:20 (2695): No heartbeat from core client for 30 sec - exiting 03:47:21 (2695): No heartbeat from core client for 30 sec - exiting 03:47:22 (2695): No heartbeat from core client for 30 sec - exiting 03:47:23 (2695): No heartbeat from core client for 30 sec - exiting 03:47:24 (2695): No heartbeat from core client for 30 sec - exiting 03:47:25 (2695): No heartbeat from core client for 30 sec - exiting 03:47:26 (2695): No heartbeat from core client for 30 sec - exiting 03:47:27 (2695): No heartbeat from core client for 30 sec - exiting 03:47:28 (2695): No heartbeat from core client for 30 sec - exiting 03:47:29 (2695): No heartbeat from core client for 30 sec - exiting 03:47:30 (2695): No heartbeat from core client for 30 sec - exiting 03:47:31 (2695): No heartbeat from core client for 30 sec - exiting 03:47:32 (2695): No heartbeat from core client for 30 sec - exiting 07:39:26 (4436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:29:38 (5973): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:29:39 (5973): No heartbeat from core client for 30 sec - exiting 17:29:40 (5973): No heartbeat from core client for 30 sec - exiting 17:29:41 (5973): No heartbeat from core client for 30 sec - exiting 17:29:42 (5973): No heartbeat from core client for 30 sec - exiting 17:29:43 (5973): No heartbeat from core client for 30 sec - exiting 17:29:44 (5973): No heartbeat from core client for 30 sec - exiting 17:29:45 (5973): No heartbeat from core client for 30 sec - exiting 17:29:46 (5973): No heartbeat from core client for 30 sec - exiting 17:29:47 (5973): No heartbeat from core client for 30 sec - exiting 17:29:48 (5973): No heartbeat from core client for 30 sec - exiting 17:29:49 (5973): No heartbeat from core client for 30 sec - exiting 17:29:50 (5973): No heartbeat from core client for 30 sec - exiting 17:29:51 (5973): No heartbeat from core client for 30 sec - exiting 17:29:52 (5973): No heartbeat from core client for 30 sec - exiting 17:29:53 (5973): No heartbeat from core client for 30 sec - exiting 17:29:54 (5973): No heartbeat from core client for 30 sec - exiting 17:29:55 (5973): No heartbeat from core client for 30 sec - exiting 17:29:56 (5973): No heartbeat from core client for 30 sec - exiting 19:24:43 (9846): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Oct 2013 14:16:17	871746	15920904	hadcm3n_4e8m_1980_40_008390438_2	1,036,800	1,435,567	1.3846
31 Oct 2013 03:32:35	871746	15920904	hadcm3n_4e8m_1980_40_008390438_2	1,010,880	1,400,134	1.3851
30 Oct 2013 16:30:42	871746	15920904	hadcm3n_4e8m_1980_40_008390438_2	984,960	1,364,089	1.3849
30 Oct 2013 05:46:36	871746	15920904	hadcm3n_4e8m_1980_40_008390438_2	959,040	1,328,263	1.3850
29 Oct 2013 18:52:27	871746	15920904	hadcm3n_4e8m_1980_40_008390438_2	933,120	1,292,867	1.3855
29 Oct 2013 09:03:01	871746	15920904	hadcm3n_4e8m_1980_40_008390438_2	907,200	1,256,604	1.3851
28 Oct 2013 20:11:17	871746	15920904	hadcm3n_4e8m_1980_40_008390438_2	881,280	1,220,384	1.3848
28 Oct 2013 09:21:08	871746	15920904	hadcm3n_4e8m_1980_40_008390438_2	855,360	1,183,827	1.3840
27 Oct 2013 21:38:59	871746	15920904	hadcm3n_4e8m_1980_40_008390438_2	829,440	1,147,367	1.3833
27 Oct 2013 09:38:39	871746	15920904	hadcm3n_4e8m_1980_40_008390438_2	803,520	1,110,303	1.3818
26 Oct 2013 19:48:07	871746	15920904	hadcm3n_4e8m_1980_40_008390438_2	777,600	1,071,631	1.3781
26 Oct 2013 04:19:56	871746	15920904	hadcm3n_4e8m_1980_40_008390438_2	751,680	1,032,434	1.3735
25 Oct 2013 09:54:00	871746	15920904	hadcm3n_4e8m_1980_40_008390438_2	725,760	992,795	1.3679
24 Oct 2013 17:44:49	871746	15920904	hadcm3n_4e8m_1980_40_008390438_2	699,840	953,330	1.3622
02 Oct 2013 10:51:51	871746	15920904	hadcm3n_4e8m_1980_40_008390438_2	673,920	915,418	1.3583
01 Oct 2013 21:36:03	871746	15920904	hadcm3n_4e8m_1980_40_008390438_2	648,000	878,890	1.3563
29 Sep 2013 17:53:11	871746	15920904	hadcm3n_4e8m_1980_40_008390438_2	622,080	843,068	1.3552
29 Sep 2013 07:02:53	871746	15920904	hadcm3n_4e8m_1980_40_008390438_2	596,160	806,685	1.3531
28 Sep 2013 09:35:14	871746	15920904	hadcm3n_4e8m_1980_40_008390438_2	570,240	770,530	1.3512
26 Sep 2013 01:44:18	871746	15920904	hadcm3n_4e8m_1980_40_008390438_2	544,320	734,636	1.3496