Task 15920489

Name	hadcm3n_zdmj_1960_40_008352742_4
Workunit	8503603
Created	14 Aug 2013, 19:13:29 UTC
Sent	14 Aug 2013, 19:14:02 UTC
Report deadline	14 Nov 2013, 2:41:13 UTC
Received	27 Sep 2013, 6:52:09 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1197259
Run time	33 days 5 hours 47 min 4 sec
CPU time	20 days 3 hours 47 min 13 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.19 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <stderr_txt> 01:28:29 (80154): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:28:33 (80154): No heartbeat from core client for 30 sec - exiting 01:28:34 (80154): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:29:23 (56545): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:29:24 (56545): No heartbeat from core client for 30 sec - exiting 01:29:25 (56545): No heartbeat from core client for 30 sec - exiting 02:30:39 (14109): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x7c1bc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x6c2cc04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x4c2c804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x4c2c800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x1419c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x8c19c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x8c19c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x5bfb804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x5bfb800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x7c00204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x7c00200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x7c00204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x7c00200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x7c00204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x7c00200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x7c00204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x7c00200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x7c00204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x7c00200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x5bfb804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x5c09e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x5c0de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3996,0xac96e2c0) malloc: * error for object 0x5c0de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:31:32 (87609): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:57:12 (52796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:01:15 (61941): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:01:16 (61941): No heartbeat from core client for 30 sec - exiting 02:01:17 (61941): No heartbeat from core client for 30 sec - exiting 02:01:18 (61941): No heartbeat from core client for 30 sec - exiting 02:01:19 (61941): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 17:52:43 (43020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:53:17 (49749): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:01:29 (1912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 01:48:42 (29468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:09:21 (39691): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:02:37 (2790): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:46:34 (47154): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Sep 2013 05:56:14	1197259	15920489	hadcm3n_zdmj_1960_40_008352742_4	1,036,800	1,741,052	1.6793
26 Sep 2013 09:37:30	1197259	15920489	hadcm3n_zdmj_1960_40_008352742_4	1,010,880	1,697,312	1.6790
25 Sep 2013 11:26:40	1197259	15920489	hadcm3n_zdmj_1960_40_008352742_4	984,960	1,652,028	1.6773
25 Sep 2013 09:20:10	1197259	15920489	hadcm3n_zdmj_1960_40_008352742_4	959,040	1,608,337	1.6770
23 Sep 2013 15:59:44	1197259	15920489	hadcm3n_zdmj_1960_40_008352742_4	933,120	1,563,531	1.6756
23 Sep 2013 09:47:53	1197259	15920489	hadcm3n_zdmj_1960_40_008352742_4	907,200	1,519,165	1.6746
21 Sep 2013 19:05:45	1197259	15920489	hadcm3n_zdmj_1960_40_008352742_4	881,280	1,474,691	1.6734
20 Sep 2013 20:11:33	1197259	15920489	hadcm3n_zdmj_1960_40_008352742_4	855,360	1,429,852	1.6716
19 Sep 2013 18:33:34	1197259	15920489	hadcm3n_zdmj_1960_40_008352742_4	829,440	1,384,641	1.6694
18 Sep 2013 21:19:14	1197259	15920489	hadcm3n_zdmj_1960_40_008352742_4	803,520	1,340,410	1.6682
17 Sep 2013 22:05:15	1197259	15920489	hadcm3n_zdmj_1960_40_008352742_4	777,600	1,295,750	1.6663
16 Sep 2013 23:55:43	1197259	15920489	hadcm3n_zdmj_1960_40_008352742_4	751,680	1,250,653	1.6638
16 Sep 2013 02:34:21	1197259	15920489	hadcm3n_zdmj_1960_40_008352742_4	725,760	1,206,211	1.6620
15 Sep 2013 03:57:38	1197259	15920489	hadcm3n_zdmj_1960_40_008352742_4	699,840	1,161,067	1.6590
14 Sep 2013 06:01:55	1197259	15920489	hadcm3n_zdmj_1960_40_008352742_4	673,920	1,116,226	1.6563
13 Sep 2013 08:00:54	1197259	15920489	hadcm3n_zdmj_1960_40_008352742_4	648,000	1,072,151	1.6546
12 Sep 2013 10:19:53	1197259	15920489	hadcm3n_zdmj_1960_40_008352742_4	622,080	1,026,863	1.6507
11 Sep 2013 11:11:44	1197259	15920489	hadcm3n_zdmj_1960_40_008352742_4	596,160	982,524	1.6481
10 Sep 2013 12:35:34	1197259	15920489	hadcm3n_zdmj_1960_40_008352742_4	570,240	938,060	1.6450
09 Sep 2013 14:31:21	1197259	15920489	hadcm3n_zdmj_1960_40_008352742_4	544,320	894,716	1.6437