Task 13335236

Name	hadcm3n_o1wn_1900_40_007439199_1
Workunit	7636702
Created	5 Sep 2011, 18:15:39 UTC
Sent	6 Sep 2011, 13:07:06 UTC
Report deadline	6 Dec 2011, 20:34:17 UTC
Received	31 Oct 2011, 10:14:19 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	931635
Run time	27 days 10 hours 25 min 26 sec
CPU time	22 days 21 hours 16 min 24 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.20 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:36:11 (3033): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:18:48 (23708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:39:05 (68341): No heartbeat from core client for 30 sec - exiting 00:39:06 (68341): No heartbeat from core client for 30 sec - exiting 00:39:07 (68341): No heartbeat from core client for 30 sec - exiting 00:39:08 (68341): No heartbeat from core client for 30 sec - exiting 00:39:09 (68341): No heartbeat from core client for 30 sec - exiting 00:39:10 (68341): No heartbeat from core client for 30 sec - exiting 00:39:12 (68341): No heartbeat from core client for 30 sec - exiting 00:39:13 (68341): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 62 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/o1wnko.pjb0c10 is not a valid UM file. Error converting file to netcdf: dataout/o1wnko.pjb0c10 Error: Input file: dataout/o1wnko.pib0c10 is not a valid UM file. Error converting file to netcdf: dataout/o1wnko.pib0c10 Error: Input file: dataout/o1wnko.pfb0c10 is not a valid UM file. Error converting file to netcdf: dataout/o1wnko.pfb0c10 Error: Input file: dataout/o1wnko.pcb0c10 is not a valid UM file. Error converting file to netcdf: dataout/o1wnko.pcb0c10 Error: Input file: dataout/o1wnko.pbb0c10 is not a valid UM file. Error converting file to netcdf: dataout/o1wnko.pbb0c10 Error: Input file: dataout/o1wnko.pab0c10 is not a valid UM file. Error converting file to netcdf: dataout/o1wnko.pab0c10 Error: Input file: dataout/o1wnka.phb0c10 is not a valid UM file. Error converting file to netcdf: dataout/o1wnka.phb0c10 Error: Input file: dataout/o1wnka.pgb0c10 is not a valid UM file. Error converting file to netcdf: dataout/o1wnka.pgb0c10 Error: Input file: dataout/o1wnka.peb0c10 is not a valid UM file. Error converting file to netcdf: dataout/o1wnka.peb0c10 Error: Input file: dataout/o1wnka.pdb0c10 is not a valid UM file. Error converting file to netcdf: dataout/o1wnka.pdb0c10 hadcm3n_6.07_i686-apple-darwin(76108,0xac44e2c0) malloc: * error for object 0x28f6004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76108,0xac44e2c0) malloc: * error for object 0x28f6000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76108,0xac44e2c0) malloc: * error for object 0x8f6404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76108,0xac44e2c0) malloc: * error for object 0x8f7204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76108,0xac44e2c0) malloc: * error for object 0x8f7200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76108,0xac44e2c0) malloc: * error for object 0x8f7204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76108,0xac44e2c0) malloc: * error for object 0x8f7200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(76108,0xac44e2c0) malloc: * error for object 0x8f7200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=76114, selfPID=76114, iMonCtr=1 hadcm3n_6.07_i686-apple-darwin(84091,0xac44e2c0) malloc: * error for object 0x1a38c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(84091,0xac44e2c0) malloc: * error for object 0x1a38c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(84091,0xac44e2c0) malloc: * error for object 0xa17204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(84091,0xac44e2c0) malloc: * error for object 0xa18004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(84091,0xac44e2c0) malloc: * error for object 0xa18000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(84091,0xac44e2c0) malloc: * error for object 0xa18004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(84091,0xac44e2c0) malloc: * error for object 0xa18000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(84091,0xac44e2c0) malloc: * error for object 0xa18004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(84091,0xac44e2c0) malloc: * error for object 0xa18000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(84091,0xac44e2c0) malloc: * error for object 0xa18004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(84091,0xac44e2c0) malloc: * error for object 0xa18000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug 13:04:02 (10087): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:43:34 (66904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:14:02 (23332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:52:49 (85676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:43:59 (7399): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:56:23 (32100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:27:35 (37235): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:27:36 (37235): No heartbeat from core client for 30 sec - exiting 18:27:37 (37235): No heartbeat from core client for 30 sec - exiting 18:27:38 (37235): No heartbeat from core client for 30 sec - exiting 18:27:39 (37235): No heartbeat from core client for 30 sec - exiting 18:27:40 (37235): No heartbeat from core client for 30 sec - exiting 18:27:41 (37235): No heartbeat from core client for 30 sec - exiting 18:27:42 (37235): No heartbeat from core client for 30 sec - exiting 18:27:43 (37235): No heartbeat from core client for 30 sec - exiting 18:27:45 (37235): No heartbeat from core client for 30 sec - exiting 18:27:46 (37235): No heartbeat from core client for 30 sec - exiting 18:27:47 (37235): No heartbeat from core client for 30 sec - exiting 18:27:48 (37235): No heartbeat from core client for 30 sec - exiting 18:27:49 (37235): No heartbeat from core client for 30 sec - exiting 18:27:50 (37235): No heartbeat from core client for 30 sec - exiting 18:27:51 (37235): No heartbeat from core client for 30 sec - exiting 18:27:52 (37235): No heartbeat from core client for 30 sec - exiting 18:27:53 (37235): No heartbeat from core client for 30 sec - exiting 18:27:54 (37235): No heartbeat from core client for 30 sec - exiting 18:27:55 (37235): No heartbeat from core client for 30 sec - exiting 18:27:56 (37235): No heartbeat from core client for 30 sec - exiting 18:27:57 (37235): No heartbeat from core client for 30 sec - exiting 18:27:58 (37235): No heartbeat from core client for 30 sec - exiting 18:27:59 (37235): No heartbeat from core client for 30 sec - exiting 18:28:00 (37235): No heartbeat from core client for 30 sec - exiting 18:28:01 (37235): No heartbeat from core client for 30 sec - exiting 18:28:02 (37235): No heartbeat from core client for 30 sec - exiting 18:28:03 (37235): No heartbeat from core client for 30 sec - exiting 18:28:04 (37235): No heartbeat from core client for 30 sec - exiting 18:28:05 (37235): No heartbeat from core client for 30 sec - exiting 18:28:06 (37235): No heartbeat from core client for 30 sec - exiting 18:28:07 (37235): No heartbeat from core client for 30 sec - exiting 18:28:08 (37235): No heartbeat from core client for 30 sec - exiting 18:28:09 (37235): No heartbeat from core client for 30 sec - exiting 18:28:10 (37235): No heartbeat from core client for 30 sec - exiting 18:28:11 (37235): No heartbeat from core client for 30 sec - exiting 18:28:12 (37235): No heartbeat from core client for 30 sec - exiting 18:28:13 (37235): No heartbeat from core client for 30 sec - exiting 18:28:14 (37235): No heartbeat from core client for 30 sec - exiting 18:28:15 (37235): No heartbeat from core client for 30 sec - exiting 18:28:16 (37235): No heartbeat from core client for 30 sec - exiting 18:28:17 (37235): No heartbeat from core client for 30 sec - exiting 18:28:18 (37235): No heartbeat from core client for 30 sec - exiting 18:28:19 (37235): No heartbeat from core client for 30 sec - exiting 18:28:20 (37235): No heartbeat from core client for 30 sec - exiting 18:28:21 (37235): No heartbeat from core client for 30 sec - exiting 18:28:22 (37235): No heartbeat from core client for 30 sec - exiting 18:28:23 (37235): No heartbeat from core client for 30 sec - exiting 18:28:24 (37235): No heartbeat from core client for 30 sec - exiting 18:28:25 (37235): No heartbeat from core client for 30 sec - exiting 18:28:26 (37235): No heartbeat from core client for 30 sec - exiting 18:28:27 (37235): No heartbeat from core client for 30 sec - exiting 18:28:28 (37235): No heartbeat from core client for 30 sec - exiting 18:28:29 (37235): No heartbeat from core client for 30 sec - exiting 18:28:30 (37235): No heartbeat from core client for 30 sec - exiting 18:28:31 (37235): No heartbeat from core client for 30 sec - exiting 18:28:32 (37235): No heartbeat from core client for 30 sec - exiting 18:28:33 (37235): No heartbeat from core client for 30 sec - exiting 18:28:34 (37235): No heartbeat from core client for 30 sec - exiting 18:28:35 (37235): No heartbeat from core client for 30 sec - exiting 18:28:36 (37235): No heartbeat from core client for 30 sec - exiting 18:28:37 (37235): No heartbeat from core client for 30 sec - exiting 18:28:38 (37235): No heartbeat from core client for 30 sec - exiting 18:28:40 (37235): No heartbeat from core client for 30 sec - exiting 18:28:41 (37235): No heartbeat from core client for 30 sec - exiting 18:28:42 (37235): No heartbeat from core client for 30 sec - exiting 18:28:43 (37235): No heartbeat from core client for 30 sec - exiting 18:28:44 (37235): No heartbeat from core client for 30 sec - exiting 18:28:45 (37235): No heartbeat from core client for 30 sec - exiting 18:28:46 (37235): No heartbeat from core client for 30 sec - exiting 18:28:47 (37235): No heartbeat from core client for 30 sec - exiting 18:28:48 (37235): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 08:35:00 (71051): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:35:01 (71051): No heartbeat from core client for 30 sec - exiting 08:35:02 (71051): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Oct 2011 19:41:11	931635	13335236	hadcm3n_o1wn_1900_40_007439199_1	1,036,800	1,976,591	1.9064
31 Oct 2011 19:15:42	931635	13335236	hadcm3n_o1wn_1900_40_007439199_1	1,010,880	1,925,003	1.9043
31 Oct 2011 18:51:46	931635	13335236	hadcm3n_o1wn_1900_40_007439199_1	984,960	1,875,267	1.9039
31 Oct 2011 18:29:54	931635	13335236	hadcm3n_o1wn_1900_40_007439199_1	959,040	1,826,717	1.9047
31 Oct 2011 17:26:10	931635	13335236	hadcm3n_o1wn_1900_40_007439199_1	933,120	1,777,419	1.9048
31 Oct 2011 16:23:59	931635	13335236	hadcm3n_o1wn_1900_40_007439199_1	907,200	1,726,385	1.9030
31 Oct 2011 15:04:04	931635	13335236	hadcm3n_o1wn_1900_40_007439199_1	881,280	1,678,346	1.9044
31 Oct 2011 14:25:26	931635	13335236	hadcm3n_o1wn_1900_40_007439199_1	855,360	1,630,395	1.9061
31 Oct 2011 14:25:26	931635	13335236	hadcm3n_o1wn_1900_40_007439199_1	829,440	1,581,877	1.9072
31 Oct 2011 14:25:26	931635	13335236	hadcm3n_o1wn_1900_40_007439199_1	803,520	1,534,259	1.9094
31 Oct 2011 14:25:26	931635	13335236	hadcm3n_o1wn_1900_40_007439199_1	777,600	1,485,648	1.9106
31 Oct 2011 14:25:26	931635	13335236	hadcm3n_o1wn_1900_40_007439199_1	751,680	1,437,498	1.9124
31 Oct 2011 14:25:26	931635	13335236	hadcm3n_o1wn_1900_40_007439199_1	725,760	1,389,556	1.9146
31 Oct 2011 14:25:26	931635	13335236	hadcm3n_o1wn_1900_40_007439199_1	699,840	1,340,044	1.9148
31 Oct 2011 14:25:26	931635	13335236	hadcm3n_o1wn_1900_40_007439199_1	673,920	1,288,565	1.9120
19 Oct 2011 05:47:55	931635	13335236	hadcm3n_o1wn_1900_40_007439199_1	648,000	1,236,046	1.9075
18 Oct 2011 11:30:29	931635	13335236	hadcm3n_o1wn_1900_40_007439199_1	622,080	1,182,337	1.9006
17 Oct 2011 17:03:08	931635	13335236	hadcm3n_o1wn_1900_40_007439199_1	596,160	1,132,524	1.8997
16 Oct 2011 07:56:12	931635	13335236	hadcm3n_o1wn_1900_40_007439199_1	570,240	1,085,344	1.9033
15 Oct 2011 07:20:52	931635	13335236	hadcm3n_o1wn_1900_40_007439199_1	544,320	1,037,560	1.9062