Task 15715778

Name	hadcm3n_3a54_1940_40_008263731_2
Workunit	8418855
Created	7 Apr 2013, 21:20:07 UTC
Sent	7 Apr 2013, 21:27:57 UTC
Report deadline	8 Jul 2013, 4:55:08 UTC
Received	16 Apr 2013, 20:20:58 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1125116
Run time	4 days 0 hours 15 min 22 sec
CPU time	3 days 21 hours 38 min 30 sec
Validate state	Invalid
Credit	3,421.44
Device peak FLOPS	3.53 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/3a54ko.pje2c10 is not a valid UM file. Error converting file to netcdf: dataout/3a54ko.pje2c10 Error: Input file: dataout/3a54ko.pie2c10 is not a valid UM file. Error converting file to netcdf: dataout/3a54ko.pie2c10 Error: Input file: dataout/3a54ko.pfe2c10 is not a valid UM file. Error converting file to netcdf: dataout/3a54ko.pfe2c10 Error: Input file: dataout/3a54ka.phe2c10 is not a valid UM file. Error converting file to netcdf: dataout/3a54ka.phe2c10 Error: Input file: dataout/3a54ka.pge2c10 is not a valid UM file. Error converting file to netcdf: dataout/3a54ka.pge2c10 Error: Input file: dataout/3a54ka.pee2c10 is not a valid UM file. Error converting file to netcdf: dataout/3a54ka.pee2c10 Error: Input file: dataout/3a54ka.pde2c10 is not a valid UM file. Error converting file to netcdf: dataout/3a54ka.pde2c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:37:28 (7579): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:37:29 (7579): No heartbeat from core client for 30 sec - exiting 03:37:30 (7579): No heartbeat from core client for 30 sec - exiting 03:37:31 (7579): No heartbeat from core client for 30 sec - exiting 03:37:32 (7579): No heartbeat from core client for 30 sec - exiting 03:37:33 (7579): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(153,0xa02a2540) malloc: * error for object 0x205e604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(153,0xa02a2540) malloc: * error for object 0x205e600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(153,0xa02a2540) malloc: * error for object 0x1030604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(2397,0xa02a2540) malloc: * error for object 0x103ac04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2397,0xa02a2540) malloc: * error for object 0x1031e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2397,0xa02a2540) malloc: * error for object 0x1031e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2397,0xa02a2540) malloc: * error for object 0x1031e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2397,0xa02a2540) malloc: * error for object 0x1031e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2397,0xa02a2540) malloc: * error for object 0x1031e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2397,0xa02a2540) malloc: * error for object 0x1031e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2397,0xa02a2540) malloc: * error for object 0x1031e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) hadcm3n_6.07_i686-apple-darwin(3852,0xa02a2540) malloc: * error for object 0x282de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(154,0xa02a2540) malloc: * error for object 0x1842c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(154,0xa02a2540) malloc: * error for object 0x102c604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(154,0xa02a2540) malloc: * error for object 0x181b004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(154,0xa02a2540) malloc: * error for object 0x181b000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(154,0xa02a2540) malloc: * error for object 0x2801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(154,0xa02a2540) malloc: * error for object 0x2801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(154,0xa02a2540) malloc: * error for object 0x2801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(151,0xa02a2540) malloc: * error for object 0x2034604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(151,0xa02a2540) malloc: * error for object 0x103ac04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(151,0xa02a2540) malloc: * error for object 0x2034604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(151,0xa02a2540) malloc: * error for object 0x2823604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(151,0xa02a2540) malloc: * error for object 0x2823600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(151,0xa02a2540) malloc: * error for object 0x101a804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(151,0xa02a2540) malloc: * error for object 0x101a800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(151,0xa02a2540) malloc: * error for object 0x101a804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(151,0xa02a2540) malloc: * error for object 0x101a800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(151,0xa02a2540) malloc: * error for object 0x101a804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(151,0xa02a2540) malloc: * error for object 0x101a800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(151,0xa02a2540) malloc: * error for object 0x101a804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(151,0xa02a2540) malloc: * error for object 0x101a800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(151,0xa02a2540) malloc: * error for object 0x101a804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(151,0xa02a2540) malloc: * error for object 0x101a800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(151,0xa02a2540) malloc: * error for object 0x101a804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(151,0xa02a2540) malloc: * error for object 0x101a800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(151,0xa02a2540) malloc: * error for object 0x2000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(151,0xa02a2540) malloc: * error for object 0x2000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 3 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Apr 2013 03:48:05	1125116	15715778	hadcm3n_3a54_1940_40_008263731_2	285,120	329,158	1.1545
14 Apr 2013 18:43:11	1125116	15715778	hadcm3n_3a54_1940_40_008263731_2	259,200	298,206	1.1505
14 Apr 2013 05:10:25	1125116	15715778	hadcm3n_3a54_1940_40_008263731_2	233,280	267,745	1.1477
13 Apr 2013 15:05:45	1125116	15715778	hadcm3n_3a54_1940_40_008263731_2	207,360	238,061	1.1481
13 Apr 2013 03:21:42	1125116	15715778	hadcm3n_3a54_1940_40_008263731_2	181,440	207,722	1.1449
12 Apr 2013 03:22:26	1125116	15715778	hadcm3n_3a54_1940_40_008263731_2	155,520	178,721	1.1492
11 Apr 2013 04:52:48	1125116	15715778	hadcm3n_3a54_1940_40_008263731_2	129,600	149,011	1.1498
10 Apr 2013 14:40:26	1125116	15715778	hadcm3n_3a54_1940_40_008263731_2	103,680	118,343	1.1414
10 Apr 2013 04:46:45	1125116	15715778	hadcm3n_3a54_1940_40_008263731_2	77,760	88,145	1.1336
09 Apr 2013 05:28:49	1125116	15715778	hadcm3n_3a54_1940_40_008263731_2	51,840	57,703	1.1131
08 Apr 2013 16:41:17	1125116	15715778	hadcm3n_3a54_1940_40_008263731_2	25,920	29,270	1.1292