Task 13380573

Name	hadcm3n_ygx3_1940_40_007454507_1
Workunit	7652010
Created	12 Sep 2011, 18:06:18 UTC
Sent	12 Sep 2011, 18:19:33 UTC
Report deadline	13 Dec 2011, 1:46:44 UTC
Received	21 Nov 2011, 17:06:50 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1150085
Run time	20 days 4 hours 34 min 3 sec
CPU time	19 days 0 hours 57 min 49 sec
Validate state	Invalid
Credit	11,819.52
Device peak FLOPS	3.15 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.26</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:03:15 (87780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:09:45 (589): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(537,0xa031d540) malloc: * error for object 0x1022a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(537,0xa031d540) malloc: * error for object 0x1022a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(537,0xa031d540) malloc: * error for object 0x1022a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(537,0xa031d540) malloc: * error for object 0x1022a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(537,0xa031d540) malloc: * error for object 0x1022a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(537,0xa031d540) malloc: * error for object 0x1022a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(537,0xa031d540) malloc: * error for object 0x1022a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(537,0xa031d540) malloc: * error for object 0x1022a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(537,0xa031d540) malloc: * error for object 0x1022a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(537,0xa031d540) malloc: * error for object 0x1022a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(537,0xa031d540) malloc: * error for object 0x1022a04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(537,0xa031d540) malloc: * error for object 0x1022a00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 21 - Return code = 1 Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 21 - Return code = 1 Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 21 - Return code = 1 Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 21 - Return code = 1 Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 21 - Return code = 1 Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 21 - Return code = 1 Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Nov 2011 17:26:32	1150085	13380573	hadcm3n_ygx3_1940_40_007454507_1	984,960	1,633,417	1.6584
18 Nov 2011 04:28:03	1150085	13380573	hadcm3n_ygx3_1940_40_007454507_1	959,040	1,590,246	1.6582
17 Nov 2011 04:47:19	1150085	13380573	hadcm3n_ygx3_1940_40_007454507_1	933,120	1,547,485	1.6584
16 Nov 2011 08:44:57	1150085	13380573	hadcm3n_ygx3_1940_40_007454507_1	907,200	1,504,284	1.6582
15 Nov 2011 18:14:44	1150085	13380573	hadcm3n_ygx3_1940_40_007454507_1	881,280	1,461,759	1.6587
15 Nov 2011 17:12:14	1150085	13380573	hadcm3n_ygx3_1940_40_007454507_1	855,360	1,418,733	1.6586
06 Nov 2011 18:50:18	1150085	13380573	hadcm3n_ygx3_1940_40_007454507_1	829,440	1,376,108	1.6591
05 Nov 2011 18:32:05	1150085	13380573	hadcm3n_ygx3_1940_40_007454507_1	803,520	1,333,662	1.6598
05 Nov 2011 04:21:24	1150085	13380573	hadcm3n_ygx3_1940_40_007454507_1	777,600	1,290,856	1.6601
03 Nov 2011 18:37:35	1150085	13380573	hadcm3n_ygx3_1940_40_007454507_1	751,680	1,248,064	1.6604
31 Oct 2011 20:04:11	1150085	13380573	hadcm3n_ygx3_1940_40_007454507_1	725,760	1,205,329	1.6608
31 Oct 2011 17:36:52	1150085	13380573	hadcm3n_ygx3_1940_40_007454507_1	699,840	1,162,140	1.6606
31 Oct 2011 16:59:04	1150085	13380573	hadcm3n_ygx3_1940_40_007454507_1	673,920	1,118,970	1.6604
31 Oct 2011 16:42:22	1150085	13380573	hadcm3n_ygx3_1940_40_007454507_1	648,000	1,075,784	1.6602
31 Oct 2011 14:05:23	1150085	13380573	hadcm3n_ygx3_1940_40_007454507_1	622,080	1,032,645	1.6600
31 Oct 2011 13:22:55	1150085	13380573	hadcm3n_ygx3_1940_40_007454507_1	596,160	989,566	1.6599
19 Oct 2011 09:12:35	1150085	13380573	hadcm3n_ygx3_1940_40_007454507_1	570,240	946,688	1.6602
18 Oct 2011 05:05:14	1150085	13380573	hadcm3n_ygx3_1940_40_007454507_1	544,320	903,555	1.6600
17 Oct 2011 17:01:09	1150085	13380573	hadcm3n_ygx3_1940_40_007454507_1	518,400	860,289	1.6595
14 Oct 2011 12:07:11	1150085	13380573	hadcm3n_ygx3_1940_40_007454507_1	492,480	817,048	1.6590