Task 13589441

Name	hadcm3n_ydp4_1900_40_007526458_4
Workunit	7723933
Created	3 Nov 2011, 8:03:50 UTC
Sent	3 Nov 2011, 8:12:27 UTC
Report deadline	2 Feb 2012, 15:39:38 UTC
Received	10 Nov 2011, 3:10:43 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	878131
Run time	5 days 18 hours 26 min 33 sec
CPU time	5 days 12 hours 53 min 35 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.95 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/ydp4ko.pja2c10 is not a valid UM file. Error converting file to netcdf: dataout/ydp4ko.pja2c10 Error: Input file: dataout/ydp4ko.pia2c10 is not a valid UM file. Error converting file to netcdf: dataout/ydp4ko.pia2c10 Error: Input file: dataout/ydp4ko.pfa2c10 is not a valid UM file. Error converting file to netcdf: dataout/ydp4ko.pfa2c10 Error: Input file: dataout/ydp4ka.pha2c10 is not a valid UM file. Error converting file to netcdf: dataout/ydp4ka.pha2c10 Error: Input file: dataout/ydp4ka.pga2c10 is not a valid UM file. Error converting file to netcdf: dataout/ydp4ka.pga2c10 Error: Input file: dataout/ydp4ka.pea2c10 is not a valid UM file. Error converting file to netcdf: dataout/ydp4ka.pea2c10 Error: Input file: dataout/ydp4ka.pda2c10 is not a valid UM file. Error converting file to netcdf: dataout/ydp4ka.pda2c10 CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08190c18 *** ======= Backtrace: ========= /lib/libc.so.6(+0x6de2b)[0xf7466e2b] /lib/libc.so.6(+0x6ebab)[0xf7467bab] /lib/libc.so.6(cfree+0x6d)[0xf746ba6d] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xf765d6e1] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xf765d73d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xfe)[0xf740fc2e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:04 12206205 /home/dc/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rwxp 0009b000 08:04 12206205 /home/dc/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-081a1000 rwxp 00000000 00:00 0 [heap] f6e00000-f6e21000 rwxp 00000000 00:00 0 f6e21000-f6f00000 ---p 00000000 00:00 0 f6f7c000-f73f7000 rwxs 00000000 08:04 12779545 /home/dc/BOINC/slots/0/136815 f73f7000-f73f9000 rwxp 00000000 00:00 0 f73f9000-f755f000 r-xp 00000000 08:03 2485942 /lib/libc-2.11.3.so f755f000-f7560000 ---p 00166000 08:03 2485942 /lib/libc-2.11.3.so f7560000-f7562000 r-xp 00166000 08:03 2485942 /lib/libc-2.11.3.so f7562000-f7563000 rwxp 00168000 08:03 2485942 /lib/libc-2.11.3.so f7563000-f7566000 rwxp 00000000 00:00 0 f7566000-f7582000 r-xp 00000000 08:03 2489478 /lib/libgcc_s.so.1 f7582000-f7583000 r-xp 0001b000 08:03 2489478 /lib/libgcc_s.so.1 f7583000-f7584000 rwxp 0001c000 08:03 2489478 /lib/libgcc_s.so.1 f7584000-f7585000 rwxp 00000000 00:00 0 f7585000-f75ad000 r-xp 00000000 08:03 2489538 /lib/libm-2.11.3.so f75ad000-f75ae000 r-xp 00027000 08:03 2489538 /lib/libm-2.11.3.so f75ae000-f75af000 rwxp 00028000 08:03 2489538 /lib/libm-2.11.3.so f75af000-f7692000 r-xp 00000000 08:03 924954 /usr/lib/libstdc++.so.6.0.14 f7692000-f7696000 r-xp 000e2000 08:03 924954 /usr/lib/libstdc++.so.6.0.14 f7696000-f7697000 rwxp 000e6000 08:03 924954 /usr/lib/libstdc++.so.6.0.14 f7697000-f769e000 rwxp 00000000 00:00 0 f769e000-f76a1000 r-xp 00000000 08:03 2486018 /lib/libdl-2.11.3.so f76a1000-f76a2000 r-xp 00002000 08:03 2486018 /lib/libdl-2.11.3.so f76a2000-f76a3000 rwxp 00003000 08:03 2486018 /lib/libdl-2.11.3.so f76a3000-f76ba000 r-xp 00000000 08:03 2485897 /lib/libpthread-2.11.3.so f76ba000-f76bb000 r-xp 00016000 08:03 2485897 /lib/libpthread-2.11.3.so f76bb000-f76bc000 rwxp 00017000 08:03 2485897 /lib/libpthread-2.11.3.so f76bc000-f76be000 rwxp 00000000 00:00 0 f76d9000-f76da000 rwxp 00000000 00:00 0 f76da000-f76db000 ---p 00000000 00:00 0 f76db000-f76de000 rwxp 00000000 00:00 0 f76de000-f76e0000 rwxs 00000000 08:04 12779542 /home/dc/BOINC/slots/0/boinc_mmap_file f76e0000-f76e1000 rwxp 00000000 00:00 0 f76e1000-f7700000 r-xp 00000000 08:03 2485640 /lib/ld-2.11.3.so f7700000-f7701000 r-xp 0001e000 08:03 2485640 /lib/ld-2.11.3.so f7701000-f7702000 rwxp 0001f000 08:03 2485640 /lib/ld-2.11.3.so fff29000-fff99000 rw-p 00000000 00:00 0 [stack] ffffe000-fffff000 r-xp 00000000 00:00 0 [vdso] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xffffe400] [0xffffe430] /lib/libc.so.6(gsignal+0x4f)[0xf74248df] /lib/libc.so.6(abort+0x180)[0xf7426220] /lib/libc.so.6(+0x67e07)[0xf7460e07] /lib/libc.so.6(+0x6de2b)[0xf7466e2b] /lib/libc.so.6(+0x6ebab)[0xf7467bab] /lib/libc.so.6(cfree+0x6d)[0xf746ba6d] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xf765d6e1] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xf765d73d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xfe)[0xf740fc2e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Nov 2011 02:13:10	878131	13589441	hadcm3n_ydp4_1900_40_007526458_4	259,200	478,407	1.8457
09 Nov 2011 12:09:56	878131	13589441	hadcm3n_ydp4_1900_40_007526458_4	233,280	430,315	1.8446
08 Nov 2011 06:12:52	878131	13589441	hadcm3n_ydp4_1900_40_007526458_4	207,360	382,406	1.8442
07 Nov 2011 16:41:33	878131	13589441	hadcm3n_ydp4_1900_40_007526458_4	181,440	334,556	1.8439
07 Nov 2011 01:51:27	878131	13589441	hadcm3n_ydp4_1900_40_007526458_4	155,520	286,749	1.8438
06 Nov 2011 12:13:55	878131	13589441	hadcm3n_ydp4_1900_40_007526458_4	129,600	239,096	1.8449
05 Nov 2011 22:20:45	878131	13589441	hadcm3n_ydp4_1900_40_007526458_4	103,680	191,234	1.8445
05 Nov 2011 07:54:26	878131	13589441	hadcm3n_ydp4_1900_40_007526458_4	77,760	143,278	1.8426
04 Nov 2011 19:53:15	878131	13589441	hadcm3n_ydp4_1900_40_007526458_4	51,840	95,527	1.8427
04 Nov 2011 05:08:12	878131	13589441	hadcm3n_ydp4_1900_40_007526458_4	25,920	47,837	1.8456