Task 15834572

Name	hadcm3n_3gh1_2020_40_008390268_1
Workunit	8541127
Created	7 Jun 2013, 21:40:16 UTC
Sent	7 Jun 2013, 22:20:16 UTC
Report deadline	7 Sep 2013, 5:47:27 UTC
Received	5 Jul 2013, 9:56:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1164946
Run time	15 days 2 hours 22 min 12 sec
CPU time	14 days 15 hours 44 min 20 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	0.62 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.12.35</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x090899e0 *** ======= Backtrace: ========= /lib/libc.so.6[0x421e8af2] /usr/lib/libstdc++.so.6(_ZdlPv+0x20)[0x456931f0] /usr/lib/libstdc++.so.6(_ZdaPv+0x1c)[0x4569324c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xf3)[0x421903f3] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 fd:01 266332 /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 fd:01 266332 /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 09034000-090ba000 rw-p 00000000 00:00 0 [heap] 42155000-42173000 r-xp 00000000 fd:01 1482 /lib/ld-2.14.1.so 42173000-42174000 r--p 0001d000 fd:01 1482 /lib/ld-2.14.1.so 42174000-42175000 rw-p 0001e000 fd:01 1482 /lib/ld-2.14.1.so 42177000-422fc000 r-xp 00000000 fd:01 2338 /lib/libc-2.14.1.so 422fc000-422fd000 ---p 00185000 fd:01 2338 /lib/libc-2.14.1.so 422fd000-422ff000 r--p 00185000 fd:01 2338 /lib/libc-2.14.1.so 422ff000-42300000 rw-p 00187000 fd:01 2338 /lib/libc-2.14.1.so 42300000-42303000 rw-p 00000000 00:00 0 42305000-4231b000 r-xp 00000000 fd:01 5252 /lib/libpthread-2.14.1.so 4231b000-4231c000 r--p 00015000 fd:01 5252 /lib/libpthread-2.14.1.so 4231c000-4231d000 rw-p 00016000 fd:01 5252 /lib/libpthread-2.14.1.so 4231d000-4231f000 rw-p 00000000 00:00 0 42321000-42324000 r-xp 00000000 fd:01 10409 /lib/libdl-2.14.1.so 42324000-42325000 r--p 00002000 fd:01 10409 /lib/libdl-2.14.1.so 42325000-42326000 rw-p 00003000 fd:01 10409 /lib/libdl-2.14.1.so 42333000-4235b000 r-xp 00000000 fd:01 5143 /lib/libm-2.14.1.so 4235b000-4235c000 r--p 00028000 fd:01 5143 /lib/libm-2.14.1.so 4235c000-4235d000 rw-p 00029000 fd:01 5143 /lib/libm-2.14.1.so 45315000-45331000 r-xp 00000000 fd:01 1382 /lib/libgcc_s-4.6.3-20120306.so.1 45331000-45332000 rw-p 0001b000 fd:01 1382 /lib/libgcc_s-4.6.3-20120306.so.1 455e2000-456c4000 r-xp 00000000 fd:01 142984 /usr/lib/libstdc++.so.6.0.16 456c4000-456c8000 r--p 000e1000 fd:01 142984 /usr/lib/libstdc++.so.6.0.16 456c8000-456ca000 rw-p 000e5000 fd:01 142984 /usr/lib/libstdc++.so.6.0.16 456ca000-456d0000 rw-p 00000000 00:00 0 b70ff000-b7100000 rw-p 00000000 00:00 0 b7100000-b7121000 rw-p 00000000 00:00 0 b7121000-b7200000 ---p 00000000 00:00 0 b72a8000-b7723000 rw-s 00000000 fd:01 527156 /var/lib/boinc/slots/1/133010 b7723000-b7726000 rw-p 00000000 00:00 0 b7730000-b7731000 rw-p 00000000 00:00 0 b7731000-b7732000 ---p 00000000 00:00 0 b7732000-b7735000 rw-p 00000000 00:00 0 b7735000-b7737000 rw-s 00000000 fd:01 527066 /var/lib/boinc/slots/1/boinc_mmap_file b7737000-b7738000 rw-p 00000000 00:00 0 b7738000-b7739000 r-xp 00000000 00:00 0 [vdso] bfca6000-bfd16000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (17 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xb7738400] [0xb7738424] /lib/libc.so.6(gsignal+0x4f)[0x421a50ef] /lib/libc.so.6(abort+0x175)[0x421a6a25] /lib/libc.so.6[0x421e1c0a] /lib/libc.so.6[0x421e8af2] /usr/lib/libstdc++.so.6(_ZdlPv+0x20)[0x456931f0] /usr/lib/libstdc++.so.6(_ZdaPv+0x1c)[0x4569324c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xf3)[0x421903f3] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Jul 2013 04:48:45	1164946	15834572	hadcm3n_3gh1_2020_40_008390268_1	259,200	1,266,255	4.8852
02 Jul 2013 11:03:09	1164946	15834572	hadcm3n_3gh1_2020_40_008390268_1	233,280	1,139,836	4.8861
27 Jun 2013 18:52:30	1164946	15834572	hadcm3n_3gh1_2020_40_008390268_1	207,360	1,014,438	4.8922
24 Jun 2013 05:08:18	1164946	15834572	hadcm3n_3gh1_2020_40_008390268_1	181,440	888,435	4.8966
17 Jun 2013 00:37:19	1164946	15834572	hadcm3n_3gh1_2020_40_008390268_1	155,520	760,758	4.8917
15 Jun 2013 12:16:09	1164946	15834572	hadcm3n_3gh1_2020_40_008390268_1	129,600	634,043	4.8923
13 Jun 2013 23:57:54	1164946	15834572	hadcm3n_3gh1_2020_40_008390268_1	103,680	507,430	4.8942
12 Jun 2013 11:34:21	1164946	15834572	hadcm3n_3gh1_2020_40_008390268_1	77,760	380,544	4.8938
11 Jun 2013 02:30:38	1164946	15834572	hadcm3n_3gh1_2020_40_008390268_1	51,840	253,631	4.8926
09 Jun 2013 10:50:31	1164946	15834572	hadcm3n_3gh1_2020_40_008390268_1	25,920	127,022	4.9005