climateprediction.net home page
Task 12929128

Task 12929128

Name hadcm3n_o349_1940_40_007267734_1
Workunit 7465974
Created 3 Jun 2011, 5:18:16 UTC
Sent 3 Jun 2011, 5:18:35 UTC
Report deadline 2 Sep 2011, 12:45:46 UTC
Received 7 Jul 2011, 16:19:57 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1006480
Run time 10 days 0 hours 31 min 4 sec
CPU time 9 days 13 hours 22 min 49 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.88 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.59</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:27:51 (31546): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:40:25 (457): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:29:40 (938): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:30:22 (6676): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
12:55:24 (2654): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
08:28:28 (3548): No heartbeat from core client for 30 sec - exiting
08:28:32 (3548): No heartbeat from core client for 30 sec - exiting
08:28:33 (3548): No heartbeat from core client for 30 sec - exiting
08:28:34 (3548): No heartbeat from core client for 30 sec - exiting
08:28:35 (3548): No heartbeat from core client for 30 sec - exiting
08:28:36 (3548): No heartbeat from core client for 30 sec - exiting
08:28:37 (3548): No heartbeat from core client for 30 sec - exiting
08:28:38 (3548): No heartbeat from core client for 30 sec - exiting
08:28:39 (3548): No heartbeat from core client for 30 sec - exiting
08:28:40 (3548): No heartbeat from core client for 30 sec - exiting
08:28:41 (3548): No heartbeat from core client for 30 sec - exiting
08:28:42 (3548): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:28:43 (3548): No heartbeat from core client for 30 sec - exiting
08:28:44 (3548): No heartbeat from core client for 30 sec - exiting
08:28:45 (3548): No heartbeat from core client for 30 sec - exiting
08:28:46 (3548): No heartbeat from core client for 30 sec - exiting
08:28:47 (3548): No heartbeat from core client for 30 sec - exiting
08:28:48 (3548): No heartbeat from core client for 30 sec - exiting
08:28:49 (3548): No heartbeat from core client for 30 sec - exiting
08:28:50 (3548): No heartbeat from core client for 30 sec - exiting
08:28:51 (3548): No heartbeat from core client for 30 sec - exiting
08:28:52 (3548): No heartbeat from core client for 30 sec - exiting
08:28:53 (3548): No heartbeat from core client for 30 sec - exiting
08:28:54 (3548): No heartbeat from core client for 30 sec - exiting
08:28:55 (3548): No heartbeat from core client for 30 sec - exiting
08:28:56 (3548): No heartbeat from core client for 30 sec - exiting
08:28:57 (3548): No heartbeat from core client for 30 sec - exiting
08:28:58 (3548): No heartbeat from core client for 30 sec - exiting
08:28:59 (3548): No heartbeat from core client for 30 sec - exiting
08:29:00 (3548): No heartbeat from core client for 30 sec - exiting
08:29:01 (3548): No heartbeat from core client for 30 sec - exiting
08:29:02 (3548): No heartbeat from core client for 30 sec - exiting
08:29:03 (3548): No heartbeat from core client for 30 sec - exiting
08:29:04 (3548): No heartbeat from core client for 30 sec - exiting
08:29:05 (3548): No heartbeat from core client for 30 sec - exiting
08:29:06 (3548): No heartbeat from core client for 30 sec - exiting
08:29:07 (3548): No heartbeat from core client for 30 sec - exiting
08:29:08 (3548): No heartbeat from core client for 30 sec - exiting
08:29:09 (3548): No heartbeat from core client for 30 sec - exiting
08:29:10 (3548): No heartbeat from core client for 30 sec - exiting
08:29:11 (3548): No heartbeat from core client for 30 sec - exiting
08:29:12 (3548): No heartbeat from core client for 30 sec - exiting
08:29:13 (3548): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:29:53 (2411): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:29:57 (2411): No heartbeat from core client for 30 sec - exiting
08:29:58 (2411): No heartbeat from core client for 30 sec - exiting
08:29:59 (2411): No heartbeat from core client for 30 sec - exiting
08:30:00 (2411): No heartbeat from core client for 30 sec - exiting
08:30:01 (2411): No heartbeat from core client for 30 sec - exiting
08:30:02 (2411): No heartbeat from core client for 30 sec - exiting
08:30:03 (2411): No heartbeat from core client for 30 sec - exiting
08:30:04 (2411): No heartbeat from core client for 30 sec - exiting
08:30:05 (2411): No heartbeat from core client for 30 sec - exiting
08:30:06 (2411): No heartbeat from core client for 30 sec - exiting
08:30:07 (2411): No heartbeat from core client for 30 sec - exiting
08:30:08 (2411): No heartbeat from core client for 30 sec - exiting
08:30:09 (2411): No heartbeat from core client for 30 sec - exiting
08:30:10 (2411): No heartbeat from core client for 30 sec - exiting
08:30:11 (2411): No heartbeat from core client for 30 sec - exiting
08:30:12 (2411): No heartbeat from core client for 30 sec - exiting
08:30:13 (2411): No heartbeat from core client for 30 sec - exiting
08:30:14 (2411): No heartbeat from core client for 30 sec - exiting
08:30:15 (2411): No heartbeat from core client for 30 sec - exiting
08:30:16 (2411): No heartbeat from core client for 30 sec - exiting
08:30:17 (2411): No heartbeat from core client for 30 sec - exiting
08:30:18 (2411): No heartbeat from core client for 30 sec - exiting
08:30:19 (2411): No heartbeat from core client for 30 sec - exiting
08:30:20 (2411): No heartbeat from core client for 30 sec - exiting
08:30:21 (2411): No heartbeat from core client for 30 sec - exiting
08:30:22 (2411): No heartbeat from core client for 30 sec - exiting
08:30:23 (2411): No heartbeat from core client for 30 sec - exiting
08:30:24 (2411): No heartbeat from core client for 30 sec - exiting
08:30:25 (2411): No heartbeat from core client for 30 sec - exiting
08:30:26 (2411): No heartbeat from core client for 30 sec - exiting
08:30:27 (2411): No heartbeat from core client for 30 sec - exiting
08:30:28 (2411): No heartbeat from core client for 30 sec - exiting
08:30:29 (2411): No heartbeat from core client for 30 sec - exiting
08:30:30 (2411): No heartbeat from core client for 30 sec - exiting
08:30:31 (2411): No heartbeat from core client for 30 sec - exiting
08:30:32 (2411): No heartbeat from core client for 30 sec - exiting
08:30:33 (2411): No heartbeat from core client for 30 sec - exiting
08:30:34 (2411): No heartbeat from core client for 30 sec - exiting
08:30:35 (2411): No heartbeat from core client for 30 sec - exiting
08:30:36 (2411): No heartbeat from core client for 30 sec - exiting
08:30:37 (2411): No heartbeat from core client for 30 sec - exiting
08:30:38 (2411): No heartbeat from core client for 30 sec - exiting
08:30:39 (2411): No heartbeat from core client for 30 sec - exiting
08:30:40 (2411): No heartbeat from core client for 30 sec - exiting
08:30:41 (2411): No heartbeat from core client for 30 sec - exiting
08:30:42 (2411): No heartbeat from core client for 30 sec - exiting
08:30:43 (2411): No heartbeat from core client for 30 sec - exiting
08:30:44 (2411): No heartbeat from core client for 30 sec - exiting
08:30:45 (2411): No heartbeat from core client for 30 sec - exiting
08:30:46 (2411): No heartbeat from core client for 30 sec - exiting
08:30:47 (2411): No heartbeat from core client for 30 sec - exiting
08:30:48 (2411): No heartbeat from core client for 30 sec - exiting
08:30:49 (2411): No heartbeat from core client for 30 sec - exiting
08:30:50 (2411): No heartbeat from core client for 30 sec - exiting
08:30:51 (2411): No heartbeat from core client for 30 sec - exiting
08:30:52 (2411): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x095dfba8 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6b511)[0xf755b511]
/lib32/libc.so.6(+0x6ce1b)[0xf755ce1b]
/lib32/libc.so.6(cfree+0x6d)[0xf755ff8d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf7739841]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf773989d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf7506e37]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:01 711                                /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 711                                /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
0958a000-095f0000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f7072000-f74ed000 rw-s 00000000 08:01 398827                             /var/lib/boinc-client/slots/3/131600
f74ed000-f74f0000 rw-p 00000000 00:00 0 
f74f0000-f7646000 r-xp 00000000 08:01 16047                              /lib32/libc-2.13.so
f7646000-f7647000 ---p 00156000 08:01 16047                              /lib32/libc-2.13.so
f7647000-f7649000 r--p 00156000 08:01 16047                              /lib32/libc-2.13.so
f7649000-f764a000 rw-p 00158000 08:01 16047                              /lib32/libc-2.13.so
f764a000-f764d000 rw-p 00000000 00:00 0 
f764d000-f7667000 r-xp 00000000 08:01 2680                               /usr/lib32/libgcc_s.so.1
f7667000-f7668000 r--p 00019000 08:01 2680                               /usr/lib32/libgcc_s.so.1
f7668000-f7669000 rw-p 0001a000 08:01 2680                               /usr/lib32/libgcc_s.so.1
f7669000-f768d000 r-xp 00000000 08:01 16155                              /lib32/libm-2.13.so
f768d000-f768e000 r--p 00023000 08:01 16155                              /lib32/libm-2.13.so
f768e000-f768f000 rw-p 00024000 08:01 16155                              /lib32/libm-2.13.so
f768f000-f776e000 r-xp 00000000 08:01 28433                              /usr/lib32/libstdc++.so.6.0.14
f776e000-f7772000 r--p 000de000 08:01 28433                              /usr/lib32/libstdc++.so.6.0.14
f7772000-f7773000 rw-p 000e2000 08:01 28433                              /usr/lib32/libstdc++.so.6.0.14
f7773000-f777a000 rw-p 00000000 00:00 0 
f777a000-f777c000 r-xp 00000000 08:01 16141                              /lib32/libdl-2.13.so
f777c000-f777d000 r--p 00001000 08:01 16141                              /lib32/libdl-2.13.so
f777d000-f777e000 rw-p 00002000 08:01 16141                              /lib32/libdl-2.13.so
f777e000-f7793000 r-xp 00000000 08:01 16586                              /lib32/libpthread-2.13.so
f7793000-f7794000 r--p 00014000 08:01 16586                              /lib32/libpthread-2.13.so
f7794000-f7795000 rw-p 00015000 08:01 16586                              /lib32/libpthread-2.13.so
f7795000-f7798000 rw-p 00000000 00:00 0 
f77b9000-f77ba000 rw-p 00000000 00:00 0 
f77ba000-f77bb000 ---p 00000000 00:00 0 
f77bb000-f77be000 rw-p 00000000 00:00 0 
f77be000-f77c0000 rw-s 00000000 08:01 397059                             /var/lib/boinc-client/slots/3/boinc_mmap_file
f77c0000-f77c1000 rw-p 00000000 00:00 0 
f77c1000-f77c2000 r-xp 00000000 00:00 0                                  [vdso]
f77c2000-f77de000 r-xp 00000000 08:01 15963                              /lib32/ld-2.13.so
f77de000-f77df000 r--p 0001b000 08:01 15963                              /lib32/ld-2.13.so
f77df000-f77e0000 rw-p 0001c000 08:01 15963                              /lib32/ld-2.13.so
ffb51000-ffbc1000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf77c1400]
[0xf77c1430]
/lib32/libc.so.6(gsignal+0x51)[0xf751aea1]
/lib32/libc.so.6(abort+0x17e)[0xf751e2ce]
/lib32/libc.so.6(+0x61277)[0xf7551277]
/lib32/libc.so.6(+0x6b511)[0xf755b511]
/lib32/libc.so.6(+0x6ce1b)[0xf755ce1b]
/lib32/libc.so.6(cfree+0x6d)[0xf755ff8d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf7739841]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf773989d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf7506e37]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
04 Jul 2011 20:16:59 1006480 12929128 hadcm3n_o349_1940_40_007267734_1 518,400 825,766 1.5929
01 Jul 2011 06:25:07 1006480 12929128 hadcm3n_o349_1940_40_007267734_1 492,480 784,172 1.5923
29 Jun 2011 12:10:27 1006480 12929128 hadcm3n_o349_1940_40_007267734_1 466,560 742,796 1.5921
28 Jun 2011 14:12:22 1006480 12929128 hadcm3n_o349_1940_40_007267734_1 440,640 701,153 1.5912
27 Jun 2011 21:29:43 1006480 12929128 hadcm3n_o349_1940_40_007267734_1 414,720 659,291 1.5897
27 Jun 2011 08:43:50 1006480 12929128 hadcm3n_o349_1940_40_007267734_1 388,800 618,126 1.5898
24 Jun 2011 17:02:58 1006480 12929128 hadcm3n_o349_1940_40_007267734_1 362,880 575,989 1.5873
24 Jun 2011 05:03:13 1006480 12929128 hadcm3n_o349_1940_40_007267734_1 336,960 535,016 1.5878
23 Jun 2011 02:04:40 1006480 12929128 hadcm3n_o349_1940_40_007267734_1 311,040 493,894 1.5879
22 Jun 2011 14:37:43 1006480 12929128 hadcm3n_o349_1940_40_007267734_1 285,120 452,963 1.5887
21 Jun 2011 14:08:17 1006480 12929128 hadcm3n_o349_1940_40_007267734_1 259,200 411,714 1.5884
20 Jun 2011 10:56:00 1006480 12929128 hadcm3n_o349_1940_40_007267734_1 233,280 370,603 1.5887
17 Jun 2011 07:25:05 1006480 12929128 hadcm3n_o349_1940_40_007267734_1 207,360 329,707 1.5900
16 Jun 2011 04:19:32 1006480 12929128 hadcm3n_o349_1940_40_007267734_1 181,440 287,970 1.5871
15 Jun 2011 17:35:36 1006480 12929128 hadcm3n_o349_1940_40_007267734_1 155,520 246,508 1.5851
14 Jun 2011 14:13:48 1006480 12929128 hadcm3n_o349_1940_40_007267734_1 129,600 205,400 1.5849
10 Jun 2011 10:24:41 1006480 12929128 hadcm3n_o349_1940_40_007267734_1 103,680 164,242 1.5841
09 Jun 2011 22:47:50 1006480 12929128 hadcm3n_o349_1940_40_007267734_1 77,760 123,129 1.5834
09 Jun 2011 11:16:26 1006480 12929128 hadcm3n_o349_1940_40_007267734_1 51,840 82,001 1.5818
08 Jun 2011 08:10:14 1006480 12929128 hadcm3n_o349_1940_40_007267734_1 25,920 40,910 1.5783


©2024 climateprediction.net