climateprediction.net home page
Task 13315765

Task 13315765

Name hadcm3n_yg6k_1940_40_007432239_0
Workunit 7629742
Created 30 Aug 2011, 10:26:35 UTC
Sent 30 Aug 2011, 10:38:11 UTC
Report deadline 29 Nov 2011, 18:05:22 UTC
Received 25 Sep 2011, 7:47:18 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1166680
Run time 15 days 22 hours 43 min 48 sec
CPU time 14 days 16 hours 1 min 16 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.40 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.13.1</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:36:45 (2754): No heartbeat from core client for 30 sec - exiting
03:36:47 (2754): No heartbeat from core client for 30 sec - exiting
03:36:48 (2754): No heartbeat from core client for 30 sec - exiting
03:36:50 (2754): No heartbeat from core client for 30 sec - exiting
03:36:51 (2754): No heartbeat from core client for 30 sec - exiting
03:36:52 (2754): No heartbeat from core client for 30 sec - exiting
03:36:53 (2754): No heartbeat from core client for 30 sec - exiting
03:36:54 (2754): No heartbeat from core client for 30 sec - exiting
03:36:55 (2754): No heartbeat from core client for 30 sec - exiting
03:36:56 (2754): No heartbeat from core client for 30 sec - exiting
03:36:57 (2754): No heartbeat from core client for 30 sec - exiting
03:36:58 (2754): No heartbeat from core client for 30 sec - exiting
03:36:59 (2754): No heartbeat from core client for 30 sec - exiting
03:37:00 (2754): No heartbeat from core client for 30 sec - exiting
03:37:01 (2754): No heartbeat from core client for 30 sec - exiting
03:37:02 (2754): No heartbeat from core client for 30 sec - exiting
03:37:03 (2754): No heartbeat from core client for 30 sec - exiting
03:37:04 (2754): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
23:47:01 (2756): No heartbeat from core client for 30 sec - exiting
23:47:04 (2756): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
14:42:29 (31005): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
16:14:04 (31049): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:44:34 (27684): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:38:56 (13599): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:38:58 (13599): No heartbeat from core client for 30 sec - exiting
19:39:00 (13599): No heartbeat from core client for 30 sec - exiting
19:40:35 (14607): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:28:02 (27841): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
04:21:58 (3167): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09a35830 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6b6f1)[0xf74c96f1]
/lib32/libc.so.6(+0x6cf78)[0xf74caf78]
/lib32/libc.so.6(cfree+0x6d)[0xf74ce02d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf76abf1f]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7474e46]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:05 11810376                           /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:05 11810376                           /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
099e0000-09a45000 rw-p 00000000 00:00 0                                  [heap]
f6e00000-f6e21000 rw-p 00000000 00:00 0 
f6e21000-f6f00000 ---p 00000000 00:00 0 
f6fe0000-f745b000 rw-s 00000000 08:05 11811135                           /var/lib/boinc-client/slots/9/136455
f745b000-f745e000 rw-p 00000000 00:00 0 
f745e000-f75b1000 r-xp 00000000 08:05 13893677                           /lib32/libc-2.13.so
f75b1000-f75b3000 r--p 00153000 08:05 13893677                           /lib32/libc-2.13.so
f75b3000-f75b4000 rw-p 00155000 08:05 13893677                           /lib32/libc-2.13.so
f75b4000-f75b7000 rw-p 00000000 00:00 0 
f75b7000-f75d3000 r-xp 00000000 08:05 26218272                           /usr/lib32/libgcc_s.so.1
f75d3000-f75d4000 rw-p 0001b000 08:05 26218272                           /usr/lib32/libgcc_s.so.1
f75d4000-f75f8000 r-xp 00000000 08:05 13893684                           /lib32/libm-2.13.so
f75f8000-f75f9000 r--p 00023000 08:05 13893684                           /lib32/libm-2.13.so
f75f9000-f75fa000 rw-p 00024000 08:05 13893684                           /lib32/libm-2.13.so
f75fa000-f76dc000 r-xp 00000000 08:05 26215118                           /usr/lib32/libstdc++.so.6.0.16
f76dc000-f76e0000 r--p 000e2000 08:05 26215118                           /usr/lib32/libstdc++.so.6.0.16
f76e0000-f76e1000 rw-p 000e6000 08:05 26215118                           /usr/lib32/libstdc++.so.6.0.16
f76e1000-f76e8000 rw-p 00000000 00:00 0 
f76e8000-f76ea000 r-xp 00000000 08:05 13893691                           /lib32/libdl-2.13.so
f76ea000-f76eb000 r--p 00001000 08:05 13893691                           /lib32/libdl-2.13.so
f76eb000-f76ec000 rw-p 00002000 08:05 13893691                           /lib32/libdl-2.13.so
f76ec000-f7701000 r-xp 00000000 08:05 13893695                           /lib32/libpthread-2.13.so
f7701000-f7702000 r--p 00014000 08:05 13893695                           /lib32/libpthread-2.13.so
f7702000-f7703000 rw-p 00015000 08:05 13893695                           /lib32/libpthread-2.13.so
f7703000-f7706000 rw-p 00000000 00:00 0 
f771e000-f771f000 rw-p 00000000 00:00 0 
f771f000-f7720000 ---p 00000000 00:00 0 
f7720000-f7723000 rw-p 00000000 00:00 0 
f7723000-f7725000 rw-s 00000000 08:05 11811055                           /var/lib/boinc-client/slots/9/boinc_mmap_file
f7725000-f7726000 rw-p 00000000 00:00 0 
f7726000-f7727000 r-xp 00000000 00:00 0                                  [vdso]
f7727000-f7743000 r-xp 00000000 08:05 13893699                           /lib32/ld-2.13.so
f7743000-f7744000 r--p 0001b000 08:05 13893699                           /lib32/ld-2.13.so
f7744000-f7745000 rw-p 0001c000 08:05 13893699                           /lib32/ld-2.13.so
fff0f000-fff7f000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (17 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7726400]
[0xf7726430]
/lib32/libc.so.6(gsignal+0x51)[0xf7488bb1]
/lib32/libc.so.6(abort+0x182)[0xf748bfd2]
/lib32/libc.so.6(+0x61605)[0xf74bf605]
/lib32/libc.so.6(+0x6b6f1)[0xf74c96f1]
/lib32/libc.so.6(+0x6cf78)[0xf74caf78]
/lib32/libc.so.6(cfree+0x6d)[0xf74ce02d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf76abf1f]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7474e46]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
25 Sep 2011 07:45:00 1166680 13315765 hadcm3n_yg6k_1940_40_007432239_0 518,400 1,267,272 2.4446
23 Sep 2011 19:15:54 1166680 13315765 hadcm3n_yg6k_1940_40_007432239_0 492,480 1,207,654 2.4522
22 Sep 2011 17:47:56 1166680 13315765 hadcm3n_yg6k_1940_40_007432239_0 466,560 1,148,818 2.4623
21 Sep 2011 02:57:51 1166680 13315765 hadcm3n_yg6k_1940_40_007432239_0 440,640 1,087,284 2.4675
20 Sep 2011 08:13:13 1166680 13315765 hadcm3n_yg6k_1940_40_007432239_0 414,720 1,026,544 2.4753
18 Sep 2011 19:16:47 1166680 13315765 hadcm3n_yg6k_1940_40_007432239_0 388,800 964,114 2.4797
18 Sep 2011 00:30:12 1166680 13315765 hadcm3n_yg6k_1940_40_007432239_0 362,880 903,547 2.4899
16 Sep 2011 19:06:45 1166680 13315765 hadcm3n_yg6k_1940_40_007432239_0 336,960 840,864 2.4954
15 Sep 2011 22:03:04 1166680 13315765 hadcm3n_yg6k_1940_40_007432239_0 311,040 780,050 2.5079
14 Sep 2011 05:10:47 1166680 13315765 hadcm3n_yg6k_1940_40_007432239_0 285,120 717,886 2.5178
12 Sep 2011 19:38:26 1166680 13315765 hadcm3n_yg6k_1940_40_007432239_0 259,200 653,117 2.5197
11 Sep 2011 11:46:14 1166680 13315765 hadcm3n_yg6k_1940_40_007432239_0 233,280 587,339 2.5177
10 Sep 2011 11:24:26 1166680 13315765 hadcm3n_yg6k_1940_40_007432239_0 207,360 518,563 2.5008
09 Sep 2011 09:22:58 1166680 13315765 hadcm3n_yg6k_1940_40_007432239_0 181,440 449,160 2.4755
07 Sep 2011 12:58:16 1166680 13315765 hadcm3n_yg6k_1940_40_007432239_0 155,520 383,997 2.4691
05 Sep 2011 19:12:46 1166680 13315765 hadcm3n_yg6k_1940_40_007432239_0 129,600 318,279 2.4559
04 Sep 2011 21:45:59 1166680 13315765 hadcm3n_yg6k_1940_40_007432239_0 103,680 254,180 2.4516
03 Sep 2011 13:33:05 1166680 13315765 hadcm3n_yg6k_1940_40_007432239_0 77,760 192,221 2.4720
02 Sep 2011 13:47:07 1166680 13315765 hadcm3n_yg6k_1940_40_007432239_0 51,840 130,961 2.5263
01 Sep 2011 10:39:32 1166680 13315765 hadcm3n_yg6k_1940_40_007432239_0 25,920 65,117 2.5122


©2024 climateprediction.net