climateprediction.net home page
Task 13017132

Task 13017132

Name hadcm3n_t4k2_1940_40_007312789_0
Workunit 7510219
Created 28 Jun 2011, 4:48:51 UTC
Sent 28 Jun 2011, 5:02:20 UTC
Report deadline 27 Sep 2011, 12:29:31 UTC
Received 27 Aug 2011, 7:50:38 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1143136
Run time 15 days 1 hours 47 min 34 sec
CPU time 13 days 18 hours 18 min 33 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 3.59 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.12.33</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:07:25 (9175): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:07:26 (9175): No heartbeat from core client for 30 sec - exiting
02:07:27 (9175): No heartbeat from core client for 30 sec - exiting
02:07:28 (9175): No heartbeat from core client for 30 sec - exiting
02:07:29 (9175): No heartbeat from core client for 30 sec - exiting
02:07:30 (9175): No heartbeat from core client for 30 sec - exiting
02:07:31 (9175): No heartbeat from core client for 30 sec - exiting
02:07:32 (9175): No heartbeat from core client for 30 sec - exiting
02:07:33 (9175): No heartbeat from core client for 30 sec - exiting
02:07:34 (9175): No heartbeat from core client for 30 sec - exiting
02:07:35 (9175): No heartbeat from core client for 30 sec - exiting
02:07:36 (9175): No heartbeat from core client for 30 sec - exiting
02:07:37 (9175): No heartbeat from core client for 30 sec - exiting
02:07:38 (9175): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:07:28 (21806): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08979030 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6d0bf)[0xf74f50bf]
/lib32/libc.so.6(+0x6e9e0)[0xf74f69e0]
/lib32/libc.so.6(cfree+0x6e)[0xf74f9b7e]
/usr/lib/gcc/x86_64-pc-linux-gnu/4.4.5/32/libstdc++.so.6(_ZdlPv+0x22)[0xf76e5732]
/usr/lib/gcc/x86_64-pc-linux-gnu/4.4.5/32/libstdc++.so.6(_ZdaPv+0x1e)[0xf76e578e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf749ecd7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:03 262623                             /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:03 262623                             /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
08923000-08989000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f700b000-f7486000 rw-s 00000000 08:03 661543                             /var/lib/boinc/slots/1/134480
f7486000-f7488000 rw-p 00000000 00:00 0 
f7488000-f75de000 r-xp 00000000 08:03 101919                             /lib32/libc-2.12.2.so
f75de000-f75e0000 r--p 00156000 08:03 101919                             /lib32/libc-2.12.2.so
f75e0000-f75e1000 rw-p 00158000 08:03 101919                             /lib32/libc-2.12.2.so
f75e1000-f75e4000 rw-p 00000000 00:00 0 
f75e4000-f75ff000 r-xp 00000000 08:03 922415                             /lib32/libgcc_s.so.1
f75ff000-f7600000 r--p 0001a000 08:03 922415                             /lib32/libgcc_s.so.1
f7600000-f7601000 rw-p 0001b000 08:03 922415                             /lib32/libgcc_s.so.1
f7601000-f7625000 r-xp 00000000 08:03 97871                              /lib32/libm-2.12.2.so
f7625000-f7626000 r--p 00023000 08:03 97871                              /lib32/libm-2.12.2.so
f7626000-f7627000 rw-p 00024000 08:03 97871                              /lib32/libm-2.12.2.so
f7627000-f7628000 rw-p 00000000 00:00 0 
f7628000-f7713000 r-xp 00000000 08:03 1471692                            /usr/lib64/gcc/x86_64-pc-linux-gnu/4.4.5/32/libstdc++.so.6.0.13
f7713000-f7714000 ---p 000eb000 08:03 1471692                            /usr/lib64/gcc/x86_64-pc-linux-gnu/4.4.5/32/libstdc++.so.6.0.13
f7714000-f7718000 r--p 000eb000 08:03 1471692                            /usr/lib64/gcc/x86_64-pc-linux-gnu/4.4.5/32/libstdc++.so.6.0.13
f7718000-f7719000 rw-p 000ef000 08:03 1471692                            /usr/lib64/gcc/x86_64-pc-linux-gnu/4.4.5/32/libstdc++.so.6.0.13
f7719000-f7720000 rw-p 00000000 00:00 0 
f7720000-f7722000 r-xp 00000000 08:03 97872                              /lib32/libdl-2.12.2.so
f7722000-f7723000 r--p 00001000 08:03 97872                              /lib32/libdl-2.12.2.so
f7723000-f7724000 rw-p 00002000 08:03 97872                              /lib32/libdl-2.12.2.so
f7724000-f7739000 r-xp 00000000 08:03 41377                              /lib32/libpthread-2.12.2.so
f7739000-f773a000 ---p 00015000 08:03 41377                              /lib32/libpthread-2.12.2.so
f773a000-f773b000 r--p 00015000 08:03 41377                              /lib32/libpthread-2.12.2.so
f773b000-f773c000 rw-p 00016000 08:03 41377                              /lib32/libpthread-2.12.2.so
f773c000-f773e000 rw-p 00000000 00:00 0 
f7766000-f7767000 rw-p 00000000 00:00 0 
f7767000-f7768000 ---p 00000000 00:00 0 
f7768000-f776b000 rw-p 00000000 00:00 0 
f776b000-f776d000 rw-s 00000000 08:03 661540                             /var/lib/boinc/slots/1/boinc_mmap_file
f776d000-f776e000 rw-p 00000000 00:00 0 
f776e000-f778a000 r-xp 00000000 08:03 101913                             /lib32/ld-2.12.2.so
f778a000-f778b000 r-xp 00000000 00:00 0                                  [vdso]
f778b000-f778c000 r--p 0001c000 08:03 101913                             /lib32/ld-2.12.2.so
f778c000-f778d000 rw-p 0001d000 08:03 101913                             /lib32/ld-2.12.2.so
ffc9f000-ffd10000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf778a400]
[0xf778a430]
/lib32/libc.so.6(gsignal+0x52)[0xf74b2b62]
/lib32/libc.so.6(abort+0x180)[0xf74b42d0]
/lib32/libc.so.6(+0x67085)[0xf74ef085]
/lib32/libc.so.6(+0x6d0bf)[0xf74f50bf]
/lib32/libc.so.6(+0x6e9e0)[0xf74f69e0]
/lib32/libc.so.6(cfree+0x6e)[0xf74f9b7e]
/usr/lib/gcc/x86_64-pc-linux-gnu/4.4.5/32/libstdc++.so.6(_ZdlPv+0x22)[0xf76e5732]
/usr/lib/gcc/x86_64-pc-linux-gnu/4.4.5/32/libstdc++.so.6(_ZdaPv+0x1e)[0xf76e578e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf749ecd7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
27 Aug 2011 07:52:05 1143136 13017132 hadcm3n_t4k2_1940_40_007312789_0 777,600 1,189,108 1.5292
25 Aug 2011 07:03:52 1143136 13017132 hadcm3n_t4k2_1940_40_007312789_0 751,680 1,149,928 1.5298
22 Aug 2011 05:44:48 1143136 13017132 hadcm3n_t4k2_1940_40_007312789_0 725,760 1,110,763 1.5305
19 Aug 2011 08:23:19 1143136 13017132 hadcm3n_t4k2_1940_40_007312789_0 699,840 1,072,354 1.5323
18 Aug 2011 04:36:49 1143136 13017132 hadcm3n_t4k2_1940_40_007312789_0 673,920 1,034,447 1.5350
16 Aug 2011 05:44:57 1143136 13017132 hadcm3n_t4k2_1940_40_007312789_0 648,000 995,777 1.5367
14 Aug 2011 08:42:37 1143136 13017132 hadcm3n_t4k2_1940_40_007312789_0 622,080 956,843 1.5381
13 Aug 2011 04:22:40 1143136 13017132 hadcm3n_t4k2_1940_40_007312789_0 596,160 918,115 1.5400
11 Aug 2011 03:51:00 1143136 13017132 hadcm3n_t4k2_1940_40_007312789_0 570,240 879,046 1.5415
09 Aug 2011 04:41:51 1143136 13017132 hadcm3n_t4k2_1940_40_007312789_0 544,320 839,731 1.5427
07 Aug 2011 05:23:10 1143136 13017132 hadcm3n_t4k2_1940_40_007312789_0 518,400 800,681 1.5445
05 Aug 2011 05:18:52 1143136 13017132 hadcm3n_t4k2_1940_40_007312789_0 492,480 761,487 1.5462
03 Aug 2011 03:25:48 1143136 13017132 hadcm3n_t4k2_1940_40_007312789_0 466,560 721,619 1.5467
01 Aug 2011 05:29:52 1143136 13017132 hadcm3n_t4k2_1940_40_007312789_0 440,640 682,181 1.5482
30 Jul 2011 07:26:35 1143136 13017132 hadcm3n_t4k2_1940_40_007312789_0 414,720 642,785 1.5499
27 Jul 2011 06:16:52 1143136 13017132 hadcm3n_t4k2_1940_40_007312789_0 388,800 603,519 1.5523
25 Jul 2011 22:51:19 1143136 13017132 hadcm3n_t4k2_1940_40_007312789_0 362,880 564,285 1.5550
25 Jul 2011 19:28:19 1143136 13017132 hadcm3n_t4k2_1940_40_007312789_0 336,960 524,763 1.5573
25 Jul 2011 18:47:16 1143136 13017132 hadcm3n_t4k2_1940_40_007312789_0 311,040 484,295 1.5570
25 Jul 2011 16:48:16 1143136 13017132 hadcm3n_t4k2_1940_40_007312789_0 285,120 443,624 1.5559


©2024 cpdn.org