climateprediction.net home page
Task 13112504

Task 13112504

Name hadcm3n_ygk3_1900_40_007354317_0
Workunit 7551747
Created 6 Jul 2011, 14:32:50 UTC
Sent 15 Jul 2011, 14:15:30 UTC
Report deadline 14 Oct 2011, 21:42:41 UTC
Received 24 Jul 2011, 2:40:15 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1147202
Run time 7 days 13 hours 51 min 42 sec
CPU time 6 days 14 hours 24 min 33 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 2.47 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.59</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
23:29:25 (2532): No heartbeat from core client for 30 sec - exiting
23:29:27 (2532): No heartbeat from core client for 30 sec - exiting
23:29:28 (2532): No heartbeat from core client for 30 sec - exiting
23:29:30 (2532): No heartbeat from core client for 30 sec - exiting
23:29:32 (2532): No heartbeat from core client for 30 sec - exiting
23:29:34 (2532): No heartbeat from core client for 30 sec - exiting
23:29:35 (2532): No heartbeat from core client for 30 sec - exiting
23:29:36 (2532): No heartbeat from core client for 30 sec - exiting
23:29:37 (2532): No heartbeat from core client for 30 sec - exiting
23:29:38 (2532): No heartbeat from core client for 30 sec - exiting
23:29:39 (2532): No heartbeat from core client for 30 sec - exiting
23:29:40 (2532): No heartbeat from core client for 30 sec - exiting
23:29:41 (2532): No heartbeat from core client for 30 sec - exiting
23:29:42 (2532): No heartbeat from core client for 30 sec - exiting
23:29:43 (2532): No heartbeat from core client for 30 sec - exiting
23:29:44 (2532): No heartbeat from core client for 30 sec - exiting
23:29:45 (2532): No heartbeat from core client for 30 sec - exiting
23:29:47 (2532): No heartbeat from core client for 30 sec - exiting
23:29:48 (2532): No heartbeat from core client for 30 sec - exiting
23:29:49 (2532): No heartbeat from core client for 30 sec - exiting
23:29:50 (2532): No heartbeat from core client for 30 sec - exiting
23:29:51 (2532): No heartbeat from core client for 30 sec - exiting
23:29:52 (2532): No heartbeat from core client for 30 sec - exiting
23:29:53 (2532): No heartbeat from core client for 30 sec - exiting
23:29:54 (2532): No heartbeat from core client for 30 sec - exiting
23:29:55 (2532): No heartbeat from core client for 30 sec - exiting
23:29:56 (2532): No heartbeat from core client for 30 sec - exiting
23:29:57 (2532): No heartbeat from core client for 30 sec - exiting
23:29:58 (2532): No heartbeat from core client for 30 sec - exiting
23:29:59 (2532): No heartbeat from core client for 30 sec - exiting
23:30:00 (2532): No heartbeat from core client for 30 sec - exiting
23:30:01 (2532): No heartbeat from core client for 30 sec - exiting
23:30:02 (2532): No heartbeat from core client for 30 sec - exiting
23:30:03 (2532): No heartbeat from core client for 30 sec - exiting
23:30:04 (2532): No heartbeat from core client for 30 sec - exiting
23:30:05 (2532): No heartbeat from core client for 30 sec - exiting
23:30:06 (2532): No heartbeat from core client for 30 sec - exiting
23:30:07 (2532): No heartbeat from core client for 30 sec - exiting
23:30:08 (2532): No heartbeat from core client for 30 sec - exiting
23:30:09 (2532): No heartbeat from core client for 30 sec - exiting
23:30:10 (2532): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:31:09 (3943): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:31:10 (3943): No heartbeat from core client for 30 sec - exiting
16:31:11 (3943): No heartbeat from core client for 30 sec - exiting
16:31:12 (3943): No heartbeat from core client for 30 sec - exiting
16:31:13 (3943): No heartbeat from core client for 30 sec - exiting
16:31:14 (3943): No heartbeat from core client for 30 sec - exiting
16:31:15 (3943): No heartbeat from core client for 30 sec - exiting
16:31:16 (3943): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
14:00:24 (12976): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:01:04 (12976): No heartbeat from core client for 30 sec - exiting
14:01:05 (12976): No heartbeat from core client for 30 sec - exiting
14:01:06 (12976): No heartbeat from core client for 30 sec - exiting
14:01:07 (12976): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
CPDN Monitor - Quit request from BOINC...
15:18:05 (3183): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:00:15 (2854): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:00:22 (2854): No heartbeat from core client for 30 sec - exiting
01:00:58 (2854): No heartbeat from core client for 30 sec - exiting
01:00:59 (2854): No heartbeat from core client for 30 sec - exiting
01:01:00 (2854): No heartbeat from core client for 30 sec - exiting
01:01:01 (2854): No heartbeat from core client for 30 sec - exiting
01:01:02 (2854): No heartbeat from core client for 30 sec - exiting
01:01:03 (2854): No heartbeat from core client for 30 sec - exiting
01:01:04 (2854): No heartbeat from core client for 30 sec - exiting
01:01:05 (2854): No heartbeat from core client for 30 sec - exiting
01:01:06 (2854): No heartbeat from core client for 30 sec - exiting
01:01:07 (2854): No heartbeat from core client for 30 sec - exiting
01:01:08 (2854): No heartbeat from core client for 30 sec - exiting
01:01:09 (2854): No heartbeat from core client for 30 sec - exiting
01:01:10 (2854): No heartbeat from core client for 30 sec - exiting
01:01:11 (2854): No heartbeat from core client for 30 sec - exiting
01:01:12 (2854): No heartbeat from core client for 30 sec - exiting
01:01:13 (2854): No heartbeat from core client for 30 sec - exiting
01:01:14 (2854): No heartbeat from core client for 30 sec - exiting
01:01:15 (2854): No heartbeat from core client for 30 sec - exiting
01:01:16 (2854): No heartbeat from core client for 30 sec - exiting
01:01:17 (2854): No heartbeat from core client for 30 sec - exiting
01:01:18 (2854): No heartbeat from core client for 30 sec - exiting
01:01:19 (2854): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:39:21 (2543): No heartbeat from core client for 30 sec - exiting
19:39:22 (2543): No heartbeat from core client for 30 sec - exiting
19:39:23 (2543): No heartbeat from core client for 30 sec - exiting
19:39:24 (2543): No heartbeat from core client for 30 sec - exiting
19:39:25 (2543): No heartbeat from core client for 30 sec - exiting
19:39:26 (2543): No heartbeat from core client for 30 sec - exiting
19:39:27 (2543): No heartbeat from core client for 30 sec - exiting
19:39:28 (2543): No heartbeat from core client for 30 sec - exiting
19:39:29 (2543): No heartbeat from core client for 30 sec - exiting
19:39:30 (2543): No heartbeat from core client for 30 sec - exiting
19:39:31 (2543): No heartbeat from core client for 30 sec - exiting
19:39:32 (2543): No heartbeat from core client for 30 sec - exiting
19:39:33 (2543): No heartbeat from core client for 30 sec - exiting
19:39:34 (2543): No heartbeat from core client for 30 sec - exiting
19:39:35 (2543): No heartbeat from core client for 30 sec - exiting
19:39:36 (2543): No heartbeat from core client for 30 sec - exiting
19:39:37 (2543): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08a187d0 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6b511)[0xf74c7511]
/lib32/libc.so.6(+0x6ce1b)[0xf74c8e1b]
/lib32/libc.so.6(cfree+0x6d)[0xf74cbf8d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76a5841]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76a589d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf7472e37]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:11 29097994                           /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:11 29097994                           /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
089c3000-08a28000 rw-p 00000000 00:00 0                                  [heap]
f6e00000-f6e21000 rw-p 00000000 00:00 0 
f6e21000-f6f00000 ---p 00000000 00:00 0 
f6fde000-f7459000 rw-s 00000000 08:11 21365486                           /var/lib/boinc-client/slots/11/135680
f7459000-f745c000 rw-p 00000000 00:00 0 
f745c000-f75b2000 r-xp 00000000 08:11 21233715                           /lib32/libc-2.13.so
f75b2000-f75b3000 ---p 00156000 08:11 21233715                           /lib32/libc-2.13.so
f75b3000-f75b5000 r--p 00156000 08:11 21233715                           /lib32/libc-2.13.so
f75b5000-f75b6000 rw-p 00158000 08:11 21233715                           /lib32/libc-2.13.so
f75b6000-f75b9000 rw-p 00000000 00:00 0 
f75b9000-f75d3000 r-xp 00000000 08:11 14290333                           /usr/lib32/libgcc_s.so.1
f75d3000-f75d4000 r--p 00019000 08:11 14290333                           /usr/lib32/libgcc_s.so.1
f75d4000-f75d5000 rw-p 0001a000 08:11 14290333                           /usr/lib32/libgcc_s.so.1
f75d5000-f75f9000 r-xp 00000000 08:11 21233719                           /lib32/libm-2.13.so
f75f9000-f75fa000 r--p 00023000 08:11 21233719                           /lib32/libm-2.13.so
f75fa000-f75fb000 rw-p 00024000 08:11 21233719                           /lib32/libm-2.13.so
f75fb000-f76da000 r-xp 00000000 08:11 14289813                           /usr/lib32/libstdc++.so.6.0.14
f76da000-f76de000 r--p 000de000 08:11 14289813                           /usr/lib32/libstdc++.so.6.0.14
f76de000-f76df000 rw-p 000e2000 08:11 14289813                           /usr/lib32/libstdc++.so.6.0.14
f76df000-f76e6000 rw-p 00000000 00:00 0 
f76e6000-f76e8000 r-xp 00000000 08:11 21233718                           /lib32/libdl-2.13.so
f76e8000-f76e9000 r--p 00001000 08:11 21233718                           /lib32/libdl-2.13.so
f76e9000-f76ea000 rw-p 00002000 08:11 21233718                           /lib32/libdl-2.13.so
f76ea000-f76ff000 r-xp 00000000 08:11 21233729                           /lib32/libpthread-2.13.so
f76ff000-f7700000 r--p 00014000 08:11 21233729                           /lib32/libpthread-2.13.so
f7700000-f7701000 rw-p 00015000 08:11 21233729                           /lib32/libpthread-2.13.so
f7701000-f7704000 rw-p 00000000 00:00 0 
f7737000-f7738000 rw-p 00000000 00:00 0 
f7738000-f7739000 ---p 00000000 00:00 0 
f7739000-f773c000 rw-p 00000000 00:00 0 
f773c000-f773e000 rw-s 00000000 08:11 21366125                           /var/lib/boinc-client/slots/11/boinc_mmap_file
f773e000-f773f000 rw-p 00000000 00:00 0 
f773f000-f7740000 r-xp 00000000 00:00 0                                  [vdso]
f7740000-f775c000 r-xp 00000000 08:11 21233703                           /lib32/ld-2.13.so
f775c000-f775d000 r--p 0001b000 08:11 21233703                           /lib32/ld-2.13.so
f775d000-f775e000 rw-p 0001c000 08:11 21233703                           /lib32/ld-2.13.so
ffb63000-ffbd2000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf773f400]
[0xf773f430]
/lib32/libc.so.6(gsignal+0x51)[0xf7486ea1]
/lib32/libc.so.6(abort+0x17e)[0xf748a2ce]
/lib32/libc.so.6(+0x61277)[0xf74bd277]
/lib32/libc.so.6(+0x6b511)[0xf74c7511]
/lib32/libc.so.6(+0x6ce1b)[0xf74c8e1b]
/lib32/libc.so.6(cfree+0x6d)[0xf74cbf8d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76a5841]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76a589d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf7472e37]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
25 Jul 2011 21:41:07 1147202 13112504 hadcm3n_ygk3_1900_40_007354317_0 259,200 570,270 2.2001
25 Jul 2011 20:34:55 1147202 13112504 hadcm3n_ygk3_1900_40_007354317_0 233,280 512,984 2.1990
25 Jul 2011 20:19:23 1147202 13112504 hadcm3n_ygk3_1900_40_007354317_0 207,360 456,111 2.1996
25 Jul 2011 20:19:23 1147202 13112504 hadcm3n_ygk3_1900_40_007354317_0 181,440 398,982 2.1990
25 Jul 2011 18:49:38 1147202 13112504 hadcm3n_ygk3_1900_40_007354317_0 155,520 341,646 2.1968
25 Jul 2011 18:00:24 1147202 13112504 hadcm3n_ygk3_1900_40_007354317_0 129,600 285,174 2.2004
25 Jul 2011 17:28:06 1147202 13112504 hadcm3n_ygk3_1900_40_007354317_0 103,680 229,234 2.2110
25 Jul 2011 16:30:13 1147202 13112504 hadcm3n_ygk3_1900_40_007354317_0 77,760 171,907 2.2107
25 Jul 2011 15:55:01 1147202 13112504 hadcm3n_ygk3_1900_40_007354317_0 51,840 114,173 2.2024
25 Jul 2011 15:29:03 1147202 13112504 hadcm3n_ygk3_1900_40_007354317_0 25,920 57,107 2.2032


©2024 climateprediction.net