climateprediction.net home page
Task 15886103

Task 15886103

Name hadcm3n_n2b6_1880_40_008399159_0
Workunit 8550015
Created 8 Jul 2013, 19:53:35 UTC
Sent 11 Jul 2013, 4:11:48 UTC
Report deadline 10 Oct 2013, 11:38:59 UTC
Received 20 Jul 2013, 21:12:05 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1170335
Run time 8 days 0 hours 40 min 31 sec
CPU time 7 days 13 hours 58 min 45 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 1.96 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
21:28:10 (20043): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:28:12 (20043): No heartbeat from core client for 30 sec - exiting
21:28:13 (20043): No heartbeat from core client for 30 sec - exiting
23:55:58 (20434): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
00:30:43 (21000): No heartbeat from core client for 30 sec - exiting
00:30:47 (21000): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:30:48 (21000): No heartbeat from core client for 30 sec - exiting
00:30:49 (21000): No heartbeat from core client for 30 sec - exiting
00:30:50 (21000): No heartbeat from core client for 30 sec - exiting
00:30:51 (21000): No heartbeat from core client for 30 sec - exiting
00:30:52 (21000): No heartbeat from core client for 30 sec - exiting
00:30:53 (21000):00:52:28 (7728): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:13:52 (7874): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:13:54 (7874): No heartbeat from core client for 30 sec - exiting
01:13:55 (7874): No heartbeat from core client for 30 sec - exiting
01:13:56 (7874): No heartbeat from core client for 30 sec - exiting
01:13:57 (7874): No heartbeat from core client for 30 sec - exiting
01:27:04 (8014): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:27:14 (8014): No heartbeat from core client for 30 sec - exiting
01:45:58 (8140): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:46:00 (8140): No heartbeat from core client for 30 sec - exiting
01:46:02 (8140): No heartbeat from core client for 30 sec - exiting
01:57:13 (8263): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:57:15 (8263): No heartbeat from core client for 30 sec - exiting
01:57:16 (8263): No heartbeat from core client for 30 sec - exiting
01:57:17 (8263): No heartbeat from core client for 30 sec - exiting
01:57:18 (8263): No heartbeat from core client for 30 sec - exiting
02:08:41 (8378): No heartbeat from core client for 30 sec - exiting
02:08:44 (8378): No heartbeat from core client for 30 sec - exiting
02:08:45 (8378): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:08:46 (8378): No heartbeat from core client for 30 sec - exiting
02:08:47 (8378): No heartbeat from core client for 30 sec - exiting
02:08:48 (8378): No heartbeat from core client for 30 sec - exiting
02:41:26 (8453): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:41:27 (8453): No heartbeat from core client for 30 sec - exiting
02:41:28 (8453): No heartbeat from core client for 30 sec - exiting
02:54:25 (8593): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:54:30 (8593): No heartbeat from core client for 30 sec - exiting
02:54:31 (8593): No heartbeat from core client for 30 sec - exiting
02:54:32 (8593): No heartbeat from core client for 30 sec - exiting
02:54:33 (8593): No heartbeat from core client for 30 sec - exiting
03:07:05 (8680): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:07:11 (8680): No heartbeat from core client for 30 sec - exiting
03:57:59 (8772): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:58:04 (8772): No heartbeat from core client for 30 sec - exiting
04:25:00 (8972): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:40:07 (9093): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:40:11 (9093): No heartbeat from core client for 30 sec - exiting
04:40:12 (9093): No heartbeat from core client for 30 sec - exiting
05:02:04 (9172): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:23:58 (9255): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:24:03 (9255): No heartbeat from core client for 30 sec - exiting
05:24:04 (9255): No heartbeat from core client for 30 sec - exiting
05:24:05 (9255): No heartbeat from core client for 30 sec - exiting
05:24:06 (9255): No heartbeat from core client for 30 sec - exiting
05:24:07 (9255): No heartbeat from core client for 30 sec - exiting
05:47:01 (9354): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:13:51 (9438): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
18:41:46 (2592): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:41:47 (2592): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08636db8 ***
======= Backtrace: =========
/lib32/libc.so.6[0xf7547da1]
/lib32/libc.so.6[0xf75494d2]
/lib32/libc.so.6(cfree+0x6d)[0xf754c5ad]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf771da61]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf771dabd]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf74f2b56]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:06 1442079                            /home/antonio/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rwxp 0009b000 08:06 1442079                            /home/antonio/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rwxp 00000000 00:00 0 
085e1000-08647000 rwxp 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rwxp 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f705f000-f74da000 rwxs 00000000 08:06 918950                             /home/antonio/BOINC/slots/27/134945
f74da000-f74dc000 rwxp 00000000 00:00 0 
f74dc000-f761b000 r-xp 00000000 08:01 835                                /lib32/libc-2.10.1.so
f761b000-f761d000 r-xp 0013e000 08:01 835                                /lib32/libc-2.10.1.so
f761d000-f761e000 rwxp 00140000 08:01 835                                /lib32/libc-2.10.1.so
f761e000-f7621000 rwxp 00000000 00:00 0 
f7621000-f763d000 r-xp 00000000 08:01 154                                /usr/lib32/libgcc_s.so.1
f763d000-f763e000 r-xp 0001b000 08:01 154                                /usr/lib32/libgcc_s.so.1
f763e000-f763f000 rwxp 0001c000 08:01 154                                /usr/lib32/libgcc_s.so.1
f763f000-f7663000 r-xp 00000000 08:01 1277                               /lib32/libm-2.10.1.so
f7663000-f7664000 r-xp 00023000 08:01 1277                               /lib32/libm-2.10.1.so
f7664000-f7665000 rwxp 00024000 08:01 1277                               /lib32/libm-2.10.1.so
f7665000-f774b000 r-xp 00000000 08:01 147                                /usr/lib32/libstdc++.so.6.0.13
f774b000-f774f000 r-xp 000e6000 08:01 147                                /usr/lib32/libstdc++.so.6.0.13
f774f000-f7750000 rwxp 000ea000 08:01 147                                /usr/lib32/libstdc++.so.6.0.13
f7750000-f7757000 rwxp 00000000 00:00 0 
f7757000-f7759000 r-xp 00000000 08:01 1268                               /lib32/libdl-2.10.1.so
f7759000-f775a000 r-xp 00001000 08:01 1268                               /lib32/libdl-2.10.1.so
f775a000-f775b000 rwxp 00002000 08:01 1268                               /lib32/libdl-2.10.1.so
f775b000-f775c000 rwxp 00000000 00:00 0 
f775c000-f7771000 r-xp 00000000 08:01 1525                               /lib32/libpthread-2.10.1.so
f7771000-f7772000 r-xp 00014000 08:01 1525                               /lib32/libpthread-2.10.1.so
f7772000-f7773000 rwxp 00015000 08:01 1525                               /lib32/libpthread-2.10.1.so
f7773000-f7775000 rwxp 00000000 00:00 0 
f778c000-f778d000 rwxp 00000000 00:00 0 
f778d000-f778e000 ---p 00000000 00:00 0 
f778e000-f7791000 rwxp 00000000 00:00 0 
f7791000-f7793000 rwxs 00000000 08:06 918945                             /home/antonio/BOINC/slots/27/boinc_mmap_file
f7793000-f7795000 rwxp 00000000 00:00 0 
f7795000-f7796000 r-xp 00000000 00:00 0                                  [vdso]
f7796000-f77b2000 r-xp 00000000 08:01 772                                /lib32/ld-2.10.1.so
f77b2000-f77b3000 r-xp 0001b000 08:01 772                                /lib32/ld-2.10.1.so
f77b3000-f77b4000 rwxp 0001c000 08:01 772                                /lib32/ld-2.10.1.so
ff99c000-ffa0d000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7795400]
[0xf7795430]
/lib32/libc.so.6(gsignal+0x51)[0xf75067d1]
/lib32/libc.so.6(abort+0x182)[0xf7509c32]
/lib32/libc.so.6[0xf753dc95]
/lib32/libc.so.6[0xf7547da1]
/lib32/libc.so.6[0xf75494d2]
/lib32/libc.so.6(cfree+0x6d)[0xf754c5ad]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf771da61]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf771dabd]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf74f2b56]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
23 Jul 2013 20:40:15 1170335 15886103 hadcm3n_n2b6_1880_40_008399159_0 259,200 655,121 2.5275
23 Jul 2013 20:09:23 1170335 15886103 hadcm3n_n2b6_1880_40_008399159_0 233,280 589,225 2.5258
23 Jul 2013 19:30:21 1170335 15886103 hadcm3n_n2b6_1880_40_008399159_0 207,360 524,844 2.5311
23 Jul 2013 17:14:26 1170335 15886103 hadcm3n_n2b6_1880_40_008399159_0 181,440 460,337 2.5371
23 Jul 2013 17:14:27 1170335 15886103 hadcm3n_n2b6_1880_40_008399159_0 155,520 395,644 2.5440
23 Jul 2013 17:14:26 1170335 15886103 hadcm3n_n2b6_1880_40_008399159_0 129,600 333,066 2.5700
23 Jul 2013 17:14:30 1170335 15886103 hadcm3n_n2b6_1880_40_008399159_0 103,680 265,975 2.5653
23 Jul 2013 17:14:28 1170335 15886103 hadcm3n_n2b6_1880_40_008399159_0 77,760 198,266 2.5497
23 Jul 2013 17:14:30 1170335 15886103 hadcm3n_n2b6_1880_40_008399159_0 51,840 131,138 2.5297
23 Jul 2013 17:14:27 1170335 15886103 hadcm3n_n2b6_1880_40_008399159_0 25,920 64,134 2.4743


©2024 climateprediction.net