climateprediction.net home page
Task 15839411

Task 15839411

Name hadcm3n_4asp_1940_40_008311134_4
Workunit 8462269
Created 11 Jun 2013, 20:44:03 UTC
Sent 11 Jun 2013, 21:23:58 UTC
Report deadline 11 Sep 2013, 4:51:09 UTC
Received 22 Jul 2013, 9:31:44 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1266853
Run time 8 days 17 hours 22 min 23 sec
CPU time 8 days 5 hours 30 min 30 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 2.07 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
05:48:18 (21399): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:48:26 (21399): No heartbeat from core client for 30 sec - exiting
05:48:28 (21399): No heartbeat from core client for 30 sec - exiting
05:48:29 (21399): No heartbeat from core client for 30 sec - exiting
05:48:30 (21399): No heartbeat from core client for 30 sec - exiting
05:48:31 (21399): No heartbeat from core client for 30 sec - exiting
05:48:32 (21399): No heartbeat from core client for 30 sec - exiting
05:48:33 (21399): No heartbeat from core client for 30 sec - exiting
05:48:34 (21399): No heartbeat from core client for 30 sec - exiting
05:48:35 (21399): No heartbeat from core client for 30 sec - exiting
07:44:46 (30321): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:44:50 (30321): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
01:26:36 (30889): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:38:16 (7426): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:46:56 (7607): No heartbeat from core client for 30 sec - exiting
01:46:59 (7607): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:55:05 (7748): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:55:06 (7748): No heartbeat from core client for 30 sec - exiting
01:55:07 (7748): No heartbeat from core client for 30 sec - exiting
01:55:08 (7748): No heartbeat from core client for 30 sec - exiting
01:55:09 (7748): No heartbeat from core client for 30 sec - exiting
01:55:10 (7748): No heartbeat from core client for 30 sec - exiting
02:04:41 (7910): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:04:52 (7910): No heartbeat from core client for 30 sec - exiting
02:10:31 (8003): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:10:34 (8003):02:15:58 (8093): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:16:03 (8093): No heartbeat from core client for 30 sec - exiting
02:25:40 (8185): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:25:44 (8185): No heartbeat from core client for 30 sec - exiting
03:25:18 (8274): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:00:54 (8415): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:01:11 (8415): No heartbeat from core client for 30 sec - exiting
04:01:12 (8415): No heartbeat from core client for 30 sec - exiting
04:01:13 (8415): No heartbeat from core client for 30 sec - exiting
04:01:14 (8415): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
04:59:21 (8519): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:07:05 (8640): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:12:59 (8753): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:13:03 (8753): No heartbeat from core client for 30 sec - exiting
05:22:18 (8848): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:22:19 (8848): No heartbeat from core client for 30 sec - exiting
05:29:22 (8968): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:29:26 (8968): No heartbeat from core client for 30 sec - exiting
05:29:27 (8968): No heartbeat from core client for 30 sec - exiting
05:29:28 (8968): No heartbeat from core client for 30 sec - exiting
05:29:29 (8968): No heartbeat from core client for 30 sec - exiting
05:47:10 (9082): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:47:17 (9082): No heartbeat from core client for 30 sec - exiting
05:47:18 (9082): No heartbeat from core client for 30 sec - exiting
06:23:10 (9189): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:23:22 (9189): No heartbeat from core client for 30 sec - exiting
07:08:59 (9306): No heartbeat from core client for 30 sec - exiting
07:09:15 (9306): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:09:16 (9306): No heartbeat from core client for 30 sec - exiting
07:09:17 (9306): No heartbeat from core client for 30 sec - exiting
07:09:18 (9306): No heartbeat from core client for 30 sec - exiting
18:42:09 (1732): No heartbeat from core client for 30 sec - exiting
18:42:10 (1732): No heartbeat from core client for 30 sec - exiting
18:42:11 (1732): No heartbeat from core client for 30 sec - exiting
18:42:12 (1732): No heartbeat from core client for 30 sec - exiting
18:42:13 (1732): No heartbeat from core client for 30 sec - exiting
18:42:14 (1732): No heartbeat from core client for 30 sec - exiting
18:42:15 (1732): No heartbeat from core client for 30 sec - exiting
18:42:16 (1732): No heartbeat from core client for 30 sec - exiting
18:42:17 (1732): No heartbeat from core client for 30 sec - exiting
18:42:18 (1732): No heartbeat from core client for 30 sec - exiting
18:42:19 (1732): No heartbeat from core client for 30 sec - exiting
18:42:20 (1732): No heartbeat from core client for 30 sec - exiting
18:42:21 (1732): No heartbeat from core client for 30 sec - exiting
18:42:22 (1732): No heartbeat from core client for 30 sec - exiting
18:42:23 (1732): No heartbeat from core client for 30 sec - exiting
18:42:24 (1732): No heartbeat from core client for 30 sec - exiting
18:42:25 (1732): No heartbeat from core client for 30 sec - exiting
18:42:26 (1732): No heartbeat from core client for 30 sec - exiting
18:42:27 (1732): No heartbeat from core client for 30 sec - exiting
18:42:28 (1732): No heartbeat from core client for 30 sec - exiting
18:42:29 (1732): No heartbeat from core client for 30 sec - exiting
18:42:30 (1732): No heartbeat from core client for 30 sec - exiting
18:42:31 (1732): No heartbeat from core client for 30 sec - exiting
18:42:32 (1732): No heartbeat from core client for 30 sec - exiting
18:42:33 (1732): No heartbeat from core client for 30 sec - exiting
18:42:34 (1732): No heartbeat from core client for 30 sec - exiting
18:42:35 (1732): No heartbeat from core client for 30 sec - exiting
18:42:36 (1732): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09439210 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6c421)[0xf750b421]
/lib32/libc.so.6(+0x6dcb0)[0xf750ccb0]
/lib32/libc.so.6(cfree+0x6d)[0xf750fd5d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76e67b1]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76e680d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf74b5ce7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:05 2555935                            /home/antonio/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rwxp 0009b000 08:05 2555935                            /home/antonio/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rwxp 00000000 00:00 0 
093e3000-09449000 rwxp 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rwxp 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f7021000-f749c000 rwxs 00000000 08:05 2572459                            /home/antonio/BOINC/slots/21/135505
f749c000-f749f000 rwxp 00000000 00:00 0 
f749f000-f75f3000 r-xp 00000000 08:05 647175                             /lib32/libc-2.12.1.so
f75f3000-f75f4000 ---p 00154000 08:05 647175                             /lib32/libc-2.12.1.so
f75f4000-f75f6000 r-xp 00154000 08:05 647175                             /lib32/libc-2.12.1.so
f75f6000-f75f7000 rwxp 00156000 08:05 647175                             /lib32/libc-2.12.1.so
f75f7000-f75fa000 rwxp 00000000 00:00 0 
f75fa000-f7614000 r-xp 00000000 08:05 1878250                            /usr/lib32/libgcc_s.so.1
f7614000-f7615000 r-xp 00019000 08:05 1878250                            /usr/lib32/libgcc_s.so.1
f7615000-f7616000 rwxp 0001a000 08:05 1878250                            /usr/lib32/libgcc_s.so.1
f7616000-f763a000 r-xp 00000000 08:05 647179                             /lib32/libm-2.12.1.so
f763a000-f763b000 r-xp 00023000 08:05 647179                             /lib32/libm-2.12.1.so
f763b000-f763c000 rwxp 00024000 08:05 647179                             /lib32/libm-2.12.1.so
f763c000-f771b000 r-xp 00000000 08:05 1878253                            /usr/lib32/libstdc++.so.6.0.14
f771b000-f771f000 r-xp 000de000 08:05 1878253                            /usr/lib32/libstdc++.so.6.0.14
f771f000-f7720000 rwxp 000e2000 08:05 1878253                            /usr/lib32/libstdc++.so.6.0.14
f7720000-f7727000 rwxp 00000000 00:00 0 
f7727000-f7729000 r-xp 00000000 08:05 647178                             /lib32/libdl-2.12.1.so
f7729000-f772a000 r-xp 00001000 08:05 647178                             /lib32/libdl-2.12.1.so
f772a000-f772b000 rwxp 00002000 08:05 647178                             /lib32/libdl-2.12.1.so
f772b000-f772c000 rwxp 00000000 00:00 0 
f772c000-f7741000 r-xp 00000000 08:05 647189                             /lib32/libpthread-2.12.1.so
f7741000-f7742000 r-xp 00014000 08:05 647189                             /lib32/libpthread-2.12.1.so
f7742000-f7743000 rwxp 00015000 08:05 647189                             /lib32/libpthread-2.12.1.so
f7743000-f7745000 rwxp 00000000 00:00 0 
f7757000-f7758000 rwxp 00000000 00:00 0 
f7758000-f7759000 ---p 00000000 00:00 0 
f7759000-f775c000 rwxp 00000000 00:00 0 
f775c000-f775e000 rwxs 00000000 08:05 2572456                            /home/antonio/BOINC/slots/21/boinc_mmap_file
f775e000-f7760000 rwxp 00000000 00:00 0 
f7760000-f7761000 r-xp 00000000 00:00 0                                  [vdso]
f7761000-f777d000 r-xp 00000000 08:05 647172                             /lib32/ld-2.12.1.so
f777d000-f777e000 r-xp 0001b000 08:05 647172                             /lib32/ld-2.12.1.so
f777e000-f777f000 rwxp 0001c000 08:05 647172                             /lib32/ld-2.12.1.so
ff9df000-ffa4e000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7760400]
[0xf7760430]
/lib32/libc.so.6(gsignal+0x51)[0xf74c9a01]
/lib32/libc.so.6(abort+0x182)[0xf74cce42]
/lib32/libc.so.6(+0x62345)[0xf7501345]
/lib32/libc.so.6(+0x6c421)[0xf750b421]
/lib32/libc.so.6(+0x6dcb0)[0xf750ccb0]
/lib32/libc.so.6(cfree+0x6d)[0xf750fd5d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76e67b1]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76e680d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf74b5ce7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
23 Jul 2013 21:39:11 1266853 15839411 hadcm3n_4asp_1940_40_008311134_4 259,200 711,028 2.7432
23 Jul 2013 21:01:31 1266853 15839411 hadcm3n_4asp_1940_40_008311134_4 233,280 638,647 2.7377
23 Jul 2013 20:31:20 1266853 15839411 hadcm3n_4asp_1940_40_008311134_4 207,360 564,628 2.7229
23 Jul 2013 20:04:30 1266853 15839411 hadcm3n_4asp_1940_40_008311134_4 181,440 504,328 2.7796
23 Jul 2013 19:14:13 1266853 15839411 hadcm3n_4asp_1940_40_008311134_4 155,520 435,360 2.7994
23 Jul 2013 17:05:28 1266853 15839411 hadcm3n_4asp_1940_40_008311134_4 129,600 362,080 2.7938
23 Jul 2013 17:05:24 1266853 15839411 hadcm3n_4asp_1940_40_008311134_4 103,680 291,509 2.8116
23 Jul 2013 17:05:28 1266853 15839411 hadcm3n_4asp_1940_40_008311134_4 77,760 221,429 2.8476
23 Jul 2013 17:05:26 1266853 15839411 hadcm3n_4asp_1940_40_008311134_4 51,840 148,934 2.8730
23 Jul 2013 17:05:27 1266853 15839411 hadcm3n_4asp_1940_40_008311134_4 25,920 76,426 2.9485


©2024 climateprediction.net