climateprediction.net home page
Task 15539965

Task 15539965

Name hadcm3n_3hhl_1940_40_008264323_2
Workunit 8419447
Created 13 Jan 2013, 12:03:19 UTC
Sent 13 Jan 2013, 12:03:47 UTC
Report deadline 14 Apr 2013, 19:30:58 UTC
Received 16 Feb 2013, 11:07:00 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1171203
Run time 18 days 9 hours 28 min 7 sec
CPU time 17 days 10 hours 35 min 50 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 3.08 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:14:59 (1811): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:48:38 (11893): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:54:49 (12890): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:56:39 (13019): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:58:30 (13068): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:01:19 (24306): No heartbeat from core client for 30 sec - exiting
18:01:20 (24306): No heartbeat from core client for 30 sec - exiting
18:01:21 (24306): No heartbeat from core client for 30 sec - exiting
18:01:22 (24306): No heartbeat from core client for 30 sec - exiting
18:01:23 (24306): No heartbeat from core client for 30 sec - exiting
18:01:24 (24306): No heartbeat from core client for 30 sec - exiting
18:01:25 (24306): No heartbeat from core client for 30 sec - exiting
18:01:26 (24306): No heartbeat from core client for 30 sec - exiting
18:01:27 (24306): No heartbeat from core client for 30 sec - exiting
18:01:28 (24306): No heartbeat from core client for 30 sec - exiting
18:01:29 (24306): No heartbeat from core client for 30 sec - exiting
18:01:30 (24306): No heartbeat from core client for 30 sec - exiting
18:01:31 (24306): No heartbeat from core client for 30 sec - exiting
18:01:32 (24306): No heartbeat from core client for 30 sec - exiting
18:01:33 (24306): No heartbeat from core client for 30 sec - exiting
18:01:34 (24306): No heartbeat from core client for 30 sec - exiting
18:01:35 (24306): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:02:16 (24486): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09bd6120 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6efe1)[0xf74cffe1]
/lib32/libc.so.6(+0x70868)[0xf74d1868]
/lib32/libc.so.6(cfree+0x6d)[0xf74d494d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76c1a91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76c1aed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7477bd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 09:01 131312                             /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 09:01 131312                             /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
09b80000-09be4000 rw-p 00000000 00:00 0                                  [heap]
f6e00000-f6e21000 rw-p 00000000 00:00 0 
f6e21000-f6f00000 ---p 00000000 00:00 0 
f6fe4000-f745f000 rw-s 00000000 09:01 263101                             /var/lib/boinc-client/slots/6/135890
f745f000-f7461000 rw-p 00000000 00:00 0 
f7461000-f75ba000 r-xp 00000000 09:01 263916                             /lib32/libc-2.11.1.so
f75ba000-f75bb000 ---p 00159000 09:01 263916                             /lib32/libc-2.11.1.so
f75bb000-f75bd000 r--p 00159000 09:01 263916                             /lib32/libc-2.11.1.so
f75bd000-f75be000 rw-p 0015b000 09:01 263916                             /lib32/libc-2.11.1.so
f75be000-f75c1000 rw-p 00000000 00:00 0 
f75c1000-f75de000 r-xp 00000000 09:01 821291                             /usr/lib32/libgcc_s.so.1
f75de000-f75df000 r--p 0001c000 09:01 821291                             /usr/lib32/libgcc_s.so.1
f75df000-f75e0000 rw-p 0001d000 09:01 821291                             /usr/lib32/libgcc_s.so.1
f75e0000-f7604000 r-xp 00000000 09:01 263895                             /lib32/libm-2.11.1.so
f7604000-f7605000 r--p 00023000 09:01 263895                             /lib32/libm-2.11.1.so
f7605000-f7606000 rw-p 00024000 09:01 263895                             /lib32/libm-2.11.1.so
f7606000-f76ef000 r-xp 00000000 09:01 821289                             /usr/lib32/libstdc++.so.6.0.13
f76ef000-f76f3000 r--p 000e9000 09:01 821289                             /usr/lib32/libstdc++.so.6.0.13
f76f3000-f76f4000 rw-p 000ed000 09:01 821289                             /usr/lib32/libstdc++.so.6.0.13
f76f4000-f76fb000 rw-p 00000000 00:00 0 
f76fb000-f76fd000 r-xp 00000000 09:01 263913                             /lib32/libdl-2.11.1.so
f76fd000-f76fe000 r--p 00001000 09:01 263913                             /lib32/libdl-2.11.1.so
f76fe000-f76ff000 rw-p 00002000 09:01 263913                             /lib32/libdl-2.11.1.so
f76ff000-f7700000 rw-p 00000000 00:00 0 
f7700000-f7715000 r-xp 00000000 09:01 263908                             /lib32/libpthread-2.11.1.so
f7715000-f7716000 r--p 00014000 09:01 263908                             /lib32/libpthread-2.11.1.so
f7716000-f7717000 rw-p 00015000 09:01 263908                             /lib32/libpthread-2.11.1.so
f7717000-f7719000 rw-p 00000000 00:00 0 
f772d000-f772e000 rw-p 00000000 00:00 0 
f772e000-f772f000 ---p 00000000 00:00 0 
f772f000-f7732000 rw-p 00000000 00:00 0 
f7732000-f7734000 rw-s 00000000 09:01 263094                             /var/lib/boinc-client/slots/6/boinc_mmap_file
f7734000-f7736000 rw-p 00000000 00:00 0 
f7736000-f7737000 r-xp 00000000 00:00 0                                  [vdso]
f7737000-f7753000 r-xp 00000000 09:01 263905                             /lib32/ld-2.11.1.so
f7753000-f7754000 r--p 0001b000 09:01 263905                             /lib32/ld-2.11.1.so
f7754000-f7755000 rw-p 0001c000 09:01 263905                             /lib32/ld-2.11.1.so
fff36000-fffa5000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7736400]
[0xf7736430]
/lib32/libc.so.6(gsignal+0x51)[0xf748b951]
/lib32/libc.so.6(abort+0x182)[0xf748ed82]
/lib32/libc.so.6(+0x64eed)[0xf74c5eed]
/lib32/libc.so.6(+0x6efe1)[0xf74cffe1]
/lib32/libc.so.6(+0x70868)[0xf74d1868]
/lib32/libc.so.6(cfree+0x6d)[0xf74d494d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76c1a91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76c1aed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7477bd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
16 Feb 2013 11:09:26 1171203 15539965 hadcm3n_3hhl_1940_40_008264323_2 777,600 1,506,946 1.9379
15 Feb 2013 11:27:38 1171203 15539965 hadcm3n_3hhl_1940_40_008264323_2 751,680 1,457,760 1.9393
14 Feb 2013 12:26:29 1171203 15539965 hadcm3n_3hhl_1940_40_008264323_2 725,760 1,409,181 1.9417
13 Feb 2013 12:17:05 1171203 15539965 hadcm3n_3hhl_1940_40_008264323_2 699,840 1,358,835 1.9416
12 Feb 2013 11:05:08 1171203 15539965 hadcm3n_3hhl_1940_40_008264323_2 673,920 1,308,089 1.9410
11 Feb 2013 10:11:30 1171203 15539965 hadcm3n_3hhl_1940_40_008264323_2 648,000 1,259,014 1.9429
10 Feb 2013 20:57:07 1171203 15539965 hadcm3n_3hhl_1940_40_008264323_2 622,080 1,209,985 1.9451
10 Feb 2013 06:31:26 1171203 15539965 hadcm3n_3hhl_1940_40_008264323_2 596,160 1,161,843 1.9489
09 Feb 2013 06:56:23 1171203 15539965 hadcm3n_3hhl_1940_40_008264323_2 570,240 1,112,954 1.9517
07 Feb 2013 15:56:37 1171203 15539965 hadcm3n_3hhl_1940_40_008264323_2 544,320 1,064,541 1.9557
06 Feb 2013 14:55:39 1171203 15539965 hadcm3n_3hhl_1940_40_008264323_2 518,400 1,016,335 1.9605
05 Feb 2013 09:22:02 1171203 15539965 hadcm3n_3hhl_1940_40_008264323_2 492,480 966,800 1.9631
04 Feb 2013 08:12:41 1171203 15539965 hadcm3n_3hhl_1940_40_008264323_2 466,560 917,938 1.9675
03 Feb 2013 16:36:07 1171203 15539965 hadcm3n_3hhl_1940_40_008264323_2 440,640 867,084 1.9678
02 Feb 2013 17:21:25 1171203 15539965 hadcm3n_3hhl_1940_40_008264323_2 414,720 804,529 1.9399
01 Feb 2013 15:16:06 1171203 15539965 hadcm3n_3hhl_1940_40_008264323_2 388,800 743,183 1.9115
31 Jan 2013 12:40:12 1171203 15539965 hadcm3n_3hhl_1940_40_008264323_2 362,880 683,916 1.8847
30 Jan 2013 14:10:21 1171203 15539965 hadcm3n_3hhl_1940_40_008264323_2 336,960 622,894 1.8486
29 Jan 2013 15:00:29 1171203 15539965 hadcm3n_3hhl_1940_40_008264323_2 311,040 572,182 1.8396
24 Jan 2013 09:41:17 1171203 15539965 hadcm3n_3hhl_1940_40_008264323_2 285,120 523,896 1.8375


©2024 climateprediction.net