climateprediction.net home page
Task 16291632

Task 16291632

Name hadcm3n_83ns_1980_40_008462683_4
Workunit 8613539
Created 18 Feb 2014, 12:01:07 UTC
Sent 18 Feb 2014, 12:09:40 UTC
Report deadline 20 May 2014, 19:36:51 UTC
Received 9 Mar 2014, 1:56:38 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1313937
Run time 9 days 5 hours 0 min 48 sec
CPU time 9 days 4 hours 41 min 2 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.62 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
21:03:16 (30955): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:08:28 (31989): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
06:23:45 (32011): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:55:01 (32062): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:46:34 (32252): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
06:23:48 (32757): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:23:53 (32757): No heartbeat from core client for 30 sec - exiting
21:12:15 (321): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:15:06 (490): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:16:17 (720): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:22:47 (2371): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:26:51 (2395): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:55:30 (2419): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:06:10 (10450): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:18:28 (10719): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:40:35 (11053): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:54:05 (11924): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:59:29 (13058): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:16:39 (13230): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:27:57 (13686): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:31:21 (13955): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:25:41 (15513): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x099b0978 ***
======= Backtrace: =========
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x70f01)[0xf7502f01]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x72768)[0xf7504768]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(cfree+0x6d)[0xf75078ad]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0xf76864bf]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xf74a8e46]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 ca:02 778248                             /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 ca:02 778248                             /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
09961000-099c6000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f7014000-f748f000 rw-s 00000000 ca:02 778485                             /var/lib/boinc-client/slots/5/135915
f748f000-f7492000 rw-p 00000000 00:00 0 
f7492000-f75ef000 r-xp 00000000 ca:02 393741                             /lib/i386-linux-gnu/i686/cmov/libc-2.13.so
f75ef000-f75f0000 ---p 0015d000 ca:02 393741                             /lib/i386-linux-gnu/i686/cmov/libc-2.13.so
f75f0000-f75f2000 r--p 0015d000 ca:02 393741                             /lib/i386-linux-gnu/i686/cmov/libc-2.13.so
f75f2000-f75f3000 rw-p 0015f000 ca:02 393741                             /lib/i386-linux-gnu/i686/cmov/libc-2.13.so
f75f3000-f75f6000 rw-p 00000000 00:00 0 
f75f6000-f7612000 r-xp 00000000 ca:02 1041545                            /lib/i386-linux-gnu/libgcc_s.so.1
f7612000-f7613000 rw-p 0001b000 ca:02 1041545                            /lib/i386-linux-gnu/libgcc_s.so.1
f7613000-f7637000 r-xp 00000000 ca:02 393724                             /lib/i386-linux-gnu/i686/cmov/libm-2.13.so
f7637000-f7638000 r--p 00023000 ca:02 393724                             /lib/i386-linux-gnu/i686/cmov/libm-2.13.so
f7638000-f7639000 rw-p 00024000 ca:02 393724                             /lib/i386-linux-gnu/i686/cmov/libm-2.13.so
f7639000-f7719000 r-xp 00000000 ca:02 336568                             /usr/lib/i386-linux-gnu/libstdc++.so.6.0.17
f7719000-f771d000 r--p 000e0000 ca:02 336568                             /usr/lib/i386-linux-gnu/libstdc++.so.6.0.17
f771d000-f771e000 rw-p 000e4000 ca:02 336568                             /usr/lib/i386-linux-gnu/libstdc++.so.6.0.17
f771e000-f7726000 rw-p 00000000 00:00 0 
f7726000-f7728000 r-xp 00000000 ca:02 393730                             /lib/i386-linux-gnu/i686/cmov/libdl-2.13.so
f7728000-f7729000 r--p 00001000 ca:02 393730                             /lib/i386-linux-gnu/i686/cmov/libdl-2.13.so
f7729000-f772a000 rw-p 00002000 ca:02 393730                             /lib/i386-linux-gnu/i686/cmov/libdl-2.13.so
f772a000-f773f000 r-xp 00000000 ca:02 393740                             /lib/i386-linux-gnu/i686/cmov/libpthread-2.13.so
f773f000-f7740000 r--p 00014000 ca:02 393740                             /lib/i386-linux-gnu/i686/cmov/libpthread-2.13.so
f7740000-f7741000 rw-p 00015000 ca:02 393740                             /lib/i386-linux-gnu/i686/cmov/libpthread-2.13.so
f7741000-f7743000 rw-p 00000000 00:00 0 
f7746000-f7747000 rw-p 00000000 00:00 0 
f7747000-f7748000 ---p 00000000 00:00 0 
f7748000-f774b000 rw-p 00000000 00:00 0 
f774b000-f774d000 rw-s 00000000 ca:02 778482                             /var/lib/boinc-client/slots/5/boinc_mmap_file
f774d000-f774f000 rw-p 00000000 00:00 0 
f774f000-f7750000 r-xp 00000000 00:00 0                                  [vdso]
f7750000-f776c000 r-xp 00000000 ca:02 24589                              /lib/i386-linux-gnu/ld-2.13.so
f776c000-f776d000 r--p 0001b000 ca:02 24589                              /lib/i386-linux-gnu/ld-2.13.so
f776d000-f776e000 rw-p 0001c000 ca:02 24589                              /lib/i386-linux-gnu/ld-2.13.so
ffe3d000-ffeae000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (17 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf774f400]
[0xf774f430]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(gsignal+0x51)[0xf74bc941]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(abort+0x182)[0xf74bfd72]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x66e15)[0xf74f8e15]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x70f01)[0xf7502f01]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x72768)[0xf7504768]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(cfree+0x6d)[0xf75078ad]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0xf76864bf]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xf74a8e46]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 Mar 2014 01:53:45 1313937 16291632 hadcm3n_83ns_1980_40_008462683_4 518,400 794,457 1.5325
07 Mar 2014 03:26:44 1313937 16291632 hadcm3n_83ns_1980_40_008462683_4 492,480 751,928 1.5268
02 Mar 2014 10:18:06 1313937 16291632 hadcm3n_83ns_1980_40_008462683_4 466,560 711,194 1.5243
01 Mar 2014 23:31:49 1313937 16291632 hadcm3n_83ns_1980_40_008462683_4 440,640 669,368 1.5191
26 Feb 2014 09:49:18 1313937 16291632 hadcm3n_83ns_1980_40_008462683_4 414,720 629,048 1.5168
25 Feb 2014 22:52:47 1313937 16291632 hadcm3n_83ns_1980_40_008462683_4 388,800 589,631 1.5165
25 Feb 2014 11:29:40 1313937 16291632 hadcm3n_83ns_1980_40_008462683_4 362,880 550,339 1.5166
25 Feb 2014 00:53:21 1313937 16291632 hadcm3n_83ns_1980_40_008462683_4 336,960 511,062 1.5167
24 Feb 2014 13:29:31 1313937 16291632 hadcm3n_83ns_1980_40_008462683_4 311,040 471,716 1.5166
24 Feb 2014 02:33:10 1313937 16291632 hadcm3n_83ns_1980_40_008462683_4 285,120 432,383 1.5165
23 Feb 2014 15:31:52 1313937 16291632 hadcm3n_83ns_1980_40_008462683_4 259,200 392,997 1.5162
23 Feb 2014 04:35:22 1313937 16291632 hadcm3n_83ns_1980_40_008462683_4 233,280 353,603 1.5158
22 Feb 2014 18:23:42 1313937 16291632 hadcm3n_83ns_1980_40_008462683_4 207,360 314,337 1.5159
22 Feb 2014 06:37:16 1313937 16291632 hadcm3n_83ns_1980_40_008462683_4 181,440 274,905 1.5151
21 Feb 2014 06:12:00 1313937 16291632 hadcm3n_83ns_1980_40_008462683_4 155,520 235,435 1.5139
20 Feb 2014 19:15:29 1313937 16291632 hadcm3n_83ns_1980_40_008462683_4 129,600 196,208 1.5140
20 Feb 2014 08:36:38 1313937 16291632 hadcm3n_83ns_1980_40_008462683_4 103,680 156,895 1.5133
19 Feb 2014 21:25:00 1313937 16291632 hadcm3n_83ns_1980_40_008462683_4 77,760 117,664 1.5132
19 Feb 2014 10:22:53 1313937 16291632 hadcm3n_83ns_1980_40_008462683_4 51,840 78,351 1.5114
19 Feb 2014 00:26:35 1313937 16291632 hadcm3n_83ns_1980_40_008462683_4 25,920 39,267 1.5149


©2024 climateprediction.net