climateprediction.net home page
Task 13105785

Task 13105785

Name hadcm3n_ydys_1900_40_007350958_0
Workunit 7548388
Created 6 Jul 2011, 14:10:11 UTC
Sent 16 Jul 2011, 15:54:32 UTC
Report deadline 15 Oct 2011, 23:21:43 UTC
Received 28 Aug 2011, 10:36:30 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 859190
Run time 25 days 22 hours 43 min 17 sec
CPU time 23 days 9 hours 53 min 28 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 1.76 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
Signal 1 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
Signal 1 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
10:27:00 (2745): No heartbeat from core client for 30 sec - exiting
10:27:01 (2745): No heartbeat from core client for 30 sec - exiting
10:27:02 (2745): No heartbeat from core client for 30 sec - exiting
10:27:03 (2745): No heartbeat from core client for 30 sec - exiting
10:27:04 (2745): No heartbeat from core client for 30 sec - exiting
10:27:05 (2745): No heartbeat from core client for 30 sec - exiting
10:27:06 (2745): No heartbeat from core client for 30 sec - exiting
10:27:12 (2745): No heartbeat from core client for 30 sec - exiting
10:27:13 (2745): No heartbeat from core client for 30 sec - exiting
10:27:14 (2745): No heartbeat from core client for 30 sec - exiting
10:27:15 (2745): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
10:08:19 (2533): No heartbeat from core client for 30 sec - exiting
10:08:22 (2533): No heartbeat from core client for 30 sec - exiting
10:08:23 (2533): No heartbeat from core client for 30 sec - exiting
10:08:24 (2533): No heartbeat from core client for 30 sec - exiting
10:08:25 (2533): No heartbeat from core client for 30 sec - exiting
10:08:26 (2533): No heartbeat from core client for 30 sec - exiting
10:08:27 (2533): No heartbeat from core client for 30 sec - exiting
10:08:28 (2533): No heartbeat from core client for 30 sec - exiting
10:08:29 (2533): No heartbeat from core client for 30 sec - exiting
10:08:30 (2533): No heartbeat from core client for 30 sec - exiting
10:08:31 (2533): No heartbeat from core client for 30 sec - exiting
10:08:32 (2533): No heartbeat from core client for 30 sec - exiting
10:08:33 (2533): No heartbeat from core client for 30 sec - exiting
10:08:34 (2533): No heartbeat from core client for 30 sec - exiting
10:08:35 (2533): No heartbeat from core client for 30 sec - exiting
10:08:36 (2533): No heartbeat from core client for 30 sec - exiting
10:08:37 (2533): No heartbeat from core client for 30 sec - exiting
10:08:38 (2533): No heartbeat from core client for 30 sec - exiting
10:08:39 (2533): No heartbeat from core client for 30 sec - exiting
10:08:40 (2533): No heartbeat from core client for 30 sec - exiting
10:08:41 (2533): No heartbeat from core client for 30 sec - exiting
10:08:42 (2533): No heartbeat from core client for 30 sec - exiting
10:08:43 (2533): No heartbeat from core client for 30 sec - exiting
10:08:44 (2533): No heartbeat from core client for 30 sec - exiting
10:08:45 (2533): No heartbeat from core client for 30 sec - exiting
10:08:46 (2533): No heartbeat from core client for 30 sec - exiting
10:08:47 (2533): No heartbeat from core client for 30 sec - exiting
10:08:48 (2533): No heartbeat from core client for 30 sec - exiting
10:08:49 (2533): No heartbeat from core client for 30 sec - exiting
10:08:50 (2533): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Signal 15 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:31:45 (2562): No heartbeat from core client for 30 sec - exiting
10:31:48 (2562): No heartbeat from core client for 30 sec - exiting
10:32:00 (2562): No heartbeat from core client for 30 sec - exiting
10:32:01 (2562): No heartbeat from core client for 30 sec - exiting
10:32:02 (2562): No heartbeat from core client for 30 sec - exiting
10:32:03 (2562): No heartbeat from core client for 30 sec - exiting
10:32:04 (2562): No heartbeat from core client for 30 sec - exiting
10:32:05 (2562): No heartbeat from core client for 30 sec - exiting
10:32:06 (2562): No heartbeat from core client for 30 sec - exiting
10:32:07 (2562): No heartbeat from core client for 30 sec - exiting
10:32:08 (2562): No heartbeat from core client for 30 sec - exiting
10:32:09 (2562): No heartbeat from core client for 30 sec - exiting
10:32:10 (2562): No heartbeat from core client for 30 sec - exiting
10:32:11 (2562): No heartbeat from core client for 30 sec - exiting
10:32:12 (2562): No heartbeat from core client for 30 sec - exiting
10:32:13 (2562): No heartbeat from core client for 30 sec - exiting
10:32:14 (2562): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:34:22 (2735): No heartbeat from core client for 30 sec - exiting
10:34:23 (2735): No heartbeat from core client for 30 sec - exiting
10:34:24 (2735): No heartbeat from core client for 30 sec - exiting
10:34:25 (2735): No heartbeat from core client for 30 sec - exiting
10:34:26 (2735): No heartbeat from core client for 30 sec - exiting
10:34:27 (2735): No heartbeat from core client for 30 sec - exiting
10:34:28 (2735): No heartbeat from core client for 30 sec - exiting
10:34:29 (2735): No heartbeat from core client for 30 sec - exiting
10:34:30 (2735): No heartbeat from core client for 30 sec - exiting
10:34:31 (2735): No heartbeat from core client for 30 sec - exiting
10:34:32 (2735): No heartbeat from core client for 30 sec - exiting
10:34:33 (2735): No heartbeat from core client for 30 sec - exiting
10:34:34 (2735): No heartbeat from core client for 30 sec - exiting
10:34:35 (2735): No heartbeat from core client for 30 sec - exiting
10:34:36 (2735): No heartbeat from core client for 30 sec - exiting
10:34:37 (2735): No heartbeat from core client for 30 sec - exiting
10:34:38 (2735): No heartbeat from core client for 30 sec - exiting
10:34:39 (2735): No heartbeat from core client for 30 sec - exiting
10:34:40 (2735): No heartbeat from core client for 30 sec - exiting
10:34:41 (2735): No heartbeat from core client for 30 sec - exiting
10:34:42 (2735): No heartbeat from core client for 30 sec - exiting
10:34:43 (2735): No heartbeat from core client for 30 sec - exiting
10:34:44 (2735): No heartbeat from core client for 30 sec - exiting
10:34:45 (2735): No heartbeat from core client for 30 sec - exiting
10:34:46 (2735): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 15 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:30:07 (2596): No heartbeat from core client for 30 sec - exiting
10:30:09 (2596): No heartbeat from core client for 30 sec - exiting
10:30:10 (2596): No heartbeat from core client for 30 sec - exiting
10:30:11 (2596): No heartbeat from core client for 30 sec - exiting
10:30:12 (2596): No heartbeat from core client for 30 sec - exiting
10:30:13 (2596): No heartbeat from core client for 30 sec - exiting
10:30:14 (2596): No heartbeat from core client for 30 sec - exiting
10:30:15 (2596): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:30:56 (2736): No heartbeat from core client for 30 sec - exiting
10:30:57 (2736): No heartbeat from core client for 30 sec - exiting
10:30:58 (2736): No heartbeat from core client for 30 sec - exiting
10:30:59 (2736): No heartbeat from core client for 30 sec - exiting
10:31:00 (2736): No heartbeat from core client for 30 sec - exiting
10:31:01 (2736): No heartbeat from core client for 30 sec - exiting
10:31:02 (2736): No heartbeat from core client for 30 sec - exiting
10:31:03 (2736): No heartbeat from core client for 30 sec - exiting
10:31:04 (2736): No heartbeat from core client for 30 sec - exiting
10:31:05 (2736): No heartbeat from core client for 30 sec - exiting
10:31:06 (2736): No heartbeat from core client for 30 sec - exiting
10:31:07 (2736): No heartbeat from core client for 30 sec - exiting
10:31:08 (2736): No heartbeat from core client for 30 sec - exiting
10:31:09 (2736): No heartbeat from core client for 30 sec - exiting
10:31:10 (2736): No heartbeat from core client for 30 sec - exiting
10:31:11 (2736): No heartbeat from core client for 30 sec - exiting
10:31:12 (2736): No heartbeat from core client for 30 sec - exiting
10:31:13 (2736): No heartbeat from core client for 30 sec - exiting
10:31:14 (2736): No heartbeat from core client for 30 sec - exiting
10:31:15 (2736): No heartbeat from core client for 30 sec - exiting
10:31:16 (2736): No heartbeat from core client for 30 sec - exiting
10:31:17 (2736): No heartbeat from core client for 30 sec - exiting
10:31:18 (2736): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:42:57 (1528): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Signal 15 received, exiting...
Called boinc_finish
10:22:03 (2810): No heartbeat from core client for 30 sec - exiting
10:22:05 (2810): No heartbeat from core client for 30 sec - exiting
10:22:06 (2810): No heartbeat from core client for 30 sec - exiting
10:22:07 (2810): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12932, iMonCtr=1
Model crash detected, will try to restart...
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
Signal 15 received, exiting...
Called boinc_finish
07:18:59 (3049): No heartbeat from core client for 30 sec - exiting
07:19:01 (3049): No heartbeat from core client for 30 sec - exiting
07:19:02 (3049): No heartbeat from core client for 30 sec - exiting
07:19:03 (3049): No heartbeat from core client for 30 sec - exiting
07:19:04 (3049): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0952fa60 ***
======= Backtrace: =========
/lib/tls/i686/cmov/libc.so.6(+0x6b591)[0xb75f0591]
/lib/tls/i686/cmov/libc.so.6(+0x6cde8)[0xb75f1de8]
/lib/tls/i686/cmov/libc.so.6(cfree+0x6d)[0xb75f4ecd]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb77df741]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb77df79d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xb759bbd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:22 7217738    /home/hans/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rwxp 0009b000 08:22 7217738    /home/hans/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rwxp 00000000 00:00 0 
094da000-09540000 rwxp 00000000 00:00 0          [heap]
b7000000-b7021000 rwxp 00000000 00:00 0 
b7021000-b7100000 ---p 00000000 00:00 0 
b7108000-b7583000 rwxs 00000000 08:22 7430169    /home/hans/BOINC/slots/1/140760
b7583000-b7585000 rwxp 00000000 00:00 0 
b7585000-b76d8000 r-xp 00000000 08:21 955332     /lib/tls/i686/cmov/libc-2.11.1.so
b76d8000-b76d9000 ---p 00153000 08:21 955332     /lib/tls/i686/cmov/libc-2.11.1.so
b76d9000-b76db000 r-xp 00153000 08:21 955332     /lib/tls/i686/cmov/libc-2.11.1.so
b76db000-b76dc000 rwxp 00155000 08:21 955332     /lib/tls/i686/cmov/libc-2.11.1.so
b76dc000-b76df000 rwxp 00000000 00:00 0 
b76df000-b76fc000 r-xp 00000000 08:21 930323     /lib/libgcc_s.so.1
b76fc000-b76fd000 r-xp 0001c000 08:21 930323     /lib/libgcc_s.so.1
b76fd000-b76fe000 rwxp 0001d000 08:21 930323     /lib/libgcc_s.so.1
b76fe000-b7722000 r-xp 00000000 08:21 955340     /lib/tls/i686/cmov/libm-2.11.1.so
b7722000-b7723000 r-xp 00023000 08:21 955340     /lib/tls/i686/cmov/libm-2.11.1.so
b7723000-b7724000 rwxp 00024000 08:21 955340     /lib/tls/i686/cmov/libm-2.11.1.so
b7724000-b780d000 r-xp 00000000 08:21 644647     /usr/lib/libstdc++.so.6.0.13
b780d000-b780e000 ---p 000e9000 08:21 644647     /usr/lib/libstdc++.so.6.0.13
b780e000-b7812000 r-xp 000e9000 08:21 644647     /usr/lib/libstdc++.so.6.0.13
b7812000-b7813000 rwxp 000ed000 08:21 644647     /usr/lib/libstdc++.so.6.0.13
b7813000-b781b000 rwxp 00000000 00:00 0 
b781b000-b781d000 r-xp 00000000 08:21 955338     /lib/tls/i686/cmov/libdl-2.11.1.so
b781d000-b781e000 r-xp 00001000 08:21 955338     /lib/tls/i686/cmov/libdl-2.11.1.so
b781e000-b781f000 rwxp 00002000 08:21 955338     /lib/tls/i686/cmov/libdl-2.11.1.so
b781f000-b7834000 r-xp 00000000 08:21 955358     /lib/tls/i686/cmov/libpthread-2.11.1.so
b7834000-b7835000 r-xp 00014000 08:21 955358     /lib/tls/i686/cmov/libpthread-2.11.1.so
b7835000-b7836000 rwxp 00015000 08:21 955358     /lib/tls/i686/cmov/libpthread-2.11.1.so
b7836000-b7838000 rwxp 00000000 00:00 0 
b784a000-b784b000 rwxp 00000000 00:00 0 
b784b000-b784c000 ---p 00000000 00:00 0 
b784c000-b784f000 rwxp 00000000 00:00 0 
b784f000-b7851000 rwxs 00000000 08:22 7430166    /home/hans/BOINC/slots/1/boinc_mmap_file
b7851000-b7853000 rwxp 00000000 00:00 0 
b7853000-b7854000 r-xp 00000000 00:00 0          [vdso]
b7854000-b786f000 r-xp 00000000 08:21 930265     /lib/ld-2.11.1.so
b786f000-b7870000 r-xp 0001a000 08:21 930265     /lib/ld-2.11.1.so
b7870000-b7871000 rwxp 0001b000 08:21 930265     /lib/ld-2.11.1.so
bf965000-bf9d6000 rw-p 00000000 00:00 0          [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xb7853400]
[0xb7853422]
/lib/tls/i686/cmov/libc.so.6(gsignal+0x51)[0xb75af651]
/lib/tls/i686/cmov/libc.so.6(abort+0x182)[0xb75b2a82]
/lib/tls/i686/cmov/libc.so.6(+0x6149d)[0xb75e649d]
/lib/tls/i686/cmov/libc.so.6(+0x6b591)[0xb75f0591]
/lib/tls/i686/cmov/libc.so.6(+0x6cde8)[0xb75f1de8]
/lib/tls/i686/cmov/libc.so.6(cfree+0x6d)[0xb75f4ecd]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb77df741]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb77df79d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xb759bbd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
28 Aug 2011 09:37:44 859190 13105785 hadcm3n_ydys_1900_40_007350958_0 777,600 2,022,796 2.6013
27 Aug 2011 13:04:10 859190 13105785 hadcm3n_ydys_1900_40_007350958_0 751,680 1,955,571 2.6016
26 Aug 2011 15:24:34 859190 13105785 hadcm3n_ydys_1900_40_007350958_0 725,760 1,889,952 2.6041
25 Aug 2011 02:32:13 859190 13105785 hadcm3n_ydys_1900_40_007350958_0 699,840 1,820,883 2.6019
23 Aug 2011 22:48:27 859190 13105785 hadcm3n_ydys_1900_40_007350958_0 673,920 1,754,204 2.6030
22 Aug 2011 17:21:26 859190 13105785 hadcm3n_ydys_1900_40_007350958_0 648,000 1,687,397 2.6040
21 Aug 2011 12:02:59 859190 13105785 hadcm3n_ydys_1900_40_007350958_0 622,080 1,620,925 2.6057
20 Aug 2011 16:09:27 859190 13105785 hadcm3n_ydys_1900_40_007350958_0 596,160 1,555,848 2.6098
19 Aug 2011 20:17:39 859190 13105785 hadcm3n_ydys_1900_40_007350958_0 570,240 1,490,839 2.6144
18 Aug 2011 17:22:06 859190 13105785 hadcm3n_ydys_1900_40_007350958_0 544,320 1,425,141 2.6182
17 Aug 2011 03:28:50 859190 13105785 hadcm3n_ydys_1900_40_007350958_0 518,400 1,360,552 2.6245
15 Aug 2011 15:50:39 859190 13105785 hadcm3n_ydys_1900_40_007350958_0 492,480 1,295,823 2.6312
14 Aug 2011 00:10:05 859190 13105785 hadcm3n_ydys_1900_40_007350958_0 466,560 1,230,566 2.6375
12 Aug 2011 17:09:06 859190 13105785 hadcm3n_ydys_1900_40_007350958_0 440,640 1,163,700 2.6409
10 Aug 2011 23:06:01 859190 13105785 hadcm3n_ydys_1900_40_007350958_0 414,720 1,097,424 2.6462
08 Aug 2011 20:02:18 859190 13105785 hadcm3n_ydys_1900_40_007350958_0 388,800 1,030,154 2.6496
07 Aug 2011 09:23:39 859190 13105785 hadcm3n_ydys_1900_40_007350958_0 362,880 964,681 2.6584
05 Aug 2011 23:56:46 859190 13105785 hadcm3n_ydys_1900_40_007350958_0 336,960 897,012 2.6621
02 Aug 2011 19:12:20 859190 13105785 hadcm3n_ydys_1900_40_007350958_0 311,040 828,962 2.6651
31 Jul 2011 05:27:53 859190 13105785 hadcm3n_ydys_1900_40_007350958_0 285,120 761,509 2.6708


©2024 cpdn.org