climateprediction.net home page
Task 13600968

Task 13600968

Name hadcm3n_t76w_1940_40_007536254_0
Workunit 7733486
Created 5 Nov 2011, 11:55:15 UTC
Sent 17 Nov 2011, 7:45:56 UTC
Report deadline 16 Feb 2012, 15:13:07 UTC
Received 11 Dec 2011, 4:14:45 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1178741
Run time 18 days 5 hours 7 min 10 sec
CPU time 16 days 0 hours 34 min 50 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 1.41 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.12.33</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:48:36 (31220): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:51:19 (31975): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:51:20 (31975): No heartbeat from core client for 30 sec - exiting
18:51:23 (31975): No heartbeat from core client for 30 sec - exiting
18:51:24 (31975): No heartbeat from core client for 30 sec - exiting
18:51:27 (31975): No heartbeat from core client for 30 sec - exiting
18:51:28 (31975): No heartbeat from core client for 30 sec - exiting
18:51:29 (31975): No heartbeat from core client for 30 sec - exiting
18:51:31 (31975): No heartbeat from core client for 30 sec - exiting
18:51:33 (31975): No heartbeat from core client for 30 sec - exiting
18:51:34 (31975): No heartbeat from core client for 30 sec - exiting
18:51:36 (31975): No heartbeat from core client for 30 sec - exiting
18:51:37 (31975): No heartbeat from core client for 30 sec - exiting
18:51:38 (31975): No heartbeat from core client for 30 sec - exiting
18:51:39 (31975): No heartbeat from core client for 30 sec - exiting
18:51:42 (31975): No heartbeat from core client for 30 sec - exiting
18:51:45 (31975): No heartbeat from core client for 30 sec - exiting
18:51:46 (31975): No heartbeat from core client for 30 sec - exiting
18:51:48 (31975): No heartbeat from core client for 30 sec - exiting
18:51:49 (31975): No heartbeat from core client for 30 sec - exiting
18:51:50 (31975): No heartbeat from core client for 30 sec - exiting
18:51:53 (31975): No heartbeat from core client for 30 sec - exiting
18:51:55 (31975): No heartbeat from core client for 30 sec - exiting
18:51:57 (31975): No heartbeat from core client for 30 sec - exiting
18:51:58 (31975): No heartbeat from core client for 30 sec - exiting
18:51:59 (31975): No heartbeat from core client for 30 sec - exiting
18:52:01 (31975): No heartbeat from core client for 30 sec - exiting
18:52:03 (31975): No heartbeat from core client for 30 sec - exiting
18:52:04 (31975): No heartbeat from core client for 30 sec - exiting
18:52:05 (31975): No heartbeat from core client for 30 sec - exiting
18:52:06 (31975): No heartbeat from core client for 30 sec - exiting
18:52:07 (31975): No heartbeat from core client for 30 sec - exiting
18:52:08 (31975): No heartbeat from core client for 30 sec - exiting
18:52:09 (31975): No heartbeat from core client for 30 sec - exiting
18:52:12 (31975): No heartbeat from core client for 30 sec - exiting
18:52:14 (31975): No heartbeat from core client for 30 sec - exiting
18:52:16 (31975): No heartbeat from core client for 30 sec - exiting
18:52:17 (31975): No heartbeat from core client for 30 sec - exiting
18:52:18 (31975): No heartbeat from core client for 30 sec - exiting
18:52:19 (31975): No heartbeat from core client for 30 sec - exiting
18:52:22 (31975): No heartbeat from core client for 30 sec - exiting
18:52:23 (31975): No heartbeat from core client for 30 sec - exiting
18:52:25 (31975): No heartbeat from core client for 30 sec - exiting
18:52:26 (31975): No heartbeat from core client for 30 sec - exiting
18:52:27 (31975): No heartbeat from core client for 30 sec - exiting
18:53:50 (32054): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:56:36 (32133): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:57:25 (32193): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:59:35 (32259): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:00:34 (32313): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:56:43 (32365): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:00:04 (32615): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:02:24 (32704): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:03:24 (353): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:06:05 (433): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:04:35 (12588): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:05:56 (15537): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:55:17 (7563): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:56:22 (12890): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
06:59:22 (15280): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:05:32 (1650): No heartbeat from core client for 30 sec - exiting
08:05:36 (1650): No heartbeat from core client for 30 sec - exiting
08:05:37 (1650): No heartbeat from core client for 30 sec - exiting
08:05:38 (1650): No heartbeat from core client for 30 sec - exiting
08:05:39 (1650): No heartbeat from core client for 30 sec - exiting
08:05:40 (1650): No heartbeat from core client for 30 sec - exiting
08:05:41 (1650): No heartbeat from core client for 30 sec - exiting
08:05:42 (1650): No heartbeat from core client for 30 sec - exiting
08:05:43 (1650): No heartbeat from core client for 30 sec - exiting
08:05:44 (1650): No heartbeat from core client for 30 sec - exiting
08:05:45 (1650): No heartbeat from core client for 30 sec - exiting
08:05:46 (1650): No heartbeat from core client for 30 sec - exiting
08:05:47 (1650): No heartbeat from core client for 30 sec - exiting
08:05:48 (1650): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
20:20:58 (4301): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:23:46 (12861): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:18:01 (12940): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:12:24 (1927): No heartbeat from core client for 30 sec - exiting
08:12:25 (1927): No heartbeat from core client for 30 sec - exiting
08:12:26 (1927): No heartbeat from core client for 30 sec - exiting
08:12:27 (1927): No heartbeat from core client for 30 sec - exiting
08:12:28 (1927): No heartbeat from core client for 30 sec - exiting
08:12:29 (1927): No heartbeat from core client for 30 sec - exiting
08:12:30 (1927): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:08:49 (1618): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:08:50 (1618): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08635a88 ***
======= Backtrace: =========
/lib/i386-linux-gnu/libc.so.6(+0x6ebc2)[0xb755fbc2]
/lib/i386-linux-gnu/libc.so.6(+0x6f862)[0xb7560862]
/lib/i386-linux-gnu/libc.so.6(cfree+0x6d)[0xb756394d]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0xb776280f]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdaPv+0x1b)[0xb776286b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xb750a113]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:01 28033088   /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 28033088   /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
085e0000-08645000 rw-p 00000000 00:00 0          [heap]
b6f00000-b6f21000 rw-p 00000000 00:00 0 
b6f21000-b7000000 ---p 00000000 00:00 0 
b7073000-b74ee000 rw-s 00000000 08:01 3883957    /var/lib/boinc-client/slots/4/134950
b74ee000-b74f1000 rw-p 00000000 00:00 0 
b74f1000-b7667000 r-xp 00000000 08:01 23896145   /lib/i386-linux-gnu/libc-2.13.so
b7667000-b7669000 r--p 00176000 08:01 23896145   /lib/i386-linux-gnu/libc-2.13.so
b7669000-b766a000 rw-p 00178000 08:01 23896145   /lib/i386-linux-gnu/libc-2.13.so
b766a000-b766d000 rw-p 00000000 00:00 0 
b766d000-b7689000 r-xp 00000000 08:01 27566342   /lib/i386-linux-gnu/libgcc_s.so.1
b7689000-b768a000 r--p 0001b000 08:01 27566342   /lib/i386-linux-gnu/libgcc_s.so.1
b768a000-b768b000 rw-p 0001c000 08:01 27566342   /lib/i386-linux-gnu/libgcc_s.so.1
b768b000-b76b3000 r-xp 00000000 08:01 23896149   /lib/i386-linux-gnu/libm-2.13.so
b76b3000-b76b4000 r--p 00028000 08:01 23896149   /lib/i386-linux-gnu/libm-2.13.so
b76b4000-b76b5000 rw-p 00029000 08:01 23896149   /lib/i386-linux-gnu/libm-2.13.so
b76b5000-b7793000 r-xp 00000000 08:01 26468505   /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
b7793000-b7794000 ---p 000de000 08:01 26468505   /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
b7794000-b7798000 r--p 000de000 08:01 26468505   /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
b7798000-b7799000 rw-p 000e2000 08:01 26468505   /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
b7799000-b77a1000 rw-p 00000000 00:00 0 
b77a1000-b77a4000 r-xp 00000000 08:01 23896148   /lib/i386-linux-gnu/libdl-2.13.so
b77a4000-b77a5000 r--p 00002000 08:01 23896148   /lib/i386-linux-gnu/libdl-2.13.so
b77a5000-b77a6000 rw-p 00003000 08:01 23896148   /lib/i386-linux-gnu/libdl-2.13.so
b77a6000-b77bd000 r-xp 00000000 08:01 25731305   /lib/i386-linux-gnu/libpthread-2.13.so
b77bd000-b77be000 r--p 00016000 08:01 25731305   /lib/i386-linux-gnu/libpthread-2.13.so
b77be000-b77bf000 rw-p 00017000 08:01 25731305   /lib/i386-linux-gnu/libpthread-2.13.so
b77bf000-b77c1000 rw-p 00000000 00:00 0 
b77d0000-b77d1000 rw-p 00000000 00:00 0 
b77d1000-b77d2000 ---p 00000000 00:00 0 
b77d2000-b77d5000 rw-p 00000000 00:00 0 
b77d5000-b77d7000 rw-s 00000000 08:01 3883721    /var/lib/boinc-client/slots/4/boinc_mmap_file
b77d7000-b77d9000 rw-p 00000000 00:00 0 
b77d9000-b77da000 r-xp 00000000 00:00 0          [vdso]
b77da000-b77f8000 r-xp 00000000 08:01 27566343   /lib/i386-linux-gnu/ld-2.13.so
b77f8000-b77f9000 r--p 0001d000 08:01 27566343   /lib/i386-linux-gnu/ld-2.13.so
b77f9000-b77fa000 rw-p 0001e000 08:01 27566343   /lib/i386-linux-gnu/ld-2.13.so
bfed3000-bff42000 rw-p 00000000 00:00 0          [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xb77d9400]
[0xb77d9424]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xb751ec8f]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xb75222b5]
/lib/i386-linux-gnu/libc.so.6(+0x63dfc)[0xb7554dfc]
/lib/i386-linux-gnu/libc.so.6(+0x6ebc2)[0xb755fbc2]
/lib/i386-linux-gnu/libc.so.6(+0x6f862)[0xb7560862]
/lib/i386-linux-gnu/libc.so.6(cfree+0x6d)[0xb756394d]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0xb776280f]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdaPv+0x1b)[0xb776286b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xb750a113]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
11 Dec 2011 03:15:29 1178741 13600968 hadcm3n_t76w_1940_40_007536254_0 259,200 1,384,476 5.3413
07 Dec 2011 23:35:00 1178741 13600968 hadcm3n_t76w_1940_40_007536254_0 233,280 1,264,159 5.4191
06 Dec 2011 04:53:37 1178741 13600968 hadcm3n_t76w_1940_40_007536254_0 207,360 1,136,197 5.4793
04 Dec 2011 09:04:59 1178741 13600968 hadcm3n_t76w_1940_40_007536254_0 181,440 1,007,416 5.5523
02 Dec 2011 17:24:23 1178741 13600968 hadcm3n_t76w_1940_40_007536254_0 155,520 877,570 5.6428
30 Nov 2011 19:40:24 1178741 13600968 hadcm3n_t76w_1940_40_007536254_0 129,600 752,305 5.8048
29 Nov 2011 05:30:07 1178741 13600968 hadcm3n_t76w_1940_40_007536254_0 103,680 627,048 6.0479
26 Nov 2011 16:26:25 1178741 13600968 hadcm3n_t76w_1940_40_007536254_0 77,760 479,077 6.1610
24 Nov 2011 09:06:40 1178741 13600968 hadcm3n_t76w_1940_40_007536254_0 51,840 323,237 6.2353
20 Nov 2011 01:31:14 1178741 13600968 hadcm3n_t76w_1940_40_007536254_0 25,920 153,585 5.9253


©2024 cpdn.org