climateprediction.net home page
Task 12821603

Task 12821603

Name hadcm3n_p2ig_1900_40_007220840_1
Workunit 7419080
Created 26 Apr 2011, 15:21:17 UTC
Sent 2 May 2011, 9:56:57 UTC
Report deadline 1 Aug 2011, 17:24:08 UTC
Received 21 May 2011, 12:22:51 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1147084
Run time 6 days 18 hours 37 min 36 sec
CPU time 6 days 2 hours 8 min 51 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 2.56 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.59</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
13:42:16 (9046): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
18:07:07 (15715): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
14:10:49 (7502): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
14:10:50 (7502): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
14:05:11 (3182): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
00:19:02 (3200): No heartbeat from core client for 30 sec - exiting
00:19:30 (3200): No heartbeat from core client for 30 sec - exiting
00:19:31 (3200): No heartbeat from core client for 30 sec - exiting
00:19:32 (3200): No heartbeat from core client for 30 sec - exiting
00:19:33 (3200): No heartbeat from core client for 30 sec - exiting
00:19:34 (3200): No heartbeat from core client for 30 sec - exiting
00:19:35 (3200): No heartbeat from core client for 30 sec - exiting
00:19:36 (3200): No heartbeat from core client for 30 sec - exiting
00:19:37 (3200): No heartbeat from core client for 30 sec - exiting
00:19:38 (3200): No heartbeat from core client for 30 sec - exiting
00:19:39 (3200): No heartbeat from core client for 30 sec - exiting
00:19:40 (3200): No heartbeat from core client for 30 sec - exiting
00:19:41 (3200): No heartbeat from core client for 30 sec - exiting
00:19:42 (3200): No heartbeat from core client for 30 sec - exiting
00:20:00 (3200): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:20:05 (3200): No heartbeat from core client for 30 sec - exiting
00:20:06 (3200): No heartbeat from core client for 30 sec - exiting
00:20:07 (3200): No heartbeat from core client for 30 sec - exiting
00:20:08 (3200): No heartbeat from core client for 30 sec - exiting
00:20:09 (3200): No heartbeat from core client for 30 sec - exiting
00:20:23 (3200): No heartbeat from core client for 30 sec - exiting
00:20:24 (3200): No heartbeat from core client for 30 sec - exiting
00:20:25 (3200): No heartbeat from core client for 30 sec - exiting
00:20:26 (3200): No heartbeat from core client for 30 sec - exiting
00:20:27 (3200): No heartbeat from core client for 30 sec - exiting
00:20:28 (3200): No heartbeat from core client for 30 sec - exiting
00:20:29 (3200): No heartbeat from core client for 30 sec - exiting
00:20:30 (3200): No heartbeat from core client for 30 sec - exiting
00:20:31 (3200): No heartbeat from core client for 30 sec - exiting
00:20:32 (3200): No heartbeat from core client for 30 sec - exiting
00:20:33 (3200): No heartbeat from core client for 30 sec - exiting
00:20:34 (3200): No heartbeat from core client for 30 sec - exiting
00:20:35 (3200): No heartbeat from core client for 30 sec - exiting
00:20:36 (3200): No heartbeat from core client for 30 sec - exiting
00:20:37 (3200): No heartbeat from core client for 30 sec - exiting
00:20:40 (3200): No heartbeat from core client for 30 sec - exiting
00:20:41 (3200): No heartbeat from core client for 30 sec - exiting
00:20:42 (3200): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
15:34:21 (2843): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:34:33 (2843): No heartbeat from core client for 30 sec - exiting
15:34:34 (2843): No heartbeat from core client for 30 sec - exiting
15:34:35 (2843): No heartbeat from core client for 30 sec - exiting
15:34:36 (2843): No heartbeat from core client for 30 sec - exiting
15:34:37 (2843): No heartbeat from core client for 30 sec - exiting
15:34:38 (2843): No heartbeat from core client for 30 sec - exiting
15:34:39 (2843): No heartbeat from core client for 30 sec - exiting
15:34:40 (2843): No heartbeat from core client for 30 sec - exiting
15:34:41 (2843): No heartbeat from core client for 30 sec - exiting
15:34:42 (2843): No heartbeat from core client for 30 sec - exiting
15:34:43 (2843): No heartbeat from core client for 30 sec - exiting
15:34:44 (2843): No heartbeat from core client for 30 sec - exiting
15:34:45 (2843): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09179ca0 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6b511)[0xf7541511]
/lib32/libc.so.6(+0x6ce1b)[0xf7542e1b]
/lib32/libc.so.6(cfree+0x6d)[0xf7545f8d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf771f841]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf771f89d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf74ece37]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:02 1321740                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:02 1321740                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
09124000-0918a000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f7058000-f74d3000 rw-s 00000000 08:02 1469342                            /var/lib/boinc-client/slots/0/134760
f74d3000-f74d6000 rw-p 00000000 00:00 0 
f74d6000-f762c000 r-xp 00000000 08:02 917513                             /lib32/libc-2.13.so
f762c000-f762d000 ---p 00156000 08:02 917513                             /lib32/libc-2.13.so
f762d000-f762f000 r--p 00156000 08:02 917513                             /lib32/libc-2.13.so
f762f000-f7630000 rw-p 00158000 08:02 917513                             /lib32/libc-2.13.so
f7630000-f7633000 rw-p 00000000 00:00 0 
f7633000-f764d000 r-xp 00000000 08:02 1180530                            /usr/lib32/libgcc_s.so.1
f764d000-f764e000 r--p 00019000 08:02 1180530                            /usr/lib32/libgcc_s.so.1
f764e000-f764f000 rw-p 0001a000 08:02 1180530                            /usr/lib32/libgcc_s.so.1
f764f000-f7673000 r-xp 00000000 08:02 917517                             /lib32/libm-2.13.so
f7673000-f7674000 r--p 00023000 08:02 917517                             /lib32/libm-2.13.so
f7674000-f7675000 rw-p 00024000 08:02 917517                             /lib32/libm-2.13.so
f7675000-f7754000 r-xp 00000000 08:02 1180533                            /usr/lib32/libstdc++.so.6.0.14
f7754000-f7758000 r--p 000de000 08:02 1180533                            /usr/lib32/libstdc++.so.6.0.14
f7758000-f7759000 rw-p 000e2000 08:02 1180533                            /usr/lib32/libstdc++.so.6.0.14
f7759000-f7760000 rw-p 00000000 00:00 0 
f7760000-f7762000 r-xp 00000000 08:02 917516                             /lib32/libdl-2.13.so
f7762000-f7763000 r--p 00001000 08:02 917516                             /lib32/libdl-2.13.so
f7763000-f7764000 rw-p 00002000 08:02 917516                             /lib32/libdl-2.13.so
f7764000-f7779000 r-xp 00000000 08:02 917527                             /lib32/libpthread-2.13.so
f7779000-f777a000 r--p 00014000 08:02 917527                             /lib32/libpthread-2.13.so
f777a000-f777b000 rw-p 00015000 08:02 917527                             /lib32/libpthread-2.13.so
f777b000-f777e000 rw-p 00000000 00:00 0 
f779c000-f779d000 rw-p 00000000 00:00 0 
f779d000-f779e000 ---p 00000000 00:00 0 
f779e000-f77a1000 rw-p 00000000 00:00 0 
f77a1000-f77a3000 rw-s 00000000 08:02 1469220                            /var/lib/boinc-client/slots/0/boinc_mmap_file
f77a3000-f77a4000 rw-p 00000000 00:00 0 
f77a4000-f77a5000 r-xp 00000000 00:00 0                                  [vdso]
f77a5000-f77c1000 r-xp 00000000 08:02 917510                             /lib32/ld-2.13.so
f77c1000-f77c2000 r--p 0001b000 08:02 917510                             /lib32/ld-2.13.so
f77c2000-f77c3000 rw-p 0001c000 08:02 917510                             /lib32/ld-2.13.so
ffc91000-ffd01000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf77a4400]
[0xf77a4430]
/lib32/libc.so.6(gsignal+0x51)[0xf7500ea1]
/lib32/libc.so.6(abort+0x17e)[0xf75042ce]
/lib32/libc.so.6(+0x61277)[0xf7537277]
/lib32/libc.so.6(+0x6b511)[0xf7541511]
/lib32/libc.so.6(+0x6ce1b)[0xf7542e1b]
/lib32/libc.so.6(cfree+0x6d)[0xf7545f8d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf771f841]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf771f89d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf74ece37]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
21 May 2011 11:54:05 1147084 12821603 hadcm3n_p2ig_1900_40_007220840_1 259,200 526,122 2.0298
20 May 2011 11:11:07 1147084 12821603 hadcm3n_p2ig_1900_40_007220840_1 233,280 473,244 2.0287
19 May 2011 06:46:55 1147084 12821603 hadcm3n_p2ig_1900_40_007220840_1 207,360 420,851 2.0296
17 May 2011 08:29:30 1147084 12821603 hadcm3n_p2ig_1900_40_007220840_1 181,440 368,710 2.0321
12 May 2011 08:52:46 1147084 12821603 hadcm3n_p2ig_1900_40_007220840_1 155,520 316,036 2.0321
11 May 2011 06:37:55 1147084 12821603 hadcm3n_p2ig_1900_40_007220840_1 129,600 263,324 2.0318
09 May 2011 19:57:03 1147084 12821603 hadcm3n_p2ig_1900_40_007220840_1 103,680 210,853 2.0337
08 May 2011 13:22:48 1147084 12821603 hadcm3n_p2ig_1900_40_007220840_1 77,760 157,833 2.0297
06 May 2011 09:04:49 1147084 12821603 hadcm3n_p2ig_1900_40_007220840_1 51,840 105,384 2.0329
04 May 2011 19:45:00 1147084 12821603 hadcm3n_p2ig_1900_40_007220840_1 25,920 52,647 2.0311


©2024 cpdn.org