climateprediction.net home page
Task 13103445

Task 13103445

Name hadcm3n_yd2b_1900_40_007349789_0
Workunit 7547219
Created 6 Jul 2011, 14:01:16 UTC
Sent 17 Jul 2011, 10:21:44 UTC
Report deadline 16 Oct 2011, 17:48:55 UTC
Received 6 Oct 2011, 11:07:54 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1152383
Run time 12 days 18 hours 14 min 30 sec
CPU time 11 days 12 hours 38 min 27 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.15 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
05:41:36 (4183): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:49:14 (3789): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
05:34:55 (3641): No heartbeat from core client for 30 sec - exiting
05:34:56 (3641): No heartbeat from core client for 30 sec - exiting
05:34:57 (3641): No heartbeat from core client for 30 sec - exiting
05:34:58 (3641): No heartbeat from core client for 30 sec - exiting
05:34:59 (3641): No heartbeat from core client for 30 sec - exiting
05:35:00 (3641): No heartbeat from core client for 30 sec - exiting
05:35:01 (3641): No heartbeat from core client for 30 sec - exiting
05:35:02 (3641): No heartbeat from core client for 30 sec - exiting
05:35:03 (3641): No heartbeat from core client for 30 sec - exiting
05:35:04 (3641): No heartbeat from core client for 30 sec - exiting
05:35:05 (3641): No heartbeat from core client for 30 sec - exiting
05:35:06 (3641): No heartbeat from core client for 30 sec - exiting
05:35:08 (3641): No heartbeat from core client for 30 sec - exiting
05:35:09 (3641): No heartbeat from core client for 30 sec - exiting
05:35:10 (3641): No heartbeat from core client for 30 sec - exiting
05:35:11 (3641): No heartbeat from core client for 30 sec - exiting
05:35:12 (3641): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
06:05:38 (3809): No heartbeat from core client for 30 sec - exiting
06:05:39 (3809): No heartbeat from core client for 30 sec - exiting
06:05:40 (3809): No heartbeat from core client for 30 sec - exiting
06:05:41 (3809): No heartbeat from core client for 30 sec - exiting
06:05:42 (3809): No heartbeat from core client for 30 sec - exiting
06:05:43 (3809): No heartbeat from core client for 30 sec - exiting
06:05:44 (3809): No heartbeat from core client for 30 sec - exiting
06:05:45 (3809): No heartbeat from core client for 30 sec - exiting
06:06:44 (3809): No heartbeat from core client for 30 sec - exiting
06:06:45 (3809): No heartbeat from core client for 30 sec - exiting
06:07:54 (3809): No heartbeat from core client for 30 sec - exiting
06:07:55 (3809): No heartbeat from core client for 30 sec - exiting
06:07:56 (3809): No heartbeat from core client for 30 sec - exiting
06:08:17 (3809): No heartbeat from core client for 30 sec - exiting
06:08:20 (3809): No heartbeat from core client for 30 sec - exiting
06:08:21 (3809): No heartbeat from core client for 30 sec - exiting
06:08:22 (3809): No heartbeat from core client for 30 sec - exiting
06:08:23 (3809): No heartbeat from core client for 30 sec - exiting
06:08:24 (3809): No heartbeat from core client for 30 sec - exiting
06:08:25 (3809): No heartbeat from core client for 30 sec - exiting
06:08:26 (3809): No heartbeat from core client for 30 sec - exiting
06:08:27 (3809): No heartbeat from core client for 30 sec - exiting
06:08:28 (3809): No heartbeat from core client for 30 sec - exiting
06:08:29 (3809): No heartbeat from core client for 30 sec - exiting
06:08:30 (3809): No heartbeat from core client for 30 sec - exiting
06:08:31 (3809): No heartbeat from core client for 30 sec - exiting
06:08:32 (3809): No heartbeat from core client for 30 sec - exiting
06:08:33 (3809): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
06:43:29 (3734): No heartbeat from core client for 30 sec - exiting
06:43:31 (3734): No heartbeat from core client for 30 sec - exiting
06:43:32 (3734): No heartbeat from core client for 30 sec - exiting
06:43:33 (3734): No heartbeat from core client for 30 sec - exiting
06:43:34 (3734): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
23:18:20 (3883): No heartbeat from core client for 30 sec - exiting
23:18:21 (3883): No heartbeat from core client for 30 sec - exiting
23:18:22 (3883): No heartbeat from core client for 30 sec - exiting
23:18:23 (3883): No heartbeat from core client for 30 sec - exiting
23:18:24 (3883): No heartbeat from core client for 30 sec - exiting
23:18:25 (3883): No heartbeat from core client for 30 sec - exiting
23:18:26 (3883): No heartbeat from core client for 30 sec - exiting
23:18:27 (3883): No heartbeat from core client for 30 sec - exiting
23:18:28 (3883): No heartbeat from core client for 30 sec - exiting
23:18:29 (3883): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
06:36:58 (3941): No heartbeat from core client for 30 sec - exiting
06:36:59 (3941): No heartbeat from core client for 30 sec - exiting
06:37:00 (3941): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
10:29:57 (4397): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:30:02 (4397): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
06:11:01 (3825): No heartbeat from core client for 30 sec - exiting
06:11:03 (3825): No heartbeat from core client for 30 sec - exiting
06:11:04 (3825): No heartbeat from core client for 30 sec - exiting
06:11:05 (3825): No heartbeat from core client for 30 sec - exiting
06:11:06 (3825): No heartbeat from core client for 30 sec - exiting
06:11:07 (3825): No heartbeat from core client for 30 sec - exiting
06:11:08 (3825): No heartbeat from core client for 30 sec - exiting
06:11:09 (3825): No heartbeat from core client for 30 sec - exiting
06:11:10 (3825): No heartbeat from core client for 30 sec - exiting
06:11:11 (3825): No heartbeat from core client for 30 sec - exiting
06:11:12 (3825): No heartbeat from core client for 30 sec - exiting
06:11:13 (3825): No heartbeat from core client for 30 sec - exiting
06:11:14 (3825): No heartbeat from core client for 30 sec - exiting
06:11:15 (3825): No heartbeat from core client for 30 sec - exiting
06:11:16 (3825): No heartbeat from core client for 30 sec - exiting
06:11:17 (3825): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
04:59:30 (3691): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
10:24:02 (3885): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
05:46:51 (3768): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
05:34:35 (3748): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
06:28:39 (3828): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:16:08 (3710): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
21:12:29 (3704): No heartbeat from core client for 30 sec - exiting
21:12:30 (3704): No heartbeat from core client for 30 sec - exiting
21:12:31 (3704): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:12:32 (3704): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:16:48 (11578): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:19:47 (3728): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:19:48 (3728): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:19:16 (3941): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x090ab820 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6c231)[0xf7566231]
/lib32/libc.so.6(+0x6dab8)[0xf7567ab8]
/lib32/libc.so.6(cfree+0x6d)[0xf756ab9d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf7754a91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf7754aed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7510bd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:01 20840718                           /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 20840718                           /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
09056000-090bb000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f707d000-f74f8000 rw-s 00000000 08:01 20914309                           /var/lib/boinc-client/slots/2/137615
f74f8000-f74fa000 rw-p 00000000 00:00 0 
f74fa000-f764d000 r-xp 00000000 08:01 24797348                           /lib32/libc-2.11.1.so
f764d000-f764e000 ---p 00153000 08:01 24797348                           /lib32/libc-2.11.1.so
f764e000-f7650000 r--p 00153000 08:01 24797348                           /lib32/libc-2.11.1.so
f7650000-f7651000 rw-p 00155000 08:01 24797348                           /lib32/libc-2.11.1.so
f7651000-f7654000 rw-p 00000000 00:00 0 
f7654000-f7671000 r-xp 00000000 08:01 6479876                            /usr/lib32/libgcc_s.so.1
f7671000-f7672000 r--p 0001c000 08:01 6479876                            /usr/lib32/libgcc_s.so.1
f7672000-f7673000 rw-p 0001d000 08:01 6479876                            /usr/lib32/libgcc_s.so.1
f7673000-f7697000 r-xp 00000000 08:01 24797354                           /lib32/libm-2.11.1.so
f7697000-f7698000 r--p 00023000 08:01 24797354                           /lib32/libm-2.11.1.so
f7698000-f7699000 rw-p 00024000 08:01 24797354                           /lib32/libm-2.11.1.so
f7699000-f7782000 r-xp 00000000 08:01 6479874                            /usr/lib32/libstdc++.so.6.0.13
f7782000-f7783000 ---p 000e9000 08:01 6479874                            /usr/lib32/libstdc++.so.6.0.13
f7783000-f7787000 r--p 000e9000 08:01 6479874                            /usr/lib32/libstdc++.so.6.0.13
f7787000-f7788000 rw-p 000ed000 08:01 6479874                            /usr/lib32/libstdc++.so.6.0.13
f7788000-f778f000 rw-p 00000000 00:00 0 
f778f000-f7791000 r-xp 00000000 08:01 24797353                           /lib32/libdl-2.11.1.so
f7791000-f7792000 r--p 00001000 08:01 24797353                           /lib32/libdl-2.11.1.so
f7792000-f7793000 rw-p 00002000 08:01 24797353                           /lib32/libdl-2.11.1.so
f7793000-f7794000 rw-p 00000000 00:00 0 
f7794000-f77a9000 r-xp 00000000 08:01 24797393                           /lib32/libpthread-2.11.1.so
f77a9000-f77aa000 r--p 00014000 08:01 24797393                           /lib32/libpthread-2.11.1.so
f77aa000-f77ab000 rw-p 00015000 08:01 24797393                           /lib32/libpthread-2.11.1.so
f77ab000-f77ad000 rw-p 00000000 00:00 0 
f77ce000-f77cf000 rw-p 00000000 00:00 0 
f77cf000-f77d0000 ---p 00000000 00:00 0 
f77d0000-f77d3000 rw-p 00000000 00:00 0 
f77d3000-f77d5000 rw-s 00000000 08:01 20914306                           /var/lib/boinc-client/slots/2/boinc_mmap_file
f77d5000-f77d7000 rw-p 00000000 00:00 0 
f77d7000-f77d8000 r-xp 00000000 00:00 0                                  [vdso]
f77d8000-f77f4000 r-xp 00000000 08:01 24797210                           /lib32/ld-2.11.1.so
f77f4000-f77f5000 r--p 0001b000 08:01 24797210                           /lib32/ld-2.11.1.so
f77f5000-f77f6000 rw-p 0001c000 08:01 24797210                           /lib32/ld-2.11.1.so
ff93d000-ff9ae000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf77d7400]
[0xf77d7425]
/lib32/libc.so.6(gsignal+0x51)[0xf7524921]
/lib32/libc.so.6(abort+0x182)[0xf7527d52]
/lib32/libc.so.6(+0x6213d)[0xf755c13d]
/lib32/libc.so.6(+0x6c231)[0xf7566231]
/lib32/libc.so.6(+0x6dab8)[0xf7567ab8]
/lib32/libc.so.6(cfree+0x6d)[0xf756ab9d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf7754a91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf7754aed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7510bd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
05 Oct 2011 18:28:30 1152383 13103445 hadcm3n_yd2b_1900_40_007349789_0 518,400 995,902 1.9211
03 Oct 2011 16:32:42 1152383 13103445 hadcm3n_yd2b_1900_40_007349789_0 492,480 944,080 1.9170
02 Oct 2011 14:00:29 1152383 13103445 hadcm3n_yd2b_1900_40_007349789_0 466,560 893,112 1.9142
01 Oct 2011 07:17:13 1152383 13103445 hadcm3n_yd2b_1900_40_007349789_0 440,640 842,379 1.9117
30 Sep 2011 02:30:10 1152383 13103445 hadcm3n_yd2b_1900_40_007349789_0 414,720 792,839 1.9117
28 Sep 2011 21:38:45 1152383 13103445 hadcm3n_yd2b_1900_40_007349789_0 388,800 743,508 1.9123
25 Sep 2011 20:10:29 1152383 13103445 hadcm3n_yd2b_1900_40_007349789_0 362,880 693,362 1.9107
23 Sep 2011 00:29:08 1152383 13103445 hadcm3n_yd2b_1900_40_007349789_0 336,960 642,945 1.9081
19 Sep 2011 06:06:12 1152383 13103445 hadcm3n_yd2b_1900_40_007349789_0 311,040 593,017 1.9066
11 Sep 2011 21:04:55 1152383 13103445 hadcm3n_yd2b_1900_40_007349789_0 285,120 543,277 1.9054
08 Sep 2011 05:40:06 1152383 13103445 hadcm3n_yd2b_1900_40_007349789_0 259,200 493,654 1.9045
26 Aug 2011 07:11:55 1152383 13103445 hadcm3n_yd2b_1900_40_007349789_0 233,280 444,464 1.9053
25 Aug 2011 02:01:10 1152383 13103445 hadcm3n_yd2b_1900_40_007349789_0 207,360 395,103 1.9054
23 Aug 2011 01:03:46 1152383 13103445 hadcm3n_yd2b_1900_40_007349789_0 181,440 346,218 1.9082
21 Aug 2011 10:10:29 1152383 13103445 hadcm3n_yd2b_1900_40_007349789_0 155,520 297,081 1.9102
20 Aug 2011 07:11:32 1152383 13103445 hadcm3n_yd2b_1900_40_007349789_0 129,600 247,699 1.9113
17 Aug 2011 03:43:59 1152383 13103445 hadcm3n_yd2b_1900_40_007349789_0 103,680 196,517 1.8954
14 Aug 2011 05:13:35 1152383 13103445 hadcm3n_yd2b_1900_40_007349789_0 77,760 147,068 1.8913
31 Jul 2011 05:43:35 1152383 13103445 hadcm3n_yd2b_1900_40_007349789_0 51,840 98,342 1.8970
25 Jul 2011 18:20:49 1152383 13103445 hadcm3n_yd2b_1900_40_007349789_0 25,920 48,802 1.8828


©2024 cpdn.org