| Name |
hadcm3n_o7ll_1980_40_007426168_2 |
| Workunit |
7623671 |
| Created |
23 Sep 2011, 19:34:50 UTC |
| Sent |
23 Sep 2011, 19:46:31 UTC |
| Report deadline |
24 Dec 2011, 3:13:42 UTC |
| Received |
17 Nov 2011, 18:06:50 UTC |
| Server state |
Over |
| Outcome |
Computation error |
| Client state |
Compute error |
| Exit status |
193 (0x000000C1) EXIT_SIGNAL |
| Computer ID |
1151942 |
| Run time |
11 days 3 hours 35 min 7 sec |
| CPU time |
7 days 4 hours 48 min 35 sec |
| Validate state |
Invalid |
| Credit |
3,110.40 |
| Device peak FLOPS |
2.23 GFLOPS |
| Application version |
UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu |
| Stderr | <core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
03:11:16 (18014): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:11:21 (18014): No heartbeat from core client for 30 sec - exiting
03:16:22 (5808): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:16:37 (5808): No heartbeat from core client for 30 sec - exiting
03:16:38 (5808): No heartbeat from core client for 30 sec - exiting
03:16:39 (5808): No heartbeat from core client for 30 sec - exiting
03:16:40 (5808): No heartbeat from core client for 30 sec - exiting
03:16:41 (5808): No heartbeat from core client for 30 sec - exiting
03:21:15 (5940): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:27:31 (6037): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:27:32 (6037): No heartbeat from core client for 30 sec - exiting
19:58:38 (812): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
03:46:33 (4254): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:05:10 (4646): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1
Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048
BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1
Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048
BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1
Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048
08:51:06 (21885): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
03:21:03 (20136): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:23:20 (30302): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:38:37 (30478): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:38:38 (30478): No heartbeat from core client for 30 sec - exiting
01:38:39 (30478): No heartbeat from core client for 30 sec - exiting
01:38:40 (30478): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
03:12:36 (21052): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:30:36 (8398): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:07:19 (11832): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:11:08 (7491): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:11:09 (7491): No heartbeat from core client for 30 sec - exiting
13:11:10 (7491): No heartbeat from core client for 30 sec - exiting
13:11:11 (7491): No heartbeat from core client for 30 sec - exiting
13:11:12 (7491): No heartbeat from core client for 30 sec - exiting
13:13:32 (8413): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:18:04 (9583): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:37:16 (9763): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:37:17 (9763): No heartbeat from core client for 30 sec - exiting
13:37:18 (9763): No heartbeat from core client for 30 sec - exiting
13:37:19 (9763): No heartbeat from core client for 30 sec - exiting
13:39:06 (13920): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:41:24 (14808): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:54:50 (15130): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:54:51 (15130): No heartbeat from core client for 30 sec - exiting
13:54:52 (15130): No heartbeat from core client for 30 sec - exiting
13:54:53 (15130): No heartbeat from core client for 30 sec - exiting
13:54:54 (15130): No heartbeat from core client for 30 sec - exiting
13:54:55 (15130): No heartbeat from core client for 30 sec - exiting
13:57:56 (18183): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:03:07 (19352): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:18:01 (20361): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:18:02 (20361): No heartbeat from core client for 30 sec - exiting
14:18:03 (20361): No heartbeat from core client for 30 sec - exiting
14:18:04 (20361): No heartbeat from core client for 30 sec - exiting
14:18:05 (20361): No heartbeat from core client for 30 sec - exiting
14:18:06 (20361): No heartbeat from core client for 30 sec - exiting
14:18:07 (20361): No heartbeat from core client for 30 sec - exiting
14:18:08 (20361): No heartbeat from core client for 30 sec - exiting
14:18:09 (20361): No heartbeat from core client for 30 sec - exiting
14:18:10 (20361): No heartbeat from core client for 30 sec - exiting
14:18:11 (20361): No heartbeat from core client for 30 sec - exiting
14:18:12 (20361): No heartbeat from core client for 30 sec - exiting
14:18:13 (20361): No heartbeat from core client for 30 sec - exiting
14:18:14 (20361): No heartbeat from core client for 30 sec - exiting
14:18:15 (20361): No heartbeat from core client for 30 sec - exiting
14:18:16 (20361): No heartbeat from core client for 30 sec - exiting
14:18:17 (20361): No heartbeat from core client for 30 sec - exiting
14:18:18 (20361): No heartbeat from core client for 30 sec - exiting
14:18:19 (20361): No heartbeat from core client for 30 sec - exiting
14:18:20 (20361): No heartbeat from core client for 30 sec - exiting
14:18:21 (20361): No heartbeat from core client for 30 sec - exiting
14:18:22 (20361): No heartbeat from core client for 30 sec - exiting
14:18:23 (20361): No heartbeat from core client for 30 sec - exiting
14:18:24 (20361): No heartbeat from core client for 30 sec - exiting
14:18:25 (20361): No heartbeat from core client for 30 sec - exiting
14:18:26 (20361): No heartbeat from core client for 30 sec - exiting
14:18:27 (20361): No heartbeat from core client for 30 sec - exiting
14:18:28 (20361): No heartbeat from core client for 30 sec - exiting
14:18:29 (20361): No heartbeat from core client for 30 sec - exiting
14:18:30 (20361): No heartbeat from core client for 30 sec - exiting
14:58:35 (22814): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:58:36 (22814): No heartbeat from core client for 30 sec - exiting
14:58:37 (22814): No heartbeat from core client for 30 sec - exiting
14:58:38 (22814): No heartbeat from core client for 30 sec - exiting
14:58:39 (22814): No heartbeat from core client for 30 sec - exiting
14:58:40 (22814): No heartbeat from core client for 30 sec - exiting
14:58:41 (22814): No heartbeat from core client for 30 sec - exiting
14:58:42 (22814): No heartbeat from core client for 30 sec - exiting
15:00:46 (31200): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:00:47 (31200): No heartbeat from core client for 30 sec - exiting
15:00:48 (31200): No heartbeat from core client for 30 sec - exiting
15:00:49 (31200): No heartbeat from core client for 30 sec - exiting
15:00:50 (31200): No heartbeat from core client for 30 sec - exiting
15:00:51 (31200): No heartbeat from core client for 30 sec - exiting
15:00:52 (31200): No heartbeat from core client for 30 sec - exiting
15:00:53 (31200): No heartbeat from core client for 30 sec - exiting
15:00:54 (31200): No heartbeat from core client for 30 sec - exiting
15:00:55 (31200): No heartbeat from core client for 30 sec - exiting
15:00:56 (31200): No heartbeat from core client for 30 sec - exiting
15:04:47 (32259): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:42:11 (32684): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:42:12 (32684): No heartbeat from core client for 30 sec - exiting
15:42:13 (32684): No heartbeat from core client for 30 sec - exiting
15:42:14 (32684): No heartbeat from core client for 30 sec - exiting
15:42:15 (32684): No heartbeat from core client for 30 sec - exiting
15:42:16 (32684): No heartbeat from core client for 30 sec - exiting
15:42:17 (32684): No heartbeat from core client for 30 sec - exiting
15:42:18 (32684): No heartbeat from core client for 30 sec - exiting
15:42:19 (32684): No heartbeat from core client for 30 sec - exiting
15:42:20 (32684): No heartbeat from core client for 30 sec - exiting
15:42:21 (32684): No heartbeat from core client for 30 sec - exiting
15:42:22 (32684): No heartbeat from core client for 30 sec - exiting
15:44:27 (7587): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:22:39 (8580): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:22:40 (8580): No heartbeat from core client for 30 sec - exiting
16:24:20 (15957): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:04:34 (17001): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:21:24 (5811): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:28:34 (21594): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:10:43 (22594): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:10:45 (22594): No heartbeat from core client for 30 sec - exiting
20:10:46 (22594): No heartbeat from core client for 30 sec - exiting
20:10:47 (22594): No heartbeat from core client for 30 sec - exiting
03:06:42 (30872): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:06:58 (30872): No heartbeat from core client for 30 sec - exiting
03:04:09 (28223): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:20:05 (14117): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
03:35:25 (16864): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:35:27 (16864): No heartbeat from core client for 30 sec - exiting
17:55:25 (2327): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:24:06 (22899): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:24:07 (22899): No heartbeat from core client for 30 sec - exiting
18:27:19 (9919): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x094db6d0 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6c231)[0xf74d7231]
/lib32/libc.so.6(+0x6dab8)[0xf74d8ab8]
/lib32/libc.so.6(cfree+0x6d)[0xf74dbb9d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76c5a91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76c5aed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7481bd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 fb:00 44331351 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 fb:00 44331351 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0
09486000-094eb000 rw-p 00000000 00:00 0 [heap]
f6e00000-f6e21000 rw-p 00000000 00:00 0
f6e21000-f6f00000 ---p 00000000 00:00 0
f6fee000-f7469000 rw-s 00000000 fb:00 44312873 /var/lib/boinc-client/slots/7/137485
f7469000-f746b000 rw-p 00000000 00:00 0
f746b000-f75be000 r-xp 00000000 fb:00 213647365 /lib32/libc-2.11.1.so
f75be000-f75bf000 ---p 00153000 fb:00 213647365 /lib32/libc-2.11.1.so
f75bf000-f75c1000 r--p 00153000 fb:00 213647365 /lib32/libc-2.11.1.so
f75c1000-f75c2000 rw-p 00155000 fb:00 213647365 /lib32/libc-2.11.1.so
f75c2000-f75c5000 rw-p 00000000 00:00 0
f75c5000-f75e2000 r-xp 00000000 fb:00 109451375 /usr/lib32/libgcc_s.so.1
f75e2000-f75e3000 r--p 0001c000 fb:00 109451375 /usr/lib32/libgcc_s.so.1
f75e3000-f75e4000 rw-p 0001d000 fb:00 109451375 /usr/lib32/libgcc_s.so.1
f75e4000-f7608000 r-xp 00000000 fb:00 213647369 /lib32/libm-2.11.1.so
f7608000-f7609000 r--p 00023000 fb:00 213647369 /lib32/libm-2.11.1.so
f7609000-f760a000 rw-p 00024000 fb:00 213647369 /lib32/libm-2.11.1.so
f760a000-f76f3000 r-xp 00000000 fb:00 109451378 /usr/lib32/libstdc++.so.6.0.13
f76f3000-f76f4000 ---p 000e9000 fb:00 109451378 /usr/lib32/libstdc++.so.6.0.13
f76f4000-f76f8000 r--p 000e9000 fb:00 109451378 /usr/lib32/libstdc++.so.6.0.13
f76f8000-f76f9000 rw-p 000ed000 fb:00 109451378 /usr/lib32/libstdc++.so.6.0.13
f76f9000-f7700000 rw-p 00000000 00:00 0
f7700000-f7702000 r-xp 00000000 fb:00 213647368 /lib32/libdl-2.11.1.so
f7702000-f7703000 r--p 00001000 fb:00 213647368 /lib32/libdl-2.11.1.so
f7703000-f7704000 rw-p 00002000 fb:00 213647368 /lib32/libdl-2.11.1.so
f7704000-f7705000 rw-p 00000000 00:00 0
f7705000-f771a000 r-xp 00000000 fb:00 213647379 /lib32/libpthread-2.11.1.so
f771a000-f771b000 r--p 00014000 fb:00 213647379 /lib32/libpthread-2.11.1.so
f771b000-f771c000 rw-p 00015000 fb:00 213647379 /lib32/libpthread-2.11.1.so
f771c000-f771e000 rw-p 00000000 00:00 0
f772a000-f772b000 rw-p 00000000 00:00 0
f772b000-f772c000 ---p 00000000 00:00 0
f772c000-f772f000 rw-p 00000000 00:00 0
f772f000-f7731000 rw-s 00000000 fb:00 44308272 /var/lib/boinc-client/slots/7/boinc_mmap_file
f7731000-f7733000 rw-p 00000000 00:00 0
f7733000-f7734000 r-xp 00000000 00:00 0 [vdso]
f7734000-f7750000 r-xp 00000000 fb:00 213647362 /lib32/ld-2.11.1.so
f7750000-f7751000 r--p 0001b000 fb:00 213647362 /lib32/ld-2.11.1.so
f7751000-f7752000 rw-p 0001c000 fb:00 213647362 /lib32/ld-2.11.1.so
ffcb2000-ffd22000 rw-p 00000000 00:00 0 [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7733400]
[0xf7733430]
/lib32/libc.so.6(gsignal+0x51)[0xf7495921]
/lib32/libc.so.6(abort+0x182)[0xf7498d52]
/lib32/libc.so.6(+0x6213d)[0xf74cd13d]
/lib32/libc.so.6(+0x6c231)[0xf74d7231]
/lib32/libc.so.6(+0x6dab8)[0xf74d8ab8]
/lib32/libc.so.6(cfree+0x6d)[0xf74dbb9d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76c5a91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76c5aed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7481bd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
Exiting...
</stderr_txt>
]]>
|
