climateprediction.net home page
Task 16000832

Task 16000832

Name hadcm3n_o1q2_2020_40_008409895_1
Workunit 8560751
Created 2 Sep 2013, 21:42:31 UTC
Sent 2 Sep 2013, 22:15:24 UTC
Report deadline 3 Dec 2013, 5:42:35 UTC
Received 20 Sep 2013, 4:45:09 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1186682
Run time 17 days 1 hours 6 min 20 sec
CPU time 17 days 0 hours 59 min 57 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 1.72 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:59:02 (18947): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
16:55:18 (6640): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:56:46 (11926): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:59:21 (11942): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:01:28 (11958): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:03:21 (12106): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:05:29 (12123): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:07:06 (12153): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:44:20 (12169): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:45:48 (12670): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:48:24 (12699): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:52:17 (12715): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:53:45 (14222): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:57:10 (14239): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:01:52 (14282): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:53:46 (14427): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:55:13 (24540): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:57:21 (24571): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
20:15:49 (32709): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:14:40 (1354): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:16:08 (3928): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:25:10 (3949): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:32:40 (4011): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
16:17:58 (12173): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:20:46 (17825): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:24:49 (17876): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x081d6d00 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6f141)[0xf756c141]
/lib32/libc.so.6(+0x709c8)[0xf756d9c8]
/lib32/libc.so.6(cfree+0x6d)[0xf7570a7d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf76ea26f]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7513e46]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 68:03 896249                             /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 68:03 896249                             /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
08181000-081e7000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f707f000-f74fa000 rw-s 00000000 68:03 912366                             /var/lib/boinc-client/slots/6/134445
f74fa000-f74fd000 rw-p 00000000 00:00 0 
f74fd000-f7654000 r-xp 00000000 68:02 162890                             /lib32/libc-2.13.so
f7654000-f7656000 r--p 00156000 68:02 162890                             /lib32/libc-2.13.so
f7656000-f7657000 rw-p 00158000 68:02 162890                             /lib32/libc-2.13.so
f7657000-f765a000 rw-p 00000000 00:00 0 
f765a000-f7676000 r-xp 00000000 68:02 342064                             /usr/lib32/libgcc_s.so.1
f7676000-f7677000 rw-p 0001b000 68:02 342064                             /usr/lib32/libgcc_s.so.1
f7677000-f769b000 r-xp 00000000 68:02 163141                             /lib32/libm-2.13.so
f769b000-f769c000 r--p 00023000 68:02 163141                             /lib32/libm-2.13.so
f769c000-f769d000 rw-p 00024000 68:02 163141                             /lib32/libm-2.13.so
f769d000-f777d000 r-xp 00000000 68:02 342210                             /usr/lib32/libstdc++.so.6.0.17
f777d000-f7781000 r--p 000e0000 68:02 342210                             /usr/lib32/libstdc++.so.6.0.17
f7781000-f7782000 rw-p 000e4000 68:02 342210                             /usr/lib32/libstdc++.so.6.0.17
f7782000-f7789000 rw-p 00000000 00:00 0 
f7789000-f778b000 r-xp 00000000 68:02 163451                             /lib32/libdl-2.13.so
f778b000-f778c000 r--p 00001000 68:02 163451                             /lib32/libdl-2.13.so
f778c000-f778d000 rw-p 00002000 68:02 163451                             /lib32/libdl-2.13.so
f778d000-f77a2000 r-xp 00000000 68:02 164777                             /lib32/libpthread-2.13.so
f77a2000-f77a3000 r--p 00014000 68:02 164777                             /lib32/libpthread-2.13.so
f77a3000-f77a4000 rw-p 00015000 68:02 164777                             /lib32/libpthread-2.13.so
f77a4000-f77a7000 rw-p 00000000 00:00 0 
f77b5000-f77b6000 rw-p 00000000 00:00 0 
f77b6000-f77b7000 ---p 00000000 00:00 0 
f77b7000-f77ba000 rw-p 00000000 00:00 0 
f77ba000-f77bc000 rw-s 00000000 68:03 912363                             /var/lib/boinc-client/slots/6/boinc_mmap_file
f77bc000-f77bd000 rw-p 00000000 00:00 0 
f77bd000-f77be000 r-xp 00000000 00:00 0                                  [vdso]
f77be000-f77da000 r-xp 00000000 68:02 164781                             /lib32/ld-2.13.so
f77da000-f77db000 r--p 0001c000 68:02 164781                             /lib32/ld-2.13.so
f77db000-f77dc000 rw-p 0001d000 68:02 164781                             /lib32/ld-2.13.so
ffb59000-ffbc9000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (17 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf77bd400]
[0xf77bd430]
/lib32/libc.so.6(gsignal+0x51)[0xf7527c11]
/lib32/libc.so.6(abort+0x182)[0xf752b032]
/lib32/libc.so.6(+0x65055)[0xf7562055]
/lib32/libc.so.6(+0x6f141)[0xf756c141]
/lib32/libc.so.6(+0x709c8)[0xf756d9c8]
/lib32/libc.so.6(cfree+0x6d)[0xf7570a7d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf76ea26f]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7513e46]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
20 Sep 2013 04:47:47 1186682 16000832 hadcm3n_o1q2_2020_40_008409895_1 518,400 1,472,394 2.8403
19 Sep 2013 07:16:59 1186682 16000832 hadcm3n_o1q2_2020_40_008409895_1 492,480 1,398,746 2.8402
18 Sep 2013 09:53:37 1186682 16000832 hadcm3n_o1q2_2020_40_008409895_1 466,560 1,325,741 2.8415
17 Sep 2013 14:22:53 1186682 16000832 hadcm3n_o1q2_2020_40_008409895_1 440,640 1,255,333 2.8489
16 Sep 2013 18:49:35 1186682 16000832 hadcm3n_o1q2_2020_40_008409895_1 414,720 1,184,922 2.8572
15 Sep 2013 23:13:07 1186682 16000832 hadcm3n_o1q2_2020_40_008409895_1 388,800 1,114,437 2.8664
15 Sep 2013 03:37:34 1186682 16000832 hadcm3n_o1q2_2020_40_008409895_1 362,880 1,043,956 2.8769
14 Sep 2013 06:01:54 1186682 16000832 hadcm3n_o1q2_2020_40_008409895_1 336,960 970,347 2.8797
13 Sep 2013 08:00:54 1186682 16000832 hadcm3n_o1q2_2020_40_008409895_1 311,040 892,273 2.8687
12 Sep 2013 08:04:15 1186682 16000832 hadcm3n_o1q2_2020_40_008409895_1 285,120 809,838 2.8403
11 Sep 2013 12:21:59 1186682 16000832 hadcm3n_o1q2_2020_40_008409895_1 259,200 738,875 2.8506
10 Sep 2013 16:46:38 1186682 16000832 hadcm3n_o1q2_2020_40_008409895_1 233,280 668,511 2.8657
09 Sep 2013 22:14:51 1186682 16000832 hadcm3n_o1q2_2020_40_008409895_1 207,360 598,461 2.8861
09 Sep 2013 01:51:32 1186682 16000832 hadcm3n_o1q2_2020_40_008409895_1 181,440 528,281 2.9116
08 Sep 2013 06:21:15 1186682 16000832 hadcm3n_o1q2_2020_40_008409895_1 155,520 458,105 2.9456
07 Sep 2013 10:49:32 1186682 16000832 hadcm3n_o1q2_2020_40_008409895_1 129,600 387,964 2.9935
06 Sep 2013 16:14:37 1186682 16000832 hadcm3n_o1q2_2020_40_008409895_1 103,680 317,846 3.0656
05 Sep 2013 18:46:55 1186682 16000832 hadcm3n_o1q2_2020_40_008409895_1 77,760 243,886 3.1364
04 Sep 2013 20:45:18 1186682 16000832 hadcm3n_o1q2_2020_40_008409895_1 51,840 164,842 3.1798
03 Sep 2013 21:21:24 1186682 16000832 hadcm3n_o1q2_2020_40_008409895_1 25,920 82,346 3.1769


©2024 climateprediction.net