climateprediction.net home page
Task 13340760

Task 13340760

Name hadcm3n_o5lv_1900_40_007440394_3
Workunit 7637897
Created 6 Sep 2011, 15:23:19 UTC
Sent 6 Sep 2011, 15:30:36 UTC
Report deadline 6 Dec 2011, 22:57:47 UTC
Received 25 Sep 2011, 14:41:06 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1167989
Run time 16 days 21 hours 31 min 46 sec
CPU time 16 days 6 hours 40 min 31 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 1.49 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
06:06:03 (2404): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:33:23 (3698): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:35:26 (3763): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0895a560 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6c231)[0xf754e231]
/lib32/libc.so.6(+0x6dab8)[0xf754fab8]
/lib32/libc.so.6(cfree+0x6d)[0xf7552b9d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf773ca91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf773caed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf74f8bd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 fc:03 5505252                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 fc:03 5505252                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
08905000-0896a000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f7065000-f74e0000 rw-s 00000000 fc:03 5505698                            /var/lib/boinc-client/slots/9/136925
f74e0000-f74e2000 rw-p 00000000 00:00 0 
f74e2000-f7635000 r-xp 00000000 fc:03 16777221                           /lib32/libc-2.11.1.so
f7635000-f7636000 ---p 00153000 fc:03 16777221                           /lib32/libc-2.11.1.so
f7636000-f7638000 r--p 00153000 fc:03 16777221                           /lib32/libc-2.11.1.so
f7638000-f7639000 rw-p 00155000 fc:03 16777221                           /lib32/libc-2.11.1.so
f7639000-f763c000 rw-p 00000000 00:00 0 
f763c000-f7659000 r-xp 00000000 fc:03 11822036                           /usr/lib32/libgcc_s.so.1
f7659000-f765a000 r--p 0001c000 fc:03 11822036                           /usr/lib32/libgcc_s.so.1
f765a000-f765b000 rw-p 0001d000 fc:03 11822036                           /usr/lib32/libgcc_s.so.1
f765b000-f767f000 r-xp 00000000 fc:03 16777225                           /lib32/libm-2.11.1.so
f767f000-f7680000 r--p 00023000 fc:03 16777225                           /lib32/libm-2.11.1.so
f7680000-f7681000 rw-p 00024000 fc:03 16777225                           /lib32/libm-2.11.1.so
f7681000-f776a000 r-xp 00000000 fc:03 11822039                           /usr/lib32/libstdc++.so.6.0.13
f776a000-f776b000 ---p 000e9000 fc:03 11822039                           /usr/lib32/libstdc++.so.6.0.13
f776b000-f776f000 r--p 000e9000 fc:03 11822039                           /usr/lib32/libstdc++.so.6.0.13
f776f000-f7770000 rw-p 000ed000 fc:03 11822039                           /usr/lib32/libstdc++.so.6.0.13
f7770000-f7777000 rw-p 00000000 00:00 0 
f7777000-f7779000 r-xp 00000000 fc:03 16777224                           /lib32/libdl-2.11.1.so
f7779000-f777a000 r--p 00001000 fc:03 16777224                           /lib32/libdl-2.11.1.so
f777a000-f777b000 rw-p 00002000 fc:03 16777224                           /lib32/libdl-2.11.1.so
f777b000-f777c000 rw-p 00000000 00:00 0 
f777c000-f7791000 r-xp 00000000 fc:03 16777235                           /lib32/libpthread-2.11.1.so
f7791000-f7792000 r--p 00014000 fc:03 16777235                           /lib32/libpthread-2.11.1.so
f7792000-f7793000 rw-p 00015000 fc:03 16777235                           /lib32/libpthread-2.11.1.so
f7793000-f7795000 rw-p 00000000 00:00 0 
f77b5000-f77b6000 rw-p 00000000 00:00 0 
f77b6000-f77b7000 ---p 00000000 00:00 0 
f77b7000-f77ba000 rw-p 00000000 00:00 0 
f77ba000-f77bc000 rw-s 00000000 fc:03 5505684                            /var/lib/boinc-client/slots/9/boinc_mmap_file
f77bc000-f77be000 rw-p 00000000 00:00 0 
f77be000-f77bf000 r-xp 00000000 00:00 0                                  [vdso]
f77bf000-f77db000 r-xp 00000000 fc:03 16777218                           /lib32/ld-2.11.1.so
f77db000-f77dc000 r--p 0001b000 fc:03 16777218                           /lib32/ld-2.11.1.so
f77dc000-f77dd000 rw-p 0001c000 fc:03 16777218                           /lib32/ld-2.11.1.so
ffb24000-ffb93000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf77be400]
[0xf77be430]
/lib32/libc.so.6(gsignal+0x51)[0xf750c921]
/lib32/libc.so.6(abort+0x182)[0xf750fd52]
/lib32/libc.so.6(+0x6213d)[0xf754413d]
/lib32/libc.so.6(+0x6c231)[0xf754e231]
/lib32/libc.so.6(+0x6dab8)[0xf754fab8]
/lib32/libc.so.6(cfree+0x6d)[0xf7552b9d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf773ca91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf773caed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf74f8bd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
25 Sep 2011 14:39:15 1167989 13340760 hadcm3n_o5lv_1900_40_007440394_3 518,400 1,406,428 2.7130
24 Sep 2011 21:51:23 1167989 13340760 hadcm3n_o5lv_1900_40_007440394_3 492,480 1,346,581 2.7343
24 Sep 2011 05:39:43 1167989 13340760 hadcm3n_o5lv_1900_40_007440394_3 466,560 1,289,178 2.7632
23 Sep 2011 12:33:12 1167989 13340760 hadcm3n_o5lv_1900_40_007440394_3 440,640 1,229,360 2.7899
21 Sep 2011 23:06:30 1167989 13340760 hadcm3n_o5lv_1900_40_007440394_3 414,720 1,171,040 2.8237
21 Sep 2011 06:45:11 1167989 13340760 hadcm3n_o5lv_1900_40_007440394_3 388,800 1,112,455 2.8613
20 Sep 2011 14:21:42 1167989 13340760 hadcm3n_o5lv_1900_40_007440394_3 362,880 1,054,822 2.9068
19 Sep 2011 21:55:00 1167989 13340760 hadcm3n_o5lv_1900_40_007440394_3 336,960 996,162 2.9563
19 Sep 2011 05:51:05 1167989 13340760 hadcm3n_o5lv_1900_40_007440394_3 311,040 938,729 3.0180
18 Sep 2011 07:45:47 1167989 13340760 hadcm3n_o5lv_1900_40_007440394_3 285,120 861,202 3.0205
17 Sep 2011 15:28:38 1167989 13340760 hadcm3n_o5lv_1900_40_007440394_3 259,200 802,836 3.0974
16 Sep 2011 18:51:30 1167989 13340760 hadcm3n_o5lv_1900_40_007440394_3 233,280 731,224 3.1345
15 Sep 2011 23:25:57 1167989 13340760 hadcm3n_o5lv_1900_40_007440394_3 207,360 663,986 3.2021
14 Sep 2011 20:43:57 1167989 13340760 hadcm3n_o5lv_1900_40_007440394_3 181,440 585,773 3.2285
13 Sep 2011 18:29:09 1167989 13340760 hadcm3n_o5lv_1900_40_007440394_3 155,520 503,046 3.2346
12 Sep 2011 17:22:17 1167989 13340760 hadcm3n_o5lv_1900_40_007440394_3 129,600 416,172 3.2112
11 Sep 2011 08:21:06 1167989 13340760 hadcm3n_o5lv_1900_40_007440394_3 103,680 342,937 3.3076
10 Sep 2011 06:43:00 1167989 13340760 hadcm3n_o5lv_1900_40_007440394_3 77,760 256,913 3.3039
09 Sep 2011 04:40:42 1167989 13340760 hadcm3n_o5lv_1900_40_007440394_3 51,840 170,012 3.2796
08 Sep 2011 03:26:39 1167989 13340760 hadcm3n_o5lv_1900_40_007440394_3 25,920 85,685 3.3057


©2024 climateprediction.net