climateprediction.net home page
Task 15452315

Task 15452315

Name hadcm3n_zk5g_1880_40_008250693_0
Workunit 8405817
Created 22 Nov 2012, 7:20:47 UTC
Sent 22 Nov 2012, 7:24:17 UTC
Report deadline 21 Feb 2013, 14:51:28 UTC
Received 9 Jan 2013, 9:33:53 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1228500
Run time 20 days 20 hours 30 min 13 sec
CPU time 19 days 22 hours 2 min 24 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.02 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Error: Input file: dataout/zk5gko.pj84c10 is not a valid UM file.
Error converting file to netcdf: dataout/zk5gko.pj84c10
Error: Input file: dataout/zk5gko.pi84c10 is not a valid UM file.
Error converting file to netcdf: dataout/zk5gko.pi84c10
Error: Input file: dataout/zk5gko.pf84c10 is not a valid UM file.
Error converting file to netcdf: dataout/zk5gko.pf84c10
Error: Input file: dataout/zk5gka.ph84c10 is not a valid UM file.
Error converting file to netcdf: dataout/zk5gka.ph84c10
Error: Input file: dataout/zk5gka.pg84c10 is not a valid UM file.
Error converting file to netcdf: dataout/zk5gka.pg84c10
Error: Input file: dataout/zk5gka.pe84c10 is not a valid UM file.
Error converting file to netcdf: dataout/zk5gka.pe84c10
Error: Input file: dataout/zk5gka.pd84c10 is not a valid UM file.
Error converting file to netcdf: dataout/zk5gka.pd84c10
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
15:25:11 (1804): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:25:52 (20607): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:03:28 (1675): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Error: Input file: dataout/zk5gko.pj96c10 is not a valid UM file.
Error converting file to netcdf: dataout/zk5gko.pj96c10
Error: Input file: dataout/zk5gko.pi96c10 is not a valid UM file.
Error converting file to netcdf: dataout/zk5gko.pi96c10
Error: Input file: dataout/zk5gko.pf96c10 is not a valid UM file.
Error converting file to netcdf: dataout/zk5gko.pf96c10
Error: Input file: dataout/zk5gka.ph96c10 is not a valid UM file.
Error converting file to netcdf: dataout/zk5gka.ph96c10
Error: Input file: dataout/zk5gka.pg96c10 is not a valid UM file.
Error converting file to netcdf: dataout/zk5gka.pg96c10
Error: Input file: dataout/zk5gka.pe96c10 is not a valid UM file.
Error converting file to netcdf: dataout/zk5gka.pe96c10
Error: Input file: dataout/zk5gka.pd96c10 is not a valid UM file.
Error converting file to netcdf: dataout/zk5gka.pd96c10
02:48:11 (1531): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:37:53 (29897): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:39:19 (29921): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:40:10 (29927): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:41:31 (29950): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:42:17 (29964): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:43:02 (29979): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:43:49 (29994): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:44:39 (30009): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:46:00 (30024): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:46:46 (30038): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:47:36 (30054): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:48:23 (30069): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:49:08 (30085): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:49:55 (30099): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:50:41 (30113): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:51:27 (30128): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:52:13 (30134): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:52:59 (30149): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:53:45 (30163): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:54:31 (30179): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:55:16 (30194): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:56:03 (30209): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:56:49 (30223): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:57:35 (30238): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:58:21 (30252): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:59:07 (30259): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:59:53 (30274): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:00:39 (30288): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:01:25 (30303): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:02:45 (30327): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:03:32 (30341): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:04:17 (30348): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:05:03 (30363): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:05:50 (30378): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:06:35 (30394): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:07:21 (30409): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:08:07 (30423): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:08:53 (30438): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:09:40 (30454): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:10:26 (30468): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: free(): invalid next size (normal): 0x08df4df0 ***
======= Backtrace: =========
/lib/i386-linux-gnu/libc.so.6(+0x75ee2)[0xf747bee2]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0xf76a351f]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdaPv+0x1b)[0xf76a357b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf741f4d3]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:01 9060436                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 9060436                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
08d31000-08e31000 rw-p 00000000 00:00 0                                  [heap]
f6e00000-f6e21000 rw-p 00000000 00:00 0 
f6e21000-f6f00000 ---p 00000000 00:00 0 
f6f88000-f7403000 rw-s 00000000 08:01 9327668                            /var/lib/boinc-client/slots/1/137010
f7403000-f7406000 rw-p 00000000 00:00 0 
f7406000-f75a9000 r-xp 00000000 08:01 10224451                           /lib/i386-linux-gnu/libc-2.15.so
f75a9000-f75aa000 ---p 001a3000 08:01 10224451                           /lib/i386-linux-gnu/libc-2.15.so
f75aa000-f75ac000 r--p 001a3000 08:01 10224451                           /lib/i386-linux-gnu/libc-2.15.so
f75ac000-f75ad000 rw-p 001a5000 08:01 10224451                           /lib/i386-linux-gnu/libc-2.15.so
f75ad000-f75b0000 rw-p 00000000 00:00 0 
f75b0000-f75cc000 r-xp 00000000 08:01 10223724                           /lib/i386-linux-gnu/libgcc_s.so.1
f75cc000-f75cd000 r--p 0001b000 08:01 10223724                           /lib/i386-linux-gnu/libgcc_s.so.1
f75cd000-f75ce000 rw-p 0001c000 08:01 10223724                           /lib/i386-linux-gnu/libgcc_s.so.1
f75ce000-f75f8000 r-xp 00000000 08:01 10232612                           /lib/i386-linux-gnu/libm-2.15.so
f75f8000-f75f9000 r--p 00029000 08:01 10232612                           /lib/i386-linux-gnu/libm-2.15.so
f75f9000-f75fa000 rw-p 0002a000 08:01 10232612                           /lib/i386-linux-gnu/libm-2.15.so
f75fa000-f76d2000 r-xp 00000000 08:01 10626255                           /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
f76d2000-f76d3000 ---p 000d8000 08:01 10626255                           /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
f76d3000-f76d7000 r--p 000d8000 08:01 10626255                           /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
f76d7000-f76d8000 rw-p 000dc000 08:01 10626255                           /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
f76d8000-f76e0000 rw-p 00000000 00:00 0 
f76e0000-f76e3000 r-xp 00000000 08:01 10232628                           /lib/i386-linux-gnu/libdl-2.15.so
f76e3000-f76e4000 r--p 00002000 08:01 10232628                           /lib/i386-linux-gnu/libdl-2.15.so
f76e4000-f76e5000 rw-p 00003000 08:01 10232628                           /lib/i386-linux-gnu/libdl-2.15.so
f76e5000-f76fc000 r-xp 00000000 08:01 10232604                           /lib/i386-linux-gnu/libpthread-2.15.so
f76fc000-f76fd000 r--p 00016000 08:01 10232604                           /lib/i386-linux-gnu/libpthread-2.15.so
f76fd000-f76fe000 rw-p 00017000 08:01 10232604                           /lib/i386-linux-gnu/libpthread-2.15.so
f76fe000-f7700000 rw-p 00000000 00:00 0 
f7716000-f7718000 rw-p 00000000 00:00 0 
f7718000-f7719000 ---p 00000000 00:00 0 
f7719000-f771c000 rw-p 00000000 00:00 0 
f771c000-f771e000 rw-s 00000000 08:01 9327579                            /var/lib/boinc-client/slots/1/boinc_mmap_file
f771e000-f7720000 rw-p 00000000 00:00 0 
f7720000-f7721000 r-xp 00000000 00:00 0                                  [vdso]
f7721000-f7741000 r-xp 00000000 08:01 10232616                           /lib/i386-linux-gnu/ld-2.15.so
f7741000-f7742000 r--p 0001f000 08:01 10232616                           /lib/i386-linux-gnu/ld-2.15.so
f7742000-f7743000 rw-p 00020000 08:01 10232616                           /lib/i386-linux-gnu/ld-2.15.so
fff21000-fff92000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (17 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7720400]
[0xf7720430]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf74341df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7437825]
/lib/i386-linux-gnu/libc.so.6(+0x6b39a)[0xf747139a]
/lib/i386-linux-gnu/libc.so.6(+0x75ee2)[0xf747bee2]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0xf76a351f]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdaPv+0x1b)[0xf76a357b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf741f4d3]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 Jan 2013 09:35:21 1228500 15452315 hadcm3n_zk5g_1880_40_008250693_0 518,400 1,720,935 3.3197
06 Jan 2013 08:00:56 1228500 15452315 hadcm3n_zk5g_1880_40_008250693_0 492,480 1,629,191 3.3081
04 Jan 2013 22:10:47 1228500 15452315 hadcm3n_zk5g_1880_40_008250693_0 466,560 1,533,577 3.2870
03 Jan 2013 18:51:57 1228500 15452315 hadcm3n_zk5g_1880_40_008250693_0 440,640 1,439,985 3.2679
02 Jan 2013 13:20:55 1228500 15452315 hadcm3n_zk5g_1880_40_008250693_0 414,720 1,342,113 3.2362
01 Jan 2013 17:22:06 1228500 15452315 hadcm3n_zk5g_1880_40_008250693_0 388,800 1,264,281 3.2518
31 Dec 2012 13:25:22 1228500 15452315 hadcm3n_zk5g_1880_40_008250693_0 362,880 1,176,678 3.2426
26 Dec 2012 09:49:13 1228500 15452315 hadcm3n_zk5g_1880_40_008250693_0 336,960 1,086,583 3.2247
25 Dec 2012 07:07:09 1228500 15452315 hadcm3n_zk5g_1880_40_008250693_0 311,040 994,307 3.1967
25 Dec 2012 05:41:54 1228500 15452315 hadcm3n_zk5g_1880_40_008250693_0 285,120 904,648 3.1729
25 Dec 2012 05:41:54 1228500 15452315 hadcm3n_zk5g_1880_40_008250693_0 259,200 827,373 3.1920
25 Dec 2012 05:41:54 1228500 15452315 hadcm3n_zk5g_1880_40_008250693_0 233,280 749,993 3.2150
25 Dec 2012 05:41:54 1228500 15452315 hadcm3n_zk5g_1880_40_008250693_0 207,360 676,904 3.2644
25 Dec 2012 05:41:54 1228500 15452315 hadcm3n_zk5g_1880_40_008250693_0 181,440 604,106 3.3295
06 Dec 2012 05:42:48 1228500 15452315 hadcm3n_zk5g_1880_40_008250693_0 155,520 524,774 3.3743
03 Dec 2012 15:05:46 1228500 15452315 hadcm3n_zk5g_1880_40_008250693_0 129,600 423,864 3.2706
28 Nov 2012 20:48:53 1228500 15452315 hadcm3n_zk5g_1880_40_008250693_0 103,680 327,477 3.1585
27 Nov 2012 07:43:27 1228500 15452315 hadcm3n_zk5g_1880_40_008250693_0 77,760 231,776 2.9807
24 Nov 2012 16:20:09 1228500 15452315 hadcm3n_zk5g_1880_40_008250693_0 51,840 154,818 2.9865
23 Nov 2012 14:44:13 1228500 15452315 hadcm3n_zk5g_1880_40_008250693_0 25,920 92,086 3.5527


©2024 climateprediction.net