climateprediction.net home page
Task 15459798

Task 15459798

Name hadcm3n_zk7s_1880_40_008252922_2
Workunit 8408046
Created 24 Nov 2012, 2:26:55 UTC
Sent 24 Nov 2012, 2:28:09 UTC
Report deadline 23 Feb 2013, 9:55:20 UTC
Received 14 Jan 2013, 19:47:34 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1228540
Run time 32 days 4 hours 16 min 2 sec
CPU time 30 days 7 hours 43 min 58 sec
Validate state Invalid
Credit 12,441.60
Device peak FLOPS 1.94 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.29</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
05:44:38 (13941): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:47:20 (19525): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:50:04 (19579): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:52:35 (19643): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:54:33 (19691): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:56:34 (19745): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:59:25 (19792): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
18:52:17 (12829): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:52:18 (12829): No heartbeat from core client for 30 sec - exiting
18:52:19 (12829): No heartbeat from core client for 30 sec - exiting
18:52:20 (12829): No heartbeat from core client for 30 sec - exiting
18:52:21 (12829): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
19:03:54 (23184): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
19:17:48 (23283): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: free(): invalid next size (normal): 0x087db778 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x77620)[0xf74c7620]
/usr/lib/gcc/x86_64-pc-linux-gnu/4.6.3/32/libstdc++.so.6(_ZdlPv+0x1f)[0xf76f17bf]
/usr/lib/gcc/x86_64-pc-linux-gnu/4.6.3/32/libstdc++.so.6(_ZdaPv+0x1b)[0xf76f183b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xf3)[0xf746c953]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 fc:06 16777876                           /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 fc:06 16777876                           /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
08717000-08817000 rw-p 00000000 00:00 0                                  [heap]
f6fd1000-f6fd2000 rw-p 00000000 00:00 0 
f6fd2000-f744d000 rw-s 00000000 fc:06 16780098                           /var/lib/boinc/slots/13/137310
f744d000-f7450000 rw-p 00000000 00:00 0 
f7450000-f75f3000 r-xp 00000000 fc:01 1118945                            /lib32/libc-2.15.so
f75f3000-f75f5000 r--p 001a3000 fc:01 1118945                            /lib32/libc-2.15.so
f75f5000-f75f6000 rw-p 001a5000 fc:01 1118945                            /lib32/libc-2.15.so
f75f6000-f75f9000 rw-p 00000000 00:00 0 
f75f9000-f7614000 r-xp 00000000 fc:01 983787                             /usr/lib64/gcc/x86_64-pc-linux-gnu/4.6.3/32/libgcc_s.so.1
f7614000-f7615000 r--p 0001a000 fc:01 983787                             /usr/lib64/gcc/x86_64-pc-linux-gnu/4.6.3/32/libgcc_s.so.1
f7615000-f7616000 rw-p 0001b000 fc:01 983787                             /usr/lib64/gcc/x86_64-pc-linux-gnu/4.6.3/32/libgcc_s.so.1
f7616000-f7640000 r-xp 00000000 fc:01 1114875                            /lib32/libm-2.15.so
f7640000-f7641000 r--p 00029000 fc:01 1114875                            /lib32/libm-2.15.so
f7641000-f7642000 rw-p 0002a000 fc:01 1114875                            /lib32/libm-2.15.so
f7642000-f7643000 rw-p 00000000 00:00 0 
f7643000-f7725000 r-xp 00000000 fc:01 983766                             /usr/lib64/gcc/x86_64-pc-linux-gnu/4.6.3/32/libstdc++.so.6.0.16
f7725000-f7729000 r--p 000e2000 fc:01 983766                             /usr/lib64/gcc/x86_64-pc-linux-gnu/4.6.3/32/libstdc++.so.6.0.16
f7729000-f772a000 rw-p 000e6000 fc:01 983766                             /usr/lib64/gcc/x86_64-pc-linux-gnu/4.6.3/32/libstdc++.so.6.0.16
f772a000-f7731000 rw-p 00000000 00:00 0 
f7731000-f7734000 r-xp 00000000 fc:01 1117542                            /lib32/libdl-2.15.so
f7734000-f7735000 r--p 00002000 fc:01 1117542                            /lib32/libdl-2.15.so
f7735000-f7736000 rw-p 00003000 fc:01 1117542                            /lib32/libdl-2.15.so
f7736000-f774e000 r-xp 00000000 fc:01 1117753                            /lib32/libpthread-2.15.so
f774e000-f774f000 r--p 00017000 fc:01 1117753                            /lib32/libpthread-2.15.so
f774f000-f7750000 rw-p 00018000 fc:01 1117753                            /lib32/libpthread-2.15.so
f7750000-f7752000 rw-p 00000000 00:00 0 
f7776000-f7777000 rw-p 00000000 00:00 0 
f7777000-f7778000 ---p 00000000 00:00 0 
f7778000-f777b000 rw-p 00000000 00:00 0                                  [stack:3485]
f777b000-f777d000 rw-s 00000000 fc:06 16780091                           /var/lib/boinc/slots/13/boinc_mmap_file
f777d000-f777e000 rw-p 00000000 00:00 0 
f777e000-f779e000 r-xp 00000000 fc:01 1116708                            /lib32/ld-2.15.so
f779e000-f779f000 r-xp 00000000 00:00 0                                  [vdso]
f779f000-f77a0000 r--p 00020000 fc:01 1116708                            /lib32/ld-2.15.so
f77a0000-f77a1000 rw-p 00021000 fc:01 1116708                            /lib32/ld-2.15.so
ffdf9000-ffe6a000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (17 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf779e400]
linux-gate.so.1(__kernel_vsyscall+0x5)[0xf779e425]
/lib32/libc.so.6(gsignal+0x47)[0xf7481907]
/lib32/libc.so.6(abort+0x186)[0xf7483126]
/lib32/libc.so.6(+0x70d85)[0xf74c0d85]
/lib32/libc.so.6(+0x77620)[0xf74c7620]
/usr/lib/gcc/x86_64-pc-linux-gnu/4.6.3/32/libstdc++.so.6(_ZdlPv+0x1f)[0xf76f17bf]
/usr/lib/gcc/x86_64-pc-linux-gnu/4.6.3/32/libstdc++.so.6(_ZdaPv+0x1b)[0xf76f183b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xf3)[0xf746c953]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Jan 2013 19:48:19 1228540 15459798 hadcm3n_zk7s_1880_40_008252922_2 1,036,800 2,619,833 2.5268
01 Jan 2013 15:20:55 1228540 15459798 hadcm3n_zk7s_1880_40_008252922_2 1,010,880 2,556,617 2.5291
31 Dec 2012 21:18:11 1228540 15459798 hadcm3n_zk7s_1880_40_008252922_2 984,960 2,491,634 2.5297
31 Dec 2012 03:02:15 1228540 15459798 hadcm3n_zk7s_1880_40_008252922_2 959,040 2,425,658 2.5293
28 Dec 2012 12:50:17 1228540 15459798 hadcm3n_zk7s_1880_40_008252922_2 933,120 2,360,514 2.5297
27 Dec 2012 18:07:44 1228540 15459798 hadcm3n_zk7s_1880_40_008252922_2 907,200 2,293,440 2.5280
26 Dec 2012 22:17:01 1228540 15459798 hadcm3n_zk7s_1880_40_008252922_2 881,280 2,222,655 2.5221
26 Dec 2012 03:17:46 1228540 15459798 hadcm3n_zk7s_1880_40_008252922_2 855,360 2,154,377 2.5187
25 Dec 2012 07:32:13 1228540 15459798 hadcm3n_zk7s_1880_40_008252922_2 829,440 2,085,739 2.5146
24 Dec 2012 10:53:22 1228540 15459798 hadcm3n_zk7s_1880_40_008252922_2 803,520 2,011,523 2.5034
23 Dec 2012 16:59:58 1228540 15459798 hadcm3n_zk7s_1880_40_008252922_2 777,600 1,947,118 2.5040
22 Dec 2012 22:20:36 1228540 15459798 hadcm3n_zk7s_1880_40_008252922_2 751,680 1,880,065 2.5012
21 Dec 2012 19:57:33 1228540 15459798 hadcm3n_zk7s_1880_40_008252922_2 725,760 1,813,500 2.4988
20 Dec 2012 23:47:49 1228540 15459798 hadcm3n_zk7s_1880_40_008252922_2 699,840 1,746,124 2.4950
20 Dec 2012 02:24:54 1228540 15459798 hadcm3n_zk7s_1880_40_008252922_2 673,920 1,678,430 2.4905
19 Dec 2012 04:51:15 1228540 15459798 hadcm3n_zk7s_1880_40_008252922_2 648,000 1,611,592 2.4870
17 Dec 2012 17:36:24 1228540 15459798 hadcm3n_zk7s_1880_40_008252922_2 622,080 1,543,060 2.4805
15 Dec 2012 18:21:35 1228540 15459798 hadcm3n_zk7s_1880_40_008252922_2 596,160 1,472,792 2.4705
14 Dec 2012 12:30:26 1228540 15459798 hadcm3n_zk7s_1880_40_008252922_2 570,240 1,401,641 2.4580
14 Dec 2012 05:56:59 1228540 15459798 hadcm3n_zk7s_1880_40_008252922_2 544,320 1,331,753 2.4466


©2024 climateprediction.net