climateprediction.net home page
Task 16200746

Task 16200746

Name hadcm3n_ob36_1900_40_008469493_1
Workunit 8620332
Created 2 Jan 2014, 23:14:09 UTC
Sent 2 Jan 2014, 23:14:17 UTC
Report deadline 4 Apr 2014, 6:41:28 UTC
Received 16 Jan 2014, 7:33:49 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1434483
Run time 13 days 4 hours 51 min 39 sec
CPU time 12 days 15 hours 56 min 54 sec
Validate state Invalid
Credit 12,441.60
Device peak FLOPS 3.88 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
00:33:28 (6636): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:34:40 (7038): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:37:36 (7052): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:42:17 (7068): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:55:36 (7088): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:01:59 (7118): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:04:17 (7144): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:06:13 (7160): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:08:29 (7176): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:10:46 (7192): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:13:08 (7208): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:15:04 (7224): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:17:38 (7240): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:19:34 (7259): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:22:01 (7277): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:24:41 (7293): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:27:07 (7311): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:29:13 (7327): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:31:26 (7343): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:33:41 (7359): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:36:17 (7375): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:38:33 (7391): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:41:01 (7407): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:43:32 (7423): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:45:22 (7439): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:47:29 (7455): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:49:36 (7471): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:51:46 (7489): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:54:04 (7505): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:56:06 (7523): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:57:54 (7539): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:00:23 (7555): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:02:10 (7571): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:04:41 (7587): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:07:02 (7603): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:09:01 (7619): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:10:53 (7635): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:12:39 (7651): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09402298 ***
======= Backtrace: =========
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x70f01)[0xf74d7f01]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x72768)[0xf74d9768]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(cfree+0x6d)[0xf74dc81d]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0xf765a4bf]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xf747de46]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:13 391547                             /home/cpdn/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:13 391547                             /home/cpdn/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
093ac000-09412000 rw-p 00000000 00:00 0                                  [heap]
f6e00000-f6e21000 rw-p 00000000 00:00 0 
f6e21000-f6f00000 ---p 00000000 00:00 0 
f6fe9000-f7464000 rw-s 00000000 08:13 783665                             /home/cpdn/BOINC/slots/4/134105
f7464000-f7467000 rw-p 00000000 00:00 0 
f7467000-f75c3000 r-xp 00000000 08:12 141297                             /lib/i386-linux-gnu/i686/cmov/libc-2.13.so
f75c3000-f75c4000 ---p 0015c000 08:12 141297                             /lib/i386-linux-gnu/i686/cmov/libc-2.13.so
f75c4000-f75c6000 r--p 0015c000 08:12 141297                             /lib/i386-linux-gnu/i686/cmov/libc-2.13.so
f75c6000-f75c7000 rw-p 0015e000 08:12 141297                             /lib/i386-linux-gnu/i686/cmov/libc-2.13.so
f75c7000-f75ca000 rw-p 00000000 00:00 0 
f75ca000-f75e6000 r-xp 00000000 08:12 134703                             /lib/i386-linux-gnu/libgcc_s.so.1
f75e6000-f75e7000 rw-p 0001b000 08:12 134703                             /lib/i386-linux-gnu/libgcc_s.so.1
f75e7000-f760b000 r-xp 00000000 08:12 141294                             /lib/i386-linux-gnu/i686/cmov/libm-2.13.so
f760b000-f760c000 r--p 00023000 08:12 141294                             /lib/i386-linux-gnu/i686/cmov/libm-2.13.so
f760c000-f760d000 rw-p 00024000 08:12 141294                             /lib/i386-linux-gnu/i686/cmov/libm-2.13.so
f760d000-f76ed000 r-xp 00000000 08:12 668972                             /usr/lib/i386-linux-gnu/libstdc++.so.6.0.17
f76ed000-f76f1000 r--p 000e0000 08:12 668972                             /usr/lib/i386-linux-gnu/libstdc++.so.6.0.17
f76f1000-f76f2000 rw-p 000e4000 08:12 668972                             /usr/lib/i386-linux-gnu/libstdc++.so.6.0.17
f76f2000-f76fa000 rw-p 00000000 00:00 0 
f76fa000-f76fc000 r-xp 00000000 08:12 141290                             /lib/i386-linux-gnu/i686/cmov/libdl-2.13.so
f76fc000-f76fd000 r--p 00001000 08:12 141290                             /lib/i386-linux-gnu/i686/cmov/libdl-2.13.so
f76fd000-f76fe000 rw-p 00002000 08:12 141290                             /lib/i386-linux-gnu/i686/cmov/libdl-2.13.so
f76fe000-f7713000 r-xp 00000000 08:12 141287                             /lib/i386-linux-gnu/i686/cmov/libpthread-2.13.so
f7713000-f7714000 r--p 00014000 08:12 141287                             /lib/i386-linux-gnu/i686/cmov/libpthread-2.13.so
f7714000-f7715000 rw-p 00015000 08:12 141287                             /lib/i386-linux-gnu/i686/cmov/libpthread-2.13.so
f7715000-f7717000 rw-p 00000000 00:00 0 
f772a000-f772b000 rw-p 00000000 00:00 0 
f772b000-f772c000 ---p 00000000 00:00 0 
f772c000-f772f000 rw-p 00000000 00:00 0 
f772f000-f7731000 rw-s 00000000 08:13 783662                             /home/cpdn/BOINC/slots/4/boinc_mmap_file
f7731000-f7733000 rw-p 00000000 00:00 0 
f7733000-f7734000 r-xp 00000000 00:00 0                                  [vdso]
f7734000-f7750000 r-xp 00000000 08:12 134723                             /lib/i386-linux-gnu/ld-2.13.so
f7750000-f7751000 r--p 0001b000 08:12 134723                             /lib/i386-linux-gnu/ld-2.13.so
f7751000-f7752000 rw-p 0001c000 08:12 134723                             /lib/i386-linux-gnu/ld-2.13.so
ffb7e000-ffbef000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (17 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7733400]
[0xf7733430]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(gsignal+0x51)[0xf7491941]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(abort+0x182)[0xf7494d72]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x66e15)[0xf74cde15]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x70f01)[0xf74d7f01]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x72768)[0xf74d9768]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(cfree+0x6d)[0xf74dc81d]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0xf765a4bf]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xf747de46]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
16 Jan 2014 07:38:14 1304334 16200746 hadcm3n_ob36_1900_40_008469493_1 1,036,800 1,094,210 1.0554
15 Jan 2014 23:46:18 1304334 16200746 hadcm3n_ob36_1900_40_008469493_1 1,010,880 1,067,118 1.0556
15 Jan 2014 16:27:50 1304334 16200746 hadcm3n_ob36_1900_40_008469493_1 984,960 1,041,334 1.0572
15 Jan 2014 08:38:53 1304334 16200746 hadcm3n_ob36_1900_40_008469493_1 959,040 1,014,046 1.0574
15 Jan 2014 00:46:57 1304334 16200746 hadcm3n_ob36_1900_40_008469493_1 933,120 986,671 1.0574
14 Jan 2014 17:24:43 1304334 16200746 hadcm3n_ob36_1900_40_008469493_1 907,200 959,479 1.0576
14 Jan 2014 09:08:05 1304334 16200746 hadcm3n_ob36_1900_40_008469493_1 881,280 932,258 1.0578
14 Jan 2014 00:41:37 1304334 16200746 hadcm3n_ob36_1900_40_008469493_1 855,360 905,748 1.0589
14 Jan 2014 00:40:50 1304334 16200746 hadcm3n_ob36_1900_40_008469493_1 829,440 878,368 1.0590
13 Jan 2014 08:27:45 1304334 16200746 hadcm3n_ob36_1900_40_008469493_1 803,520 851,021 1.0591
13 Jan 2014 00:26:02 1304334 16200746 hadcm3n_ob36_1900_40_008469493_1 777,600 823,706 1.0593
12 Jan 2014 16:17:47 1304334 16200746 hadcm3n_ob36_1900_40_008469493_1 751,680 796,195 1.0592
12 Jan 2014 08:28:23 1304334 16200746 hadcm3n_ob36_1900_40_008469493_1 725,760 768,739 1.0592
12 Jan 2014 00:31:27 1304334 16200746 hadcm3n_ob36_1900_40_008469493_1 699,840 741,404 1.0594
11 Jan 2014 16:28:19 1304334 16200746 hadcm3n_ob36_1900_40_008469493_1 673,920 713,967 1.0594
11 Jan 2014 08:32:34 1304334 16200746 hadcm3n_ob36_1900_40_008469493_1 648,000 686,694 1.0597
11 Jan 2014 00:44:23 1304334 16200746 hadcm3n_ob36_1900_40_008469493_1 622,080 659,544 1.0602
10 Jan 2014 17:36:55 1304334 16200746 hadcm3n_ob36_1900_40_008469493_1 596,160 632,003 1.0601
10 Jan 2014 08:47:22 1304334 16200746 hadcm3n_ob36_1900_40_008469493_1 570,240 604,575 1.0602
10 Jan 2014 00:44:58 1304334 16200746 hadcm3n_ob36_1900_40_008469493_1 544,320 577,079 1.0602


©2024 climateprediction.net