climateprediction.net home page
Task 14284834

Task 14284834

Name hadcm3n_yk8x_1980_40_007832334_4
Workunit 7987446
Created 18 Mar 2012, 20:22:19 UTC
Sent 18 Mar 2012, 20:22:45 UTC
Report deadline 18 Jun 2012, 3:49:56 UTC
Received 20 Nov 2012, 9:22:39 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1192940
Run time 18 days 3 hours 26 min 6 sec
CPU time 13 days 16 hours 54 min 5 sec
Validate state Invalid
Credit 6,531.84
Device peak FLOPS 1.69 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.12.42</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:15:52 (8477): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:16:36 (22472): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:17:47 (22480): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:21:35 (22490): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:22:14 (22521): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:23:02 (22528): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:23:54 (22537): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:25:41 (22548): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25311, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16964, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16964, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16964, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16964, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16964, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16964, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16964, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16964, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16964, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16964, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16964, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16964, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16964, iMonCtr=1
Model crash detected, will try to restart...
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
SIGABRT: abort called
Stack trace (23 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xffffe400]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xffffe430]
/lib32/libc.so.6(gsignal+0x51)[0xf74435f1]
/lib32/libc.so.6(abort+0x17e)[0xf7444dce]
/usr/lib/gcc/x86_64-pc-linux-gnu/4.5.4/32/libstdc++.so.6(_ZN9__gnu_cxx27__verbose_terminate_handlerEv+0x155)[0xf768dd25]
/usr/lib/gcc/x86_64-pc-linux-gnu/4.5.4/32/libstdc++.so.6(+0xaac25)[0xf768bc25]
/usr/lib/gcc/x86_64-pc-linux-gnu/4.5.4/32/libstdc++.so.6(+0xaac62)[0xf768bc62]
/usr/lib/gcc/x86_64-pc-linux-gnu/4.5.4/32/libstdc++.so.6(+0xaadd1)[0xf768bdd1]
/usr/lib/gcc/x86_64-pc-linux-gnu/4.5.4/32/libstdc++.so.6(_Znwj+0x87)[0xf768c367]
/usr/lib/gcc/x86_64-pc-linux-gnu/4.5.4/32/libstdc++.so.6(_Znaj+0x1d)[0xf768c43d]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so(_Z8ReadDataRSt14basic_ifstreamIcSt11char_traitsIcEEPiS4_+0x8e)[0xf6f3d91e]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so(_Z11ConvertFileSsSsSsSsi+0x238)[0xf6f38d18]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so(umtonc+0x158)[0xf6f3efc8]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805afab]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805490c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8058324]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f1f4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf742f606]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
19 Nov 2012 12:19:05 1192940 14284834 hadcm3n_yk8x_1980_40_007832334_4 544,320 1,451,777 2.6671
18 Nov 2012 17:31:02 1192940 14284834 hadcm3n_yk8x_1980_40_007832334_4 518,400 1,384,874 2.6714
17 Nov 2012 22:43:21 1192940 14284834 hadcm3n_yk8x_1980_40_007832334_4 492,480 1,317,775 2.6758
17 Nov 2012 03:54:45 1192940 14284834 hadcm3n_yk8x_1980_40_007832334_4 466,560 1,250,949 2.6812
16 Nov 2012 08:55:52 1192940 14284834 hadcm3n_yk8x_1980_40_007832334_4 440,640 1,183,703 2.6863
08 Apr 2012 17:51:26 1192940 14284834 hadcm3n_yk8x_1980_40_007832334_4 414,720 1,115,411 2.6896
05 Apr 2012 23:31:05 1192940 14284834 hadcm3n_yk8x_1980_40_007832334_4 388,800 1,044,188 2.6857
02 Apr 2012 08:22:59 1192940 14284834 hadcm3n_yk8x_1980_40_007832334_4 362,880 972,995 2.6813
01 Apr 2012 12:28:23 1192940 14284834 hadcm3n_yk8x_1980_40_007832334_4 336,960 902,124 2.6772
31 Mar 2012 16:28:20 1192940 14284834 hadcm3n_yk8x_1980_40_007832334_4 311,040 831,760 2.6741
30 Mar 2012 20:30:47 1192940 14284834 hadcm3n_yk8x_1980_40_007832334_4 285,120 761,001 2.6691
30 Mar 2012 00:11:28 1192940 14284834 hadcm3n_yk8x_1980_40_007832334_4 259,200 690,038 2.6622
28 Mar 2012 04:22:45 1192940 14284834 hadcm3n_yk8x_1980_40_007832334_4 233,280 619,255 2.6546
27 Mar 2012 07:02:48 1192940 14284834 hadcm3n_yk8x_1980_40_007832334_4 207,360 566,948 2.7341
26 Mar 2012 09:37:13 1192940 14284834 hadcm3n_yk8x_1980_40_007832334_4 181,440 496,386 2.7358
25 Mar 2012 07:17:59 1192940 14284834 hadcm3n_yk8x_1980_40_007832334_4 155,520 425,020 2.7329
23 Mar 2012 00:16:20 1192940 14284834 hadcm3n_yk8x_1980_40_007832334_4 129,600 354,420 2.7347
22 Mar 2012 04:21:18 1192940 14284834 hadcm3n_yk8x_1980_40_007832334_4 103,680 284,083 2.7400
21 Mar 2012 08:29:26 1192940 14284834 hadcm3n_yk8x_1980_40_007832334_4 77,760 213,057 2.7399
20 Mar 2012 12:32:37 1192940 14284834 hadcm3n_yk8x_1980_40_007832334_4 51,840 141,895 2.7372


©2024 cpdn.org