Task 13636021

Name	hadcm3n_t2q4_1940_40_007544613_2
Workunit	7741845
Created	15 Nov 2011, 20:40:50 UTC
Sent	15 Nov 2011, 20:41:12 UTC
Report deadline	15 Feb 2012, 4:08:23 UTC
Received	5 Jan 2012, 0:07:29 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	890436
Run time	12 days 20 hours 24 min 2 sec
CPU time	11 days 21 hours 2 min 38 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	1.94 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.17</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10939, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10939, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10939, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10939, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10939, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10939, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10939, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10939, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10939, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10939, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10939, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10939, iMonCtr=1 Model crash detected, will try to restart... Signal 1 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (10 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xffffe400] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804e73f] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804e767] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804e921] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8052e29] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050763] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8051127] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xfe)[0xb752fc0e] Exiting... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25301, iMonCtr=1 Model crash detected, will try to restart... 18:20:04 (25301): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xffffe400] [0xffffe424] /lib/libc.so.6(gsignal+0x4f)[0xb74be7af] /lib/libc.so.6(abort+0x180)[0xb74c00f0] /lib/libc.so.6(+0x67f97)[0xb74faf97] /lib/libc.so.6(+0x6dfbb)[0xb7500fbb] /lib/libc.so.6(+0x6ed3b)[0xb7501d3b] /lib/libc.so.6(cfree+0x6d)[0xb7505a9d] /usr/lib/libstdc++.so.6(_ZdlPv+0x1f)[0xb76f898f] /usr/lib/libstdc++.so.6(_ZdaPv+0x1b)[0xb76f89eb] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xfe)[0xb74a9c0e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Jan 2012 00:12:16	890436	13636021	hadcm3n_t2q4_1940_40_007544613_2	518,400	1,026,155	1.9795
03 Jan 2012 23:23:40	890436	13636021	hadcm3n_t2q4_1940_40_007544613_2	492,480	973,095	1.9759
29 Dec 2011 23:32:06	890436	13636021	hadcm3n_t2q4_1940_40_007544613_2	466,560	919,717	1.9713
29 Dec 2011 00:16:26	890436	13636021	hadcm3n_t2q4_1940_40_007544613_2	440,640	866,070	1.9655
20 Dec 2011 23:20:26	890436	13636021	hadcm3n_t2q4_1940_40_007544613_2	414,720	811,780	1.9574
19 Dec 2011 21:39:53	890436	13636021	hadcm3n_t2q4_1940_40_007544613_2	388,800	758,704	1.9514
15 Dec 2011 21:17:02	890436	13636021	hadcm3n_t2q4_1940_40_007544613_2	362,880	705,664	1.9446
14 Dec 2011 00:10:24	890436	13636021	hadcm3n_t2q4_1940_40_007544613_2	336,960	652,416	1.9362
12 Dec 2011 23:57:41	890436	13636021	hadcm3n_t2q4_1940_40_007544613_2	311,040	598,406	1.9239
08 Dec 2011 18:52:53	890436	13636021	hadcm3n_t2q4_1940_40_007544613_2	285,120	585,034	2.0519
07 Dec 2011 21:39:12	890436	13636021	hadcm3n_t2q4_1940_40_007544613_2	259,200	531,690	2.0513
06 Dec 2011 20:56:13	890436	13636021	hadcm3n_t2q4_1940_40_007544613_2	233,280	478,431	2.0509
05 Dec 2011 21:40:50	890436	13636021	hadcm3n_t2q4_1940_40_007544613_2	207,360	425,390	2.0515
01 Dec 2011 20:58:39	890436	13636021	hadcm3n_t2q4_1940_40_007544613_2	181,440	372,492	2.0530
30 Nov 2011 22:06:49	890436	13636021	hadcm3n_t2q4_1940_40_007544613_2	155,520	319,283	2.0530
29 Nov 2011 21:07:44	890436	13636021	hadcm3n_t2q4_1940_40_007544613_2	129,600	266,030	2.0527
28 Nov 2011 21:26:56	890436	13636021	hadcm3n_t2q4_1940_40_007544613_2	103,680	212,987	2.0543
24 Nov 2011 20:36:38	890436	13636021	hadcm3n_t2q4_1940_40_007544613_2	77,760	159,674	2.0534
23 Nov 2011 22:08:25	890436	13636021	hadcm3n_t2q4_1940_40_007544613_2	51,840	106,267	2.0499
22 Nov 2011 20:54:11	890436	13636021	hadcm3n_t2q4_1940_40_007544613_2	25,920	53,090	2.0482