Task 12987372

Name	hadcm3n_s19k_1940_40_007298607_0
Workunit	7496031
Created	20 Jun 2011, 14:03:50 UTC
Sent	20 Jun 2011, 14:04:03 UTC
Report deadline	19 Sep 2011, 21:31:14 UTC
Received	29 Jun 2011, 4:39:43 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1480358
Run time	7 days 11 hours 40 min 10 sec
CPU time	1 days 13 hours 43 min 5 sec
Validate state	Invalid
Credit	2,799.36
Device peak FLOPS	1.48 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.12.26</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10269, iMonCtr=1 Signal 15 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (9 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0x36b400] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x35b)[0x804cd43] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804ffc5] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050665] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x723bd6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Jun 2011 01:45:30	1110459	12987372	hadcm3n_s19k_1940_40_007298607_0	233,280	620,910	2.6617
28 Jun 2011 03:25:05	1110459	12987372	hadcm3n_s19k_1940_40_007298607_0	207,360	545,027	2.6284
27 Jun 2011 07:53:32	1110459	12987372	hadcm3n_s19k_1940_40_007298607_0	181,440	477,422	2.6313
26 Jun 2011 10:20:08	1110459	12987372	hadcm3n_s19k_1940_40_007298607_0	155,520	411,138	2.6436
25 Jun 2011 15:00:57	1110459	12987372	hadcm3n_s19k_1940_40_007298607_0	129,600	345,298	2.6643
24 Jun 2011 19:26:09	1110459	12987372	hadcm3n_s19k_1940_40_007298607_0	103,680	280,427	2.7047
24 Jun 2011 00:16:36	1110459	12987372	hadcm3n_s19k_1940_40_007298607_0	77,760	216,793	2.7880
22 Jun 2011 23:38:42	1110459	12987372	hadcm3n_s19k_1940_40_007298607_0	51,840	147,109	2.8378
21 Jun 2011 22:01:39	1110459	12987372	hadcm3n_s19k_1940_40_007298607_0	25,920	76,083	2.9353