Task 17354073

Name	hadcm3n_xaam_1940_40_009149636_0
Workunit	9279972
Created	6 Nov 2014, 14:35:20 UTC
Sent	8 Nov 2014, 12:58:59 UTC
Report deadline	7 Feb 2015, 20:26:10 UTC
Received	20 Nov 2014, 23:08:06 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1408374
Run time	2 days 13 hours 34 min 15 sec
CPU time	2 days 8 hours 4 min 14 sec
Validate state	Invalid
Credit	2,488.32
Device peak FLOPS	4.24 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:10:31 (8298): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... SIGABRT: abort called Stack trace (9 frames): /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf77d7c70] [0xf77d7ca0] /lib/i386-linux-gnu/libc.so.6(gsignal+0x47)[0xf75ca577] /lib/i386-linux-gnu/libc.so.6(abort+0x143)[0xf75cbcf3] /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75b5a83] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5700, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf77cac70] [0xf77caca0] /lib/i386-linux-gnu/libc.so.6(gsignal+0x47)[0xf75bd577] /lib/i386-linux-gnu/libc.so.6(abort+0x143)[0xf75becf3] /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75a8a83] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5700, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf76ddc70] [0xf76ddca0] /lib/i386-linux-gnu/libc.so.6(gsignal+0x47)[0xf74d0577] /lib/i386-linux-gnu/libc.so.6(abort+0x143)[0xf74d1cf3] /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf74bba83] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5700, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf7797c70] [0xf7797ca0] /lib/i386-linux-gnu/libc.so.6(gsignal+0x47)[0xf758a577] /lib/i386-linux-gnu/libc.so.6(abort+0x143)[0xf758bcf3] /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf7575a83] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5700, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf774dc70] [0xf774dca0] /lib/i386-linux-gnu/libc.so.6(gsignal+0x47)[0xf7540577] /lib/i386-linux-gnu/libc.so.6(abort+0x143)[0xf7541cf3] /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf752ba83] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5700, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf7707c70] [0xf7707ca0] /lib/i386-linux-gnu/libc.so.6(gsignal+0x47)[0xf74fa577] /lib/i386-linux-gnu/libc.so.6(abort+0x143)[0xf74fbcf3] /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /media/WD600_5_26GB/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf74e5a83] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5700, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Nov 2014 16:14:17	1241544	17354073	hadcm3n_xaam_1940_40_009149636_0	207,360	185,851	0.8963
19 Nov 2014 22:40:54	1241544	17354073	hadcm3n_xaam_1940_40_009149636_0	181,440	161,828	0.8919
13 Nov 2014 21:53:30	1241544	17354073	hadcm3n_xaam_1940_40_009149636_0	155,520	137,530	0.8843
13 Nov 2014 05:50:54	1241544	17354073	hadcm3n_xaam_1940_40_009149636_0	129,600	114,289	0.8819
10 Nov 2014 00:03:03	1241544	17354073	hadcm3n_xaam_1940_40_009149636_0	103,680	91,389	0.8815
09 Nov 2014 11:01:09	1241544	17354073	hadcm3n_xaam_1940_40_009149636_0	77,760	68,639	0.8827
09 Nov 2014 03:15:25	1241544	17354073	hadcm3n_xaam_1940_40_009149636_0	51,840	45,754	0.8826
08 Nov 2014 20:36:51	1241544	17354073	hadcm3n_xaam_1940_40_009149636_0	25,920	22,958	0.8857