Task 17515324

Name	hadam3p_pnw_vnkv_2002_1_009235531_1
Workunit	9348642
Created	29 Nov 2014, 2:04:06 UTC
Sent	29 Nov 2014, 2:14:01 UTC
Report deadline	11 Nov 2015, 7:34:01 UTC
Received	7 Dec 2014, 23:41:29 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1337590
Run time	1 days 14 hours 49 min 19 sec
CPU time	1 days 13 hours 38 min 14 sec
Validate state	Invalid
Credit	757.44
Device peak FLOPS	1.50 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v7.22 i686-pc-linux-gnu
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... 18:23:21 (4872): called boinc_finish 18:23:21 (4873): called boinc_finish Signal 15 received, exiting... 18:23:21 (4873): called boinc_finish Signal 15 received, exiting... 18:23:21 (4872): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... SIGSEGV: segmentation violation Signal 15 received, exiting... Stack trace (18 frames): ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf] [0xf77c2400] /lib/libc.so.6(getenv+0x72)[0x4e821192] /lib/libc.so.6[0x4e89a2fe] /lib/libc.so.6[0x4e89ac0f] /lib/libc.so.6(localtime_r+0x2b)[0x4e898e1b] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80c4306] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80c47b6] [0xf77c2400] [0xf77c2425] /lib/libc.so.6(nanosleep+0x46)[0x4e8a8e16] /lib/libc.so.6(usleep+0x3d)[0x4e8deaed] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80da8e0] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8050f76] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8051aa9] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8051d7b] /lib/libc.so.6(__libc_start_main+0xf3)[0x4e809963] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331] Exiting... Signal 15 received, exiting... Signal 15 received, exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (20 frames): ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf] [0xf77c7400] /lib/libc.so.6(getenv+0x72)[0x4e821192] /lib/libc.so.6[0x4e89a2fe] /lib/libc.so.6[0x4e89ac0f] /lib/libc.so.6(localtime_r+0x2b)[0x4e898e1b] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80c4306] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80c47b6] [0xf77c7400] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80c46a0] [0xf77c7400] [0xf77c7425] /lib/libc.so.6(nanosleep+0x46)[0x4e8a8e16] /lib/libc.so.6(usleep+0x3d)[0x4e8deaed] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80da8e0] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8050f76] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8051aa9] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8051d7b] /lib/libc.so.6(__libc_start_main+0xf3)[0x4e809963] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331] Exiting... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (18 frames): ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf] [0xf7756400] /lib/libc.so.6(getenv+0x72)[0x4e821192] /lib/libc.so.6[0x4e89a2fe] /lib/libc.so.6[0x4e89ac0f] /lib/libc.so.6(localtime_r+0x2b)[0x4e898e1b] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80c4306] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80c47b6] [0xf7756400] [0xf7756425] /lib/libc.so.6(nanosleep+0x46)[0x4e8a8e16] /lib/libc.so.6(usleep+0x3d)[0x4e8deaed] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80da8e0] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8050f76] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8051aa9] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8051d7b] /lib/libc.so.6(__libc_start_main+0xf3)[0x4e809963] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331] Exiting... Signal 15 received, exiting... Signal 15 received, exiting... 17:33:10 (2378): called boinc_finish Signal 15 received, exiting... 17:33:10 (2378): called boinc_finish Signal 15 received, exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (18 frames): ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf] [0xf7771400] /lib/libc.so.6(getenv+0x72)[0x4e821192] /lib/libc.so.6[0x4e89a2fe] /lib/libc.so.6[0x4e89ac0f] /lib/libc.so.6(localtime_r+0x2b)[0x4e898e1b] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80c4306] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80c47b6] [0xf7771400] [0xf7771425] /lib/libc.so.6(nanosleep+0x46)[0x4e8a8e16] /lib/libc.so.6(usleep+0x3d)[0x4e8deaed] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80da8e0] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8050f76] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8051aa9] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8051d7b] /lib/libc.so.6(__libc_start_main+0xf3)[0x4e809963] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... Signal 15 received, exiting... 17:44:05 (13899): called boinc_finish 17:44:05 (13900): called boinc_finish 17:44:05 (13899): called boinc_finish Signal 15 received, exiting... 17:44:05 (13900): called boinc_finish Signal 15 received, exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (18 frames): ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf] [0xf7702400] /lib/libc.so.6(getenv+0x72)[0x4e821192] /lib/libc.so.6[0x4e89a2fe] /lib/libc.so.6[0x4e89ac0f] /lib/libc.so.6(localtime_r+0x2b)[0x4e898e1b] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80c4306] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80c47b6] [0xf7702400] [0xf7702425] /lib/libc.so.6(nanosleep+0x46)[0x4e8a8e16] /lib/libc.so.6(usleep+0x3d)[0x4e8deaed] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80da8e0] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8050f76] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8051aa9] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8051d7b] /lib/libc.so.6(__libc_start_main+0xf3)[0x4e809963] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331] Exiting... Signal 15 received, exiting... Signal 15 received, exiting... 21:13:17 (2124): called boinc_finish Signal 15 received, exiting... 21:13:17 (2124): called boinc_finish Signal 15 received, exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (18 frames): ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf] [0xf77d2400] /lib/libc.so.6(getenv+0x72)[0x4e821192] /lib/libc.so.6[0x4e89a2fe] /lib/libc.so.6[0x4e89ac0f] /lib/libc.so.6(localtime_r+0x2b)[0x4e898e1b] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80c4306] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80c47b6] [0xf77d2400] [0xf77d2425] /lib/libc.so.6(nanosleep+0x46)[0x4e8a8e16] /lib/libc.so.6(usleep+0x3d)[0x4e8deaed] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80da8e0] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8050f76] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8051aa9] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8051d7b] /lib/libc.so.6(__libc_start_main+0xf3)[0x4e809963] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331] Exiting... Signal 15 received, exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (18 frames): ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf] [0xf77cc400] /lib/libc.so.6(getenv+0x72)[0x4e821192] /lib/libc.so.6[0x4e89a2fe] /lib/libc.so.6[0x4e89ac0f] /lib/libc.so.6(localtime_r+0x2b)[0x4e898e1b] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80c4306] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80c47b6] [0xf77cc400] [0xf77cc425] /lib/libc.so.6(nanosleep+0x46)[0x4e8a8e16] /lib/libc.so.6(usleep+0x3d)[0x4e8deaed] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80da8e0] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8050f76] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8051aa9] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8051d7b] /lib/libc.so.6(__libc_start_main+0xf3)[0x4e809963] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331] Exiting... Signal 15 received, exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (18 frames): ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf] [0xf776dcb0] /lib/libc.so.6(getenv+0x72)[0xf74193f2] /lib/libc.so.6(+0xaa43e)[0xf749243e] /lib/libc.so.6(+0xaad4f)[0xf7492d4f] /lib/libc.so.6(localtime_r+0x2b)[0xf7490f5b] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80c4306] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80c47b6] [0xf776dcb0] [0xf776dcd5] /lib/libc.so.6(nanosleep+0x46)[0xf74a0ff6] /lib/libc.so.6(usleep+0x3d)[0xf74d68ed] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x80da8e0] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8050f76] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8051aa9] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8051d7b] /lib/libc.so.6(__libc_start_main+0xf3)[0xf7401b73] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331] Exiting... Signal 3 received, exiting... SIGSEGV: segmentation violation 22:24:25 (2102): called boinc_finish Stack trace (7 frames): ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf] [0xf77cccb0] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x804d6bf] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x805134f] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu[0x8051d7b] /lib/libc.so.6(__libc_start_main+0xf3)[0xf7461b73] ../../projects/climateprediction.net/hadam3p_pnw_7.22_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Dec 2014 16:26:57	1337590	17515324	hadam3p_pnw_vnkv_2002_1_009235531_1	34,859	122,410	3.5116
02 Dec 2014 15:05:10	1337590	17515324	hadam3p_pnw_vnkv_2002_1_009235531_1	23,339	81,149	3.4770
02 Dec 2014 03:28:50	1337590	17515324	hadam3p_pnw_vnkv_2002_1_009235531_1	11,819	40,328	3.4121