Task 18679582

Name	hadam3prm3pm2t_eu_llp1_2002_1_010011149_0
Workunit	10010554
Created	7 Jul 2015, 14:36:19 UTC
Sent	12 Jul 2015, 16:29:06 UTC
Report deadline	23 Jun 2016, 21:49:06 UTC
Received	14 Aug 2015, 13:51:53 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	14 (0x0000000E) Unknown error code
Computer ID	1328334
Run time	15 days 12 hours 52 min 17 sec
CPU time	12 days 17 hours 58 min 14 sec
Validate state	Invalid
Credit	7,174.84
Device peak FLOPS	1.96 GFLOPS
Application version	UK Met Office HadAM3P and HadRM3P model with MOSES II and TRIFFID Europe v7.01 i686-pc-linux-gnu
Stderr	<core_client_version>6.12.43</core_client_version> <![CDATA[ <message> process exited with code 14 (0xe, -242) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 22:16:33 (6063): No heartbeat from client for 30 sec - exiting 22:16:46 (6063): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... 22:36:08 (7751): called boinc_finish Signal 15 received, exiting... SIGSEGV: segmentation violation SIGSEGV: segmentation violation Stack trace (16 frames): ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7720400] /lib/libc.so.6(getenv+0x72)[0xf74059a2] /lib/libc.so.6(+0xa7d6e)[0xf747cd6e] /lib/libc.so.6(+0xa80bf)[0xf747d0bf] /lib/libc.so.6(localtime_r+0x2b)[0xf747b77b] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7720400] linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7720430] /lib/libc.so.6(nanosleep+0x46)[0xf748ad46] /lib/libc.so.6(usleep+0x3d)[0xf74bb5dd] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884] /lib/libpthread.so.0(+0x707a)[0xf76e207a] /lib/libc.so.6(clone+0x5e)[0xf74c2a4e] Exiting... 22:39:42 (2340): No heartbeat from client for 30 sec - exiting 22:39:42 (2340): timer handler: client dead, exiting 22:39:43 (2340): No heartbeat from client for 30 sec - exiting 22:39:43 (2340): timer handler: client dead, exiting 22:39:44 (2340): No heartbeat from client for 30 sec - exiting 22:39:44 (2340): timer handler: client dead, exiting 22:39:45 (2340): No heartbeat from client for 30 sec - exiting 22:39:45 (2340): timer handler: client dead, exiting 22:39:46 (2340): No heartbeat from client for 30 sec - exiting 22:39:46 (2340): timer handler: client dead, exiting 22:39:47 (2340): No heartbeat from client for 30 sec - exiting 22:39:47 (2340): timer handler: client dead, exiting 22:39:48 (2340): No heartbeat from client for 30 sec - exiting 22:39:48 (2340): timer handler: client dead, exiting 22:39:49 (2340): No heartbeat from client for 30 sec - exiting 22:39:49 (2340): timer handler: client dead, exiting 22:39:50 (2340): No heartbeat from client for 30 sec - exiting 22:39:50 (2340): timer handler: client dead, exiting 22:39:51 (2340): No heartbeat from client for 30 sec - exiting 22:39:51 (2340): timer handler: client dead, exiting 22:39:52 (2340): No heartbeat from client for 30 sec - exiting 22:39:52 (2340): timer handler: client dead, exiting 22:39:53 (2340): No heartbeat from client for 30 sec - exiting 22:39:57 (2340): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:29:06 (2576): No heartbeat from client for 30 sec - exiting 19:29:18 (2576): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:29:10 (6375): No heartbeat from client for 30 sec - exiting 01:29:41 (6375): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:31:30 (9999): No heartbeat from client for 30 sec - exiting 01:31:32 (9999): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf773d400] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f7d] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79] /lib/libc.so.6(__libc_start_main+0xf3)[0xf740b9d3] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 forrtl: No space left on device forrtl: severe (38): error during write, unit 0, file /var/lib/boinc/projects/climateprediction.net/hadam3prm3pm2t_eu_llp1_2002_1_010011149/dataout/xacxf.err Image PC Routine Line Source hadrm3p_eu_um_7.0 083EFBED Unknown Unknown Unknown hadrm3p_eu_um_7.0 083EE9E5 Unknown Unknown Unknown hadrm3p_eu_um_7.0 083BF43F Unknown Unknown Unknown hadrm3p_eu_um_7.0 0837B5AD Unknown Unknown Unknown hadrm3p_eu_um_7.0 0837AEF7 Unknown Unknown Unknown hadrm3p_eu_um_7.0 083B552F Unknown Unknown Unknown hadrm3p_eu_um_7.0 083B1F69 Unknown Unknown Unknown hadrm3p_eu_um_7.0 082E99E8 Unknown Unknown Unknown hadrm3p_eu_um_7.0 082EC662 Unknown Unknown Unknown libc.so.6 2A8399D3 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2433, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2461, iMonCtr=2 Leaving CPDN_Main::Monitor... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Aug 2015 13:35:41	1328334	18679582	hadam3prm3pm2t_eu_llp1_2002_1_010011149_0	103,979	1,036,570	9.9690
08 Aug 2015 20:09:36	1328334	18679582	hadam3prm3pm2t_eu_llp1_2002_1_010011149_0	92,459	925,105	10.0056
06 Aug 2015 08:06:56	1328334	18679582	hadam3prm3pm2t_eu_llp1_2002_1_010011149_0	80,939	812,240	10.0352
03 Aug 2015 13:16:38	1328334	18679582	hadam3prm3pm2t_eu_llp1_2002_1_010011149_0	69,419	696,654	10.0355
31 Jul 2015 13:00:48	1328334	18679582	hadam3prm3pm2t_eu_llp1_2002_1_010011149_0	57,899	581,507	10.0435
27 Jul 2015 20:45:48	1328334	18679582	hadam3prm3pm2t_eu_llp1_2002_1_010011149_0	46,379	465,199	10.0304
22 Jul 2015 15:05:39	1328334	18679582	hadam3prm3pm2t_eu_llp1_2002_1_010011149_0	34,859	349,556	10.0277
20 Jul 2015 17:19:01	1328334	18679582	hadam3prm3pm2t_eu_llp1_2002_1_010011149_0	23,339	235,193	10.0773
16 Jul 2015 13:55:09	1328334	18679582	hadam3prm3pm2t_eu_llp1_2002_1_010011149_0	11,819	116,577	9.8635