Task 12732984

Name	hadcm3n_o0fx_1900_40_007195904_0
Workunit	7394184
Created	28 Mar 2011, 13:56:58 UTC
Sent	3 Apr 2011, 2:20:24 UTC
Report deadline	3 Jul 2011, 9:47:35 UTC
Received	7 Apr 2011, 21:08:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	156527
Run time	3 days 8 hours 45 min 38 sec
CPU time	2 days 1 hours 39 min 31 sec
Validate state	Invalid
Credit	1,244.16
Device peak FLOPS	1.96 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:06:20 (3443): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:06:21 (3443): No heartbeat from core client for 30 sec - exiting 18:06:22 (3443): No heartbeat from core client for 30 sec - exiting 18:06:23 (3443): No heartbeat from core client for 30 sec - exiting 18:06:24 (3443): No heartbeat from core client for 30 sec - exiting 18:06:25 (3443): No heartbeat from core client for 30 sec - exiting 18:06:26 (3443): No heartbeat from core client for 30 sec - exiting 18:06:27 (3443): No heartbeat from core client for 30 sec - exiting 18:06:28 (3443): No heartbeat from core client for 30 sec - exiting 18:06:29 (3443): No heartbeat from core client for 30 sec - exiting 18:06:30 (3443): No heartbeat from core client for 30 sec - exiting 18:06:31 (3443): No heartbeat from core client for 30 sec - exiting 18:06:32 (3443): No heartbeat from core client for 30 sec - exiting 18:06:33 (3443): No heartbeat from core client for 30 sec - exiting 18:06:34 (3443): No heartbeat from core client for 30 sec - exiting 18:06:35 (3443): No heartbeat from core client for 30 sec - exiting 18:06:36 (3443): No heartbeat from core client for 30 sec - exiting 18:06:37 (3443): No heartbeat from core client for 30 sec - exiting 18:06:38 (3443): No heartbeat from core client for 30 sec - exiting 18:06:39 (3443): No heartbeat from core client for 30 sec - exiting 18:06:40 (3443): No heartbeat from core client for 30 sec - exiting 18:06:41 (3443): No heartbeat from core client for 30 sec - exiting 18:06:42 (3443): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Apr 2011 06:02:36	156527	12732984	hadcm3n_o0fx_1900_40_007195904_0	103,680	227,108	2.1905
06 Apr 2011 13:30:24	156527	12732984	hadcm3n_o0fx_1900_40_007195904_0	77,760	169,301	2.1772
05 Apr 2011 21:14:45	156527	12732984	hadcm3n_o0fx_1900_40_007195904_0	51,840	111,587	2.1525
05 Apr 2011 04:51:42	156527	12732984	hadcm3n_o0fx_1900_40_007195904_0	25,920	53,408	2.0605