Task 15400752

Name	hadcm3n_2073_1980_40_008239713_0
Workunit	8394837
Created	26 Oct 2012, 19:19:56 UTC
Sent	26 Oct 2012, 19:20:06 UTC
Report deadline	26 Jan 2013, 2:47:17 UTC
Received	19 Nov 2012, 10:21:59 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1241743
Run time	21 days 7 hours 23 min 6 sec
CPU time	16 days 1 hours 54 min 57 sec
Validate state	Invalid
Credit	10,886.40
Device peak FLOPS	1.18 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Nov 2012 20:16:12	1241743	15400752	hadcm3n_2073_1980_40_008239713_0	907,200	1,422,990	1.5686
18 Nov 2012 05:54:30	1241743	15400752	hadcm3n_2073_1980_40_008239713_0	881,280	1,384,290	1.5708
17 Nov 2012 15:56:21	1241743	15400752	hadcm3n_2073_1980_40_008239713_0	855,360	1,343,440	1.5706
17 Nov 2012 01:49:31	1241743	15400752	hadcm3n_2073_1980_40_008239713_0	829,440	1,302,370	1.5702
16 Nov 2012 12:46:23	1241743	15400752	hadcm3n_2073_1980_40_008239713_0	803,520	1,263,072	1.5719
15 Nov 2012 22:29:13	1241743	15400752	hadcm3n_2073_1980_40_008239713_0	777,600	1,223,271	1.5731
15 Nov 2012 08:59:22	1241743	15400752	hadcm3n_2073_1980_40_008239713_0	751,680	1,182,652	1.5733
14 Nov 2012 18:47:12	1241743	15400752	hadcm3n_2073_1980_40_008239713_0	725,760	1,141,183	1.5724
13 Nov 2012 22:42:35	1241743	15400752	hadcm3n_2073_1980_40_008239713_0	699,840	1,098,795	1.5701
13 Nov 2012 05:38:03	1241743	15400752	hadcm3n_2073_1980_40_008239713_0	673,920	1,056,495	1.5677
12 Nov 2012 15:58:24	1241743	15400752	hadcm3n_2073_1980_40_008239713_0	648,000	1,014,860	1.5661
12 Nov 2012 00:01:18	1241743	15400752	hadcm3n_2073_1980_40_008239713_0	622,080	979,203	1.5741
11 Nov 2012 10:47:51	1241743	15400752	hadcm3n_2073_1980_40_008239713_0	596,160	938,616	1.5744
10 Nov 2012 20:09:31	1241743	15400752	hadcm3n_2073_1980_40_008239713_0	570,240	898,411	1.5755
10 Nov 2012 06:55:40	1241743	15400752	hadcm3n_2073_1980_40_008239713_0	544,320	859,226	1.5785
09 Nov 2012 18:43:13	1241743	15400752	hadcm3n_2073_1980_40_008239713_0	518,400	820,003	1.5818
09 Nov 2012 03:59:43	1241743	15400752	hadcm3n_2073_1980_40_008239713_0	492,480	779,505	1.5828
08 Nov 2012 13:40:21	1241743	15400752	hadcm3n_2073_1980_40_008239713_0	466,560	737,660	1.5811
07 Nov 2012 23:33:12	1241743	15400752	hadcm3n_2073_1980_40_008239713_0	440,640	699,206	1.5868
07 Nov 2012 08:12:34	1241743	15400752	hadcm3n_2073_1980_40_008239713_0	414,720	657,440	1.5853