Task 13539591

Name	hadcm3n_yg3y_1900_40_007516957_0
Workunit	7714432
Created	28 Oct 2011, 12:49:54 UTC
Sent	22 Nov 2011, 9:43:52 UTC
Report deadline	21 Feb 2012, 17:11:03 UTC
Received	29 Dec 2011, 16:52:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1086997
Run time	6 days 5 hours 50 min 29 sec
CPU time	5 days 8 hours 0 min 1 sec
Validate state	Invalid
Credit	4,976.64
Device peak FLOPS	3.34 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/yg3yko.pja8c10 is not a valid UM file. Error converting file to netcdf: dataout/yg3yko.pja8c10 Error: Input file: dataout/yg3yko.pia8c10 is not a valid UM file. Error converting file to netcdf: dataout/yg3yko.pia8c10 Error: Input file: dataout/yg3yko.pfa8c10 is not a valid UM file. Error converting file to netcdf: dataout/yg3yko.pfa8c10 Error: Input file: dataout/yg3yka.pha8c10 is not a valid UM file. Error converting file to netcdf: dataout/yg3yka.pha8c10 Error: Input file: dataout/yg3yka.pga8c10 is not a valid UM file. Error converting file to netcdf: dataout/yg3yka.pga8c10 Error: Input file: dataout/yg3yka.pea8c10 is not a valid UM file. Error converting file to netcdf: dataout/yg3yka.pea8c10 Error: Input file: dataout/yg3yka.pda8c10 is not a valid UM file. Error converting file to netcdf: dataout/yg3yka.pda8c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=35919, selfPID=35919, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Dec 2011 09:59:16	1086997	13539591	hadcm3n_yg3y_1900_40_007516957_0	414,720	485,377	1.1704
28 Dec 2011 22:30:42	1086997	13539591	hadcm3n_yg3y_1900_40_007516957_0	388,800	455,391	1.1713
28 Dec 2011 13:00:43	1086997	13539591	hadcm3n_yg3y_1900_40_007516957_0	362,880	425,126	1.1715
28 Dec 2011 00:47:52	1086997	13539591	hadcm3n_yg3y_1900_40_007516957_0	336,960	395,028	1.1723
27 Dec 2011 13:13:32	1086997	13539591	hadcm3n_yg3y_1900_40_007516957_0	311,040	364,226	1.1710
27 Dec 2011 03:31:17	1086997	13539591	hadcm3n_yg3y_1900_40_007516957_0	285,120	333,767	1.1706
26 Dec 2011 18:56:22	1086997	13539591	hadcm3n_yg3y_1900_40_007516957_0	259,200	303,738	1.1718
26 Dec 2011 07:39:54	1086997	13539591	hadcm3n_yg3y_1900_40_007516957_0	233,280	274,020	1.1746
25 Dec 2011 12:44:43	1086997	13539591	hadcm3n_yg3y_1900_40_007516957_0	207,360	243,728	1.1754
24 Dec 2011 18:46:33	1086997	13539591	hadcm3n_yg3y_1900_40_007516957_0	181,440	213,081	1.1744
23 Dec 2011 22:42:56	1086997	13539591	hadcm3n_yg3y_1900_40_007516957_0	155,520	182,693	1.1747
22 Dec 2011 02:26:33	1086997	13539591	hadcm3n_yg3y_1900_40_007516957_0	129,600	152,687	1.1781
20 Dec 2011 02:36:23	1086997	13539591	hadcm3n_yg3y_1900_40_007516957_0	103,680	122,498	1.1815
17 Dec 2011 13:04:48	1086997	13539591	hadcm3n_yg3y_1900_40_007516957_0	77,760	92,218	1.1859
15 Dec 2011 18:30:26	1086997	13539591	hadcm3n_yg3y_1900_40_007516957_0	51,840	61,595	1.1882
23 Nov 2011 06:22:07	1086997	13539591	hadcm3n_yg3y_1900_40_007516957_0	25,920	30,751	1.1864