Task 13131586

Name	hadcm3n_yldt_1900_40_007360571_2
Workunit	7558001
Created	7 Jul 2011, 19:11:50 UTC
Sent	7 Jul 2011, 19:12:20 UTC
Report deadline	7 Oct 2011, 2:39:31 UTC
Received	22 Jul 2011, 15:56:22 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	982579
Run time	10 days 14 hours 42 min 18 sec
CPU time	8 days 22 hours 50 min 22 sec
Validate state	Invalid
Credit	4,354.56
Device peak FLOPS	2.45 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/yldtko.pja4c10 is not a valid UM file. Error converting file to netcdf: dataout/yldtko.pja4c10 Error: Input file: dataout/yldtko.pia4c10 is not a valid UM file. Error converting file to netcdf: dataout/yldtko.pia4c10 Error: Input file: dataout/yldtko.pfa4c10 is not a valid UM file. Error converting file to netcdf: dataout/yldtko.pfa4c10 Error: Input file: dataout/yldtka.pha4c10 is not a valid UM file. Error converting file to netcdf: dataout/yldtka.pha4c10 Error: Input file: dataout/yldtka.pga4c10 is not a valid UM file. Error converting file to netcdf: dataout/yldtka.pga4c10 Error: Input file: dataout/yldtka.pea4c10 is not a valid UM file. Error converting file to netcdf: dataout/yldtka.pea4c10 Error: Input file: dataout/yldtka.pda4c10 is not a valid UM file. Error converting file to netcdf: dataout/yldtka.pda4c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:08:47 (57053): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 138975) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15577, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 138975) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15577, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 138975) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15577, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 138975) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15577, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 138975) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15577, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 138975) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15577, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2011 18:47:18	982579	13131586	hadcm3n_yldt_1900_40_007360571_2	362,880	729,158	2.0094
25 Jul 2011 17:47:14	982579	13131586	hadcm3n_yldt_1900_40_007360571_2	336,960	677,446	2.0105
25 Jul 2011 16:46:04	982579	13131586	hadcm3n_yldt_1900_40_007360571_2	311,040	626,276	2.0135
25 Jul 2011 16:10:31	982579	13131586	hadcm3n_yldt_1900_40_007360571_2	285,120	575,119	2.0171
25 Jul 2011 15:43:59	982579	13131586	hadcm3n_yldt_1900_40_007360571_2	259,200	523,702	2.0205
25 Jul 2011 14:53:10	982579	13131586	hadcm3n_yldt_1900_40_007360571_2	233,280	471,598	2.0216
25 Jul 2011 14:28:41	982579	13131586	hadcm3n_yldt_1900_40_007360571_2	207,360	420,649	2.0286
25 Jul 2011 14:28:41	982579	13131586	hadcm3n_yldt_1900_40_007360571_2	181,440	368,124	2.0289
25 Jul 2011 14:28:40	982579	13131586	hadcm3n_yldt_1900_40_007360571_2	155,520	315,649	2.0296
25 Jul 2011 14:28:40	982579	13131586	hadcm3n_yldt_1900_40_007360571_2	129,600	263,095	2.0301
25 Jul 2011 14:28:40	982579	13131586	hadcm3n_yldt_1900_40_007360571_2	103,680	209,687	2.0224
10 Jul 2011 13:03:34	982579	13131586	hadcm3n_yldt_1900_40_007360571_2	77,760	156,671	2.0148
09 Jul 2011 21:32:21	982579	13131586	hadcm3n_yldt_1900_40_007360571_2	51,840	104,442	2.0147
08 Jul 2011 23:15:49	982579	13131586	hadcm3n_yldt_1900_40_007360571_2	25,920	52,058	2.0084