Task 15989066

Name	hadcm3n_7xyc_1980_40_008455287_0
Workunit	8606143
Created	30 Aug 2013, 18:21:26 UTC
Sent	14 Sep 2013, 6:08:28 UTC
Report deadline	14 Dec 2013, 13:35:39 UTC
Received	19 Sep 2013, 16:34:58 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1284660
Run time	3 days 7 hours 57 min 30 sec
CPU time	3 days 6 hours 59 min 42 sec
Validate state	Invalid
Credit	2,488.32
Device peak FLOPS	3.40 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/7xycko.pji8c10 is not a valid UM file. Error converting file to netcdf: dataout/7xycko.pji8c10 Error: Input file: dataout/7xycko.pii8c10 is not a valid UM file. Error converting file to netcdf: dataout/7xycko.pii8c10 Error: Input file: dataout/7xycko.pfi8c10 is not a valid UM file. Error converting file to netcdf: dataout/7xycko.pfi8c10 Error: Input file: dataout/7xycka.phi8c10 is not a valid UM file. Error converting file to netcdf: dataout/7xycka.phi8c10 Error: Input file: dataout/7xycka.pgi8c10 is not a valid UM file. Error converting file to netcdf: dataout/7xycka.pgi8c10 Error: Input file: dataout/7xycka.pei8c10 is not a valid UM file. Error converting file to netcdf: dataout/7xycka.pei8c10 Error: Input file: dataout/7xycka.pdi8c10 is not a valid UM file. Error converting file to netcdf: dataout/7xycka.pdi8c10 CPDN Monitor - Quit request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 SETPOS: Seek Failed: No space left on device SETPOS: Unit 22 to Word Address 2359296 Failed with Error Code -1 Model crashed: SETPOS: Unit 22 to Word Address 2359296 Failed with Error Code -1 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_7xyc_1980_40_008455287/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3831, iMonCtr=1 Model crash detected, will try to restart... forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_7xyc_1980_40_008455287/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 084554BF Unknown Unknown Unknown hadcm3n_um_6.07_i 0832327C Unknown Unknown Unknown hadcm3n_um_6.07_i 08198894 Unknown Unknown Unknown hadcm3n_um_6.07_i 08391957 Unknown Unknown Unknown hadcm3n_um_6.07_i 0838F8B7 Unknown Unknown Unknown hadcm3n_um_6.07_i 0839BDF8 Unknown Unknown Unknown libc.so.6 F7575E46 Unknown Unknown Unknown hadcm3n_um_6.07_i 0804CB11 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3831, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Sep 2013 16:36:52	1284660	15989066	hadcm3n_7xyc_1980_40_008455287_0	207,360	271,126	1.3075
19 Sep 2013 16:36:52	1284660	15989066	hadcm3n_7xyc_1980_40_008455287_0	181,440	242,156	1.3346
18 Sep 2013 11:12:31	1284660	15989066	hadcm3n_7xyc_1980_40_008455287_0	155,520	212,607	1.3671
17 Sep 2013 21:34:56	1284660	15989066	hadcm3n_7xyc_1980_40_008455287_0	129,600	179,326	1.3837
16 Sep 2013 01:49:06	1284660	15989066	hadcm3n_7xyc_1980_40_008455287_0	103,680	140,662	1.3567
15 Sep 2013 14:00:36	1284660	15989066	hadcm3n_7xyc_1980_40_008455287_0	77,760	98,770	1.2702
15 Sep 2013 03:57:38	1284660	15989066	hadcm3n_7xyc_1980_40_008455287_0	51,840	65,433	1.2622
14 Sep 2013 17:10:03	1284660	15989066	hadcm3n_7xyc_1980_40_008455287_0	25,920	32,122	1.2393