Task 13382193

Name	hadcm3n_t0hv_1940_40_007454783_2
Workunit	7652286
Created	13 Sep 2011, 0:39:02 UTC
Sent	13 Sep 2011, 0:41:24 UTC
Report deadline	13 Dec 2011, 8:08:35 UTC
Received	21 Sep 2011, 7:32:59 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1163023
Run time	5 days 19 hours 2 min 5 sec
CPU time	1 days 12 hours 13 min 8 sec
Validate state	Invalid
Credit	4,665.60
Device peak FLOPS	3.29 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SETPOS: Seek Failed: No space left on device SETPOS: Unit 22 to Word Address 3006464 Failed with Error Code -1 Model crashed: SETPOS: Unit 22 to Word Address 3006464 Failed with Error Code -1 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 SETPOS: Seek Failed: No space left on device SETPOS: Unit 22 to Word Address 169984 Failed with Error Code -1 Model crashed: SETPOS: Unit 22 to Word Address 169984 Failed with Error Code -1 SETPOS: Seek Failed: No space left on device SETPOS: Unit 22 to Word Address 169984 Failed with Error Code -1 Model crashed: SETPOS: Unit 22 to Word Address 169984 Failed with Error Code -1 Suspended CPDN Monitor - Suspend request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /home/connor/Programmes/BOINC/projects/climateprediction.net/hadcm3n_t0hv_1940_40_007454783/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 084554BF Unknown Unknown Unknown hadcm3n_um_6.07_i 083759F6 Unknown Unknown Unknown hadcm3n_um_6.07_i 0839982E Unknown Unknown Unknown hadcm3n_um_6.07_i 0838F8B7 Unknown Unknown Unknown hadcm3n_um_6.07_i 0839BDF8 Unknown Unknown Unknown libc.so.6 F75DDE46 Unknown Unknown Unknown hadcm3n_um_6.07_i 0804CB11 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3821, iMonCtr=1 Model crash detected, will try to restart... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Sep 2011 02:27:37	1163023	13382193	hadcm3n_t0hv_1940_40_007454783_2	388,800	140,673	0.3618
19 Sep 2011 10:04:07	1163023	13382193	hadcm3n_t0hv_1940_40_007454783_2	362,880	173,989	0.4795
19 Sep 2011 02:03:45	1163023	13382193	hadcm3n_t0hv_1940_40_007454783_2	336,960	143,566	0.4261
18 Sep 2011 17:31:35	1163023	13382193	hadcm3n_t0hv_1940_40_007454783_2	311,040	257,591	0.8282
18 Sep 2011 07:50:49	1163023	13382193	hadcm3n_t0hv_1940_40_007454783_2	285,120	226,479	0.7943
17 Sep 2011 22:58:32	1163023	13382193	hadcm3n_t0hv_1940_40_007454783_2	259,200	195,428	0.7540
17 Sep 2011 13:57:55	1163023	13382193	hadcm3n_t0hv_1940_40_007454783_2	233,280	164,351	0.7045
17 Sep 2011 04:53:27	1163023	13382193	hadcm3n_t0hv_1940_40_007454783_2	207,360	133,344	0.6431
16 Sep 2011 15:43:46	1163023	13382193	hadcm3n_t0hv_1940_40_007454783_2	181,440	102,455	0.5647
16 Sep 2011 07:19:40	1163023	13382193	hadcm3n_t0hv_1940_40_007454783_2	155,520	75,439	0.4851
15 Sep 2011 22:28:29	1163023	13382193	hadcm3n_t0hv_1940_40_007454783_2	129,600	154,755	1.1941
15 Sep 2011 13:43:23	1163023	13382193	hadcm3n_t0hv_1940_40_007454783_2	103,680	123,887	1.1949
15 Sep 2011 04:54:09	1163023	13382193	hadcm3n_t0hv_1940_40_007454783_2	77,760	93,010	1.1961
14 Sep 2011 12:34:13	1163023	13382193	hadcm3n_t0hv_1940_40_007454783_2	51,840	62,074	1.1974
14 Sep 2011 03:38:25	1163023	13382193	hadcm3n_t0hv_1940_40_007454783_2	25,920	31,158	1.2021