Task 18019527

Name	hadam3pm2_pe5u_1991_10_009528651_1
Workunit	9610394
Created	5 Mar 2015, 22:41:22 UTC
Sent	6 Mar 2015, 4:51:05 UTC
Report deadline	16 Feb 2016, 10:11:05 UTC
Received	23 Mar 2015, 12:49:39 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1355043
Run time	12 days 6 hours 53 min 34 sec
CPU time	11 days 19 hours 55 min 43 sec
Validate state	Invalid
Credit	6,072.64
Device peak FLOPS	2.61 GFLOPS
Application version	UK Met Office HadAM3P (global only) with MOSES II landsurface scheme v7.03 i686-pc-linux-gnu
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /home/gtippitt/BOINC/q2/projects/climateprediction.net/hadam3pm2_pe5u_1991_10_009528651/dataout/stdout_um.txt Image PC Routine Line Source hadam3pm2_um_7.03 0845AB9D Unknown Unknown Unknown hadam3pm2_um_7.03 08459995 Unknown Unknown Unknown hadam3pm2_um_7.03 0842865F Unknown Unknown Unknown hadam3pm2_um_7.03 083E7E1D Unknown Unknown Unknown hadam3pm2_um_7.03 083E7767 Unknown Unknown Unknown hadam3pm2_um_7.03 0841A0BC Unknown Unknown Unknown hadam3pm2_um_7.03 08417BC7 Unknown Unknown Unknown hadam3pm2_um_7.03 080FF819 Unknown Unknown Unknown hadam3pm2_um_7.03 0818B701 Unknown Unknown Unknown hadam3pm2_um_7.03 08194497 Unknown Unknown Unknown hadam3pm2_um_7.03 0831901D Unknown Unknown Unknown hadam3pm2_um_7.03 083205F9 Unknown Unknown Unknown hadam3pm2_um_7.03 0834C82D Unknown Unknown Unknown libc.so.6 F0D76A63 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=20021, iMonCtr=1 Model crash detected, will try to restart... forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /home/gtippitt/BOINC/q2/projects/climateprediction.net/hadam3pm2_pe5u_1991_10_009528651/dataout/stdout_um.txt Image PC Routine Line Source hadam3pm2_um_7.03 0845AB9D Unknown Unknown Unknown hadam3pm2_um_7.03 08459995 Unknown Unknown Unknown hadam3pm2_um_7.03 0842865F Unknown Unknown Unknown hadam3pm2_um_7.03 083E7E1D Unknown Unknown Unknown hadam3pm2_um_7.03 083E7767 Unknown Unknown Unknown hadam3pm2_um_7.03 0841A0BC Unknown Unknown Unknown hadam3pm2_um_7.03 080FF133 Unknown Unknown Unknown hadam3pm2_um_7.03 0818B701 Unknown Unknown Unknown hadam3pm2_um_7.03 08194497 Unknown Unknown Unknown hadam3pm2_um_7.03 0831901D Unknown Unknown Unknown hadam3pm2_um_7.03 083205F9 Unknown Unknown Unknown hadam3pm2_um_7.03 0834C82D Unknown Unknown Unknown libc.so.6 F0CDAA63 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=20021, iMonCtr=1 Model crash detected, will try to restart... forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /home/gtippitt/BOINC/q2/projects/climateprediction.net/hadam3pm2_pe5u_1991_10_009528651/dataout/stdout_um.txt Image PC Routine Line Source hadam3pm2_um_7.03 0845AB9D Unknown Unknown Unknown hadam3pm2_um_7.03 08459995 Unknown Unknown Unknown hadam3pm2_um_7.03 0842865F Unknown Unknown Unknown hadam3pm2_um_7.03 083E7E1D Unknown Unknown Unknown hadam3pm2_um_7.03 083E7767 Unknown Unknown Unknown hadam3pm2_um_7.03 0841A0BC Unknown Unknown Unknown hadam3pm2_um_7.03 08417BC7 Unknown Unknown Unknown hadam3pm2_um_7.03 080FF819 Unknown Unknown Unknown hadam3pm2_um_7.03 0818B701 Unknown Unknown Unknown hadam3pm2_um_7.03 08194497 Unknown Unknown Unknown hadam3pm2_um_7.03 0831901D Unknown Unknown Unknown hadam3pm2_um_7.03 083205F9 Unknown Unknown Unknown hadam3pm2_um_7.03 0834C82D Unknown Unknown Unknown libc.so.6 F0D28A63 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=20021, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( 08:15:31 (20021): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Mar 2015 10:49:08	1355043	18019527	hadam3pm2_pe5u_1991_10_009528651_1	210,308	1,041,816	4.9538
21 Mar 2015 12:16:51	1355043	18019527	hadam3pm2_pe5u_1991_10_009528651_1	181,508	888,252	4.8937
21 Mar 2015 08:51:05	1355043	18019527	hadam3pm2_pe5u_1991_10_009528651_1	178,628	876,005	4.9041
21 Mar 2015 05:09:49	1355043	18019527	hadam3pm2_pe5u_1991_10_009528651_1	175,748	862,939	4.9101
16 Mar 2015 17:45:44	1355043	18019527	hadam3pm2_pe5u_1991_10_009528651_1	112,388	552,047	4.9120
16 Mar 2015 13:54:44	1355043	18019527	hadam3pm2_pe5u_1991_10_009528651_1	109,508	538,438	4.9169
16 Mar 2015 10:28:47	1355043	18019527	hadam3pm2_pe5u_1991_10_009528651_1	106,628	526,264	4.9355
14 Mar 2015 12:58:26	1355043	18019527	hadam3pm2_pe5u_1991_10_009528651_1	77,828	379,008	4.8698
14 Mar 2015 09:07:09	1355043	18019527	hadam3pm2_pe5u_1991_10_009528651_1	74,948	365,376	4.8751
14 Mar 2015 05:09:20	1355043	18019527	hadam3pm2_pe5u_1991_10_009528651_1	72,068	349,994	4.8564
11 Mar 2015 16:39:28	1355043	18019527	hadam3pm2_pe5u_1991_10_009528651_1	37,508	171,564	4.5741
10 Mar 2015 16:33:14	1355043	18019527	hadam3pm2_pe5u_1991_10_009528651_1	5,828	27,704	4.7536
10 Mar 2015 16:32:53	1355043	18019527	hadam3pm2_pe5u_1991_10_009528651_1	2,948	13,837	4.6937