Task 11881674

Name	famous_v3pd_1999_200_006690567_6
Workunit	6893820
Created	11 Sep 2010, 16:24:50 UTC
Sent	11 Sep 2010, 16:30:58 UTC
Report deadline	11 Dec 2010, 23:58:09 UTC
Received	3 Dec 2010, 10:32:33 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1066926
Run time	5 days 7 hours 1 min 39 sec
CPU time	4 days 11 hours 35 min 4 sec
Validate state	Invalid
Credit	3,242.66
Device peak FLOPS	2.31 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-apple-darwin
Stderr	<core_client_version>6.10.21</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... (15624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (15624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... no start tag in app init data (5041): Can't parse init data file - running in standalone mode no start tag in app init data (5041): Can't parse init data file - running in standalone mode Could not change to project directory (5041): called boinc_finish CPDN Monitor - Quit request from BOINC... OPEN: File Creation Failed: No space left on device OPEN: Unable to Open File dataout/v3pdlo#pi000002106c1+ for Read/Write Model crashed: PPCTL : Error opening new PPfile tmp/pipe_dummy Error: Output file: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v3pd_1999_200_006690567/dataout/v3pdlo#pj000002105c1+.nc already exists or could not be opened. Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v3pd_1999_200_006690567/dataout/v3pdlo#pj000002105c1+ MainError: 07:49:09 PM No files match the supplied pattern. MainError: 07:49:10 PM No files match the supplied pattern. zip I/O error: No space left on device zip error: Could not create output file (trickle_famous_v3pd_1999_200_006690567_6_2105.zip) no start tag in app init data (5279): Can't parse init data file - running in standalone mode no start tag in app init data (6433): Can't parse init data file - running in standalone mode forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v3pd_1999_200_006690567/dataout/stdout_um.txt Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5279, iMonCtr=1 Model crash detected, will try to restart... no start tag in app init data (5279): Can't parse init data file - running in standalone mode no start tag in app init data (6434): Can't parse init data file - running in standalone mode forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v3pd_1999_200_006690567/dataout/stdout_um.txt Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5279, iMonCtr=1 Model crash detected, will try to restart... no start tag in app init data (5279): Can't parse init data file - running in standalone mode no start tag in app init data (6435): Can't parse init data file - running in standalone mode forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v3pd_1999_200_006690567/dataout/stdout_um.txt Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5279, iMonCtr=1 Model crash detected, will try to restart... no start tag in app init data (5279): Can't parse init data file - running in standalone mode no start tag in app init data (6436): Can't parse init data file - running in standalone mode forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /Library/Application Support/BOINC Data/prCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (14464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (14464): No heartbeat from core client for 30 sec - exiting (14464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( (140): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Oct 2010 19:12:07	1066926	11881674	famous_v3pd_1999_200_006690567_6	982,826	212,757	0.2165
21 Oct 2010 18:26:27	1066926	11881674	famous_v3pd_1999_200_006690567_6	973,466	210,650	0.2164
21 Oct 2010 18:05:59	1066926	11881674	famous_v3pd_1999_200_006690567_6	964,106	208,720	0.2165
21 Oct 2010 18:05:59	1066926	11881674	famous_v3pd_1999_200_006690567_6	954,746	206,673	0.2165
17 Oct 2010 20:45:01	1066926	11881674	famous_v3pd_1999_200_006690567_6	945,386	204,603	0.2164
17 Oct 2010 20:09:27	1066926	11881674	famous_v3pd_1999_200_006690567_6	936,026	202,690	0.2165
17 Oct 2010 19:33:57	1066926	11881674	famous_v3pd_1999_200_006690567_6	926,666	200,789	0.2167
17 Oct 2010 18:58:23	1066926	11881674	famous_v3pd_1999_200_006690567_6	917,306	198,892	0.2168
17 Oct 2010 18:27:54	1066926	11881674	famous_v3pd_1999_200_006690567_6	907,946	197,000	0.2170
17 Oct 2010 16:56:26	1066926	11881674	famous_v3pd_1999_200_006690567_6	898,586	195,091	0.2171
17 Oct 2010 16:20:51	1066926	11881674	famous_v3pd_1999_200_006690567_6	889,226	193,202	0.2173
17 Oct 2010 15:45:05	1066926	11881674	famous_v3pd_1999_200_006690567_6	879,866	191,232	0.2173
17 Oct 2010 14:27:41	1066926	11881674	famous_v3pd_1999_200_006690567_6	870,506	189,156	0.2173
17 Oct 2010 13:53:28	1066926	11881674	famous_v3pd_1999_200_006690567_6	861,146	187,193	0.2174
17 Oct 2010 13:20:33	1066926	11881674	famous_v3pd_1999_200_006690567_6	851,786	185,306	0.2175
17 Oct 2010 11:42:35	1066926	11881674	famous_v3pd_1999_200_006690567_6	842,426	183,370	0.2177
17 Oct 2010 11:03:14	1066926	11881674	famous_v3pd_1999_200_006690567_6	833,066	181,359	0.2177
17 Oct 2010 10:27:33	1066926	11881674	famous_v3pd_1999_200_006690567_6	823,706	179,403	0.2178
17 Oct 2010 09:46:49	1066926	11881674	famous_v3pd_1999_200_006690567_6	814,346	177,464	0.2179
17 Oct 2010 09:46:49	1066926	11881674	famous_v3pd_1999_200_006690567_6	804,986	175,531	0.2181