Task 15625822

Name	hadcm3n_z8wk_1880_40_008252818_3
Workunit	8407942
Created	22 Feb 2013, 23:41:11 UTC
Sent	22 Feb 2013, 23:41:27 UTC
Report deadline	25 May 2013, 7:08:38 UTC
Received	30 Mar 2013, 6:41:04 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1041589
Run time	31 days 4 hours 25 min 20 sec
CPU time	27 days 5 hours 16 min 18 sec
Validate state	Invalid
Credit	9,953.28
Device peak FLOPS	2.33 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... cpdnmonitor: error reading file dataout/ocean_restart.day forrtl: Insufficient system resources exist to complete the requested service. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4060, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4060, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4060, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4060, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4060, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4396, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error ferror - Unit 63 - Return code = 32 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error ferror - Unit 116 - Return code = 32 Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 BUFFIN: C I/O Error ferror - Unit 68 - Return code = 32 BUFFIN: C I/O Error ferror - Unit 69 - Return code = 32 BUFFIN: C I/O Error ferror - Unit 30 - Return code = 32 Model crashed: REPLANCA :I/O ERROR tmp/pipe_dummy 2048 cpdnmonitor: error reading file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_z8wk_1880_40_008252818/dataout/ocean_restart.day BUFFIN: C I/O Error ferror - Unit 41 - Return code = 32 Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/pipe_dummy 2048 cpdnmonitor: error reading file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_z8wk_1880_40_008252818/dataout/ocean_restart.day BUFFIN: C I/O Error ferror - Unit 41 - Return code = 32 Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/pipe_dummy 2048 cpdnmonitor: error reading file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_z8wk_1880_40_008252818/dataout/ocean_restart.day BUFFIN: C I/O Error ferror - Unit 41 - Return code = 32 Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Mar 2013 20:23:14	1041589	15625822	hadcm3n_z8wk_1880_40_008252818_3	829,440	2,437,135	2.9383
29 Mar 2013 06:19:48	1041589	15625822	hadcm3n_z8wk_1880_40_008252818_3	803,520	2,390,598	2.9752
28 Mar 2013 16:11:15	1041589	15625822	hadcm3n_z8wk_1880_40_008252818_3	777,600	2,344,155	3.0146
28 Mar 2013 02:46:39	1041589	15625822	hadcm3n_z8wk_1880_40_008252818_3	751,680	2,298,082	3.0573
27 Mar 2013 13:14:06	1041589	15625822	hadcm3n_z8wk_1880_40_008252818_3	725,760	2,251,698	3.1025
26 Mar 2013 23:22:52	1041589	15625822	hadcm3n_z8wk_1880_40_008252818_3	699,840	2,204,310	3.1497
26 Mar 2013 09:31:25	1041589	15625822	hadcm3n_z8wk_1880_40_008252818_3	673,920	2,157,045	3.2007
25 Mar 2013 20:09:11	1041589	15625822	hadcm3n_z8wk_1880_40_008252818_3	648,000	2,111,190	3.2580
25 Mar 2013 06:36:43	1041589	15625822	hadcm3n_z8wk_1880_40_008252818_3	622,080	2,064,966	3.3195
24 Mar 2013 17:15:58	1041589	15625822	hadcm3n_z8wk_1880_40_008252818_3	596,160	2,019,044	3.3867
24 Mar 2013 03:55:33	1041589	15625822	hadcm3n_z8wk_1880_40_008252818_3	570,240	1,973,075	3.4601
07 Mar 2013 16:35:48	1041589	15625822	hadcm3n_z8wk_1880_40_008252818_3	544,320	964,975	1.7728
07 Mar 2013 02:23:11	1041589	15625822	hadcm3n_z8wk_1880_40_008252818_3	518,400	918,410	1.7716
06 Mar 2013 12:46:39	1041589	15625822	hadcm3n_z8wk_1880_40_008252818_3	492,480	872,007	1.7706
05 Mar 2013 23:13:30	1041589	15625822	hadcm3n_z8wk_1880_40_008252818_3	466,560	825,659	1.7697
05 Mar 2013 08:50:55	1041589	15625822	hadcm3n_z8wk_1880_40_008252818_3	440,640	778,955	1.7678
04 Mar 2013 18:42:58	1041589	15625822	hadcm3n_z8wk_1880_40_008252818_3	414,720	732,374	1.7659
04 Mar 2013 05:07:26	1041589	15625822	hadcm3n_z8wk_1880_40_008252818_3	388,800	686,375	1.7654
03 Mar 2013 15:45:40	1041589	15625822	hadcm3n_z8wk_1880_40_008252818_3	362,880	640,393	1.7648
03 Mar 2013 02:24:21	1041589	15625822	hadcm3n_z8wk_1880_40_008252818_3	336,960	594,462	1.7642