Task 16041663

Name	hadcm3n_oc8e_1900_40_008470977_0
Workunit	8621816
Created	27 Sep 2013, 10:01:42 UTC
Sent	1 Oct 2013, 11:50:23 UTC
Report deadline	31 Dec 2013, 19:17:34 UTC
Received	7 Oct 2013, 16:24:08 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1275614
Run time	5 days 20 hours 55 min 27 sec
CPU time	3 days 20 hours 8 min 21 sec
Validate state	Invalid
Credit	5,909.76
Device peak FLOPS	3.79 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy 2048 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 4 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8256, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Signal 4 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8256, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Signal 4 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8256, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Signal 4 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8256, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Signal 4 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8256, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Signal 4 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8256, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Oct 2013 15:10:44	1275614	16041663	hadcm3n_oc8e_1900_40_008470977_0	492,480	457,234	0.9284
07 Oct 2013 07:29:20	1275614	16041663	hadcm3n_oc8e_1900_40_008470977_0	466,560	430,190	0.9220
06 Oct 2013 23:59:02	1275614	16041663	hadcm3n_oc8e_1900_40_008470977_0	440,640	403,300	0.9153
06 Oct 2013 16:17:28	1275614	16041663	hadcm3n_oc8e_1900_40_008470977_0	414,720	376,353	0.9075
06 Oct 2013 08:44:50	1275614	16041663	hadcm3n_oc8e_1900_40_008470977_0	388,800	349,755	0.8996
05 Oct 2013 19:37:58	1275614	16041663	hadcm3n_oc8e_1900_40_008470977_0	362,880	323,641	0.8919
05 Oct 2013 11:45:00	1275614	16041663	hadcm3n_oc8e_1900_40_008470977_0	336,960	297,860	0.8840
05 Oct 2013 04:22:13	1275614	16041663	hadcm3n_oc8e_1900_40_008470977_0	311,040	271,856	0.8740
04 Oct 2013 20:58:33	1275614	16041663	hadcm3n_oc8e_1900_40_008470977_0	285,120	245,862	0.8623
04 Oct 2013 13:29:39	1275614	16041663	hadcm3n_oc8e_1900_40_008470977_0	259,200	220,006	0.8488
04 Oct 2013 06:15:01	1275614	16041663	hadcm3n_oc8e_1900_40_008470977_0	233,280	194,102	0.8321
03 Oct 2013 22:56:12	1275614	16041663	hadcm3n_oc8e_1900_40_008470977_0	207,360	168,089	0.8106
03 Oct 2013 15:34:41	1275614	16041663	hadcm3n_oc8e_1900_40_008470977_0	181,440	142,416	0.7849
03 Oct 2013 08:20:54	1275614	16041663	hadcm3n_oc8e_1900_40_008470977_0	155,520	116,643	0.7500
03 Oct 2013 01:07:41	1275614	16041663	hadcm3n_oc8e_1900_40_008470977_0	129,600	90,890	0.7013
02 Oct 2013 17:28:01	1275614	16041663	hadcm3n_oc8e_1900_40_008470977_0	103,680	65,108	0.6280
02 Oct 2013 10:00:57	1275614	16041663	hadcm3n_oc8e_1900_40_008470977_0	77,760	39,278	0.5051
02 Oct 2013 02:41:14	1275614	16041663	hadcm3n_oc8e_1900_40_008470977_0	51,840	13,422	0.2589
01 Oct 2013 19:17:39	1275614	16041663	hadcm3n_oc8e_1900_40_008470977_0	25,920	25,672	0.9904