Task 12816454

Name	hadcm3n_p0iz_1900_40_007218267_0
Workunit	7416507
Created	26 Apr 2011, 15:14:31 UTC
Sent	5 May 2011, 11:11:07 UTC
Report deadline	4 Aug 2011, 18:38:18 UTC
Received	2 Jun 2011, 8:26:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1103902
Run time	20 days 8 hours 23 min 13 sec
CPU time	3 days 11 hours 28 min 18 sec
Validate state	Invalid
Credit	6,531.84
Device peak FLOPS	1.59 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3568, iMonCtr=1 Model crash detected, will try to restart... 23:39:42 (1208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:39:48 (1208): No heartbeat from core client for 30 sec - exiting 23:39:49 (1208): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Suspended CPDN Monitor - Suspend request from BOINC... 18:44:53 (4372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:44:54 (4372): No heartbeat from core client for 30 sec - exiting 18:44:55 (4372): No heartbeat from core client for 30 sec - exiting 07:10:42 (844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Jun 2011 06:11:35	1103902	12816454	hadcm3n_p0iz_1900_40_007218267_0	544,320	300,480	0.5520
01 Jun 2011 06:41:57	1103902	12816454	hadcm3n_p0iz_1900_40_007218267_0	518,400	222,069	0.4284
31 May 2011 07:28:03	1103902	12816454	hadcm3n_p0iz_1900_40_007218267_0	492,480	144,864	0.2942
30 May 2011 08:28:55	1103902	12816454	hadcm3n_p0iz_1900_40_007218267_0	466,560	1,407,201	3.0161
29 May 2011 09:07:52	1103902	12816454	hadcm3n_p0iz_1900_40_007218267_0	440,640	1,328,629	3.0152
28 May 2011 09:24:49	1103902	12816454	hadcm3n_p0iz_1900_40_007218267_0	414,720	1,249,480	3.0128
27 May 2011 09:35:24	1103902	12816454	hadcm3n_p0iz_1900_40_007218267_0	388,800	1,169,348	3.0076
26 May 2011 09:18:01	1103902	12816454	hadcm3n_p0iz_1900_40_007218267_0	362,880	1,087,359	2.9965
25 May 2011 08:28:46	1103902	12816454	hadcm3n_p0iz_1900_40_007218267_0	336,960	1,003,960	2.9795
24 May 2011 08:28:31	1103902	12816454	hadcm3n_p0iz_1900_40_007218267_0	311,040	923,033	2.9676
23 May 2011 08:57:17	1103902	12816454	hadcm3n_p0iz_1900_40_007218267_0	285,120	844,055	2.9604
22 May 2011 09:58:48	1103902	12816454	hadcm3n_p0iz_1900_40_007218267_0	259,200	766,106	2.9557
21 May 2011 10:07:37	1103902	12816454	hadcm3n_p0iz_1900_40_007218267_0	233,280	685,709	2.9394
20 May 2011 11:06:07	1103902	12816454	hadcm3n_p0iz_1900_40_007218267_0	207,360	608,019	2.9322
19 May 2011 11:51:06	1103902	12816454	hadcm3n_p0iz_1900_40_007218267_0	181,440	529,199	2.9167
18 May 2011 13:06:57	1103902	12816454	hadcm3n_p0iz_1900_40_007218267_0	155,520	451,659	2.9042
17 May 2011 14:23:26	1103902	12816454	hadcm3n_p0iz_1900_40_007218267_0	129,600	375,015	2.8936
16 May 2011 16:07:04	1103902	12816454	hadcm3n_p0iz_1900_40_007218267_0	103,680	299,314	2.8869
15 May 2011 18:13:11	1103902	12816454	hadcm3n_p0iz_1900_40_007218267_0	77,760	224,820	2.8912
14 May 2011 20:34:23	1103902	12816454	hadcm3n_p0iz_1900_40_007218267_0	51,840	150,675	2.9065