Task 13805005

Name	hadcm3n_u5uu_1980_40_007545094_3
Workunit	7742326
Created	21 Dec 2011, 23:49:09 UTC
Sent	21 Dec 2011, 23:58:02 UTC
Report deadline	22 Mar 2012, 7:25:13 UTC
Received	29 Feb 2012, 2:56:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-2 (0xFFFFFFFE) Unknown error code
Computer ID	1019837
Run time	47 days 2 hours 43 min 46 sec
CPU time	24 days 12 hours 59 min 24 sec
Validate state	Invalid
Credit	4,665.60
Device peak FLOPS	0.87 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.6.38</core_client_version> <![CDATA[ <message> - exit code -2 (0xfffffffe) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 02:44:55 (1243640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 00:01:28 (42944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Restart file copy failed on u5uuka.daj24r0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on u5uuka.daj24s0 Atmos Hold Restart file rename failed on atmos_restart.hold Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 02:48:48 (1184076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: DUMPCTL : Fail to open output dump - may already exist tmp/pipe_dummy 2048 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=860880, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=860880, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=860880, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=860880, iMonCtr=1 Model crash detected, will try to restart... Could not launch model process. Last Error=1450 Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Feb 2012 06:10:29	1019837	13805005	hadcm3n_u5uu_1980_40_007545094_3	388,800	2,053,680	5.2821
22 Feb 2012 00:18:11	1019837	13805005	hadcm3n_u5uu_1980_40_007545094_3	362,880	1,909,651	5.2625
15 Feb 2012 06:58:55	1019837	13805005	hadcm3n_u5uu_1980_40_007545094_3	336,960	1,767,735	5.2461
11 Feb 2012 19:18:50	1019837	13805005	hadcm3n_u5uu_1980_40_007545094_3	311,040	1,616,558	5.1973
02 Feb 2012 10:08:19	1019837	13805005	hadcm3n_u5uu_1980_40_007545094_3	285,120	1,496,216	5.2477
31 Jan 2012 14:37:42	1019837	13805005	hadcm3n_u5uu_1980_40_007545094_3	259,200	1,361,772	5.2538
27 Jan 2012 13:13:28	1019837	13805005	hadcm3n_u5uu_1980_40_007545094_3	233,280	1,217,563	5.2193
23 Jan 2012 03:29:06	1019837	13805005	hadcm3n_u5uu_1980_40_007545094_3	207,360	1,084,352	5.2293
21 Jan 2012 04:29:36	1019837	13805005	hadcm3n_u5uu_1980_40_007545094_3	181,440	951,879	5.2462
16 Jan 2012 15:26:43	1019837	13805005	hadcm3n_u5uu_1980_40_007545094_3	155,520	807,934	5.1950
12 Jan 2012 23:05:30	1019837	13805005	hadcm3n_u5uu_1980_40_007545094_3	129,600	670,814	5.1760
08 Jan 2012 21:19:58	1019837	13805005	hadcm3n_u5uu_1980_40_007545094_3	103,680	535,473	5.1647
04 Jan 2012 04:25:05	1019837	13805005	hadcm3n_u5uu_1980_40_007545094_3	77,760	402,392	5.1748
01 Jan 2012 06:11:51	1019837	13805005	hadcm3n_u5uu_1980_40_007545094_3	51,840	266,305	5.1371
24 Dec 2011 22:21:08	1019837	13805005	hadcm3n_u5uu_1980_40_007545094_3	25,920	139,861	5.3959