Task 15717517

Name	hadcm3n_3mt4_1940_40_008260677_2
Workunit	8415801
Created	8 Apr 2013, 17:55:49 UTC
Sent	8 Apr 2013, 17:55:55 UTC
Report deadline	9 Jul 2013, 1:23:06 UTC
Received	28 Apr 2013, 7:31:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1239512
Run time	5 days 16 hours 11 min 31 sec
CPU time	4 days 16 hours 59 min 12 sec
Validate state	Invalid
Credit	4,976.64
Device peak FLOPS	2.87 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5452, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4824, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:25:29 (4680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3240, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3240, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3240, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3444, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4376, iMonCtr=1 Model crash detected, will try to restart... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Apr 2013 20:46:43	1239512	15717517	hadcm3n_3mt4_1940_40_008260677_2	414,720	398,807	0.9616
27 Apr 2013 16:42:23	1239512	15717517	hadcm3n_3mt4_1940_40_008260677_2	388,800	370,910	0.9540
27 Apr 2013 16:42:23	1239512	15717517	hadcm3n_3mt4_1940_40_008260677_2	362,880	342,948	0.9451
21 Apr 2013 20:02:59	1239512	15717517	hadcm3n_3mt4_1940_40_008260677_2	336,960	312,748	0.9281
21 Apr 2013 11:22:51	1239512	15717517	hadcm3n_3mt4_1940_40_008260677_2	311,040	282,266	0.9075
20 Apr 2013 14:35:32	1239512	15717517	hadcm3n_3mt4_1940_40_008260677_2	285,120	251,413	0.8818
19 Apr 2013 23:35:43	1239512	15717517	hadcm3n_3mt4_1940_40_008260677_2	259,200	220,661	0.8513
17 Apr 2013 20:07:28	1239512	15717517	hadcm3n_3mt4_1940_40_008260677_2	233,280	200,755	0.8606
15 Apr 2013 19:26:34	1239512	15717517	hadcm3n_3mt4_1940_40_008260677_2	207,360	170,131	0.8205
14 Apr 2013 13:08:04	1239512	15717517	hadcm3n_3mt4_1940_40_008260677_2	181,440	140,183	0.7726
14 Apr 2013 05:30:31	1239512	15717517	hadcm3n_3mt4_1940_40_008260677_2	155,520	111,533	0.7172
13 Apr 2013 20:26:26	1239512	15717517	hadcm3n_3mt4_1940_40_008260677_2	129,600	143,166	1.1047
13 Apr 2013 12:54:48	1239512	15717517	hadcm3n_3mt4_1940_40_008260677_2	103,680	113,323	1.0930
11 Apr 2013 21:40:08	1239512	15717517	hadcm3n_3mt4_1940_40_008260677_2	77,760	91,560	1.1775
10 Apr 2013 19:22:20	1239512	15717517	hadcm3n_3mt4_1940_40_008260677_2	51,840	60,910	1.1750
10 Apr 2013 11:44:12	1239512	15717517	hadcm3n_3mt4_1940_40_008260677_2	25,920	30,239	1.1666