Task 15806878

Name	hadcm3n_4ai9_1940_40_008311781_3
Workunit	8462916
Created	30 May 2013, 11:52:29 UTC
Sent	20 Jun 2013, 6:38:28 UTC
Report deadline	19 Sep 2013, 14:05:39 UTC
Received	4 Jul 2013, 18:22:43 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1129601
Run time	7 days 9 hours 22 min 44 sec
CPU time	6 days 22 hours 29 min 25 sec
Validate state	Invalid
Credit	1,866.24
Device peak FLOPS	1.99 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quitforrtl: Access is denied. CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4408, selfPID=4408, iMonCtr=1 CPDN Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5212, selfPID=5212, iMonCtr=1 CPDN Monitor - Quforrtl: Access is denied. CPDN Monitor - QuiWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5412, selfPID=5412, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor forPtl: N Monccestor - is Quitenierequ. est from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2200, selfPID=2200, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN MonWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1512, selfPID=1512, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - QWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3796, selfPID=3796, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - QuWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3232, selfPID=3232, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN MonitorWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4820, selfPID=4820, iMonCtr=1 CPDN Monitor - QWorker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 CPDN MonitorWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5240, selfPID=5240, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN MonitorWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5968, selfPID=5968, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4352, selfPID=4352, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN MoWorker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 CPDN Monitor forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5516, selfPID=5516, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3060, selfPID=3060, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Qforrtl: Access is denied. CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3332, selfPID=3332, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit requesWorker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN MonitoWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=172, selfPID=172, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2876, selfPID=2876, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4476, selfPID=4476, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit requesWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4444, selfPID=4444, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3108, selfPID=3108, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDNCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN MoWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5464, selfPID=5464, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5716, selfPID=5716, iMonCtr=1 CPDN Monitorforrtl: Access is denied. CWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=244, selfPID=244, iMonCtr=1 CPDN MoWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3040, selfPID=3040, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit requeWorker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 CPDN Monitor - Quit requeWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5348, selfPID=5348, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOIWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2172, selfPID=2172, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4472, selfPID=4472, iMonCtr=1 CPDN Moforrtl: Access is denied. CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5084, selfPID=5084, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC..Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3940, selfPID=3940, iMonCtr=1 CPDN MonitorWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4436, selfPID=4436, iMonCtr=1 CPDN Monitor - Quit requeWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5924, selfPID=5924, iMonCtr=1 CPDN MoWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6100, selfPID=6100, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN MonitorCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN MoWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2796, selfPID=2796, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN MonitWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5056, selfPID=5056, iMonCtr=1 CPDN Monitor - Quit request frWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2688, selfPID=2688, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor CPDN Monitor - Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 CPDN MoWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6056, selfPID=6056, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC..Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2524, selfPID=2524, iMonCtr=1 CPDN Monitor - Quit request from BOIWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4116, selfPID=4116, iMonCtr=1 CPDN MonitorWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6044, selfPID=6044, iMonCtr=1 CPDN MonitorWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5328, selfPID=5328, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request frWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6028, selfPID=6028, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request froWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8660, selfPID=8660, iMonCtr=1 CPDN Monitor Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10796, selfPID=10796, iMonCtr=1 CPDN Monitor - QuiWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11852, selfPID=11852, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Moforrtl: Access is denied. CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10584, selfPID=10584, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit reforrtl: Access is denied. CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12168, selfPID=12168, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - QuWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11312, selfPID=11312, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOI9:33:17 (9360): Can't acquire lockfile (32) - waiting 35s Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12140, selfPID=12140, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN MoWorker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 CPDN Monitor - QuiWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8536, selfPID=8536, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3112, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2252, selfPID=2252, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12256, selfPID=12256, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN MoWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5212, selfPID=5212, iMonCtr=1 CPDN Monitor - Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9316, selfPID=9316, iMonCtr=1 CPDN MonitorWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7788, selfPID=7788, iMonCtr=1 CPDN Monitor - Quit requesWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7048, selfPID=7048, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN MonitorWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10204, selfPID=10204, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6264, selfPID=6264, iMonCtr=1 CPDWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7240, selfPID=7240, iMonCtr=1 CPDN Monitor - Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9192, selfPID=9192, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN MoWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9524, selfPID=9524, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN MonitorWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8288, selfPID=8288, iMonCtr=1 CPDN MoWorker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9536, selfPID=9536, iMonCtr=1 </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Jul 2013 18:41:30	1129601	15806878	hadcm3n_4ai9_1940_40_008311781_3	155,520	572,654	3.6822
02 Jul 2013 10:55:35	1129601	15806878	hadcm3n_4ai9_1940_40_008311781_3	129,600	477,073	3.6811
02 Jul 2013 10:07:58	1129601	15806878	hadcm3n_4ai9_1940_40_008311781_3	103,680	381,354	3.6782
25 Jun 2013 23:18:12	1129601	15806878	hadcm3n_4ai9_1940_40_008311781_3	77,760	286,291	3.6817
24 Jun 2013 19:01:27	1129601	15806878	hadcm3n_4ai9_1940_40_008311781_3	51,840	191,275	3.6897
23 Jun 2013 14:29:11	1129601	15806878	hadcm3n_4ai9_1940_40_008311781_3	25,920	96,365	3.7178