Task 15793181

Name	hadcm3n_4g4h_1980_40_008325039_2
Workunit	8476174
Created	22 May 2013, 12:23:15 UTC
Sent	22 May 2013, 12:23:28 UTC
Report deadline	21 Aug 2013, 19:50:39 UTC
Received	18 Jun 2013, 9:22:14 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1235573
Run time	4 days 17 hours 9 min 42 sec
CPU time	4 days 11 hours 20 min 47 sec
Validate state	Invalid
Credit	5,287.68
Device peak FLOPS	3.47 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> Das Gerät erkennt den Befehl nicht. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5164, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4140, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5272, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5144, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5412, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5412, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5412, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6020, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6020, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6020, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5780, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5664, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5664, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5468, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5704, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5704, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5592, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5592, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5668, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5668, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5668, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Jun 2013 08:23:32	1235573	15793181	hadcm3n_4g4h_1980_40_008325039_2	440,640	390,875	0.8871
17 Jun 2013 10:16:36	1235573	15793181	hadcm3n_4g4h_1980_40_008325039_2	414,720	368,425	0.8884
14 Jun 2013 09:58:07	1235573	15793181	hadcm3n_4g4h_1980_40_008325039_2	388,800	346,129	0.8902
13 Jun 2013 11:49:58	1235573	15793181	hadcm3n_4g4h_1980_40_008325039_2	362,880	323,614	0.8918
12 Jun 2013 13:40:52	1235573	15793181	hadcm3n_4g4h_1980_40_008325039_2	336,960	300,904	0.8930
12 Jun 2013 07:25:28	1235573	15793181	hadcm3n_4g4h_1980_40_008325039_2	311,040	278,119	0.8942
11 Jun 2013 09:58:47	1235573	15793181	hadcm3n_4g4h_1980_40_008325039_2	285,120	255,413	0.8958
10 Jun 2013 11:38:58	1235573	15793181	hadcm3n_4g4h_1980_40_008325039_2	259,200	232,869	0.8984
07 Jun 2013 13:12:23	1235573	15793181	hadcm3n_4g4h_1980_40_008325039_2	233,280	210,533	0.9025
07 Jun 2013 07:55:06	1235573	15793181	hadcm3n_4g4h_1980_40_008325039_2	207,360	188,263	0.9079
05 Jun 2013 11:11:22	1235573	15793181	hadcm3n_4g4h_1980_40_008325039_2	181,440	165,580	0.9126
04 Jun 2013 14:12:17	1235573	15793181	hadcm3n_4g4h_1980_40_008325039_2	155,520	141,712	0.9112
04 Jun 2013 06:54:01	1235573	15793181	hadcm3n_4g4h_1980_40_008325039_2	129,600	116,423	0.8983
03 Jun 2013 08:02:59	1235573	15793181	hadcm3n_4g4h_1980_40_008325039_2	103,680	93,380	0.9007
31 May 2013 08:06:00	1235573	15793181	hadcm3n_4g4h_1980_40_008325039_2	77,760	70,363	0.9049
29 May 2013 08:02:42	1235573	15793181	hadcm3n_4g4h_1980_40_008325039_2	51,840	47,808	0.9222
23 May 2013 10:13:34	1235573	15793181	hadcm3n_4g4h_1980_40_008325039_2	25,920	23,390	0.9024