Task 15908276

Name	hadcm3n_n3vc_1920_40_008378159_2
Workunit	8529018
Created	25 Jul 2013, 22:57:53 UTC
Sent	25 Jul 2013, 22:58:12 UTC
Report deadline	25 Oct 2013, 6:25:23 UTC
Received	21 Sep 2013, 20:45:15 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1237073
Run time	1 days 21 hours 47 min 12 sec
CPU time	1 days 21 hours 11 min 11 sec
Validate state	Invalid
Credit	2,488.32
Device peak FLOPS	3.46 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:12:18 (20268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:09:24 (7144): No heartbeat from core client for 30 sec - exiting 16:09:28 (7144): No heartbeat from core client for 30 sec - exiting 16:09:29 (7144): No heartbeat from core client for 30 sec - exiting 16:09:30 (7144): No heartbeat from core client for 30 sec - exiting 16:09:31 (7144): No heartbeat from core client for 30 sec - exiting 16:09:33 (7144): No heartbeat from core client for 30 sec - exiting 16:09:34 (7144): No heartbeat from core client for 30 sec - exiting 16:09:35 (7144): No heartbeat from core client for 30 sec - exiting 16:09:36 (7144): No heartbeat from core client for 30 sec - exiting 16:09:37 (7144): No heartbeat from core client for 30 sec - exiting 16:09:38 (7144): No heartbeat from core client for 30 sec - exiting 16:09:39 (7144): No heartbeat from core client for 30 sec - exiting 16:09:40 (7144): No heartbeat from core client for 30 sec - exiting 16:09:41 (7144): No heartbeat from core client for 30 sec - exiting 16:09:42 (7144): No heartbeat from core client for 30 sec - exiting 16:09:43 (7144): No heartbeat from core client for 30 sec - exiting 16:09:44 (7144): No heartbeat from core client for 30 sec - exiting 16:09:45 (7144): No heartbeat from core client for 30 sec - exiting 16:09:46 (7144): No heartbeat from core client for 30 sec - exiting 16:09:47 (7144): No heartbeat from core client for 30 sec - exiting 16:09:48 (7144): No heartbeat from core client for 30 sec - exiting 16:09:49 (7144): No heartbeat from core client for 30 sec - exiting 16:09:50 (7144): No heartbeat from core client for 30 sec - exiting 16:09:51 (7144): No heartbeat from core client for 30 sec - exiting 16:09:52 (7144): No heartbeat from core client for 30 sec - exiting 16:09:53 (7144): No heartbeat from core client for 30 sec - exiting 16:09:54 (7144): No heartbeat from core client for 30 sec - exiting 16:09:55 (7144): No heartbeat from core client for 30 sec - exiting 16:09:56 (7144): No heartbeat from core client for 30 sec - exiting 16:09:57 (7144): No heartbeat from core client for 30 sec - exiting 16:09:58 (7144): No heartbeat from core client for 30 sec - exiting 16:09:59 (7144): No heartbeat from core client for 30 sec - exiting 16:10:00 (7144): No heartbeat from core client for 30 sec - exiting 16:10:01 (7144): No heartbeat from core client for 30 sec - exiting 16:10:02 (7144): No heartbeat from core client for 30 sec - exiting 16:10:03 (7144): No heartbeat from core client for 30 sec - exiting 16:10:04 (7144): No heartbeat from core client for 30 sec - exiting 16:10:05 (7144): No heartbeat from core client for 30 sec - exiting 16:10:06 (7144): No heartbeat from core client for 30 sec - exiting 16:10:07 (7144): No heartbeat from core client for 30 sec - exiting 16:10:08 (7144): No heartbeat from core client for 30 sec - exiting 16:10:09 (7144): No heartbeat from core client for 30 sec - exiting 16:10:10 (7144): No heartbeat from core client for 30 sec - exiting 16:10:11 (7144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_n3vc_1920_40_008378159/dataout/ocean_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5552, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_n3vc_1920_40_008378159/dataout/ocean_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5552, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_n3vc_1920_40_008378159/dataout/ocean_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5552, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_n3vc_1920_40_008378159/dataout/ocean_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5552, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_n3vc_1920_40_008378159/dataout/ocean_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5552, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_n3vc_1920_40_008378159/dataout/ocean_restart.day after 11 attempts Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5552, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Sep 2013 19:22:55	1237073	15908276	hadcm3n_n3vc_1920_40_008378159_2	207,360	159,869	0.7710
01 Sep 2013 02:17:04	1237073	15908276	hadcm3n_n3vc_1920_40_008378159_2	181,440	140,097	0.7721
19 Aug 2013 22:29:08	1237073	15908276	hadcm3n_n3vc_1920_40_008378159_2	155,520	120,098	0.7722
19 Aug 2013 21:33:59	1237073	15908276	hadcm3n_n3vc_1920_40_008378159_2	129,600	99,379	0.7668
19 Aug 2013 21:33:59	1237073	15908276	hadcm3n_n3vc_1920_40_008378159_2	103,680	79,131	0.7632
26 Jul 2013 15:36:09	1237073	15908276	hadcm3n_n3vc_1920_40_008378159_2	77,760	59,481	0.7649
26 Jul 2013 10:08:10	1237073	15908276	hadcm3n_n3vc_1920_40_008378159_2	51,840	39,746	0.7667
26 Jul 2013 04:35:55	1237073	15908276	hadcm3n_n3vc_1920_40_008378159_2	25,920	19,992	0.7713