Task 14357221

Name	hadcm3n_o3lv_2020_40_007856147_2
Workunit	8011259
Created	4 Apr 2012, 16:24:37 UTC
Sent	4 Apr 2012, 16:24:40 UTC
Report deadline	4 Jul 2012, 23:51:51 UTC
Received	15 May 2012, 18:00:06 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1202052
Run time	9 days 20 hours 46 min 57 sec
CPU time	8 days 6 hours 16 min 11 sec
Validate state	Invalid
Credit	4,665.60
Device peak FLOPS	2.19 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> El dispositivo no reconoce el comando. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3748, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4032, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3924, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:21:32 (4596): No heartbeat from core client for 30 sec - exiting 18:21:33 (4596): No heartbeat from core client for 30 sec - exiting 18:21:34 (4596): No heartbeat from core client for 30 sec - exiting 18:21:35 (4596): No heartbeat from core client for 30 sec - exiting 18:21:36 (4596): No heartbeat from core client for 30 sec - exiting 18:21:37 (4596): No heartbeat from core client for 30 sec - exiting 18:21:38 (4596): No heartbeat from core client for 30 sec - exiting 18:21:39 (4596): No heartbeat from core client for 30 sec - exiting 18:21:40 (4596): No heartbeat from core client for 30 sec - exiting 18:21:41 (4596): No heartbeat from core client for 30 sec - exiting 18:21:42 (4596): No heartbeat from core client for 30 sec - exiting 18:21:43 (4596): No heartbeat from core client for 30 sec - exiting 18:21:44 (4596): No heartbeat from core client for 30 sec - exiting 18:21:45 (4596): No heartbeat from core client for 30 sec - exiting 18:21:46 (4596): No heartbeat from core client for 30 sec - exiting 18:21:47 (4596): No heartbeat from core client for 30 sec - exiting 18:21:48 (4596): No heartbeat from core client for 30 sec - exiting 18:21:49 (4596): No heartbeat from core client for 30 sec - exiting 18:21:50 (4596): No heartbeat from core client for 30 sec - exiting 18:21:51 (4596): No heartbeat from core client for 30 sec - exiting 18:21:52 (4596): No heartbeat from core client for 30 sec - exiting 18:21:53 (4596): No heartbeat from core client for 30 sec - exiting 18:21:54 (4596): No heartbeat from core client for 30 sec - exiting 18:21:55 (4596): No heartbeat from core client for 30 sec - exiting 18:21:56 (4596): No heartbeat from core client for 30 sec - exiting 18:21:57 (4596): No heartbeat from core client for 30 sec - exiting 18:21:58 (4596): No heartbeat from core client for 30 sec - exiting 18:21:59 (4596): No heartbeat from core client for 30 sec - exiting 18:22:00 (4596): No heartbeat from core client for 30 sec - exiting 18:22:01 (4596): No heartbeat from core client for 30 sec - exiting 18:22:02 (4596): No heartbeat from core client for 30 sec - exiting 18:22:03 (4596): No heartbeat from core client for 30 sec - exiting 18:22:04 (4596): No heartbeat from core client for 30 sec - exiting 18:22:05 (4596): No heartbeat from core client for 30 sec - exiting 18:22:06 (4596): No heartbeat from core client for 30 sec - exiting 18:22:07 (4596): No heartbeat from core client for 30 sec - exiting 18:22:08 (4596): No heartbeat from core client for 30 sec - exiting 18:22:09 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:17:55 (320): No heartbeat from core client for 30 sec - exiting 15:17:56 (320): No heartbeat from core client for 30 sec - exiting 15:17:57 (320): No heartbeat from core client for 30 sec - exiting 15:17:58 (320): No heartbeat from core client for 30 sec - exiting 15:17:59 (320): No heartbeat from core client for 30 sec - exiting 15:18:00 (320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:54:58 (4988): No heartbeat from core client for 30 sec - exiting 18:54:59 (4988): No heartbeat from core client for 30 sec - exiting 18:55:00 (4988): No heartbeat from core client for 30 sec - exiting 18:55:01 (4988): No heartbeat from core client for 30 sec - exiting 18:55:02 (4988): No heartbeat from core client for 30 sec - exiting 18:55:03 (4988): No heartbeat from core client for 30 sec - exiting 18:55:04 (4988): No heartbeat from core client for 30 sec - exiting 18:55:05 (4988): No heartbeat from core client for 30 sec - exiting 18:55:06 (4988): No heartbeat from core client for 30 sec - exiting 18:55:08 (4988): No heartbeat from core client for 30 sec - exiting 18:55:09 (4988): No heartbeat from core client for 30 sec - exiting 18:55:10 (4988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4740, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4740, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4740, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4740, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4740, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4740, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 May 2012 18:16:38	1202052	14357221	hadcm3n_o3lv_2020_40_007856147_2	388,800	704,930	1.8131
11 May 2012 14:03:30	1202052	14357221	hadcm3n_o3lv_2020_40_007856147_2	362,880	661,016	1.8216
10 May 2012 08:24:31	1202052	14357221	hadcm3n_o3lv_2020_40_007856147_2	336,960	612,785	1.8186
06 May 2012 09:39:29	1202052	14357221	hadcm3n_o3lv_2020_40_007856147_2	311,040	564,199	1.8139
06 May 2012 09:39:29	1202052	14357221	hadcm3n_o3lv_2020_40_007856147_2	285,120	515,865	1.8093
26 Apr 2012 16:07:04	1202052	14357221	hadcm3n_o3lv_2020_40_007856147_2	259,200	466,281	1.7989
25 Apr 2012 21:21:07	1202052	14357221	hadcm3n_o3lv_2020_40_007856147_2	233,280	419,878	1.7999
24 Apr 2012 20:27:43	1202052	14357221	hadcm3n_o3lv_2020_40_007856147_2	207,360	376,654	1.8164
24 Apr 2012 20:27:43	1202052	14357221	hadcm3n_o3lv_2020_40_007856147_2	181,440	330,581	1.8220
16 Apr 2012 18:28:05	1202052	14357221	hadcm3n_o3lv_2020_40_007856147_2	155,520	282,248	1.8149
11 Apr 2012 20:28:07	1202052	14357221	hadcm3n_o3lv_2020_40_007856147_2	129,600	236,944	1.8283
11 Apr 2012 20:28:07	1202052	14357221	hadcm3n_o3lv_2020_40_007856147_2	103,680	192,993	1.8614
11 Apr 2012 20:28:07	1202052	14357221	hadcm3n_o3lv_2020_40_007856147_2	77,760	144,684	1.8606
06 Apr 2012 21:09:10	1202052	14357221	hadcm3n_o3lv_2020_40_007856147_2	51,840	97,765	1.8859
05 Apr 2012 20:11:56	1202052	14357221	hadcm3n_o3lv_2020_40_007856147_2	25,920	48,573	1.8740