Task 15068640

Name	hadcm3n_o24b_2100_40_008116768_1
Workunit	8271882
Created	3 Aug 2012, 21:22:34 UTC
Sent	3 Aug 2012, 21:22:44 UTC
Report deadline	3 Nov 2012, 4:49:55 UTC
Received	28 Aug 2012, 0:16:27 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1169423
Run time	6 days 1 hours 6 min 23 sec
CPU time	5 days 9 hours 14 min 37 sec
Validate state	Invalid
Credit	5,909.76
Device peak FLOPS	3.62 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> El dispositivo no reconoce el comando. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 01:30:08 (6472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:06:58 (7920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:57:24 (4644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:04:42 (7980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:11:58 (1040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:11:59 (1040): No heartbeat from core client for 30 sec - exiting 12:12:00 (1040): No heartbeat from core client for 30 sec - exiting 12:16:24 (7788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:16:30 (7788): No heartbeat from core client for 30 sec - exiting 12:16:31 (7788): No heartbeat from core client for 30 sec - exiting 12:16:32 (7788): No heartbeat from core client for 30 sec - exiting 12:16:33 (7788): No heartbeat from core client for 30 sec - exiting 12:16:34 (7788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 12:42:17 (4844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:42:22 (4844): No heartbeat from core client for 30 sec - exiting 12:42:23 (4844): No heartbeat from core client for 30 sec - exiting 12:42:24 (4844): No heartbeat from core client for 30 sec - exiting 12:42:25 (4844): No heartbeat from core client for 30 sec - exiting 12:42:26 (4844): No heartbeat from core client for 30 sec - exiting 12:42:27 (4844): No heartbeat from core client for 30 sec - exiting 12:42:28 (4844): No heartbeat from core client for 30 sec - exiting 12:42:29 (4844): No heartbeat from core client for 30 sec - exiting 12:42:30 (4844): No heartbeat from core client for 30 sec - exiting 12:42:31 (4844): No heartbeat from core client for 30 sec - exiting 12:42:32 (4844): No heartbeat from core client for 30 sec - exiting 12:42:33 (4844): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 12:49:29 (5540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:49:30 (5540): No heartbeat from core client for 30 sec - exiting 12:49:31 (5540): No heartbeat from core client for 30 sec - exiting 12:49:32 (5540): No heartbeat from core client for 30 sec - exiting 12:55:22 (5508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:55:26 (5508): No heartbeat from core client for 30 sec - exiting 12:55:27 (5508): No heartbeat from core client for 30 sec - exiting 12:55:28 (5508): No heartbeat from core client for 30 sec - exiting 12:55:29 (5508): No heartbeat from core client for 30 sec - exiting 12:55:30 (5508): No heartbeat from core client for 30 sec - exiting 13:01:17 (8120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:59:52 (6708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:59:53 (6708): No heartbeat from core client for 30 sec - exiting 16:59:54 (6708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:23:28 (5988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:23:29 (5988): No heartbeat from core client for 30 sec - exiting 19:23:30 (5988): No heartbeat from core client for 30 sec - exiting 19:23:31 (5988): No heartbeat from core client for 30 sec - exiting 19:23:32 (5988): No heartbeat from core client for 30 sec - exiting 19:30:05 (6548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:30:06 (6548): No heartbeat from core client for 30 sec - exiting 19:30:07 (6548): No heartbeat from core client for 30 sec - exiting 19:33:46 (4616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:33:50 (4616): No heartbeat from core client for 30 sec - exiting 19:33:51 (4616): No heartbeat from core client for 30 sec - exiting 19:33:52 (4616): No heartbeat from core client for 30 sec - exiting 19:33:53 (4616): No heartbeat from core client for 30 sec - exiting 19:33:54 (4616): No heartbeat from core client for 30 sec - exiting 19:40:28 (5644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:40:30 (5644): No heartbeat from core client for 30 sec - exiting 19:40:31 (5644): No heartbeat from core client for 30 sec - exiting 19:40:32 (5644): No heartbeat from core client for 30 sec - exiting 19:40:33 (5644): No heartbeat from core client for 30 sec - exiting 19:40:34 (5644): No heartbeat from core client for 30 sec - exiting 19:40:35 (5644): No heartbeat from core client for 30 sec - exiting 19:40:36 (5644): No heartbeat from core client for 30 sec - exiting 19:43:20 (4848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:32 (5720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:34 (5720): No heartbeat from core client for 30 sec - exiting 19:51:35 (5720): No heartbeat from core client for 30 sec - exiting 19:51:36 (5720): No heartbeat from core client for 30 sec - exiting 19:51:37 (5720): No heartbeat from core client for 30 sec - exiting 19:51:38 (5720): No heartbeat from core client for 30 sec - exiting 19:51:39 (5720): No heartbeat from core client for 30 sec - exiting 19:51:40 (5720): No heartbeat from core client for 30 sec - exiting 19:51:41 (5720): No heartbeat from core client for 30 sec - exiting 19:51:42 (5720): No heartbeat from core client for 30 sec - exiting 19:53:16 (6036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:59:33 (7136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:59:35 (7136): No heartbeat from core client for 30 sec - exiting 19:59:36 (7136): No heartbeat from core client for 30 sec - exiting 19:59:37 (7136): No heartbeat from core client for 30 sec - exiting 20:04:18 (6856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:04:19 (6856): No heartbeat from core client for 30 sec - exiting 20:12:49 (1072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:51 (1072): No heartbeat from core client for 30 sec - exiting 20:12:52 (1072): No heartbeat from core client for 30 sec - exiting 20:15:01 (5576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:01 (3800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:03 (3800): No heartbeat from core client for 30 sec - exiting 20:24:04 (3800): No heartbeat from core client for 30 sec - exiting 20:24:05 (3800): No heartbeat from core client for 30 sec - exiting 20:24:06 (3800): No heartbeat from core client for 30 sec - exiting 20:33:21 (6552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:33:24 (6552): No heartbeat from core client for 30 sec - exiting 20:33:25 (6552): No heartbeat from core client for 30 sec - exiting 20:33:26 (6552): No heartbeat from core client for 30 sec - exiting 20:33:27 (6552): No heartbeat from core client for 30 sec - exiting 20:33:28 (6552): No heartbeat from core client for 30 sec - exiting 20:33:29 (6552): No heartbeat from core client for 30 sec - exiting 20:33:30 (6552): No heartbeat from core client for 30 sec - exiting 20:33:31 (6552): No heartbeat from core client for 30 sec - exiting 20:37:31 (6924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:37:32 (6924): No heartbeat from core client for 30 sec - exiting 20:37:33 (6924): No heartbeat from core client for 30 sec - exiting 20:37:34 (6924): No heartbeat from core client for 30 sec - exiting 20:37:35 (6924): No heartbeat from core client for 30 sec - exiting 20:37:36 (6924): No heartbeat from core client for 30 sec - exiting 20:37:37 (6924): No heartbeat from core client for 30 sec - exiting 20:45:39 (784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:45:45 (784): No heartbeat from core client for 30 sec - exiting 20:45:46 (784): No heartbeat from core client for 30 sec - exiting 20:45:47 (784): No heartbeat from core client for 30 sec - exiting 20:45:48 (784): No heartbeat from core client for 30 sec - exiting 20:45:49 (784): No heartbeat from core client for 30 sec - exiting 20:45:50 (784): No heartbeat from core client for 30 sec - exiting 20:45:51 (784): No heartbeat from core client for 30 sec - exiting 20:50:29 (6180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:50:35 (6180): No heartbeat from core client for 30 sec - exiting 20:50:36 (6180): No heartbeat from core client for 30 sec - exiting 20:50:37 (6180): No heartbeat from core client for 30 sec - exiting 20:50:38 (6180): No heartbeat from core client for 30 sec - exiting 20:50:40 (6180): No heartbeat from core client for 30 sec - exiting 20:50:41 (6180): No heartbeat from core client for 30 sec - exiting 20:50:42 (6180): No heartbeat from core client for 30 sec - exiting 20:50:43 (6180): No heartbeat from core client for 30 sec - exiting 20:58:43 (4664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:58:45 (4664): No heartbeat from core client for 30 sec - exiting 20:58:46 (4664): No heartbeat from core client for 30 sec - exiting 20:58:47 (4664): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4192, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4192, iMonCtr=1 Model crash detected, will try to restart... 21:06:49 (4192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5688, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5688, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5688, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5688, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Aug 2012 16:03:02	1169423	15068640	hadcm3n_o24b_2100_40_008116768_1	492,480	449,153	0.9120
27 Aug 2012 09:06:27	1169423	15068640	hadcm3n_o24b_2100_40_008116768_1	466,560	431,172	0.9242
27 Aug 2012 04:15:21	1169423	15068640	hadcm3n_o24b_2100_40_008116768_1	440,640	413,496	0.9384
26 Aug 2012 22:38:52	1169423	15068640	hadcm3n_o24b_2100_40_008116768_1	414,720	395,758	0.9543
26 Aug 2012 17:33:17	1169423	15068640	hadcm3n_o24b_2100_40_008116768_1	388,800	377,447	0.9708
24 Aug 2012 18:44:08	1169423	15068640	hadcm3n_o24b_2100_40_008116768_1	362,880	352,997	0.9728
22 Aug 2012 15:12:53	1169423	15068640	hadcm3n_o24b_2100_40_008116768_1	336,960	326,699	0.9695
22 Aug 2012 03:05:04	1169423	15068640	hadcm3n_o24b_2100_40_008116768_1	311,040	302,368	0.9721
20 Aug 2012 20:36:40	1169423	15068640	hadcm3n_o24b_2100_40_008116768_1	285,120	277,095	0.9719
15 Aug 2012 13:50:57	1169423	15068640	hadcm3n_o24b_2100_40_008116768_1	259,200	253,346	0.9774
15 Aug 2012 08:09:53	1169423	15068640	hadcm3n_o24b_2100_40_008116768_1	233,280	233,266	0.9999
15 Aug 2012 01:08:29	1169423	15068640	hadcm3n_o24b_2100_40_008116768_1	207,360	208,935	1.0076
13 Aug 2012 16:22:03	1169423	15068640	hadcm3n_o24b_2100_40_008116768_1	181,440	182,786	1.0074
12 Aug 2012 01:48:59	1169423	15068640	hadcm3n_o24b_2100_40_008116768_1	155,520	156,803	1.0082
08 Aug 2012 16:07:33	1169423	15068640	hadcm3n_o24b_2100_40_008116768_1	129,600	130,457	1.0066
07 Aug 2012 23:45:16	1169423	15068640	hadcm3n_o24b_2100_40_008116768_1	103,680	105,096	1.0137
06 Aug 2012 00:57:38	1169423	15068640	hadcm3n_o24b_2100_40_008116768_1	77,760	78,846	1.0140
04 Aug 2012 17:02:11	1169423	15068640	hadcm3n_o24b_2100_40_008116768_1	51,840	52,780	1.0181
04 Aug 2012 06:15:12	1169423	15068640	hadcm3n_o24b_2100_40_008116768_1	25,920	26,311	1.0151