Task 13413790

Name	hadcm3n_u1k9_1980_40_007460797_2
Workunit	7658300
Created	23 Sep 2011, 2:03:29 UTC
Sent	23 Sep 2011, 3:13:33 UTC
Report deadline	23 Dec 2011, 10:40:44 UTC
Received	11 Oct 2011, 2:09:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1153226
Run time	5 days 16 hours 28 min 31 sec
CPU time	4 days 16 hours 49 min 59 sec
Validate state	Invalid
Credit	3,421.44
Device peak FLOPS	2.94 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 17:07:12 (6100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:14:16 (6976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:14:17 (6976): No heartbeat from core client for 30 sec - exiting 10:14:18 (6976): No heartbeat from core client for 30 sec - exiting 10:14:19 (6976): No heartbeat from core client for 30 sec - exiting 10:14:20 (6976): No heartbeat from core client for 30 sec - exiting 10:14:21 (6976): No heartbeat from core client for 30 sec - exiting 10:31:32 (6808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:31:33 (6808): No heartbeat from core client for 30 sec - exiting 10:31:34 (6808): No heartbeat from core client for 30 sec - exiting 10:31:35 (6808): No heartbeat from core client for 30 sec - exiting 10:31:36 (6808): No heartbeat from core client for 30 sec - exiting 10:31:37 (6808): No heartbeat from core client for 30 sec - exiting 10:31:38 (6808): No heartbeat from core client for 30 sec - exiting 10:31:39 (6808): No heartbeat from core client for 30 sec - exiting 10:31:40 (6808): No heartbeat from core client for 30 sec - exiting 10:31:41 (6808): No heartbeat from core client for 30 sec - exiting 10:31:42 (6808): No heartbeat from core client for 30 sec - exiting 10:31:43 (6808): No heartbeat from core client for 30 sec - exiting 10:31:44 (6808): No heartbeat from core client for 30 sec - exiting 10:31:45 (6808): No heartbeat from core client for 30 sec - exiting 10:31:46 (6808): No heartbeat from core client for 30 sec - exiting 10:31:48 (6808): No heartbeat from core client for 30 sec - exiting 10:31:49 (6808): No heartbeat from core client for 30 sec - exiting 10:31:50 (6808): No heartbeat from core client for 30 sec - exiting 10:31:51 (6808): No heartbeat from core client for 30 sec - exiting 10:31:52 (6808): No heartbeat from core client for 30 sec - exiting 10:31:53 (6808): No heartbeat from core client for 30 sec - exiting 10:31:54 (6808): No heartbeat from core client for 30 sec - exiting 10:31:55 (6808): No heartbeat from core client for 30 sec - exiting 10:31:56 (6808): No heartbeat from core client for 30 sec - exiting 10:31:57 (6808): No heartbeat from core client for 30 sec - exiting 10:31:59 (6808): No heartbeat from core client for 30 sec - exiting 10:32:00 (6808): No heartbeat from core client for 30 sec - exiting 10:46:29 (3400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:49:23 (5744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:51:35 (7128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:52:01 (7128): No heartbeat from core client for 30 sec - exiting 10:52:02 (7128): No heartbeat from core client for 30 sec - exiting 10:52:03 (7128): No heartbeat from core client for 30 sec - exiting 10:52:04 (7128): No heartbeat from core client for 30 sec - exiting 10:52:05 (7128): No heartbeat from core client for 30 sec - exiting 10:52:07 (7128): No heartbeat from core client for 30 sec - exiting 10:52:08 (7128): No heartbeat from core client for 30 sec - exiting 10:52:09 (7128): No heartbeat from core client for 30 sec - exiting 11:06:24 (4008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:06:25 (4008): No heartbeat from core client for 30 sec - exiting 11:06:26 (4008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:38:46 (236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:56:53 (5404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:11:05 (7472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:27:03 (3240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:27:05 (3240): No heartbeat from core client for 30 sec - exiting 00:27:08 (3240): No heartbeat from core client for 30 sec - exiting 00:27:09 (3240): No heartbeat from core client for 30 sec - exiting 00:27:11 (3240): No heartbeat from core client for 30 sec - exiting 00:39:24 (7652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:39:25 (7652): No heartbeat from core client for 30 sec - exiting 00:39:26 (7652): No heartbeat from core client for 30 sec - exiting 00:39:27 (7652): No heartbeat from core client for 30 sec - exiting 00:39:28 (7652): No heartbeat from core client for 30 sec - exiting 00:39:29 (7652): No heartbeat from core client for 30 sec - exiting 00:39:31 (7652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:53:33 (6876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:02:40 (7336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:02:49 (7336): No heartbeat from core client for 30 sec - exiting 09:02:50 (7336): No heartbeat from core client for 30 sec - exiting 09:02:51 (7336): No heartbeat from core client for 30 sec - exiting 09:02:52 (7336): No heartbeat from core client for 30 sec - exiting 09:02:53 (7336): No heartbeat from core client for 30 sec - exiting forrtl: The requested operation cannot be performed on a file with a user-mapped section open. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6928, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 22:42:39 (4440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy 2048 Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy 2048 Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy 2048 Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy 2048 Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy 2048 Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Oct 2011 02:11:25	1153226	13413790	hadcm3n_u1k9_1980_40_007460797_2	285,120	428,605	1.5032
09 Oct 2011 12:34:59	1153226	13413790	hadcm3n_u1k9_1980_40_007460797_2	259,200	389,661	1.5033
05 Oct 2011 02:03:16	1153226	13413790	hadcm3n_u1k9_1980_40_007460797_2	233,280	349,945	1.5001
01 Oct 2011 22:01:29	1153226	13413790	hadcm3n_u1k9_1980_40_007460797_2	207,360	312,133	1.5053
01 Oct 2011 08:48:34	1153226	13413790	hadcm3n_u1k9_1980_40_007460797_2	181,440	274,677	1.5139
28 Sep 2011 09:44:24	1153226	13413790	hadcm3n_u1k9_1980_40_007460797_2	155,520	238,113	1.5311
27 Sep 2011 22:57:10	1153226	13413790	hadcm3n_u1k9_1980_40_007460797_2	129,600	202,381	1.5616
27 Sep 2011 06:16:21	1153226	13413790	hadcm3n_u1k9_1980_40_007460797_2	103,680	165,685	1.5980
26 Sep 2011 03:31:29	1153226	13413790	hadcm3n_u1k9_1980_40_007460797_2	77,760	129,151	1.6609
25 Sep 2011 16:55:55	1153226	13413790	hadcm3n_u1k9_1980_40_007460797_2	51,840	92,729	1.7888
25 Sep 2011 02:31:25	1153226	13413790	hadcm3n_u1k9_1980_40_007460797_2	25,920	46,885	1.8088