Task 16063757

Name	hadcm3n_o81t_1900_40_008465556_2
Workunit	8616395
Created	10 Oct 2013, 2:26:44 UTC
Sent	10 Oct 2013, 2:28:34 UTC
Report deadline	9 Jan 2014, 9:55:45 UTC
Received	29 Oct 2013, 12:25:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1285155
Run time	8 days 5 hours 18 min 25 sec
CPU time	5 days 6 hours 41 min 16 sec
Validate state	Invalid
Credit	2,799.36
Device peak FLOPS	2.01 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.23</core_client_version> <![CDATA[ <message> Enheten känner inte igen kommandot. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 18:29:26 (1380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:32:12 (5216): No heartbeat from core client for 30 sec - exiting 18:32:13 (5216): No heartbeat from core client for 30 sec - exiting 18:32:14 (5216): No heartbeat from core client for 30 sec - exiting 18:32:15 (5216): No heartbeat from core client for 30 sec - exiting 18:32:16 (5216): No heartbeat from core client for 30 sec - exiting 18:32:17 (5216): No heartbeat from core client for 30 sec - exiting 18:32:18 (5216): No heartbeat from core client for 30 sec - exiting 18:32:19 (5216): No heartbeat from core client for 30 sec - exiting 18:32:20 (5216): No heartbeat from core client for 30 sec - exiting 18:32:21 (5216): No heartbeat from core client for 30 sec - exiting 18:32:22 (5216): No heartbeat from core client for 30 sec - exiting 18:32:23 (5216): No heartbeat from core client for 30 sec - exiting 18:32:24 (5216): No heartbeat from core client for 30 sec - exiting 18:32:25 (5216): No heartbeat from core client for 30 sec - exiting 18:32:26 (5216): No heartbeat from core client for 30 sec - exiting 18:32:27 (5216): No heartbeat from core client for 30 sec - exiting 18:32:28 (5216): No heartbeat from core client for 30 sec - exiting 18:32:29 (5216): No heartbeat from core client for 30 sec - exiting 18:32:30 (5216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:37:14 (220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:39:11 (3160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:39:12 (3160): No heartbeat from core client for 30 sec - exiting 18:39:13 (3160): No heartbeat from core client for 30 sec - exiting 18:39:14 (3160): No heartbeat from core client for 30 sec - exiting 18:39:15 (3160): No heartbeat from core client for 30 sec - exiting 18:39:16 (3160): No heartbeat from core client for 30 sec - exiting 18:39:17 (3160): No heartbeat from core client for 30 sec - exiting 18:39:18 (3160): No heartbeat from core client for 30 sec - exiting 18:39:19 (3160): No heartbeat from core client for 30 sec - exiting 18:39:20 (3160): No heartbeat from core client for 30 sec - exiting 18:39:21 (3160): No heartbeat from core client for 30 sec - exiting 18:42:11 (4424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:42:12 (4424): No heartbeat from core client for 30 sec - exiting 18:42:13 (4424): No heartbeat from core client for 30 sec - exiting 18:42:14 (4424): No heartbeat from core client for 30 sec - exiting 18:42:15 (4424): No heartbeat from core client for 30 sec - exiting 18:42:16 (4424): No heartbeat from core client for 30 sec - exiting 18:42:17 (4424): No heartbeat from core client for 30 sec - exiting 18:42:18 (4424): No heartbeat from core client for 30 sec - exiting 18:42:19 (4424): No heartbeat from core client for 30 sec - exiting 18:42:20 (4424): No heartbeat from core client for 30 sec - exiting 18:42:21 (4424): No heartbeat from core client for 30 sec - exiting 18:49:06 (4328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:49:07 (4328): No heartbeat from core client for 30 sec - exiting 18:49:08 (4328): No heartbeat from core client for 30 sec - exiting 18:49:09 (4328): No heartbeat from core client for 30 sec - exiting 18:49:10 (4328): No heartbeat from core client for 30 sec - exiting 18:49:11 (4328): No heartbeat from core client for 30 sec - exiting 18:49:12 (4328): No heartbeat from core client for 30 sec - exiting 18:49:13 (4328): No heartbeat from core client for 30 sec - exiting 18:49:14 (4328): No heartbeat from core client for 30 sec - exiting 18:49:15 (4328): No heartbeat from core client for 30 sec - exiting 18:49:16 (4328): No heartbeat from core client for 30 sec - exiting BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 forrtl: Det finns inte tillrackligt med utrymme pa disken. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3316, iMonCtr=1 Model crash detected, will try to restart... forrtl: Det finns inte tillrackligt med utrymme pa disken. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3316, iMonCtr=1 Model crash detected, will try to restart... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 forrtl: Det finns inte tillrackligt med utrymme pa disken. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3316, iMonCtr=1 Model crash detected, will try to restart... forrtl: Det finns inte tillrackligt med utrymme pa disken. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3316, iMonCtr=1 Model crash detected, will try to restart... forrtl: Det finns inte tillrackligt med utrymme pa disken. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3316, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Oct 2013 12:29:59	1285155	16063757	hadcm3n_o81t_1900_40_008465556_2	233,280	584,482	2.5055
29 Oct 2013 12:29:59	1285155	16063757	hadcm3n_o81t_1900_40_008465556_2	207,360	520,136	2.5084
29 Oct 2013 12:29:59	1285155	16063757	hadcm3n_o81t_1900_40_008465556_2	181,440	456,071	2.5136
23 Oct 2013 19:30:58	1285155	16063757	hadcm3n_o81t_1900_40_008465556_2	155,520	390,549	2.5112
22 Oct 2013 23:42:38	1285155	16063757	hadcm3n_o81t_1900_40_008465556_2	129,600	326,122	2.5164
22 Oct 2013 02:40:46	1285155	16063757	hadcm3n_o81t_1900_40_008465556_2	103,680	261,332	2.5206
21 Oct 2013 05:12:35	1285155	16063757	hadcm3n_o81t_1900_40_008465556_2	77,760	195,709	2.5168
20 Oct 2013 06:33:20	1285155	16063757	hadcm3n_o81t_1900_40_008465556_2	51,840	130,020	2.5081
19 Oct 2013 09:20:31	1285155	16063757	hadcm3n_o81t_1900_40_008465556_2	25,920	64,925	2.5048