Task 15521341

Name	hadcm3n_3kk9_1940_40_008259839_2
Workunit	8414963
Created	2 Jan 2013, 9:50:52 UTC
Sent	2 Jan 2013, 9:51:06 UTC
Report deadline	3 Apr 2013, 17:18:17 UTC
Received	19 Jan 2013, 1:24:43 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1228845
Run time	6 days 15 hours 33 min 48 sec
CPU time	1 days 18 hours 53 min 14 sec
Validate state	Invalid
Credit	3,732.48
Device peak FLOPS	3.18 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8292, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 forrtl: There is not enough space on the disk. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7300, iMonCtr=1 Model crash detected, will try to restart... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Jan 2013 14:56:28	1228845	15521341	hadcm3n_3kk9_1940_40_008259839_2	311,040	255,213	0.8205
18 Jan 2013 00:17:32	1228845	15521341	hadcm3n_3kk9_1940_40_008259839_2	285,120	207,734	0.7286
17 Jan 2013 09:04:39	1228845	15521341	hadcm3n_3kk9_1940_40_008259839_2	259,200	161,986	0.6249
16 Jan 2013 15:46:06	1228845	15521341	hadcm3n_3kk9_1940_40_008259839_2	233,280	368,912	1.5814
16 Jan 2013 01:40:59	1228845	15521341	hadcm3n_3kk9_1940_40_008259839_2	207,360	321,166	1.5488
15 Jan 2013 10:13:53	1228845	15521341	hadcm3n_3kk9_1940_40_008259839_2	181,440	274,936	1.5153
14 Jan 2013 19:43:14	1228845	15521341	hadcm3n_3kk9_1940_40_008259839_2	155,520	229,093	1.4731
14 Jan 2013 04:37:44	1228845	15521341	hadcm3n_3kk9_1940_40_008259839_2	129,600	183,578	1.4165
13 Jan 2013 15:25:28	1228845	15521341	hadcm3n_3kk9_1940_40_008259839_2	103,680	149,235	1.4394
13 Jan 2013 08:19:22	1228845	15521341	hadcm3n_3kk9_1940_40_008259839_2	77,760	120,446	1.5489
12 Jan 2013 20:56:24	1228845	15521341	hadcm3n_3kk9_1940_40_008259839_2	51,840	91,000	1.7554
12 Jan 2013 06:48:57	1228845	15521341	hadcm3n_3kk9_1940_40_008259839_2	25,920	48,094	1.8555