Task 15720779

Name	hadcm3n_3amr_1940_40_008264686_4
Workunit	8419810
Created	11 Apr 2013, 0:01:59 UTC
Sent	11 Apr 2013, 0:02:29 UTC
Report deadline	11 Jul 2013, 7:29:40 UTC
Received	5 Jun 2013, 13:14:15 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1436881
Run time	11 days 8 hours 17 min 37 sec
CPU time	10 days 0 hours 34 min 47 sec
Validate state	Invalid
Credit	4,976.64
Device peak FLOPS	2.01 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> Urządzenie nie rozpoznaje polecenia. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: dataout/3amrko.pje1c10 Error converting file to netcdf: dataout/3amrko.pie1c10 Error converting file to netcdf: dataout/3amrko.pfe1c10 Error converting file to netcdf: dataout/3amrka.phe1c10 Error converting file to netcdf: dataout/3amrka.pge1c10 Error converting file to netcdf: dataout/3amrka.pee1c10 Error converting file to netcdf: dataout/3amrka.pde1c10 MainError: 05:58:08 PM No files match the supplied pattern. MainError: 05:58:08 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: dataout/3amrko.pje2c10 Error converting file to netcdf: dataout/3amrko.pie2c10 Error converting file to netcdf: dataout/3amrko.pfe2c10 Error converting file to netcdf: dataout/3amrka.phe2c10 Error converting file to netcdf: dataout/3amrka.pge2c10 Error converting file to netcdf: dataout/3amrka.pee2c10 Error converting file to netcdf: dataout/3amrka.pde2c10 MainError: 11:14:15 AM No files match the supplied pattern. MainError: 11:14:15 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7316, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: dataout/3amrko.pje3c10 Error converting file to netcdf: dataout/3amrko.pie3c10 Error converting file to netcdf: dataout/3amrko.pfe3c10 Error converting file to netcdf: dataout/3amrka.phe3c10 Error converting file to netcdf: dataout/3amrka.pge3c10 Error converting file to netcdf: dataout/3amrka.pee3c10 Error converting file to netcdf: dataout/3amrka.pde3c10 MainError: 07:59:46 AM No files match the supplied pattern. MainError: 07:59:46 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: dataout/3amrko.pje4c10 Error converting file to netcdf: dataout/3amrko.pie4c10 Error converting file to netcdf: dataout/3amrko.pfe4c10 Error converting file to netcdf: dataout/3amrka.phe4c10 Error converting file to netcdf: dataout/3amrka.pge4c10 Error converting file to netcdf: dataout/3amrka.pee4c10 Error converting file to netcdf: dataout/3amrka.pde4c10 MainError: 04:06:52 AM No files match the supplied pattern. MainError: 04:06:52 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: dataout/3amrko.pje5c10 Error converting file to netcdf: dataout/3amrko.pie5c10 Error converting file to netcdf: dataout/3amrko.pfe5c10 Error converting file to netcdf: dataout/3amrka.phe5c10 Error converting file to netcdf: dataout/3amrka.pge5c10 Error converting file to netcdf: dataout/3amrka.pee5c10 Error converting file to netcdf: dataout/3amrka.pde5c10 MainError: 11:19:26 AM No files match the supplied pattern. MainError: 11:19:26 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: dataout/3amrko.pje6c10 Error converting file to netcdf: dataout/3amrko.pie6c10 Error converting file to netcdf: dataout/3amrko.pfe6c10 Error converting file to netcdf: dataout/3amrka.phe6c10 Error converting file to netcdf: dataout/3amrka.pge6c10 Error converting file to netcdf: dataout/3amrka.pee6c10 Error converting file to netcdf: dataout/3amrka.pde6c10 MainError: 02:31:36 AM No files match the supplied pattern. MainError: 02:31:36 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... 16:54:02 (4580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: dataout/3amrko.pje7c10 Error converting file to netcdf: dataout/3amrko.pie7c10 Error converting file to netcdf: dataout/3amrko.pfe7c10 Error converting file to netcdf: dataout/3amrka.phe7c10 Error converting file to netcdf: dataout/3amrka.pge7c10 Error converting file to netcdf: dataout/3amrka.pee7c10 Error converting file to netcdf: dataout/3amrka.pde7c10 MainError: 07:50:43 PM No files match the supplied pattern. MainError: 07:50:43 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: dataout/3amrko.pje8c10 Error converting file to netcdf: dataout/3amrko.pie8c10 Error converting file to netcdf: dataout/3amrko.pfe8c10 Error converting file to netcdf: dataout/3amrka.phe8c10 Error converting file to netcdf: dataout/3amrka.pge8c10 Error converting file to netcdf: dataout/3amrka.pee8c10 Error converting file to netcdf: dataout/3amrka.pde8c10 MainError: 09:22:17 AM No files match the supplied pattern. MainError: 09:22:17 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: dataout/3amrko.pje9c10 Error converting file to netcdf: dataout/3amrko.pie9c10 Error converting file to netcdf: dataout/3amrko.pfe9c10 Error converting file to netcdf: dataout/3amrka.phe9c10 Error converting file to netcdf: dataout/3amrka.pge9c10 Error converting file to netcdf: dataout/3amrka.pee9c10 Error converting file to netcdf: dataout/3amrka.pde9c10 MainError: 01:38:13 PM No files match the supplied pattern. MainError: 01:38:13 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: dataout/3amrko.pjf0c10 Error converting file to netcdf: dataout/3amrko.pif0c10 Error converting file to netcdf: dataout/3amrko.pff0c10 Error converting file to netcdf: dataout/3amrko.pcf0c10 Error converting file to netcdf: dataout/3amrko.pbf0c10 Error converting file to netcdf: dataout/3amrko.paf0c10 Error converting file to netcdf: dataout/3amrka.phf0c10 Error converting file to netcdf: dataout/3amrka.pgf0c10 Error converting file to netcdf: dataout/3amrka.pef0c10 Error converting file to netcdf: dataout/3amrka.pdf0c10 MainError: 02:46:35 AM No files match the supplied pattern. MainError: 02:46:35 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:43:58 (5492): No heartbeat from core client for 30 sec - exiting 01:43:59 (5492): No heartbeat from core client for 30 sec - exiting 01:44:00 (5492): No heartbeat from core client for 30 sec - exiting 01:44:01 (5492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Error converting file to netcdf: dataout/3amrko.pjf1c10 Error converting file to netcdf: dataout/3amrko.pif1c10 Error converting file to netcdf: dataout/3amrko.pff1c10 Error converting file to netcdf: dataout/3amrka.phf1c10 Error converting file to netcdf: dataout/3amrka.pgf1c10 Error converting file to netcdf: dataout/3amrka.pef1c10 Error converting file to netcdf: dataout/3amrka.pdf1c10 MainError: 12:48:38 AM No files match the supplied pattern. MainError: 12:48:38 AM No files match the supplied pattern. Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:00:08 (2552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:00:09 (2552): No heartbeat from core client for 30 sec - exiting 19:00:10 (2552): No heartbeat from core client for 30 sec - exiting 19:00:11 (2552): No heartbeat from core client for 30 sec - exiting 19:27:29 (6188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: dataout/3amrko.pjf2c10 Error converting file to netcdf: dataout/3amrko.pif2c10 Error converting file to netcdf: dataout/3amrko.pff2c10 Error converting file to netcdf: dataout/3amrka.phf2c10 Error converting file to netcdf: dataout/3amrka.pgf2c10 Error converting file to netcdf: dataout/3amrka.pef2c10 Error converting file to netcdf: dataout/3amrka.pdf2c10 MainError: 05:14:13 AM No files match the supplied pattern. MainError: 05:14:13 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: dataout/3amrko.pjf3c10 Error converting file to netcdf: dataout/3amrko.pif3c10 Error converting file to netcdf: dataout/3amrko.pff3c10 Error converting file to netcdf: dataout/3amrka.phf3c10 Error converting file to netcdf: dataout/3amrka.pgf3c10 Error converting file to netcdf: dataout/3amrka.pef3c10 Error converting file to netcdf: dataout/3amrka.pdf3c10 MainError: 03:19:36 AM No files match the supplied pattern. MainError: 03:19:36 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:50:53 (6436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: dataout/3amrko.pjf4c10 Error converting file to netcdf: dataout/3amrko.pif4c10 Error converting file to netcdf: dataout/3amrko.pff4c10 Error converting file to netcdf: dataout/3amrka.phf4c10 Error converting file to netcdf: dataout/3amrka.pgf4c10 Error converting file to netcdf: dataout/3amrka.pef4c10 Error converting file to netcdf: dataout/3amrka.pdf4c10 MainError: 09:44:23 AM No files match the supplied pattern. MainError: 09:44:23 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: dataout/3amrko.pjf5c10 Error converting file to netcdf: dataout/3amrko.pif5c10 Error converting file to netcdf: dataout/3amrko.pff5c10 Error converting file to netcdf: dataout/3amrka.phf5c10 Error converting file to netcdf: dataout/3amrka.pgf5c10 Error converting file to netcdf: dataout/3amrka.pef5c10 Error converting file to netcdf: dataout/3amrka.pdf5c10 MainError: 11:28:33 PM No files match the supplied pattern. MainError: 11:28:33 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: dataout/3amrko.pjf6c10 Error converting file to netcdf: dataout/3amrko.pif6c10 Error converting file to netcdf: dataout/3amrko.pff6c10 Error converting file to netcdf: dataout/3amrka.phf6c10 Error converting file to netcdf: dataout/3amrka.pgf6c10 Error converting file to netcdf: dataout/3amrka.pef6c10 Error converting file to netcdf: dataout/3amrka.pdf6c10 MainError: 04:40:58 PM No files match the supplied pattern. MainError: 04:40:58 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Jun 2013 16:43:46	1175522	15720779	hadcm3n_3amr_1940_40_008264686_4	414,720	854,424	2.0602
02 Jun 2013 23:30:56	1175522	15720779	hadcm3n_3amr_1940_40_008264686_4	388,800	799,601	2.0566
29 May 2013 09:48:16	1175522	15720779	hadcm3n_3amr_1940_40_008264686_4	362,880	746,342	2.0567
28 May 2013 03:21:44	1175522	15720779	hadcm3n_3amr_1940_40_008264686_4	336,960	692,391	2.0548
27 May 2013 05:17:46	1175522	15720779	hadcm3n_3amr_1940_40_008264686_4	311,040	639,174	2.0550
25 May 2013 11:28:00	1175522	15720779	hadcm3n_3amr_1940_40_008264686_4	285,120	586,940	2.0586
20 May 2013 03:23:59	1175522	15720779	hadcm3n_3amr_1940_40_008264686_4	259,200	534,525	2.0622
15 May 2013 13:42:14	1175522	15720779	hadcm3n_3amr_1940_40_008264686_4	233,280	481,862	2.0656
07 May 2013 09:26:45	1175522	15720779	hadcm3n_3amr_1940_40_008264686_4	207,360	428,874	2.0683
01 May 2013 19:55:39	1175522	15720779	hadcm3n_3amr_1940_40_008264686_4	181,440	375,150	2.0676
29 Apr 2013 02:35:51	1175522	15720779	hadcm3n_3amr_1940_40_008264686_4	155,520	321,880	2.0697
24 Apr 2013 11:20:58	1175522	15720779	hadcm3n_3amr_1940_40_008264686_4	129,600	268,585	2.0724
23 Apr 2013 04:52:44	1175522	15720779	hadcm3n_3amr_1940_40_008264686_4	103,680	215,726	2.0807
20 Apr 2013 08:03:42	1175522	15720779	hadcm3n_3amr_1940_40_008264686_4	77,760	160,572	2.0650
19 Apr 2013 11:14:29	1175522	15720779	hadcm3n_3amr_1940_40_008264686_4	51,840	106,036	2.0454
15 Apr 2013 17:59:17	1175522	15720779	hadcm3n_3amr_1940_40_008264686_4	25,920	52,725	2.0341