Task 13794861

Name	hadcm3n_t1ds_1940_40_007445051_4
Workunit	7642554
Created	18 Dec 2011, 21:45:53 UTC
Sent	18 Dec 2011, 21:46:11 UTC
Report deadline	19 Mar 2012, 5:13:22 UTC
Received	1 Feb 2012, 0:23:35 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1180066
Run time	5 days 11 hours 5 min 59 sec
CPU time	5 days 9 hours 34 min 48 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.31 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:48:21 (2657): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:48:27 (2657): No heartbeat from core client for 30 sec - exiting 13:48:28 (2657): No heartbeat from core client for 30 sec - exiting 13:48:29 (2657): No heartbeat from core client for 30 sec - exiting 13:48:30 (2657): No heartbeat from core client for 30 sec - exiting 13:48:31 (2657): No heartbeat from core client for 30 sec - exiting 13:48:32 (2657): No heartbeat from core client for 30 sec - exiting 13:48:33 (2657): No heartbeat from core client for 30 sec - exiting 13:48:34 (2657): No heartbeat from core client for 30 sec - exiting 13:48:35 (2657): No heartbeat from core client for 30 sec - exiting 13:48:36 (2657): No heartbeat from core client for 30 sec - exiting 13:48:37 (2657): No heartbeat from core client for 30 sec - exiting 13:48:38 (2657): No heartbeat from core client for 30 sec - exiting 13:48:39 (2657): No heartbeat from core client for 30 sec - exiting 13:48:40 (2657): No heartbeat from core client for 30 sec - exiting 13:48:41 (2657): No heartbeat from core client for 30 sec - exiting 13:48:42 (2657): No heartbeat from core client for 30 sec - exiting 13:48:43 (2657): No heartbeat from core client for 30 sec - exiting 13:48:44 (2657): No heartbeat from core client for 30 sec - exiting 13:48:45 (2657): No heartbeat from core client for 30 sec - exiting 13:48:46 (2657): No heartbeat from core client for 30 sec - exiting 13:48:47 (2657): No heartbeat from core client for 30 sec - exiting 13:48:48 (2657): No heartbeat from core client for 30 sec - exiting 13:48:49 (2657): No heartbeat from core client for 30 sec - exiting 13:48:50 (2657): No heartbeat from core client for 30 sec - exiting 13:48:51 (2657): No heartbeat from core client for 30 sec - exiting 13:48:52 (2657): No heartbeat from core client for 30 sec - exiting 13:48:53 (2657): No heartbeat from core client for 30 sec - exiting 13:48:54 (2657): No heartbeat from core client for 30 sec - exiting 13:48:55 (2657): No heartbeat from core client for 30 sec - exiting 13:48:56 (2657): No heartbeat from core client for 30 sec - exiting 13:48:57 (2657): No heartbeat from core client for 30 sec - exiting 13:48:58 (2657): No heartbeat from core client for 30 sec - exiting 13:48:59 (2657): No heartbeat from core client for 30 sec - exiting 13:49:00 (2657): No heartbeat from core client for 30 sec - exiting 13:49:01 (2657): No heartbeat from core client for 30 sec - exiting 13:49:02 (2657): No heartbeat from core client for 30 sec - exiting 13:49:03 (2657): No heartbeat from core client for 30 sec - exiting 13:49:04 (2657): No heartbeat from core client for 30 sec - exiting 13:49:05 (2657): No heartbeat from core client for 30 sec - exiting 13:49:06 (2657): No heartbeat from core client for 30 sec - exiting 13:49:07 (2657): No heartbeat from core client for 30 sec - exiting 13:49:08 (2657): No heartbeat from core client for 30 sec - exiting 13:49:09 (2657): No heartbeat from core client for 30 sec - exiting 13:49:10 (2657): No heartbeat from core client for 30 sec - exiting 13:49:11 (2657): No heartbeat from core client for 30 sec - exiting 13:49:12 (2657): No heartbeat from core client for 30 sec - exiting 13:49:13 (2657): No heartbeat from core client for 30 sec - exiting 13:49:14 (2657): No heartbeat from core client for 30 sec - exiting 13:49:15 (2657): No heartbeat from core client for 30 sec - exiting 13:49:16 (2657): No heartbeat from core client for 30 sec - exiting 13:49:17 (2657): No heartbeat from core client for 30 sec - exiting 13:49:18 (2657): No heartbeat from core client for 30 sec - exiting 13:49:19 (2657): No heartbeat from core client for 30 sec - exiting 13:49:20 (2657): No heartbeat from core client for 30 sec - exiting 13:49:21 (2657): No heartbeat from core client for 30 sec - exiting 13:49:22 (2657): No heartbeat from core client for 30 sec - exiting 13:49:23 (2657): No heartbeat from core client for 30 sec - exiting 13:49:24 (2657): No heartbeat from core client for 30 sec - exiting 13:49:25 (2657): No heartbeat from core client for 30 sec - exiting 13:49:27 (2657): No heartbeat from core client for 30 sec - exiting 13:49:28 (2657): No heartbeat from core client for 30 sec - exiting 13:49:29 (2657): No heartbeat from core client for 30 sec - exiting 13:49:30 (2657): No heartbeat from core client for 30 sec - exiting 13:49:31 (2657): No heartbeat from core client for 30 sec - exiting 13:49:32 (2657): No heartbeat from core client for 30 sec - exiting 13:49:33 (2657): No heartbeat from core client for 30 sec - exiting 13:49:34 (2657): No heartbeat from core client for 30 sec - exiting 13:49:35 (2657): No heartbeat from core client for 30 sec - exiting 13:49:36 (2657): No heartbeat from core client for 30 sec - exiting 13:49:37 (2657): No heartbeat from core client for 30 sec - exiting 13:49:38 (2657): No heartbeat from core client for 30 sec - exiting 13:49:39 (2657): No heartbeat from core client for 30 sec - exiting 13:49:40 (2657): No heartbeat from core client for 30 sec - exiting 13:49:41 (2657): No heartbeat from core client for 30 sec - exiting 13:49:42 (2657): No heartbeat from core client for 30 sec - exiting 13:49:43 (2657): No heartbeat from core client for 30 sec - exiting 13:49:44 (2657): No heartbeat from core client for 30 sec - exiting 13:49:45 (2657): No heartbeat from core client for 30 sec - exiting 13:49:46 (2657): No heartbeat from core client for 30 sec - exiting 13:49:47 (2657): No heartbeat from core client for 30 sec - exiting 13:49:48 (2657): No heartbeat from core client for 30 sec - exiting 13:49:49 (2657): No heartbeat from core client for 30 sec - exiting 13:49:50 (2657): No heartbeat from core client for 30 sec - exiting 13:49:51 (2657): No heartbeat from core client for 30 sec - exiting 13:49:52 (2657): No heartbeat from core client for 30 sec - exiting 13:49:53 (2657): No heartbeat from core client for 30 sec - exiting 13:49:54 (2657): No heartbeat from core client for 30 sec - exiting 13:49:55 (2657): No heartbeat from core client for 30 sec - exiting 13:49:56 (2657): No heartbeat from core client for 30 sec - exiting 13:49:57 (2657): No heartbeat from core client for 30 sec - exiting 13:49:58 (2657): No heartbeat from core client for 30 sec - exiting 13:49:59 (2657): No heartbeat from core client for 30 sec - exiting 13:50:00 (2657): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:24:25 (5114): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:26:22 (5273): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:28:16 (5280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:30:12 (5291): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:34:04 (5304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:36:03 (5315): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:38:01 (5327): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:39:55 (5338): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:43:47 (5350): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:45:41 (5361): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:49:33 (5373): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:51:57 (5384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:57:27 (5392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:00:31 (5404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:03:16 (5416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:05:10 (5425): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:10:04 (5436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:12:48 (5448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:15:37 (5457): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:18:56 (5471): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:21:25 (5483): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:16 (5494): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_t1ds_1940_40_007445051/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_t1ds_1940_40_007445051/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_t1ds_1940_40_007445051/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_t1ds_1940_40_007445051/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_t1ds_1940_40_007445051/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_t1ds_1940_40_007445051/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_t1ds_1940_40_007445051/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_t1ds_1940_40_007445051/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_t1ds_1940_40_007445051/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_t1ds_1940_40_007445051/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_t1ds_1940_40_007445051/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_t1ds_1940_40_007445051/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Feb 2012 00:25:54	1180066	13794861	hadcm3n_t1ds_1940_40_007445051_4	259,200	466,510	1.7998
28 Jan 2012 21:40:31	1180066	13794861	hadcm3n_t1ds_1940_40_007445051_4	233,280	419,577	1.7986
27 Jan 2012 22:58:19	1180066	13794861	hadcm3n_t1ds_1940_40_007445051_4	207,360	373,208	1.7998
23 Jan 2012 11:55:59	1180066	13794861	hadcm3n_t1ds_1940_40_007445051_4	181,440	326,918	1.8018
21 Jan 2012 04:09:30	1180066	13794861	hadcm3n_t1ds_1940_40_007445051_4	155,520	280,035	1.8006
15 Jan 2012 04:04:29	1180066	13794861	hadcm3n_t1ds_1940_40_007445051_4	129,600	233,567	1.8022
02 Jan 2012 12:30:40	1180066	13794861	hadcm3n_t1ds_1940_40_007445051_4	103,680	187,044	1.8041
26 Dec 2011 20:39:05	1180066	13794861	hadcm3n_t1ds_1940_40_007445051_4	77,760	140,054	1.8011
25 Dec 2011 14:35:04	1180066	13794861	hadcm3n_t1ds_1940_40_007445051_4	51,840	93,745	1.8084
24 Dec 2011 20:00:04	1180066	13794861	hadcm3n_t1ds_1940_40_007445051_4	25,920	47,215	1.8216