Task 14068519

Name	hadcm3n_yfub_1980_40_007751565_1
Workunit	7906674
Created	6 Feb 2012, 7:15:35 UTC
Sent	6 Feb 2012, 7:15:48 UTC
Report deadline	7 May 2012, 14:42:59 UTC
Received	29 Feb 2012, 3:31:30 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1095198
Run time	8 days 19 hours 50 min 32 sec
CPU time	6 days 22 hours 26 min 38 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.00 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 16:14:20 (25491): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 16:14:21 (25491): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 10:24:44 (21461): No heartbeat from core client for 30 sec - exiting 10:24:49 (21461): No heartbeat from core client for 30 sec - exiting 10:24:50 (21461): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 10:24:51 (21461): No heartbeat from core client for 30 sec - exiting cpdnmonitor: error reading file /afs/rchland.ibm.com/rel/common/proj/timingdev/alter/BOINC/projects/climateprediction.net/hadcm3n_yfub_1980_40_007751565/dataout/atmos_restart.day BUFFIN: Read Failed: Interrupted system call BUFFIN: C I/O Error ferror - Unit 116 - Return code = 1 Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /afs/rchland.ibm.com/rel/common/proj/timingdev/alter/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /afs/rchland.ibm.com/rel/common/proj/timingdev/alter/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /afs/rchland.ibm.com/rel/common/proj/timingdev/alter/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /afs/rchland.ibm.com/rel/common/proj/timingdev/alter/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /afs/rchland.ibm.com/rel/common/proj/timingdev/alter/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /afs/rchland.ibm.com/rel/common/proj/timingdev/alter/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /afs/rchland.ibm.com/rel/common/proj/timingdev/alter/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /afs/rchland.ibm.com/rel/common/proj/timingdev/alter/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) 11:12:58 (1822): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:12:59 (1822): No heartbeat from core client for 30 sec - exiting 11:13:00 (1822): No heartbeat from core client for 30 sec - exiting 11:13:01 (1822): No heartbeat from core client for 30 sec - exiting Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /afs/rchland.ibm.com/rel/common/proj/timingdev/alter/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /afs/rchland.ibm.com/rel/common/proj/timingdev/alter/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /afs/rchland.ibm.com/rel/common/proj/timingdev/alter/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) OPEN: File Creation Failed: Disk quota exceeded OPEN: Unable to Open File dataout/yfubko.daj1710 for Read/Write Model crashed: DUMPCTL : Fail to open output dump - may already exist tmp/pipe_dummy 2048 OPEN: File Creation Failed: Disk quota exceeded OPEN: Unable to Open File dataout/yfubko.daj1810 for Read/Write Model crashed: DUMPCTL : Fail to open output dump - may already exist tmp/pipe_dummy 2048 OPEN: File Creation Failed: Disk quota exceeded OPEN: Unable to Open File dataout/yfubka.daj1810 for Read/Write Model crashed: DUMPCTL : Fail to open output dump - may already exist tmp/pipe_dummy 2048 OPEN: File Creation Failed: Disk quota exceeded OPEN: Unable to Open File dataout/yfubka.daj1810 for Read/Write Model crashed: DUMPCTL : Fail to open output dump - may already exist tmp/pipe_dummy 2048 OPEN: File Creation Failed: Disk quota exceeded OPEN: Unable to Open File dataout/yfubka.daj1810 for Read/Write Model crashed: DUMPCTL : Fail to open output dump - may already exist tmp/pipe_dummy 2048 OPEN: File Creation Failed: Disk quota exceeded OPEN: Unable to Open File dataout/yfubka.daj1810 for Read/Write Model crashed: DUMPCTL : Fail to open output dump - may already exist tmp/pipe_dummy 2048 </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Feb 2012 15:16:04	1095198	14068519	hadcm3n_yfub_1980_40_007751565_1	259,200	672,614	2.5950
27 Feb 2012 19:21:38	1095198	14068519	hadcm3n_yfub_1980_40_007751565_1	233,280	604,918	2.5931
27 Feb 2012 00:32:41	1095198	14068519	hadcm3n_yfub_1980_40_007751565_1	207,360	538,030	2.5947
26 Feb 2012 04:07:31	1095198	14068519	hadcm3n_yfub_1980_40_007751565_1	181,440	471,045	2.5961
25 Feb 2012 08:25:07	1095198	14068519	hadcm3n_yfub_1980_40_007751565_1	155,520	403,731	2.5960
23 Feb 2012 19:18:02	1095198	14068519	hadcm3n_yfub_1980_40_007751565_1	129,600	336,920	2.5997
22 Feb 2012 23:59:12	1095198	14068519	hadcm3n_yfub_1980_40_007751565_1	103,680	269,895	2.6032
21 Feb 2012 08:52:17	1095198	14068519	hadcm3n_yfub_1980_40_007751565_1	77,760	202,750	2.6074
20 Feb 2012 05:52:58	1095198	14068519	hadcm3n_yfub_1980_40_007751565_1	51,840	135,527	2.6143
18 Feb 2012 19:20:53	1095198	14068519	hadcm3n_yfub_1980_40_007751565_1	25,920	68,452	2.6409