Task 11217225

Name	hadsm3dhet2_k4jt_006615547_8
Workunit	6818920
Created	15 Mar 2010, 12:27:44 UTC
Sent	29 Apr 2010, 17:05:18 UTC
Report deadline	11 Apr 2011, 22:25:18 UTC
Received	18 Jul 2010, 15:08:35 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1051161
Run time	4 days 9 hours 19 min 43 sec
CPU time	4 days 0 hours 23 min 24 sec
Validate state	Invalid
Credit	3,870.49
Device peak FLOPS	0.00 GFLOPS
Application version	---
Stderr	<core_client_version>6.10.21</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. MainError: 12:11:50 AM No files match the supplied pattern. Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Model crashed: cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/jobs/yabsd.ihist cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/jobs/climate.spin cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/jobs/climate.cont cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/jobs/climate.doub cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/dataout/restart.day cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/datain/heatflux.ph1 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/datain/phase2.start forrtl: Bad file descriptor forrtl: severe (30): open failure, unit 6, file stdout Image PC Routine Line Source libirc.dylib 00B8B5E3 Unknown Unknown Unknown libirc.dylib 00B8A2D3 Unknown Unknown Unknown libifcoremt.dylib 008C5EFA Unknown Unknown Unknown libifcoremt.dylib 0083C2E0 Unknown Unknown Unknown libifcoremt.dylib 00879BCF Unknown Unknown Unknown hadsm3_um_6.09_i6 0027D503 Unknown Unknown Unknown hadsm3_um_6.09_i6 0029A2BE Unknown Unknown Unknown hadsm3_um_6.09_i6 000023B2 Unknown Unknown Unknown hadsm3_um_6.09_i6 000022D9 Unknown Unknown Unknown Unknown 00000003 Unknown Unknown Unknown CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9321, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/jobs/yabsd.ihist cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/jobs/climate.spin cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/jobs/climate.cont cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/jobs/climate.doub cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/dataout/restart.day cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/datain/heatflux.ph1 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/datain/phase2.start forrtl: Bad file descriptor forrtl: severe (30): open failure, unit 6, file stdout Image PC Routine Line Source libirc.dylib 00B8B5E3 Unknown Unknown Unknown libirc.dylib 00B8A2D3 Unknown Unknown Unknown libifcoremt.dylib 008C5EFA Unknown Unknown Unknown libifcoremt.dylib 0083C2E0 Unknown Unknown Unknown libifcoremt.dylib 00879BCF Unknown Unknown Unknown hadsm3_um_6.09_i6 0027D503 Unknown Unknown Unknown hadsm3_um_6.09_i6 0029A2BE Unknown Unknown Unknown hadsm3_um_6.09_i6 000023B2 Unknown Unknown Unknown hadsm3_um_6.09_i6 000022D9 Unknown Unknown Unknown Unknown 00000003 Unknown Unknown Unknown CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9321, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/jobs/yabsd.ihist cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/jobs/climate.spin cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/jobs/climate.cont cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/jobs/climate.doub cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/dataout/restart.day cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/datain/heatflux.ph1 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/datain/phase2.start forrtl: Bad file descriptor forrtl: severe (30): open failure, unit 6, file stdout Image PC Routine Line Source libirc.dylib 00B8B5E3 Unknown Unknown Unknown libirc.dylib 00B8A2D3 Unknown Unknown Unknown libifcoremt.dylib 008C5EFA Unknown Unknown Unknown libifcoremt.dylib 0083C2E0 Unknown Unknown Unknown libifcoremt.dylib 00879BCF Unknown Unknown Unknown hadsm3_um_6.09_i6 0027D503 Unknown Unknown Unknown hadsm3_um_6.09_i6 0029A2BE Unknown Unknown Unknown hadsm3_um_6.09_i6 000023B2 Unknown Unknown Unknown hadsm3_um_6.09_i6 000022D9 Unknown Unknown Unknown Unknown 00000003 Unknown Unknown Unknown CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9321, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/jobs/yabsd.ihist cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/jobs/climate.spin cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/jobs/climate.cont cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/jobs/climate.doub cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/dataout/restart.day cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/datain/heatflux.ph1 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/datain/phase2.start forrtl: Bad file descriptor forrtl: severe (30): open failure, unit 6, file stdout Image PC Routine Line Source libirc.dylib 00B8B5E3 Unknown Unknown Unknown libirc.dylib 00B8A2D3 Unknown Unknown Unknown libifcoremt.dylib 008C5EFA Unknown Unknown Unknown libifcoremt.dylib 0083C2E0 Unknown Unknown Unknown libifcoremt.dylib 00879BCF Unknown Unknown Unknown hadsm3_um_6.09_i6 0027D503 Unknown Unknown Unknown hadsm3_um_6.09_i6 0029A2BE Unknown Unknown Unknown hadsm3_um_6.09_i6 000023B2 Unknown Unknown Unknown hadsm3_um_6.09_i6 000022D9 Unknown Unknown Unknown Unknown 00000003 Unknown Unknown Unknown CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9321, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/jobs/yabsd.ihist cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/jobs/climate.spin cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/jobs/climate.cont cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/jobs/climate.doub cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/dataout/restart.day cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/datain/heatflux.ph1 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4jt_006615547/datain/phase2.start forrtl: Bad file descriptor forrtl: severe (30): open failure, unit 6, file stdout Image PC Routine Line Source libirc.dylib 00B8B5E3 Unknown Unknown Unknown libirc.dylib 00B8A2D3 Unknown Unknown Unknown libifcoremt.dylib 008C5EFA Unknown Unknown Unknown libifcoremt.dylib 0083C2E0 Unknown Unknown Unknown libifcoremt.dylib 00879BCF Unknown Unknown Unknown hadsm3_um_6.09_i6 0027D503 Unknown Unknown Unknown hadsm3_um_6.09_i6 0029A2BE Unknown Unknown Unknown hadsm3_um_6.09_i6 000023B2 Unknown Unknown Unknown hadsm3_um_6.09_i6 000022D9 Unknown Unknown Unknown Unknown 00000003 Unknown Unknown Unknown CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9321, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Jul 2010 12:47:58	1051161	11217225	hadsm3dhet2_k4jt_006615547_8	162,030	342,726	0.8135
22 Jun 2010 12:49:54	1051161	11217225	hadsm3dhet2_k4jt_006615547_8	151,228	333,989	0.8137
22 Jun 2010 09:20:13	1051161	11217225	hadsm3dhet2_k4jt_006615547_8	140,426	325,247	0.8138
22 Jun 2010 05:46:57	1051161	11217225	hadsm3dhet2_k4jt_006615547_8	129,624	316,508	0.8139
21 Jun 2010 09:53:07	1051161	11217225	hadsm3dhet2_k4jt_006615547_8	118,822	307,776	0.8141
18 Jun 2010 11:16:12	1051161	11217225	hadsm3dhet2_k4jt_006615547_8	108,020	299,042	0.8142
18 Jun 2010 07:39:04	1051161	11217225	hadsm3dhet2_k4jt_006615547_8	97,218	290,319	0.8144
16 Jun 2010 11:50:31	1051161	11217225	hadsm3dhet2_k4jt_006615547_8	86,416	281,569	0.8146
16 Jun 2010 08:17:07	1051161	11217225	hadsm3dhet2_k4jt_006615547_8	75,614	272,864	0.8149
12 Jun 2010 17:20:23	1051161	11217225	hadsm3dhet2_k4jt_006615547_8	64,812	264,125	0.8150
11 Jun 2010 15:02:41	1051161	11217225	hadsm3dhet2_k4jt_006615547_8	54,010	255,344	0.8151
03 Jun 2010 13:15:17	1051161	11217225	hadsm3dhet2_k4jt_006615547_8	43,208	246,613	0.8154
03 Jun 2010 13:15:17	1051161	11217225	hadsm3dhet2_k4jt_006615547_8	32,406	237,865	0.8156
31 May 2010 09:22:26	1051161	11217225	hadsm3dhet2_k4jt_006615547_8	21,604	229,080	0.8157
24 May 2010 04:05:52	1051161	11217225	hadsm3dhet2_k4jt_006615547_8	10,802	220,351	0.8160
24 May 2010 00:18:40	1051161	11217225	hadsm3dhet2_k4jt_006615547_8	259,248	211,645	0.8164
22 May 2010 19:04:24	1051161	11217225	hadsm3dhet2_k4jt_006615547_8	248,446	202,813	0.8163
22 May 2010 19:04:24	1051161	11217225	hadsm3dhet2_k4jt_006615547_8	237,644	193,942	0.8161
20 May 2010 09:42:13	1051161	11217225	hadsm3dhet2_k4jt_006615547_8	226,842	184,999	0.8155
19 May 2010 10:07:38	1051161	11217225	hadsm3dhet2_k4jt_006615547_8	216,040	176,170	0.8155