Task 12017733

Name	hadcm3igeo_w1cv_2000_80_06761298_0
Workunit	6964614
Created	12 Nov 2010, 15:32:15 UTC
Sent	13 Nov 2010, 22:57:08 UTC
Report deadline	14 May 2012, 19:40:17 UTC
Received	7 Dec 2010, 11:02:38 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	974339
Run time	2 days 20 hours 8 min 53 sec
CPU time	2 days 14 hours 14 min 3 sec
Validate state	Invalid
Credit	1,306.37
Device peak FLOPS	2.28 GFLOPS
Application version	HadCM3L Coupled Model Experiment Optimised File I/O v6.04 windows_intelx86
Stderr	<core_client_version>6.6.20</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5672, iMonCtr=1 Model crash detected, will try to restart... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... CNo heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt No heartbCPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error in converting file dataout/w1cvfo.pjk3c10 to netcdf format. Error in converting file dataout/w1cvfo.pik3c10 to netcdf format. Error in converting file dataout/w1cvfo.pfk3c10 to netcdf format. Error in converting file dataout/w1cvfa.phk3c10 to netcdf format. Error in converting file dataout/w1cvfa.pgk3c10 to netcdf format. Error in converting file dataout/w1cvfa.pek3c10 to netcdf format. Error in converting file dataout/w1cvfa.pdk3c10 to netcdf format. scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... CPDN NetCDF Err #2 - No such file or directory CPDN NetCDF Err #2 - No such file or directory CPDN NetCDF Err #2 - No such file or directory CPDN NetCDF Err #2 - No such file or directory MainError: 10:52:45 AM No files match the supplied pattern. MainError: 10:52:45 AM No files match the supplied pattern. scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... scan: boinc_lockfile scan: einstein_S5GC1_3.02_windows_intelx86__S5GCESSE2.exe scan: GCT.out scan: init_data.xml scan: stderr.old scan: stderr.txt </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Dec 2010 10:59:28	974339	12017733	hadcm3igeo_w1cv_2000_80_06761298_0	103,680	224,391	2.1643
01 Dec 2010 10:05:56	974339	12017733	hadcm3igeo_w1cv_2000_80_06761298_0	77,760	168,007	2.1606
20 Nov 2010 15:30:33	974339	12017733	hadcm3igeo_w1cv_2000_80_06761298_0	51,840	112,481	2.1698
18 Nov 2010 21:33:45	974339	12017733	hadcm3igeo_w1cv_2000_80_06761298_0	25,920	56,298	2.1720