Task 13407321

Name	hadcm3n_u3ze_1980_40_007458603_0
Workunit	7656106
Created	22 Sep 2011, 15:32:32 UTC
Sent	25 Sep 2011, 22:14:10 UTC
Report deadline	26 Dec 2011, 5:41:21 UTC
Received	25 Nov 2011, 3:50:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1089959
Run time	4 days 22 hours 25 min 49 sec
CPU time	4 days 21 hours 9 min 9 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.81 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7184, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/u3zeko.pji5c10 Error converting file to netcdf: dataout/u3zeko.pii5c10 Error converting file to netcdf: dataout/u3zeko.pfi5c10 Error converting file to netcdf: dataout/u3zeka.phi5c10 Error converting file to netcdf: dataout/u3zeka.pgi5c10 Error converting file to netcdf: dataout/u3zeka.pei5c10 Error converting file to netcdf: dataout/u3zeka.pdi5c10 CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/u3zeko.pji5c10 Error converting file to netcdf: dataout/u3zeko.pii5c10 Error converting file to netcdf: dataout/u3zeko.pfi5c10 Error converting file to netcdf: dataout/u3zeka.phi5c10 Error converting file to netcdf: dataout/u3zeka.pgi5c10 Error converting file to netcdf: dataout/u3zeka.pei5c10 Error converting file to netcdf: dataout/u3zeka.pdi5c10 CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/u3zeko.pji5c10 Error converting file to netcdf: dataout/u3zeko.pii5c10 Error converting file to netcdf: dataout/u3zeko.pfi5c10 Error converting file to netcdf: dataout/u3zeka.phi5c10 Error converting file to netcdf: dataout/u3zeka.pgi5c10 Error converting file to netcdf: dataout/u3zeka.pei5c10 Error converting file to netcdf: dataout/u3zeka.pdi5c10 CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/u3zeko.pji5c10 Error converting file to netcdf: dataout/u3zeko.pii5c10 Error converting file to netcdf: dataout/u3zeko.pfi5c10 Error converting file to netcdf: dataout/u3zeka.phi5c10 Error converting file to netcdf: dataout/u3zeka.pgi5c10 Error converting file to netcdf: dataout/u3zeka.pei5c10 Error converting file to netcdf: dataout/u3zeka.pdi5c10 CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/u3zeko.pji5c10 Error converting file to netcdf: dataout/u3zeko.pii5c10 Error converting file to netcdf: dataout/u3zeko.pfi5c10 Error converting file to netcdf: dataout/u3zeka.phi5c10 Error converting file to netcdf: dataout/u3zeka.pgi5c10 Error converting file to netcdf: dataout/u3zeka.pei5c10 Error converting file to netcdf: dataout/u3zeka.pdi5c10 CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/u3zeko.pji5c10 Error converting file to netcdf: dataout/u3zeko.pii5c10 Error converting file to netcdf: dataout/u3zeko.pfi5c10 Error converting file to netcdf: dataout/u3zeka.phi5c10 Error converting file to netcdf: dataout/u3zeka.pgi5c10 Error converting file to netcdf: dataout/u3zeka.pei5c10 Error converting file to netcdf: dataout/u3zeka.pdi5c10 CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/u3zeko.pji5c10 Error converting file to netcdf: dataout/u3zeko.pii5c10 Error converting file to netcdf: dataout/u3zeko.pfi5c10 Error converting file to netcdf: dataout/u3zeka.phi5c10 Error converting file to netcdf: dataout/u3zeka.pgi5c10 Error converting file to netcdf: dataout/u3zeka.pei5c10 Error converting file to netcdf: dataout/u3zeka.pdi5c10 CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/u3zeko.pji5c10 Error converting file to netcdf: dataout/u3zeko.pii5c10 Error converting file to netcdf: dataout/u3zeko.pfi5c10 Error converting file to netcdf: dataout/u3zeka.phi5c10 Error converting file to netcdf: dataout/u3zeka.pgi5c10 Error converting file to netcdf: dataout/u3zeka.pei5c10 Error converting file to netcdf: dataout/u3zeka.pdi5c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77373A93 read attempt to address 0x4042092C Engaging BOINC Windows Runtime Debugger... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4380, selfPID=4380, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77373A93 read attempt to address 0x4042092C Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_u3ze_1980_40_007458603/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Nov 2011 06:47:12	1089959	13407321	hadcm3n_u3ze_1980_40_007458603_0	259,200	413,548	1.5955
22 Nov 2011 04:22:44	1089959	13407321	hadcm3n_u3ze_1980_40_007458603_0	233,280	372,011	1.5947
18 Nov 2011 09:44:25	1089959	13407321	hadcm3n_u3ze_1980_40_007458603_0	207,360	330,300	1.5929
15 Nov 2011 20:12:52	1089959	13407321	hadcm3n_u3ze_1980_40_007458603_0	181,440	288,106	1.5879
15 Nov 2011 17:39:59	1089959	13407321	hadcm3n_u3ze_1980_40_007458603_0	155,520	247,314	1.5902
15 Nov 2011 17:39:59	1089959	13407321	hadcm3n_u3ze_1980_40_007458603_0	129,600	207,075	1.5978
15 Nov 2011 17:39:59	1089959	13407321	hadcm3n_u3ze_1980_40_007458603_0	103,680	166,777	1.6086
15 Nov 2011 17:39:59	1089959	13407321	hadcm3n_u3ze_1980_40_007458603_0	77,760	126,341	1.6248
15 Nov 2011 17:39:59	1089959	13407321	hadcm3n_u3ze_1980_40_007458603_0	51,840	85,215	1.6438
26 Sep 2011 11:21:24	1089959	13407321	hadcm3n_u3ze_1980_40_007458603_0	25,920	42,780	1.6505