Task 16078204

Name	hadcm3n_o148_1980_40_008385866_4
Workunit	8536725
Created	6 Nov 2013, 9:59:46 UTC
Sent	6 Nov 2013, 9:59:51 UTC
Report deadline	5 Feb 2014, 17:27:02 UTC
Received	22 Nov 2013, 22:43:57 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1229298
Run time	12 days 15 hours 11 min 30 sec
CPU time	12 days 1 hours 13 min 5 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.43 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o148ko.pji1c10 Error converting file to netcdf: dataout/o148ko.pii1c10 Error converting file to netcdf: dataout/o148ko.pfi1c10 Error converting file to netcdf: dataout/o148ka.phi1c10 Error converting file to netcdf: dataout/o148ka.pgi1c10 Error converting file to netcdf: dataout/o148ka.pei1c10 Error converting file to netcdf: dataout/o148ka.pdi1c10 CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o148ko.pji1c10 Error converting file to netcdf: dataout/o148ko.pii1c10 Error converting file to netcdf: dataout/o148ko.pfi1c10 Error converting file to netcdf: dataout/o148ka.phi1c10 Error converting file to netcdf: dataout/o148ka.pgi1c10 Error converting file to netcdf: dataout/o148ka.pei1c10 Error converting file to netcdf: dataout/o148ka.pdi1c10 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o148ko.pji3c10 Error converting file to netcdf: dataout/o148ko.pii3c10 Error converting file to netcdf: dataout/o148ko.pfi3c10 Error converting file to netcdf: dataout/o148ka.phi3c10 Error converting file to netcdf: dataout/o148ka.pgi3c10 Error converting file to netcdf: dataout/o148ka.pei3c10 Error converting file to netcdf: dataout/o148ka.pdi3c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o148ko.pji5c10 Error converting file to netcdf: dataout/o148ko.pii5c10 Error converting file to netcdf: dataout/o148ko.pfi5c10 Error converting file to netcdf: dataout/o148ka.phi5c10 Error converting file to netcdf: dataout/o148ka.pgi5c10 Error converting file to netcdf: dataout/o148ka.pei5c10 Error converting file to netcdf: dataout/o148ka.pdi5c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o148ko.pji6c10 Error converting file to netcdf: dataout/o148ko.pii6c10 Error converting file to netcdf: dataout/o148ko.pfi6c10 Error converting file to netcdf: dataout/o148ka.phi6c10 Error converting file to netcdf: dataout/o148ka.pgi6c10 Error converting file to netcdf: dataout/o148ka.pei6c10 Error converting file to netcdf: dataout/o148ka.pdi6c10 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o148ko.pji8c10 Error converting file to netcdf: dataout/o148ko.pii8c10 Error converting file to netcdf: dataout/o148ko.pfi8c10 Error converting file to netcdf: dataout/o148ka.phi8c10 Error converting file to netcdf: dataout/o148ka.pgi8c10 Error converting file to netcdf: dataout/o148ka.pei8c10 Error converting file to netcdf: dataout/o148ka.pdi8c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77625EAB read attempt to address 0x402F33D8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o148_1980_40_008385866/dataout/shmem_restart.day </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Nov 2013 22:47:17	1229298	16078204	hadcm3n_o148_1980_40_008385866_4	259,200	1,041,180	4.0169
20 Nov 2013 09:47:18	1229298	16078204	hadcm3n_o148_1980_40_008385866_4	233,280	937,591	4.0192
18 Nov 2013 23:17:03	1229298	16078204	hadcm3n_o148_1980_40_008385866_4	207,360	834,061	4.0223
17 Nov 2013 11:28:46	1229298	16078204	hadcm3n_o148_1980_40_008385866_4	181,440	729,580	4.0211
16 Nov 2013 03:19:04	1229298	16078204	hadcm3n_o148_1980_40_008385866_4	155,520	623,732	4.0106
14 Nov 2013 16:10:41	1229298	16078204	hadcm3n_o148_1980_40_008385866_4	129,600	519,054	4.0050
12 Nov 2013 07:26:30	1229298	16078204	hadcm3n_o148_1980_40_008385866_4	103,680	415,820	4.0106
10 Nov 2013 18:52:49	1229298	16078204	hadcm3n_o148_1980_40_008385866_4	77,760	312,474	4.0184
09 Nov 2013 12:01:53	1229298	16078204	hadcm3n_o148_1980_40_008385866_4	51,840	207,576	4.0042
08 Nov 2013 02:35:36	1229298	16078204	hadcm3n_o148_1980_40_008385866_4	25,920	103,382	3.9885