Task 15772093

Name	hadcm3n_ykd0_2020_40_008360668_1
Workunit	8511527
Created	10 May 2013, 15:29:37 UTC
Sent	10 May 2013, 15:33:55 UTC
Report deadline	9 Aug 2013, 23:01:06 UTC
Received	11 Jul 2013, 15:39:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1143523
Run time	5 days 17 hours 31 min 18 sec
CPU time	5 days 8 hours 55 min 57 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.55 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3824, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4996, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4864, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4116, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2288, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5612, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4552, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2708, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2708, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2708, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/ykd0ko.pjm3c10 Error converting file to netcdf: dataout/ykd0ko.pim3c10 Error converting file to netcdf: dataout/ykd0ko.pfm3c10 Error converting file to netcdf: dataout/ykd0ka.phm3c10 Error converting file to netcdf: dataout/ykd0ka.pgm3c10 Error converting file to netcdf: dataout/ykd0ka.pem3c10 Error converting file to netcdf: dataout/ykd0ka.pdm3c10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2072, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4968, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3548, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4308, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4748, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5008, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3356, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2908, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2956, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3784, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77963AB3 read attempt to address 0x40B34F5B Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76FF3AB3 read attempt to address 0x40B34F5B Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_ykd0_2020_40_008360668/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Jul 2013 00:52:50	1143523	15772093	hadcm3n_ykd0_2020_40_008360668_1	259,200	459,684	1.7735
07 Jul 2013 18:44:57	1143523	15772093	hadcm3n_ykd0_2020_40_008360668_1	233,280	413,596	1.7730
04 Jul 2013 14:04:13	1143523	15772093	hadcm3n_ykd0_2020_40_008360668_1	207,360	367,505	1.7723
02 Jul 2013 10:52:01	1143523	15772093	hadcm3n_ykd0_2020_40_008360668_1	181,440	322,708	1.7786
26 Jun 2013 21:02:40	1143523	15772093	hadcm3n_ykd0_2020_40_008360668_1	155,520	277,809	1.7863
19 Jun 2013 21:11:34	1143523	15772093	hadcm3n_ykd0_2020_40_008360668_1	129,600	231,717	1.7879
14 Jun 2013 00:13:06	1143523	15772093	hadcm3n_ykd0_2020_40_008360668_1	103,680	186,474	1.7986
04 Jun 2013 15:48:02	1143523	15772093	hadcm3n_ykd0_2020_40_008360668_1	77,760	140,290	1.8041
23 May 2013 01:45:37	1143523	15772093	hadcm3n_ykd0_2020_40_008360668_1	51,840	94,508	1.8231
16 May 2013 00:39:18	1143523	15772093	hadcm3n_ykd0_2020_40_008360668_1	25,920	47,668	1.8390