Task 13605842

Name	hadcm3n_yeet_1980_40_007538189_0
Workunit	7735421
Created	5 Nov 2011, 19:31:58 UTC
Sent	5 Nov 2011, 19:33:42 UTC
Report deadline	5 Feb 2012, 3:00:53 UTC
Received	24 Dec 2011, 15:59:22 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1045266
Run time	11 days 19 hours 34 min 53 sec
CPU time	11 days 12 hours 8 min 28 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.66 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3604, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5248, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4496, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4128, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4236, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5084, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5084, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1468, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1468, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6256, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6672, selfPID=6672, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/yeetko.pjj5c10 Error converting file to netcdf: dataout/yeetko.pij5c10 Error converting file to netcdf: dataout/yeetko.pfj5c10 Error converting file to netcdf: dataout/yeetka.phj5c10 Error converting file to netcdf: dataout/yeetka.pgj5c10 Error converting file to netcdf: dataout/yeetka.pej5c10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6064, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 19:18:36 (2620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6600, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6256, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7084, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7798C3CB write attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_yeet_1980_40_007538189/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Dec 2011 12:55:44	1045266	13605842	hadcm3n_yeet_1980_40_007538189_0	518,400	994,102	1.9176
23 Dec 2011 08:51:19	1045266	13605842	hadcm3n_yeet_1980_40_007538189_0	492,480	945,563	1.9200
20 Dec 2011 21:14:39	1045266	13605842	hadcm3n_yeet_1980_40_007538189_0	466,560	897,199	1.9230
18 Dec 2011 04:26:44	1045266	13605842	hadcm3n_yeet_1980_40_007538189_0	440,640	848,341	1.9252
17 Dec 2011 14:20:08	1045266	13605842	hadcm3n_yeet_1980_40_007538189_0	414,720	798,254	1.9248
12 Dec 2011 21:46:41	1045266	13605842	hadcm3n_yeet_1980_40_007538189_0	388,800	750,319	1.9298
11 Dec 2011 10:52:17	1045266	13605842	hadcm3n_yeet_1980_40_007538189_0	362,880	700,054	1.9292
10 Dec 2011 11:51:45	1045266	13605842	hadcm3n_yeet_1980_40_007538189_0	336,960	651,311	1.9329
06 Dec 2011 18:08:13	1045266	13605842	hadcm3n_yeet_1980_40_007538189_0	311,040	602,323	1.9365
03 Dec 2011 20:26:25	1045266	13605842	hadcm3n_yeet_1980_40_007538189_0	285,120	551,713	1.9350
02 Dec 2011 19:16:36	1045266	13605842	hadcm3n_yeet_1980_40_007538189_0	259,200	501,939	1.9365
29 Nov 2011 20:42:32	1045266	13605842	hadcm3n_yeet_1980_40_007538189_0	233,280	452,367	1.9392
26 Nov 2011 18:43:51	1045266	13605842	hadcm3n_yeet_1980_40_007538189_0	207,360	401,377	1.9357
24 Nov 2011 21:06:50	1045266	13605842	hadcm3n_yeet_1980_40_007538189_0	181,440	350,522	1.9319
22 Nov 2011 16:15:46	1045266	13605842	hadcm3n_yeet_1980_40_007538189_0	155,520	300,701	1.9335
18 Nov 2011 16:06:09	1045266	13605842	hadcm3n_yeet_1980_40_007538189_0	129,600	251,085	1.9374
15 Nov 2011 18:54:46	1045266	13605842	hadcm3n_yeet_1980_40_007538189_0	103,680	200,233	1.9313
15 Nov 2011 18:07:15	1045266	13605842	hadcm3n_yeet_1980_40_007538189_0	77,760	150,699	1.9380
08 Nov 2011 20:06:55	1045266	13605842	hadcm3n_yeet_1980_40_007538189_0	51,840	101,036	1.9490
06 Nov 2011 10:24:37	1045266	13605842	hadcm3n_yeet_1980_40_007538189_0	25,920	50,891	1.9634