Task 13816432

Name	hadcm3n_ylpm_1940_40_007548192_3
Workunit	7745424
Created	24 Dec 2011, 19:48:28 UTC
Sent	24 Dec 2011, 19:49:27 UTC
Report deadline	25 Mar 2012, 3:16:38 UTC
Received	16 Jan 2012, 10:15:15 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1187235
Run time	9 days 12 hours 45 min 57 sec
CPU time	9 days 4 hours 47 min 48 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	3.52 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5060, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2700, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=308, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3632, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 forrtl: Espace insuffisant sur le disque. 19:45:54 (3060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... forrtl: Espace insuffisant sur le disque. 19:49:18 (3260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3252, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3356, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/ylpmko.pjh8c10 Error converting file to netcdf: dataout/ylpmko.pih8c10 Error converting file to netcdf: dataout/ylpmko.pfh8c10 Error converting file to netcdf: dataout/ylpmka.phh8c10 Error converting file to netcdf: dataout/ylpmka.pgh8c10 Error converting file to netcdf: dataout/ylpmka.peh8c10 Error converting file to netcdf: dataout/ylpmka.pdh8c10 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x774E3AB3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Jan 2012 06:34:09	1187235	13816432	hadcm3n_ylpm_1940_40_007548192_3	1,036,800	794,848	0.7666
15 Jan 2012 15:06:45	1187235	13816432	hadcm3n_ylpm_1940_40_007548192_3	1,010,880	772,891	0.7646
15 Jan 2012 08:20:23	1187235	13816432	hadcm3n_ylpm_1940_40_007548192_3	984,960	756,765	0.7683
14 Jan 2012 19:21:47	1187235	13816432	hadcm3n_ylpm_1940_40_007548192_3	959,040	736,198	0.7676
14 Jan 2012 12:48:01	1187235	13816432	hadcm3n_ylpm_1940_40_007548192_3	933,120	713,542	0.7647
13 Jan 2012 21:29:21	1187235	13816432	hadcm3n_ylpm_1940_40_007548192_3	907,200	692,712	0.7636
13 Jan 2012 13:23:40	1187235	13816432	hadcm3n_ylpm_1940_40_007548192_3	881,280	670,492	0.7608
12 Jan 2012 21:24:56	1187235	13816432	hadcm3n_ylpm_1940_40_007548192_3	855,360	648,543	0.7582
12 Jan 2012 09:48:32	1187235	13816432	hadcm3n_ylpm_1940_40_007548192_3	829,440	627,628	0.7567
11 Jan 2012 14:50:34	1187235	13816432	hadcm3n_ylpm_1940_40_007548192_3	803,520	606,801	0.7552
10 Jan 2012 19:50:23	1187235	13816432	hadcm3n_ylpm_1940_40_007548192_3	777,600	586,369	0.7541
09 Jan 2012 23:36:13	1187235	13816432	hadcm3n_ylpm_1940_40_007548192_3	751,680	565,170	0.7519
09 Jan 2012 14:14:43	1187235	13816432	hadcm3n_ylpm_1940_40_007548192_3	725,760	544,632	0.7504
08 Jan 2012 23:15:56	1187235	13816432	hadcm3n_ylpm_1940_40_007548192_3	699,840	523,855	0.7485
08 Jan 2012 13:30:59	1187235	13816432	hadcm3n_ylpm_1940_40_007548192_3	673,920	502,651	0.7459
07 Jan 2012 15:58:44	1187235	13816432	hadcm3n_ylpm_1940_40_007548192_3	648,000	482,443	0.7445
07 Jan 2012 10:02:28	1187235	13816432	hadcm3n_ylpm_1940_40_007548192_3	622,080	461,533	0.7419
06 Jan 2012 19:43:55	1187235	13816432	hadcm3n_ylpm_1940_40_007548192_3	596,160	440,111	0.7382
06 Jan 2012 08:37:58	1187235	13816432	hadcm3n_ylpm_1940_40_007548192_3	570,240	419,304	0.7353
05 Jan 2012 13:15:38	1187235	13816432	hadcm3n_ylpm_1940_40_007548192_3	544,320	398,468	0.7320