Task 14097562

Name	hadcm3n_yb4d_1940_40_007544639_2
Workunit	7741871
Created	15 Feb 2012, 2:55:33 UTC
Sent	15 Feb 2012, 2:55:43 UTC
Report deadline	16 May 2012, 10:22:54 UTC
Received	30 Mar 2012, 22:25:14 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1100942
Run time	30 days 8 hours 36 min 15 sec
CPU time	28 days 23 hours 44 min 16 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.57 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12148, selfPID=12148, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/yb4dko.pje1c10 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11380, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11412, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3696, selfPID=3696, iMonCtr=1 18:39:05 (11264): Can't acquire lockfile (32) - waiting 35s No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10848, selfPID=10848, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/yb4dko.pjf2c10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11264, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6760, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12088, iMonCtr=1 Model crash detected, will try to restart... 03:39:03 (2992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11064, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77606E5F read attempt to address 0x40AA6BF6 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77608851 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_yb4d_1940_40_007544639/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Mar 2012 20:36:59	1100942	14097562	hadcm3n_yb4d_1940_40_007544639_2	1,036,800	2,503,772	2.4149
29 Mar 2012 00:36:04	1100942	14097562	hadcm3n_yb4d_1940_40_007544639_2	1,010,880	2,442,757	2.4165
28 Mar 2012 02:50:28	1100942	14097562	hadcm3n_yb4d_1940_40_007544639_2	984,960	2,380,713	2.4171
27 Mar 2012 08:04:00	1100942	14097562	hadcm3n_yb4d_1940_40_007544639_2	959,040	2,317,948	2.4169
26 Mar 2012 11:54:43	1100942	14097562	hadcm3n_yb4d_1940_40_007544639_2	933,120	2,252,688	2.4141
25 Mar 2012 16:21:21	1100942	14097562	hadcm3n_yb4d_1940_40_007544639_2	907,200	2,188,272	2.4121
24 Mar 2012 20:09:38	1100942	14097562	hadcm3n_yb4d_1940_40_007544639_2	881,280	2,123,378	2.4094
23 Mar 2012 22:19:57	1100942	14097562	hadcm3n_yb4d_1940_40_007544639_2	855,360	2,057,498	2.4054
23 Mar 2012 02:59:17	1100942	14097562	hadcm3n_yb4d_1940_40_007544639_2	829,440	1,992,086	2.4017
22 Mar 2012 08:46:08	1100942	14097562	hadcm3n_yb4d_1940_40_007544639_2	803,520	1,930,365	2.4024
21 Mar 2012 14:17:25	1100942	14097562	hadcm3n_yb4d_1940_40_007544639_2	777,600	1,864,813	2.3982
20 Mar 2012 15:15:47	1100942	14097562	hadcm3n_yb4d_1940_40_007544639_2	751,680	1,799,149	2.3935
19 Mar 2012 17:53:52	1100942	14097562	hadcm3n_yb4d_1940_40_007544639_2	725,760	1,734,732	2.3902
18 Mar 2012 22:24:03	1100942	14097562	hadcm3n_yb4d_1940_40_007544639_2	699,840	1,669,197	2.3851
18 Mar 2012 04:21:57	1100942	14097562	hadcm3n_yb4d_1940_40_007544639_2	673,920	1,608,003	2.3860
17 Mar 2012 09:24:48	1100942	14097562	hadcm3n_yb4d_1940_40_007544639_2	648,000	1,545,372	2.3848
16 Mar 2012 15:32:44	1100942	14097562	hadcm3n_yb4d_1940_40_007544639_2	622,080	1,481,622	2.3817
14 Mar 2012 23:51:16	1100942	14097562	hadcm3n_yb4d_1940_40_007544639_2	596,160	1,417,006	2.3769
14 Mar 2012 01:01:03	1100942	14097562	hadcm3n_yb4d_1940_40_007544639_2	570,240	1,352,262	2.3714
13 Mar 2012 06:21:03	1100942	14097562	hadcm3n_yb4d_1940_40_007544639_2	544,320	1,289,263	2.3686