Task 15941686

Name	hadcm3n_3hz3_2020_40_008409330_1
Workunit	8560186
Created	27 Aug 2013, 18:09:57 UTC
Sent	27 Aug 2013, 18:10:07 UTC
Report deadline	27 Nov 2013, 1:37:18 UTC
Received	5 Oct 2013, 20:41:43 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	889051
Run time	6 days 3 hours 57 min 22 sec
CPU time	5 days 1 hours 29 min 44 sec
Validate state	Invalid
Credit	7,153.92
Device peak FLOPS	4.08 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> ted, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... hadcm3n_6.07_i686-apple-darwin(15905,0x35ca28) malloc: * error for object 0xc04e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15905,0x35ca28) malloc: * error for object 0xc04e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15905,0x35ca28) malloc: * error for object 0x33dd004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15905,0x35ca28) malloc: * error for object 0x33dd000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15905,0x35ca28) malloc: * error for object 0x33dd004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15905,0x35ca28) malloc: * error for object 0x33dd000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15905,0x35ca28) malloc: * error for object 0x33dd004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15905,0x35ca28) malloc: * error for object 0x33dd000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15905,0x35ca28) malloc: * error for object 0x33dd004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15905,0x35ca28) malloc: * error for object 0x33dd000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15905,0x35ca28) malloc: * error for object 0xc04e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15905,0x35ca28) malloc: * error for object 0xc04e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15905,0x35ca28) malloc: * error for object 0xc04e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15905,0x35ca28) malloc: * error for object 0xc04e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.8.4 build 12E55 Sun Sep 8 12:38:34 2013 dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid hadcm3n_6.07_i686-apple-darwin(16837,0x35ca28) malloc: * error for object 0x18fe004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid hadcm3n_6.07_i686-apple-darwin(17566,0x35ca28) malloc: * error for object 0x1a00c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(17566,0x35ca28) malloc: * error for object 0x19ea404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid hadcm3n_6.07_i686-apple-darwin(23014,0x35ca28) malloc: * error for object 0x23fa404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23014,0x35ca28) malloc: * error for object 0xbfa804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23014,0x35ca28) malloc: * error for object 0x33e5804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23014,0x35ca28) malloc: * error for object 0x1bcc004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23014,0x35ca28) malloc: * error for object 0x1bcc000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23014,0x35ca28) malloc: * error for object 0x1bcc004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23014,0x35ca28) malloc: * error for object 0x1bcc000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23014,0x35ca28) malloc: * error for object 0x1bcc004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23014,0x35ca28) malloc: * error for object 0x1bcc000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23014,0x35ca28) malloc: * error for object 0x1bcc004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23014,0x35ca28) malloc: * error for object 0x1bcc000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23014,0x35ca28) malloc: * error for object 0x1bcc004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23014,0x35ca28) malloc: * error for object 0x1bcc000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23014,0x35ca28) malloc: * error for object 0xbc3004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(23014,0x35ca28) malloc: * error for object 0xbc3000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid 17:04:54 (4916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid 01:18:48 (37812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_3hz3_2020_40_008409330/dataout/ocean_restart.day after 11 attempts SIGABRT: abort called dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.8.5 build 12F37 Sat Oct 5 15:39:51 2013 dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Thread 0 Crashed: Thread 1: dyld: DYLD_ environment variables being ignored because main executable (/usr/bin/atos) has __RESTRICT/__restrict section Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0xcc1000 - 0xcc1fff /usr/lib/libSystem.B.dylib 0xcc8000 - 0xcd6fff /usr/lib/libz.1.dylib 0xcdc000 - 0xce0fff /usr/lib/system/libcache.dylib 0xce5000 - 0xcf0fff /usr/lib/system/libcommonCrypto.dylib 0xcfb000 - 0xcfefff /usr/lib/system/libcompiler_rt.dylib 0xd05000 - 0xd0dfff /usr/lib/system/libcopyfile.dylib 0xd13000 - 0xd25fff /usr/lib/system/libdispatch.dylib 0xd35000 - 0xd36fff /usr/lib/system/libdnsinfo.dylib 0xd3b000 - 0xd3dfff /usr/lib/system/libdyld.dylib 0xd43000 - 0xd43fff /usr/lib/system/libkeymgr.dylib 0xd47000 - 0xd4efff /usr/lib/system/liblaunch.dylib 0xd56000 - 0xd5afff /usr/lib/system/libmacho.dylib 0xd5f000 - 0xd60fff /usr/lib/system/libquarantine.dylib 0xd65000 - 0xd66fff /usr/lib/system/libremovefile.dylib 0xd6c000 - 0xd6cfff /usr/lib/system/libsystem_blocks.dylib 0xd70000 - 0xe2dfff /usr/lib/system/libsystem_c.dylib 0xe69000 - 0xe70fff /usr/lib/system/libsystem_dnssd.dylib 0xe76000 - 0xea2fff /usr/lib/system/libsystem_info.dylib 0xeb7000 - 0xed1fff /usr/lib/system/libsystem_kernel.dylib 0xee2000 - 0xf0ffff /usr/lib/system/libsystem_m.dylib 0xf19000 - 0xf27fff /usr/lib/system/libsystem_network.dylib 0xf33000 - 0xf3dfff /usr/lib/system/libsystem_notify.dylib 0xf46000 - 0xf47fff /usr/lib/system/libsystem_sandbox.dylib 0xf4c000 - 0xf4dfff /usr/lib/system/libunc.dylib 0xf53000 - 0xf5afff /usr/lib/system/libunwind.dylib 0xf61000 - 0xf7efff /usr/lib/system/libxpc.dylib 0xf91000 - 0xfddfff /usr/lib/system/libcorecrypto.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1767, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_3hz3_2020_40_008409330/dataout/ocean_restart.day after 11 attempts SIGABRT: abort called dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.8.5 build 12F37 Sat Oct 5 15:39:55 2013 dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Thread 0 Crashed: Thread 1: dyld: DYLD_ environment variables being ignored because main executable (/usr/bin/atos) has __RESTRICT/__restrict section Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0xcc1000 - 0xcc1fff /usr/lib/libSystem.B.dylib 0xcc8000 - 0xcd6fff /usr/lib/libz.1.dylib 0xcdc000 - 0xce0fff /usr/lib/system/libcache.dylib 0xce5000 - 0xcf0fff /usr/lib/system/libcommonCrypto.dylib 0xcfb000 - 0xcfefff /usr/lib/system/libcompiler_rt.dylib 0xd05000 - 0xd0dfff /usr/lib/system/libcopyfile.dylib 0xd13000 - 0xd25fff /usr/lib/system/libdispatch.dylib 0xd35000 - 0xd36fff /usr/lib/system/libdnsinfo.dylib 0xd3b000 - 0xd3dfff /usr/lib/system/libdyld.dylib 0xd43000 - 0xd43fff /usr/lib/system/libkeymgr.dylib 0xd47000 - 0xd4efff /usr/lib/system/liblaunch.dylib 0xd56000 - 0xd5afff /usr/lib/system/libmacho.dylib 0xd5f000 - 0xd60fff /usr/lib/system/libquarantine.dylib 0xd65000 - 0xd66fff /usr/lib/system/libremovefile.dylib 0xd6c000 - 0xd6cfff /usr/lib/system/libsystem_blocks.dylib 0xd70000 - 0xe2dfff /usr/lib/system/libsystem_c.dylib 0xe69000 - 0xe70fff /usr/lib/system/libsystem_dnssd.dylib 0xe76000 - 0xea2fff /usr/lib/system/libsystem_info.dylib 0xeb7000 - 0xed1fff /usr/lib/system/libsystem_kernel.dylib 0xee2000 - 0xf0ffff /usr/lib/system/libsystem_m.dylib 0xf19000 - 0xf27fff /usr/lib/system/libsystem_network.dylib 0xf33000 - 0xf3dfff /usr/lib/system/libsystem_notify.dylib 0xf46000 - 0xf47fff /usr/lib/system/libsystem_sandbox.dylib 0xf4c000 - 0xf4dfff /usr/lib/system/libunc.dylib 0xf53000 - 0xf5afff /usr/lib/system/libunwind.dylib 0xf61000 - 0xf7efff /usr/lib/system/libxpc.dylib 0xf91000 - 0xfddfff /usr/lib/system/libcorecrypto.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1767, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_3hz3_2020_40_008409330/dataout/ocean_restart.day after 11 attempts SIGABRT: abort called dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.8.5 build 12F37 Sat Oct 5 15:39:58 2013 dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Thread 0 Crashed: Thread 1: dyld: DYLD_ environment variables being ignored because main executable (/usr/bin/atos) has __RESTRICT/__restrict section Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0xcc1000 - 0xcc1fff /usr/lib/libSystem.B.dylib 0xcc8000 - 0xcd6fff /usr/lib/libz.1.dylib 0xcdc000 - 0xce0fff /usr/lib/system/libcache.dylib 0xce5000 - 0xcf0fff /usr/lib/system/libcommonCrypto.dylib 0xcfb000 - 0xcfefff /usr/lib/system/libcompiler_rt.dylib 0xd05000 - 0xd0dfff /usr/lib/system/libcopyfile.dylib 0xd13000 - 0xd25fff /usr/lib/system/libdispatch.dylib 0xd35000 - 0xd36fff /usr/lib/system/libdnsinfo.dylib 0xd3b000 - 0xd3dfff /usr/lib/system/libdyld.dylib 0xd43000 - 0xd43fff /usr/lib/system/libkeymgr.dylib 0xd47000 - 0xd4efff /usr/lib/system/liblaunch.dylib 0xd56000 - 0xd5afff /usr/lib/system/libmacho.dylib 0xd5f000 - 0xd60fff /usr/lib/system/libquarantine.dylib 0xd65000 - 0xd66fff /usr/lib/system/libremovefile.dylib 0xd6c000 - 0xd6cfff /usr/lib/system/libsystem_blocks.dylib 0xd70000 - 0xe2dfff /usr/lib/system/libsystem_c.dylib 0xe69000 - 0xe70fff /usr/lib/system/libsystem_dnssd.dylib 0xe76000 - 0xea2fff /usr/lib/system/libsystem_info.dylib 0xeb7000 - 0xed1fff /usr/lib/system/libsystem_kernel.dylib 0xee2000 - 0xf0ffff /usr/lib/system/libsystem_m.dylib 0xf19000 - 0xf27fff /usr/lib/system/libsystem_network.dylib 0xf33000 - 0xf3dfff /usr/lib/system/libsystem_notify.dylib 0xf46000 - 0xf47fff /usr/lib/system/libsystem_sandbox.dylib 0xf4c000 - 0xf4dfff /usr/lib/system/libunc.dylib 0xf53000 - 0xf5afff /usr/lib/system/libunwind.dylib 0xf61000 - 0xf7efff /usr/lib/system/libxpc.dylib 0xf91000 - 0xfddfff /usr/lib/system/libcorecrypto.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1767, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_3hz3_2020_40_008409330/dataout/ocean_restart.day after 11 attempts SIGABRT: abort called dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.8.5 build 12F37 Sat Oct 5 15:40:01 2013 dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Thread 0 Crashed: Thread 1: dyld: DYLD_ environment variables being ignored because main executable (/usr/bin/atos) has __RESTRICT/__restrict section Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0xcc1000 - 0xcc1fff /usr/lib/libSystem.B.dylib 0xcc8000 - 0xcd6fff /usr/lib/libz.1.dylib 0xcdc000 - 0xce0fff /usr/lib/system/libcache.dylib 0xce5000 - 0xcf0fff /usr/lib/system/libcommonCrypto.dylib 0xcfb000 - 0xcfefff /usr/lib/system/libcompiler_rt.dylib 0xd05000 - 0xd0dfff /usr/lib/system/libcopyfile.dylib 0xd13000 - 0xd25fff /usr/lib/system/libdispatch.dylib 0xd35000 - 0xd36fff /usr/lib/system/libdnsinfo.dylib 0xd3b000 - 0xd3dfff /usr/lib/system/libdyld.dylib 0xd43000 - 0xd43fff /usr/lib/system/libkeymgr.dylib 0xd47000 - 0xd4efff /usr/lib/system/liblaunch.dylib 0xd56000 - 0xd5afff /usr/lib/system/libmacho.dylib 0xd5f000 - 0xd60fff /usr/lib/system/libquarantine.dylib 0xd65000 - 0xd66fff /usr/lib/system/libremovefile.dylib 0xd6c000 - 0xd6cfff /usr/lib/system/libsystem_blocks.dylib 0xd70000 - 0xe2dfff /usr/lib/system/libsystem_c.dylib 0xe69000 - 0xe70fff /usr/lib/system/libsystem_dnssd.dylib 0xe76000 - 0xea2fff /usr/lib/system/libsystem_info.dylib 0xeb7000 - 0xed1fff /usr/lib/system/libsystem_kernel.dylib 0xee2000 - 0xf0ffff /usr/lib/system/libsystem_m.dylib 0xf19000 - 0xf27fff /usr/lib/system/libsystem_network.dylib 0xf33000 - 0xf3dfff /usr/lib/system/libsystem_notify.dylib 0xf46000 - 0xf47fff /usr/lib/system/libsystem_sandbox.dylib 0xf4c000 - 0xf4dfff /usr/lib/system/libunc.dylib 0xf53000 - 0xf5afff /usr/lib/system/libunwind.dylib 0xf61000 - 0xf7efff /usr/lib/system/libxpc.dylib 0xf91000 - 0xfddfff /usr/lib/system/libcorecrypto.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1767, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_3hz3_2020_40_008409330/dataout/ocean_restart.day after 11 attempts SIGABRT: abort called dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.8.5 build 12F37 Sat Oct 5 15:40:04 2013 dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Thread 0 Crashed: Thread 1: dyld: DYLD_ environment variables being ignored because main executable (/usr/bin/atos) has __RESTRICT/__restrict section Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0xcc1000 - 0xcc1fff /usr/lib/libSystem.B.dylib 0xcc8000 - 0xcd6fff /usr/lib/libz.1.dylib 0xcdc000 - 0xce0fff /usr/lib/system/libcache.dylib 0xce5000 - 0xcf0fff /usr/lib/system/libcommonCrypto.dylib 0xcfb000 - 0xcfefff /usr/lib/system/libcompiler_rt.dylib 0xd05000 - 0xd0dfff /usr/lib/system/libcopyfile.dylib 0xd13000 - 0xd25fff /usr/lib/system/libdispatch.dylib 0xd35000 - 0xd36fff /usr/lib/system/libdnsinfo.dylib 0xd3b000 - 0xd3dfff /usr/lib/system/libdyld.dylib 0xd43000 - 0xd43fff /usr/lib/system/libkeymgr.dylib 0xd47000 - 0xd4efff /usr/lib/system/liblaunch.dylib 0xd56000 - 0xd5afff /usr/lib/system/libmacho.dylib 0xd5f000 - 0xd60fff /usr/lib/system/libquarantine.dylib 0xd65000 - 0xd66fff /usr/lib/system/libremovefile.dylib 0xd6c000 - 0xd6cfff /usr/lib/system/libsystem_blocks.dylib 0xd70000 - 0xe2dfff /usr/lib/system/libsystem_c.dylib 0xe69000 - 0xe70fff /usr/lib/system/libsystem_dnssd.dylib 0xe76000 - 0xea2fff /usr/lib/system/libsystem_info.dylib 0xeb7000 - 0xed1fff /usr/lib/system/libsystem_kernel.dylib 0xee2000 - 0xf0ffff /usr/lib/system/libsystem_m.dylib 0xf19000 - 0xf27fff /usr/lib/system/libsystem_network.dylib 0xf33000 - 0xf3dfff /usr/lib/system/libsystem_notify.dylib 0xf46000 - 0xf47fff /usr/lib/system/libsystem_sandbox.dylib 0xf4c000 - 0xf4dfff /usr/lib/system/libunc.dylib 0xf53000 - 0xf5afff /usr/lib/system/libunwind.dylib 0xf61000 - 0xf7efff /usr/lib/system/libxpc.dylib 0xf91000 - 0xfddfff /usr/lib/system/libcorecrypto.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1767, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_3hz3_2020_40_008409330/dataout/ocean_restart.day after 11 attempts SIGABRT: abort called dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.8.5 build 12F37 Sat Oct 5 15:40:07 2013 dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Thread 0 Crashed: Thread 1: dyld: DYLD_ environment variables being ignored because main executable (/usr/bin/atos) has __RESTRICT/__restrict section Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffccc8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0xcc1000 - 0xcc1fff /usr/lib/libSystem.B.dylib 0xcc8000 - 0xcd6fff /usr/lib/libz.1.dylib 0xcdc000 - 0xce0fff /usr/lib/system/libcache.dylib 0xce5000 - 0xcf0fff /usr/lib/system/libcommonCrypto.dylib 0xcfb000 - 0xcfefff /usr/lib/system/libcompiler_rt.dylib 0xd05000 - 0xd0dfff /usr/lib/system/libcopyfile.dylib 0xd13000 - 0xd25fff /usr/lib/system/libdispatch.dylib 0xd35000 - 0xd36fff /usr/lib/system/libdnsinfo.dylib 0xd3b000 - 0xd3dfff /usr/lib/system/libdyld.dylib 0xd43000 - 0xd43fff /usr/lib/system/libkeymgr.dylib 0xd47000 - 0xd4efff /usr/lib/system/liblaunch.dylib 0xd56000 - 0xd5afff /usr/lib/system/libmacho.dylib 0xd5f000 - 0xd60fff /usr/lib/system/libquarantine.dylib 0xd65000 - 0xd66fff /usr/lib/system/libremovefile.dylib 0xd6c000 - 0xd6cfff /usr/lib/system/libsystem_blocks.dylib 0xd70000 - 0xe2dfff /usr/lib/system/libsystem_c.dylib 0xe69000 - 0xe70fff /usr/lib/system/libsystem_dnssd.dylib 0xe76000 - 0xea2fff /usr/lib/system/libsystem_info.dylib 0xeb7000 - 0xed1fff /usr/lib/system/libsystem_kernel.dylib 0xee2000 - 0xf0ffff /usr/lib/system/libsystem_m.dylib 0xf19000 - 0xf27fff /usr/lib/system/libsystem_network.dylib 0xf33000 - 0xf3dfff /usr/lib/system/libsystem_notify.dylib 0xf46000 - 0xf47fff /usr/lib/system/libsystem_sandbox.dylib 0xf4c000 - 0xf4dfff /usr/lib/system/libunc.dylib 0xf53000 - 0xf5afff /usr/lib/system/libunwind.dylib 0xf61000 - 0xf7efff /usr/lib/system/libxpc.dylib 0xf91000 - 0xfddfff /usr/lib/system/libcorecrypto.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1767, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Oct 2013 09:44:58	889051	15941686	hadcm3n_3hz3_2020_40_008409330_1	596,160	424,992	0.7129
29 Sep 2013 10:49:35	889051	15941686	hadcm3n_3hz3_2020_40_008409330_1	570,240	406,574	0.7130
27 Sep 2013 19:59:32	889051	15941686	hadcm3n_3hz3_2020_40_008409330_1	544,320	388,001	0.7128
27 Sep 2013 13:39:35	889051	15941686	hadcm3n_3hz3_2020_40_008409330_1	518,400	369,466	0.7127
27 Sep 2013 07:26:39	889051	15941686	hadcm3n_3hz3_2020_40_008409330_1	492,480	350,908	0.7125
14 Sep 2013 10:28:31	889051	15941686	hadcm3n_3hz3_2020_40_008409330_1	466,560	332,441	0.7125
13 Sep 2013 18:48:18	889051	15941686	hadcm3n_3hz3_2020_40_008409330_1	440,640	313,878	0.7123
13 Sep 2013 12:41:57	889051	15941686	hadcm3n_3hz3_2020_40_008409330_1	414,720	295,369	0.7122
13 Sep 2013 04:55:09	889051	15941686	hadcm3n_3hz3_2020_40_008409330_1	388,800	276,896	0.7122
11 Sep 2013 12:01:55	889051	15941686	hadcm3n_3hz3_2020_40_008409330_1	362,880	258,324	0.7119
10 Sep 2013 12:00:24	889051	15941686	hadcm3n_3hz3_2020_40_008409330_1	336,960	239,741	0.7115
10 Sep 2013 03:22:12	889051	15941686	hadcm3n_3hz3_2020_40_008409330_1	311,040	221,177	0.7111
08 Sep 2013 17:39:32	889051	15941686	hadcm3n_3hz3_2020_40_008409330_1	285,120	204,454	0.7171
08 Sep 2013 09:32:17	889051	15941686	hadcm3n_3hz3_2020_40_008409330_1	259,200	184,886	0.7133
03 Sep 2013 18:04:40	889051	15941686	hadcm3n_3hz3_2020_40_008409330_1	233,280	166,534	0.7139
03 Sep 2013 11:56:43	889051	15941686	hadcm3n_3hz3_2020_40_008409330_1	207,360	148,205	0.7147
03 Sep 2013 00:21:55	889051	15941686	hadcm3n_3hz3_2020_40_008409330_1	181,440	129,869	0.7158
01 Sep 2013 13:05:55	889051	15941686	hadcm3n_3hz3_2020_40_008409330_1	155,520	111,484	0.7168
31 Aug 2013 14:42:36	889051	15941686	hadcm3n_3hz3_2020_40_008409330_1	129,600	93,091	0.7183
31 Aug 2013 08:19:34	889051	15941686	hadcm3n_3hz3_2020_40_008409330_1	103,680	74,703	0.7205