Task 13809629

Name	hadcm3n_u19u_1980_40_007458131_4
Workunit	7655634
Created	22 Dec 2011, 20:43:59 UTC
Sent	22 Dec 2011, 20:52:34 UTC
Report deadline	23 Mar 2012, 4:19:45 UTC
Received	19 Jan 2012, 5:07:35 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1181465
Run time	14 days 13 hours 55 min 17 sec
CPU time	14 days 9 hours 5 min 2 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.30 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:42:29 (4020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:42:30 (4020): No heartbeat from core client for 30 sec - exiting 08:42:31 (4020): No heartbeat from core client for 30 sec - exiting 08:42:32 (4020): No heartbeat from core client for 30 sec - exiting 08:42:33 (4020): No heartbeat from core client for 30 sec - exiting 08:42:34 (4020): No heartbeat from core client for 30 sec - exiting 08:42:35 (4020): No heartbeat from core client for 30 sec - exiting 08:42:36 (4020): No heartbeat from core client for 30 sec - exiting 08:42:37 (4020): No heartbeat from core client for 30 sec - exiting 08:42:38 (4020): No heartbeat from core client for 30 sec - exiting 08:42:39 (4020): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 13:49:06 (1432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:49:07 (1432): No heartbeat from core client for 30 sec - exiting 13:49:08 (1432): No heartbeat from core client for 30 sec - exiting 13:49:09 (1432): No heartbeat from core client for 30 sec - exiting 13:49:10 (1432): No heartbeat from core client for 30 sec - exiting 13:49:11 (1432): No heartbeat from core client for 30 sec - exiting 13:49:12 (1432): No heartbeat from core client for 30 sec - exiting 13:49:13 (1432): No heartbeat from core client for 30 sec - exiting 13:49:14 (1432): No heartbeat from core client for 30 sec - exiting 13:49:15 (1432): No heartbeat from core client for 30 sec - exiting 13:49:16 (1432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4272, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x775B7373 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3648, selfPID=3648, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x773E7373 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file D:\BOINC\BOINC Data/projects/climateprediction.net/hadcm3n_u19u_1980_40_007458131/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Jan 2012 00:54:52	1181465	13809629	hadcm3n_u19u_1980_40_007458131_4	777,600	1,240,521	1.5953
18 Jan 2012 12:45:05	1181465	13809629	hadcm3n_u19u_1980_40_007458131_4	751,680	1,197,964	1.5937
18 Jan 2012 00:37:15	1181465	13809629	hadcm3n_u19u_1980_40_007458131_4	725,760	1,155,546	1.5922
17 Jan 2012 10:53:43	1181465	13809629	hadcm3n_u19u_1980_40_007458131_4	699,840	1,113,251	1.5907
16 Jan 2012 21:10:27	1181465	13809629	hadcm3n_u19u_1980_40_007458131_4	673,920	1,076,423	1.5973
16 Jan 2012 12:26:03	1181465	13809629	hadcm3n_u19u_1980_40_007458131_4	648,000	1,045,321	1.6131
15 Jan 2012 17:52:33	1181465	13809629	hadcm3n_u19u_1980_40_007458131_4	622,080	1,014,537	1.6309
15 Jan 2012 06:45:00	1181465	13809629	hadcm3n_u19u_1980_40_007458131_4	596,160	974,965	1.6354
14 Jan 2012 14:13:19	1181465	13809629	hadcm3n_u19u_1980_40_007458131_4	570,240	932,684	1.6356
13 Jan 2012 20:27:21	1181465	13809629	hadcm3n_u19u_1980_40_007458131_4	544,320	889,462	1.6341
13 Jan 2012 16:24:21	1181465	13809629	hadcm3n_u19u_1980_40_007458131_4	518,400	846,725	1.6333
04 Jan 2012 17:27:10	1181465	13809629	hadcm3n_u19u_1980_40_007458131_4	492,480	805,483	1.6356
04 Jan 2012 04:35:08	1181465	13809629	hadcm3n_u19u_1980_40_007458131_4	466,560	760,807	1.6307
03 Jan 2012 23:23:39	1181465	13809629	hadcm3n_u19u_1980_40_007458131_4	440,640	716,811	1.6267
03 Jan 2012 23:23:39	1181465	13809629	hadcm3n_u19u_1980_40_007458131_4	414,720	674,070	1.6254
03 Jan 2012 23:23:39	1181465	13809629	hadcm3n_u19u_1980_40_007458131_4	388,800	631,298	1.6237
03 Jan 2012 23:23:39	1181465	13809629	hadcm3n_u19u_1980_40_007458131_4	362,880	588,769	1.6225
03 Jan 2012 23:23:39	1181465	13809629	hadcm3n_u19u_1980_40_007458131_4	336,960	546,029	1.6205
03 Jan 2012 23:23:39	1181465	13809629	hadcm3n_u19u_1980_40_007458131_4	311,040	503,366	1.6183
03 Jan 2012 23:23:39	1181465	13809629	hadcm3n_u19u_1980_40_007458131_4	285,120	460,706	1.6158