Task 13328807

Name	hadcm3n_o2w0_1940_40_007267516_2
Workunit	7465756
Created	2 Sep 2011, 11:20:54 UTC
Sent	2 Sep 2011, 12:38:49 UTC
Report deadline	2 Dec 2011, 20:06:00 UTC
Received	12 Sep 2011, 17:15:39 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1216523
Run time	6 days 3 hours 18 min 13 sec
CPU time	5 days 14 hours 58 min 54 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.54 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> 09:04:34 (6248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:58:28 (10280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:58:29 (10280): No heartbeat from core client for 30 sec - exiting 16:58:30 (10280): No heartbeat from core client for 30 sec - exiting 07:17:49 (612): No heartbeat from core client for 30 sec - exiting 07:17:50 (612): No heartbeat from core client for 30 sec - exiting 07:17:51 (612): No heartbeat from core client for 30 sec - exiting 07:17:52 (612): No heartbeat from core client for 30 sec - exiting 07:17:53 (612): No heartbeat from core client for 30 sec - exiting 07:17:54 (612): No heartbeat from core client for 30 sec - exiting 07:17:55 (612): No heartbeat from core client for 30 sec - exiting 07:17:56 (612): No heartbeat from core client for 30 sec - exiting 07:17:57 (612): No heartbeat from core client for 30 sec - exiting 07:17:58 (612): No heartbeat from core client for 30 sec - exiting 07:17:59 (612): No heartbeat from core client for 30 sec - exiting 07:18:00 (612): No heartbeat from core client for 30 sec - exiting 07:18:01 (612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5708, iMonCtr=1 Model crash detected, will try to restart... 15:47:38 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:55:16 (1196): No heartbeat from core client for 30 sec - exiting 07:55:17 (1196): No heartbeat from core client for 30 sec - exiting 07:55:18 (1196): No heartbeat from core client for 30 sec - exiting 07:55:19 (1196): No heartbeat from core client for 30 sec - exiting 07:55:20 (1196): No heartbeat from core client for 30 sec - exiting 07:55:21 (1196): No heartbeat from core client for 30 sec - exiting 07:55:22 (1196): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 04:46:09 (1396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:23:22 (4440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:29:07 (12128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:31:27 (12040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:31:28 (12040): No heartbeat from core client for 30 sec - exiting 05:31:29 (12040): No heartbeat from core client for 30 sec - exiting 08:24:46 (12072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7812, iMonCtr=1 Model crash detected, will try to restart... 09:37:08 (3952): No heartbeat from core client for 30 sec - exiting 09:37:09 (3952): No heartbeat from core client for 30 sec - exiting 09:37:10 (3952): No heartbeat from core client for 30 sec - exiting 09:37:11 (3952): No heartbeat from core client for 30 sec - exiting 09:37:12 (3952): No heartbeat from core client for 30 sec - exiting 09:37:13 (3952): No heartbeat from core client for 30 sec - exiting 09:37:15 (3952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:13:43 (2412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x774432FF read attempt to address 0x00000004 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o2w0_1940_40_007267516/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Sep 2011 17:16:51	1021810	13328807	hadcm3n_o2w0_1940_40_007267516_2	259,200	485,916	1.8747
11 Sep 2011 09:42:22	1021810	13328807	hadcm3n_o2w0_1940_40_007267516_2	233,280	436,133	1.8696
10 Sep 2011 18:14:08	1021810	13328807	hadcm3n_o2w0_1940_40_007267516_2	207,360	386,433	1.8636
10 Sep 2011 03:07:00	1021810	13328807	hadcm3n_o2w0_1940_40_007267516_2	181,440	337,533	1.8603
07 Sep 2011 17:54:29	1021810	13328807	hadcm3n_o2w0_1940_40_007267516_2	155,520	289,353	1.8606
05 Sep 2011 15:53:31	1021810	13328807	hadcm3n_o2w0_1940_40_007267516_2	129,600	241,018	1.8597
05 Sep 2011 00:58:59	1021810	13328807	hadcm3n_o2w0_1940_40_007267516_2	103,680	192,866	1.8602
04 Sep 2011 09:45:47	1021810	13328807	hadcm3n_o2w0_1940_40_007267516_2	77,760	144,625	1.8599
03 Sep 2011 17:43:56	1021810	13328807	hadcm3n_o2w0_1940_40_007267516_2	51,840	96,488	1.8613
03 Sep 2011 03:12:37	1021810	13328807	hadcm3n_o2w0_1940_40_007267516_2	25,920	47,692	1.8400