Task 15857384

Name	hadcm3n_n3xo_1920_40_008335010_1
Workunit	8485871
Created	22 Jun 2013, 8:14:05 UTC
Sent	22 Jun 2013, 8:34:33 UTC
Report deadline	21 Sep 2013, 16:01:44 UTC
Received	14 Aug 2013, 17:42:29 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1535185
Run time	8 days 22 hours 6 min 51 sec
CPU time	7 days 19 hours 54 min 2 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.32 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9752, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:17:18 (7888): No heartbeat from core client for 30 sec - exiting 19:17:19 (7888): No heartbeat from core client for 30 sec - exiting 19:17:20 (7888): No heartbeat from core client for 30 sec - exiting 19:17:21 (7888): No heartbeat from core client for 30 sec - exiting 19:17:22 (7888): No heartbeat from core client for 30 sec - exiting 19:17:23 (7888): No heartbeat from core client for 30 sec - exiting 19:17:24 (7888): No heartbeat from core client for 30 sec - exiting 19:17:25 (7888): No heartbeat from core client for 30 sec - exiting 19:17:26 (7888): No heartbeat from core client for 30 sec - exiting 19:17:27 (7888): No heartbeat from core client for 30 sec - exiting 19:17:28 (7888): No heartbeat from core client for 30 sec - exiting 19:17:29 (7888): No heartbeat from core client for 30 sec - exiting 19:17:30 (7888): No heartbeat from core client for 30 sec - exiting 19:17:31 (7888): No heartbeat from core client for 30 sec - exiting 19:17:32 (7888): No heartbeat from core client for 30 sec - exiting 19:17:33 (7888): No heartbeat from core client for 30 sec - exiting 19:17:34 (7888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7860, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5244, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:37:31 (6868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:37:32 (6868): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7741FF2B write attempt to address 0x40AAF025 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77403AB3 read attempt to address 0x40AAF02D Engaging BOINC Windows Runtime Debugger... Cannot serialize file E:\var\BOINC/projects/climateprediction.net/hadcm3n_n3xo_1920_40_008335010/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Aug 2013 17:44:01	1203749	15857384	hadcm3n_n3xo_1920_40_008335010_1	518,400	675,547	1.3031
14 Aug 2013 17:44:01	1203749	15857384	hadcm3n_n3xo_1920_40_008335010_1	492,480	644,780	1.3093
29 Jul 2013 14:22:15	1203749	15857384	hadcm3n_n3xo_1920_40_008335010_1	466,560	614,160	1.3164
29 Jul 2013 14:22:15	1203749	15857384	hadcm3n_n3xo_1920_40_008335010_1	440,640	583,530	1.3243
29 Jul 2013 14:22:15	1203749	15857384	hadcm3n_n3xo_1920_40_008335010_1	414,720	551,116	1.3289
26 Jul 2013 03:55:40	1203749	15857384	hadcm3n_n3xo_1920_40_008335010_1	388,800	519,205	1.3354
24 Jul 2013 11:44:58	1203749	15857384	hadcm3n_n3xo_1920_40_008335010_1	362,880	487,355	1.3430
23 Jul 2013 22:11:17	1203749	15857384	hadcm3n_n3xo_1920_40_008335010_1	336,960	455,056	1.3505
23 Jul 2013 21:51:14	1203749	15857384	hadcm3n_n3xo_1920_40_008335010_1	311,040	422,407	1.3580
23 Jul 2013 21:24:38	1203749	15857384	hadcm3n_n3xo_1920_40_008335010_1	285,120	388,782	1.3636
23 Jul 2013 20:57:59	1203749	15857384	hadcm3n_n3xo_1920_40_008335010_1	259,200	353,635	1.3643
23 Jul 2013 20:44:14	1203749	15857384	hadcm3n_n3xo_1920_40_008335010_1	233,280	317,430	1.3607
23 Jul 2013 15:56:11	1203749	15857384	hadcm3n_n3xo_1920_40_008335010_1	207,360	281,813	1.3591
23 Jul 2013 15:56:11	1203749	15857384	hadcm3n_n3xo_1920_40_008335010_1	181,440	247,118	1.3620
23 Jul 2013 15:56:11	1203749	15857384	hadcm3n_n3xo_1920_40_008335010_1	155,520	210,286	1.3521
23 Jul 2013 15:56:11	1203749	15857384	hadcm3n_n3xo_1920_40_008335010_1	129,600	173,409	1.3380
23 Jul 2013 15:56:11	1203749	15857384	hadcm3n_n3xo_1920_40_008335010_1	103,680	136,573	1.3173
02 Jul 2013 10:47:17	1203749	15857384	hadcm3n_n3xo_1920_40_008335010_1	77,760	100,995	1.2988
26 Jun 2013 18:49:40	1203749	15857384	hadcm3n_n3xo_1920_40_008335010_1	51,840	64,938	1.2527
23 Jun 2013 17:00:58	1203749	15857384	hadcm3n_n3xo_1920_40_008335010_1	25,920	31,936	1.2321