Task 15548848

Name	hadcm3n_n5n5_1880_40_008286073_0
Workunit	8437208
Created	17 Jan 2013, 17:35:48 UTC
Sent	17 Jan 2013, 17:36:07 UTC
Report deadline	19 Apr 2013, 1:03:18 UTC
Received	13 Mar 2013, 10:38:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1153555
Run time	16 days 15 hours 2 min 48 sec
CPU time	16 days 8 hours 28 min 24 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.44 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:46:50 (4480): No heartbeat from core client for 30 sec - exiting 03:46:51 (4480): No heartbeat from core client for 30 sec - exiting 03:46:52 (4480): No heartbeat from core client for 30 sec - exiting 03:46:53 (4480): No heartbeat from core client for 30 sec - exiting 03:46:54 (4480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:28:35 (3336): No heartbeat from core client for 30 sec - exiting 06:28:36 (3336): No heartbeat from core client for 30 sec - exiting 06:28:37 (3336): No heartbeat from core client for 30 sec - exiting 06:28:38 (3336): No heartbeat from core client for 30 sec - exiting 06:28:39 (3336): No heartbeat from core client for 30 sec - exiting 06:28:40 (3336): No heartbeat from core client for 30 sec - exiting 06:28:41 (3336): No heartbeat from core client for 30 sec - exiting 06:28:42 (3336): No heartbeat from core client for 30 sec - exiting 06:28:43 (3336): No heartbeat from core client for 30 sec - exiting 06:28:45 (3336): No heartbeat from core client for 30 sec - exiting 06:28:46 (3336): No heartbeat from core client for 30 sec - exiting 06:28:47 (3336): No heartbeat from core client for 30 sec - exiting 06:28:48 (3336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4996, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:50:42 (3600): No heartbeat from core client for 30 sec - exiting 03:50:43 (3600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:13:57 (4920): No heartbeat from core client for 30 sec - exiting 06:13:58 (4920): No heartbeat from core client for 30 sec - exiting 06:13:59 (4920): No heartbeat from core client for 30 sec - exiting 06:14:00 (4920): No heartbeat from core client for 30 sec - exiting 06:14:01 (4920): No heartbeat from core client for 30 sec - exiting 06:14:02 (4920): No heartbeat from core client for 30 sec - exiting 06:14:03 (4920): No heartbeat from core client for 30 sec - exiting 06:14:05 (4920): No heartbeat from core client for 30 sec - exiting 06:14:06 (4920): No heartbeat from core client for 30 sec - exiting 06:14:07 (4920): No heartbeat from core client for 30 sec - exiting 06:14:08 (4920): No heartbeat from core client for 30 sec - exiting 06:14:09 (4920): No heartbeat from core client for 30 sec - exiting 06:14:10 (4920): No heartbeat from core client for 30 sec - exiting 06:14:11 (4920): No heartbeat from core client for 30 sec - exiting 06:14:12 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:37:05 (2388): No heartbeat from core client for 30 sec - exiting 06:37:07 (2388): No heartbeat from core client for 30 sec - exiting 06:37:08 (2388): No heartbeat from core client for 30 sec - exiting 06:37:09 (2388): No heartbeat from core client for 30 sec - exiting 06:37:10 (2388): No heartbeat from core client for 30 sec - exiting 06:37:11 (2388): No heartbeat from core client for 30 sec - exiting 06:37:12 (2388): No heartbeat from core client for 30 sec - exiting 06:37:14 (2388): No heartbeat from core client for 30 sec - exiting 06:37:15 (2388): No heartbeat from core client for 30 sec - exiting 06:37:16 (2388): No heartbeat from core client for 30 sec - exiting 06:37:17 (2388): No heartbeat from core client for 30 sec - exiting 06:37:18 (2388): No heartbeat from core client for 30 sec - exiting 06:37:19 (2388): No heartbeat from core client for 30 sec - exiting 06:37:20 (2388): No heartbeat from core client for 30 sec - exiting 06:37:21 (2388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:47:54 (4168): No heartbeat from core client for 30 sec - exiting 15:47:56 (4168): No heartbeat from core client for 30 sec - exiting 15:47:57 (4168): No heartbeat from core client for 30 sec - exiting 15:47:58 (4168): No heartbeat from core client for 30 sec - exiting 15:47:59 (4168): No heartbeat from core client for 30 sec - exiting 15:48:00 (4168): No heartbeat from core client for 30 sec - exiting 15:48:01 (4168): No heartbeat from core client for 30 sec - exiting 15:48:03 (4168): No heartbeat from core client for 30 sec - exiting 15:48:04 (4168): No heartbeat from core client for 30 sec - exiting 15:48:05 (4168): No heartbeat from core client for 30 sec - exiting 15:48:06 (4168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:48:07 (4168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Mar 2013 21:00:06	1153555	15548848	hadcm3n_n5n5_1880_40_008286073_0	777,600	1,412,888	1.8170
09 Mar 2013 01:35:39	1153555	15548848	hadcm3n_n5n5_1880_40_008286073_0	751,680	1,361,712	1.8116
07 Mar 2013 22:07:39	1153555	15548848	hadcm3n_n5n5_1880_40_008286073_0	725,760	1,308,490	1.8029
05 Mar 2013 23:53:42	1153555	15548848	hadcm3n_n5n5_1880_40_008286073_0	699,840	1,262,039	1.8033
04 Mar 2013 21:16:43	1153555	15548848	hadcm3n_n5n5_1880_40_008286073_0	673,920	1,211,489	1.7977
01 Mar 2013 02:05:51	1153555	15548848	hadcm3n_n5n5_1880_40_008286073_0	648,000	1,162,631	1.7942
26 Feb 2013 21:07:59	1153555	15548848	hadcm3n_n5n5_1880_40_008286073_0	622,080	1,111,398	1.7866
25 Feb 2013 15:31:53	1153555	15548848	hadcm3n_n5n5_1880_40_008286073_0	596,160	1,063,667	1.7842
21 Feb 2013 14:35:34	1153555	15548848	hadcm3n_n5n5_1880_40_008286073_0	570,240	1,010,272	1.7717
16 Feb 2013 19:10:57	1153555	15548848	hadcm3n_n5n5_1880_40_008286073_0	544,320	959,661	1.7630
14 Feb 2013 22:39:52	1153555	15548848	hadcm3n_n5n5_1880_40_008286073_0	518,400	905,407	1.7465
11 Feb 2013 18:31:49	1153555	15548848	hadcm3n_n5n5_1880_40_008286073_0	492,480	855,375	1.7369
08 Feb 2013 21:38:23	1153555	15548848	hadcm3n_n5n5_1880_40_008286073_0	466,560	802,572	1.7202
08 Feb 2013 02:19:33	1153555	15548848	hadcm3n_n5n5_1880_40_008286073_0	440,640	758,095	1.7204
07 Feb 2013 15:21:24	1153555	15548848	hadcm3n_n5n5_1880_40_008286073_0	414,720	715,987	1.7264
06 Feb 2013 17:47:06	1153555	15548848	hadcm3n_n5n5_1880_40_008286073_0	388,800	668,459	1.7193
05 Feb 2013 15:55:50	1153555	15548848	hadcm3n_n5n5_1880_40_008286073_0	362,880	622,080	1.7143
04 Feb 2013 19:46:13	1153555	15548848	hadcm3n_n5n5_1880_40_008286073_0	336,960	575,614	1.7083
03 Feb 2013 03:51:33	1153555	15548848	hadcm3n_n5n5_1880_40_008286073_0	311,040	528,740	1.6999
01 Feb 2013 22:18:01	1153555	15548848	hadcm3n_n5n5_1880_40_008286073_0	285,120	478,651	1.6788