Task 19198906

Name	hadam3p_anz_q3k0_201212_12_290_010261107_0
Workunit	10261107
Created	14 Jan 2016, 15:42:30 UTC
Sent	14 Jan 2016, 18:04:54 UTC
Report deadline	26 Dec 2016, 23:24:54 UTC
Received	30 Jan 2016, 22:25:29 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	1 (0x00000001) Unknown error code
Computer ID	1358336
Run time	4 days 18 hours 28 min 39 sec
CPU time	4 days 16 hours 3 min 27 sec
Validate state	Invalid
Credit	4,981.10
Device peak FLOPS	3.29 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <message> Incorrect function. (0x1) - exit code 1 (0x1) </message> <stderr_txt> 13:24:07 (2828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3764, selfPID=3764, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 16:34:59 (7024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:37:13 (10624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:32:59 (9760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:13:52 (6312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6336, selfPID=6336, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 10:16:47 (6172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:17:48 (9472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2468, selfPID=2468, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6804, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:13:54 (6112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:25:47 (11772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:44:43 (3776): start_timer_thread(): CreateThread() failed, errno 0 08:44:45 (10116): start_timer_thread(): CreateThread() failed, errno 0 17:36:41 (5692): start_timer_thread(): CreateThread() failed, errno 0 17:36:43 (7952): start_timer_thread(): CreateThread() failed, errno 0 19:01:10 (1644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:01:20 (10976): start_timer_thread(): CreateThread() failed, errno 0 19:01:21 (9852): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:53:49 (7400): start_timer_thread(): CreateThread() failed, errno 0 21:53:51 (5704): start_timer_thread(): CreateThread() failed, errno 0 22:28:54 (6424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:29:05 (1336): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 08:35:57 (11040): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 09:38:51 (10400): start_timer_thread(): CreateThread() failed, errno 0 09:38:52 (7440): start_timer_thread(): CreateThread() failed, errno 0 18:10:39 (10220): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:18:02 (9692): start_timer_thread(): CreateThread() failed, errno 0 19:18:04 (10392): start_timer_thread(): CreateThread() failed, errno 0 20:02:55 (7344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:03:01 (3628): start_timer_thread(): CreateThread() failed, errno 0 20:03:03 (9676): start_timer_thread(): CreateThread() failed, errno 0 22:13:26 (296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:13:39 (10784): start_timer_thread(): CreateThread() failed, errno 0 08:39:54 (10040): start_timer_thread(): CreateThread() failed, errno 0 08:39:55 (10924): start_timer_thread(): CreateThread() failed, errno 0 18:28:45 (5188): start_timer_thread(): CreateThread() failed, errno 0 18:28:46 (8328): start_timer_thread(): CreateThread() failed, errno 0 08:56:36 (7912): start_timer_thread(): CreateThread() failed, errno 0 18:15:26 (5272): start_timer_thread(): CreateThread() failed, errno 0 18:15:28 (9512): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:43:35 (8884): start_timer_thread(): CreateThread() failed, errno 0 19:43:36 (9376): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 00:20:07 (9100): start_timer_thread(): CreateThread() failed, errno 0 00:20:08 (9136): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 00:23:06 (5432): start_timer_thread(): CreateThread() failed, errno 0 00:23:08 (7048): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:28:27 (12084): start_timer_thread(): CreateThread() failed, errno 0 10:28:29 (10668): start_timer_thread(): CreateThread() failed, errno 0 14:22:04 (3472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:22:13 (9804): start_timer_thread(): CreateThread() failed, errno 0 14:22:14 (8912): start_timer_thread(): CreateThread() failed, errno 0 14:27:12 (8932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:27:18 (4028): start_timer_thread(): CreateThread() failed, errno 0 14:27:19 (7804): start_timer_thread(): CreateThread() failed, errno 0 14:51:02 (6232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:51:05 (5340): start_timer_thread(): CreateThread() failed, errno 0 14:51:06 (11144): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:39:38 (12788): start_timer_thread(): CreateThread() failed, errno 0 20:39:39 (12660): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:07:09 (11636): start_timer_thread(): CreateThread() failed, errno 0 21:07:10 (6172): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7152, iMonCtr=2 Model crash detected, will try to restart... GlobalLeaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:26:11 (6548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:51:18 (2904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:52:22 (9424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7548, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7752, selfPID=6672, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 13:26:47 (1924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3432, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7980, selfPID=7980, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8564, selfPID=8564, iMonCtr=2 18:32:17 (2780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:33:06 (5648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:23:29 (8952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10184, selfPID=6776, iMonCtr=1 Model crash detected, will try to restart... 16:20:14 (6716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Jan 2016 14:42:14	1358336	19198906	hadam3p_anz_q3k0_201212_12_290_010261107_0	115,499	387,974	3.3591
25 Jan 2016 14:11:31	1358336	19198906	hadam3p_anz_q3k0_201212_12_290_010261107_0	103,979	350,583	3.3717
23 Jan 2016 23:44:19	1358336	19198906	hadam3p_anz_q3k0_201212_12_290_010261107_0	92,459	313,329	3.3888
22 Jan 2016 20:30:47	1358336	19198906	hadam3p_anz_q3k0_201212_12_290_010261107_0	80,939	275,935	3.4092
21 Jan 2016 03:42:06	1358336	19198906	hadam3p_anz_q3k0_201212_12_290_010261107_0	69,419	237,789	3.4254
19 Jan 2016 04:38:58	1358336	19198906	hadam3p_anz_q3k0_201212_12_290_010261107_0	57,899	198,888	3.4351
17 Jan 2016 22:37:36	1358336	19198906	hadam3p_anz_q3k0_201212_12_290_010261107_0	46,379	159,031	3.4289
17 Jan 2016 01:45:57	1358336	19198906	hadam3p_anz_q3k0_201212_12_290_010261107_0	34,859	119,542	3.4293
16 Jan 2016 03:03:06	1358336	19198906	hadam3p_anz_q3k0_201212_12_290_010261107_0	23,339	79,978	3.4268
15 Jan 2016 15:31:58	1358336	19198906	hadam3p_anz_q3k0_201212_12_290_010261107_0	11,819	40,613	3.4362