Task 12162630

Name	hadam3p_saf_10cl_1980_1_006889885_0
Workunit	7093201
Created	19 Nov 2010, 16:50:12 UTC
Sent	5 Apr 2011, 3:56:51 UTC
Report deadline	17 Mar 2012, 9:16:51 UTC
Received	28 Jun 2011, 0:14:23 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1088181
Run time	9 days 14 hours 4 min 31 sec
CPU time	7 days 10 hours 24 min 27 sec
Validate state	Workunit error - check skipped
Credit	2,244.09
Device peak FLOPS	1.52 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>6.12.26</core_client_version> <![CDATA[ <stderr_txt> 19:45:42 (3688): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4288, selfPID=4288, iMonCtr=2 21:52:50 (5388): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5436, selfPID=5436, iMonCtr=2 00:49:19 (2892): start_timer_thread(): CreateThread() failed, errno 0 08:26:22 (5948): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:44:04 (5572): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:00:53 (1816): start_timer_thread(): CreateThread() failed, errno 0 18:13:55 (4392): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:30:11 (5340): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:23:28 (5804): start_timer_thread(): CreateThread() failed, errno 0 20:02:16 (4464): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:20:02 (3328): start_timer_thread(): CreateThread() failed, errno 0 22:20:02 (3636): start_timer_thread(): CreateThread() failed, errno 0 21:52:01 (4848): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4004, iMonCtr=2 Model crash detected, will try to restart... 04:55:03 (1664): start_timer_thread(): CreateThread() failed, errno 0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1700, selfPID=3896, iMonCtr=1 Model crash detected, will try to restart... 21:04:34 (4408): start_timer_thread(): CreateThread() failed, errno 0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2240, selfPID=756, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4064, selfPID=3604, iMonCtr=1 Model crash detected, will try to restart... 04:51:16 (2488): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2488, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2096, selfPID=3992, iMonCtr=1 Model crash detected, will try to restart... 21:51:16 (2108): No heartbeat from core client for 30 sec - exiting 21:51:17 (2108): No heartbeat from core client for 30 sec - exiting 21:51:18 (2108): No heartbeat from core client for 30 sec - exiting 21:51:19 (2108): No heartbeat from core client for 30 sec - exiting 21:51:21 (2108): No heartbeat from core client for 30 sec - exiting 21:51:22 (2108): No heartbeat from core client for 30 sec - exiting 21:51:23 (2108): No heartbeat from core client for 30 sec - exiting 21:51:24 (2108): No heartbeat from core client for 30 sec - exiting 21:51:25 (2108): No heartbeat from core client for 30 sec - exiting 21:51:26 (2108): No heartbeat from core client for 30 sec - exiting 21:51:27 (2108): No heartbeat from core client for 30 sec - exiting 21:51:28 (2108): No heartbeat from core client for 30 sec - exiting 21:51:29 (2108): No heartbeat from core client for 30 sec - exiting 21:51:30 (2108): No heartbeat from core client for 30 sec - exiting 21:51:31 (2108): No heartbeat from core client for 30 sec - exiting 21:51:33 (2108): No heartbeat from core client for 30 sec - exiting 21:51:34 (2108): No heartbeat from core client for 30 sec - exiting 21:51:35 (2108): No heartbeat from core client for 30 sec - exiting 21:51:36 (2108): No heartbeat from core client for 30 sec - exiting 21:51:37 (2108): No heartbeat from core client for 30 sec - exiting 21:51:38 (2108): No heartbeat from core client for 30 sec - exiting 21:51:39 (2108): No heartbeat from core client for 30 sec - exiting 21:51:40 (2108): No heartbeat from core client for 30 sec - exiting 21:51:41 (2108): No heartbeat from core client for 30 sec - exiting 21:51:42 (2108): No heartbeat from core client for 30 sec - exiting 21:51:43 (2108): No heartbeat from core client for 30 sec - exiting 21:51:45 (2108): No heartbeat from core client for 30 sec - exiting 21:51:46 (2108): No heartbeat from core client for 30 sec - exiting 21:51:47 (2108): No heartbeat from core client for 30 sec - exiting 21:51:48 (2108): No heartbeat from core client for 30 sec - exiting 21:51:49 (2108): No heartbeat from core client for 30 sec - exiting 21:51:50 (2108): No heartbeat from core client for 30 sec - exiting 21:51:51 (2108): No heartbeat from core client for 30 sec - exiting 21:51:52 (2108): No heartbeat from core client for 30 sec - exiting 21:51:53 (2108): No heartbeat from core client for 30 sec - exiting 21:51:54 (2108): No heartbeat from core client for 30 sec - exiting 21:51:55 (2108): No heartbeat from core client for 30 sec - exiting 21:51:57 (2108): No heartbeat from core client for 30 sec - exiting 21:51:58 (2108): No heartbeat from core client for 30 sec - exiting 21:51:59 (2108): No heartbeat from core client for 30 sec - exiting 21:52:00 (2108): No heartbeat from core client for 30 sec - exiting 21:52:01 (2108): No heartbeat from core client for 30 sec - exiting 21:52:02 (2108): No heartbeat from core client for 30 sec - exiting 21:52:03 (2108): No heartbeat from core client for 30 sec - exiting 21:52:04 (2108): No heartbeat from core client for 30 sec - exiting 21:52:05 (2108): No heartbeat from core client for 30 sec - exiting 21:52:06 (2108): No heartbeat from core client for 30 sec - exiting 21:52:08 (2108): No heartbeat from core client for 30 sec - exiting 21:52:09 (2108): No heartbeat from core client for 30 sec - exiting 21:52:10 (2108): No heartbeat from core client for 30 sec - exiting 21:52:11 (2108): No heartbeat from core client for 30 sec - exiting 21:52:12 (2108): No heartbeat from core client for 30 sec - exiting 21:52:13 (2108): No heartbeat from core client for 30 sec - exiting 21:52:14 (2108): No heartbeat from core client for 30 sec - exiting 21:52:15 (2108): No heartbeat from core client for 30 sec - exiting 21:52:16 (2108): No heartbeat from core client for 30 sec - exiting 21:52:17 (2108): No heartbeat from core client for 30 sec - exiting 21:52:19 (2108): No heartbeat from core client for 30 sec - exiting 21:52:20 (2108): No heartbeat from core client for 30 sec - exiting 21:52:21 (2108): No heartbeat from core client for 30 sec - exiting 21:52:22 (2108): No heartbeat from core client for 30 sec - exiting 21:52:23 (2108): No heartbeat from core client for 30 sec - exiting 21:52:24 (2108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:58:39 (6032): start_timer_thread(): CreateThread() failed, errno 0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6104, selfPID=2980, iMonCtr=1 Model crash detected, will try to restart... 22:25:58 (3976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2444, iMonCtr=2 Model crash detected, will try to restart... 08:08:51 (4884): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:31:17 (652): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3388, selfPID=3388, iMonCtr=2 00:47:54 (1092): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:26:59 (4048): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4048, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3908, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3952, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4996, iMonCtr=2 Mode l crash detected, will try to restart... 17:20:28 (5616): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:43:09 (7756): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:58:15 (6240): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6720, selfPID=6720, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 14:34:05 (5268): start_timer_thread(): CreateThread() failed, errno 0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3356, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5268, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4076, selfPID=4076, iMonCtr=2 17:13:01 (1472): start_timer_thread(): CreateThread() failed, errno 0 19:42:08 (5844): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:58:05 (7744): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3728, selfPID=3728, iMonCtr=2 06:32:11 (5556): start_timer_thread(): CreateThread() failed, errno 0 07:45:33 (1172): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:02:47 (6220): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:40:37 (12016): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12524, selfPID=12524, iMonCtr=2 22:15:52 (10948): start_timer_thread(): CreateThread() failed, errno 0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15444, selfPID=14700, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5024, selfPID=5024, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 09:16:51 (4572): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:33:21 (752): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3064, selfPID=3064, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9948, selfPID=9948, iMonCtr=2 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2944, selfPID=4360, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2944, selfPID=2944, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5776, selfPID=5776, iMonCtr=2 10:44:26 (13136): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:47:09 (15820): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:03:54 (14988): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:53:29 (17052): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:09:11 (5624): start_timer_thread(): CreateThread() failed, errno 0 CCPDN Monitor - Quit request from BOINC... 04:49:42 (7144): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:48:24 (4356): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9640, selfPID=9640, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11984, selfPID=11984, iMonCtr=2 12:01:26 (10852): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 01:04:58 (6216): start_timer_thread(): CreateThread() failed, errno 0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7680, iMonCtr=2 Model crash detected, will try to restart... 01:31:02 (3748): No heartbeat from core client for 30 sec - exiting 01:31:04 (3748): No heartbeat from core client for 30 sec - exiting 01:31:05 (3748): No heartbeat from core client for 30 sec - exiting 01:31:06 (3748): No heartbeat from core client for 30 sec - exiting 01:31:07 (3748): No heartbeat from core client for 30 sec - exiting 01:31:08 (3748): No heartbeat from core client for 30 sec - exiting 01:31:09 (3748): No heartbeat from core client for 30 sec - exiting 01:31:10 (3748): No heartbeat from core client for 30 sec - exiting 01:31:11 (3748): No heartbeat from core client for 30 sec - exiting 01:31:12 (3748): No heartbeat from core client for 30 sec - exiting 01:31:13 (3748): No heartbeat from core client for 30 sec - exiting 01:31:15 (3748): No heartbeat from core client for 30 sec - exiting 01:31:16 (3748): No heartbeat from core client for 30 sec - exiting 01:31:17 (3748): No heartbeat from core client for 30 sec - exiting 01:31:18 (3748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:47:29 (972): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:17:23 (8536): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:38:34 (1380): start_timer_thread(): CreateThread() failed, errno 0 Global04:59:06 (4060): start_timer_thread(): CreateThread() failed, errno 0 19:50:11 (4124): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:57:42 (7160): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 01:33:54 (5236): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7720, selfPID=7720, iMonCtr=2 21:44:29 (2620): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1928, selfPID=1928, iMonCtr=2 22:47:02 (1980): start_timer_thread(): CreateThread() failed, errno 0 22:48:42 (4812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1360, selfPID=1360, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5908, selfPID=5908, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2360, selfPID=2360, iMonCtr=2 04:17:56 (5360): start_timer_thread(): CreateThread() failed, errno 0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1776, iMonCtr=2 Model crash detected, will try to restart... 00:19:44 (4892): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1580, selfPID=1580, CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5872, selfPID=5872, iMonCtr=2 01:32:35 (8312): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:27:48 (13540): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:21:28 (15328): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:02:22 (18816): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:05:25 (19336): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:15:07 (2152): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8388, selfPID=8388, iMonCtr=2 10:39:01 (2800): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8484, selfPID=8484, iMonCtr=2 19:04:31 (5384): start_timer_thread(): CreateThread() failed, errno 0 21:22:37 (5548): start_timer_thread(): CreateThread() failed, errno 0 22:58:20 (2184): start_timer_thread(): CreateThread() failed, errno 0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3992, iMonCtr=2 Model crash detected, will try to restart... 04:48:21 (4020): start_timer_thread(): CreateThread() failed, errno 0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4028, selfPID=3860, iMonCtr=1 Model crash detected, will try to restart... 19:50:27 (3996): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8868, selfPID=8868, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:35:46 (8048): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:55:32 (4688): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:30:11 (11692): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:02:14 (6116): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 03:36:24 (7040): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3372, selfPID=3372, iMonCtr=2 07:55:57 (10868): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:57:10 (6084): start_timer_thread(): CreateThread() failed, errno 0 14:57:11 (5412): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5412, selfPID=5412, iMonCtr=2 19:48:45 (5132): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:09:52 (11644): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11180, selfPID=11180, iMonCtr=2 19:49:30 (3956): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 02:07:11 (8852): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:08:48 (1832): start_timer_thread(): CreateThread() failed, errno 0 22:17:50 (7064): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11956, selfPID=11956, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 05:40:20 (13656): start_timer_thread(): CreateThread() failed, errno 0 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13656, selfPID=12216, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13656, selfPID=13656, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14564, selfPID=14564, iMonCtr=2 10:47:08 (16848): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:55:49 (17956): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17956, selfPID=17956, iMonCtr=2 15:18:39 (16540): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=19708, selfPID=19708, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=22068, selfPID=22068, iMonCtr=2 23:12:43 (1504): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:55:05 (4140): start_timer_thread(): CreateThread() failed, errno 0 10:55:05 (2312): start_timer_thread(): CreateThread() failed, errno 0 17:28:53 (4816): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:08:36 (1988): No heartbeat from core client for 30 sec - exiting 22:08:37 (1988): No heartbeat from core client for 30 sec - exiting 22:08:38 (1988): No heartbeat from core client for 30 sec - exiting 22:08:40 (1988): No heartbeat from core client for 30 sec - exiting 22:08:41 (1988): No heartbeat from core client for 30 sec - exiting 22:08:42 (1988): No heartbeat from core client for 30 sec - exiting 22:08:43 (1988): No heartbeat from core client for 30 sec - exiting 22:08:44 (1988): No heartbeat from core client for 30 sec - exiting 22:08:45 (1988): No heartbeat from core client for 30 sec - exiting 22:08:47 (1988): No heartbeat from core client for 30 sec - exiting 22:08:48 (1988): No heartbeat from core client for 30 sec - exiting 22:08:49 (1988): No heartbeat from core client for 30 sec - exiting 22:08:50 (1988): No heartbeat from core client for 30 sec - exiting 22:08:51 (1988): No heartbeat from core client for 30 sec - exiting 22:08:52 (1988): No heartbeat from core client for 30 sec - exiting 22:08:53 (1988): No heartbeat from core client for 30 sec - exiting 22:08:54 (1988): No heartbeat from core client for 30 sec - exiting 22:08:56 (1988): No heartbeat from core client for 30 sec - exiting 22:08:57 (1988): No heartbeat from core client for 30 sec - exiting 22:08:58 (1988): No heartbeat from core client for 30 sec - exiting 22:08:59 (1988): No heartbeat from core client for 30 sec - exiting 22:09:00 (1988): No heartbeat from core client for 30 sec - exiting 22:09:01 (1988): No heartbeat from core client for 30 sec - exiting 22:09:02 (1988): No heartbeat from core client for 30 sec - exiting 22:09:03 (1988): No heartbeat from core client for 30 sec - exiting 22:09:05 (1988): No heartbeat from core client for 30 sec - exiting 22:09:06 (1988): No heartbeat from core client for 30 sec - exiting 22:09:07 (1988): No heartbeat from core client for 30 sec - exiting 22:09:08 (1988): No heartbeat from core client for 30 sec - exiting 22:09:09 (1988): No heartbeat from core client for 30 sec - exiting 22:09:10 (1988): No heartbeat from core client for 30 sec - exiting 22:09:11 (1988): No heartbeat from core client for 30 sec - exiting 22:09:12 (1988): No heartbeat from core client for 30 sec - exiting 22:09:13 (1988): No heartbeat from core client for 30 sec - exiting 22:09:15 (1988): No heartbeat from core client for 30 sec - exiting 22:09:17 (1988): No heartbeat from core client for 30 sec - exiting 22:09:18 (1988): No heartbeat from core client for 30 sec - exiting 22:09:19 (1988): No heartbeat from core client for 30 sec - exiting 22:09:20 (1988): No heartbeat from core client for 30 sec - exiting 22:09:21 (1988): No heartbeat from core client for 30 sec - exiting 22:09:22 (1988): No heartbeat from core client for 30 sec - exiting 22:09:23 (1988): No heartbeat from core client for 30 sec - exiting 22:09:24 (1988): No heartbeat from core client for 30 sec - exiting 22:09:25 (1988): No heartbeat from core client for 30 sec - exiting 22:09:26 (1988): No heartbeat from core client for 30 sec - exiting 22:09:27 (1988): No heartbeat from core client for 30 sec - exiting 22:09:29 (1988): No heartbeat from core client for 30 sec - exiting 22:09:30 (1988): No heartbeat from core client for 30 sec - exiting 22:09:31 (1988): No heartbeat from core client for 30 sec - exiting 22:09:32 (1988): No heartbeat from core client for 30 sec - exiting 22:09:33 (1988): No heartbeat from core client for 30 sec - exiting 22:09:34 (1988): No heartbeat from core client for 30 sec - exiting 22:09:35 (1988): No heartbeat from core client for 30 sec - exiting 22:09:36 (1988): No heartbeat from core client for 30 sec - exiting 22:09:37 (1988): No heartbeat from core client for 30 sec - exiting 22:09:38 (1988): No heartbeat from core client for 30 sec - exiting 22:09:39 (1988): No heartbeat from core client for 30 sec - exiting 22:09:40 (1988): No heartbeat from core client for 30 sec - exiting 22:09:41 (1988): No heartbeat from core client for 30 sec - exiting 22:09:42 (1988): No heartbeat from core client for 30 sec - exiting 22:09:43 (1988): No heartbeat from core client for 30 sec - exiting 22:09:45 (1988): No heartbeat from core client for 30 sec - exiting 22:09:46 (1988): No heartbeat from core client for 30 sec - exiting 22:09:47 (1988): No heartbeat from core client for 30 sec - exiting 22:09:48 (1988): No heartbeat from core client for 30 sec - exiting 22:09:49 (1988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:09:51 (1988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 03:08:09 (7852): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:55:40 (6732): start_timer_thread(): CreateThread() failed, errno 0 22:55:55 (3364): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6732, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 14:01:12 (3860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10616, selfPID=10616, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:19:48 (2292): start_timer_thread(): CreateThread() failed, errno 0 0:19:48 (4272): start_timer_thread(): CreateThread() failed, errno 0 20:30:56 (2376): start_timer_thread(): CreateThread() failed, errno 0 20:30:57 (2848): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2376, selfPID=2376, iMonCtr=2 22:18:50 (5932): start_timer_thread(): CreateThread() failed, errno 0 22:18:50 (5060): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 00:50:14 (8096): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 04:42:55 (3428): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 04:42:56 (2788): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:49:38 (7880): start_timer_thread(): CreateThread() failed, errno 0 23:49:38 (6064): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6064, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7880, selfPID=5116, iMonCtr=1 Model crash detected, will try to restart... 09:20:17 (5696): start_timer_thread(): CreateThread() failed, errno 0 09:20:18 (2000): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:18:47 (8504): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:45:30 (12092): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 01:25:30 (2808): start_timer_thread(): CreateThread() failed, errno 0 01:25:57 (7640): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 04:52:53 (9152): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9152, selfPID=9152, iMonCtr=2 07:53:08 (11924): start_timer_thread(): CreateThread() failed, errno 0 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11924, selfPID=11928, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11924, selfPID=11924, iMonCtr=1 11:23:58 (12940): start_timer_thread(): CreateThread() failed, errno 0 11:24:45 (10768): start_timer_thread(): CreateThread() failed, errno 0 16:08:19 (7044): start_timer_thread(): CreateThread() failed, errno 0 16:08:19 (7156): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:40:35 (196): start_timer_thread(): CreateThread() failed, errno 0 19:40:36 (4204): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:40:14 (8872): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:08:00 (5412): start_timer_thread(): CreateThread() failed, errno 0 20:08:00 (5404): start_timer_thread(): CreateThread() failed, errno 0 21:08:00 (992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:09:26 (8684): start_timer_thread(): CreateThread() failed, errno 0 21:09:27 (4252): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 01:14:42 (6264): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:34:53 (4020): start_timer_thread(): CreateThread() failed, errno 0 21:34:54 (5108): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:18:31 (3448): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:36:10 (5572): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5572, selfPID=5572, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 18:43:11 (4708): start_timer_thread(): CreateThread() failed, errno 0 errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4708, iMonCtr=2 08:25:17 (4028): No heartbeat from core client for 30 sec - exiting 08:25:18 (4028): No heartbeat from core client for 30 sec - exiting 08:25:20 (4028): No heartbeat from core client for 30 sec - exiting 08:25:21 (4028): No heartbeat from core client for 30 sec - exiting 08:25:22 (4028): No heartbeat from core client for 30 sec - exiting 08:25:23 (4028): No heartbeat from core client for 30 sec - exiting 08:25:24 (4028): No heartbeat from core client for 30 sec - exiting 08:25:25 (4028): No heartbeat from core client for 30 sec - exiting 08:25:26 (4028): No heartbeat from core client for 30 sec - exiting 08:25:27 (4028): No heartbeat from core client for 30 sec - exiting 08:25:28 (4028): No heartbeat from core client for 30 sec - exiting 08:25:29 (4028): No heartbeat from core client for 30 sec - exiting 08:25:31 (4028): No heartbeat from core client for 30 sec - exiting 08:25:32 (4028): No heartbeat from core client for 30 sec - exiting 08:25:33 (4028): No heartbeat from core client for 30 sec - exiting 08:25:34 (4028): No heartbeat from core client for 30 sec - exiting 08:25:35 (4028): No heartbeat from core client for 30 sec - exiting 08:25:36 (4028): No heartbeat from core client for 30 sec - exiting 08:25:37 (4028): No heartbeat from core client for 30 sec - exiting 08:25:38 (4028): No heartbeat from core client for 30 sec - exiting 08:25:39 (4028): No heartbeat from core client for 30 sec - exiting 08:25:40 (4028): No heartbeat from core client for 30 sec - exiting 08:25:41 (4028): No heartbeat from core client for 30 sec - exiting 08:25:43 (4028): No heartbeat from core client for 30 sec - exiting 08:25:44 (4028): No heartbeat from core client for 30 sec - exiting 08:25:45 (4028): No heartbeat from core client for 30 sec - exiting 08:25:46 (4028): No heartbeat from core client for 30 sec - exiting 08:25:47 (4028): No heartbeat from core client for 30 sec - exiting 08:25:48 (4028): No heartbeat from core client for 30 sec - exiting 08:25:49 (4028): No heartbeat from core client for 30 sec - exiting 08:25:50 (4028): No heartbeat from core client for 30 sec - exiting 08:25:51 (4028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:26:48 (3120): start_timer_thread(): CreateThread() failed, errno 0 08:26:55 (4400): start_timer_thread(): CreateThread() failed, errno 0 08:26:55 (4392): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4400, selfPID=4400, iMonCtr=2 12:32:34 (1808): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:19:27 (6396): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:49:26 (2852): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:17:37 (8132): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 05:01:04 (6292): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:55:57 (5332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5176, selfPID=5176, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5736, selfPID=5528, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3428, selfPID=3428, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1780, selfPID=1780, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 21:14:55 (5988): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1284, selfPID=1284, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4204, selfPID=4204, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:53:48 (4376): No heartbeat from core client for 30 sec - exiting 19:53:49 (4376): No heartbeat from core client for 30 sec - exiting 19:53:51 (4376): No heartbeat from core client for 30 sec - exiting 19:53:52 (4376): No heartbeat from core client for 30 sec - exiting 19:53:53 (4376): No heartbeat from core client for 30 sec - exiting 19:53:54 (4376): No heartbeat from core client for 30 sec - exiting 19:53:56 (4376): No heartbeat from core client for 30 sec - exiting 19:53:57 (4376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Jun 2011 23:17:22	1088181	12162630	hadam3p_saf_10cl_1980_1_006889885_0	138,336	641,317	4.6359
25 Jun 2011 03:35:27	1088181	12162630	hadam3p_saf_10cl_1980_1_006889885_0	126,816	585,653	4.6181
19 Jun 2011 22:03:28	1088181	12162630	hadam3p_saf_10cl_1980_1_006889885_0	115,296	533,891	4.6306
12 Jun 2011 01:25:23	1088181	12162630	hadam3p_saf_10cl_1980_1_006889885_0	103,776	485,174	4.6752
05 Jun 2011 00:42:35	1088181	12162630	hadam3p_saf_10cl_1980_1_006889885_0	92,256	431,186	4.6738
29 May 2011 06:10:27	1088181	12162630	hadam3p_saf_10cl_1980_1_006889885_0	80,736	378,169	4.6840
21 May 2011 18:38:31	1088181	12162630	hadam3p_saf_10cl_1980_1_006889885_0	69,216	327,279	4.7284
15 May 2011 05:06:16	1088181	12162630	hadam3p_saf_10cl_1980_1_006889885_0	57,696	275,813	4.7805
11 May 2011 01:50:01	1088181	12162630	hadam3p_saf_10cl_1980_1_006889885_0	46,176	223,713	4.8448
02 May 2011 20:47:09	1088181	12162630	hadam3p_saf_10cl_1980_1_006889885_0	34,656	168,445	4.8605
29 Apr 2011 19:01:02	1088181	12162630	hadam3p_saf_10cl_1980_1_006889885_0	23,136	112,981	4.8833
21 Apr 2011 17:29:32	1088181	12162630	hadam3p_saf_10cl_1980_1_006889885_0	11,616	57,118	4.9172