Task 20114216

Name	wah2_pnw25_c0oc_200312_48_485_010812827_1
Workunit	10812827
Created	22 Dec 2016, 7:41:16 UTC
Sent	22 Dec 2016, 7:41:31 UTC
Report deadline	4 Dec 2017, 13:01:31 UTC
Received	29 Dec 2016, 10:08:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID	1397908
Run time	6 days 11 hours 6 min 29 sec
CPU time	6 days 8 hours 22 min 40 sec
Validate state	Invalid
Credit	24,337.69
Device peak FLOPS	3.62 GFLOPS
Application version	Weather At Home 2 (wah2) v8.24 windows_intelx86
Peak working set size	185.89 MB
Peak swap size	165.55 MB
Peak disk usage	2.27 MB
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <message> finish file present too long </message> <stderr_txt> hread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:19:20 (11980): start_timer_thread(): CreateThread() failed, errno 0 07:19:21 (2800): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:19:36 (5952): start_timer_thread(): CreateThread() failed, errno 0 07:19:38 (13172): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:19:42 (7572): start_timer_thread(): CreateThread() failed, errno 0 07:19:43 (7080): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:19:48 (11560): start_timer_thread(): CreateThread() failed, errno 0 07:19:50 (8336): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:19:54 (5968): start_timer_thread(): CreateThread() failed, errno 0 07:19:56 (7340): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:20:00 (4884): start_timer_thread(): CreateThread() failed, errno 0 07:20:01 (7388): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:20:10 (11556): start_timer_thread(): CreateThread() failed, errno 0 07:20:11 (1868): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:20:19 (13188): start_timer_thread(): CreateThread() failed, errno 0 07:20:20 (1908): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:20:25 (6724): start_timer_thread(): CreateThread() failed, errno 0 07:20:26 (11884): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:20:30 (6816): start_timer_thread(): CreateThread() failed, errno 0 07:20:32 (11776): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:20:36 (5540): start_timer_thread(): CreateThread() failed, errno 0 07:20:38 (9196): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:20:42 (10824): start_timer_thread(): CreateThread() failed, errno 0 07:20:43 (10224): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:20:47 (8208): start_timer_thread(): CreateThread() failed, errno 0 07:20:49 (8876): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:20:57 (6172): start_timer_thread(): CreateThread() failed, errno 0 07:20:59 (5348): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:21:04 (4148): start_timer_thread(): CreateThread() failed, errno 0 07:21:05 (11504): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:21:11 (12208): start_timer_thread(): CreateThread() failed, errno 0 07:21:12 (9496): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:21:16 (10404): start_timer_thread(): CreateThread() failed, errno 0 07:21:18 (2244): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:21:32 (1052): start_timer_thread(): CreateThread() failed, errno 0 07:21:34 (2792): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:21:37 (7268): start_timer_thread(): CreateThread() failed, errno 0 07:21:39 (10900): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:21:44 (10776): start_timer_thread(): CreateThread() failed, errno 0 07:21:45 (10056): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:21:49 (6860): start_timer_thread(): CreateThread() failed, errno 0 07:21:51 (10948): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:21:57 (5424): start_timer_thread(): CreateThread() failed, errno 0 07:21:59 (2488): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:22:18 (8660): start_timer_thread(): CreateThread() failed, errno 0 07:22:19 (5500): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:22:26 (772): start_timer_thread(): CreateThread() failed, errno 0 07:22:27 (11964): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:22:35 (11948): start_timer_thread(): CreateThread() failed, errno 0 07:22:37 (12728): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:22:45 (7408): start_timer_thread(): CreateThread() failed, errno 0 07:22:47 (12368): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:22:51 (6664): start_timer_thread(): CreateThread() failed, errno 0 07:22:52 (8808): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:22:56 (6708): start_timer_thread(): CreateThread() failed, errno 0 07:22:58 (7624): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:23:07 (6628): start_timer_thread(): CreateThread() failed, errno 0 07:23:08 (5988): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:23:12 (10956): start_timer_thread(): CreateThread() failed, errno 0 07:23:13 (12584): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:23:18 (10932): start_timer_thread(): CreateThread() failed, errno 0 07:23:20 (4644): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:23:30 (9460): start_timer_thread(): CreateThread() failed, errno 0 07:23:31 (12260): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:23:55 (1644): start_timer_thread(): CreateThread() failed, errno 0 07:23:56 (12100): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:24:07 (9228): start_timer_thread(): CreateThread() failed, errno 0 07:24:09 (12840): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:24:22 (7284): start_timer_thread(): CreateThread() failed, errno 0 07:24:23 (12676): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:24:44 (11140): start_timer_thread(): CreateThread() failed, errno 0 07:24:46 (10384): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:24:59 (5788): start_timer_thread(): CreateThread() failed, errno 0 07:25:01 (5468): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:25:06 (6880): start_timer_thread(): CreateThread() failed, errno 0 07:25:07 (3028): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:25:33 (7540): start_timer_thread(): CreateThread() failed, errno 0 07:25:35 (1720): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:26:03 (4100): start_timer_thread(): CreateThread() failed, errno 0 07:26:04 (8752): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:26:11 (8264): start_timer_thread(): CreateThread() failed, errno 0 07:26:12 (5176): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:26:17 (380): start_timer_thread(): CreateThread() failed, errno 0 07:26:19 (11472): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:26:22 (10608): start_timer_thread(): CreateThread() failed, errno 0 07:26:24 (7640): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:27:13 (12304): start_timer_thread(): CreateThread() failed, errno 0 07:27:14 (12184): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:27:29 (7068): start_timer_thread(): CreateThread() failed, errno 0 07:27:31 (12368): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:27:47 (7932): start_timer_thread(): CreateThread() failed, errno 0 07:27:49 (10272): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:18:33 (12664): start_timer_thread(): CreateThread() failed, errno 0 08:18:35 (12076): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: E:\/projects/climateprediction.net/wah2_pnw25_c0oc_200312_48_485_010812827/dataout\c0ocga.pdk5dec Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:37:55 (5492): start_timer_thread(): CreateThread() failed, errno 0 19:37:56 (1724): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:35:58 (7292): start_timer_thread(): CreateThread() failed, errno 0 20:36:01 (8368): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 01:01:23 (8672): start_timer_thread(): CreateThread() failed, errno 0 01:01:26 (6564): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: E:\/projects/climateprediction.net/wah2_pnw25_c0oc_200312_48_485_010812827/dataout\c0ocga.pdk6feb CPDN Monitor - Quit request from BOINC... 06:18:09 (8248): start_timer_thread(): CreateThread() failed, errno 0 06:18:10 (1876): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:18:16 (11568): start_timer_thread(): CreateThread() failed, errno 0 06:18:18 (10744): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:18:37 (5768): start_timer_thread(): CreateThread() failed, errno 0 06:18:39 (4160): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:18:54 (8460): start_timer_thread(): CreateThread() failed, errno 0 06:18:56 (11220): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:19:20 (4908): start_timer_thread(): CreateThread() failed, errno 0 06:19:22 (9612): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:19:35 (2492): start_timer_thread(): CreateThread() failed, errno 0 06:19:36 (8516): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:19:47 (13024): start_timer_thread(): CreateThread() failed, errno 0 06:19:49 (2232): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:19:53 (5456): start_timer_thread(): CreateThread() failed, errno 0 06:19:55 (4464): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:20:07 (9444): start_timer_thread(): CreateThread() failed, errno 0 06:20:08 (12312): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:21:02 (12960): start_timer_thread(): CreateThread() failed, errno 0 06:21:04 (4308): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:21:23 (10828): start_timer_thread(): CreateThread() failed, errno 0 06:21:24 (8768): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:22:02 (2984): start_timer_thread(): CreateThread() failed, errno 0 06:22:04 (6600): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:22:09 (9164): start_timer_thread(): CreateThread() failed, errno 0 06:22:11 (1856): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:23:01 (872): start_timer_thread(): CreateThread() failed, errno 0 06:23:03 (13012): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:23:15 (12860): start_timer_thread(): CreateThread() failed, errno 0 06:23:16 (11828): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:23:21 (12260): start_timer_thread(): CreateThread() failed, errno 0 06:23:23 (5104): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:23:46 (10784): start_timer_thread(): CreateThread() failed, errno 0 06:23:48 (12088): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:23:55 (8232): start_timer_thread(): CreateThread() failed, errno 0 06:23:56 (6796): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:24:04 (11404): start_timer_thread(): CreateThread() failed, errno 0 06:24:06 (12796): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:24:17 (9036): start_timer_thread(): CreateThread() failed, errno 0 06:24:19 (12540): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:24:23 (10092): start_timer_thread(): CreateThread() failed, errno 0 06:24:25 (8936): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:24:29 (8332): start_timer_thread(): CreateThread() failed, errno 0 06:24:31 (580): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:24:41 (3148): start_timer_thread(): CreateThread() failed, errno 0 06:24:43 (12768): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:24:47 (5808): start_timer_thread(): CreateThread() failed, errno 0 06:24:48 (236): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:24:52 (4528): start_timer_thread(): CreateThread() failed, errno 0 06:24:53 (10352): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:25:04 (13240): start_timer_thread(): CreateThread() failed, errno 0 06:25:05 (4292): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:25:18 (12076): start_timer_thread(): CreateThread() failed, errno 0 06:25:20 (7628): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:25:35 (12304): start_timer_thread(): CreateThread() failed, errno 0 06:25:36 (12260): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:25:41 (6972): start_timer_thread(): CreateThread() failed, errno 0 06:25:42 (7836): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:25:46 (6644): start_timer_thread(): CreateThread() failed, errno 0 06:25:48 (10564): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:25:58 (5172): start_timer_thread(): CreateThread() failed, errno 0 06:25:59 (8936): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:26:04 (4540): start_timer_thread(): CreateThread() failed, errno 0 06:26:05 (12812): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:26:12 (8572): start_timer_thread(): CreateThread() failed, errno 0 06:26:14 (12952): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:26:27 (3936): start_timer_thread(): CreateThread() failed, errno 0 06:26:29 (6444): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:26:40 (1428): start_timer_thread(): CreateThread() failed, errno 0 06:26:42 (5832): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:27:00 (5596): start_timer_thread(): CreateThread() failed, errno 0 06:27:02 (2100): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:27:08 (7204): start_timer_thread(): CreateThread() failed, errno 0 06:27:10 (6756): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:27:21 (5448): start_timer_thread(): CreateThread() failed, errno 0 06:27:22 (10732): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:27:34 (4044): start_timer_thread(): CreateThread() failed, errno 0 06:27:35 (9924): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:28:29 (7540): start_timer_thread(): CreateThread() failed, errno 0 06:28:30 (11444): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:28:34 (8552): start_timer_thread(): CreateThread() failed, errno 0 06:28:36 (7932): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:28:42 (12388): start_timer_thread(): CreateThread() failed, errno 0 06:28:43 (4752): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:28:47 (12112): start_timer_thread(): CreateThread() failed, errno 0 06:28:49 (11768): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:29:04 (12468): start_timer_thread(): CreateThread() failed, errno 0 06:29:05 (5984): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:29:14 (6428): start_timer_thread(): CreateThread() failed, errno 0 06:29:16 (9760): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:29:26 (1964): start_timer_thread(): CreateThread() failed, errno 0 06:29:28 (8216): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:29:32 (6000): start_timer_thread(): CreateThread() failed, errno 0 06:29:34 (6964): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:29:41 (13020): start_timer_thread(): CreateThread() failed, errno 0 06:29:42 (4452): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:30:54 (1564): start_timer_thread(): CreateThread() failed, errno 0 06:30:55 (2296): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:30:59 (3488): start_timer_thread(): CreateThread() failed, errno 0 06:31:01 (12756): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:31:22 (10680): start_timer_thread(): CreateThread() failed, errno 0 06:31:23 (10956): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:32:04 (9588): start_timer_thread(): CreateThread() failed, errno 0 06:32:05 (2116): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:32:09 (10528): start_timer_thread(): CreateThread() failed, errno 0 06:32:10 (7064): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:32:16 (1624): start_timer_thread(): CreateThread() failed, errno 0 06:32:17 (5172): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:32:40 (12608): start_timer_thread(): CreateThread() failed, errno 0 06:32:42 (11384): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:33:29 (6284): start_timer_thread(): CreateThread() failed, errno 0 06:33:31 (12500): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:33:39 (3060): start_timer_thread(): CreateThread() failed, errno 0 06:33:40 (11836): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:34:16 (11636): start_timer_thread(): CreateThread() failed, errno 0 06:34:18 (2056): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:34:25 (4008): start_timer_thread(): CreateThread() failed, errno 0 06:34:26 (10364): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:34:34 (6584): start_timer_thread(): CreateThread() failed, errno 0 06:34:36 (4832): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:34:54 (12584): start_timer_thread(): CreateThread() failed, errno 0 06:34:56 (5828): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:35:10 (3488): start_timer_thread(): CreateThread() failed, errno 0 06:35:12 (12428): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:35:45 (9940): start_timer_thread(): CreateThread() failed, errno 0 06:35:46 (10400): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:35:51 (10080): start_timer_thread(): CreateThread() failed, errno 0 06:35:52 (4100): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:35:59 (10028): start_timer_thread(): CreateThread() failed, errno 0 06:36:00 (5412): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:36:20 (8808): start_timer_thread(): CreateThread() failed, errno 0 06:36:21 (9404): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:36:45 (12292): start_timer_thread(): CreateThread() failed, errno 0 06:36:47 (11768): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: E:\/projects/climateprediction.net/wah2_pnw25_c0oc_200312_48_485_010812827/dataout\c0ocga.pdk6mar Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: E:\/projects/climateprediction.net/wah2_pnw25_c0oc_200312_48_485_010812827/dataout\c0ocga.pdk6apr Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:23:31 (11164): start_timer_thread(): CreateThread() failed, errno 0 16:23:33 (10052): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:03:22 (7108): start_timer_thread(): CreateThread() failed, errno 0 18:03:23 (12204): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: E:\/projects/climateprediction.net/wah2_pnw25_c0oc_200312_48_485_010812827/dataout\c0ocga.pdk6may Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: E:\/projects/climateprediction.net/wah2_pnw25_c0oc_200312_48_485_010812827/dataout\c0ocga.pdk6jun Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 05:42:48 (10684): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:01:16 (10128): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:07:04 (12820): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:08:20 (12260): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:08:27 (9324): start_timer_thread(): CreateThread() failed, errno 0 06:08:28 (10208): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:08:39 (12124): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:09:00 (6664): start_timer_thread(): CreateThread() failed, errno 0 06:09:01 (4752): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:09:43 (5808): start_timer_thread(): CreateThread() failed, errno 0 06:09:44 (10128): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:10:05 (9080): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:11:32 (1968): start_timer_thread(): CreateThread() failed, errno 0 06:11:33 (10532): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:11:41 (11560): start_timer_thread(): CreateThread() failed, errno 0 06:11:43 (7584): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:11:52 (12780): start_timer_thread(): CreateThread() failed, errno 0 06:11:53 (12336): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:12:04 (6104): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:12:17 (11652): start_timer_thread(): CreateThread() failed, errno 0 06:12:19 (6080): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:12:26 (9592): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:13:18 (7476): start_timer_thread(): CreateThread() failed, errno 0 06:13:19 (7056): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:13:28 (10168): start_timer_thread(): CreateThread() failed, errno 0 06:13:29 (2116): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:13:37 (4308): start_timer_thread(): CreateThread() failed, errno 0 06:13:38 (13084): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:14:21 (7936): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:14:36 (2492): start_timer_thread(): CreateThread() failed, errno 0 06:14:38 (6984): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:14:50 (9064): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:14:56 (976): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:15:26 (12100): start_timer_thread(): CreateThread() failed, errno 0 06:15:27 (5844): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:15:33 (11812): start_timer_thread(): CreateThread() failed, errno 0 06:15:34 (11760): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:16:21 (10356): start_timer_thread(): CreateThread() failed, errno 0 06:16:22 (9956): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:16:34 (10060): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:17:28 (976): start_timer_thread(): CreateThread() failed, errno 0 06:17:30 (9040): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:17:37 (9832): start_timer_thread(): CreateThread() failed, errno 0 06:17:38 (5520): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:17:52 (11368): start_timer_thread(): CreateThread() failed, errno 0 06:17:53 (11736): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:18:01 (4736): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:18:18 (10100): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:18:23 (12464): start_timer_thread(): CreateThread() failed, errno 0 06:18:25 (5352): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:18:50 (5784): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:19:40 (7848): start_timer_thread(): CreateThread() failed, errno 0 06:19:41 (8552): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:19:52 (7364): start_timer_thread(): CreateThread() failed, errno 0 06:19:54 (8812): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:20:04 (12284): start_timer_thread(): CreateThread() failed, errno 0 06:20:05 (10484): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:20:13 (11200): start_timer_thread(): CreateThread() failed, errno 0 06:20:14 (10280): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:22:00 (6104): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:22:15 (6264): start_timer_thread(): CreateThread() failed, errno 0 06:22:17 (8652): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=6964, iMonCtr=1 CPDN Monitor - Quit request from BOINC... 06:22:40 (12092): start_timer_thread(): CreateThread() failed, errno 0 06:22:41 (7404): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:22:57 (9484): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:23:03 (11868): start_timer_thread(): CreateThread() failed, errno 0 06:23:04 (11364): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:23:20 (9028): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:23:32 (6776): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:24:20 (580): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:24:35 (3616): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:24:46 (9980): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:24:59 (10164): start_timer_thread(): CreateThread() failed, errno 0 06:25:01 (392): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:25:23 (10672): start_timer_thread(): CreateThread() failed, errno 0 06:25:24 (12240): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:26:16 (12260): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:27:03 (2484): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:27:12 (9736): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:27:30 (12044): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:27:46 (4976): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:27:55 (4480): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:28:04 (6300): start_timer_thread(): CreateThread() failed, errno 0 06:28:05 (2660): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:28:12 (10576): start_timer_thread(): CreateThread() failed, errno 0 06:28:14 (8832): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:28:25 (12664): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:28:37 (12004): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:28:44 (2876): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:28:56 (8684): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:33:54 (12056): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:36:12 (1624): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:36:31 (9868): start_timer_thread(): CreateThread() failed, errno 0 06:36:33 (10784): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:38:09 (4632): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:38:37 (12564): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:38:55 (8572): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:39:23 (12144): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:39:41 (6796): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:39:51 (1048): start_timer_thread(): CreateThread() failed, errno 0 06:39:53 (9276): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:40:06 (2492): start_timer_thread(): CreateThread() failed, errno 0 06:40:07 (12124): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:40:33 (4292): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:40:40 (6980): start_timer_thread(): CreateThread() failed, errno 0 06:40:41 (10192): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:41:10 (6136): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:41:31 (12852): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:41:39 (12100): start_timer_thread(): CreateThread() failed, errno 0 06:41:40 (12920): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:41:47 (8384): start_timer_thread(): CreateThread() failed, errno 0 06:41:49 (6820): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:42:15 (8248): start_timer_thread(): CreateThread() failed, errno 0 06:42:18 (11344): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:42:26 (12768): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:42:40 (10488): start_timer_thread(): CreateThread() failed, errno 0 06:42:42 (5028): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:42:52 (12148): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=12148, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 06:43:07 (10156): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:43:12 (12764): start_timer_thread(): CreateThread() failed, errno 0 06:43:13 (2876): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:43:23 (10820): start_timer_thread(): CreateThread() failed, errno 0 06:43:25 (11796): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:43:41 (248): start_timer_thread(): CreateThread() failed, errno 0 06:43:43 (10596): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:44:15 (5944): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:45:07 (12700): start_timer_thread(): CreateThread() failed, errno 0 06:45:09 (2336): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:45:25 (11144): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:45:48 (11556): start_timer_thread(): CreateThread() failed, errno 0 06:45:49 (5944): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:46:10 (11620): start_timer_thread(): CreateThread() failed, errno 0 06:46:13 (12660): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=11620, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:46:29 (10292): start_timer_thread(): CreateThread() failed, errno 0 06:46:31 (7180): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:46:47 (11524): start_timer_thread(): CreateThread() failed, errno 0 06:46:48 (13156): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:47:05 (6912): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:47:16 (2572): start_timer_thread(): CreateThread() failed, errno 0 06:47:19 (4780): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:47:25 (9788): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:47:43 (9564): start_timer_thread(): CreateThread() failed, errno 0 06:47:44 (5436): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:47:52 (9948): start_timer_thread(): CreateThread() failed, errno 0 06:47:58 (4788): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:48:28 (9020): start_timer_thread(): CreateThread() failed, errno 0 06:48:29 (13016): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:48:36 (528): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=528, iMonCtr=1 CPDN Monitor - Quit request from BOINC... 06:48:49 (10632): start_timer_thread(): CreateThread() failed, errno 0 06:48:50 (4964): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:49:25 (10968): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:49:37 (9980): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: E:\/projects/climateprediction.net/wah2_pnw25_c0oc_200312_48_485_010812827/dataout\c0ocga.pdk6jul CPDN Monitor - Quit request from BOINC... 10:02:38 (772): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:02:55 (13292): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:03:09 (3384): start_timer_thread(): CreateThread() failed, errno 0 10:03:10 (9488): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:03:21 (3344): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:03:33 (11372): start_timer_thread(): CreateThread() failed, errno 0 10:03:35 (1840): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:03:46 (10728): start_timer_thread(): CreateThread() failed, errno 0 10:03:48 (4956): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:03:55 (528): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:04:23 (6984): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:04:31 (2860): start_timer_thread(): CreateThread() failed, errno 0 10:04:33 (8200): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:04:44 (1956): start_timer_thread(): CreateThread() failed, errno 0 10:04:45 (13160): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:04:56 (5304): start_timer_thread(): CreateThread() failed, errno 0 10:04:57 (12180): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:05:04 (1304): start_timer_thread(): CreateThread() failed, errno 0 10:05:09 (7760): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:05:39 (13072): start_timer_thread(): CreateThread() failed, errno 0 10:05:41 (5572): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:05:54 (13088): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5528, selfPID=11748, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_ain::Monitor... 10:07:26 (11748): called boinc_finish(0) CPDN Monitor - Quit request from BOINC... CPDN Monitor - Abort request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0040A58A write attempt to address 0x00000130 Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 7.7.0 Dump Timestamp : 12/29/16 10:08:10 Install Directory : C:\Program Files (x86)\BOINC\ Data Directory : E:\ Project Symstore : LoadLibraryA( C:\Program Files (x86)\BOINC\\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\Program Files (x86)\BOINC\\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\Program Files (x86)\BOINC\\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\Program Files (x86)\BOINC\\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: E:\projects\climateprediction.net;E:\projects\climateprediction.net ModLoad: 0000000000400000 0000000000152000 E:\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 0000000077730000 0000000000183000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.14393.479) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 10.0.14393.206 (rs1_release.160915-0644) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 10.0.14393.206 ModLoad: 0000000074360000 00000000000e0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 10.0.14393.206 (rs1_release.160915-0644) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 10.0.14393.206 ModLoad: 00000000774d0000 00000000001a1000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.14393.479) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 10.0.14393.206 (rs1_release.160915-0644) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 10.0.14393.206 ModLoad: 00000000750f0000 000000000015f000 C:\WINDOWS\System32\USER32.dll (6.2.14393.576) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 10.0.14393.0 ModLoad: 0000000077130000 0000000000015000 C:\WINDOWS\System32\win32u.dll (6.2.14393.51) (-exported- Symbols Loaded) Linked PDB Filename : wwin32u.pdb File Version : 10.0.14393.51 (rs1_release_inmarket.160801-1836) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.51 ModLoad: 0000000077100000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.14393.206) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 10.0.14393.206 (rs1_release.160915-0644) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.206 ModLoad: 00000000768b0000 000000000015b000 C:\WINDOWS\System32\gdi32full.dll (6.2.14393.576) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32full.pdb File Version : 10.0.14393.576 (rs1_release_inmarket.161208-2252) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.576 ModLoad: 0000000075350000 0000000000077000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 10.0.14393.0 ModLoad: 0000000076b30000 00000000000be000 C:\WINDOWS\System32\msvcrt.dll (7.0.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.14393.0 ModLoad: 0000000077380000 0000000000041000 C:\WINDOWS\System32\sechost.dll (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.0 ModLoad: 0000000076a10000 00000000000c1000 C:\WINDOWS\System32\RPCRT4.dll (6.2.14393.82) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 10.0.14393.0 ModLoad: 00000000741d0000 000000000001e000 C:\WINDOWS\System32\SspiCli.dll (6.2.14393.576) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 10.0.14393.576 (rs1_release_inmarket.161208-2252) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.576 ModLoad: 00000000741c0000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.0 ModLoad: 0000000077060000 000000000005a000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.0 ModLoad: 0000000077000000 0000000000025000 C:\WINDOWS\System32\IMM32.DLL (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.0 ModLoad: 000000006e7a0000 0000000000145000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.14321.1024) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 10.0.14321.1024 (rs1_release.160715-1616) Company Name : Microsoft Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14321.1024 ModLoad: 0000000075010000 00000000000e0000 C:\WINDOWS\System32\ucrtbase.dll (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : ucrtbase.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.0 ModLoad: 00000000741b0000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.0 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 4269, Write: 0, Other 52395 - I/O Transfers Counters - Read: 0, Write: 109, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 86024, QuotaPeakPagedPoolUsage: 86160 QuotaNonPagedPoolUsage: 7936, QuotaPeakNonPagedPoolUsage: 7936 - Virtual Memory Usage - VirtualSize: 52416512, PeakVirtualSize: 52416512 - Pagefile Usage - PagefileUsage: 2609152, PeakPagefileUsage: 2609152 - Working Set Size - WorkingSetSize: 5701632, PeakWorkingSetSize: 5701632, PageFaultCount: 1517 * Dump of thread ID 596 (state: Ready): * - Information - Status: Base Priority: Above Normal, Priority: Highest, , Kernel Time: 6093750.000000, User Time: 16093750.000000, Wait Time: 47424352.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0040A58A write attempt to address 0x00000130 - Registers - eax=00000000 ebx=00000000 ecx=0000000b edx=0040a560 esi=0000000b edi=00000000 eip=0040a58a esp=0019dca4 ebp=0019dcc8 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010297 - Callstack - ChildEBP RetAddr Args to Child 0019dcc8 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 0019dce0 00485ca1 c0000005 0019dd14 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 0019ff80 743762c4 0027e000 743762a0 c9f6f850 0019ffdc wah2_8.24_windows_intelx86!+0x0 0019ff94 77790fd9 0027e000 ca33a7e9 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0019ffdc 77790fa4 ffffffff 777b2ee3 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 0019ffec 00000000 00485cce 0027e000 00000000 78746341 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 * Dump of thread ID 6736 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 47422952.000000 - Registers - eax=00000000 ebx=00812d88 ecx=00000000 edx=00000000 esi=00813288 edi=00813448 eip=777a01cc esp=0080fddc ebp=0080ff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 0080ff80 743762c4 00812d88 743762a0 c96ff850 0080ffdc ntdll!NtWaitForWorkViaWorkerFactory+0x0 0080ff94 77790fd9 00812d88 caaaa7e9 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0080ffdc 77790fa4 ffffffff 777b2ee3 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 0080ffec 00000000 777667c0 00812d88 00000000 dc7ce9b7 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 * Dump of thread ID 9044 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 47422952.000000 - Registers - eax=00000000 ebx=00812d88 ecx=00000000 edx=00000000 esi=00817fd0 edi=00818190 eip=777a01cc esp=00a0fddc ebp=00a0ff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 00a0ff80 743762c4 00812d88 743762a0 c94ff850 00a0ffdc ntdll!NtWaitForWorkViaWorkerFactory+0x0 00a0ff94 77790fd9 00812d88 ca8aa7e9 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 00a0ffdc 77790fa4 ffffffff 777b2ee3 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 00a0ffec 00000000 777667c0 00812d88 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 * Dump of thread ID 7760 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 47422952.000000 - Registers - eax=00000000 ebx=00812d88 ecx=00000000 edx=00000000 esi=00818210 edi=008183d0 eip=777a01cc esp=00b0fddc ebp=00b0ff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 00b0ff80 743762c4 00812d88 743762a0 c95ff850 00b0ffdc ntdll!NtWaitForWorkViaWorkerFactory+0x0 00b0ff94 77790fd9 00812d88 ca9aa7e9 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 00b0ffdc 77790fa4 ffffffff 777b2ee3 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 00b0ffec 00000000 777667c0 00812d88 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 * Dump of thread ID 6496 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 47424348.000000 - Registers - eax=00000000 ebx=0258fd1c ecx=00000000 edx=00000000 esi=00000000 edi=0258fd1c eip=7779e91c esp=0258fcdc ebp=0258fd40 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 0258fd40 775a2bcf 00000064 00000000 0258ff80 00478b44 ntdll!NtDelayExecution+0x0 0258fd50 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 0258ff80 743762c4 00000000 743762a0 cbb7f850 0258ffdc wah2_8.24_windows_intelx86!+0x0 0258ff94 77790fd9 00000000 c872a7e9 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0258ffdc 77790fa4 ffffffff 777b2ee3 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 0258ffec 00000000 00478b20 00000000 00000000 501d0da8 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Dec 2016 06:59:18	1397908	20114216	wah2_pnw25_c0oc_200312_48_485_010812827_1	368,939	542,165	1.4695
29 Dec 2016 00:24:27	1397908	20114216	wah2_pnw25_c0oc_200312_48_485_010812827_1	357,419	525,858	1.4713
28 Dec 2016 19:46:12	1397908	20114216	wah2_pnw25_c0oc_200312_48_485_010812827_1	345,899	509,618	1.4733
28 Dec 2016 13:38:42	1397908	20114216	wah2_pnw25_c0oc_200312_48_485_010812827_1	334,379	493,000	1.4744
28 Dec 2016 08:51:51	1397908	20114216	wah2_pnw25_c0oc_200312_48_485_010812827_1	322,859	476,372	1.4755
28 Dec 2016 03:54:36	1397908	20114216	wah2_pnw25_c0oc_200312_48_485_010812827_1	311,339	460,208	1.4782
27 Dec 2016 22:41:23	1397908	20114216	wah2_pnw25_c0oc_200312_48_485_010812827_1	299,819	443,002	1.4776
27 Dec 2016 16:17:51	1397908	20114216	wah2_pnw25_c0oc_200312_48_485_010812827_1	288,299	425,443	1.4757
27 Dec 2016 11:08:31	1397908	20114216	wah2_pnw25_c0oc_200312_48_485_010812827_1	276,779	407,858	1.4736
27 Dec 2016 04:23:21	1397908	20114216	wah2_pnw25_c0oc_200312_48_485_010812827_1	265,259	390,591	1.4725
26 Dec 2016 23:54:17	1397908	20114216	wah2_pnw25_c0oc_200312_48_485_010812827_1	253,739	374,480	1.4758
26 Dec 2016 18:34:27	1397908	20114216	wah2_pnw25_c0oc_200312_48_485_010812827_1	242,219	358,248	1.4790
26 Dec 2016 13:51:03	1397908	20114216	wah2_pnw25_c0oc_200312_48_485_010812827_1	230,699	341,441	1.4800
26 Dec 2016 08:38:05	1397908	20114216	wah2_pnw25_c0oc_200312_48_485_010812827_1	219,179	324,416	1.4801
26 Dec 2016 03:26:01	1397908	20114216	wah2_pnw25_c0oc_200312_48_485_010812827_1	207,659	307,579	1.4812
25 Dec 2016 22:02:37	1397908	20114216	wah2_pnw25_c0oc_200312_48_485_010812827_1	196,139	290,909	1.4832
25 Dec 2016 17:05:09	1397908	20114216	wah2_pnw25_c0oc_200312_48_485_010812827_1	184,619	273,516	1.4815
25 Dec 2016 12:02:57	1397908	20114216	wah2_pnw25_c0oc_200312_48_485_010812827_1	173,099	255,764	1.4776
25 Dec 2016 07:00:06	1397908	20114216	wah2_pnw25_c0oc_200312_48_485_010812827_1	161,579	238,443	1.4757
25 Dec 2016 02:04:49	1397908	20114216	wah2_pnw25_c0oc_200312_48_485_010812827_1	150,059	221,360	1.4752