Task 18649987

Name	hadam3p_pnw_pt1z_2013_1_009984995_0
Workunit	9991353
Created	29 Jun 2015, 19:04:49 UTC
Sent	3 Jul 2015, 8:30:28 UTC
Report deadline	14 Jun 2016, 13:50:28 UTC
Received	11 Jul 2015, 21:44:15 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1360251
Run time	5 days 11 hours 47 min 48 sec
CPU time	5 days 9 hours 9 min 25 sec
Validate state	Invalid
Credit	4,261.87
Device peak FLOPS	3.13 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v7.27 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:33:40 (7812): start_timer_thread(): CreateThread() failed, errno 0 13:33:41 (8544): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:36:45 (5544): start_timer_thread(): CreateThread() failed, errno 0 13:36:46 (4380): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:06:54 (7980): start_timer_thread(): CreateThread() failed, errno 0 14:06:56 (9076): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:08:45 (8484): start_timer_thread(): CreateThread() failed, errno 0 14:08:47 (8532): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:21:21 (6524): start_timer_thread(): CreateThread() failed, errno 0 14:21:23 (2468): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:23:02 (8252): start_timer_thread(): CreateThread() failed, errno 0 14:23:03 (1208): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:26:08 (5704): start_timer_thread(): CreateThread() failed, errno 0 14:26:09 (1060): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:31:31 (7400): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:35:07 (8128): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:39:09 (4780): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:51:14 (9132): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:53:24 (7840): start_timer_thread(): CreateThread() failed, errno 0 14:53:25 (3564): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:54:56 (304): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:57:55 (6500): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:05:17 (7748): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:12:26 (6000): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:13:48 (8124): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:56:14 (8068): start_timer_thread(): CreateThread() failed, errno 0 15:56:15 (2032): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:01:26 (6232): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:06:32 (1320): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:11:58 (7800): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:31:52 (6936): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:34:25 (4288): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:49:51 (7688): start_timer_thread(): CreateThread() failed, errno 0 17:49:52 (4640): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:09:22 (1656): start_timer_thread(): CreateThread() failed, errno 0 18:09:24 (4984): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:11:17 (8060): start_timer_thread(): CreateThread() failed, errno 0 18:11:18 (2992): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:38:39 (6312): start_timer_thread(): CreateThread() failed, errno 0 18:38:41 (1792): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:41:14 (8296): start_timer_thread(): CreateThread() failed, errno 0 18:41:16 (6200): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:44:49 (9060): start_timer_thread(): CreateThread() failed, errno 0 18:44:50 (4564): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:47:28 (7008): start_timer_thread(): CreateThread() failed, errno 0 18:47:29 (8872): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:50:27 (6936): start_timer_thread(): CreateThread() failed, errno 0 18:50:28 (6208): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:51:53 (304): start_timer_thread(): CreateThread() failed, errno 0 18:51:54 (7908): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:19:01 (7480): start_timer_thread(): CreateThread() failed, errno 0 19:19:02 (5852): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:55:39 (4136): start_timer_thread(): CreateThread() failed, errno 0 22:55:41 (9108): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:39:12 (5988): start_timer_thread(): CreateThread() failed, errno 0 23:39:13 (6148): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 02:13:28 (2036): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 02:15:15 (9836): start_timer_thread(): CreateThread() failed, errno 0 02:15:16 (9648): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 02:16:38 (9748): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 02:52:18 (7124): start_timer_thread(): CreateThread() failed, errno 0 02:52:20 (4104): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 03:02:51 (8864): start_timer_thread(): CreateThread() failed, errno 0 03:02:52 (10084): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 04:47:26 (9376): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 04:51:28 (10900): start_timer_thread(): CreateThread() failed, errno 0 04:51:29 (10624): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 08:31:43 (7460): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 08:46:06 (9348): start_timer_thread(): CreateThread() failed, errno 0 08:46:08 (8696): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 08:50:09 (10296): start_timer_thread(): CreateThread() failed, errno 0 08:50:10 (9208): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 09:27:23 (2508): start_timer_thread(): CreateThread() failed, errno 0 09:27:24 (9148): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:50:49 (11312): start_timer_thread(): CreateThread() failed, errno 0 17:50:51 (2804): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:57:57 (9964): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:16:16 (12172): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:17:59 (5444): start_timer_thread(): CreateThread() failed, errno 0 18:18:01 (11912): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:47:42 (12928): start_timer_thread(): CreateThread() failed, errno 0 18:47:43 (10760): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:03:44 (6092): start_timer_thread(): CreateThread() failed, errno 0 19:03:45 (8672): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:10:22 (11580): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:11:50 (12168): start_timer_thread(): CreateThread() failed, errno 0 19:11:52 (11332): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:14:24 (13104): start_timer_thread(): CreateThread() failed, errno 0 19:14:26 (10968): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:32:00 (6488): start_timer_thread(): CreateThread() failed, errno 0 19:32:01 (13268): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:34:35 (13292): start_timer_thread(): CreateThread() failed, errno 0 19:34:37 (13156): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:46:52 (3852): start_timer_thread(): CreateThread() failed, errno 0 19:46:53 (13016): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:05:14 (11588): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:53:11 (11432): start_timer_thread(): CreateThread() failed, errno 0 20:53:13 (6092): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:57:39 (11184): start_timer_thread(): CreateThread() failed, errno 0 20:57:41 (9632): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:58:42 (12220): start_timer_thread(): CreateThread() failed, errno 0 20:58:43 (8424): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:12:42 (11544): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:14:24 (9516): start_timer_thread(): CreateThread() failed, errno 0 21:14:26 (10260): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:17:58 (11004): start_timer_thread(): CreateThread() failed, errno 0 21:17:59 (10968): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 05:56:25 (10656): start_timer_thread(): CreateThread() failed, errno 0 05:56:27 (11660): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 05:58:54 (12660): start_timer_thread(): CreateThread() failed, errno 0 05:58:55 (2676): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 08:21:43 (10440): start_timer_thread(): CreateThread() failed, errno 0 08:21:45 (11864): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 08:29:09 (13300): start_timer_thread(): CreateThread() failed, errno 0 08:29:10 (4668): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 08:42:59 (10748): start_timer_thread(): CreateThread() failed, errno 0 08:43:01 (12892): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 08:45:57 (2360): start_timer_thread(): CreateThread() failed, errno 0 08:45:58 (11768): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:17:30 (12892): start_timer_thread(): CreateThread() failed, errno 0 16:17:31 (13784): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:25:00 (13428): start_timer_thread(): CreateThread() failed, errno 0 16:25:01 (12152): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:28:20 (10676): start_timer_thread(): CreateThread() failed, errno 0 16:28:22 (14468): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:46:51 (11888): start_timer_thread(): CreateThread() failed, errno 0 16:46:53 (14056): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:21:04 (12556): start_timer_thread(): CreateThread() failed, errno 0 17:21:05 (14460): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:24:39 (10620): start_timer_thread(): CreateThread() failed, errno 0 17:24:41 (13932): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:30:46 (13484): start_timer_thread(): CreateThread() failed, errno 0 17:30:47 (9972): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:58:43 (244): start_timer_thread(): CreateThread() failed, errno 0 17:58:45 (15116): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:05:35 (13884): start_timer_thread(): CreateThread() failed, errno 0 18:05:36 (11624): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:14:23 (13544): start_timer_thread(): CreateThread() failed, errno 0 18:14:24 (12696): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:18:20 (13308): start_timer_thread(): CreateThread() failed, errno 0 18:18:22 (12996): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:45:01 (12284): start_timer_thread(): CreateThread() failed, errno 0 18:45:02 (10844): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:52:28 (13916): start_timer_thread(): CreateThread() failed, errno 0 18:52:30 (11408): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:00:49 (12588): start_timer_thread(): CreateThread() failed, errno 0 19:00:50 (14760): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:08:50 (9680): start_timer_thread(): CreateThread() failed, errno 0 19:08:52 (5944): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:10:38 (14820): start_timer_thread(): CreateThread() failed, errno 0 19:10:40 (9320): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:11:51 (12600): start_timer_thread(): CreateThread() failed, errno 0 19:11:52 (9584): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:14:03 (14696): start_timer_thread(): CreateThread() failed, errno 0 19:14:05 (3748): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:19:08 (10692): start_timer_thread(): CreateThread() failed, errno 0 19:19:09 (11984): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:27:38 (12580): start_timer_thread(): CreateThread() failed, errno 0 19:27:39 (12920): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:30:07 (11920): start_timer_thread(): CreateThread() failed, errno 0 19:30:08 (9340): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:42:34 (14884): start_timer_thread(): CreateThread() failed, errno 0 19:42:36 (7172): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:02:12 (4484): start_timer_thread(): CreateThread() failed, errno 0 20:02:14 (14836): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:17:08 (12400): start_timer_thread(): CreateThread() failed, errno 0 20:17:09 (14852): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:18:41 (13292): start_timer_thread(): CreateThread() failed, errno 0 20:18:42 (15168): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:31:38 (9520): start_timer_thread(): CreateThread() failed, errno 0 20:31:40 (14788): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:37:29 (11448): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:40:54 (14976): start_timer_thread(): CreateThread() failed, errno 0 20:40:55 (14460): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:44:07 (11292): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:01:55 (16324): start_timer_thread(): CreateThread() failed, errno 0 21:01:57 (15972): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:18:59 (13516): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:23:33 (18120): start_timer_thread(): CreateThread() failed, errno 0 21:23:35 (17564): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:44:01 (12976): start_timer_thread(): CreateThread() failed, errno 0 21:44:03 (13240): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:53:53 (996): start_timer_thread(): CreateThread() failed, errno 0 21:53:55 (18288): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 08:24:57 (18020): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 08:47:53 (18256): start_timer_thread(): CreateThread() failed, errno 0 08:47:54 (9464): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 08:50:45 (17596): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 09:27:17 (16740): start_timer_thread(): CreateThread() failed, errno 0 09:27:18 (15200): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:16:13 (17636): start_timer_thread(): CreateThread() failed, errno 0 21:16:14 (10496): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:18:05 (16320): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:55:16 (13876): start_timer_thread(): CreateThread() failed, errno 0 23:55:18 (16368): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 00:40:35 (18276): start_timer_thread(): CreateThread() failed, errno 0 00:40:37 (9680): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:14:01 (10760): start_timer_thread(): CreateThread() failed, errno 0 12:14:02 (14584): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:54:44 (15560): start_timer_thread(): CreateThread() failed, errno 0 16:54:45 (18548): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:45:11 (20460): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:55:08 (13792): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:15:44 (11812): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:19:42 (17892): start_timer_thread(): CreateThread() failed, errno 0 18:19:46 (20212): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:31:39 (14240): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:37:39 (16572): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:45:03 (20300): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:46:56 (19796): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:54:38 (19180): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:57:01 (20292): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:59:45 (17028): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:03:52 (12848): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:12:55 (18552): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:16:02 (14656): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:19:05 (19948): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:38:31 (12896): start_timer_thread(): CreateThread() failed, errno 0 20:38:32 (18664): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:49:47 (14612): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:53:25 (4592): start_timer_thread(): CreateThread() failed, errno 0 15:53:26 (7904): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:01:52 (1312): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:18:18 (952): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:35:57 (6084): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:39:26 (2228): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:43:13 (8996): start_timer_thread(): CreateThread() failed, errno 0 16:43:14 (8556): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:06:50 (9424): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:43:13 (9764): start_timer_thread(): CreateThread() failed, errno 0 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x74E5F788 Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 7.5.1 Dump Timestamp : 07/11/15 21:43:14 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_pnw_pt1z_2013_1_009984995;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 0000000000910000 00000000008c0000 C:\ProgramData\BOINC\projects\climateprediction.net\hadrm3p_pnw_um_7.27_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : F:\cpdn\cpdn\cpdnboinc\monitor\win_build\Release\hadrm3p.pdb ModLoad: 00000000772e0000 0000000000179000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.10162.0) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 10.0.10162.0 (fbl_impressive.150629-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10162.0 ModLoad: 0000000074cd0000 00000000000f0000 C:\WINDOWS\SYSTEM32\KERNEL32.DLL (6.2.10162.0) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 10.0.10162.0 (fbl_impressive.150629-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10162.0 ModLoad: 0000000074dc0000 0000000000176000 C:\WINDOWS\SYSTEM32\KERNELBASE.dll (6.2.10162.0) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 10.0.10162.0 (fbl_impressive.150629-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10162.0 ModLoad: 00000000744a0000 0000000000140000 C:\WINDOWS\SYSTEM32\USER32.dll (6.2.10162.0) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 10.0.10162.0 (fbl_impressive.150629-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10162.0 ModLoad: 0000000074fe0000 000000000014d000 C:\WINDOWS\SYSTEM32\GDI32.dll (6.2.10162.0) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 10.0.10162.0 (fbl_impressive.150629-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10162.0 ModLoad: 0000000076800000 000000000007b000 C:\WINDOWS\SYSTEM32\ADVAPI32.dll (6.2.10162.0) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 10.0.10162.0 (fbl_impressive.150629-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10162.0 ModLoad: 0000000077150000 00000000000be000 C:\WINDOWS\SYSTEM32\msvcrt.dll (7.0.10162.0) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.10162.0 (fbl_impressive.150629-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.10162.0 ModLoad: 0000000074c80000 0000000000043000 C:\WINDOWS\SYSTEM32\sechost.dll (6.2.10162.0) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 10.0.10162.0 (fbl_impressive.150629-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10162.0 ModLoad: 00000000745f0000 00000000000ac000 C:\WINDOWS\SYSTEM32\RPCRT4.dll (6.2.10162.0) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 10.0.10162.0 (fbl_impressive.150629-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10162.0 ModLoad: 00000000743f0000 000000000001e000 C:\WINDOWS\SYSTEM32\SspiCli.dll (6.2.10162.0) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 10.0.10162.0 (fbl_impressive.150629-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10162.0 ModLoad: 00000000743e0000 000000000000a000 C:\WINDOWS\SYSTEM32\CRYPTBASE.dll (6.2.10162.0) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 10.0.10162.0 (fbl_impressive.150629-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10162.0 ModLoad: 0000000074380000 000000000005a000 C:\WINDOWS\SYSTEM32\bcryptPrimitives.dll (6.2.10162.0) (-exported- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 10.0.10162.0 (fbl_impressive.150629-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10162.0 ModLoad: 0000000076880000 0000000000019000 C:\WINDOWS\SYSTEM32\imagehlp.dll (6.2.10162.0) (-exported- Symbols Loaded) Linked PDB Filename : imagehlp.pdb File Version : 10.0.10162.0 (fbl_impressive.150629-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10162.0 ModLoad: 0000000074f40000 000000000002b000 C:\WINDOWS\SYSTEM32\IMM32.DLL (6.2.10162.0) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 10.0.10162.0 (fbl_impressive.150629-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10162.0 ModLoad: 00000000768a0000 0000000000120000 C:\WINDOWS\SYSTEM32\MSCTF.dll (6.2.10162.0) (-exported- Symbols Loaded) Linked PDB Filename : msctf.pdb File Version : 10.0.10162.0 (fbl_impressive.150629-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10162.0 ModLoad: 0000000071610000 000000000013f000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.10162.0) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 10.0.10162.0 (fbl_impressive.150629-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10162.0 ModLoad: 0000000074230000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.10162.0) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 10.0.10162.0 (fbl_impressive.150629-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10162.0 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 7, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 69, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 150416, QuotaPeakPagedPoolUsage: 150496 QuotaNonPagedPoolUsage: 8560, QuotaPeakNonPagedPoolUsage: 8560 - Virtual Memory Usage - VirtualSize: 1556054016, PeakVirtualSize: 1556054016 - Pagefile Usage - PagefileUsage: 7483392, PeakPagefileUsage: 23212032 - Working Set Size - WorkingSetSize: 5476352, PeakWorkingSetSize: 5476352, PageFaultCount: 1422 * Dump of thread ID 4636 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 5588193.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x74E5F788 - Registers - eax=1297f828 ebx=7f50f000 ecx=00000003 edx=00000000 esi=00c790b0 edi=00d6f148 eip=74e5f788 esp=1297f828 ebp=1297f880 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000216 - Callstack - ChildEBP RetAddr Args to Child 1297f880 00c20a97 e06d7363 00000001 00000003 1297f8ac KERNELBASE!RaiseException+0x0 1297f8b8 00c1dc42 1297f8c8 00c95bf4 00c790b0 00c8dd2c hadrm3p_pnw_um_7.27_windows_int!+0x0 1297f8d8 00918262 01000000 00917b49 37380000 37383b26 hadrm3p_pnw_um_7.27_windows_int!+0x0 1297fd04 00c1fa6d 00910000 00000000 12b631bf 0000000a hadrm3p_pnw_um_7.27_windows_int!+0x0 1297fd94 74ce3774 7f50f000 74ce3750 21bd3658 1297fdf0 hadrm3p_pnw_um_7.27_windows_int!+0x0 1297fda8 773390d1 7f50f000 225ba040 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 1297fdf0 7733909c ffffffff 7735d75f 00000000 00000000 ntdll!RtlWalkFrameChain+0x0 1297fe00 00000000 00c1fac0 7f50f000 00000000 00000000 ntdll!RtlWalkFrameChain+0x0 * Dump of thread ID 14140 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 5588193.000000 - Registers - eax=00000000 ebx=12b686a8 ecx=00000000 edx=00000000 esi=12b684e8 edi=12b63a20 eip=7734a6fc esp=2437fc04 ebp=2437fdb8 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 2437fdb8 74ce3774 12b63a20 74ce3750 171d363c 2437fe14 ntdll!NtWaitForWorkViaWorkerFactory+0x0 2437fdcc 773390d1 12b63a20 14fba3a4 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 2437fe14 7733909c ffffffff 7735d75f 00000000 00000000 ntdll!RtlWalkFrameChain+0x0 2437fe24 00000000 77329c20 12b63a20 00000000 00000000 ntdll!RtlWalkFrameChain+0x0 * Dump of thread ID 15180 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 5588193.000000 - Registers - eax=77329c20 ebx=00000000 ecx=00000000 edx=00000000 esi=12b6a120 edi=12b63a20 eip=7734a6fc esp=35c2f6a0 ebp=35c2f854 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000216 - Callstack - ChildEBP RetAddr Args to Child 35c2f854 74ce3774 12b63a20 74ce3750 06e83398 35c2f8b0 ntdll!NtWaitForWorkViaWorkerFactory+0x0 35c2f868 773390d1 12b63a20 050ea500 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 35c2f8b0 7733909c ffffffff 7735d75f 00000000 00000000 ntdll!RtlWalkFrameChain+0x0 35c2f8c0 00000000 77329c20 12b63a20 00000000 00000000 ntdll!RtlWalkFrameChain+0x0 * Dump of thread ID 9916 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 5588193.000000 - Registers - eax=00ba27a0 ebx=65aaf858 ecx=00000000 edx=00000000 esi=00000000 edi=00000001 eip=77348edc esp=65aaf818 ebp=65aaf87c cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206 - Callstack - ChildEBP RetAddr Args to Child 65aaf87c 74e5c34f 00000064 00000000 65aafabc 00ba27c4 ntdll!ZwDelayExecution+0x0 65aaf88c 00ba27c4 00000064 00ba27a0 00ba27a0 00000000 KERNELBASE!Sleep+0x0 65aafabc 74ce3774 00000000 74ce3750 56803120 65aafb18 hadrm3p_pnw_um_7.27_windows_int!+0x0 65aafad0 773390d1 00000000 5566a6a8 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 65aafb18 7733909c ffffffff 7735d75f 00000000 00000000 ntdll!RtlWalkFrameChain+0x0 65aafb28 00000000 00ba27a0 00000000 00000000 00000000 ntdll!RtlWalkFrameChain+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Signal 11 received, exiting... 21:43:15 (9764): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15380, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 21:43:29 (15380): called boinc_finish(0) </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_pt1z_2013_1_009984995_0_18.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Jul 2015 19:02:08	1360251	18649987	hadam3p_pnw_pt1z_2013_1_009984995_0	196,139	440,760	2.2472
09 Jul 2015 09:54:39	1360251	18649987	hadam3p_pnw_pt1z_2013_1_009984995_0	184,619	415,124	2.2485
09 Jul 2015 02:46:00	1360251	18649987	hadam3p_pnw_pt1z_2013_1_009984995_0	173,099	389,365	2.2494
08 Jul 2015 19:05:48	1360251	18649987	hadam3p_pnw_pt1z_2013_1_009984995_0	161,579	363,781	2.2514
08 Jul 2015 12:03:53	1360251	18649987	hadam3p_pnw_pt1z_2013_1_009984995_0	150,059	338,280	2.2543
08 Jul 2015 03:40:28	1360251	18649987	hadam3p_pnw_pt1z_2013_1_009984995_0	138,539	312,251	2.2539
07 Jul 2015 14:47:36	1360251	18649987	hadam3p_pnw_pt1z_2013_1_009984995_0	127,019	284,899	2.2430
07 Jul 2015 06:45:05	1360251	18649987	hadam3p_pnw_pt1z_2013_1_009984995_0	115,499	259,134	2.2436
06 Jul 2015 23:02:03	1360251	18649987	hadam3p_pnw_pt1z_2013_1_009984995_0	103,979	233,236	2.2431
06 Jul 2015 13:49:55	1360251	18649987	hadam3p_pnw_pt1z_2013_1_009984995_0	92,459	207,903	2.2486
06 Jul 2015 06:12:26	1360251	18649987	hadam3p_pnw_pt1z_2013_1_009984995_0	80,939	182,806	2.2586
05 Jul 2015 18:18:58	1360251	18649987	hadam3p_pnw_pt1z_2013_1_009984995_0	69,419	156,230	2.2505
05 Jul 2015 04:50:03	1360251	18649987	hadam3p_pnw_pt1z_2013_1_009984995_0	57,899	130,536	2.2545
04 Jul 2015 18:15:38	1360251	18649987	hadam3p_pnw_pt1z_2013_1_009984995_0	46,379	104,028	2.2430
04 Jul 2015 08:33:22	1360251	18649987	hadam3p_pnw_pt1z_2013_1_009984995_0	34,859	76,531	2.1954
03 Jul 2015 23:43:23	1360251	18649987	hadam3p_pnw_pt1z_2013_1_009984995_0	23,339	51,291	2.1977
03 Jul 2015 16:12:09	1360251	18649987	hadam3p_pnw_pt1z_2013_1_009984995_0	11,819	25,952	2.1958