Task 14382300

Name	hadam3p_saf_0tbl_1992_1_006861577_2
Workunit	7064893
Created	9 Apr 2012, 1:39:17 UTC
Sent	9 Apr 2012, 1:39:24 UTC
Report deadline	22 Mar 2013, 6:59:24 UTC
Received	15 Apr 2012, 9:25:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1180018
Run time	2 days 8 hours 45 min 49 sec
CPU time	2 days 8 hours 38 min 15 sec
Validate state	Invalid
Credit	1,870.33
Device peak FLOPS	3.51 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=28232, selfPID=28232, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=27220, selfPID=27220, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=28656, selfPID=28656, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18576, selfPID=18576, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 15:44:01 (26140): start_timer_thread(): CreateThread() failed, errno 0 15:44:01 (28796): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:47:38 (30540): start_timer_thread(): CreateThread() failed, errno 0 15:47:38 (26112): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:00:08 (17040): start_timer_thread(): CreateThread() failed, errno 0 16:00:08 (28052): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:04:18 (24848): start_timer_thread(): CreateThread() failed, errno 0 16:04:18 (27444): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:57:25 (28656): start_timer_thread(): CreateThread() failed, errno 0 16:57:25 (29840): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9544, selfPID=9544, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3420, selfPID=3420, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9844, selfPID=9844, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:20:06 (6680): start_timer_thread(): CreateThread() failed, errno 0 10:20:06 (7560): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:28:39 (8660): start_timer_thread(): CreateThread() failed, errno 0 10:28:39 (8900): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8900, selfPID=8900, iMonCtr=2 11:07:56 (9028): start_timer_thread(): CreateThread() failed, errno 0 11:07:56 (5004): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:23:15 (10060): start_timer_thread(): CreateThread() failed, errno 0 14:23:15 (8812): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:13:57 (3428): start_timer_thread(): CreateThread() failed, errno 0 15:13:58 (3636): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16::21:13 (8412): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:44:34 (5628): start_timer_thread(): CreateThread() failed, errno 0 16:44:34 (9912): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9912, selfPID=9912, iMonCtr=2 19:25:41 (7552): start_timer_thread(): CreateThread() failed, errno 0 19:25:41 (5128): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:32:59 (9748): start_timer_thread(): CreateThread() failed, errno 0 19:32:59 (6348): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:55:52 (5968): start_timer_thread(): CreateThread() failed, errno 0 20:55:53 (4600): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:30:58 (8804): start_timer_thread(): CreateThread() failed, errno 0 22:30:59 (5028): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:55:46 (8296): start_timer_thread2):3:55:46 (8240): start_timerno 0 ad(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 01:17:53 (9048): start_timer_thread(): CreateThread() failed, errno 0 01:17:53 (8340): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 03:58:46 (7984): start_timer_thread(): CreateThread() failed, errno 0 03:58:46 (9172): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 05:26:47 (4196): start_timer_thread(): CreateThread() failed, errno 0 05:26:47 (4128): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:40:46 (3992): start_timer_thread(): CreateThread() failed, errno 0 07:40:46 (8560): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8560, selfPID=8560, iMonCtr=2 14:42:47 (6344): start_timer_thread(): CreateThread() failed, errno 0 14:42:47 (10932): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6344, selfPID=6344, iMonCtr=2 15:09:50 (3992): start_timer_thread(): CreateThread() failed, errno 0 15:09:50 (6800): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:26:30 (8968): start_timer_thread(): CreateThread() failed, errno 0 15:26:30 (8088): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:06:17 (10948): start_timer_thread(): CreateThread() failed, errno 0 16:06:17 (6680): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:20:57 (8196): start_timer_thread(): CreateThread() failed, errno 0 16:20:57 (10896): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:26:40 (9968): start_timer_thread(): CreateThread() failed, errno 0 16:26:40 (5616): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7608, selfPID=7608, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8588, selfPID=8588, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:39:17 (7276): start_timer_thread(): CreateThread() failed, errno 0 10:39:18 (4328): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:50:36 (3712): start_timer_thread(): CreateThread() failed, errno 0 10:50:36 (8712): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3176, selfPID=3176, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3176, selfPID=8316, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_saf_0tbl_1992_1_006861577_2_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_0tbl_1992_1_006861577_2_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Apr 2012 12:45:35	1180018	14382300	hadam3p_saf_0tbl_1992_1_006861577_2	115,296	185,776	1.6113
14 Apr 2012 04:52:19	1180018	14382300	hadam3p_saf_0tbl_1992_1_006861577_2	103,776	167,725	1.6162
13 Apr 2012 20:10:59	1180018	14382300	hadam3p_saf_0tbl_1992_1_006861577_2	92,256	149,696	1.6226
13 Apr 2012 05:33:32	1180018	14382300	hadam3p_saf_0tbl_1992_1_006861577_2	80,736	131,807	1.6326
12 Apr 2012 15:26:43	1180018	14382300	hadam3p_saf_0tbl_1992_1_006861577_2	69,216	113,660	1.6421
11 Apr 2012 06:19:34	1180018	14382300	hadam3p_saf_0tbl_1992_1_006861577_2	57,708	95,109	1.6481
11 Apr 2012 04:17:27	1180018	14382300	hadam3p_saf_0tbl_1992_1_006861577_2	57,696	94,851	1.6440
10 Apr 2012 21:53:27	1180018	14382300	hadam3p_saf_0tbl_1992_1_006861577_2	46,176	76,611	1.6591
10 Apr 2012 07:26:04	1180018	14382300	hadam3p_saf_0tbl_1992_1_006861577_2	34,656	57,483	1.6587
09 Apr 2012 22:05:05	1180018	14382300	hadam3p_saf_0tbl_1992_1_006861577_2	23,136	38,519	1.6649
09 Apr 2012 15:12:50	1180018	14382300	hadam3p_saf_0tbl_1992_1_006861577_2	11,625	19,470	1.6748
09 Apr 2012 13:39:58	1180018	14382300	hadam3p_saf_0tbl_1992_1_006861577_2	11,616	19,219	1.6545