Task 19209685

Name	hadcm3n_xc5y_198012_480_010220539_2
Workunit	10220539
Created	24 Jan 2016, 22:36:57 UTC
Sent	24 Jan 2016, 22:37:03 UTC
Report deadline	6 Jan 2017, 3:57:03 UTC
Received	16 Mar 2016, 17:55:30 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1343856
Run time	8 days 4 hours 14 min 21 sec
CPU time	3 days 12 hours 10 min 44 sec
Validate state	Invalid
Credit	12,130.56
Device peak FLOPS	4.07 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 22:37:44 (81936): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 20:53:38 (110448): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 22:14:35 (304080): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:21:31 (133172): start_timer_thread(): CreateThread() failed, errno 0 Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=133172, selfPID=133172, iMonCtr=1 CPDN Monitor - Quit request from BOINC... 19:44:48 (8932): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:13:08 (3228): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:57:14 (9748): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 11:35:21 (8356): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 08:16:07 (14492): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 20:40:59 (95584): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 20:41:12 (97276): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 20:41:24 (96168): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 20:41:36 (96972): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 20:41:48 (97928): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Mar 2016 18:01:41	1343856	19209685	hadcm3n_xc5y_198012_480_010220539_2	1,010,880	596,509	0.5901
16 Mar 2016 18:01:41	1343856	19209685	hadcm3n_xc5y_198012_480_010220539_2	984,960	567,017	0.5757
16 Mar 2016 18:01:41	1343856	19209685	hadcm3n_xc5y_198012_480_010220539_2	959,040	537,478	0.5604
16 Mar 2016 18:01:41	1343856	19209685	hadcm3n_xc5y_198012_480_010220539_2	933,120	508,042	0.5445
16 Mar 2016 18:01:41	1343856	19209685	hadcm3n_xc5y_198012_480_010220539_2	907,200	478,639	0.5276
16 Mar 2016 18:01:41	1343856	19209685	hadcm3n_xc5y_198012_480_010220539_2	881,280	449,348	0.5099
16 Mar 2016 18:01:41	1343856	19209685	hadcm3n_xc5y_198012_480_010220539_2	855,360	419,793	0.4908
10 Mar 2016 09:23:42	1343856	19209685	hadcm3n_xc5y_198012_480_010220539_2	829,440	392,167	0.4728
10 Mar 2016 03:12:08	1343856	19209685	hadcm3n_xc5y_198012_480_010220539_2	803,520	368,676	0.4588
09 Mar 2016 20:29:00	1343856	19209685	hadcm3n_xc5y_198012_480_010220539_2	777,600	344,271	0.4427
09 Mar 2016 13:28:36	1343856	19209685	hadcm3n_xc5y_198012_480_010220539_2	751,680	320,362	0.4262
02 Mar 2016 17:38:27	1343856	19209685	hadcm3n_xc5y_198012_480_010220539_2	725,760	375,483	0.5174
02 Mar 2016 09:54:48	1343856	19209685	hadcm3n_xc5y_198012_480_010220539_2	699,840	345,838	0.4942
02 Mar 2016 00:42:16	1343856	19209685	hadcm3n_xc5y_198012_480_010220539_2	673,920	316,119	0.4691
01 Mar 2016 06:38:03	1343856	19209685	hadcm3n_xc5y_198012_480_010220539_2	648,000	328,795	0.5074
01 Mar 2016 00:09:04	1343856	19209685	hadcm3n_xc5y_198012_480_010220539_2	622,080	305,937	0.4918
20 Feb 2016 09:51:22	1343856	19209685	hadcm3n_xc5y_198012_480_010220539_2	596,160	281,761	0.4726
19 Feb 2016 08:44:05	1343856	19209685	hadcm3n_xc5y_198012_480_010220539_2	570,240	257,441	0.4515
17 Feb 2016 18:40:30	1343856	19209685	hadcm3n_xc5y_198012_480_010220539_2	544,320	232,372	0.4269
17 Feb 2016 06:44:05	1343856	19209685	hadcm3n_xc5y_198012_480_010220539_2	518,400	204,472	0.3944