Task 19169924

Name	hadcm3n_xc7g_198012_480_010218773_2
Workunit	10218773
Created	20 Dec 2015, 0:26:44 UTC
Sent	20 Dec 2015, 0:26:57 UTC
Report deadline	1 Dec 2016, 5:46:57 UTC
Received	20 Jan 2016, 13:00:50 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1266013
Run time	8 min 15 sec
CPU time
Validate state	Invalid
Credit	3,732.48
Device peak FLOPS	4.03 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.6.9</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 10:55:01 (11632): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 11:03:40 (12036): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:57:54 (9064): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 13:44:51 (6872): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 12:33:50 (14532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:34:04 (7532): start_timer_thread(): CreateThread() failed, errno 0 12:34:29 (17616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:34:47 (7160): start_timer_thread(): CreateThread() failed, errno 0 12:36:20 (18356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:36:59 (17872): start_timer_thread(): CreateThread() failed, errno 0 12:37:22 (1480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:37:39 (10992): start_timer_thread(): CreateThread() failed, errno 0 12:38:49 (15460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:39:33 (6028): start_timer_thread(): CreateThread() failed, errno 0 12:48:50 (18096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:49:36 (5292): start_timer_thread(): CreateThread() failed, errno 0 12:49:55 (9820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:50:36 (4844): start_timer_thread(): CreateThread() failed, errno 0 12:53:51 (10344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:54:25 (17428): start_timer_thread(): CreateThread() failed, errno 0 12:54:55 (18224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:55:33 (16744): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 12:52:04 (6056): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 12:59:27 (13460): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 12:59:36 (13440): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 12:59:44 (8936): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 12:59:52 (7700): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 13:00:01 (8328): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Jan 2016 09:19:57	1266013	19169924	hadcm3n_xc7g_198012_480_010218773_2	311,040	80,558	0.2590
13 Jan 2016 03:37:14	1266013	19169924	hadcm3n_xc7g_198012_480_010218773_2	285,120	48,597	0.1704
12 Jan 2016 16:11:56	1266013	19169924	hadcm3n_xc7g_198012_480_010218773_2	259,200	14,336	0.0553
28 Dec 2015 07:13:34	1266013	19169924	hadcm3n_xc7g_198012_480_010218773_2	233,280	279,430	1.1978
27 Dec 2015 21:47:59	1266013	19169924	hadcm3n_xc7g_198012_480_010218773_2	207,360	251,210	1.2115
27 Dec 2015 14:32:09	1266013	19169924	hadcm3n_xc7g_198012_480_010218773_2	181,440	222,604	1.2269
27 Dec 2015 05:09:36	1266013	19169924	hadcm3n_xc7g_198012_480_010218773_2	155,520	193,531	1.2444
26 Dec 2015 20:25:19	1266013	19169924	hadcm3n_xc7g_198012_480_010218773_2	129,600	163,951	1.2651
26 Dec 2015 00:50:03	1266013	19169924	hadcm3n_xc7g_198012_480_010218773_2	103,680	130,345	1.2572
25 Dec 2015 12:13:23	1266013	19169924	hadcm3n_xc7g_198012_480_010218773_2	77,760	90,841	1.1682
25 Dec 2015 03:24:55	1266013	19169924	hadcm3n_xc7g_198012_480_010218773_2	51,840	61,176	1.1801
24 Dec 2015 18:52:25	1266013	19169924	hadcm3n_xc7g_198012_480_010218773_2	25,920	30,796	1.1881