Task 16085345

Name	hadcm3n_3eqq_1980_40_008318225_4
Workunit	8469360
Created	25 Nov 2013, 22:22:34 UTC
Sent	25 Nov 2013, 23:49:46 UTC
Report deadline	25 Feb 2014, 7:16:57 UTC
Received	6 Dec 2013, 22:17:07 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1192595
Run time	9 days 20 hours 37 min 25 sec
CPU time	9 days 14 hours 59 min 11 sec
Validate state	Invalid
Credit	4,354.56
Device peak FLOPS	2.08 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 17:01:34 (5848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:33:20 (5756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:00:34 (4548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:37:32 (5092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:09:53 (1864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:43:56 (3640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:53:19 (5512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:59:47 (2784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:00:30 (828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:04:52 (4212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:25:05 (2784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:15:23 (2144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:05:04 (2552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:36:02 (4940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:23:06 (1604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:57:27 (2608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:54:24 (5876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:17:11 (4624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:50:49 (4432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:56:45 (2456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:11:28 (1840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:19:21 (1152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:31:28 (2820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:35:13 (1836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3676, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3676, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4064, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4064, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4768, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4768, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Dec 2013 00:03:56	1192595	16085345	hadcm3n_3eqq_1980_40_008318225_4	362,880	811,775	2.2370
05 Dec 2013 08:07:17	1192595	16085345	hadcm3n_3eqq_1980_40_008318225_4	336,960	757,269	2.2474
04 Dec 2013 16:18:35	1192595	16085345	hadcm3n_3eqq_1980_40_008318225_4	311,040	701,174	2.2543
03 Dec 2013 23:42:20	1192595	16085345	hadcm3n_3eqq_1980_40_008318225_4	285,120	645,033	2.2623
03 Dec 2013 07:08:09	1192595	16085345	hadcm3n_3eqq_1980_40_008318225_4	259,200	587,803	2.2678
02 Dec 2013 05:53:10	1192595	16085345	hadcm3n_3eqq_1980_40_008318225_4	233,280	527,940	2.2631
01 Dec 2013 12:39:03	1192595	16085345	hadcm3n_3eqq_1980_40_008318225_4	207,360	467,161	2.2529
30 Nov 2013 19:45:39	1192595	16085345	hadcm3n_3eqq_1980_40_008318225_4	181,440	407,004	2.2432
30 Nov 2013 03:33:37	1192595	16085345	hadcm3n_3eqq_1980_40_008318225_4	155,520	349,677	2.2484
29 Nov 2013 11:04:33	1192595	16085345	hadcm3n_3eqq_1980_40_008318225_4	129,600	291,483	2.2491
28 Nov 2013 18:40:22	1192595	16085345	hadcm3n_3eqq_1980_40_008318225_4	103,680	233,350	2.2507
28 Nov 2013 02:00:36	1192595	16085345	hadcm3n_3eqq_1980_40_008318225_4	77,760	174,344	2.2421
27 Nov 2013 09:00:57	1192595	16085345	hadcm3n_3eqq_1980_40_008318225_4	51,840	115,805	2.2339
26 Nov 2013 16:37:47	1192595	16085345	hadcm3n_3eqq_1980_40_008318225_4	25,920	58,118	2.2422