climateprediction.net home page
Task 19041556

Task 19041556

Name hadcm3n_xa43_1980_40_010022136_3
Workunit 10020206
Created 29 Oct 2015, 19:57:56 UTC
Sent 29 Oct 2015, 19:58:05 UTC
Report deadline 29 Jan 2016, 3:25:16 UTC
Received 5 Nov 2015, 14:12:55 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1461631
Run time 2 days 21 hours 59 min 34 sec
CPU time 1 days 16 hours 54 min 42 sec
Validate state Invalid
Credit 1,555.20
Device peak FLOPS 3.30 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.6.9</core_client_version>
<![CDATA[
<message>
The device does not recognize the command.
 (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
14:41:17 (9256): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:20:57 (7472): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:54:30 (5280): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:16:25 (3064): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:31:38 (6052): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:40:51 (5020): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:55:58 (8180): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:17:18 (2620): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:47:54 (4812): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:30:58 (9456): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:30:59 (9456): No heartbeat from core client for 30 sec - exiting
01:31:00 (9456): No heartbeat from core client for 30 sec - exiting
01:31:01 (9456): No heartbeat from core client for 30 sec - exiting
01:31:02 (9456): No heartbeat from core client for 30 sec - exiting
01:31:03 (9456): No heartbeat from core client for 30 sec - exiting
01:31:04 (9456): No heartbeat from core client for 30 sec - exiting
02:31:12 (4536): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:13:27 (9464): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:44:11 (7176): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:47:22 (7424): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:47:23 (7424): No heartbeat from core client for 30 sec - exiting
05:47:24 (7424): No heartbeat from core client for 30 sec - exiting
05:47:25 (7424): No heartbeat from core client for 30 sec - exiting
05:47:26 (7424): No heartbeat from core client for 30 sec - exiting
05:47:27 (7424): No heartbeat from core client for 30 sec - exiting
forrtl: Access is denied.

05:53:30 (4688): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:56:38 (9568): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:32:49 (9416): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:32:50 (9416): No heartbeat from core client for 30 sec - exiting
06:32:51 (9416): No heartbeat from core client for 30 sec - exiting
06:32:52 (9416): No heartbeat from core client for 30 sec - exiting
06:32:53 (9416): No heartbeat from core client for 30 sec - exiting
06:35:58 (10596): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:35:59 (10596): No heartbeat from core client for 30 sec - exiting
06:36:00 (10596): No heartbeat from core client for 30 sec - exiting
06:36:01 (10596): No heartbeat from core client for 30 sec - exiting
06:36:02 (10596): No heartbeat from core client for 30 sec - exiting
06:36:03 (10596): No heartbeat from core client for 30 sec - exiting
06:36:04 (10596): No heartbeat from core client for 30 sec - exiting
06:39:16 (2252): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:04:00 (8228): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:13:10 (2108): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:04:26 (10436): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:04:27 (10436): No heartbeat from core client for 30 sec - exiting
08:04:28 (10436): No heartbeat from core client for 30 sec - exiting
08:04:29 (10436): No heartbeat from core client for 30 sec - exiting
08:04:30 (10436): No heartbeat from core client for 30 sec - exiting
08:04:31 (10436): No heartbeat from core client for 30 sec - exiting
08:22:40 (4236): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:25:42 (7924): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:35:25 (5252): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:11:49 (6984): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:33:07 (5008): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:51:21 (1688): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:06:32 (9688): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
18:14:25 (11196): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:14:27 (4600): Can't acquire lockfile (32) - waiting 35s
19:30:12 (4600): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:51:32 (5852): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:51:33 (5852): No heartbeat from core client for 30 sec - exiting
19:51:34 (5852): No heartbeat from core client for 30 sec - exiting
19:51:35 (5852): No heartbeat from core client for 30 sec - exiting
19:51:36 (5852): No heartbeat from core client for 30 sec - exiting
19:51:37 (5852): No heartbeat from core client for 30 sec - exiting
19:54:40 (2108): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:54:41 (2108): No heartbeat from core client for 30 sec - exiting
19:54:42 (2108): No heartbeat from core client for 30 sec - exiting
19:54:43 (2108): No heartbeat from core client for 30 sec - exiting
19:54:45 (2108): No heartbeat from core client for 30 sec - exiting
19:54:46 (2108): No heartbeat from core client for 30 sec - exiting
20:25:00 (9652): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:25:01 (9652): No heartbeat from core client for 30 sec - exiting
20:25:02 (9652): No heartbeat from core client for 30 sec - exiting
20:25:03 (9652): No heartbeat from core client for 30 sec - exiting
20:25:04 (9652): No heartbeat from core client for 30 sec - exiting
20:25:05 (9652): No heartbeat from core client for 30 sec - exiting
20:25:06 (9652): No heartbeat from core client for 30 sec - exiting
20:37:09 (7236): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:13:27 (4964): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:16:07 (9544): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:00:54 (9704): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:10:17 (10452): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:27:16 (3652): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:27:17 (3652): No heartbeat from core client for 30 sec - exiting
06:27:18 (3652): No heartbeat from core client for 30 sec - exiting
06:27:19 (3652): No heartbeat from core client for 30 sec - exiting
06:27:20 (3652): No heartbeat from core client for 30 sec - exiting
06:27:21 (3652): No heartbeat from core client for 30 sec - exiting
06:27:22 (3652): No heartbeat from core client for 30 sec - exiting
06:27:23 (3652): No heartbeat from core client for 30 sec - exiting
06:27:24 (3652): No heartbeat from core client for 30 sec - exiting
06:30:16 (6420): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:30:17 (6420): No heartbeat from core client for 30 sec - exiting
06:30:18 (6420): No heartbeat from core client for 30 sec - exiting
06:30:19 (6420): No heartbeat from core client for 30 sec - exiting
06:30:20 (6420): No heartbeat from core client for 30 sec - exiting
06:42:40 (3680): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:45:40 (8316): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:43:54 (7448): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:43:55 (7448): No heartbeat from core client for 30 sec - exiting
08:43:56 (7448): No heartbeat from core client for 30 sec - exiting
08:43:57 (7448): No heartbeat from core client for 30 sec - exiting
08:43:59 (7448): No heartbeat from core client for 30 sec - exiting
08:44:00 (7448): No heartbeat from core client for 30 sec - exiting
08:44:01 (7448): No heartbeat from core client for 30 sec - exiting
10:57:18 (6448): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:57:19 (6448): No heartbeat from core client for 30 sec - exiting
10:57:20 (6448): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
11:47:38 (5648): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
05 Nov 2015 14:29:41 1364761 19041556 hadcm3n_xa43_1980_40_010022136_3 129,600 167,211 1.2902
05 Nov 2015 14:29:41 1364761 19041556 hadcm3n_xa43_1980_40_010022136_3 103,680 133,276 1.2855
05 Nov 2015 14:29:41 1364761 19041556 hadcm3n_xa43_1980_40_010022136_3 77,760 99,677 1.2819
05 Nov 2015 14:23:54 1364761 19041556 hadcm3n_xa43_1980_40_010022136_3 51,840 66,891 1.2903
05 Nov 2015 14:22:22 1364761 19041556 hadcm3n_xa43_1980_40_010022136_3 25,920 33,900 1.3079


©2024 climateprediction.net