climateprediction.net home page
Task 14788990

Task 14788990

Name hadcm3n_2014_1980_40_008000439_0
Workunit 8155553
Created 12 Jun 2012, 22:48:39 UTC
Sent 12 Jun 2012, 22:48:52 UTC
Report deadline 12 Sep 2012, 6:16:03 UTC
Received 10 Jul 2012, 11:14:08 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1157968
Run time 15 days 7 hours 36 min 9 sec
CPU time 11 days 9 hours 33 min 1 sec
Validate state Invalid
Credit 6,531.84
Device peak FLOPS 2.03 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.0.25</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
10:17:30 (3708): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:17:32 (3708): No heartbeat from core client for 30 sec - exiting
10:17:33 (3708): No heartbeat from core client for 30 sec - exiting
10:17:34 (3708): No heartbeat from core client for 30 sec - exiting
10:17:35 (3708): No heartbeat from core client for 30 sec - exiting
10:34:57 (1188): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:41:36 (6088): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:41:38 (6088): No heartbeat from core client for 30 sec - exiting
10:41:39 (6088): No heartbeat from core client for 30 sec - exiting
10:41:40 (6088): No heartbeat from core client for 30 sec - exiting
10:41:42 (6088): No heartbeat from core client for 30 sec - exiting
10:41:43 (6088): No heartbeat from core client for 30 sec - exiting
10:41:44 (6088): No heartbeat from core client for 30 sec - exiting
10:41:45 (6088): No heartbeat from core client for 30 sec - exiting
10:41:46 (6088): No heartbeat from core client for 30 sec - exiting
10:41:47 (6088): No heartbeat from core client for 30 sec - exiting
10:41:49 (6088): No heartbeat from core client for 30 sec - exiting
10:41:50 (6088): No heartbeat from core client for 30 sec - exiting
10:41:51 (6088): No heartbeat from core client for 30 sec - exiting
10:41:52 (6088): No heartbeat from core client for 30 sec - exiting
12:12:08 (7416): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:12:12 (7416): No heartbeat from core client for 30 sec - exiting
12:12:13 (7416): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
19:01:21 (5884): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
19:03:04 (5884): No heartbeat from core client for 30 sec - exiting
19:03:07 (5884): No heartbeat from core client for 30 sec - exiting
19:03:08 (5884): No heartbeat from core client for 30 sec - exiting
19:03:09 (5884): No heartbeat from core client for 30 sec - exiting
19:03:43 (5884): No heartbeat from core client for 30 sec - exiting
19:03:44 (5884): No heartbeat from core client for 30 sec - exiting
19:03:45 (5884): No heartbeat from core client for 30 sec - exiting
19:03:46 (5884): No heartbeat from core client for 30 sec - exiting
19:03:47 (5884): No heartbeat from core client for 30 sec - exiting
19:03:48 (5884): No heartbeat from core client for 30 sec - exiting
19:03:49 (5884): No heartbeat from core client for 30 sec - exiting
19:03:50 (5884): No heartbeat from core client for 30 sec - exiting
19:03:52 (5884): No heartbeat from core client for 30 sec - exiting
19:03:53 (5884): No heartbeat from core client for 30 sec - exiting
19:03:54 (5884): No heartbeat from core client for 30 sec - exiting
19:03:55 (5884): No heartbeat from core client for 30 sec - exiting
19:03:56 (5884): No heartbeat from core client for 30 sec - exiting
19:03:57 (5884): No heartbeat from core client for 30 sec - exiting
19:03:58 (5884): No heartbeat from core client for 30 sec - exiting
19:03:59 (5884): No heartbeat from core client for 30 sec - exiting
19:04:00 (5884): No heartbeat from core client for 30 sec - exiting
19:04:01 (5884): No heartbeat from core client for 30 sec - exiting
19:04:02 (5884): No heartbeat from core client for 30 sec - exiting
19:04:04 (5884): No heartbeat from core client for 30 sec - exiting
19:04:05 (5884): No heartbeat from core client for 30 sec - exiting
19:04:06 (5884): No heartbeat from core client for 30 sec - exiting
19:04:07 (5884): No heartbeat from core client for 30 sec - exiting
19:04:08 (5884): No heartbeat from core client for 30 sec - exiting
19:04:09 (5884): No heartbeat from core client for 30 sec - exiting
19:04:10 (5884): No heartbeat from core client for 30 sec - exiting
19:04:11 (5884): No heartbeat from core client for 30 sec - exiting
19:04:12 (5884): No heartbeat from core client for 30 sec - exiting
19:04:13 (5884): No heartbeat from core client for 30 sec - exiting
19:04:14 (5884): No heartbeat from core client for 30 sec - exiting
19:04:16 (5884): No heartbeat from core client for 30 sec - exiting
19:04:17 (5884): No heartbeat from core client for 30 sec - exiting
19:04:18 (5884): No heartbeat from core client for 30 sec - exiting
19:04:19 (5884): No heartbeat from core client for 30 sec - exiting
19:04:20 (5884): No heartbeat from core client for 30 sec - exiting
19:04:21 (5884): No heartbeat from core client for 30 sec - exiting
19:04:22 (5884): No heartbeat from core client for 30 sec - exiting
19:04:23 (5884): No heartbeat from core client for 30 sec - exiting
19:04:24 (5884): No heartbeat from core client for 30 sec - exiting
19:04:25 (5884): No heartbeat from core client for 30 sec - exiting
19:04:26 (5884): No heartbeat from core client for 30 sec - exiting
19:04:28 (5884): No heartbeat from core client for 30 sec - exiting
19:04:29 (5884): No heartbeat from core client for 30 sec - exiting
19:04:30 (5884): No heartbeat from core client for 30 sec - exiting
19:04:52 (5884): No heartbeat from core client for 30 sec - exiting
19:04:53 (5884): No heartbeat from core client for 30 sec - exiting
19:04:54 (5884): No heartbeat from core client for 30 sec - exiting
19:04:55 (5884): No heartbeat from core client for 30 sec - exiting
19:04:56 (5884): No heartbeat from core client for 30 sec - exiting
19:04:57 (5884): No heartbeat from core client for 30 sec - exiting
19:04:58 (5884): No heartbeat from core client for 30 sec - exiting
19:04:59 (5884): No heartbeat from core client for 30 sec - exiting
19:05:00 (5884): No heartbeat from core client for 30 sec - exiting
19:05:02 (5884): No heartbeat from core client for 30 sec - exiting
19:05:03 (5884): No heartbeat from core client for 30 sec - exiting
19:05:04 (5884): No heartbeat from core client for 30 sec - exiting
19:05:05 (5884): No heartbeat from core client for 30 sec - exiting
19:05:06 (5884): No heartbeat from core client for 30 sec - exiting
19:05:07 (5884): No heartbeat from core client for 30 sec - exiting
19:05:08 (5884): No heartbeat from core client for 30 sec - exiting
19:05:09 (5884): No heartbeat from core client for 30 sec - exiting
19:05:10 (5884): No heartbeat from core client for 30 sec - exiting
19:05:11 (5884): No heartbeat from core client for 30 sec - exiting
19:05:13 (5884): No heartbeat from core client for 30 sec - exiting
19:05:14 (5884): No heartbeat from core client for 30 sec - exiting
19:05:15 (5884): No heartbeat from core client for 30 sec - exiting
19:05:16 (5884): No heartbeat from core client for 30 sec - exiting
19:05:17 (5884): No heartbeat from core client for 30 sec - exiting
19:05:18 (5884): No heartbeat from core client for 30 sec - exiting
19:05:19 (5884): No heartbeat from core client for 30 sec - exiting
19:05:20 (5884): No heartbeat from core client for 30 sec - exiting
19:05:21 (5884): No heartbeat from core client for 30 sec - exiting
19:05:22 (5884): No heartbeat from core client for 30 sec - exiting
19:05:23 (5884): No heartbeat from core client for 30 sec - exiting
19:05:25 (5884): No heartbeat from core client for 30 sec - exiting
19:05:26 (5884): No heartbeat from core client for 30 sec - exiting
19:05:27 (5884): No heartbeat from core client for 30 sec - exiting
19:05:28 (5884): No heartbeat from core client for 30 sec - exiting
19:05:29 (5884): No heartbeat from core client for 30 sec - exiting
19:05:30 (5884): No heartbeat from core client for 30 sec - exiting
19:05:31 (5884): No heartbeat from core client for 30 sec - exiting
19:05:32 (5884): No heartbeat from core client for 30 sec - exiting
19:05:33 (5884): No heartbeat from core client for 30 sec - exiting
19:05:34 (5884): No heartbeat from core client for 30 sec - exiting
19:05:35 (5884): No heartbeat from core client for 30 sec - exiting
19:05:37 (5884): No heartbeat from core client for 30 sec - exiting
19:05:47 (5884): No heartbeat from core client for 30 sec - exiting
19:06:00 (5884): No heartbeat from core client for 30 sec - exiting
19:06:01 (5884): No heartbeat from core client for 30 sec - exiting
19:06:02 (5884): No heartbeat from core client for 30 sec - exiting
19:06:04 (5884): No heartbeat from core client for 30 sec - exiting
19:06:05 (5884): No heartbeat from core client for 30 sec - exiting
19:06:06 (5884): No heartbeat from core client for 30 sec - exiting
19:06:07 (5884): No heartbeat from core client for 30 sec - exiting
19:06:08 (5884): No heartbeat from core client for 30 sec - exiting
19:06:09 (5884): No heartbeat from core client for 30 sec - exiting
19:06:10 (5884): No heartbeat from core client for 30 sec - exiting
19:06:11 (5884): No heartbeat from core client for 30 sec - exiting
19:06:12 (5884): No heartbeat from core client for 30 sec - exiting
19:06:13 (5884): No heartbeat from core client for 30 sec - exiting
19:06:14 (5884): No heartbeat from core client for 30 sec - exiting
19:06:16 (5884): No heartbeat from core client for 30 sec - exiting
19:06:17 (5884): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
forrtl: There is not enough space on the disk.

Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4856, iMonCtr=1
Model crash detected, will try to restart...
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 Jul 2012 00:03:13 1157968 14788990 hadcm3n_2014_1980_40_008000439_0 544,320 1,093,314 2.0086
07 Jul 2012 08:30:14 1157968 14788990 hadcm3n_2014_1980_40_008000439_0 518,400 1,039,435 2.0051
04 Jul 2012 10:27:15 1157968 14788990 hadcm3n_2014_1980_40_008000439_0 492,480 986,668 2.0035
02 Jul 2012 13:07:35 1157968 14788990 hadcm3n_2014_1980_40_008000439_0 466,560 936,599 2.0075
02 Jul 2012 12:06:27 1157968 14788990 hadcm3n_2014_1980_40_008000439_0 440,640 886,103 2.0109
30 Jun 2012 03:42:46 1157968 14788990 hadcm3n_2014_1980_40_008000439_0 414,720 835,371 2.0143
29 Jun 2012 10:59:58 1157968 14788990 hadcm3n_2014_1980_40_008000439_0 388,800 786,270 2.0223
28 Jun 2012 20:00:29 1157968 14788990 hadcm3n_2014_1980_40_008000439_0 362,880 734,148 2.0231
28 Jun 2012 05:04:48 1157968 14788990 hadcm3n_2014_1980_40_008000439_0 336,960 682,178 2.0245
26 Jun 2012 23:39:07 1157968 14788990 hadcm3n_2014_1980_40_008000439_0 311,040 632,269 2.0328
26 Jun 2012 01:16:28 1157968 14788990 hadcm3n_2014_1980_40_008000439_0 285,120 579,475 2.0324
22 Jun 2012 10:03:12 1157968 14788990 hadcm3n_2014_1980_40_008000439_0 259,200 538,265 2.0766
21 Jun 2012 08:46:20 1157968 14788990 hadcm3n_2014_1980_40_008000439_0 233,280 488,506 2.0941
20 Jun 2012 17:25:40 1157968 14788990 hadcm3n_2014_1980_40_008000439_0 207,360 438,133 2.1129
19 Jun 2012 08:25:47 1157968 14788990 hadcm3n_2014_1980_40_008000439_0 181,440 385,977 2.1273
18 Jun 2012 03:25:16 1157968 14788990 hadcm3n_2014_1980_40_008000439_0 155,520 329,700 2.1200
17 Jun 2012 00:42:54 1157968 14788990 hadcm3n_2014_1980_40_008000439_0 129,600 277,464 2.1409
16 Jun 2012 08:04:38 1157968 14788990 hadcm3n_2014_1980_40_008000439_0 103,680 227,174 2.1911
15 Jun 2012 17:31:19 1157968 14788990 hadcm3n_2014_1980_40_008000439_0 77,760 177,323 2.2804
14 Jun 2012 20:07:05 1157968 14788990 hadcm3n_2014_1980_40_008000439_0 51,840 119,951 2.3139


©2024 climateprediction.net