climateprediction.net home page
Task 13407619

Task 13407619

Name hadcm3n_u4o7_1980_40_007458715_0
Workunit 7656218
Created 22 Sep 2011, 16:02:47 UTC
Sent 22 Sep 2011, 16:09:54 UTC
Report deadline 22 Dec 2011, 23:37:05 UTC
Received 5 Oct 2011, 12:10:34 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1144772
Run time 9 days 5 hours 14 min 32 sec
CPU time 9 days 2 hours 51 min 59 sec
Validate state Invalid
Credit 10,575.36
Device peak FLOPS 3.33 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>6.10.60</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:49:07 (7964): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:49:08 (7964): No heartbeat from core client for 30 sec - exiting
19:49:09 (7964): No heartbeat from core client for 30 sec - exiting
19:49:10 (7964): No heartbeat from core client for 30 sec - exiting
19:49:11 (7964): No heartbeat from core client for 30 sec - exiting
19:49:12 (7964): No heartbeat from core client for 30 sec - exiting
19:49:13 (7964): No heartbeat from core client for 30 sec - exiting
19:49:14 (7964): No heartbeat from core client for 30 sec - exiting
19:49:15 (7964): No heartbeat from core client for 30 sec - exiting
19:49:16 (7964): No heartbeat from core client for 30 sec - exiting
19:49:17 (7964): No heartbeat from core client for 30 sec - exiting
20:02:15 (5092): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:02:16 (5092): No heartbeat from core client for 30 sec - exiting
20:02:17 (5092): No heartbeat from core client for 30 sec - exiting
20:02:18 (5092): No heartbeat from core client for 30 sec - exiting
20:02:19 (5092): No heartbeat from core client for 30 sec - exiting
20:02:20 (5092): No heartbeat from core client for 30 sec - exiting
20:02:21 (5092): No heartbeat from core client for 30 sec - exiting
20:02:22 (5092): No heartbeat from core client for 30 sec - exiting
20:02:23 (5092): No heartbeat from core client for 30 sec - exiting
20:02:24 (5092): No heartbeat from core client for 30 sec - exiting
20:02:25 (5092): No heartbeat from core client for 30 sec - exiting
20:06:18 (7600): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:06:19 (7600): No heartbeat from core client for 30 sec - exiting
20:06:20 (7600): No heartbeat from core client for 30 sec - exiting
20:06:21 (7600): No heartbeat from core client for 30 sec - exiting
20:06:22 (7600): No heartbeat from core client for 30 sec - exiting
20:06:23 (7600): No heartbeat from core client for 30 sec - exiting
20:06:24 (7600): No heartbeat from core client for 30 sec - exiting
20:06:25 (7600): No heartbeat from core client for 30 sec - exiting
20:06:26 (7600): No heartbeat from core client for 30 sec - exiting
20:06:27 (7600): No heartbeat from core client for 30 sec - exiting
20:06:28 (7600): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
20:27:19 (6052): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:27:20 (6052): No heartbeat from core client for 30 sec - exiting
20:27:21 (6052): No heartbeat from core client for 30 sec - exiting
20:27:22 (6052): No heartbeat from core client for 30 sec - exiting
20:27:23 (6052): No heartbeat from core client for 30 sec - exiting
20:27:24 (6052): No heartbeat from core client for 30 sec - exiting
20:27:25 (6052): No heartbeat from core client for 30 sec - exiting
20:27:26 (6052): No heartbeat from core client for 30 sec - exiting
20:27:27 (6052): No heartbeat from core client for 30 sec - exiting
20:31:28 (10004): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:31:29 (10004): No heartbeat from core client for 30 sec - exiting
20:31:30 (10004): No heartbeat from core client for 30 sec - exiting
20:31:31 (10004): No heartbeat from core client for 30 sec - exiting
20:31:32 (10004): No heartbeat from core client for 30 sec - exiting
20:31:33 (10004): No heartbeat from core client for 30 sec - exiting
20:31:34 (10004): No heartbeat from core client for 30 sec - exiting
20:31:35 (10004): No heartbeat from core client for 30 sec - exiting
20:31:36 (10004): No heartbeat from core client for 30 sec - exiting
20:31:37 (10004): No heartbeat from core client for 30 sec - exiting
20:31:38 (10004): No heartbeat from core client for 30 sec - exiting
21:03:44 (6164): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:03:45 (6164): No heartbeat from core client for 30 sec - exiting
21:03:46 (6164): No heartbeat from core client for 30 sec - exiting
21:03:47 (6164): No heartbeat from core client for 30 sec - exiting
21:03:48 (6164): No heartbeat from core client for 30 sec - exiting
21:03:49 (6164): No heartbeat from core client for 30 sec - exiting
21:03:50 (6164): No heartbeat from core client for 30 sec - exiting
21:03:51 (6164): No heartbeat from core client for 30 sec - exiting
21:03:52 (6164): No heartbeat from core client for 30 sec - exiting
21:03:53 (6164): No heartbeat from core client for 30 sec - exiting
21:03:54 (6164): No heartbeat from core client for 30 sec - exiting
21:28:29 (9996): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:28:30 (9996): No heartbeat from core client for 30 sec - exiting
21:28:31 (9996): No heartbeat from core client for 30 sec - exiting
21:28:32 (9996): No heartbeat from core client for 30 sec - exiting
21:28:33 (9996): No heartbeat from core client for 30 sec - exiting
21:28:34 (9996): No heartbeat from core client for 30 sec - exiting
21:28:35 (9996): No heartbeat from core client for 30 sec - exiting
21:28:36 (9996): No heartbeat from core client for 30 sec - exiting
21:28:37 (9996): No heartbeat from core client for 30 sec - exiting
21:28:38 (9996): No heartbeat from core client for 30 sec - exiting
21:28:39 (9996): No heartbeat from core client for 30 sec - exiting
21:32:05 (9392): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:32:06 (9392): No heartbeat from core client for 30 sec - exiting
21:32:07 (9392): No heartbeat from core client for 30 sec - exiting
21:32:08 (9392): No heartbeat from core client for 30 sec - exiting
21:32:09 (9392): No heartbeat from core client for 30 sec - exiting
21:32:10 (9392): No heartbeat from core client for 30 sec - exiting
21:32:11 (9392): No heartbeat from core client for 30 sec - exiting
21:32:12 (9392): No heartbeat from core client for 30 sec - exiting
21:34:50 (6696): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:34:51 (6696): No heartbeat from core client for 30 sec - exiting
21:34:52 (6696): No heartbeat from core client for 30 sec - exiting
21:34:53 (6696): No heartbeat from core client for 30 sec - exiting
21:34:54 (6696): No heartbeat from core client for 30 sec - exiting
21:34:55 (6696): No heartbeat from core client for 30 sec - exiting
21:34:56 (6696): No heartbeat from core client for 30 sec - exiting
21:34:57 (6696): No heartbeat from core client for 30 sec - exiting
21:34:58 (6696): No heartbeat from core client for 30 sec - exiting
21:34:59 (6696): No heartbeat from core client for 30 sec - exiting
21:41:50 (8452): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:41:51 (8452): No heartbeat from core client for 30 sec - exiting
21:41:52 (8452): No heartbeat from core client for 30 sec - exiting
21:41:53 (8452): No heartbeat from core client for 30 sec - exiting
21:41:54 (8452): No heartbeat from core client for 30 sec - exiting
21:41:55 (8452): No heartbeat from core client for 30 sec - exiting
21:41:56 (8452): No heartbeat from core client for 30 sec - exiting
21:41:57 (8452): No heartbeat from core client for 30 sec - exiting
21:41:58 (8452): No heartbeat from core client for 30 sec - exiting
21:41:59 (8452): No heartbeat from core client for 30 sec - exiting
21:42:00 (8452): No heartbeat from core client for 30 sec - exiting
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
forrtl: There is not enough space on the disk.

Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9636, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
04 Oct 2011 19:30:27 1144772 13407619 hadcm3n_u4o7_1980_40_007458715_0 881,280 770,203 0.8740
04 Oct 2011 11:29:20 1144772 13407619 hadcm3n_u4o7_1980_40_007458715_0 855,360 742,078 0.8676
03 Oct 2011 18:21:47 1144772 13407619 hadcm3n_u4o7_1980_40_007458715_0 829,440 715,147 0.8622
03 Oct 2011 13:07:52 1144772 13407619 hadcm3n_u4o7_1980_40_007458715_0 803,520 693,574 0.8632
02 Oct 2011 20:51:19 1144772 13407619 hadcm3n_u4o7_1980_40_007458715_0 777,600 671,993 0.8642
02 Oct 2011 14:46:08 1144772 13407619 hadcm3n_u4o7_1980_40_007458715_0 751,680 650,346 0.8652
02 Oct 2011 08:45:42 1144772 13407619 hadcm3n_u4o7_1980_40_007458715_0 725,760 628,729 0.8663
02 Oct 2011 02:46:01 1144772 13407619 hadcm3n_u4o7_1980_40_007458715_0 699,840 607,133 0.8675
01 Oct 2011 20:45:20 1144772 13407619 hadcm3n_u4o7_1980_40_007458715_0 673,920 585,562 0.8689
01 Oct 2011 14:43:54 1144772 13407619 hadcm3n_u4o7_1980_40_007458715_0 648,000 563,941 0.8703
01 Oct 2011 08:43:29 1144772 13407619 hadcm3n_u4o7_1980_40_007458715_0 622,080 542,307 0.8718
01 Oct 2011 02:42:38 1144772 13407619 hadcm3n_u4o7_1980_40_007458715_0 596,160 520,728 0.8735
30 Sep 2011 20:41:37 1144772 13407619 hadcm3n_u4o7_1980_40_007458715_0 570,240 499,129 0.8753
30 Sep 2011 15:11:57 1144772 13407619 hadcm3n_u4o7_1980_40_007458715_0 544,320 477,416 0.8771
30 Sep 2011 09:06:32 1144772 13407619 hadcm3n_u4o7_1980_40_007458715_0 518,400 455,716 0.8791
29 Sep 2011 17:10:29 1144772 13407619 hadcm3n_u4o7_1980_40_007458715_0 492,480 432,684 0.8786
29 Sep 2011 10:05:13 1144772 13407619 hadcm3n_u4o7_1980_40_007458715_0 466,560 407,566 0.8736
28 Sep 2011 17:54:17 1144772 13407619 hadcm3n_u4o7_1980_40_007458715_0 440,640 382,004 0.8669
28 Sep 2011 11:06:00 1144772 13407619 hadcm3n_u4o7_1980_40_007458715_0 414,720 359,766 0.8675
27 Sep 2011 19:07:10 1144772 13407619 hadcm3n_u4o7_1980_40_007458715_0 388,800 337,947 0.8692


©2024 climateprediction.net