climateprediction.net home page
Task 13060627

Task 13060627

Name hadcm3n_o1xz_1900_40_007197850_2
Workunit 7396130
Created 4 Jul 2011, 11:07:06 UTC
Sent 4 Jul 2011, 12:00:28 UTC
Report deadline 3 Oct 2011, 19:27:39 UTC
Received 13 Aug 2011, 0:53:03 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 841473
Run time 15 days 23 hours 49 min 20 sec
CPU time 14 days 20 hours 42 min 43 sec
Validate state Invalid
Credit 7,776.00
Device peak FLOPS 2.33 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on o1xzko.daa2850
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
18:09:17 (616): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:09:18 (616): No heartbeat from core client for 30 sec - exiting
18:09:19 (616): No heartbeat from core client for 30 sec - exiting
18:09:20 (616): No heartbeat from core client for 30 sec - exiting
18:09:21 (616): No heartbeat from core client for 30 sec - exiting
18:09:22 (616): No heartbeat from core client for 30 sec - exiting
18:09:23 (616): No heartbeat from core client for 30 sec - exiting
18:09:24 (616): No heartbeat from core client for 30 sec - exiting
18:09:25 (616): No heartbeat from core client for 30 sec - exiting
18:09:26 (616): No heartbeat from core client for 30 sec - exiting
18:09:27 (616): No heartbeat from core client for 30 sec - exiting
18:10:48 (4504): No heartbeat from core client for 30 sec - exiting
18:10:49 (4504): No heartbeat from core client for 30 sec - exiting
18:10:50 (4504): No heartbeat from core client for 30 sec - exiting
18:10:51 (4504): No heartbeat from core client for 30 sec - exiting
18:10:52 (4504): No heartbeat from core client for 30 sec - exiting
18:10:53 (4504): No heartbeat from core client for 30 sec - exiting
18:10:54 (4504): No heartbeat from core client for 30 sec - exiting
18:10:55 (4504): No heartbeat from core client for 30 sec - exiting
18:10:56 (4504): No heartbeat from core client for 30 sec - exiting
18:10:57 (4504): No heartbeat from core client for 30 sec - exiting
18:10:58 (4504): No heartbeat from core client for 30 sec - exiting
18:10:59 (4504): No heartbeat from core client for 30 sec - exiting
18:11:00 (4504): No heartbeat from core client for 30 sec - exiting
18:11:01 (4504): No heartbeat from core client for 30 sec - exiting
18:11:02 (4504): No heartbeat from core client for 30 sec - exiting
18:11:03 (4504): No heartbeat from core client for 30 sec - exiting
18:11:04 (4504): No heartbeat from core client for 30 sec - exiting
18:11:05 (4504): No heartbeat from core client for 30 sec - exiting
18:11:06 (4504): No heartbeat from core client for 30 sec - exiting
18:11:07 (4504): No heartbeat from core client for 30 sec - exiting
18:11:08 (4504): No heartbeat from core client for 30 sec - exiting
18:11:09 (4504): No heartbeat from core client for 30 sec - exiting
18:11:10 (4504): No heartbeat from core client for 30 sec - exiting
18:11:11 (4504): No heartbeat from core client for 30 sec - exiting
18:11:12 (4504): No heartbeat from core client for 30 sec - exiting
18:11:13 (4504): No heartbeat from core client for 30 sec - exiting
18:11:14 (4504): No heartbeat from core client for 30 sec - exiting
18:11:15 (4504): No heartbeat from core client for 30 sec - exiting
18:11:16 (4504): No heartbeat from core client for 30 sec - exiting
18:11:17 (4504): No heartbeat from core client for 30 sec - exiting
18:11:18 (4504): No heartbeat from core client for 30 sec - exiting
18:11:19 (4504): No heartbeat from core client for 30 sec - exiting
18:11:20 (4504): No heartbeat from core client for 30 sec - exiting
18:11:21 (4504): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:12:02 (7116): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:12:03 (7116): No heartbeat from core client for 30 sec - exiting
18:12:04 (7116): No heartbeat from core client for 30 sec - exiting
18:12:05 (7116): No heartbeat from core client for 30 sec - exiting
18:12:06 (7116): No heartbeat from core client for 30 sec - exiting
18:12:07 (7116): No heartbeat from core client for 30 sec - exiting
18:12:08 (7116): No heartbeat from core client for 30 sec - exiting
18:12:09 (7116): No heartbeat from core client for 30 sec - exiting
18:12:10 (7116): No heartbeat from core client for 30 sec - exiting
18:12:11 (7116): No heartbeat from core client for 30 sec - exiting
18:12:12 (7116): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
16:36:13 (5024): No heartbeat from core client for 30 sec - exiting
16:36:14 (5024): No heartbeat from core client for 30 sec - exiting
16:36:15 (5024): No heartbeat from core client for 30 sec - exiting
16:36:16 (5024): No heartbeat from core client for 30 sec - exiting
16:36:17 (5024): No heartbeat from core client for 30 sec - exiting
16:36:18 (5024): No heartbeat from core client for 30 sec - exiting
16:36:19 (5024): No heartbeat from core client for 30 sec - exiting
16:36:20 (5024): No heartbeat from core client for 30 sec - exiting
16:36:21 (5024): No heartbeat from core client for 30 sec - exiting
16:36:22 (5024): No heartbeat from core client for 30 sec - exiting
16:36:23 (5024): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on o1xzko.daa82p0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
08:18:31 (8776): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on o1xzko.dab13f0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
18:40:37 (9828): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:40:38 (9828): No heartbeat from core client for 30 sec - exiting
18:40:39 (9828): No heartbeat from core client for 30 sec - exiting
18:40:40 (9828): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
09:53:23 (908): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:53:24 (908): No heartbeat from core client for 30 sec - exiting
09:53:25 (908): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on o1xzko.dac2as0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
06:12:11 (2980): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:12:12 (2980): No heartbeat from core client for 30 sec - exiting
06:12:13 (2980): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: INITDUMP: Wrong no of ocean prognostic fields                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

Model crashed: INITDUMP: Wrong no of ocean prognostic fields                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

Model crashed: INITDUMP: Wrong no of ocean prognostic fields                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

Model crashed: INITDUMP: Wrong no of ocean prognostic fields                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

Model crashed: INITDUMP: Wrong no of ocean prognostic fields                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

Model crashed: INITDUMP: Wrong no of ocean prognostic fields                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish
06:00:31 (8244): No heartbeat from core client for 30 sec - exiting
06:00:32 (8244): No heartbeat from core client for 30 sec - exiting

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
10 Aug 2011 21:43:52 841473 13060627 hadcm3n_o1xz_1900_40_007197850_2 648,000 1,263,820 1.9503
09 Aug 2011 18:17:14 841473 13060627 hadcm3n_o1xz_1900_40_007197850_2 622,080 1,217,123 1.9565
08 Aug 2011 17:30:14 841473 13060627 hadcm3n_o1xz_1900_40_007197850_2 596,160 1,170,541 1.9635
07 Aug 2011 04:02:29 841473 13060627 hadcm3n_o1xz_1900_40_007197850_2 570,240 1,121,831 1.9673
05 Aug 2011 18:22:05 841473 13060627 hadcm3n_o1xz_1900_40_007197850_2 544,320 1,072,879 1.9710
04 Aug 2011 17:48:54 841473 13060627 hadcm3n_o1xz_1900_40_007197850_2 518,400 1,023,200 1.9738
03 Aug 2011 14:40:52 841473 13060627 hadcm3n_o1xz_1900_40_007197850_2 492,480 971,061 1.9718
02 Aug 2011 01:52:37 841473 13060627 hadcm3n_o1xz_1900_40_007197850_2 466,560 916,994 1.9654
31 Jul 2011 23:02:27 841473 13060627 hadcm3n_o1xz_1900_40_007197850_2 440,640 862,041 1.9563
27 Jul 2011 21:40:55 841473 13060627 hadcm3n_o1xz_1900_40_007197850_2 414,720 808,670 1.9499
26 Jul 2011 20:01:58 841473 13060627 hadcm3n_o1xz_1900_40_007197850_2 388,800 755,731 1.9438
25 Jul 2011 23:02:37 841473 13060627 hadcm3n_o1xz_1900_40_007197850_2 362,880 702,667 1.9364
25 Jul 2011 22:12:55 841473 13060627 hadcm3n_o1xz_1900_40_007197850_2 336,960 651,582 1.9337
25 Jul 2011 20:51:22 841473 13060627 hadcm3n_o1xz_1900_40_007197850_2 311,040 601,522 1.9339
25 Jul 2011 19:23:20 841473 13060627 hadcm3n_o1xz_1900_40_007197850_2 285,120 549,004 1.9255
25 Jul 2011 19:07:26 841473 13060627 hadcm3n_o1xz_1900_40_007197850_2 259,200 495,977 1.9135
25 Jul 2011 14:10:35 841473 13060627 hadcm3n_o1xz_1900_40_007197850_2 233,280 445,650 1.9104
25 Jul 2011 14:10:35 841473 13060627 hadcm3n_o1xz_1900_40_007197850_2 207,360 392,832 1.8944
25 Jul 2011 14:10:34 841473 13060627 hadcm3n_o1xz_1900_40_007197850_2 181,440 339,713 1.8723
25 Jul 2011 14:10:32 841473 13060627 hadcm3n_o1xz_1900_40_007197850_2 155,520 286,129 1.8398


©2024 climateprediction.net