climateprediction.net home page
Task 16068544

Task 16068544

Name hadcm3n_o0oz_1980_40_008385022_3
Workunit 8535881
Created 16 Oct 2013, 17:47:44 UTC
Sent 16 Oct 2013, 17:48:03 UTC
Report deadline 16 Jan 2014, 1:15:14 UTC
Received 28 Oct 2013, 17:55:56 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1084861
Run time 11 days 1 hours 52 min 13 sec
CPU time 10 days 22 hours 13 min 28 sec
Validate state Invalid
Credit 4,043.52
Device peak FLOPS 3.04 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>6.10.60</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
06:15:44 (6056): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:07:43 (7056): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:56:30 (8048): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:37:39 (5264): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
12:08:59 (2212): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:56:32 (2920): No heartbeat from core client for 30 sec - exiting
18:56:33 (2920): No heartbeat from core client for 30 sec - exiting
18:56:34 (2920): No heartbeat from core client for 30 sec - exiting
18:56:35 (2920): No heartbeat from core client for 30 sec - exiting
18:56:36 (2920): No heartbeat from core client for 30 sec - exiting
18:56:37 (2920): No heartbeat from core client for 30 sec - exiting
18:56:38 (2920): No heartbeat from core client for 30 sec - exiting
18:56:39 (2920): No heartbeat from core client for 30 sec - exiting
18:56:41 (2920): No heartbeat from core client for 30 sec - exiting
18:56:42 (2920): No heartbeat from core client for 30 sec - exiting
18:56:43 (2920): No heartbeat from core client for 30 sec - exiting
18:56:44 (2920): No heartbeat from core client for 30 sec - exiting
18:56:46 (2920): No heartbeat from core client for 30 sec - exiting
18:56:47 (2920): No heartbeat from core client for 30 sec - exiting
18:56:48 (2920): No heartbeat from core client for 30 sec - exiting
18:56:49 (2920): No heartbeat from core client for 30 sec - exiting
18:56:50 (2920): No heartbeat from core client for 30 sec - exiting
18:56:51 (2920): No heartbeat from core client for 30 sec - exiting
18:56:52 (2920): No heartbeat from core client for 30 sec - exiting
18:56:53 (2920): No heartbeat from core client for 30 sec - exiting
18:56:54 (2920): No heartbeat from core client for 30 sec - exiting
18:56:55 (2920): No heartbeat from core client for 30 sec - exiting
18:56:57 (2920): No heartbeat from core client for 30 sec - exiting
18:56:58 (2920): No heartbeat from core client for 30 sec - exiting
18:56:59 (2920): No heartbeat from core client for 30 sec - exiting
18:57:00 (2920): No heartbeat from core client for 30 sec - exiting
18:57:01 (2920): No heartbeat from core client for 30 sec - exiting
18:57:02 (2920): No heartbeat from core client for 30 sec - exiting
18:57:03 (2920): No heartbeat from core client for 30 sec - exiting
18:57:04 (2920): No heartbeat from core client for 30 sec - exiting
18:57:05 (2920): No heartbeat from core client for 30 sec - exiting
18:57:06 (2920): No heartbeat from core client for 30 sec - exiting
18:57:08 (2920): No heartbeat from core client for 30 sec - exiting
18:57:09 (2920): No heartbeat from core client for 30 sec - exiting
18:57:10 (2920): No heartbeat from core client for 30 sec - exiting
18:57:11 (2920): No heartbeat from core client for 30 sec - exiting
18:57:12 (2920): No heartbeat from core client for 30 sec - exiting
18:57:13 (2920): No heartbeat from core client for 30 sec - exiting
18:57:14 (2920): No heartbeat from core client for 30 sec - exiting
18:57:15 (2920): No heartbeat from core client for 30 sec - exiting
18:57:16 (2920): No heartbeat from core client for 30 sec - exiting
18:57:17 (2920): No heartbeat from core client for 30 sec - exiting
18:57:19 (2920): No heartbeat from core client for 30 sec - exiting
18:57:20 (2920): No heartbeat from core client for 30 sec - exiting
18:57:21 (2920): No heartbeat from core client for 30 sec - exiting
18:57:22 (2920): No heartbeat from core client for 30 sec - exiting
18:57:23 (2920): No heartbeat from core client for 30 sec - exiting
18:57:24 (2920): No heartbeat from core client for 30 sec - exiting
18:57:25 (2920): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Error converting file to netcdf: dataout/o0ozko.pji5c10
Error converting file to netcdf: dataout/o0ozko.pii5c10
Error converting file to netcdf: dataout/o0ozko.pfi5c10
Error converting file to netcdf: dataout/o0ozka.phi5c10
Error converting file to netcdf: dataout/o0ozka.pgi5c10
Error converting file to netcdf: dataout/o0ozka.pei5c10
Error converting file to netcdf: dataout/o0ozka.pdi5c10
CPDN Monitor - Quit request from BOINC...
02:16:09 (3600): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
03:48:14 (1572): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:44:06 (6908): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:17:33 (5876): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:02:27 (6772): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
07:19:24 (8152): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
06:56:26 (7592): No heartbeat from core client for 30 sec - exiting
06:56:28 (7592): No heartbeat from core client for 30 sec - exiting
06:56:29 (7592): No heartbeat from core client for 30 sec - exiting
06:57:03 (7592): No heartbeat from core client for 30 sec - exiting
06:57:04 (7592): No heartbeat from core client for 30 sec - exiting
06:57:05 (7592): No heartbeat from core client for 30 sec - exiting
06:57:06 (7592): No heartbeat from core client for 30 sec - exiting
06:57:07 (7592): No heartbeat from core client for 30 sec - exiting
06:57:08 (7592): No heartbeat from core client for 30 sec - exiting
06:57:09 (7592): No heartbeat from core client for 30 sec - exiting
06:57:10 (7592): No heartbeat from core client for 30 sec - exiting
06:57:11 (7592): No heartbeat from core client for 30 sec - exiting
06:57:13 (7592): No heartbeat from core client for 30 sec - exiting
06:57:14 (7592): No heartbeat from core client for 30 sec - exiting
06:57:15 (7592): No heartbeat from core client for 30 sec - exiting
06:57:16 (7592): No heartbeat from core client for 30 sec - exiting
06:57:17 (7592): No heartbeat from core client for 30 sec - exiting
06:57:18 (7592): No heartbeat from core client for 30 sec - exiting
06:57:19 (7592): No heartbeat from core client for 30 sec - exiting
06:57:20 (7592): No heartbeat from core client for 30 sec - exiting
06:57:21 (7592): No heartbeat from core client for 30 sec - exiting
06:57:22 (7592): No heartbeat from core client for 30 sec - exiting
06:57:23 (7592): No heartbeat from core client for 30 sec - exiting
06:57:25 (7592): No heartbeat from core client for 30 sec - exiting
06:57:26 (7592): No heartbeat from core client for 30 sec - exiting
06:57:27 (7592): No heartbeat from core client for 30 sec - exiting
06:57:28 (7592): No heartbeat from core client for 30 sec - exiting
06:57:29 (7592): No heartbeat from core client for 30 sec - exiting
06:57:30 (7592): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

zip error: Could not create output file (was replacing the original zip file)
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
14:46:01 (7160): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
23:59:49 (8064): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:37:28 (5144): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:09:44 (6772): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:19:56 (4620): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:01:05 (6852): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
28 Oct 2013 06:19:27 1084861 16068544 hadcm3n_o0oz_1980_40_008385022_3 336,960 932,373 2.7670
27 Oct 2013 07:53:00 1084861 16068544 hadcm3n_o0oz_1980_40_008385022_3 311,040 860,686 2.7671
26 Oct 2013 07:26:27 1084861 16068544 hadcm3n_o0oz_1980_40_008385022_3 285,120 785,432 2.7547
25 Oct 2013 10:59:33 1084861 16068544 hadcm3n_o0oz_1980_40_008385022_3 259,200 713,158 2.7514
24 Oct 2013 11:21:30 1084861 16068544 hadcm3n_o0oz_1980_40_008385022_3 233,280 640,724 2.7466
23 Oct 2013 13:09:09 1084861 16068544 hadcm3n_o0oz_1980_40_008385022_3 207,360 569,287 2.7454
22 Oct 2013 17:08:25 1084861 16068544 hadcm3n_o0oz_1980_40_008385022_3 181,440 498,443 2.7472
21 Oct 2013 18:52:12 1084861 16068544 hadcm3n_o0oz_1980_40_008385022_3 155,520 427,472 2.7487
20 Oct 2013 22:59:37 1084861 16068544 hadcm3n_o0oz_1980_40_008385022_3 129,600 357,047 2.7550
20 Oct 2013 02:21:22 1084861 16068544 hadcm3n_o0oz_1980_40_008385022_3 103,680 284,491 2.7439
19 Oct 2013 06:14:42 1084861 16068544 hadcm3n_o0oz_1980_40_008385022_3 77,760 213,257 2.7425
18 Oct 2013 10:15:43 1084861 16068544 hadcm3n_o0oz_1980_40_008385022_3 51,840 142,493 2.7487
17 Oct 2013 14:17:37 1084861 16068544 hadcm3n_o0oz_1980_40_008385022_3 25,920 72,243 2.7872


©2024 climateprediction.net