climateprediction.net home page
Task 15520068

Task 15520068

Name hadcm3n_37rt_1940_40_008264219_1
Workunit 8419343
Created 1 Jan 2013, 20:22:15 UTC
Sent 1 Jan 2013, 20:22:17 UTC
Report deadline 3 Apr 2013, 3:49:28 UTC
Received 24 Jan 2013, 7:09:12 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1234474
Run time 13 days 7 hours 49 min 21 sec
CPU time 11 days 19 hours 15 min 3 sec
Validate state Invalid
Credit 10,575.36
Device peak FLOPS 2.72 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
11:56:01 (2128): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
08:57:56 (2780): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:14:11 (1280): No heartbeat from core client for 30 sec - exiting
11:14:16 (1280): No heartbeat from core client for 30 sec - exiting
11:14:18 (1280): No heartbeat from core client for 30 sec - exiting
11:14:21 (1280): No heartbeat from core client for 30 sec - exiting
11:14:23 (1280): No heartbeat from core client for 30 sec - exiting
11:14:25 (1280): No heartbeat from core client for 30 sec - exiting
11:14:26 (1280): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Error converting file to netcdf: dataout/37rtko.pjh1c10
Error converting file to netcdf: dataout/37rtko.pih1c10
Error converting file to netcdf: dataout/37rtko.pfh1c10
Error converting file to netcdf: dataout/37rtka.phh1c10
Error converting file to netcdf: dataout/37rtka.pgh1c10
Error converting file to netcdf: dataout/37rtka.peh1c10
Error converting file to netcdf: dataout/37rtka.pdh1c10
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
23 Jan 2013 05:02:34 1234474 15520068 hadcm3n_37rt_1940_40_008264219_1 881,280 1,118,679 1.2694
22 Jan 2013 19:38:20 1234474 15520068 hadcm3n_37rt_1940_40_008264219_1 855,360 1,085,552 1.2691
22 Jan 2013 07:45:18 1234474 15520068 hadcm3n_37rt_1940_40_008264219_1 829,440 1,052,478 1.2689
21 Jan 2013 19:16:59 1234474 15520068 hadcm3n_37rt_1940_40_008264219_1 803,520 1,019,764 1.2691
21 Jan 2013 07:25:58 1234474 15520068 hadcm3n_37rt_1940_40_008264219_1 777,600 986,757 1.2690
20 Jan 2013 12:35:19 1234474 15520068 hadcm3n_37rt_1940_40_008264219_1 751,680 953,746 1.2688
19 Jan 2013 22:02:15 1234474 15520068 hadcm3n_37rt_1940_40_008264219_1 725,760 920,990 1.2690
19 Jan 2013 03:44:05 1234474 15520068 hadcm3n_37rt_1940_40_008264219_1 699,840 888,020 1.2689
18 Jan 2013 12:50:14 1234474 15520068 hadcm3n_37rt_1940_40_008264219_1 673,920 854,903 1.2686
17 Jan 2013 20:36:59 1234474 15520068 hadcm3n_37rt_1940_40_008264219_1 648,000 821,814 1.2682
16 Jan 2013 09:02:39 1234474 15520068 hadcm3n_37rt_1940_40_008264219_1 622,080 789,287 1.2688
14 Jan 2013 17:46:47 1234474 15520068 hadcm3n_37rt_1940_40_008264219_1 596,160 756,654 1.2692
14 Jan 2013 04:02:34 1234474 15520068 hadcm3n_37rt_1940_40_008264219_1 570,240 723,602 1.2689
13 Jan 2013 07:49:17 1234474 15520068 hadcm3n_37rt_1940_40_008264219_1 544,320 690,583 1.2687
12 Jan 2013 19:40:03 1234474 15520068 hadcm3n_37rt_1940_40_008264219_1 518,400 657,946 1.2692
12 Jan 2013 05:03:40 1234474 15520068 hadcm3n_37rt_1940_40_008264219_1 492,480 624,969 1.2690
11 Jan 2013 15:00:36 1234474 15520068 hadcm3n_37rt_1940_40_008264219_1 466,560 591,823 1.2685
11 Jan 2013 02:53:18 1234474 15520068 hadcm3n_37rt_1940_40_008264219_1 440,640 558,942 1.2685
10 Jan 2013 12:25:07 1234474 15520068 hadcm3n_37rt_1940_40_008264219_1 414,720 526,081 1.2685
09 Jan 2013 21:36:17 1234474 15520068 hadcm3n_37rt_1940_40_008264219_1 388,800 493,193 1.2685


©2024 cpdn.org