climateprediction.net home page
Task 15883144

Task 15883144

Name hadcm3n_n26h_1880_40_008394761_1
Workunit 8545620
Created 6 Jul 2013, 21:13:07 UTC
Sent 6 Jul 2013, 21:13:20 UTC
Report deadline 6 Oct 2013, 4:40:31 UTC
Received 6 Sep 2013, 3:03:59 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1310137
Run time 20 days 1 hours 49 min 18 sec
CPU time 19 days 13 hours 17 min 9 sec
Validate state Invalid
Credit 12,441.60
Device peak FLOPS 2.94 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.65</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
19:01:31 (1276): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:03:24 (1851): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:07:07 (1878): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:09:39 (1909): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:09:40 (1909): No heartbeat from core client for 30 sec - exiting
19:12:32 (1936): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:15:47 (1963): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:18:44 (1988): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:21:56 (2021): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:24:33 (2048): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:27:41 (2072): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:31:00 (2099): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:34:05 (2124): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:37:13 (2150): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:39:44 (2171): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:39:45 (2171): No heartbeat from core client for 30 sec - exiting
19:39:46 (2171): No heartbeat from core client for 30 sec - exiting
19:39:47 (2171): No heartbeat from core client for 30 sec - exiting
19:43:07 (2196): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:45:34 (2323): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:45:35 (2323): No heartbeat from core client for 30 sec - exiting
19:45:36 (2323): No heartbeat from core client for 30 sec - exiting
19:47:21 (2371): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:49:47 (2441): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:52:25 (2469): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:55:02 (2498): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:57:27 (2530): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:59:33 (2555): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:01:20 (2614): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Error: Input file: dataout/n26hko.pj94c10 is not a valid UM file.
Error converting file to netcdf: dataout/n26hko.pj94c10
Error: Input file: dataout/n26hko.pi94c10 is not a valid UM file.
Error converting file to netcdf: dataout/n26hko.pi94c10
Error: Input file: dataout/n26hko.pf94c10 is not a valid UM file.
Error converting file to netcdf: dataout/n26hko.pf94c10
Error: Input file: dataout/n26hka.ph94c10 is not a valid UM file.
Error converting file to netcdf: dataout/n26hka.ph94c10
Error: Input file: dataout/n26hka.pg94c10 is not a valid UM file.
Error converting file to netcdf: dataout/n26hka.pg94c10
Error: Input file: dataout/n26hka.pe94c10 is not a valid UM file.
Error converting file to netcdf: dataout/n26hka.pe94c10
Error: Input file: dataout/n26hka.pd94c10 is not a valid UM file.
Error converting file to netcdf: dataout/n26hka.pd94c10
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
07:31:07 (1554): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:35:41 (14206): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:38:25 (14246): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:41:03 (14285): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:44:09 (14405): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
17:14:39 (11623): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:14:56 (11623): No heartbeat from core client for 30 sec - exiting
17:14:57 (11623): No heartbeat from core client for 30 sec - exiting
17:14:58 (11623): No heartbeat from core client for 30 sec - exiting
17:14:59 (11623): No heartbeat from core client for 30 sec - exiting
17:15:00 (11623): No heartbeat from core client for 30 sec - exiting
17:15:01 (11623): No heartbeat from core client for 30 sec - exiting
17:15:02 (11623): No heartbeat from core client for 30 sec - exiting
17:15:03 (11623): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
03:00:21 (1673): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:00:22 (1673): No heartbeat from core client for 30 sec - exiting
03:00:23 (1673): No heartbeat from core client for 30 sec - exiting
03:00:24 (1673): No heartbeat from core client for 30 sec - exiting
03:00:25 (1673): No heartbeat from core client for 30 sec - exiting
03:00:26 (1673): No heartbeat from core client for 30 sec - exiting
03:00:27 (1673): No heartbeat from core client for 30 sec - exiting
03:00:28 (1673): No heartbeat from core client for 30 sec - exiting
03:00:29 (1673): No heartbeat from core client for 30 sec - exiting
03:00:30 (1673): No heartbeat from core client for 30 sec - exiting
03:00:31 (1673): No heartbeat from core client for 30 sec - exiting
03:00:32 (1673): No heartbeat from core client for 30 sec - exiting
03:00:33 (1673): No heartbeat from core client for 30 sec - exiting
03:00:34 (1673): No heartbeat from core client for 30 sec - exiting
03:00:35 (1673): No heartbeat from core client for 30 sec - exiting
03:00:36 (1673): No heartbeat from core client for 30 sec - exiting
03:00:37 (1673): No heartbeat from core client for 30 sec - exiting
03:00:38 (1673): No heartbeat from core client for 30 sec - exiting
03:00:39 (1673): No heartbeat from core client for 30 sec - exiting
03:00:40 (1673): No heartbeat from core client for 30 sec - exiting
03:00:41 (1673): No heartbeat from core client for 30 sec - exiting
03:03:49 (17141): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:03:50 (17141): No heartbeat from core client for 30 sec - exiting
03:03:51 (17141): No heartbeat from core client for 30 sec - exiting
03:03:52 (17141): No heartbeat from core client for 30 sec - exiting
03:03:53 (17141): No heartbeat from core client for 30 sec - exiting
SIGSEGV: segmentation violation
Stack trace (14 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf77dd400]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x806c0d5]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x806e5f2]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8072509]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8077f47]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x80781a3]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e1b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf74a94d3]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
06 Sep 2013 03:04:59 1286052 15883144 hadcm3n_n26h_1880_40_008394761_1 1,036,800 1,689,427 1.6295
05 Sep 2013 05:22:18 1286052 15883144 hadcm3n_n26h_1880_40_008394761_1 1,010,880 1,644,935 1.6272
04 Sep 2013 21:40:32 1286052 15883144 hadcm3n_n26h_1880_40_008394761_1 984,960 1,598,477 1.6229
04 Sep 2013 03:14:18 1286052 15883144 hadcm3n_n26h_1880_40_008394761_1 959,040 1,552,014 1.6183
03 Sep 2013 11:01:23 1286052 15883144 hadcm3n_n26h_1880_40_008394761_1 933,120 1,505,653 1.6136
02 Sep 2013 21:45:53 1286052 15883144 hadcm3n_n26h_1880_40_008394761_1 907,200 1,459,190 1.6085
02 Sep 2013 08:28:53 1286052 15883144 hadcm3n_n26h_1880_40_008394761_1 881,280 1,412,450 1.6027
01 Sep 2013 19:18:42 1286052 15883144 hadcm3n_n26h_1880_40_008394761_1 855,360 1,366,113 1.5971
30 Jul 2013 09:30:35 1286052 15883144 hadcm3n_n26h_1880_40_008394761_1 829,440 1,321,104 1.5928
30 Jul 2013 09:30:35 1286052 15883144 hadcm3n_n26h_1880_40_008394761_1 803,520 1,277,049 1.5893
29 Jul 2013 13:01:10 1286052 15883144 hadcm3n_n26h_1880_40_008394761_1 777,600 1,239,172 1.5936
29 Jul 2013 13:01:11 1286052 15883144 hadcm3n_n26h_1880_40_008394761_1 751,680 1,205,596 1.6039
29 Jul 2013 13:01:11 1286052 15883144 hadcm3n_n26h_1880_40_008394761_1 725,760 1,172,062 1.6149
29 Jul 2013 13:01:11 1286052 15883144 hadcm3n_n26h_1880_40_008394761_1 699,840 1,136,672 1.6242
29 Jul 2013 13:01:11 1286052 15883144 hadcm3n_n26h_1880_40_008394761_1 673,920 1,096,022 1.6263
29 Jul 2013 13:01:11 1286052 15883144 hadcm3n_n26h_1880_40_008394761_1 648,000 1,053,425 1.6257
26 Jul 2013 14:44:09 1286052 15883144 hadcm3n_n26h_1880_40_008394761_1 622,080 1,010,701 1.6247
23 Jul 2013 17:29:54 1286052 15883144 hadcm3n_n26h_1880_40_008394761_1 596,160 966,674 1.6215
23 Jul 2013 14:37:42 1286052 15883144 hadcm3n_n26h_1880_40_008394761_1 570,240 922,738 1.6182
23 Jul 2013 14:37:41 1286052 15883144 hadcm3n_n26h_1880_40_008394761_1 544,320 878,730 1.6144


©2024 climateprediction.net