Network Security Internet Technology Development Database Servers Mobile Phone Android Software Apple Software Computer Software News IT Information

In addition to Weibo, there is also WeChat

Please pay attention

WeChat public account

Shulou

What if hive throws the wrong Wrong FS after configuring HDFS HA

2025-01-28 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Internet Technology >

Share

Shulou(Shulou.com)06/01 Report--

Editor to share with you after the configuration of HDFS HA hive throw wrong Wrong FS how to do, I believe that most people do not understand, so share this article for your reference, I hope you can learn a lot after reading this article, let's go to know it!

1. Question:

In CDH5.x or Apache environment, when HA of NameNode is configured, Hive does not query data normally.

The following exception occurs in the Hive query:

FAILED: SemanticException Unable to determine if hdfs://hadoop-01:8020/user/hive/warehouse/t1

Is encrypted: java.lang.IllegalArgumentException: Wrong FS: hdfs://hadoop-01:8020/user/hive/warehouse/t1, expected: hdfs://nameservice1

two。 Resolve:

The problem with Hive metadata, there are two tables in the Hive database:

DBS: the total path of the Hive data warehouse

SDS: Hive the path corresponding to each table

a. Enter mysql

B.use hive

c. Modify dbs and sds tables

Update DBS set DB_LOCATION_URI=REPLACE (DB_LOCATION_URI,'hadoop-01:8020','nameservice1')

Update SDS set LOCATION=REPLACE (LOCATION,'hadoop-01:8020','nameservice1')

The above is all the contents of the article "what to do if hive throws the wrong Wrong FS after configuring HDFS HA". Thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.

Views: 0

*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.

Share To

Internet Technology

Wechat

© 2024 shulou.com SLNews company. All rights reserved.

12
Report