In addition to Weibo, there is also WeChat
Please pay attention
WeChat public account
Shulou
2025-02-20 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Internet Technology >
Share
Shulou(Shulou.com)06/01 Report--
< org.apache.flink:force-shading >-[INFO] Building force-shading 1.10.2 [1CM176] [INFO]-- [jar]-- Packaging
In order to be compatible with hadoop, we need to manually copy the flink-shaded-hadoop-2-uber-3.1.1.3.1.5.1-2-9.0.jar compiled in the previous step to flink-1.10.2-bin/flink-1.10.2/lib
Then manually package flink-1.10.2/flink-dist/target/flink-1.10.2-bin/flink-1.10.2 into tar.gz and go to the server to deploy and install it.
Note that the hadoop version had better be consistent, otherwise there may be incompatibility.
# finally generate the path where the compilation package is located: flink-1.10.2-bin$ ll flink-1.10.2/flink-dist/targettotal 264176drwxr-xr-x 3 jiazz staff 96B 12 5 18:03 antrundrwxr-xr-x 2 jiazz staff 64B 12 5 18:04 archive-tmp-rw-r--r-- 1 jiazz staff 490K 12 5 18:04 bash-java-utils.jardrwxr-xr-x 5 jiazz staff 160B 12 5 18:03 classesdrwxr-xr-x 3 jiazz staff 96B 12 5 18:04 flink-1.10.2-bin-rw-r--r-- 1 jiazz staff 116M 12 5 18:04 flink-dist_2.11-1.10.2.jardrwxr-xr-x 3 jiazz staff 96B 12 5 18:03 generated-test-sourcesdrwxr-xr-x 3 jiazz staff 96B 12 5 18:03 maven-archiverdrwxr-xr-x 3 jiazz staff 96B 12 5 18:03 maven-shared-archive-resources-rw-r--r-- 1 jiazz staff 206K 12 5 18:03 original-flink-dist_2.11-1.10.2.jardrwxr-xr-x 4 jiazz staff 128B 12 5 18:03 temporarydrwxr-xr-x 5 jiazz staff 160B 12 5 18:03 test-classes# add flink-shaded-hadoop-2-uber to lib$ cp ~ / .m2 / repository/org/apache/flink/flink-shaded-hadoop-2-uber/3.1.1.3.1.5.1-2-9.0 Accord 2-uber-3.1.1.3.1.5.1-2-9.0.jar flink-1.10.2-bin/flink-1.10.2/lib# package $tar czvf flink-1.10.2- 3.1.5.1-problems encountered in 2.tar.gz flink-1.10.2-bin/flink-1.10.2/ compilation
I have obviously compiled flink-shaded, but I compiled 10, and the default is 9.0, so download flink-shaded-9.0 and compile again, and then continue to compile flink, or change it to the version of flink-shaded you compiled.
[ERROR] Failed to execute goal on project flink-hadoop-fs: Could not resolve dependencies for project org.apache.flink:flink-hadoop-fs:jar:1.10.2: Could not find artifact org.apache.flink:flink-shaded-hadoop-2:jar:3.1.1.3.1.5.1-2-9.0 in jetty (http://repo.hortonworks.com/content/groups/public/)-> [Help 1] [ERROR] about "Flink 1.10.2 such as This is the end of the article "he compiled". Hope that the above content can be helpful to you, so that you can learn more knowledge, if you think the article is good, please share it for more people to see.
Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.
Views: 0
*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.
Continue with the installation of the previous hadoop.First, install zookooper1. Decompress zookoope
"Every 5-10 years, there's a rare product, a really special, very unusual product that's the most un
© 2024 shulou.com SLNews company. All rights reserved.