Shulou(Shulou.com)06/01 Report--

How to read JSON files in Spark SQL, many novices are not very clear about this, in order to help you solve this problem, the following editor will explain in detail for you, people with this need can come to learn, I hope you can get something.

Val path = "/ root/temp/people.json"

Read the Json file and generate DataFrame:

1val peopleDF = spark.read.json (path)

Print Schema structure information

1peopleDF.printSchema ()

Create a temporary view

1peopleDF.createOrReplaceTempView ("people")

Execute query

1spark.sql ("SELECT name FROM people WHERE age=19"). Show

Is it helpful for you to read the above content? If you want to know more about the relevant knowledge or read more related articles, please follow the industry information channel, thank you for your support.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.