Shulou(Shulou.com)06/03 Report--

Buy big data Hadoop course package and enjoy a 15% discount!

Package address: http://edu.51cto.com/pack/view/id-806.html

Mr. Zhao Qiang blog address: http://collen7788.blog.51cto.com/

Avro is a general serialized data structure form, which plays an important role in the development of Hadoop big data. This course will explain the definition of Avro data structure for readers, and implement AVRO procedures. At the same time, it will show readers how to serialize and deserialize Java data based on Avro. At the same time, students will be introduced in detail the implementation of Avro RPC and how to use Avro serialization in MapReduce.

This series of courses includes the following six courses:

1. Hadoop 2.x (1) Foundation of big data

Http://edu.51cto.com/course/course_id-6704.html

2. Hadoop 2.x (2) big data advanced

Http://edu.51cto.com/course/course_id-6705.html

3. Hadoop 2.x (3) data analysis engine: Hive

Http://edu.51cto.com/course/course_id-6706.html

4. Hadoop 2.x (4) data analysis engine: Pig

Http://edu.51cto.com/course/course_id-6707.html

5. Hadoop 2.x (5) Collection of actual combat cases of MapReduce

Http://edu.51cto.com/course/course_id-8288.html

6. Hadoop 2.x (VI) serialization using Avro

Http://edu.51cto.com/course/course_id-8978.html

It is recommended that students start from the first course, learn step by step, and complete the corresponding experiments, so that they can better understand and master the architecture of Hadoop.

Course syllabus "Hadoop 2.x (VI) serialization using Avro"

Chapter 1 course Overview and Avro fundamentals

(*) course Overview

(*) serialization of Java

(*) serialization of Hadoop

(*) data type and Schema of Avro

Chapter 2 using Avro in Java Serialization

(*) use Schema to serialize Java

(*) use Schema to deserialize Java

(*) use Avro Tools to generate Schema generation classes to realize Java serialization

(*) use Avro Tools to generate Schema generation classes to realize Java deserialization

Chapter III using Avro in RPC

(*) Review of knowledge points: RPC communication in Hadoop

(*) use Avro to implement message communication in RPC: define the message format Schema

(*) using Avro to communicate messages in RPC II: developing server-side programs

(*) message communication using Avro in RPC part III: developing client-side programs

Chapter 4 using Avro in MapReduce

(*) Review of knowledge points: MapReduce in Hadoop

(*) use one of the Avro in MapReduce: define the data format Schema

(*) using Avro in MapReduce II: developing Mapper-side programs

(*) use Avro III in MapReduce: developing Reducer-side programs

(*) using Avro IV in MapReduce: developing Job main program side programs

(*) use Avro V in MapReduce: run tests

(*) use Schema's build class in the MapReduce task

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.