Shulou(Shulou.com)06/01 Report--

In this article Xiaobian for you to introduce in detail "Python how to serialize and deserialize", the content is detailed, the steps are clear, the details are handled properly, I hope this "Python how to serialize and deserialize" article can help you solve your doubts, following the editor's ideas slowly in-depth, together to learn new knowledge.

When we interact with each other, we can use JSON to interact, but it is wasteful to use JSON to transfer data between python applications and python applications (the information transmitted by JSON is limited). At this time, we can serialize the python object through the protobuf library, then transfer it into binary data, and finally deserialize it by python.

Protobuf introduction

Protobuf is a binary serialization format that is smaller and faster than json.

Install protobuf

The purpose of installing protobuf is to compile proto files into interfaces that can be called by python, c, and Java.

# if the gcc version is lower, you need to upgrade gccwget https://main.qcloudimg.com/raw/d7810aaf8b3073fbbc9d4049c21532aa/protobuf-2.6.1.tar.gztar-zxvf protobuf-2.6.1.tar.gz-C / usr/local/ & & cd / usr/local/protobuf-2.6.1./configure make & & make install#. You can set a permanent valid export PATH=$PATH:/usr/local/protobuf-2.6.1/bin at the end of / etc/profile or ~ / .bash_profile

Use the following command to see if the installation is successful.

[root@CodeOnTheRoad ~] # protoc-- versionlibprotoc 2.6.1 build python interface

Create a cls.proto file to define the serialization structure:

Package cls;message Log {message Content {required string key = 1; / key required string value = 2 for each group of fields; / / value} required int64 time = 1 for each group of fields; / / timestamp, UNIX time format repeated Content contents = 2; / / combinations of multiple kv in a log} message LogTag {required string key = 1; required string value = 2 } message LogGroup {repeated Log logs = 1; / / log array composed of multiple logs optional string contextFlow = 2; / / currently unavailable optional string filename = 3; / / log file name optional string source = 4; / / log source, machine IP repeated LogTag logTags = 5;} log {log = 1; / / log group list}

Just use the following command to convert the proto file to an interface that can be called by python.

Protoc cls.proto-python_out=./

After execution, generate the cls_pb2.py in this directory.

Serialization

Import cls_pb2 as clsimport time# builds protoBuf log content LogLogGroupList = cls.LogGroupList () LogGroup = LogLogGroupList.logGroupList.add () LogGroup.contextFlow = "1" LogGroup.filename = "python.log" LogGroup.source = "localhost" LogTag = LogGroup.logTags.add () LogTag.key = "key" LogTag.value = "value" Log = LogGroup.logs.add () Log.time = int (round (time.time () * 1000000) Content = Log.contents.add () Content.key = "Hello "Content.value =" World "print (LogLogGroupList) # Serialization data = LogLogGroupList.SerializeToString () print (data)

In fact, it is about the structure of a protobuf text serialized into a binary form.

Deserialization

Deserialization is the conversion of binaries to protobuf structures.

# deserialization LogLogGroupList = cls.LogGroupList () LogLogGroupList.ParseFromString (data) print (LogLogGroupList) read here, this article "how to serialize and deserialize Python" has been introduced. If you want to grasp the knowledge of this article, you need to practice and use it before you can understand it. If you want to learn more about related articles, please follow the industry information channel.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.