Shulou(Shulou.com)06/01 Report--

This article is a detailed introduction to "Practical Application Analysis in SSIO Projects". The content is detailed, the steps are clear, and the details are properly handled. I hope this article "Practical Application Analysis in SSIO Projects" can help you solve your doubts. The following is a detailed introduction to "Practical Application Analysis in SSIO Projects". Let's learn new knowledge together.

I. Project Background

We are a traditional business, but we have an unconventional heart. Enterprise users all over the country and abroad, facing the industry, to build industry-level (large) data platform. When it comes to big data platforms, we often think of Hadoop, Spark, Nosql, distributed, etc. I can only say that we are still relatively low-level, but these technologies will definitely be involved in the later stage. There are risks in making a big data platform. Apart from absolute technology, this problem should be considered from four aspects: the transformation of enterprise thinking, whether to solve practical problems, whether to implement it, and whether there is value-added effect.

Without a change in thinking, enterprises will not die, individuals will die. Why is that? Poor strategic determination, insufficient propulsion power, and the risk of PASS at any time.

If you can't solve practical problems, it's just a castle in the air. It can't create actual value. It's also very difficult to realize it. It can't last long to fool people.

It cannot be implemented on the ground. Either the group is not good, or the technology is not good. In short, the team is not good. The leader may not know everything, but he must have absolute ability to push forward.

There can be no value-added effect, and ultimately less than money, which is a situation that no one wants to see. No matter how beautiful a woman is, she can't have children, so you have to worry more. So the first principle of my college classmates looking for a partner is to be able to have children.

II. Data

There are about 238 stations in the country, excluding foreign countries. Each site has about 2000 sensors and uploads data every five minutes, which is equivalent to seven sensors per second. In-depth analysis of data is carried out on the big data platform to help production enterprises improve production processes and safety precautions.

III. Communication Protocol

Communication protocols are mainly considered comprehensively from command requirements, transmission flow, communication hierarchy, response mode, retransmission mechanism, timeout definition, data integrity, communication efficiency, code and dictionary definition, some are realized by technology, some are guaranteed by protocol...

The communication protocol command packet is as follows:

IV. Cache mechanism

Avoid frequent database operations. Buffer design is carried out on the uploading data side and the receiving data side as storage for temporary data. Of course, these temporary data can also be stored on Hadoop, which was not intended to be done in the early stage.

Client cache structure diagram:

Server cache structure diagram:

V. Framework at the communication level

The server uses SeverSuperIO (SSIO) and no other framework. One is to consider the access of different protocols, and the other is to facilitate the communication status, IO status, and site management of the site. The client is the console program written by itself.

VI. Problems and Solutions

(1) On the first day, when the client and the server are tested, the client is found to have crashed directly on the second day, and the prompt is OutOfMemoryException. After investigation and re-testing, there has been no problem so far. It may be caused by threads and operations on data.

(2) During the test, it was found that the beginning and end of the received data were correct, but the parsed data packet was empty. The problem is that the CRC16 check is duplicated with the last byte data group, and SeverSuperIO (SSIO) is missing two bytes when filtering data. CRC16 was later changed to checksum.

VII. Test effect

Test for 12 hours, as shown below:

Read here, this article "SSIO project practice application analysis" article has been introduced, want to master the knowledge points of this article also need to practice to understand, if you want to know more related content of the article, welcome to pay attention to the industry information channel.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.