Shulou(Shulou.com)06/03 Report--

First, as an architect of big data, you need to know why enterprises build data structures.

The data structure mainly includes the following contents:

1) inconsistent data standards

2) data model management is chaotic.

3) the problem of deep performance cannot be solved.

4) the poor writing level of SQL statements leads to serious performance problems.

5) developers are aware of the implementation plan

6) lack of audit before launch

7) lack of relatively complex data processing capacity

8) poor data quality needs to implement data quality management.

Data is the wealth of customers, although it is worthless to us developers, it is priceless to customers. To ensure the completeness, security and reliability of data, there must be a data structure to meet the eight requirements.

Want to absorb nutrients in the field of big data, so that they can grow and grow. Sharing direction, before action, first share the next big data communication sharing resource group 8700 Universe Universe 97548, welcome those who want to learn, want to change careers, you can join us in advanced learning.

Second, in the era of big data, what skills do you need to master if you want to be a qualified big data architect?

First of all, the architect has many directions. As an architect, he must have rich development experience and be a technical supervisor. Because he must know what can be realized, what are the ways to achieve it, how difficult it is, and the adaptability of the system to changes in requirements. Rich practical experience in development helps to avoid architects going up and down on paper, bringing real feasibility to code writers.

In addition, we need to have a deep understanding of process-oriented, object-oriented and service-oriented design concepts, so that we can quickly detect the problems in the implementation and put forward the corresponding improvement (refactoring) scheme (that is, the so-called anti-pattern).

Secondly, it is also important to have sufficient business knowledge and business acumen in the industry. A good grasp of industry business knowledge can give architects more ability to embrace change and leave some room for expansion in system design to adapt to possible changes in requirements.

Thirdly, the architect's attention to people must be raised to the beginning of the architecture design to be taken into consideration, including communication and judgment on the quality of personnel. The software process is the process of teamwork to build the system, and the communication ability is the glue that binds multiple development lines together in the whole process. The focus on people is also reflected in the judgment of the quality of team members, such as which developers are more familiar with which technologies, or which developers tend to procrastinate. Only by making rational use of human resources and letting the right people do the right things can the whole software process be more efficient.

Big data architect should always pay attention to the development of new software design and development, and constantly explore more effective new methods, development languages, design patterns and development platforms to upgrade rapidly. Software architects need to absorb these new technologies and knowledge and apply them to software system development. However, the exploration of new technology should be carried out within a rational scope and should not blindly follow the trend. A database, for example, often gives people the impression that it can do anything, as long as nothing else matters with it. But in fact, this is not the case. For small applications, a lot of business logic can be put into the database in the way of script, but it is rare to see large applications adopt this approach.

Third, what exactly does big data architect do?

Understanding the specific work of the architect is the most direct way to better understand the architect, so what exactly does the architect do in his work?

1. Confirm demand

In the project development process, the architect is involved after the completion of the requirements specification, which must be approved by the architect. Architects need to communicate repeatedly with analysts to ensure that they have a complete and accurate understanding of user needs.

two。 System decomposition

According to the needs of users, the architect breaks down the system as a whole into smaller subsystems and components, thus forming different logical layers or services. The architect then determines the interfaces of each layer and the relationship between the layers. The architect should not only layer the whole system and decompose it vertically, but also divide the same logical layer into blocks and decompose it horizontally.

3. Technology selection

Through a series of decomposition of the system, the architect finally forms the overall architecture of the software. The choice of technology mainly depends on the software architecture. Does Web Server run on Windows or Linux? Is the database MSSql, Oracle, or Mysql? Do you need to use lightweight frameworks such as MVC or Spring? Does the front end use rich client or thin client? Similar work needs to be proposed and evaluated at this stage. The architect's selection of products and technologies is limited to evaluation and has no decision, and the final decision rests with the project manager. The technical proposal proposed by the architect provides important reference information for the project manager, who will weigh the project budget, human resources, schedule and other actual situation, and finally confirm it.

4. Develop technical specifications

The architect is a technical authority in the project development process. He needs to coordinate all developers, always communicate with developers, and always ensure that developers implement various functions in accordance with its architectural intentions. Architects need to communicate not only with developers, but also with project managers, requirements analysts, and even end users. Therefore, for architects, there are not only technical requirements, but also interpersonal communication requirements.

The above are all personal views, for your reference, if you feel that you can write, you can give yourself a more accurate positioning and find the right direction for future study.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.