Shulou(Shulou.com)06/02 Report--

This article introduces the relevant knowledge of "how to achieve data sharing through DataAPI". In the operation of actual cases, many people will encounter such a dilemma, so let the editor lead you to learn how to deal with these situations. I hope you can read it carefully and be able to achieve something!

Data stack is a cloud native-station data center PaaS. We have an interesting open source project on github and gitee: FlinkX,FlinkX is a unified data synchronization tool based on Flink batch stream, which can collect both static data and real-time changing data, and is a global, heterogeneous, batch-stream integrated data synchronization engine. Please order us a star if you like! Star! Star!

Github open source project: https://github.com/DTStack/flinkx

Gitee open source project: https://gitee.com/dtstack_dev_0/flinkx

If the digital transformation of an enterprise is compared to a bicycle, then technology and data are the two wheels of the car, and on the bike are corporate strategy, culture and resources, which determine which direction the transformation will go. No matter how correct the road of digital transformation is and how clever the tactics are, the final result will be through these two wheels.

In the era of DT, "big data" does not emphasize a large quantity, but refers to many data sources and dimensions. At present, the data of many systems can not be used by third parties, and only by breaking down this barrier will new value be generated. In the process of digital intelligence transformation, the realization of open data sharing is the premise for enterprises to overtake at corners in the era of DT.

What is a data sharing service

Data sharing service can be simply summarized as sharing the data of the data center to other systems, or sharing the data of an organization to other organizations, and providing data in a variety of ways, such as database reading, file transfer, API interface services and so on.

How to provide data services and share data through data API?

Data API, which provides data services to the outside world in the form of RestfulAPI, is suitable for scenarios where the database is not directly open to the outside world and provides high concurrency and fast return of data service scenarios through interfaces. For example, the results of data processing in the middle stage of the enterprise are provided to upper data applications, data portals, visual screens and so on through data API. Securities companies provide stock, bond and other market data to external customers through data API; new media enterprises provide information to external customers through API, mainly to solve the scenario of rapid data sharing.

Second, how to generate data services

In the traditional way, the generation of API interfaces often requires back-end developers to write in languages such as Java or Python. From the beginning to the external release, some authentication and current restrictions are done in the middle, the whole process is long, and after the completion of an interface development, testers are needed to test and verify, and the input cost is high in the whole process.

The following is the process of generating data API in the traditional way:

In recent years, in the tide of data center, the product supply of big data platform is more and more complete. Some of the excellent big data product suppliers in China also have standardized data sharing service products, which encapsulate the data service capabilities, and most of the functions are completed within the platform products. The user-oriented functions are only to connect data sources, write query logic, greatly shorten the API process, and reduce development costs.

With standardized products, the general development process is as follows:

In API generation, go through the following steps:

API generation: the platform encapsulates API creation capabilities. Users only need to select tables in the WEB interface, set request parameters and return parameters. For complex API query logic, some platforms also provide a custom SQL write query logic mode to meet users' different scenarios.

API release: the platform will be integrated into an API gateway without the need for users to write their own gateway logic. After API is released, it will be directly released on the API gateway to form an API market to provide data services.

API application: users who need it can apply for the published API directly in API, which is approved by the administrator. After approval, the applicant can get the calling address and request example of API.

API Authorization: approval of API applicants' applications

API management: for enterprises, a standardized product provides a unified management platform for enterprise-level data services and an enterprise-level API market.

In the API call process, the API gateway can carry out authentication, current restriction, data decryption and other work.

(a) compared with the traditional way of generation, what can standardized products bring?

1. Improvement in development efficiency: shortening the data API development process, an API generation takes only 3 minutes

two。 Reduction of labor costs: the traditional way requires a back-end development write interface, now you only need to be more familiar with data development, by writing SQL, you can complete the development of data API.

3. API API service more scenarios: in addition to the original requirements of users, standardized products can bring more additional features, such as API, user flow limit, API call monitoring and so on.

4. Enterprise API market: to achieve unified management of enterprise API, unified API market open data services.

(2) the DataAPI products of digital stack DTinsight are oriented to the above scenarios and provide sharing services for data API.

DataAPI, through dual-mode visual configuration generation and registration of API, quickly build Oneservice data services, form an enterprise-level API market and API service management platform, and improve the efficiency of data opening and sharing.

What can DataAPI do?

In addition to the scenarios that can be solved mentioned above, DataAPI also deepens its efforts in third-party data services, service monitoring and data service security, providing customers with an excellent data service product.

Dual-mode generation API

The API service is generated by wizard mode and custom SQL mode, and the API creation is completed in 3 minutes.

Third-party service registration

In addition to generating API services on the platform, support the registration of the original API services to DataAPI, unified management, release to the API market, and unified management of all API services in the enterprise.

API call monitoring

The platform provides monitoring of the number of API calls, call logs and error logs from the perspective of API managers and API applicants.

API usage rights control

You can control the user permissions of a single API, the number of calls, and the length of the call cycle.

IV. Data service security

In the process of data external service, data security is a very important part. DataAPI ensures data security in three main aspects:

API call

Two encryption methods are provided in the API call, which can encrypt user information, API information and data information, which are suitable for scenarios with different security levels.

API current limit

The number of calls per second of API and the number of calls to API can be limited to ensure the security and stability of the data service.

Blacklist and whitelist IP control

Control access to IP from the IP level by setting a blacklist and whitelist.

This is the end of the content of "how to share data through DataAPI". Thank you for your reading. If you want to know more about the industry, you can follow the website, the editor will output more high-quality practical articles for you!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.