Shulou(Shulou.com)06/02 Report--

What this article shares with you is about the advantages of database connection pooling technology in python database connection pool. the editor thinks it is very practical, so I share it with you to learn. I hope you can get something after reading this article.

It was tested yesterday to open 500 threads to request the database, but it is not clear how much time it will take. That is, how efficient it would be to initiate so many threads at the same time. So I wonder if database connection pooling technology can significantly improve such connection operations. After finishing later, you should test a piece of data: the performance comparison between the efficiency of frequently establishing and closing database connections and connection pooling!

1. DBUtils module learning

DBUtils is actually a Python package with two submodules, one for connecting DB-API 2 modules and the other for connecting typical PyGreSQL modules. Global DB-API 2 variable

SteadyDB.py

Used to stabilize database connections

PooledDB.py

Connection pool

PersistentDB.py

Maintain a continuous database connection (persistent connection)

SimplePooledDB.py

Simple connection pool PS: extract the DB-API first and come out.

The installation provides basic services for the two modules from the top-level module, PersistentDB and PooledDB.

DBUtils.PersistentDB implements tough, thread-safe, stubborn database connections, using the DB-API 2 module. The following figure shows the connection layer steps when using PersistentDB: DBUtils.PooledDB implements a tough, thread-safe, cached, reusable database connection using any DB-API 2 module. The following figure shows the workflow when using PooledDB:

At present, there are two modules for us to choose from: PersistentDB and PooledDB are both designed to reuse database connections to improve performance and maintain database stability.

Python setup.py install

Specific module learning:

DBUtils.SimplePooledDB is a very simple database connection pool implementation. It lacks a lot of functions than the complete PooledDB module. DBUtils.SimplePooledDB is essentially similar to MiscUtils.DBPool, a component of Webware. You can think of it as a demo program.

DBUtils.SteadyDB is a module that implements a "tough" database connection based on the original connection established by DB-API 2. A "tough" connection means that the connection will be reconnected after the connection is closed, or when a number of operation limits are used. A typical example is when the database is restarted and your program is still running and needs to access the database, or when your program connects to a remote database behind a firewall and loses state when the firewall is restarted.

Generally speaking, you don't need to use SteadyDB directly. It's just to pick you up.

These are the advantages of database connection pooling technology in python database connection pool. The editor believes that there are some knowledge points that we may see or use in our daily work. I hope you can learn more from this article. For more details, please follow the industry information channel.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.