CN109977096A - A kind of database connection management method and device - Google Patents

Abstract

In view of the problem in the prior art that the leakage of the database connection pool cannot be automatically sensed, and the production service is interrupted after the leakage of the database connection pool occurs. The invention discloses a database connection management method and device. The method includes: when a database connection is occupied by an application, determining the duration that the database connection is occupied by the application; if it is determined that the duration is greater than or equal to a first preset duration, and it is not checked that the database connection has After the content is transmitted, the application's occupation of the database connection is released.

Description

A database connection management method and device

technical field

The invention relates to the field of databases, and in particular, to a database connection management method and device.

Background technique

When the application is executed, it often needs to connect with the database to obtain the required data and complete the corresponding business. One method in the prior art is to first put the database connection in the database connection pool, and directly obtain the database connection from the database connection pool when the application needs to use the database connection.

However, due to abnormal application execution and other reasons, when the application uses the database connection, it does not return the database connection to the database connection pool. This phenomenon is called database connection pool leakage. When database connection pool leakage occurs frequently, it will cause database connection. The database connections in the pool are exhausted, causing subsequent application requests to connect to the database to fail to be serviced. In the prior art, the leakage of database connection pool cannot be automatically sensed, and human input is required to check application status and background logs. When database connection pool leakage occurs, the server is restarted, resulting in interruption of production services.

Therefore, in the prior art, the phenomenon of database connection pool leakage cannot be automatically sensed, and production services are interrupted after the database connection pool leakage occurs, which is an urgent problem to be solved.

SUMMARY OF THE INVENTION

The embodiments of the present application provide a database connection management method and device, which solve the problem in the prior art that the database connection pool leakage phenomenon cannot be automatically sensed, and the production service is interrupted after the database connection pool leakage occurs.

The embodiment of the present invention provides a database connection management method, the method includes:

When the database connection is occupied by the application, determining the duration that the database connection is occupied by the application;

If it is determined that the duration is greater than or equal to the first preset duration, and it is not checked that the database connection has transmission content, the application will release the occupation of the database connection.

Optionally, the determining the duration that the database connection is occupied by the application includes:

When the database connection is occupied by the application, the start time of the occupancy is recorded;

The current time is acquired according to a first preset period, and the duration of the starting time is subtracted from the current time as the duration; the first preset period is less than the first preset time period.

Optionally, the failure to verify that there is transmission content connected to the database further includes:

If it is checked that there is transmission content connected to the database, the starting time is replaced with the current time.

Optionally, check whether the database connection has transmission content in the following manner:

Aspect interception is performed on the database connection, and the content intercepted by the aspect is stored in a first variable; the default value of the first variable is empty;

If the value of the first variable is empty within the second preset time period, it is determined that the database connection has no transmission content; otherwise, it is determined that the database connection has transmission content.

Optionally, within a time period where the duration is determined to be less than the first preset duration, or it is verified that the database connection has transmission content, the database connection is kept unchanged.

Optionally, if the duration is greater than or equal to the first preset duration, check whether the database connection has transmission content.

In the embodiment of the present invention, when the database connection is occupied by the application, the occupied duration is recorded, and when the duration is greater than or equal to the first preset duration, and no transmission content is detected in the database connection, the application will release the database connection. Occupy, return the data block connection to the database connection pool, so as to avoid the application still occupying the database connection when there is no transmission content, so that other applications cannot use the connection.

An embodiment of the present invention provides a database connection management device, the device comprising:

a determining module, configured to determine the duration that the database connection is occupied by the application when the database connection is occupied by the application;

A processing module, configured to release the application from occupying the database connection if it is determined that the duration is greater than or equal to the first preset duration and no transmission content is detected in the database connection.

Optionally, the determining module is specifically used for:

record the start time when the database connection is occupied by the application;

The current time is acquired according to a first preset period, and the duration of the starting time is subtracted from the current time as the duration; the first preset period is less than the first preset time period.

Optionally, the processing module is also used for:

If it is checked that there is transmission content connected to the database, the starting time is replaced with the current time.

Optionally, the processing module is specifically used for:

Aspect interception is performed on the database connection, and the content intercepted by the aspect is stored in a first variable; the default value of the first variable is empty;

If the value of the first variable is empty within the second preset time period, it is determined that the database connection has no transmission content; otherwise, it is determined that the database connection has transmission content.

Optionally, the processing module is also used for:

In the time period when it is determined that the duration is less than the first preset duration, or it is verified that the database connection has transmission content, the database connection is kept unchanged.

Optionally, the processing module is specifically used for:

If the duration is greater than or equal to the first preset duration, it is checked whether the database connection has transmission content.

Description of drawings

FIG. 1 is a flowchart of steps corresponding to a database connection management method proposed by an embodiment of the present invention;

2 is a schematic diagram of module interaction corresponding to a database connection management method proposed in an embodiment of the present invention;

3 is a schematic diagram of an application corresponding to a database connection management method proposed in an embodiment of the present invention acquiring a database connection;

4 is a schematic diagram of an application returning a database connection corresponding to a database connection management method proposed in an embodiment of the present invention;

FIG. 5 is a schematic structural diagram corresponding to a database connection management apparatus according to an embodiment of the present invention.

Detailed ways

In order to better understand the above technical solutions, the above technical solutions will be described in detail below with reference to the accompanying drawings and specific embodiments of the description. The description is not intended to limit the technical solutions of the present application, and the embodiments of the present application and the technical features in the embodiments may be combined with each other if there is no conflict.

When the application is executed, it often needs to connect with the database to obtain the required data and complete the corresponding business. One method in the prior art is to first put the database connection in the database connection pool, and directly obtain the database connection from the database connection pool when the application needs to use the database connection.

However, due to abnormal application execution and other reasons, when the application uses the database connection, it does not return the database connection to the database connection pool. This phenomenon is called database connection pool leakage. When database connection pool leakage occurs frequently, it will cause database connection. The database connections in the pool are exhausted, causing subsequent application requests to connect to the database to fail to be serviced. In the prior art, first, there is no method for automatically sensing the leakage of the database connection pool, which requires human input to check the application status and background logs. When the database connection pool leaks, the method of restarting the server is adopted, and the application modifies the code and publishes a new one. Version. Second, when the application encounters database connection leaks, it can only be solved by restarting continuously. The processing time is long and the impact is large, resulting in interruption of production services and interruption of production services. Generally speaking, there will be hundreds of application systems in an enterprise. If there is no database connection leakage and the automatic solution model, once the problem occurs in several systems together, a lot of manpower will be required, and the entire operation and maintenance personnel will be required. In the application of mind observation, due to a large number of manual interventions, the probability of errors will be amplified to a certain extent. A typical scenario of the above problem is a Java server. The Java server is a kind of container, and the application needs to run on the Java server to complete the business. For example, the Java server includes JAVA application server, weblogic and open source tomcat and jboss servers. The Java server encapsulates a large number of underlying functions, and the application completes the business by calling the underlying functions in the Java server.

The embodiment of the present invention proposes a method for solving database connection leakage. When database connection leakage occurs, the database connection is automatically recovered, and the method can be specifically realized by solving the model. Among them, the solution model is a code module, which defines functions for processing various abnormal events in specific scenarios. For example, for any database connection pool using Java technology, use the Java language to write the solution model. Specifically, the solution model can be summarized as: first, the middleware that automatically solves the database connection leak needs to open the connection leak, and then, when the application needs a database connection, it will obtain it from the database connection pool in the container, and the container will establish a connection with the database , put it into the database connection pool in the container, and record the acquisition time every time the connection is returned to the application. It indicates that the connection is displayed, and the connection is actively returned to the database connection pool in the container to solve the database leak problem.

As shown in FIG. 1 , it is a flowchart corresponding to the steps of a database connection management method provided by an embodiment of the present invention.

Step 101: When the database connection is occupied by the application, determine the duration for which the database connection is occupied by the application.

Step 102: If it is determined that the duration is greater than or equal to a first preset duration, and it is not verified that the database connection has transmission content, release the application from occupying the database connection.

Before step 101, the solution model needs to be opened, and the method of opening the solution model is hot opening, which takes effect immediately and does not need to restart the machine. For example, the solution model is started by entering a command at the command line. As shown in FIG. 2 , it is a schematic diagram of module interaction corresponding to a database connection management method proposed by an embodiment of the present invention. It should be noted that the container shown in Figure 2 only takes the JAVA application server as an example. The application runs on the container JAVA application server, and the database first establishes a connection with the database connection pool running in the JAVA application server. When the application needs to connect to the database , to obtain database connections directly from the database connection pool.

In step 101 , as shown in FIG. 3 , it is a schematic diagram of acquiring a database connection by an application corresponding to a database connection management method proposed in an embodiment of the present invention. The application obtains the database connection from the database connection pool, that is, when the database connection is occupied, the solution model records the timestamp when the database connection is obtained, that is, the timestamp when the database connection is occupied by the application, and the starting time of the occupied, from this start The time starts to count, and the duration is calculated.

There are many ways to determine the duration. An optional implementation is: when the database connection is occupied by the application, record the occupied starting time, obtain the current time according to the first preset cycle, and subtract the current time from the current time. The duration from the start time is taken as the duration; the first preset period is less than the first preset duration. For example, at the starting moment when the database connection is occupied by the application, a timer is set to time the first preset period. The duration of the timer can be set according to the specific scenario. For example, the timer duration is 1. second. When the timer reaches the corresponding duration, subtract the starting time from the current time as the duration.

In step 102, as shown in FIG. 4, it is a schematic diagram of an application returning a database connection corresponding to a database connection management method proposed in an embodiment of the present invention. Since in step 101, when the application obtains the database connection in the database connection pool, it has already recorded the time stamp of obtaining the database connection and started timing. It has been returned to the database connection pool, that is to say whether the application has released the occupation of the database connection. If the database connection is not returned, the detection module will detect whether there is data transmission content on the database connection. If there is no transmission content, the application will be forced to release. Occupation of database connections.

It should be noted that the calculation of the duration and the checking of whether the database connection has transmission content can be performed simultaneously or asynchronously. An optional implementation manner is, in step 101, the duration of timing is greater than or equal to the first preset time length, checking whether the database connection has transmission content, and within the second preset time length, checking whether the database connection has transmission content, The start time of the second preset duration is after the start time of the first preset duration.

In addition, for example, the duration for starting the verification database connection is determined according to the duration and the start time or the end time of the first preset duration, and a trigger verification duration for starting the verification database connection transmission content is set. It should be noted that the following times are counted from the time when the database connection is occupied. For example, if the first preset duration is 10 seconds, the duration is greater than 8 seconds, and the triggering check duration is 8 seconds, then at the end of the 8th second of the duration, the check on whether the database connection has transmitted content is enabled.

Verify that the database connection has transfer content as follows:

(1) Aspect interception is performed on the database connection, and the content intercepted by the aspect is stored in a first variable; the default value of the first variable is empty. Among them, aspect interception is a method of acquiring data transmitted in variables and database connections. Through this method, variable values and transmission content in database connections can be tracked, so that operation and maintenance personnel can analyze data changes and then troubleshoot faults. The cause can be checked and located, which can be realized through the data interceptor in the compilation environment. For example, the transmission content is intercepted by a Java interceptor. (2) Start timing from checking the database connection, until the second preset duration, check the value of the first variable again, if the value of the first variable is still empty, then determine that the database connection has no transmission content; otherwise, determine that the database connection has transfer content.

When the duration is longer than the first preset duration, if it is checked that the database is connected with transmission content, and if it is checked that the database is connected with transmission content, the starting time is replaced with the current time to re-determine the duration duration. Since the database connection has transmission content, it means that the application is still running and transmitting data normally. Therefore, it is necessary to re-time the occupied duration. When the duration is greater than or equal to the first preset duration, it is still necessary to check whether the database connection has transfer content.

In step 102, it should be noted that the database connection status includes occupied or not occupied. The default state of a database connection in the database connection pool is not occupied. When a database connection is acquired from the database connection pool and occupied by an application, the status of the database connection will be changed from unoccupied to occupied, and the application occupying the database connection will also be recorded, and the database occupied by an application will be recorded. Connections cannot be acquired and used by other applications. When the application returns the occupied database connection, the state of the database connection will be changed from the occupied state to the unoccupied state, so that it can be occupied by the application again. The application that occupied the database connection before will be stored in the database. Connect to a corresponding history library.

Whether the above database connection state is occupied, and modifying the state of the database connection, a feasible implementation is to configure a database connection state variable in the configuration file to mark whether the database connection is occupied. For example, the value of the variable T is used to represent the database connection status. The value of T includes 0 and 1. T is 0, indicating that the database connection is not occupied, and T is 1, indicating that the database connection has been occupied. After the database connection C1 is obtained from the database connection pool and occupied by the application APP1, the value of T is changed from 0 to 1, and C1 is recorded at this time. When T is 1, if another application APP2 tries to obtain C1, it will first read the value of T, and when the value of T is 1, it will return the failure to obtain C1. On the other hand, when APP1 returns C1, the value of T is changed from 1 to 0, and APP1 is stored in the operation log library corresponding to C1, so if the application APP3 tries to occupy C1 again, since T is 0 at this time , when APP3 sends a database connection request, it successfully returns the database connection C1.

In addition, in an optional implementation manner, within a time period where the duration is determined to be less than the first preset duration, or it is verified that the database connection has transmission content, the database connection is kept unchanged.

The advantages of this model are: First, it is transparent to the application, and the logic processing is completed in the middleware database connection pool. Second, it can be hot-opened and hot-closed without restarting the server. Third, for the application of database connection pool leakage, the application can continue the normal service without interrupting the service. Fourth, this mode has a low probability of manslaughter. The core of this model is to add a time attribute to each connection acquisition, and then detect whether it times out, and then detect the data traffic again.

The embodiments of the present invention have strong versatility and expansibility. In the database connection pool scenario, after the application obtains the connection, the application can be used transparently according to the set return time and connection detection technology. When a database connection leak occurs, the application can also be transparent and imperceptible, and automatically return to the database connection. pool. The method proposed by the embodiment of the present invention is applicable to any database connection pool, for example, to the database connection pool of java technology.

In the embodiment of the present invention, when the database connection is occupied by the application, the occupied duration is recorded, and when the duration is greater than or equal to the first preset duration, and no transmission content is detected in the database connection, the application will release the database connection. Occupy, return the data block connection to the database connection pool, so as to avoid the application still occupying the database connection when there is no transmission content, so that other applications cannot use the connection.

As shown in FIG. 5 , it is a schematic structural diagram corresponding to a database connection management apparatus according to an embodiment of the present invention.

An embodiment of the present invention provides a database connection management device, the device comprising:

A determining module 501, configured to determine the duration that the database connection is occupied by the application when the database connection is occupied by the application;

The processing module 502 is configured to release the application from occupying the database connection if it is determined that the duration is greater than or equal to a first preset duration and no transmission content is detected in the database connection.

Optionally, the determining module 501 is specifically used for:

record the start time when the database connection is occupied by the application;

The current time is acquired according to a first preset period, and the duration of the starting time is subtracted from the current time as the duration; the first preset period is less than the first preset time period.

Optionally, the processing module 502 is further configured to:

If it is checked that there is transmission content connected to the database, the starting time is replaced with the current time.

Optionally, the processing module 502 is specifically used for:

Aspect interception is performed on the database connection, and the content intercepted by the aspect is stored in a first variable; the default value of the first variable is empty;

If the value of the first variable is empty within the second preset time period, it is determined that the database connection has no transmission content; otherwise, it is determined that the database connection has transmission content.

Optionally, the processing module 502 is further configured to:

In the time period when it is determined that the duration is less than the first preset duration, or it is verified that the database connection has transmission content, the database connection is kept unchanged.

Optionally, the processing module 502 is specifically used for:

If the duration is greater than or equal to the first preset duration, it is checked whether the database connection has transmission content.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block in the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing device produce Means for implementing the functions specified in a flow or flow of a flowchart and/or a block or blocks of a block diagram.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions The apparatus implements the functions specified in the flow or flow of the flowcharts and/or the block or blocks of the block diagrams.

These computer program instructions can also be loaded on a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process such that The instructions provide steps for implementing the functions specified in the flow or blocks of the flowcharts and/or the block or blocks of the block diagrams.

Although preferred embodiments of the present invention have been described, additional changes and modifications to these embodiments may occur to those skilled in the art once the basic inventive concepts are known. Therefore, the appended claims are intended to be construed to include the preferred embodiment and all changes and modifications that fall within the scope of the present invention.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit and scope of the invention. Thus, provided that these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims (12)

1. a kind of database connection management method characterized by comprising

When database connection is occupied by application, determine that the database connects the duration occupied by the application；

If it is determined that the duration is greater than or equal to the first preset duration, and the database is not examined to be connected in transmission Hold, then releases the occupancy that the application connects the database.

2. the method as described in claim 1, which is characterized in that the determination database connection was occupied by the application Duration, comprising:

When the database connection is occupied by the application, it is recorded the initial time occupied；

Current time is obtained according to the first predetermined period, and current time is subtracted to the duration of the initial time, as described Duration；First predetermined period is less than first preset duration.

3. method according to claim 2, which is characterized in that it is described that the database is not examined to be connected with transferring content, Further include:

If examining to the database and being connected with transferring content, the initial time is replaced with current time.

4. method a method according to any one of claims 1-3, which is characterized in that examining the database to connect in the following way is It is no to have transferring content:

The database is connected and carries out section interception, and the content that section intercepts is stored to the first variable；Described first becomes The default value of amount is sky；

If the value of first variable is sky in the second preset duration, it is determined that the database connection is without transferring content；It is no Then, determine that the database is connected with transferring content.

5. method a method according to any one of claims 1-3, which is characterized in that further include:

It is determining in period of the duration less than first preset duration, or is examining to the database and connect There is transferring content, then keeps the database connection constant.

6. method a method according to any one of claims 1-3, which is characterized in that further include:

If the duration is greater than or equal to first preset duration, examine whether the database connection has in transmission Hold.

7. a kind of database connection management device characterized by comprising

Determining module, for when database connection is occupied by application, determining what the database connection was occupied by the application Duration；

Processing module is used for if it is determined that the duration is greater than or equal to the first preset duration, and does not examine the data Library is connected with transferring content, then releases the occupancy that the application connects the database.

8. device as claimed in claim 7, which is characterized in that the determining module is specifically used for:

Record the initial time when database connection is occupied by the application；

Current time is obtained according to the first predetermined period, and current time is subtracted to the duration of the initial time, as described Duration；First predetermined period is less than first preset duration.

9. device as claimed in claim 8, which is characterized in that the processing module is also used to:

If examining to the database and being connected with transferring content, the initial time is replaced with current time.

10. the device as described in claim 7-9 is any, which is characterized in that the processing module is specifically used for:

The database is connected and carries out section interception, and the content that section intercepts is stored to the first variable；Described first becomes The default value of amount is sky；

If the value of first variable is sky in the second preset duration, it is determined that the database connection is without transferring content；It is no Then, determine that the database is connected with transferring content.

11. the device as described in claim 7-9 is any, which is characterized in that the processing module is also used to:

It is determining in period of the duration less than first preset duration, or is examining to the database and connect There is transferring content, then keeps the database connection constant.

12. the device as described in claim 7-9 is any, which is characterized in that the processing module is specifically used for:

If the duration is greater than or equal to first preset duration, examine whether the database connection has in transmission Hold.