WO2018035799A1 - Data query method, application and database servers, middleware, and system - Google Patents

Abstract

The present application relates to the technical field of databases and provides a data query method, application and database servers, middleware, and a system. The method comprises: obtaining a data query request and generating a data query script according to the data query request; sending the data query script to a data storage system; and receiving a result obtained by executing the data query script by the data storage system. According to the present invention, by obtaining a data query request and generating a data query script according to the data query request, sending the data query script to a data storage system, and receiving a result obtained by executing the data query script by the data storage system, the data storage system can obtain a final result according to the data query script by sending the data query script to the data storage system only once. Therefore, the number of accesses to the data storage system is reduced, and data query efficiency is improved.

Description

Data query method, application and database server, middleware and system Technical field

The present application relates to the field of database technologies, and in particular, to data query methods, applications, and database servers, middleware, and systems.

Background technique

A database is organized according to a data model and stores a collection of data in secondary storage. This data set has the following characteristics: it does not repeat as much as possible, and optimally serves multiple applications of a specific organization. Its data structure is independent of the application that uses it, and the data is added, deleted, modified, and checked. Unified software for management and control. Therefore, the database provides the underlying data resources for the application that uses it, and the query effect on the data in the database directly affects the performance of the application that uses it.

In a chat application, if the user needs to query the contact information that is finally in conversation with the user, the current data query method is: after the application server of the chat application obtains the query request of the user, firstly, the first time is initiated to the database. Query the request to query all contacts who talk to the user; secondly, the second time a query request is initiated to the database to find the last message in conversation with each contact; finally, the last of each contact in chronological order After a message is sorted, the last contact with the user is determined, and a query request is initiated to the database for the third time to query the information of the last contact with the user, and the contact information is fed back to the user.

In this process, the database server needs to be accessed 3 times, and a large amount of data needs to be transmitted to the client for the client to perform the query again after filtering, which is inefficient.

Summary of the invention

In order to improve query efficiency, the embodiment of the present application proposes a data query method, an application, a database server, a middleware, and a system.

In a first aspect, an embodiment of the present application provides a data query method, where the method includes:

Obtaining a data query request, and generating a data query script according to the data query request;

Sending the data query script to a data storage system;

Receiving a result obtained by the data storage system executing the data query script.

Optionally, the data query script includes a data query statement and a result analysis statement.

Optionally, the result analysis statement includes: a result screening statement, a result sorting statement, or a result operation statement, Or any combination of the above.

Optionally, the generating a data query script according to the data query request includes:

Obtaining database model and/or interface configuration parameters from the data storage system, and generating a data query script based on the database model and/or interface configuration parameters.

Optionally, the method further includes:

Obtaining a data model of the data to be stored;

The data model is sent to a data storage system such that the data storage system defines a database model based on the data model.

In a second aspect, an embodiment of the application provides an application server, where the application server includes:

a first obtaining module, configured to obtain a data query request;

a generating module, configured to generate a data query script according to the data query request acquired by the first obtaining module;

a first sending module, configured to send a data query script generated by the generating module to a data storage system;

And a receiving module, configured to receive a result obtained by the data storage system executing a data query script sent by the first sending module.

Optionally, the data query script includes a data query statement and a result analysis statement.

Optionally, the result analysis statement includes: a result screening statement, a result sorting statement, or a result operation statement, or any combination of the above.

Optionally, the generating module is configured to acquire a database model and/or an interface configuration parameter from the data storage system, and generate a data query script according to the database model and/or the interface configuration parameter.

Optionally, the application server further includes:

a second acquiring module, configured to acquire a data model of data to be stored;

And a second sending module, configured to send the data model acquired by the second acquiring module to the data storage system, so that the data storage system defines the database model according to the data model.

In a third aspect, an embodiment of the present application provides a data query method, where the method includes:

Get the data query script from the application server;

Executing the data query script to obtain a data query result;

The data query result is fed back to the application server.

Optionally, the data query script includes a data query statement and a result analysis statement.

Optionally, the result analysis statement includes: a result screening statement, a result sorting statement, or a result operation statement, or any combination of the above.

Optionally, the obtaining the data query script from the application server comprises:

Obtaining a middleware based data query script distributed from a data query script from an application server;

The feeding back the data query result to the application server includes:

The data query result is fed back to the application server by the middleware.

Optionally, the method further includes:

Receiving a data model sent by the application server;

Defining a database model based on the data model;

Establishing an association relationship between the database model and the application server.

Optionally, the establishing an association relationship between the database model and the application server includes:

Publishing a database model to the application server, and/or determining interface configuration parameters of the database model, and publishing the interface configuration parameters to the application server.

In a fourth aspect, an embodiment of the present application provides a database server, where the database server includes:

An obtaining module, configured to obtain a data query script from an application server;

An execution module, configured to execute a data query script obtained by the obtaining module, to obtain a data query result;

And a feedback module, configured to feed back the data query result obtained by the execution module to the application server.

Optionally, the data query script includes a data query statement and a result analysis statement.

Optionally, the result analysis statement includes: a result screening statement, a result sorting statement, or a result operation statement, or any combination of the above.

Optionally, the obtaining module is configured to obtain a data query script that is distributed by the middleware based on a data query script from an application server;

The feedback module is configured to feed back the data query result to the application server by using the middleware.

Optionally, the database server further includes:

a receiving module, configured to receive a data model sent by the application server;

a definition module, configured to define a database model according to a data model received by the receiving module;

And establishing a module, configured to establish an association relationship between the database model defined by the definition module and the application server.

Optionally, the establishing module is configured to issue a database model to the application server, and/or determine an interface configuration parameter of the database model, and issue the interface configuration parameter to the application server.

In a fifth aspect, an embodiment of the present application provides a data query method, where the method includes:

Get the data query script from the application server;

Determining one or more database servers executing the data query script;

Distributing the data query script to the database server;

Obtaining a data query result fed back by the database server, and sending the data query result to the application server.

In a sixth aspect, an embodiment of the present application provides a middleware, where the middleware includes:

a first obtaining module, configured to acquire a data query script from an application server;

a determining module, configured to determine one or more database servers that execute the data query script acquired by the first obtaining module;

a sending module, configured to distribute the data query script acquired by the first acquiring module to the database server;

a second obtaining module, configured to obtain a data query result fed back by the database server;

And a sending module, configured to send the data query result obtained by the second acquiring module to the application server.

In a seventh aspect, the embodiment of the present application provides a data query system, where the system includes: an application server and a data storage system;

The application server, such as the application server described in the second aspect above;

The data storage system is composed of the database server according to the above fourth aspect, or the data storage system is composed of the database server according to the above fourth aspect and the middleware as described in the sixth aspect above.

The benefits are as follows:

Obtaining a data query request, generating a data query script according to the data query request; sending the data query script to the data storage system; receiving the result obtained by the data storage system executing the data query script, so that only the data query script is sent to the data storage system, and the data storage is performed. The system can obtain the final result according to the data query script, reduce the number of accesses with the data storage system, and improve the efficiency of data query.

DRAWINGS

Specific embodiments of the present application will be described below with reference to the accompanying drawings, in which:

FIG. 1 is a schematic diagram of an implementation environment of a data query method according to an embodiment of the present application;

FIG. 2 is a schematic flowchart diagram of a data query method according to another embodiment of the present application;

FIG. 3 is a schematic flowchart diagram of another data query method according to another embodiment of the present application;

FIG. 4 is a schematic flowchart diagram of another data query method according to another embodiment of the present application;

FIG. 5 is a schematic flowchart diagram of another data query method according to another embodiment of the present application;

FIG. 6 is a schematic flowchart diagram of another data query method according to another embodiment of the present application;

FIG. 7 is a schematic flowchart diagram of an existing data query method according to another embodiment of the present application;

FIG. 8 is a schematic flowchart diagram of another data query method according to another embodiment of the present application;

FIG. 9 is a schematic flowchart diagram of another data query method according to another embodiment of the present application;

FIG. 10 is a schematic flowchart diagram of another data query method according to another embodiment of the present application;

FIG. 11 is a schematic structural diagram of an application server according to another embodiment of the present disclosure;

FIG. 12 is a schematic structural diagram of another application server according to another embodiment of the present disclosure;

FIG. 13 is a schematic structural diagram of a database server according to another embodiment of the present application;

FIG. 14 is a schematic structural diagram of another database server according to another embodiment of the present application;

FIG. 15 is a schematic structural diagram of an intermediate member according to another embodiment of the present application;

FIG. 16 is a schematic structural diagram of a data query system according to another embodiment of the present application.

detailed description

The exemplary embodiments of the present application are further described in detail below with reference to the accompanying drawings, in which the embodiments described are only a part of the embodiments of the present application, but not all embodiments. An exhaustive example. And in the case of no conflict, the features in the embodiments and the embodiments in the description can be combined with each other.

FIG. 1 is a schematic diagram of an implementation environment of a data query method according to an embodiment of the present invention. The implementation environment includes a terminal 101, an application server 102, and a data storage system 103.

The terminal 101 is configured to send a query request to the application server 102, and receive a result obtained by the application server 102 according to the query request.

After obtaining the query request from the terminal 101, the application server 102 generates a data query script according to the data query request; sends the data query script to the data storage system 103; and receives the result obtained by the data storage system 103 to execute the data query script, and sends the result to the terminal 101. Feedback the result;

The database model is obtained from the data storage system by the application server. The database model may include the data structure of the data storage system, and may also include the data structure and data operation mode of the data storage system.

A script is an executable file, also called a macro or batch file, written in a specific descriptive language according to a certain format. The data query script may include a data query statement and a result analysis statement, wherein the result analysis statement may be a result screening statement, a result sorting statement, or a result operation statement, or any combination of the above.

The data storage system 103 can be implemented in two ways:

In the first mode, the data storage system 103 is composed of one or more database servers, and the data server includes a memory in which a database is stored. After the database server obtains the data query script from the application server 102, the data query script is executed, the data query result is obtained, and the data query result is fed back to the application server 102.

In the second mode, the data storage system 103 is composed of a middleware and one or more database servers, wherein the data server includes a memory, and the database stores the database.

Because middleware can manage database server resources and network communication, it can connect to multiple database servers. Even if multiple database servers have different interfaces, they can still exchange information with each other through middleware. Therefore, after obtaining the data query script from the application server, the middleware determines one or more database servers that execute the data query script; distributes the data query script to the database server; obtains the data query result fed back by the database server, and queries the data The result is sent to the application server.

After obtaining the data query script distributed by the middleware, the database server executes the data query script, obtains the data query result, and feeds back the data query result to the middleware.

At the same time, the database server may store only data, and may also store data at the same time and cache part of the data. This application does not limit the specific implementation of the database.

With reference to the foregoing implementation environment, referring to the embodiment shown in FIG. 2, this embodiment provides a data query method. The process of the method provided in this embodiment is as follows:

201: Acquire a data query request, and generate a data query script according to the data query request;

Optionally, the data query script includes a data query statement and a result analysis statement.

Optionally, the result analysis statement includes: a result screening statement, a result sorting statement, or a result operation statement, or any combination of the above.

Optionally, generating a data query script according to the data query request, including:

Obtain database model and/or interface configuration parameters from the data storage system and generate data query scripts based on database model and/or interface configuration parameters.

202: Send a data query script to the data storage system;

203: Receive a result obtained by the data storage system executing a data query script.

Optionally, the method further includes:

Obtaining a data model of the data to be stored;

The data model is sent to a data storage system to enable the data storage system to define a database model based on the data model.

Referring to FIG. 3, this embodiment provides another data query method, and the process of the method is specifically as follows:

301: Acquire a data query script from an application server;

Optionally, the data query script includes a data query statement and a result analysis statement.

Optionally, the result analysis statement includes: a result screening statement, a result sorting statement, or a result operation statement, or any combination of the above.

Optionally, obtaining a data query script from the application server, including:

Obtaining a middleware based data query script distributed from a data query script from an application server;

Feedback of the data query results to the application server includes:

The data query results are fed back to the application server through the middleware.

302: executing a data query script to obtain a data query result;

303: Feed the data query result to the application server.

Optionally, the method further includes:

Receiving a data model sent by the application server;

Define a database model based on the data model;

Establish an association between the database model and the application server.

Optionally, establishing an association between the database model and the application server, including:

Publish the database model to the application server, and/or determine the interface configuration parameters of the database model and publish the interface configuration parameters to the application server.

Referring to FIG. 4, this embodiment provides another data query method, and the process flow is as follows:

401: Obtain a data query script from an application server;

402: Determine one or more database servers that execute the data query script;

403: Distribute the data query script to the database server;

404: Obtain a data query result fed back by the database server, and send the data query result to the application server.

Beneficial effects:

Obtaining a data query request, generating a data query script according to the data query request; sending the data query script to the data storage system; receiving the result obtained by the data storage system executing the data query script, so that only the data query script is sent to the data storage system, and the data storage is performed. The system can obtain the final result according to the data query script, reduce the number of accesses with the data storage system, and improve the efficiency of data query.

In combination with the above implementation environment, the present application provides a data query method. The method provided by the present application can be applied to various services, especially application scenarios with complex query requirements in data-intensive applications, which can break the database access bottleneck and solve the computationally intensive real-time database access problem.

For a clearer and more explicit description of the data display method provided in this embodiment, the following specific scenarios are taken as an example in the following embodiments. For other scenarios, refer to the implementation manner of the following scenarios.

Specific scenario: In a chat application, the terminal queries the contact information of the last conversation through a structured query language, and the data storage system is a database server.

Among them, structured query language is a special purpose programming language, which is a database query and programming language for accessing data and querying, updating and managing relational database systems.

After receiving the data query script, the database server loads the script through a separately isolated thread of the backend, and after the data query script is given the database permission, the data query script is executed in a certain order. The data query script can access the database on the database server, process the data, and when the data processing is completed, the notification returns the processing result.

In addition, there are various implementations of the database server in this scenario. In this embodiment, only the Node server and the database server composed of the mongoDB database engine are taken as an example for description. Specifically, the database server receives the data query script in the form of javascript, dynamically loads the script, and queries the database according to the description of the data query script.

Among them, the Node server is an open source cross-platform running environment written in javascript, using Google's V8 engine to execute code. Since javascript itself is a scripting language, it can dynamically load script fragments for execution and execute scripts at runtime. to modify.

mongoDB is written in C++ and is an open source database system based on distributed file storage. In the case of high load, you can extend the server to ensure concurrent performance by adding more nodes. MongoDB stores the data as a document, and the data structure is composed of key-value pairs (key=>value) (keyword=>value). . The mongoDB documentation is similar to the JSON (JavaScript Object Notation, Lightweight Data Interchange Format) object. Field values can contain other documents, arrays, and document arrays.

FIG. 5 provides a data query method for the above scenario, and the process flow is as follows:

501: The application server acquires a data model of data to be stored.

When the application is designed, it defines the data structure to be stored to form a data model. In this step, The application server acquires a data model of the data to be stored.

E.g:

Application design: The data to be stored is {title:'blog',by:'user',content:'hello world'}, then the data model is {blogData:{title:'String',by:'String' ,content:'String'}}.

The application server obtains {blogData:{title:'String',by:'String',content:'String'}}.

502: The application server sends the data model to the database server.

The data model obtained in step 501 needs to be known by the database server, so that the database server establishes a corresponding database. Therefore, the application server sends the data model obtained in step 501 to the database server.

This embodiment does not limit the specific method in which the application server sends the data model to the database server. For example: Send a data model to the database server by attaching a script.

503: The database server receives the data model sent by the application server, and defines a database model according to the data model;

Since the data model sent by the application server is the data model of the data to be stored, and the data to be stored is finally stored in the database of the database server, the database server defines the database model according to the data model to store the data to be stored.

For example, the database server defines a database model based on a data model, and each database model corresponds to a table in mongoDB.

In addition, as the database server stores more data, the database model is also more complicated. In order to facilitate the database server to manage the database model, the database server may also include a database model manager specifically for storing the database model in the database server.

For example, in the mongoDB implementation, the database model is similar to a JSON string object. In the same mongoDB library, create a database model manager to uniformly find or manage the database model in the mongoDB library.

By performing steps 501 to 503, the database server establishes a database matching the data to be stored, and the database model of the database is the same as the data model of the data to be stored.

Steps 501 to 503 can be performed in other cases, except when the data query method provided in this embodiment is executed for the first time. For example, when the application server detects that the data model of the data to be stored changes, step 501 to step 503 are triggered. For another example, when the database server detects that the database model does not match the data model of the data to be stored, step 501 to step 503 are triggered. This embodiment does not limit the specific triggering conditions of step 501 to step 503.

504: The database server establishes an association relationship between the database model and the application server.

Specific implementations of this step include, but are not limited to, the following three types.

The first implementation manner: the database server issues a database model to the application server;

Specifically, the database server may directly issue a database model to the application server, or may issue an identifier of the database model to the application server.

The identifier of the database model includes, but is not limited to, the name of the database model.

The second implementation manner: the database server determines the interface configuration parameter of the database model, and publishes the interface configuration parameter to the application server;

The database server defines the interface configuration parameters of the database model, and the data query script generated by the application server can be configured to access the database through the interface configuration parameter and the database model corresponding to the database model.

The interface configuration parameter can be a public variable.

In addition, the interface configuration parameters defined by the database server vary with the implementation. E.g:

If the database access operation contains basic creation, deletion, update, insertion and query, these operations are defined by the original operation instructions of mongoDB. When the application server is programmed, these pre-made scripts can be written like the local program to achieve the permission on the database server. The effect of database analysis and calculations. Therefore, the database server must define interface configuration parameters for the following interfaces for the script:

1) Database connection interface, including the creation, deletion, insertion, update and query functions of documents in the database, providing an access interface of the data model;

2) The basic javascript base library interface provides the runtime environment for basic data analysis such as calculation and filtering of data.

3) Provide an interface for returning, exit the script and return the processed data by calling the callback function of the return interface.

The third implementation manner: the database server issues a database model to the application server, and the database server determines interface configuration parameters of the database model, and issues interface configuration parameters to the application server.

505: The application server acquires a database model and/or an interface configuration parameter from the data storage system.

After the application server obtains the database model and/or interface configuration parameters, the database model and/or interface configuration parameters may be connected to the database corresponding to the database model, and the database is accessed and operated based on the connection.

For example, the application server obtains the corresponding database connection by using the database model identifier, and the database table is Read and write.

Through this step, different database models and/or interface configuration parameters can be connected to the database corresponding to the corresponding database model, and the corresponding database can be accessed and operated based on the connection, thereby implementing separate control of the database and separate operation of the database. Control to improve concurrency efficiency.

At this point, a database connection is established between the application server and the database server. Based on the connection, the application server can access the corresponding database and operate on the data in the database.

506: After the terminal initiates the query request, the application server obtains the data query request, and generates a data query script according to the data query request.

Specifically, the application server generates a data query script according to the database model and/or interface configuration parameters from the data storage system acquired in step 505.

The data query script includes but is not limited to: a data query statement and a result analysis statement. The result analysis statement includes but is not limited to: a result screening statement, a result sorting statement, or a result operation statement, or any combination of the above.

For example, the application server generates a data query script according to the database model and/or interface configuration parameters from the data storage system acquired in step 505, and forms the following data query script:

1) Query all contacts who talk to the terminal;

2) Find the last message in conversation with each contact;

3) Sorting the last message of each contact conversation in chronological order, and determining the last contact with the terminal;

4) Query the information of the last contact with the terminal.

Among them, 1), 2), 4) are data query statements, and 3) are result analysis statements.

It should be noted that the above script is only an example. In actual applications, the script content, the script form, and the language used by the script can be adaptively changed. This embodiment does not limit the specific script content, form, and usage language.

507: The application server sends the data query script to the database server;

For example, the application server sends a data query script to the database server using a structured query language.

508: After obtaining the data query script from the application server, the database server executes the data query script, obtains the data query result, and feeds back the data query result to the application server;

The data query script includes but is not limited to: a data query statement and a result analysis statement. The result analysis statement includes but is not limited to: a result screening statement, a result sorting statement, or a result operation statement, or any combination of the above.

For example, the database server first queries all contacts that talk to the terminal; then finds the last message in conversation with each contact; then sorts the last message of each contact conversation in chronological order, determining the final The contact with the terminal; finally the information of the last contact with the user.

In addition, in the query, if the database server not only stores data but also caches part of the data, the process of querying the data can also be implemented as follows:

First, it is judged whether or not there is cache related data. If the cache has been cached and the cache has not expired, the cached data is obtained, thereby saving database access.

For example, when querying all contacts in a conversation with the terminal, it is first determined whether or not there is relevant data for all contacts that are in a conversation with the terminal. If the cache has been cached and the cache has not expired, the cached data is obtained.

In the specific execution of the data query script, the database server can support dynamic loading of language or library classes. In javascript, it supports the use of eval to dynamically load data query scripts, while java also supports loader query scripts in class loader mode, but needs to be performed. Precompiled.

The database server of different languages and frameworks is dynamically loaded. The Node server used in this embodiment has a mechanism for loading dynamic modules. In the input, the application server only needs to write the data query script as a text file and send it to the database server. After the database server receives it, it is loaded as a module.

In addition, in order to ensure the security of the data query script, the database server script must be verified before the script is loaded to prevent dangerous code injection.

509: The application server receives the result obtained by the database server executing the data query script.

By performing the above nine steps, not only the data running function is placed on the database server, but the provider of the data analysis code is still placed on the database server. At the same time, the database server executes the data query script instead of the general query language, thereby optimizing the data access process and reducing the frequent network communication with the database server. In this way, data analysis and filtering operations can be performed simultaneously while the database server is running and the operation results can be flexibly given.

For a more detailed explanation of the data query method provided by this embodiment, referring to FIG. 6, the overall process of the method is: 1) application server application deployment; 2) application server application initialization; 3) application server definition data model; 4) application The server confirms whether there is a data model in the database server, if it does not exist, executes 5), if it exists, executes 6); 5) the application server sends the data model to the database server side; 6) the application server acquires the configuration from the database server, The configuration includes, but is not limited to, a database model and/or interface configuration parameters; 7) the application server sends a data query script to the database server; 8) the application server determines whether the query is finished, if it is finished, executes 9), and if not, executes 7 ); 9) Application server output results.

The above method directly puts part of the data analysis and processing operations on the database server, solves the problem that the database access query in the database server is inconvenient, and expands the execution mode of the database operation.

Further, in order to more clearly illustrate the advantages of the data query method provided by this embodiment, the implementation flow of the existing data query method is compared with the implementation flow of the data query method provided by this embodiment.

Referring to FIG. 7, the implementation process of the existing data query method is as follows: 1) the terminal sends a query request to the application server; 2) the application server processes the query request; 3) the application server sends a data request to the database server according to the query request; 4) The database server parses the data request, determines the query content; 5) the database server performs the query based on the memory; 6) the memory performs the database access to obtain the query data; 7) the memory returns the data to the database server; 8) the database server returns the data to the application server; 9) The application server analyzes the returned data; 10) the application server sends the data request to the database server again according to the analysis result; 11) the database server parses the data request, determines the query content; 12) the database server performs the query based on the memory; 13) the memory performs the database access Query data; 14) the memory returns data to the database server; 15) the database server returns data to the application server; 16) the application server analyzes the returned data to obtain the final result; 17) the application server returns the final result to the terminal.

Referring to FIG. 8, the implementation process of the data query method provided by this embodiment is as follows: 1) the terminal sends a service request to the application server; 2) the application server processes the service request; 3) the application server constructs the data query script; 4) the application server The database server sends the data query script; 5) the database server loads the data query script; 6) the database server executes the data query script; 7) the memory performs the database access to obtain the query data; 8) the memory returns the data to the database server; 9) the database server according to the memory The returned data is analyzed for data; 10) the database server executes the query again based on the memory; 11) the memory performs database access to obtain the query data; 12) the memory returns data to the database server; 13) the database server returns data to the application server; 14) the application server Analyze the returned data to get the final result; 15) The application server returns the final result to the terminal.

The definition of the relationship between data often depends on the implementation of the database itself. For example: the find statement in mongoDB, and some operators of and or or, these operators can only perform simple operations, and can not support complex data filtering or operations.

For the above reasons, for complex data filtering, the existing implementation process can only be implemented in the application server, obtain a rough result by querying the database, and then return to the application server program to run the screening or analysis processing, and finally according to the running result. Perform the next query operation.

The data query method proposed in this embodiment directly sends the data query script as part of the query request to the data server, and the database server executes the data query script to query from the database and calculate the final data to be returned to the application server. In terms of the application server, the developer only needs to implement the preparation data query script and query Dynamically modify these data query scripts when they occur, and send them to the database server through the database query port. The database server directly returns the results of the data query script execution, thereby avoiding frequent network access problems. For a system distributed remotely, it saves a lot of network communication delay time and alleviates the computing pressure of the local application server in processing the query results returned by the network.

In data analysis-intensive applications, using this solution can significantly reduce the number of network requests, thereby saving communication time between the application server and the database server. Significantly reduces the time it takes for the application server to access the database server. Dynamically building data query scripts also increases the flexibility of database server usage.

Beneficial effects:

Obtaining a data query request, generating a data query script according to the data query request; sending the data query script to the data storage system; receiving the result obtained by the data storage system executing the data query script, so that only the data query script is sent to the data storage system, and the data storage is performed. The system can obtain the final result according to the data query script, reduce the number of accesses with the data storage system, and improve the efficiency of data query.

When the data query concurrent situation increases, the data storage system's own concurrency capability can be utilized to improve data query efficiency.

The embodiment does not limit the specific implementation manner of the data storage system concurrency. For example, the data storage system is composed of middleware and a database server, and the data query script is distributed by the middleware to implement concurrent execution of the data storage system.

When the middleware distributes the data query script, because the frequency of reading the database and the hard disk access in the data-intensive application is much larger than the write database, the data query script is split by the middleware to optimize the data query sequence, thereby optimizing the database access process. , reduce the number of readings and reading range of the database, optimize the operation efficiency. When querying the database distributed on different database servers, through the splitting of the data query script, you can make full use of the CPU of different database servers to perform operations and return the running results uniformly. The implementation process of this method can be seen in Figure 9. Example.

The embodiment shown in FIG. 9 is exemplified by the following specific scenarios. For other scenarios, refer to the implementation of the following scenarios.

Specific scenario: In a chat application, the user queries the contact information that is finally in conversation with himself through the structured query language. The data storage system consists of middleware and one or more database servers.

Referring to Figure 9, the process of the method is as follows:

901: The application server acquires a data model of data to be stored.

The implementation of this step is the same as that of step 501. For details, refer to step 501, and details are not described herein again.

902: The application server sends the data model to the database server.

The implementation of this step is the same as that of step 502. For details, refer to step 502, and details are not described herein again.

903: The database server receives the data model sent by the application server, and defines a database model according to the data model.

The database server can directly receive the data model sent by the application server, or receive the data model sent by the application server through the middleware.

By performing steps 901 to 903, the database server establishes a database matching the data to be stored, and the database model of the database is the same as the data model of the data to be stored.

Steps 901 to 903 can be performed in other cases, except when the data query method provided in this embodiment is executed for the first time. For example, when the application server detects that the data model of the data to be stored changes, step 901 to step 903 are triggered. For example, when the database server detects that the database model does not match the data model of the data to be stored, step 901 to step 903 are triggered. This embodiment does not limit the specific trigger conditions for performing steps 901 to 903.

904: The database server establishes an association relationship between the database model and the application server.

Specific implementations of this step include, but are not limited to, the following three types.

The first implementation manner: the database server issues a database model to the application server;

The second implementation manner: the database server determines the interface configuration parameter of the database model, and publishes the interface configuration parameter to the application server;

The third implementation manner: the database server issues a database model to the application server, and the database server determines interface configuration parameters of the database model, and issues interface configuration parameters to the application server.

The database server may directly publish the database model to the application server, or may publish the database model to the application server through the middleware. The database server can directly publish interface configuration parameters to the application server, and can also publish interface configuration parameters to the application server through the middleware.

905: The application server acquires a database model and/or an interface configuration parameter from the data storage system.

The application server can directly obtain the database model and/or interface configuration parameters from the data storage system, and can also obtain the database model and/or interface configuration parameters from the data storage system through the middleware.

906: After the terminal initiates the query request, the application server obtains a data query request, and generates a data query script according to the data query request.

The implementation of this step is the same as that of step 506. For details, refer to step 506, and details are not described herein again.

907: The application server sends the data query script to the middleware;

908: The middleware acquires a data query script from the application server, and after determining one or more database servers that execute the data query script, distributes the data query script to the database server;

Specifically, the middleware can obtain the data stored by each database server, select a database server that executes the data query script, and distribute a data query script to each selected database server.

For example, the data query script is: query all voice contacts that talk to the user's voice and all text messages that are in conversation with the user's text message.

If there are two database servers storing voice call data, the database server 11 and the database server 12, wherein the database server 11 stores the voice contacts of the user 0-100, and the database server 12 stores the voice contacts of the user 100-200. people. There are two database servers for storing voice call data, a database server 21 and a database server 22, wherein the database server 21 stores the short message contacts of the user 0-100, and the database server 22 stores the short message contacts of the user 100-200. .

This step distributes the data query script to the database server 11, database server 12, database server 21, and database server 22. That is, a data query script is sent to the database server 11, a data query script is sent to the database server 12, a data query script is sent to the database server 21, and a data query script is sent to the database server 22.

909: The database server obtains the data query script distributed by the middleware based on the data query script from the application server, executes the distributed data query script, obtains the data query result, and feeds back the data query result to the middleware;

The database server can determine which parts of the data query script are executable by the database server based on the data it stores, and which parts do not need to be executed. After the database server obtains the data query script distributed by the middleware based on the data query script from the application server, it executes the part of the distributed data query script that it thinks needs to be executed.

The data query script is as follows: Query the voice conversation with the user and all the contacts who talk to the user SMS.

The database server 11, which stores the voice contacts of the user number 0-100, can therefore perform a voice contact number 0-100 that queries the user's voice conversation. The database server 11 executes only in the voice contact number 0-100, queries the language contact part of the conversation with the user voice, does not execute in the voice contact number 101-200, queries the voice contact part of the conversation with the user voice and the query All SMS contact sections that are in conversation with the user's text message. After obtaining the data query result for the voice contact number 0-100, the data query result is fed back to the middleware.

The database server 12 stores the voice contacts of the user number 101-200, so that it can execute the query Voice contact number 101-200 in conversation with the user voice. The database server 12 executes only in the voice contact number 101-200, queries the language contact part of the conversation with the user voice, does not execute in the voice contact number 0-100, queries the voice contact part of the conversation with the user voice and the query All SMS contact sections that are in conversation with the user's text message. After obtaining the data query result for the voice contact number 101-200, the data query result is fed back to the middleware.

The database server 21 stores the short message contacts of the user 0-100, so that it can execute the SMS-number 0-100 contact that queries the user's short message. The database server 11 executes only the short message contact in the 0-100 number, queries the short message contact part of the short message conversation with the user, does not execute in the short message contact number 101-200, and queries the short message contact part of the short message conversation with the user and the query. All voice contact sections that talk to the user's voice. After obtaining the data query result for the SMS contact number 0-100, the data query result is fed back to the middleware.

The database server 22 stores the short message contacts of the user No. 101-200, and therefore, it can execute the short message contacts No. 101-200 for inquiring the short message with the user. The database server 22 only executes the short message contact part in the short message contact number 101-200, and queries the short message contact part of the short message conversation with the user, does not execute the short message contact part in the 0-100 number, and queries the short message contact part of the short message conversation with the user and the query. All voice contact sections that talk to the user's voice. After obtaining the data query result for the short message contact number 101-200, the data query result is fed back to the middleware.

During the query, if the database server not only stores data but also caches part of the data, the process of querying the data may first determine whether it has cached related data, and if the cache has been cached, and the cache has not expired, the cached data is obtained, thereby obtaining the cached data. Save database access.

910: The middleware obtains the data query result fed back by the database server, and sends the data query result to the application server;

Since the database server executes the relevant part of the data query script, the middleware of the step obtains the data query result fed back by each database server, summarizes the data query results, and sends the summarized result to the application server.

The specific way of summarizing can be the superposition of the data query results fed back by each database server.

For example, the middleware obtains the data query result for the voice contact number 0-100 fed back by the database server 11, the data query result for the voice contact of the number 101-200 fed back by the database server 12, and the feedback from the database server 21 for 0-100. After the data query result of the SMS contact, and the data query result reported by the database server 22 for the SMS contact number 101-200, the above four results are superimposed together to obtain the data query result of the voice contact 0-200 and The data query result of the SMS contact number 0-200 sends the data query result of the voice contact 0-200 and the data query result of the voice contact 0-200 to the application server.

911: The application server receives the result of the middleware transmission.

In order to more clearly illustrate the advantages of the data query method provided by this embodiment, the data query method provided in this embodiment will be described again. Referring to FIG. 10, 1) the terminal sends a service request to the application server; 2) the application server processes the service request; 3) the application server sends a configuration query request to the middleware; 4) the middleware query configuration, and returns the query configuration, the configuration Including but not limited to database model and/or interface configuration parameters; 5) application server builds data query script according to the configuration; 6) application server sends data query script to middleware; 7) middleware distributes data query script; 8) distributes to The database server of the data query script executes the query based on the data query script; 9) the database server returns the execution result to the middleware; 10) the database server summarizes the execution result and returns the summarized result to the application server; 11) the application server analyzes the returned summary result, The final result is obtained; 15) the application server returns the final result to the terminal.

By executing the dynamic data query script, the required results can be searched more accurately and intelligently in the database. After the database is split, the burden of the database server can also be reduced by distributing the operations in different databases.

Beneficial effects:

Obtaining a data query request, generating a data query script according to the data query request; sending the data query script to the data storage system; receiving the result obtained by the data storage system executing the data query script, so that only the data query script is sent to the data storage system, and the data storage is performed. The system can obtain the final result according to the data query script, reduce the number of accesses with the data storage system, and improve the efficiency of data query.

Based on the same inventive concept, the embodiment provides an application server. The principle of the application server is similar to the data query method shown in FIG. 2, so the implementation of the application server can refer to the method shown in FIG. The embodiments are not repeated here.

Referring to Figure 11, the application server includes:

The first obtaining module 1101 is configured to obtain a data query request.

a generating module 1102, configured to generate a data query script according to the data query request acquired by the first obtaining module 1101;

The first sending module 1103 is configured to send the data query script generated by the generating module 1102 to the data storage system;

The receiving module 1104 is configured to receive a result obtained by the data storage system executing the data query script sent by the first sending module 1103.

Optionally, the data query script includes a data query statement and a result analysis statement.

Optionally, the result analysis statement includes: a result screening statement, a result sorting statement, or a result operation statement, or Any combination of the above.

Optionally, the generating module 1102 is configured to obtain a database model and/or an interface configuration parameter from the data storage system, and generate a data query script according to the database model and/or the interface configuration parameter.

Referring to FIG. 12, the application server further includes:

a second obtaining module 1105, configured to acquire a data model of data to be stored;

The second sending module 1106 is configured to send the data model acquired by the second obtaining module 1105 to the data storage system, so that the data storage system defines the database model according to the data model.

The benefits are as follows:

Obtaining a data query request, generating a data query script according to the data query request; sending the data query script to the data storage system; receiving the result obtained by the data storage system executing the data query script, so that only the data query script is sent to the data storage system, and the data storage is performed. The system can obtain the final result according to the data query script, reduce the number of accesses with the data storage system, and improve the efficiency of data query.

Based on the same inventive concept, the embodiment provides a database server. The principle of solving the problem is similar to the data query method shown in FIG. 3, so the implementation of the database server can be referred to the method shown in FIG. The embodiments are not repeated here.

Referring to Figure 13, the database server includes:

An obtaining module 1301, configured to acquire a data query script from an application server;

The execution module 1302 is configured to execute the data query script acquired by the obtaining module 1301 to obtain a data query result.

The feedback module 1303 is configured to feed back the data query result obtained by the execution module 1302 to the application server.

Optionally, the data query script includes a data query statement and a result analysis statement.

Optionally, the result analysis statement includes: a result screening statement, a result sorting statement, or a result operation statement, or any combination of the above.

Optionally, the obtaining module 1301 is configured to obtain a data query script that is distributed by the middleware based on a data query script from an application server.

The feedback module 1303 is configured to feed back the data query result to the application server by using the middleware.

Referring to Figure 14, the database server further includes:

The receiving module 1304 is configured to receive a data model sent by the application server.

a definition module 1305, configured to define a database model according to a data model received by the receiving module 1304;

The establishing module 1306 is configured to establish a relationship between the database model defined by the definition module 1305 and the application server. Linkage.

Optionally, the establishing module 1306 is configured to issue a database model to the application server, and/or determine interface configuration parameters of the database model, and issue interface configuration parameters to the application server.

The benefits are as follows:

After the application server generates the data query script according to the data query request, the data query script is executed, and the result obtained by the execution script is fed back to the application server, so that only the receiving application server sends the data query script, and the final result can be obtained according to the data query script. As a result, the number of accesses with the application server is reduced, and data query efficiency is improved.

Based on the same inventive concept, the present embodiment provides a middleware. Since the principle of solving the problem is similar to the data query method shown in FIG. 4, the implementation of the middleware can be referred to the method shown in FIG. The embodiments are not repeated here.

Referring to Figure 15, the middleware includes:

a first obtaining module 1501, configured to acquire a data query script from an application server;

a determining module 1502, configured to determine one or more database servers that execute the data query script acquired by the first obtaining module 1501;

The sending module 1503 is configured to distribute the data query script acquired by the first obtaining module 1502 to the database server;

a second obtaining module 1504, configured to obtain a data query result fed back by the database server;

The sending module 1505 is configured to send the data query result obtained by the second obtaining module 1504 to the application server.

The benefits are as follows:

After the middleware obtains the data query script generated by the application server according to the data query request, the data query script is distributed to the database server, so that the database server executes the distributed data query script, and the data query result returned by the database server is sent to the application server, so that only The application server needs to send a data query script to obtain data according to the data query script and analyze the data to obtain the result, thereby reducing the number of accesses with the application server and improving the data query efficiency.

Based on the same inventive concept, the present embodiment provides a data query system for performing the data query method provided by the embodiment shown in FIG. 5 or FIG. 6. Referring to FIG. 16, the system includes: an application server 1601 and data. Storage system 1602;

The application server 1601 is an application server as shown in FIG. 11 or FIG. 12;

The data storage system 1602 is composed of a database server as shown in FIG. 13 or FIG. 14, or the data storage system 1602 is composed of a database server as shown in FIG. 13 or FIG. 14 and a middleware as shown in FIG.

The benefits are as follows:

Obtaining a data query request, generating a data query script according to the data query request; sending the data query script to the data storage system; receiving the result obtained by the data storage system executing the data query script, so that only the data query script is sent to the data storage system, and the data storage is performed. The system can obtain the final result according to the data query script, reduce the number of accesses with the data storage system, and improve the efficiency of data query.

For convenience of description, the various parts of the above described devices are described in terms of functions divided into various modules or units. Of course, the functions of the various modules or units may be implemented in one or more software or hardware in the practice of the invention.

Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions are provided for implementing one or more processes and/or block diagrams in the flowchart The steps of a function specified in a box or multiple boxes.

While the preferred embodiment of the invention has been described, it will be understood that Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and the modifications and

Claims (25)

A data query method, the method comprising: Obtaining a data query request, and generating a data query script according to the data query request; Sending the data query script to a data storage system; Receiving a result obtained by the data storage system executing the data query script. The method according to claim 1, wherein the data query script includes a data query statement and a result analysis statement. The method according to claim 2, wherein the result analysis statement comprises: a result screening statement, a result sorting statement or a result operation statement, or any combination of the above. The method according to claim 1, wherein the generating a data query script according to the data query request comprises: Obtaining database model and/or interface configuration parameters from the data storage system, and generating a data query script based on the database model and/or interface configuration parameters. The method according to claim 1, wherein the method further comprises: Obtaining a data model of the data to be stored; The data model is sent to a data storage system such that the data storage system defines a database model based on the data model. An application server, wherein the application server comprises: a first obtaining module, configured to obtain a data query request; a generating module, configured to generate a data query script according to the data query request acquired by the first obtaining module; a first sending module, configured to send a data query script generated by the generating module to a data storage system; And a receiving module, configured to receive a result obtained by the data storage system executing a data query script sent by the first sending module. The application server according to claim 6, wherein the data query script includes a data query statement and a result analysis statement. The application server according to claim 7, wherein the result analysis statement comprises: a result screening statement, a result sorting statement, or a result operation statement, or any combination of the above. The application server according to claim 6, wherein the generating module is configured to acquire a database model and/or an interface configuration parameter from a data storage system, and generate a data query according to the database model and/or interface configuration parameters. script. The application server according to claim 6, wherein the application server further comprises: a second acquiring module, configured to acquire a data model of data to be stored; And a second sending module, configured to send the data model acquired by the second acquiring module to the data storage system, so that the data storage system defines the database model according to the data model. A data query method, the method comprising: Get the data query script from the application server; Executing the data query script to obtain a data query result; The data query result is fed back to the application server. The method according to claim 11, wherein the data query script includes a data query statement and a result analysis statement. The method according to claim 12, wherein the result analysis statement comprises: a result screening statement, a result sorting statement or a result operation statement, or any combination of the above. The method according to claim 11, wherein the obtaining the data query script from the application server comprises: Obtaining a middleware based data query script distributed from a data query script from an application server; The feeding back the data query result to the application server includes: The data query result is fed back to the application server by the middleware. The method according to any one of claims 11 to 14, wherein the method further comprises: Receiving a data model sent by the application server; Defining a database model based on the data model; Establishing an association relationship between the database model and the application server. The method according to claim 15, wherein the establishing an association relationship between the database model and the application server comprises: Publishing a database model to the application server, and/or determining interface configuration parameters of the database model, and publishing the interface configuration parameters to the application server. A database server, characterized in that the database server comprises: An obtaining module, configured to obtain a data query script from an application server; An execution module, configured to execute a data query script obtained by the obtaining module, to obtain a data query result; And a feedback module, configured to feed back the data query result obtained by the execution module to the application server. The database server according to claim 17, wherein the data query script includes a data query statement and a result analysis statement. The database server according to claim 18, wherein the result analysis statement comprises: a result screening statement, a result sorting statement, or a result operation statement, or any combination of the above. The database server according to claim 17, wherein the obtaining module is configured to acquire a data query script that the middleware distributes based on a data query script from an application server; The feedback module is configured to feed back the data query result to the application server by using the middleware. The database server according to any one of claims 17 to 20, wherein the database server further comprises: a receiving module, configured to receive a data model sent by the application server; a definition module, configured to define a database model according to a data model received by the receiving module; And establishing a module, configured to establish an association relationship between the database model defined by the definition module and the application server. The database server according to claim 21, wherein the establishing module is configured to issue a database model to the application server, and/or determine interface configuration parameters of the database model, and issue the configuration parameters to the application server. The interface configuration parameter. A data query method, the method comprising: Get the data query script from the application server; Determining one or more database servers executing the data query script; Distributing the data query script to the database server; Obtaining a data query result fed back by the database server, and sending the data query result to the application server. A middleware, wherein the middleware comprises: a first obtaining module, configured to acquire a data query script from an application server; a determining module, configured to determine one or more database servers that execute the data query script acquired by the first obtaining module; a sending module, configured to distribute the data query script acquired by the first acquiring module to the database server; a second obtaining module, configured to obtain a data query result fed back by the database server; And a sending module, configured to send the data query result obtained by the second acquiring module to the application server. A data query system, characterized in that the system comprises: an application server and a data storage system; The application server is the application server according to any one of claims 6 to 10; The data storage system consists of the database server according to claim 17, 18, 19, 21 or 22, or the data storage system is a database server according to any one of claims 17 to 22 and The intermediate member composition of claim 24.

Images