CN112882863A - Method, device and system for recovering data and electronic equipment - Google Patents
Method, device and system for recovering data and electronic equipment Download PDFInfo
- Publication number
- CN112882863A CN112882863A CN202110200087.7A CN202110200087A CN112882863A CN 112882863 A CN112882863 A CN 112882863A CN 202110200087 A CN202110200087 A CN 202110200087A CN 112882863 A CN112882863 A CN 112882863A
- Authority
- CN
- China
- Prior art keywords
- data
- storage space
- server
- target server
- data recovery
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1469—Backup restoration techniques
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Data Mining & Analysis (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present disclosure provides a method, an apparatus, a system and an electronic device for recovering data, which can be used in the cloud computing, financial field or other fields, the method includes: responding to a data recovery request from a client, and acquiring a data file to be recovered corresponding to the data recovery request; determining a first storage space of a target server required to be occupied by recovering a data file to be recovered, wherein the first storage space is larger than a second storage space actually occupied by the data file to be recovered at a server end; and if the remaining third storage space of the target server is larger than or equal to the first storage space, transmitting the data file to be restored to the target server so that the target server can restore the data.
Description
Technical Field
The present disclosure relates to the field of cloud computing technology and finance, in particular to the field of database technology, and more particularly, to a method, an apparatus, a system, and an electronic device for recovering data.
Background
A Database (Database) is a warehouse that organizes, stores and manages data according to a data structure, and as information technology and markets develop, data management is no longer just storing and managing data, but is converted into various data management ways required by users.
To detect defects in a software product to be commissioned prior to commissioning, the database of the production environment may be restored to the test environment for testing.
In implementing the disclosed concept, the applicant finds that at least the following problems exist in the related art, and database recovery involves a large number of servers in a test environment and needs to be performed frequently and periodically, such as manual operation by using a command line tool to log in each server, and problems are easily caused in the data recovery process, which results in failure of database recovery. In addition, the work efficiency is low.
Disclosure of Invention
In view of the above, the present disclosure provides a method, an apparatus, a system, and an electronic device for recovering data, which at least partially solve the problem of failure in database recovery or low work efficiency in the related art.
One aspect of the present disclosure provides a method for restoring data, performed by a server, including: responding to a data recovery request from a client, and acquiring a data file to be recovered corresponding to the data recovery request; determining a first storage space of a target server required to be occupied by recovering a data file to be recovered, wherein the first storage space is larger than a second storage space actually occupied by the data file to be recovered at a server end; and if the remaining third storage space of the target server is larger than or equal to the first storage space, transmitting the data file to be restored to the target server so that the target server can restore the data.
One aspect of the present disclosure provides a method of recovering data performed by a client, comprising: sending a data recovery request to a server side so that the server side can acquire a data file to be recovered corresponding to the data recovery request, determining that the data file to be recovered needs to occupy a first storage space of a target server, and if the remaining third storage space of the target server is larger than or equal to the first storage space, transmitting the data file to be recovered to the target server for data recovery, wherein the first storage space is larger than a second storage space actually occupied by the data file to be recovered at the server side; and receiving the data recovery execution result from the server side, and displaying the data recovery execution result.
One aspect of the present disclosure provides an apparatus for recovering data, disposed in a server, including: the device comprises a file acquisition module, a storage space determination module and a file transmission module. The file acquisition module is used for responding to a data recovery request from a client and acquiring a data file to be recovered corresponding to the data recovery request; the storage space determining module is used for determining a first storage space of a target server required to be occupied by recovering the data file to be recovered, and the first storage space is larger than a second storage space actually occupied by the data file to be recovered at the server end; and the file transmission module is used for transmitting the data file to be recovered to the target server if the remaining third storage space of the target server is greater than or equal to the first storage space, so that the target server can recover the data.
One aspect of the present disclosure provides an apparatus for restoring data, including: the device comprises a request sending module and a result receiving module. The request sending module is used for sending a data recovery request to the server so that the server can obtain a data file to be recovered corresponding to the data recovery request, and determine that the data file to be recovered needs to occupy a first storage space of a target server, if the remaining third storage space of the target server is larger than or equal to the first storage space, the data file to be recovered is transmitted to the target server so as to recover the data, wherein the first storage space is larger than a second storage space actually occupied by the data file to be recovered at the server; and the result receiving module is used for receiving the data recovery execution result from the server and displaying the data recovery execution result.
One aspect of the present disclosure provides a system for recovering data, comprising: the system comprises a file pulling module, a file query and judgment module and a data recovery job scheduling module. The file pulling module is used for maintaining an address and a path of a source server used for pulling the data file to be recovered and acquiring the data file to be recovered; the file query and judgment module is used for determining a first storage space of a target server required to be occupied for recovering the data file to be recovered, and comparing the first storage space with a third storage space, wherein the first storage space is larger than a second storage space actually occupied by the data file to be recovered at the server end, and the third storage space is the residual storage space of the target server; and the data recovery job scheduling module is used for performing data recovery based on the data recovery jobs included in the asynchronous queue if the third storage space is larger than or equal to the first storage space.
Another aspect of the present disclosure provides an electronic device comprising one or more processors and a storage device, wherein the storage device is configured to store executable instructions, which when executed by the processors, implement the method as above.
Another aspect of the present disclosure provides a computer-readable storage medium storing computer-executable instructions for implementing the method of restoring data as above when executed.
Another aspect of the disclosure provides a computer program comprising computer executable instructions for implementing a method of recovering data as above when executed.
According to the method, the device, the system and the electronic equipment for recovering data, the size of the storage space occupied by the target server for recovering the data file to be recovered can be automatically determined according to the size of the data file to be recovered, the database recovery is carried out only on the premise that the storage space is large enough, and the probability of data recovery failure is reduced. In addition, the size of the storage space occupied for recovering the data file to be recovered is proper, and the probability that the misjudgment target server cannot recover the data due to the fact that a higher threshold value of the storage space is set is reduced.
According to the method, the device, the system and the electronic equipment for recovering data, the session connected to the database is inquired and interrupted before data recovery is performed, and the probability of data recovery failure caused by 'lock table' is reduced.
According to the method, the device and the system for recovering data and the electronic equipment, a graphical management interface is provided, the data recovery parameters are displayed as options on a page, the parameters of data recovery operation can be stored as a template, repeated input at each time is avoided, and user experience is improved.
According to the method, the device and the system for recovering data and the electronic equipment, the data recovery operation is added to the task queue, so that the data recovery operation is executed in a non-blocking mode.
The method, the device, the system and the electronic equipment for recovering data provided by the embodiment of the disclosure effectively reduce the operation difficulty of the database, so that a user who does not receive professional operation training of the database can also complete data recovery work.
Drawings
The above and other objects, features and advantages of the present disclosure will become more apparent from the following description of embodiments of the present disclosure with reference to the accompanying drawings, in which:
fig. 1 schematically illustrates an application scenario of a method, an apparatus, a system and an electronic device for recovering data according to an embodiment of the present disclosure;
FIG. 2 schematically illustrates an exemplary system architecture of an apparatus for recovering data to which the method for recovering data may be applied, according to an embodiment of the present disclosure;
FIG. 3 schematically shows a flow chart of a method of recovering data according to an embodiment of the present disclosure;
FIG. 4 schematically illustrates a logic diagram for obtaining a data file to be restored according to an embodiment of the present disclosure;
FIG. 5 schematically illustrates a logic diagram for comparing a first memory space and a third memory space according to an embodiment of the disclosure;
FIG. 6 schematically illustrates a logic diagram for scheduling data recovery jobs according to an embodiment of the present disclosure;
FIG. 7 schematically illustrates a flow diagram of a method of recovering data according to another embodiment of the present disclosure;
FIG. 8 schematically shows a schematic view of an interactive interface according to an embodiment of the present disclosure;
FIG. 9 schematically illustrates a block diagram of an apparatus for recovering data according to an embodiment of the present disclosure;
FIG. 10 schematically illustrates a block diagram of an apparatus for recovering data according to another embodiment of the present disclosure;
FIG. 11 schematically illustrates a block diagram of a system for recovering data according to an embodiment of the present disclosure; and
FIG. 12 schematically shows a block diagram of an electronic device according to an embodiment of the disclosure.
Detailed Description
Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood that the description is illustrative only and is not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present disclosure.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components. All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It is noted that the terms used herein should be interpreted as having a meaning that is consistent with the context of this specification and should not be interpreted in an idealized or overly formal sense.
Where a convention analogous to "A, B or at least one of C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B or C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.). The terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more features.
In the related art, an Oracle database is taken as an example, and an Oracle self-contained command line data recovery tool (such as a data pump) is used for data recovery. Although the data tool can complete the data recovery work, the applicant finds that the related art may have the following problems in implementing the embodiments of the present disclosure.
On one hand, only people who have received Oracle professional training can use the tool, and the tool using threshold is high.
On one hand, whether the storage space of the target server can meet the data recovery requirement cannot be determined, and if the storage space is insufficient, the data recovery will fail.
On one hand, whether the target database has the condition of the 'lock table' cannot be automatically judged, and if the 'lock table' causes data recovery failure.
On the one hand, the data recovery operation is not automated due to the lack of a graphical management interface.
On one hand, only a single server can be supported, and data recovery job scheduling cannot be simultaneously performed on a large number of servers.
The embodiment of the disclosure provides a method, a device and a system for recovering data and electronic equipment. The data recovery method comprises a storage space determining process and a data recovery process, and comprises the steps of firstly, responding to a data recovery request from a client, obtaining a data file to be recovered corresponding to the data recovery request, and then determining that the data file to be recovered needs to occupy a first storage space of a target server, wherein the first storage space is larger than a second storage space actually occupied by the data file to be recovered at the server. And entering a data recovery process after the storage space determination process is finished, and if the remaining third storage space of the target server is larger than or equal to the first storage space, transmitting the data file to be recovered to the target server so that the target server can recover the data.
The embodiment of the disclosure provides an automatic data recovery scheme aiming at the defects that a data recovery tool of a database is not robust enough, the data recovery tool is based on more command line parameters, only a single server can be operated each time, and operators need to be trained professionally and the like. In addition, submitted data recovery jobs are added to an asynchronous queue for management, and the jobs are executed in a non-blocking manner so as to support parallel processing of multiple servers and simultaneously support timed execution of the jobs. In addition, a graphical operation interface is provided, and common input parameters are stored as templates, so that people who do not receive Oracle professional training can complete data recovery work, and user experience is effectively improved.
Fig. 1 schematically illustrates an application scenario of a method, an apparatus, a system and an electronic device for recovering data according to an embodiment of the present disclosure.
As shown in fig. 1, a browser or the like at a client sends a Hypertext Transfer Protocol (HTTP) request to a Web (Web) server, the server analyzes the request after receiving the request, and then sends the request to a Web backend frame (server), the backend frame processes (such as database interaction, service processing, and the like) after receiving the request, and returns a response object message of the response request to the server after the processing is completed, and the server returns the received response object message to the browser at the client, so that the browser can display a page including the response object message.
A routing layer: and searching a corresponding processing program in the control layer according to the request address.
A control layer: the method is mainly used for receiving the request, processing the service logic, returning the response object message, and performing interactive scheduling with the view layer and the model layer. It should be noted that, in the embodiment of the present disclosure, the main service logic is implemented at the control layer, and for example, the method includes: the method comprises the steps of obtaining a data file to be recovered corresponding to a data recovery request, determining that the first storage space of a target server is occupied for recovering the data file to be recovered, transmitting the data file to be recovered to the target server when the third storage space is larger than or equal to the first storage space, adding data recovery operation in a task queue, setting operation parameters and the like.
A model layer: the method mainly comprises the steps of interacting the database, and performing operations of adding, deleting, modifying, searching and the like on data in the database.
Viewing the image layer: and compiling hypertext markup language (html), Cascading Style Sheets (css) and JavaScript (js) codes so that the client can display the programs through a webpage.
Fig. 2 schematically shows an exemplary system architecture of a method of restoring data, an apparatus for restoring data, according to an embodiment of the present disclosure. It should be noted that fig. 2 is only an example of a system architecture to which the embodiments of the present disclosure may be applied to help those skilled in the art understand the technical content of the present disclosure, and does not mean that the embodiments of the present disclosure may not be applied to other devices, systems, environments or scenarios. It should be noted that the method, the apparatus, the system, and the electronic device for recovering data provided by the embodiment of the present disclosure may be used in cloud computing in the relevant aspects of recovering data, and may also be used in various fields other than cloud computing, such as the financial field, and the like.
As shown in fig. 2, the system architecture 200 according to this embodiment may include terminal devices 201, 202, 203, a network 204 and a server 205. The network 204 may include a plurality of gateways, routers, hubs, network wires, etc. to provide a medium for communication links between the end devices 201, 202, 203 and the server 205. Network 204 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.
The user may use the terminal devices 201, 202, and 203 to interact with other terminal devices and the server 205 through the network 204 to receive or send information, such as uploading parameter values, sending data recovery requests, receiving data recovery execution results, and the like. The terminal devices 201, 202, 203 may be installed with various communication client applications, such as database-type applications, bank-type applications, e-commerce-type applications, web browser applications, search-type applications, office-type applications, instant messaging tools, mailbox clients, social platform software, etc. (just examples).
The terminal devices 201, 202, 203 include, but are not limited to, electronic devices that can support functions such as interface calls, such as smart phones, desktop computers, augmented reality devices, tablet computers, laptop computers, and the like. Data graphical processing software/plug-ins and the like can be downloaded on the terminal device so as to generate graphical reports.
The server 205 may receive a request to restore data, or the like, and process the request. For example, the server 205 may be a back office management server, a cluster of servers, or the like. The background management server can analyze and process the received service request, information request and the like, and feed back processing results (such as database recovery results, abnormal prompts and the like) to the terminal equipment.
It should be noted that the method for recovering data provided by the embodiment of the present disclosure may be executed by the terminal device 201, 202, 203 or the server 205. Accordingly, the apparatus for recovering data provided by the embodiments of the present disclosure may be disposed in the terminal device 201, 202, 203 or the server 205. It should be understood that the number of terminal devices, networks, and servers are merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.
FIG. 3 schematically shows a flow chart of a method of recovering data according to an embodiment of the present disclosure. As shown in fig. 3, the method for restoring data performed by the server may include operations S302 to S306.
In operation S302, in response to a data recovery request from a client, a data file to be recovered corresponding to the data recovery request is acquired.
In this embodiment, the data recovery request may include a storage space identifier where the data file to be recovered is located, an IP address of the data server, a file storage path, a time requirement for acquiring the data file to be recovered, and the like.
It should be noted that the server may obtain the data file to be restored from the source server based on the data restoration request and store the data file locally, which is helpful to improve the data restoration efficiency. In addition, when data recovery is performed, the data to be recovered may be recovered from the source server to the target server based on the data recovery request, which is not limited herein.
The data file to be restored may be stored in one source server or may be stored in a plurality of source servers.
In one embodiment, the data recovery request includes an internet protocol address, a user identification, and authentication information corresponding to the user identification.
Accordingly, obtaining the data file to be restored corresponding to the data restoration request may include the following operations: firstly, determining a source server set and a storage path of a data file to be restored stored by each source server in the source server set based on an internet protocol address. And then, acquiring the data file to be recovered from the storage path based on the user identification corresponding to the internet protocol address and the authentication information corresponding to the user identification. The authentication information corresponding to the user identifier includes but is not limited to: passwords, biometrics, preset passwords, etc.
In one embodiment, the method may further include the operation of determining a target server subset including at least one target server, so as to perform data recovery on at least some target servers in the target server subset respectively by traversing the target server subset.
FIG. 4 schematically illustrates a logic diagram for obtaining a data file to be restored according to an embodiment of the present disclosure.
As shown in fig. 4, a server list of target servers that need to perform data recovery, a storage path of a data file to be recovered, and corresponding file names are maintained, and the target servers are defined as a target server group, so that data recovery operations are performed in batches in units of groups in the following. The source server address and path for pulling the Oracle dmp file is then maintained for obtaining the dmp file needed for data recovery. And circularly traversing the servers in the group, pulling the dmp files on the source server to the corresponding target servers one by one, counting the pulling results and displaying the pulling results on the page.
dmp is a file exported by the database for backing up the database, can be exported by an exp command, and can be imported by an imp command, i.e., to restore the data. The dmp file may include: fixed header, table declaration statement, table creation statement, insert statement, garbage, real data, garbage, and the like.
In operation S304, it is determined that a first storage space of the target server is occupied for recovering the to-be-recovered data file, where the first storage space is greater than a second storage space actually occupied by the to-be-recovered data file at the server side.
In this embodiment, in the process of recovering the data file to be recovered, index information, decompression processing, and the like for the data file to be recovered may be involved, which may cause that a first storage space required to recover the data file to be recovered is larger than a second storage space required to store the data file to be recovered. However, since different data files to be restored have their own characteristics, the threshold setting for the first storage space becomes an important element. For example, if the threshold of the first storage space is set too large, it may result in that a part of the first storage space occupies more storage space, but the data file to be restored, which may be originally subjected to data restoration, cannot be subjected to data restoration (for example, the storage space occupied by restoring the data file to be restored is slightly larger than the first storage space). If the threshold of the first storage space is set too small, it may result in failure of recovering part of the data to be recovered (the storage space required for data recovery is larger than the threshold of the first storage space).
Specifically, it may be determined by means of simulation, calculation, or based on expert experience, that the first storage space of the target server is occupied for recovering the data file to be recovered.
In one embodiment, the sum of the sizes of all data files to be restored (e.g., the dmp file of an Oracle database) for the target server is calculated, and the size of the first storage space should be no less than a specified multiple, e.g., 1.3 times, etc., of the sum of all data files to be restored (the data files are uncompressed). The specified multiple may be adjusted according to the usage effect, for example, the specified multiple may be adjusted to be 1.2 times or less, 1.4 times or more, and the like.
In one embodiment, after acquiring the data file to be restored corresponding to the data restoration request, the method may further include the following operation.
And sending a table space contraction instruction to the target server so as to control the target server to delete the existing data in the database by taking the user as a unit. The database stores historical data of a plurality of users, and the historical data can be useless in data recovery and occupy storage space. Thus, at least some of the user's existing data may be deleted. It should be noted that, part of the user basic information, the set parameters, and the like may be backed up before being deleted. Then, the data file in the table space corresponding to the deleted existing data is contracted to increase the third storage space. Since the database may be pre-allocated with storage space for different users or groups of users, although some of the users' existing data is deleted, the storage space occupied by the table space may not be reduced accordingly. Therefore, the occupied storage space in the target server can be reduced by shrinking the table space after deleting the data. The method is favorable for improving the probability of successful data recovery.
In an embodiment, to further improve the success rate of data recovery, before transmitting the data file to be recovered to the target server, the method may further include the following operations: and sending a process termination instruction to the target server so that the target server stops the listener of the database and terminates the process corresponding to the active session on the database connected to the target server.
Since a write operation to the database may not be possible when there are active processes. For example, to avoid "lock tables" or the inability to delete old database users due to active session connections with the database, the listener of the database may be terminated and the process of the active session to the database may be shut down. By stopping the listener of the database, it is possible to avoid a new session being established and then shutting down the process of the active session, it is possible to ensure that there is no active session for the database when data recovery is performed.
In operation S306, if the remaining third storage space of the target server is greater than or equal to the first storage space, the data file to be restored is transmitted to the target server, so that the target server performs data restoration.
In this embodiment, the file transfer may be performed in a point-to-point transfer manner, or may be performed in an asynchronous transfer manner.
In one embodiment, transmitting the data file to be restored to the target server may include the following operations.
First, data recovery parameters are obtained. For example, data recovery parameters are obtained from the data recovery request, including but not limited to at least one of: database name, database identification, IP address of the database, user name of the database, database password, data recovery script, and the like.
And then splicing the data recovery parameters to obtain data recovery operation.
And then, adding the data recovery job into the task queue so as to transmit the data file to be recovered to the target server by executing the data recovery job.
Fig. 5 schematically illustrates a logic diagram for comparing a first memory space and a third memory space according to an embodiment of the disclosure.
As shown in fig. 5, the sum of the sizes of all the data files to be restored (such as the dmp file of the Oracle database) for the target server is calculated, and compared with the remaining storage space of the file system (i.e. the target server) where the database table space is located, according to the empirical value of data restoration, the remaining space of the file system where the table space is located should be not less than 1.3 times of the sum of all the data files to be restored (the data files are not compressed).
FIG. 6 schematically illustrates a logic diagram for scheduling a data recovery job according to an embodiment of the present disclosure.
As shown in FIG. 6, data recovery jobs are managed using asynchronous queues. Receiving parameters from the client for use by the Oracle data pump, the parameters including but not limited to: the parameters are spliced into a command line character string according to the grammar requirement of the data pump, the data recovery operation is called by using the character string, the operation is put into an asynchronous queue to be scheduled and executed, and a front-end page does not need to be in a state of waiting for the completion of the operation for a long time.
For example, instructions to export a data backup dmp file may be as follows: the expression/password @ orcl file: \\ \ dataBak \ oracle.dmp log: \ log.txt full ═ y. The instructions to import a data backup dmp file may be as follows: imp user/password @ outline: \\ dataBak \ oracle.dmp log ═ e: \ log.txt ignore ═ y full ═ y.
In one embodiment, after obtaining the data recovery parameters, the method may further include an operation of generating a parameter template based on the data recovery parameters, the template identification of the parameter template being a primary key, so as to determine the data recovery parameters based on the primary key.
For example, the input parameters required for submitting the data recovery job each time are more, in order to avoid repeated input, the parameters input before are stored as a template, the name of the template is used as a main key for identification, and when the data recovery job is submitted subsequently, the parameter values can be automatically filled in the page according to the parameter template stored before, and the parameters can be modified according to the actual situation.
In one embodiment, the method may further include the operations of: and if the data file to be recovered corresponding to the data recovery request fails to be acquired, sending prompt information to the client.
For example, in the case that the server side fails to pull the data file to be recovered, a prompt message may be sent to the client side, so as to prompt that an event of the data recovery failure needs to be manually processed.
The embodiment of the disclosure can automatically judge the required storage space according to the size of the Oracle dmp file, and prompt in advance if the storage is insufficient, so as to avoid the condition of data recovery failure.
The embodiment of the disclosure automatically queries and interrupts the session connected to the database before starting data recovery, thereby avoiding data recovery failure caused by 'lock table'.
The embodiment of the disclosure brings the data recovery operation into the asynchronous queue for management, and the data recovery operation is executed in a non-blocking mode.
Another aspect of the present disclosure provides a method of recovering data performed by a client.
FIG. 7 schematically shows a flow diagram of a method of recovering data according to another embodiment of the present disclosure.
As shown in fig. 7, the method of restoring data performed by the client may include operations S702 to S704.
In operation S702, a data recovery request is sent to the server, so that the server obtains a to-be-recovered data file corresponding to the data recovery request, and determines that the to-be-recovered data file occupies a first storage space of the target server, and if a remaining third storage space of the target server is greater than or equal to the first storage space, the to-be-recovered data file is transmitted to the target server for data recovery, where the first storage space is greater than a second storage space actually occupied by the to-be-recovered data file at the server.
The data recovery request includes, but is not limited to: at least one of an internet protocol address, a user identifier and authentication information corresponding to the user identifier, so that the data file to be recovered can be conveniently obtained from the source server.
In addition, the data recovery request may also include a database recovery script, or the like.
FIG. 8 schematically shows a schematic view of an interactive interface according to an embodiment of the present disclosure.
As shown in fig. 8, data recovery of the Oracle database is taken as an example for illustration. The web page may display a database IP address component, a username component, a password component, a database recovery command component, and a prompt may be displayed in each component for user input. In addition, for example, task management is facilitated, and a task name component, a task type component and the like can be displayed on the interactive interface.
It should be noted that the interactive interface shown in fig. 8 is only an exemplary example, and should not be construed as a limitation to the present disclosure.
In operation S704, a data recovery execution result is received from the server side, and the data recovery execution result is presented.
In this embodiment, the data recovery execution result includes, but is not limited to: current progress, data recovery execution completion prompt, exception prompt and the like.
And the data recovery execution result can be displayed in a graphical interactive interface.
In an embodiment, after sending the data recovery request to the server, the method may further include the following operations: and receiving prompt information from the server, wherein the prompt information is generated after the server fails to acquire the data file to be recovered corresponding to the data recovery request.
According to the method for recovering data, the client side provides a Web-based graphical interface, the command line operation is changed into the automatic operation with the parameter capable of being stored, and batch implementation of data recovery operation after a large number of servers are grouped is supported.
The embodiment of the disclosure provides a graphical management interface, changes command line parameters into options on a page, and can save parameters of data recovery operation into a template, thereby avoiding repeated input each time.
The disclosed embodiments enable data recovery work to be accomplished even by persons who have not received Oracle professional training.
Another aspect of the present disclosure provides an apparatus for recovering data.
FIG. 9 schematically shows a block diagram of an apparatus for recovering data according to an embodiment of the present disclosure.
As shown in fig. 9, the apparatus 900 for recovering data is disposed in a server, and the apparatus 900 may include: a file acquisition module 910, a storage space determination module 920 and a file transmission module 930.
The file obtaining module 910 is configured to, in response to a data recovery request from a client, obtain a data file to be recovered corresponding to the data recovery request.
The storage space determining module 920 is configured to determine that a first storage space of the target server needs to be occupied for recovering the data file to be recovered, where the first storage space is greater than a second storage space actually occupied by the data file to be recovered at the server side.
The file transmission module 930 is configured to transmit the data file to be restored to the target server if the remaining third storage space of the target server is greater than or equal to the first storage space, so that the target server performs data restoration.
Fig. 10 schematically shows a block diagram of an apparatus for restoring data according to another embodiment of the present disclosure.
As shown in fig. 10, the apparatus 1000 for recovering data is disposed in a client, and the apparatus 1000 may include: a request sending module 1010 and a result receiving module 1020.
The request sending module 1010 is configured to send a data recovery request to a server, so that the server obtains a to-be-recovered data file corresponding to the data recovery request, and determines that the to-be-recovered data file occupies a first storage space of a target server, and if a remaining third storage space of the target server is greater than or equal to the first storage space, transmits the to-be-recovered data file to the target server for data recovery, where the first storage space is greater than a second storage space actually occupied by the to-be-recovered data file at the server.
The result receiving module 1020 is configured to receive a data recovery execution result from the server side, and display the data recovery execution result.
Another aspect of the present disclosure provides a system for recovering data.
FIG. 11 schematically shows a block diagram of a system for recovering data according to an embodiment of the present disclosure.
As shown in fig. 11, the system 1100 for recovering data may include: a file pull module 1110, a file query and determination module 1120, and a data recovery job scheduling module 1130.
The file pulling module 1110 is configured to maintain an address and a path of a source server used for pulling a data file to be restored, and acquire the data file to be restored.
The file query and judgment module 1120 is configured to determine that a first storage space of the target server is occupied for recovering the data file to be recovered, and compare the first storage space with a third storage space, where the first storage space is larger than a second storage space actually occupied by the data file to be recovered at the server side, and the third storage space is a remaining storage space of the target server.
The data recovery job scheduling module 1130 is configured to perform data recovery based on the data recovery jobs included in the asynchronous queue if the third storage space is greater than or equal to the first storage space. In particular, the data recovery job scheduling module 1130 implements core functionality for data recovery and manages data recovery jobs using asynchronous queues. Receiving parameters transmitted from a front end for an Oracle data pump, comprising: the user name, the password, the directory (directory) name, the full recovery identification, the table processing rule and the like are spliced into a command line character string according to the grammatical requirement of the data pump, the data recovery operation is called by using the character string, the operation is placed into an asynchronous queue to be scheduled and executed, and the front-end page does not need to be in a state of waiting for the completion of the operation for a long time.
In one embodiment, the system 1100 for recovering data may further include: a database session management module and a data recovery operation template management module.
In order to avoid the situation that the database has active session connection to cause 'table locking' or old database users cannot be deleted, the database session management module is used for stopping the listener of the database and stopping the process corresponding to the active session connected to the database.
The data recovery operation template management module stores the parameters input before as a template, the template name is used as a main key for identification, and parameter values can be automatically filled in a page according to the parameter template stored before when data recovery operation is submitted subsequently, so that the complexity of parameter input is reduced, and the user experience is improved.
The embodiment of the disclosure overcomes the defects that the existing Oracle data recovery tool is not robust enough, is based on more command line parameters, can only operate a single server each time, and requires professional training for operators, and provides an automatic data recovery method, which avoids data recovery failure by automatically judging the storage space required by data recovery and automatically disconnecting the session externally connected to a database. Submitted data recovery jobs are brought into an asynchronous queue for management, the jobs are executed in a non-blocking mode so as to support parallel processing of a plurality of servers, and meanwhile, the jobs are executed regularly. And a graphical operation interface is provided, and common input parameters are saved as templates, so that people who do not receive Oracle professional training can complete data recovery work.
It should be noted that the implementation, solved technical problems, implemented functions, and achieved technical effects of each module/unit and the like in the apparatus part embodiment are respectively the same as or similar to the implementation, solved technical problems, implemented functions, and achieved technical effects of each corresponding step in the method part embodiment, and are not described in detail herein.
Any of the modules, units, or at least part of the functionality of any of them according to embodiments of the present disclosure may be implemented in one module. Any one or more of the modules and units according to the embodiments of the present disclosure may be implemented by being split into a plurality of modules. Any one or more of the modules, units according to the embodiments of the present disclosure may be implemented at least partially as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented by any other reasonable means of hardware or firmware by integrating or packaging the circuits, or in any one of three implementations of software, hardware and firmware, or in any suitable combination of any of them. Alternatively, one or more of the modules, units according to embodiments of the present disclosure may be implemented at least partly as computer program modules, which, when executed, may perform the respective functions.
For example, any plurality of the file obtaining module 910, the storage space determining module 920 and the file transmitting module 930 may be combined into one module to be implemented, or any one of the modules may be split into a plurality of modules. Alternatively, at least part of the functionality of one or more of these modules may be combined with at least part of the functionality of the other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the file obtaining module 910, the storage space determining module 920 and the file transmitting module 930 may be implemented at least partially as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented by hardware or firmware in any other reasonable manner of integrating or packaging a circuit, or implemented by any one of three implementations of software, hardware and firmware, or any suitable combination of any of them. Alternatively, at least one of the file acquisition module 910, the storage space determination module 920 and the file transfer module 930 may be at least partially implemented as a computer program module, which when executed, may perform a corresponding function.
FIG. 12 schematically shows a block diagram of an electronic device according to an embodiment of the disclosure. The electronic device shown in fig. 12 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 12, an electronic apparatus 1200 according to an embodiment of the present disclosure includes a processor 1201, which can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)1202 or a program loaded from a storage section 1208 into a Random Access Memory (RAM) 1203. The processor 1201 may include, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or associated chipset, and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), among others. The processor 1201 may also include on-board memory for caching purposes. The processor 1201 may include a single processing unit or multiple processing units for performing the different actions of the method flows according to embodiments of the present disclosure.
In the RAM 1203, various programs and data necessary for the operation of the electronic apparatus 1200 are stored. The processor 1201, the ROM 1202, and the RAM 1203 are communicatively connected to each other by a bus 1204. The processor 1201 performs various operations of the method flow according to the embodiments of the present disclosure by executing programs in the ROM 1202 and/or the RAM 1203. Note that the programs may also be stored in one or more memories other than the ROM 1202 and the RAM 1203. The processor 1201 may also perform various operations of method flows according to embodiments of the present disclosure by executing programs stored in the one or more memories.
According to embodiments of the present disclosure, method flows according to embodiments of the present disclosure may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable storage medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 1209, and/or installed from the removable medium 1211. The computer program, when executed by the processor 1201, performs the above-described functions defined in the system of the embodiments of the present disclosure. The systems, devices, apparatuses, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the present disclosure.
The present disclosure also provides a computer-readable storage medium, which may be contained in the apparatus/device/system described in the above embodiments; or may exist separately and not be assembled into the device/apparatus/system. The computer-readable storage medium carries one or more programs which, when executed, implement the method according to an embodiment of the disclosure.
According to embodiments of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, which may include, for example but is not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. For example, according to embodiments of the present disclosure, a computer-readable storage medium may include the ROM 1202 and/or the RAM 1203 and/or one or more memories other than the ROM 1202 and the RAM 1203 described above.
Embodiments of the present disclosure also include a computer program product comprising a computer program containing program code for performing the method provided by the embodiments of the present disclosure, when the computer program product is run on an electronic device, the program code being adapted to cause the electronic device to carry out the method of restoring data provided by the embodiments of the present disclosure.
The computer program, when executed by the processor 1201, performs the above-described functions defined in the system/apparatus of the embodiments of the present disclosure. The systems, apparatuses, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the present disclosure.
In one embodiment, the computer program may be hosted on a tangible storage medium such as an optical storage device, a magnetic storage device, or the like. In another embodiment, the computer program may also be transmitted, distributed in the form of a signal on a network medium, downloaded and installed through the communication section 1209, and/or installed from the removable medium 1211. The computer program containing program code may be transmitted using any suitable network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.
In accordance with embodiments of the present disclosure, program code for executing computer programs provided by embodiments of the present disclosure may be written in any combination of one or more programming languages, and in particular, these computer programs may be implemented using high level procedural and/or object oriented programming languages, and/or assembly/machine languages. The programming language includes, but is not limited to, programming languages such as Java, C + +, python, the "C" language, or the like. The program code may execute entirely on the user computing device, partly on the user device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
Those skilled in the art will appreciate that various combinations and/or combinations of features recited in the various embodiments and/or claims of the present disclosure can be made, even if such combinations or combinations are not expressly recited in the present disclosure. These examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the embodiments are described separately above, this does not mean that the measures in the embodiments cannot be used in advantageous combination. The scope of the disclosure is defined by the appended claims and equivalents thereof. Various alternatives and modifications can be devised by those skilled in the art without departing from the scope of the present disclosure, and such alternatives and modifications are intended to be within the scope of the present disclosure.
Claims (14)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110200087.7A CN112882863A (en) | 2021-02-23 | 2021-02-23 | Method, device and system for recovering data and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110200087.7A CN112882863A (en) | 2021-02-23 | 2021-02-23 | Method, device and system for recovering data and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112882863A true CN112882863A (en) | 2021-06-01 |
Family
ID=76053757
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110200087.7A Pending CN112882863A (en) | 2021-02-23 | 2021-02-23 | Method, device and system for recovering data and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112882863A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113553216A (en) * | 2021-06-28 | 2021-10-26 | 北京百度网讯科技有限公司 | Data recovery method and device, electronic equipment and storage medium |
| CN114168285A (en) * | 2021-11-29 | 2022-03-11 | 平安壹账通云科技(深圳)有限公司 | A data recovery drill method, device, server and storage medium |
| CN114185715A (en) * | 2021-12-08 | 2022-03-15 | 浙江中控技术股份有限公司 | Method and device for data recovery |
| CN114816845A (en) * | 2022-04-06 | 2022-07-29 | 在线途游（北京）科技有限公司 | MongoDB-based rapid data rollback method and device |
| CN114942730A (en) * | 2022-07-25 | 2022-08-26 | 北京睿芯高通量科技有限公司 | Method and device for determining residual storage space and electronic equipment |
| CN116909816A (en) * | 2023-09-13 | 2023-10-20 | 腾讯科技（深圳）有限公司 | Database recovery method and device, storage medium and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120303588A1 (en) * | 2011-05-25 | 2012-11-29 | Wei Liu | Data de-duplication processing method for point-to-point transmission and system thereof |
| CN109669814A (en) * | 2018-12-10 | 2019-04-23 | 浪潮(北京)电子信息产业有限公司 | A kind of restoration methods of Metadata Service, device, equipment and readable storage medium storing program for executing |
| CN109815057A (en) * | 2019-01-25 | 2019-05-28 | 维沃移动通信有限公司 | A data backup method and mobile terminal |
| CN111373380A (en) * | 2018-07-12 | 2020-07-03 | 华为技术有限公司 | A data recovery method and terminal when a terminal restores factory settings |
-
2021
- 2021-02-23 CN CN202110200087.7A patent/CN112882863A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120303588A1 (en) * | 2011-05-25 | 2012-11-29 | Wei Liu | Data de-duplication processing method for point-to-point transmission and system thereof |
| CN111373380A (en) * | 2018-07-12 | 2020-07-03 | 华为技术有限公司 | A data recovery method and terminal when a terminal restores factory settings |
| CN109669814A (en) * | 2018-12-10 | 2019-04-23 | 浪潮(北京)电子信息产业有限公司 | A kind of restoration methods of Metadata Service, device, equipment and readable storage medium storing program for executing |
| CN109815057A (en) * | 2019-01-25 | 2019-05-28 | 维沃移动通信有限公司 | A data backup method and mobile terminal |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113553216A (en) * | 2021-06-28 | 2021-10-26 | 北京百度网讯科技有限公司 | Data recovery method and device, electronic equipment and storage medium |
| CN114168285A (en) * | 2021-11-29 | 2022-03-11 | 平安壹账通云科技(深圳)有限公司 | A data recovery drill method, device, server and storage medium |
| CN114185715A (en) * | 2021-12-08 | 2022-03-15 | 浙江中控技术股份有限公司 | Method and device for data recovery |
| CN114816845A (en) * | 2022-04-06 | 2022-07-29 | 在线途游（北京）科技有限公司 | MongoDB-based rapid data rollback method and device |
| CN114816845B (en) * | 2022-04-06 | 2024-05-10 | 在线途游（北京）科技有限公司 | MongoDB-based rapid data rollback method and device |
| CN114942730A (en) * | 2022-07-25 | 2022-08-26 | 北京睿芯高通量科技有限公司 | Method and device for determining residual storage space and electronic equipment |
| CN114942730B (en) * | 2022-07-25 | 2022-09-23 | 北京睿芯高通量科技有限公司 | Method and device for determining residual storage space and electronic equipment |
| CN116909816A (en) * | 2023-09-13 | 2023-10-20 | 腾讯科技（深圳）有限公司 | Database recovery method and device, storage medium and electronic equipment |
| CN116909816B (en) * | 2023-09-13 | 2024-01-09 | 腾讯科技（深圳）有限公司 | Database recovery method and device, storage medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112882863A (en) | Method, device and system for recovering data and electronic equipment | |
| CN110019350A (en) | Data query method and apparatus based on configuration information | |
| US11740897B2 (en) | Methods for software development and operation process analytics and devices thereof | |
| US20240012642A1 (en) | Providing external access to a processing platform | |
| CN110555072A (en) | Data access method, device, equipment and medium | |
| CN114816499B (en) | Electronic resource sharing method, device and storage medium | |
| CN113434384B (en) | Pressure testing method and device | |
| US11775473B2 (en) | Seamless data movement and metadata management in a hybrid cloud setting using a configurable micro services based architecture | |
| CN110019158A (en) | A kind of method and apparatus of monitoring data quality | |
| CN113449035B (en) | Data synchronization method, device, computer equipment and readable storage medium | |
| CN115495197A (en) | Configuration information modification method and device, storage medium and electronic equipment | |
| CN113590483B (en) | Use case operation method and device | |
| CN114281707A (en) | Number creation method, business application testing method and related equipment | |
| CN114282506A (en) | Certificate generation method, system, electronic device and storage medium | |
| CN112395194A (en) | Method and device for accessing test platform | |
| US11803789B2 (en) | Provision of remote application action feed cards | |
| CN113542429B (en) | Platform residence processing method, device, equipment and medium | |
| CN117149248A (en) | Micro front-end construction method, device, equipment and storage medium | |
| CN111695986B (en) | Method and device for controlling accumulated gold image | |
| CN111176982B (en) | Test interface generation method and device | |
| CN112486460A (en) | Method, system, device and medium for automatically importing interface documentation | |
| CN111158649A (en) | Method and device for configuring multi-level parameters | |
| CN112597517A (en) | Encrypted communication method, system, device and medium for installing client | |
| CN114281849B (en) | Data query method and device | |
| CN112988806A (en) | Data processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |