CN1249597C - Synchronous system in distributed files and method - Google Patents

Abstract

The present invention relates to a synchronous system in distributed files and a method. The system comprises a main node, a plurality of branch nodes and a network which leads the main node and the branch nodes to be connected, wherein the main node is a control center of synchronous operation, and the main node comprises a main data base server, a main FTP server and an application server. The application server comprises a synchronous control module used for controlling the data transmission between the main FTP server of the main node and a branch FTP server of the branch node and updating file summary information in a data base server of the main node. The branch node of the system at least comprises a branch data base sever and the branch FTP server. The present invention runs a synchronous program through the application server of the main node. The file synchronous operation and the branch node are separated. Therefore, the expansion of the branch node is easy.

Description

Distributed file synchronization system and method

【Technical field】

The invention relates to a file synchronization system and method, in particular to a distributed file synchronization system and method.

【Background technique】

With the development trend of economic globalization, a large number of large enterprise groups that cross regions and borders have emerged. The branches of these enterprise groups are distributed all over the world, and the branches need to share information to work together. Therefore, how to manage and control its data to realize the sharing of enterprise information resources has become an important part of the operation of this type of enterprise. The development of information technology has made cross-institutional and cross-regional data access and collaboration possible. At present, in order to improve the efficiency of data access and reduce the loss of failures, enterprises generally use distributed data management systems.

A distributed data management system refers to a data storage and management system that is physically dispersed and logically connected through a network. In this system, users can use the data in the remote storage area just like accessing the data in the local storage area. For example, the Chinese patent titled "File Management Method and System in Distributed Environment" published on June 12, 2002 with the publication number CN1353836, sets a file controller on the client side to manage local files and control network information exchange , and generate a meta index containing file storage locations to identify network information. When a user accesses a file on a certain client, the file storage location is obtained through the meta index, the file is copied to the local terminal, and the meta index information is modified at the same time. This patent solves the problems of specific terminal load concentration and file update synchronization, but the system has problems such as repeated storage of client data, large communication volume during synchronization, and difficult expansion of the system.

【Content of invention】

The invention provides a distributed file synchronization system and method. The synchronization program is run by the application server of the main node, so that the file synchronization operation is separated from the branch nodes, so as to solve the problem that the system is not easy to expand.

The system includes a main node, several branch nodes and a network connecting the main node and the above-mentioned branch nodes. The branch node includes a branch database server and a branch FTP server, wherein the branch database server is used to store file summary information, which keeps synchronization with the file summary information in the main database server of the master node; the branch FTP server is used to store files and can Transfer files with the master FTP server of the master node. The master node is a synchronous operation control center. The master node includes a master database server, a master FTP server and an application program server, wherein the master database server is used to store file summary information and control the synchronization of the above summary information with each branch database server ; The main FTP server is used to store files, and can upload files to the branch FTP server and download files from the branch FTP server; the application server is used to control the synchronization operation, and the server includes a synchronization control module for controlling the main FTP The server downloads files from the branch FTP server and uploads files to the branch FTP server, and updates the summary information of the files in the main database server.

The invention also provides a distributed file synchronization method. The method comprises the following steps: (a) synchronizing the file abstract information in the branch database servers of several branch nodes with the file abstract information in the master database server of the master node; (b) the first branch node sending a file synchronization request message to the master node ; (c) the master node receives the synchronization request message, judges the specific location of the requested file, and obtains the file; (d) the master node uploads the file to the first branch node; (e) the master node is on the master database server Update file summary information in .

Through the invention, the files stored in different regions can be accurately synchronized under the condition of relatively small communication volume, and the branch nodes of the system are easy to expand.

【Description of drawings】

FIG. 1 is an implementation environment diagram of the distributed file synchronization system and method of the present invention.

FIG. 2 is a structural diagram of branch nodes of the distributed file synchronization system and method of the present invention.

FIG. 3 is a structural diagram of a master node of the distributed file synchronization system and method of the present invention.

Fig. 4 is a file summary information table in the database server of the distributed file synchronization system and method of the present invention.

FIG. 5 is a flow chart of the client reading files in the distributed file synchronization system and method of the present invention.

FIG. 6 is a flow chart of file copying in the distributed file synchronization system and method of the present invention.

【Detailed ways】

As shown in FIG. 1 , it is an implementation environment diagram of the distributed file synchronization system and method of the present invention. The system is composed of enterprise information system nodes scattered in different geographical locations, which specifically includes a master node 110 and several branch nodes 120, 130 (only two are shown in the figure). These nodes are connected by intranet 140, and all adopt three-layer (or multi-layer) structure: a database server (113, 123 or 133), a series of application server systems (112, 122 or 132), and scattered clients end (111, 121 or 131). The composition of each node will be introduced below by taking the master node 110 as an example.

The master node 110 includes a master database server 113, a master application server system 112 and several clients 111 (only one is shown in the figure). The master database server 113 is used to store all data related to the enterprise, and is responsible for managing the reading, writing and maintenance of the database, and can quickly update and retrieve a large amount of data. The main application server system 112 includes the core and changeable business logic (planning, operation method, management mode, etc.) in the enterprise information system, and its function is to receive input, process and return the result. The client 111 is the user interface of the system application, responsible for receiving user input and displaying system processing results to the user. The composition structure of the branch nodes 120 and 130 is the same as that of the master node 110 .

FIG. 2 is a structural diagram of the branch node 120 of the distributed file synchronization system and method of the present invention. The client 121 of the branch node 120 includes a client agent program 201 for encapsulating system operations, separating system operations from user operations, and simplifying user operations. The client agent program 201 includes a user operation module 202 , a database operation module 203 and a file operation module 205 . The branch application server system 122 of the branch node 120 includes a branch FTP (File Transfer Protocol 1) server 207 and a branch application server 209.

The user operation module 202 provides a graphical user interface (Graphical User Interface, GUI) for the user to facilitate user input. The user operation module 202 is connected with the database operation module 203 and the file operation module 205, and displays the operation results of the system on the branch FTP server 207 and the branch database server 123 to the user. The file operation module 205 is connected with the branch FTP server 207, and is used to send operation commands to the file to the branch FTP server 207. This command includes operations such as file opening, closing, editing, uploading, downloading, deleting, changing and adding or deleting folders . The file operation module 205 is also connected to the database operation module 203 for processing the data transmitted by the database operation module 203 . The database operation module 203 is connected to the branch application server 209 and is used to generate operation commands such as query, update and delete on the data in the branch database server 123 . The database operation module 203 is also responsible for transmitting the operation result of the branch database server 123 to the file operation module 205 .

The branch FTP server 207 is used to store files, such as documents, images, audio and video files, and the like. The branch FTP server 207 is connected to the intranet 140 of the enterprise, and can perform file transfer operations with FTP servers of other branch nodes or master nodes through the intranet 140 . The branch application server 209 is used to connect the client 121 and the branch database server 123, and the database operation module 203 of the client 121 passes the command of the database operation to the branch database server 123 for execution, and the execution result of the branch database server 123 is transmitted to the database Operation module 203 .

Branch database server 123 stores summary information of enterprise files (such as files such as sound, image, document, and video), and the summary information includes information such as file number, storage location and directory, and update date. The file summary information in the branch database server 123 is synchronized with the file summary information in the master database server 113 of the master node 110 at regular intervals.

FIG. 3 is a structural diagram of the master node 110 of the distributed file synchronization system and method of the present invention. The function, composition and structure of the client 111 and the master database server 113 of the master node 110 are the same as those of the branch node 120 (see FIG. 2 ).

The main application server system 112 of the main node 110 includes a main FTP server 309 and a main application server 310 . The main FTP server 309 is used to store files, including documents, images, audio and video. The main FTP server 309 is connected to the intranet 140 of the enterprise, and can perform file transfer operations with FTP servers of other nodes through the intranet 140 of the enterprise. The main application server 310 is the control center of the file synchronization system, which includes a synchronization control module 313 , a file transfer control module 311 and a database connection module 315 . The synchronization control module 313 is used to control the execution of the synchronization operation, and it is connected with the file transfer control module 311 and the database connection module 315 . The synchronization control module 313 can generate several synchronization operation commands according to the synchronization request. These synchronization operation commands include data transmission commands and database update commands, and then the synchronization control module 313 sends commands to the file transmission control module 311 and the database connection module 315 for execution. The file transfer control module 311 can receive a synchronization request from the main FTP server 309 and send the request to the synchronization control module 313 to generate a synchronization control command. At the same time, the file transfer control module 311 is also responsible for interpreting the synchronization command of the synchronization control module 313 and compiling the synchronization command into an executable command of the main FTP server 309 . The database connection module 315 is connected with the main database server 113, and the database update command of the synchronization control module 313 can be sent to the main database server 113, and the main database server 113 executes the database update order, and the data synchronization information such as information such as location change and time update to update.

FIG. 4 is a file summary information table 400 in the main database server 113 (or branch database servers 123, 133) of the distributed file synchronization system and method of the present invention. The abstract information table 400 includes a file number 401 , a file title 403 , a file location 405 , a file directory 407 and an update time 409 . Wherein, the file number 401 is the uniform number of the corresponding file in the enterprise information system, and each file has and only has one unique number. The file title 403 is the title of the file, which can briefly describe the contents of the file. The file location 405 is the IP address of the FTP server where the file is stored, such as 10.153.24.126. The file directory 407 is a directory of files in the FTP server. Update time 409 is the specific time of the last file operation. The summary information table 400 in the branch database server 123 (or 133 ) of the branch node 120 (or 130 ) is regularly synchronized with the summary information table 400 in the master database server 113 of the master node 110 . For example, the master database server 113 of the master node 110 can be set to execute the synchronizing step of the summary information table 400 every three minutes.

FIG. 5 is a flow chart of reading files by the client 121 of the distributed file synchronization system and method of the present invention. First, the user sends an operation request for a file to the system through the GUI of the user operation module 202 (step S501). The operation can be reading or editing the file, and the file corresponds to a unique number. The database operation module 203 compiles the request into a database query statement, and sends it to the branch database server 123 via the branch application server 209 . The branch database server 123 executes the query statement, and searches for eligible entries in the file number 401 column of the file summary information table 400 of the branch database server 123 (step S503 ). Then, the branch database server 123 sends the table columns whose numbers meet the conditions to the file operation module 205 .

The file operation module 205 reads the listing information, and searches the column of the file location 405 listed in the summary information table 400 (step S505 ). If do not have the IP address of the branch FTP server 207 of this node 200 in this column, then represent that this file is not in this node, then file operation module 205 sends data copy request to main node 110 synchronous control module 313 via branch FTP server 207, this The data copy request only contains the data number (step S507), which will be described in detail in FIG. 6 . If there is this data locally, that is, the file location 405 column has the IP address of the branch FTP server 207 of this node 200, then the file operation module 205 further compares the update date column (step S501) listed in the summary information table 400. If the update date of the list corresponding to the IP address of the branch FTP server 207 is earlier than the update date of any other list, that is, the latest version of the data is not in the local node 200, then step S507 is executed. If the latest version of the data is in the branch FTP server 207 of the node 200, the file operation module 205 will directly display the file to the user.

FIG. 6 is a flow chart of file copying in the distributed file synchronization system and method of the present invention. Synchronization between the branch node 120 and the master node 110 is described below as an example. First, the master FTP server 309 of the master node 110 receives a file synchronization request sent by the branch FTP server 207 of the branch node 120 (step S601 ). The file synchronization request is sent to the synchronization control module 313 via the file transmission control module 311 . The synchronization control module 313 queries the data number in the data copy request in the summary information table 400 of the main database server 113 through the database connection module 315, and sends the query result list back to the synchronization control module 313 (step S603).

The synchronization control module 313 determines the location of the latest version of the file according to the file location 405 column and the update date 409 column in the summary information table 400 (step S605 ). If the latest version of the data is not in the main FTP server 309 of the main node 110, then the synchronization control module 313 sends a data download command to the file transfer control module 311, the data download command includes data number, position and directory, and the file transfer control module 311 sends the The download command is compiled into a download instruction that the main FTP server 309 can directly execute, and sends to the main FTP server 309, and the main FTP server 309 executes the download instruction, and downloads the latest file from the branch FTP server of the node (such as branch node 130) where the latest version of the file is located version (step S607), determine whether the file download is successful, if the file download fails, then return to step S603; if the file is successfully downloaded to the master FTP server 309 of the master node 110, a response message is generated to notify the synchronization control module 313 that the file has been Download (step S608). After the synchronization control module 313 receives the response message, it generates a file upload command, and sends the command to the file transfer control module 311, and the compiled data upload command of the file transfer control module 311 is executed by the main FTP server 309, and the corresponding data is sent to The branch FTP server 207 of the original requesting node 120 (step S609). Judging whether the file upload is successful, if the file upload is successful, the main FTP server 309 returns an upload success message to the synchronization control module 313 via the file transfer control module 311; if the file upload fails, then return to step S601 (step S611). After the synchronization control module 313 receives the upload success message, it will modify the summary message table 400 in the main database server 113 (step S613).

Claims (9)

1. synchronous system in distributed files, this system comprises a host node, some branch nodes and with host node and the network that above-mentioned branch node links to each other, it is characterized in that:

This host node comprises a main database server, a main ftp server and a primary application program server; This branch node comprises a branch data storehouse server, branch's ftp server and a drop applications procedure service device, wherein:

Main database server is used for the storage file summary info, and controls the document information synchronization in above-mentioned summary info and each the branch data storehouse server;

Main ftp server is used for storage file, and upload file is to branch's ftp server and from branch's ftp server file in download;

The primary application program server, be connected with main ftp server and main database server, the synchronous operation that is used for control documents and document information is carried out, this primary application program server comprises a synchronous control module, be used to control main ftp server from branch's ftp server file in download and upload file to each branch's ftp server, and upgrade the summary info of the file in the main database server;

Branch data storehouse server is used for the storage file summary info, and the document information in the main database server of itself and host node keeps synchronously;

Branch's ftp server is used for the file of stores branch node, and carries out the transmission of file with the main ftp server of host node;

Drop applications procedure service device links to each other with branch data storehouse server, is used for the order of branch node is sent to branch data storehouse server, and the execution result of branch data storehouse server is sent back branch node.

2. synchronous system in distributed files as claimed in claim 1, it is characterized in that, wherein main database server and branch data storehouse server comprise a document information table, and this summary info table comprises reference number of a document, file storage location, file update time.

3. synchronous system in distributed files as claimed in claim 1 is characterized in that, the file of storing in wherein main ftp server and the branch's ftp server comprises document, sound, image and image file.

4. synchronous system in distributed files as claimed in claim 1 is characterized in that, wherein the summary info between main database server and branch data storehouse server is synchronously for regularly carrying out.

5. synchronous system in distributed files as claimed in claim 1, it is characterized in that, wherein the host node apps server comprises a database link block, be used for the database update order of synchronization control module is sent to main database server, to the data in the main database server inquire about, renewal and deletion action.

6. synchronous system in distributed files as claimed in claim 1, it is characterized in that, wherein the host node apps server comprises a file transfer control module, be used to understand the order that synchronization control module sends and be compiled as the executable instruction of branch's ftp server, also can be used for receiving the synchronization request of branch's ftp server and this request is sent to synchronization control module to generate synchronous control command.

7. distributed document method for synchronous is characterized in that this method may further comprise the steps:

(a) with the document information synchronization in the main database server of document information in the branch data storehouse server of some branch nodes and host node;

(b) client of first branch node is searched for one and is treated the operation file summary info in the server of the branch data storehouse of this first branch node;

(i) if treat the branch ftp server of operation file latest edition at this first branch node

In, then open this and treat operation file, EO;

(ii) if treat that the operation file latest edition is not at branch's ftp server of first branch node

On, then send the synchronization control module of a file synchronization request message to host node;

(c) summary info in the main database server of synchronization control module search host node obtains to treat operation file latest edition position;

(i) if treat the main ftp server of operation file latest edition at host node, then host node

File is uploaded to first branch node;

(ii) if treat the branch ftp server of operation file latest edition at one second branch node

In, then host node is at first downloaded from second branch node and is treated operation file to host node, then will

This treats that operation file is uploaded to first branch node;

(d) host node updating file summary info in main database server.

8. distributed document method for synchronous as claimed in claim 7 is characterized in that, wherein document information comprises reference number of a document, file storage location, file update time.

9. distributed document method for synchronous as claimed in claim 7 is characterized in that, wherein carrying out for timing synchronously in the step (a).

Images