CN1519743A - File preassembling system and method for balancing load by using broadcasting mechanism - Google Patents

Abstract

A file preassembly system and method for balancing load by using broadcast mechanism is applied to client/server network structure, the system includes: the data connection is established between the server and the client in a connection-oriented mode and is used for transmitting data packets from the server to the client; and the command connection is established between the server and the client in a connection-oriented mode and is used for bidirectionally transmitting the command request. The method comprises the following steps: establishing two connections between the client and the server, wherein one connection adopts data connection without a connection-oriented mode, and the other connection adopts a command connection with a connection-oriented mode; propagating data packets from the server to the client through the data connection, and establishing a bidirectional transmission command request between the client and the server through the command connection; and the client receives the data packet broadcasted from the server and writes the data packet into the specified position of the disk. The invention has the advantages of less occupied network bandwidth and flexible process arrangement.

Description

File Preinstallation System and Method Using Broadcast Mechanism to Balance Load

technical field

The invention relates to a file preinstallation system and method, in particular to a file preinstallation system and method applied to a client/server network structure and using a broadcast mechanism to balance loads.

Background technique

Computers (including notebook computers and desktop computers) all have operating systems and application software pre-installed on the hard disk before leaving the factory. After a user buys a calculator, he can turn on the power and use it.

In order to achieve this goal, the general method is: first, perform routine operations on a prototype, including partitioning, formatting, installing the operating system, installing random software, etc.; then copy the hard disk of the prototype into a mirror image file under DOS , and put the image file in the shared directory on the server; finally download the image file through the client computer, and restore a shipping image according to the image file.

The advantage of this method is that the system and software only need to be installed once, which reduces the process and man-hours. However, this still has the following obvious disadvantages:

1. If there are n clients downloading the shipping image from the server at the same time, the network traffic is n times that of one client. When the number of clients is large, it will cause a huge burden on the network, not only greatly reducing the download efficiency, but also It may even cause too much network data and paralyze the network.

2. When several clients download the shipping image file online at the same time, the server performs concurrent processing on the same image file. Because there is no unified scheduling for concurrent processing, it will cause a large burden on the server disk. To a certain extent The data download rate has been reduced.

3. When there are many shipping images online at the same time on the production line, in order to improve efficiency, measures such as using high-performance servers, increasing the number of servers, and adopting Gigabit networks have to be taken, which greatly increases production costs.

An obvious example is that when there are 20 client computers downloading the shipping image at the same time on the production line, it takes 45 minutes to download the 1G shipping image file, but when only one client computer is online, it only takes 45 minutes to download the same shipping image file 5 minutes.

Contents of the invention

The purpose of the present invention is to provide a file preinstallation system and method thereof that utilizes a broadcast mechanism to balance loads. No matter how many clients each image file corresponds to at the same time, it only needs the bandwidth of one client to realize multi-client It can download and install image files with high efficiency at a low cost without expanding the existing network. The present invention provides a file preinstallation system using a broadcast mechanism to balance loads, which is applied to a client/server network structure. The system includes: a data connection established between the server and the client in a non-connection-oriented manner for Propagate data packets from the server to the client; and a command connection is established between the server and the client in a connection-oriented manner for bidirectional transmission of command requests.

The present invention also provides a file preloading method using a broadcast mechanism to balance loads, which is applied to a client/server network structure. The method includes: establishing two connections between the client and the server, one using a non-connection-oriented Data connection, another connection-oriented command connection; through the data connection, the data packet is transmitted from the server to the client, and through the command connection, a two-way transmission command request is established between the client and the server; and the client receives the data packet from the server. The data packet broadcasted by the server is written to the specified location on the disk.

The present invention has the following advantages:

1. Occupies less network bandwidth: Since the server adopts the broadcast method, all clients can receive the broadcast data once the data is broadcast. Therefore, no matter how many clients correspond to each image file at the same time, the data transmission only takes up Same bandwidth as for one client. A further advantage of less network bandwidth is the reduced danger of network data overload.

2. High production efficiency: Since the time taken by one and multiple clients to download the image file at the same time is basically the same, it can reflect high production efficiency in mass production on the production line.

3. Flexible process arrangement: Since the server uses the UDP protocol to broadcast data packets to the client, as long as it detects that the client is online, it will circulate the data of the mirror file. As long as the client detects that all disk locations have written data, it quit. This can ensure that the client computer does not need to download data from the beginning of the image file, that is, the client computers do not need to be started at the same time, thereby ensuring greater flexibility in the arrangement of the production process.

4. Lower production cost: From the perspective of speed, the 100M network environment has met the needs of the client, because the current speed bottleneck is the client's decompression and writing to the hard disk, faster network speed and higher server performance is no longer a necessary requirement. In this way, there is no need to require a higher-speed network environment and a higher-performance server.

Description of drawings

Fig. 1 is the schematic diagram of the network environment that utilizes the file preloading system of the present invention to balance load and method to run;

Fig. 2 is the structural representation of the file preinstallation system utilizing the broadcast mechanism to balance the load of the present invention;

FIG. 3 is a schematic diagram of server-side functional modules involved in the present invention;

FIG. 4 is a schematic diagram of the functional modules of the client terminal involved in the present invention;

Fig. 5 is the flow chart of the file preinstallation method utilizing the broadcast mechanism to balance the load of the present invention;

FIG. 6 is a flow chart of the steps involved in transmitting data packets from the server to the client according to the present invention; and

FIG. 7 is a flow chart of the steps of the client receiving the data packet and writing it to the disk according to the present invention.

Explanation of reference signs:

10 server side, 11 server management module, 12 file read module, 13 write socket module, 20 client side, 21 client management module, 22 read socket module, 23 write file module, 24 decompression module, 30 Hub (Share Hub), 40 switches (Switch Hub), 101 data connections, 102 command connections,

Step 501 Establish two connections between the client and the server, one is a data connection without a connection-oriented method, and the other is a command connection with a connection-oriented method

Step 502 Through the data connection, broadcast data packets from the server to the client, and through the command connection, establish a two-way transmission command request between the client and the server

Step 503 The client receives the data packet broadcast from the server and writes it to the specified location on the disk

Step 601 The server listens to and responds to the client's request command

Step 602 Find the current data segment of the image file that needs to be installed

Step 603 Determine the position parameter of the current data segment

Step 604 Read the data segment according to the position parameter

Step 605 Determine the node of the write socket task queue

Step 606 According to the node, push the read data segment into the write socket task queue

Step 607 Broadcast the data packet of the node

Step 608 Release the node

Step 701 Read data packet from socket

Step 702 Create a task queue node for writing files

Step 703 Press the data packet into the file writing task queue according to the node

Step 704 Obtain the node from the file writing task queue

Step 705 Write the data to the specified location on the disk according to the node

Step 706 Release the node

Detailed ways

Please refer to Fig. 1, it is the schematic diagram of the network environment that utilizes the file preinstallation system and the method of broadcasting mechanism load balance of the present invention to run, server end 10 is through concentrator (Share Hub) 30 and switchboard (Switch Hub) 40 and client end 20 Form a network. All (usually only one) network hubs connected to the client are connected to a switch, and the switch shields the IP address of the server to prevent the broadcast of data from affecting other systems on the network.

Referring to FIG. 2 , it is a schematic structural diagram of a file preinstallation system using a broadcast mechanism to balance loads according to the present invention. Client 20 is responsible for receiving data, decompressing data when necessary, and then writes the original data of the image file to the specified location in the client disk; server end 10 is responsible for managing the image file to be installed, responding to the request of the client, and providing The machine broadcasts the image file data packet and the user interaction function and the access requirement of the unified scheduling client 20; the data connection 101 is established between the server and the client in a non-connection-oriented manner, in order to broadcast the data packet from the server to the client; The command connection 102 is established between the server and the client in a connection-oriented manner for bidirectional transmission of command requests.

The above-mentioned non-connection-oriented manner may adopt the UDP protocol, while the connection-oriented manner may adopt the TCP protocol.

When server 10 adopts UDP protocol to broadcast data packets to client computers, since the header of each data packet all contains the location information of data packets, each image file is only broadcast once, and all client computers can receive the file data. The client terminal 20 maintains a linked list in the internal memory. The information of the linked list indicates which position on the disk has written data, and that position has not yet written data. As long as the server 10 detects that a client is online, the data of the mirror image file will be played in a loop. The client exits as soon as it detects that all disk locations have been written. This can ensure that the client computer does not need to download data from the beginning of the image file, that is, the client computers do not need to be activated at the same time, thereby ensuring greater flexibility in the arrangement of the production process.

Referring to FIG. 3 , it is a schematic diagram of server-side functional modules, which is composed of a server management module 11 , a file reading module 12 and a socket writing module 13 . Wherein, the file reading module 12 is used to read the image file in the disk, the write socket module 13 is used to broadcast the data packets read from the image file, and the server management module is used to manage the file reading module and Write a socket module and monitor client requests.

Referring to FIG. 4 , it is a schematic diagram of the functional modules of the client, which is composed of a client management module 21 , a socket reading module 22 and a file writing module 23 . Wherein, the read socket module 22 is used to read data packets from the broadcast port, the write file module 23 is used to write the data to the specified location on the disk, and the client management module 21 is used to manage the read socket module and the write file module , monitor the loss of data packets, and send a request to the server. If the image file is compressed, the client end may further include a decompression module 24 for decompressing the read compressed data package.

In order to improve the download efficiency, both the server and the client can use multi-thread parallel processing, and the data can be transferred between modules through queues.

Referring to FIG. 5 , it is a flow chart of the file preinstallation method using the broadcast mechanism to balance the load of the present invention. At first, two connections are set up between the client computer and the server, one adopts a data connection without a connection-oriented mode, and the other adopts a connection-oriented command connection (step 501); then, through the data connection, from the server to the client computer Broadcast data packet, set up bidirectional transmission order request (step 502) between client computer and server by command connection; Finally, client computer receives the data packet that broadcasts from server end, and writes it to disk specified location (step 503).

Referring to Fig. 6, it is the flow chart of the steps of transmitting the data packet data packet from the server to the client computer involved in the present invention, at first the server end listens to and responds to the request command (step 601) of the client computer; then, finds the image file that needs to be installed The current data segment (step 602); determine the position parameter (step 603) of this current data segment; read this data segment (step 604) according to this position parameter; determine the node (step 605) of write socket task queue; According to the node, push the read data segment into the write socket task queue (step 606); broadcast the data packet of the node (step 607); release the node (step 608).

Wherein, the server end is used for listening to the data packet of the image file being cyclically broadcasted when the client computer is online. For the image file that needs to be installed, it can be divided into several data segments, and the data segment of the image file can be managed and sorted by creating a file read task queue.

Before reading the file, it is necessary to determine the position parameters of the current data segment, such as: offset address (Offset) or length (LEN), etc.

Referring to FIG. 7 , it is a flow chart of the steps of the client receiving the data packet and writing it to the disk according to the present invention. First, read the data packet (step 701) from the socket; then, create a write file task queue node (step 702); according to the node, the data packet is pressed into the write file task queue (step 703); from the write file Obtain the node from the task queue (step 704); write the data to the designated location on the disk according to the node (step 705); finally, release the node (step 706).

Wherein, if the image file is compressed, after creating a file writing task queue node (step 702 ), a step of decompressing the read compressed data package is also included.

After the client computer writes data to the designated location on the disk, if the client computer detects that all disk locations have written data, it exits.

The embodiments described above are only preferred embodiments of the present invention, and are not intended to limit the scope of implementation of the present invention; all changes made within the scope of the claims of the present invention do not depart from the spirit and scope of the present invention and modifications are within the protection scope of the present invention.

Claims (18)

1. A file preinstallation system utilizing a broadcast mechanism load balancing, applied to a client/server network structure, characterized in that the system comprises: a data connection established between the server and the client in a connectionless manner for broadcasting data packets from the server to the client; and A command connection is established between the server and the client in a connection-oriented manner for bidirectional transmission of command requests. 2. The file preinstallation system utilizing a broadcast mechanism to balance loads as claimed in claim 1, wherein the non-connection-oriented mode is a UDP protocol. 3. The file preinstallation system utilizing a broadcast mechanism for load balancing as claimed in claim 1, wherein the connection-oriented mode is a TCP protocol. 4. The file pre-installation system utilizing a broadcast mechanism for load balancing as claimed in claim 1, wherein the headers of the data packets all contain location information of the data packets. 5. the file preinstallation system utilizing broadcast mechanism load balancing as claimed in claim 1, is characterized in that, described server end also comprises: A file reading module, used to read the image file in the disk; A socket module for broadcasting the data packets read from the image file; and A server management module is used to manage the file reading module and the socket writing module, and monitor the request of the client. 6. the file preloading system utilizing broadcast mechanism load balancing as claimed in claim 1, is characterized in that, described client end also comprises: A read socket module, used to read data packets from the broadcast port; A write file module, which is used to write data to a specified location on the disk; and A client management module is used to manage the socket reading module and the file writing module, monitor the loss of data packets, and send a request to the server. 7. The file preinstallation system utilizing broadcast mechanism load balancing as claimed in claim 6, wherein said client end also includes a decompression module for decompressing the compressed data packets read out . 8. The file preinstallation system utilizing broadcast mechanism load balancing as claimed in claim 6, wherein a linked list is maintained in the internal memory of the client, and the information of the linked list indicates which position on the disk has written data, which A block of locations has not yet been written with data. 9. A method for preloading files utilizing a broadcast mechanism for load balancing, applied to a client/server network structure, the method comprising: Establish two connections between the client and the server, one is a data connection without a connection-oriented method, and the other is a command connection with a connection-oriented method; Broadcast data packets from the server to the client through the data connection, and establish bidirectional transmission command requests between the client and the server through the command connection; and The client receives the data packet broadcast from the server and writes it to the specified location on the disk. 10. The file preloading method utilizing a broadcast mechanism to balance loads as claimed in claim 9, wherein the non-connection-oriented method is a UDP protocol. 11. The file preinstallation method utilizing broadcast mechanism to balance load as claimed in claim 9, characterized in that, the connection-oriented mode is TCP protocol. 12. as claimed in claim 9 utilizing the file preinstallation method of broadcast mechanism load balancing, it is characterized in that, this by data connection, the step of transmitting data packet from server to client computer, also comprises the following steps: Monitor and respond to client requests; Find the current data segment of the image file to be installed; Determine the position parameter of the current data segment; Read the data segment according to the position parameter; Determine the node of the write socket task queue; According to the node, push the read data segment into the write socket task queue; broadcast the node's packets; and Release the node. 13. The file preinstallation method utilizing broadcast mechanism load balancing as claimed in claim 12, characterized in that, the step of listening to and responding to the request command of the client computer is as long as the server detects that there is a client computer online and broadcasts the image in a loop file packets. 14. The file preinstallation method utilizing the broadcast mechanism load balancing as claimed in claim 12, wherein the step of searching for the current data segment of the image file that needs to be installed can be performed by creating a file task queue to read the image file. The data segments of the file are managed and sorted. 15. The file preloading method utilizing a broadcast mechanism to balance loads as claimed in claim 12, wherein the position parameters of the current data segment include offset addresses and lengths. 16. The file preinstallation method utilizing broadcast mechanism load balancing as claimed in claim 9, characterized in that, the client computer receives the data packets broadcast from the server end, and writes it to the step of disk designated location, Also include the following steps: read packets from socket; Create a write file task queue node; Press the data packet into the file writing task queue according to the node; Obtain the node from the file writing task queue; Write data to the specified location on disk according to the node; and Release the node. 17. The file preinstallation method utilizing broadcast mechanism load balancing as claimed in claim 16, wherein, after the described creation of a write file task queue node step, it also includes a process of decompressing the read compressed data packets A step of. 18. The file preinstallation method utilizing broadcast mechanism load balancing as claimed in claim 16, characterized in that, in the step of writing data to a specified location on the disk according to the node, if the client monitors that all disk locations have been Write data and exit.

Images