CN108111566A - A kind of cloud storage system expansion method, device and cloud storage system - Google Patents

Abstract

The embodiment of the present invention provides a cloud storage system capacity expansion method, device and cloud storage system, the method is applied to the management server in the cloud storage system, the method includes: determining at least two registered to the management server within a preset time Expanding the server; selecting an auxiliary server from at least two expanding servers, and instructing the auxiliary server to manage at least two expanding servers; when a write data request is detected, writing data to the auxiliary server, so that the auxiliary server will receive the data Write at least two expansion servers according to the load balancing principle; monitor the storage space occupancy ratio of at least two expansion servers through the auxiliary server; Administrative rights to the two scale-out servers. By applying the embodiment of the present invention, data can be smoothly written to the expansion server.

Description

A cloud storage system expansion method, device and cloud storage system

technical field

The present invention relates to the technical field of cloud storage, in particular to a method and device for expanding the capacity of a cloud storage system, and a cloud storage system.

Background technique

Currently, users often access data through cloud storage systems. Among them, the cloud storage system is an extension and development of the concept of cloud computing, which uses functions such as cluster applications, grid technology, or distributed file systems, and works together through application software to jointly provide data storage and services to the outside world. A system of access functions. A cloud storage system may include a management server and a storage server. Wherein, the management server is used to write the received data into the storage server in the cloud storage system; the storage server is used to store the received data.

In practical applications, the storage capacity of the cloud storage system ranges from several PB (Petabyte, petabyte) to hundreds of PB. However, with the widespread application of cloud storage technology, the capacity of fixed cloud storage systems can no longer meet the needs of users. Therefore, technicians often need to manually add a corresponding number of expansion servers to the cloud storage system according to storage requirements, so as to increase the storage capacity of the cloud storage system.

However, when the cloud storage system is expanded in this way, the following problems will arise: during expansion, the management server will preferentially store data in the expansion server with high storage performance, causing the storage pressure of the expansion server to soar, and even exceed the capacity of the expansion server. The ability to write data, resulting in the loss of data to be written to the expansion server.

Contents of the invention

The purpose of the embodiment of the present invention is to provide a cloud storage system capacity expansion method, device and cloud storage system, so as to write data to the capacity expansion server smoothly.

In the first aspect, an embodiment of the present invention provides a method for expanding the capacity of a cloud storage system, which is applied to a management server in the cloud storage system, and the method may include:

determining at least two expansion servers registered to the management server within a preset time;

Select an auxiliary server from the at least two expansion servers, and instruct the auxiliary server to manage the at least two expansion servers, wherein, before the auxiliary server is determined, the management server does not send to the preset Write data to any expansion server registered to the management server within a certain period of time;

When a write data request is detected, write data to the auxiliary server, so that the auxiliary server writes the received data into the at least two expansion servers according to the load balancing principle;

Monitoring the storage space occupancy ratio of the at least two expansion servers through the auxiliary server;

When it is detected that the storage space occupancy ratios of the at least two expansion servers reach a first threshold, the management authority for managing the at least two expansion servers is obtained.

Optionally, the step of selecting an auxiliary server from the at least two expansion servers may include:

Determining a target expansion server among the at least two expansion servers as an auxiliary server, and the target expansion server is the first expansion server registered with the management server within the preset time.

Optionally, the step of selecting an auxiliary server from the at least two expansion servers may include:

selecting the expansion server selected by the at least two expansion servers as an auxiliary server, wherein the auxiliary server is selected by the at least two expansion servers based on the received storage performance parameters of each expansion server .

Optionally, before the step of writing data to the auxiliary server, it may also include:

Sending an initialization and/or formatting instruction to the auxiliary server, so that the auxiliary server can initialize and/or format each expansion server according to the received initialization and/or formatting instruction.

Optionally, the step of the auxiliary server writing the received data into the at least two expansion servers according to the principle of load balancing may include:

The auxiliary server writes the received data into the auxiliary server itself and other expansion servers, and detects whether the storage space occupancy ratios of the auxiliary server and the other expansion servers reach a second threshold;

If not, continue to write data to the expansion server that has not reached the second threshold;

If both reach the second threshold, write data to the auxiliary server itself and the other expansion servers, and stop writing data to the auxiliary server and other expansion servers until the storage space occupancy ratios of the auxiliary server and other expansion servers reach the first threshold. The auxiliary server and other expansion servers write data, wherein the second threshold is smaller than the first threshold.

In the second aspect, the embodiment of the present invention also provides a cloud storage system expansion device, which is applied to the management server in the cloud storage system, and the device may include:

A determining unit, configured to determine at least two expansion servers registered to the management server within a preset time;

a selection unit, configured to select an auxiliary server from the at least two expansion servers;

An instructing unit, configured to instruct the auxiliary server to manage the at least two capacity expansion servers, wherein the management server does not register with the management server within the preset time before the auxiliary server is determined. Any expansion server writes data;

A write data unit, configured to write data to the auxiliary server when a write data request is detected, so that the auxiliary server writes the received data into the at least two expansion servers according to the load balancing principle;

A monitoring unit, configured to monitor the storage space occupancy ratio of the at least two expansion servers through the auxiliary server;

The acquiring unit is configured to acquire management authority to manage the at least two expansion servers when it is detected that the storage space occupancy ratios of the at least two expansion servers reach a first threshold.

Optionally, in an implementation manner, the selecting unit is specifically configured to:

Determining a target expansion server among the at least two expansion servers as an auxiliary server, and the target expansion server is the first expansion server registered with the management server within the preset time.

Optionally, in another implementation manner, the selecting unit is specifically configured to:

selecting the expansion server selected by the at least two expansion servers as an auxiliary server, wherein the auxiliary server is selected by the at least two expansion servers based on the received storage performance parameters of each expansion server .

Optionally, the device may also include:

a sending unit, before the write data unit writes data to the auxiliary server, send an initialization and/or formatting instruction to the auxiliary server, so that the auxiliary server can use the received initialization and/or formatting instruction Instructions to initialize and/or format each expansion server.

Optionally, after the write data unit writes data to the auxiliary server, the step of the auxiliary server writing the received data into the at least two expansion servers according to the principle of load balancing may include:

The auxiliary server writes the received data into the auxiliary server itself and other expansion servers, and detects whether the storage space occupancy ratios of the auxiliary server and the other expansion servers reach a second threshold;

If not, continue to write data to the expansion server that has not reached the second threshold;

If both reach the second threshold, write data to the auxiliary server itself and the other expansion servers, and stop writing data to the auxiliary server and other expansion servers until the storage space occupancy ratios of the auxiliary server and other expansion servers reach the first threshold. The auxiliary server and other expansion servers write data, wherein the second threshold is smaller than the first threshold.

In the third aspect, the embodiment of the present invention also provides a cloud storage system, including a management server and a plurality of expansion servers, and the management server is used for:

determining at least two expansion servers registered to the management server within a preset time;

Select an auxiliary server from the at least two expansion servers, and instruct the auxiliary server to manage the at least two expansion servers, wherein, before the auxiliary server is determined, the management server does not send to the preset Write data to any expansion server registered to the management server within a certain period of time;

When a write data request is detected, write data to the auxiliary server, so that the auxiliary server writes the received data into the at least two expansion servers according to the load balancing principle;

Monitoring the storage space occupancy ratio of the at least two expansion servers through the auxiliary server;

When it is detected that the storage space occupancy ratios of the at least two expansion servers reach a first threshold, the management authority for managing the at least two expansion servers is acquired.

In the embodiment of the present invention, the management server in the cloud storage system can register to the expansion servers of the management server within a preset time, and select an expansion server as the auxiliary server; Writing data to any expansion server avoids the problem of soaring storage pressure when the expansion server is connected to the cloud storage system; after selecting the auxiliary server, instruct the auxiliary server to register to the specified The at least two expansion servers of the management server are managed; when a write data request is detected, data is written to the auxiliary server, and the auxiliary server smoothly writes data to the expansion server; the management server can also pass The auxiliary server monitors the storage space occupancy ratio of each expansion server; when the storage space occupancy ratio of each expansion server is monitored by the auxiliary server and reaches the first threshold, the management server obtains the management authority for each expansion server. At this time, the management The server can write data to the expansion server smoothly, that is, the expansion server is smoothly added to the cloud storage system.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

FIG. 1 is a flowchart of a method for expanding the capacity of a cloud storage system provided by an embodiment of the present invention;

FIG. 2 is a schematic diagram of a method for expanding the capacity of a cloud storage system provided by an embodiment of the present invention;

FIG. 3 is a schematic structural diagram of a cloud storage system expansion device provided by an embodiment of the present invention;

FIG. 4 is a schematic diagram of interaction between a management server and an auxiliary server in a cloud storage system according to an embodiment of the present invention.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

In order to solve the problem of expanding the capacity of the cloud storage system, because the management server in the cloud storage system preferentially stores data in the expansion server with high storage performance, the storage pressure of the expansion server is soaring, which even exceeds the ability of the expansion server to withstand the write data To solve the problem, an embodiment of the present invention provides a method and device for expanding the capacity of a cloud storage system.

The method for expanding the capacity of the cloud storage system provided by the embodiment of the present invention will firstly be described below.

It should be noted that the subject of execution of the method for expanding the capacity of the cloud storage system is: a management server in the cloud storage system that needs to expand the storage capacity. Wherein, the functional software implementing the method for expanding the capacity of the cloud storage system according to the embodiment of the present invention may be: the software specially used for capacity expansion set in the management server, or may be: the software set in the management server for capacity expansion The functional plug-ins are of course not limited to this.

Referring to Fig. 1, the method for expanding the capacity of the cloud storage system may include the following steps:

S101: Determine at least two expansion servers registered to the management server within a preset time;

It can be understood that the management server will receive the registration request sent by the expansion server, and further, the management server can determine at least two expansion servers registered with itself within a preset time.

For example, the management server may determine at least two capacity expansion servers registered with itself within the preset time period of 9:00-9:05, and use the at least two capacity expansion servers as the first capacity expansion device cluster. Of course, the management server may also determine at least two capacity expansion servers registered to itself within the preset time of 10:00-15:05, and use the at least two capacity expansion servers determined this time as the second capacity expansion device cluster, which makes sense.

S102: Select an auxiliary server from the at least two capacity expansion servers, and instruct the auxiliary server to manage the at least two capacity expansion servers, wherein the management server does not send information to the at least two capacity expansion servers before the auxiliary server is determined. Writing data to any expansion server registered to the management server within a preset time;

Wherein, after determining at least two expansion servers registered to the management server within a preset time, in an implementation manner, the management server may determine a target expansion server among the determined at least two expansion servers as Auxiliary server. Wherein, the target capacity expansion server may be the first capacity expansion server registered with the management server within the preset time, and of course it is not limited thereto.

In another implementation manner, the management server may select an expansion server selected by the determined at least two expansion servers as an auxiliary server, wherein the auxiliary server is the at least two expansion servers based on It is selected from the received storage performance parameters of each expansion server. In order to clarify the layout, this implementation manner will be described in detail later.

It should be noted that the storage performance parameters include, but are not limited to, memory usage, central processing unit usage, and network card usage.

It can be understood that after the auxiliary server is selected from the determined at least two expansion servers, the management server may instruct the auxiliary server to manage the at least two expansion servers, that is, the auxiliary server obtains the management of the at least two expansion servers. The management authority of the two expansion servers, the management authority includes the management of writing data to the at least two expansion servers.

For example, when the management server will be within the preset time period of 9:00-9:05, the capacity expansion in the registered first capacity expansion device cluster (including capacity expansion server A, capacity expansion server B and capacity expansion server C) After server A is selected as the auxiliary server, the management server may instruct the capacity expansion server A to manage itself, capacity expansion server B and capacity expansion server C.

Similarly, when the management server will register the expansion server D in the second expansion device cluster (including expansion server D and expansion server E) within the preset time period of 10:00-15:05, select as After assisting the server, the management server can instruct the expansion server D to manage itself and the expansion server E.

It should be noted that, in order to avoid the situation that the management server frantically writes data to the expansion server at the moment when the expansion server registers with the management server, causing the storage pressure of the expansion server to soar instantaneously, the management server is in the Before the auxiliary server is determined, do not write data to any expansion server registered with the management server within the preset time.

S103: When a write data request is detected, write data to the auxiliary server, so that the auxiliary server writes the received data into the at least two expansion servers according to the load balancing principle;

It can be understood that, in an implementation manner, after the management server receives a data write request for writing data to the auxiliary server, the management server may write data to the auxiliary server. Wherein, the write data request may be sent by the auxiliary server.

In another implementation, when the management server sends a data write request to the auxiliary server, and when the auxiliary server is the recipient of the data write request, it receives the data write request and responds with permission When writing data, the management server writes data to the auxiliary server.

In addition, after the management server writes data to the auxiliary server, the auxiliary server receives the data written by the management server, and may write the received data into the at least two Each expansion server realizes write data management for each expansion server. In order to clarify the layout, the implementation manner of the auxiliary server for writing data management to each expansion server will be described in detail later.

S104: Monitor the storage space occupancy ratio of the at least two expansion servers through the auxiliary server;

S105: When it is detected that the storage space occupancy ratios of the at least two expansion servers reach a first threshold, acquire management authority to manage the at least two expansion servers.

It can be understood that, during the period when the auxiliary server manages the at least two expansion servers, the management server may monitor the storage space occupancy ratio of the at least two expansion servers through the auxiliary server. When it is detected that the storage space occupancy ratios of the at least two expansion servers reach the first threshold, obtain the management authority to manage the at least two expansion servers, so that the management server can directly perform operations on the at least two expansion servers. management to complete the expansion of the cloud storage system.

Wherein, the manner in which the management server obtains the management authority of the at least two expansion servers includes: obtaining the index data corresponding to the data written by the auxiliary server to the at least two expansion servers, and instructing the auxiliary server to Turn off the function of managing the at least two expansion servers. Wherein, after the auxiliary server closes the management function, it only serves as a storage server to store data.

It should be noted that the absolute value of the difference between the first threshold and the storage space occupancy ratio of each server in the cloud storage system is smaller than the preset threshold. The preset threshold can be set by those skilled in the art according to actual conditions, and is not limited here.

In addition, the storage space occupancy ratio refers to the ratio of the amount of data written to the expansion server to the storage capacity of the expansion server.

It is worth noting that, the at least two capacity expansion servers involved in the embodiment of the present invention refer to the capacity expansion servers registered to the management server within the same preset time.

In the embodiment of the present invention, the management server in the cloud storage system can register to the expansion servers of the management server within a preset time, and select an expansion server as the auxiliary server; Writing data to any expansion server avoids the problem of soaring storage pressure when the expansion server is connected to the cloud storage system; after selecting the auxiliary server, instruct the auxiliary server to register to the specified The at least two expansion servers of the management server are managed; when a write data request is detected, data is written to the auxiliary server, and the auxiliary server smoothly writes data to the expansion server; the management server can also pass The auxiliary server monitors the storage space occupancy ratio of each expansion server; when the storage space occupancy ratio of each expansion server is monitored by the auxiliary server and reaches the first threshold, the management server obtains the management authority for each expansion server. At this time, the management The server can write data to the expansion server smoothly, that is, the expansion server is smoothly added to the cloud storage system.

The implementation manner in which the management server selects the expansion server selected by the determined at least two expansion servers as the auxiliary server in the embodiment of the present invention will be further described below.

For example, after the management server determines that the preset time is 9:00-9:05, after registering with its own first expansion device cluster (including expansion server A, expansion server B and expansion server C), Information such as the number of expansion servers included in the first expansion device cluster, and the IP addresses and storage performance parameters of each included expansion server may be sent to each expansion server in the first expansion device cluster.

For each expansion server in the first expansion equipment cluster, for example, expansion server A, after receiving the number of expansion servers contained in the first expansion equipment cluster sent by the management server, the expansion server A and the expansion server B and the IP address of expansion server C, and the storage performance parameters of expansion server A, expansion server B, and expansion server C, the expansion server A can select expansion server B as the auxiliary server according to the storage performance parameters of each expansion server , and send a connection request to the expansion server B according to the IP address of the expansion server B, and send information such as its working status and disk parameters to the expansion server B.

According to the same selection method, the expansion server B elects itself as the auxiliary server; the expansion server C elects the expansion server B as the auxiliary server, and sends a connection request to the expansion server B according to the IP address of the expansion server B, and sends itself to the expansion server B The working status and disk parameters and other information.

The capacity expansion server B detects that two connection requests have been received, and the capacity expansion server B can determine that it is the capacity expansion server selected by the capacity expansion server A, the capacity expansion server B and the capacity expansion server C, and report itself to the management service as the at least two capacity expansion servers. The expansion server is selected by the expansion server, so that the management server can select the expansion server B as an auxiliary server.

Because in the prior art, before the expansion server is connected to the cloud storage system, technicians need to perform initialization operation or formatting operation on the expansion server by manual operation, after the initialization operation or formatting operation is completed, the expansion Registering the server into the cloud storage system requires a lot of human resources. And because the initialization operation and the formatting operation often need more time, it will greatly consume the time of the technician. Therefore, in one embodiment of the present invention, before the step of writing data to the auxiliary server, it may further include:

Sending an initialization and/or formatting instruction to the auxiliary server, so that the auxiliary server can initialize and/or format each expansion server according to the received initialization and/or formatting instruction.

It can be understood that, after the expansion server registers with itself and before writing data to the auxiliary server, the management server may send an initialization instruction to the auxiliary server, so that the auxiliary server receives the After the initialization instruction is executed, the at least two expansion servers may be initialized based on the initialization instruction. For example, the disks of the at least two expansion servers are virtualized into one disk, but of course it is not limited thereto.

In addition, before the management server writes data to the auxiliary server, it may also send a formatting instruction to the auxiliary server, so that after receiving the formatting instruction, the auxiliary server may, based on the format Formatting instructions to format the disks of the at least two expansion servers into the disk format of the cloud storage system. For example: dividing the disks of the at least two expansion servers into preset groups (that is, preset block areas), of course, it is not limited thereto.

It should be noted that, after the auxiliary server initializes and/or formats the at least two expansion servers, it may send a write data request to the management server; After that, write data to the secondary server.

The following describes in detail how the auxiliary server performs data writing management on each expansion server in the embodiment of the present invention.

In an implementation manner, the step of the auxiliary server writing the received data into the at least two expansion servers according to the principle of load balancing may include:

The auxiliary server writes the received data into the auxiliary server itself and other expansion servers, and detects whether the storage space occupancy ratios of the auxiliary server and the other expansion servers reach a second threshold;

If not, continue to write data to the expansion server that has not reached the second threshold;

If both reach the second threshold, write data to the auxiliary server itself and the other expansion servers, and stop writing data to the auxiliary server and other expansion servers until the storage space occupancy ratios of the auxiliary server and other expansion servers reach the first threshold. The auxiliary server and other expansion servers write data, wherein the second threshold is smaller than the first threshold.

Wherein, the auxiliary server may preset a first threshold and a second threshold, and set the second threshold to be smaller than the first threshold. The first threshold has been described above, and will not be repeated here.

It can be understood that when the auxiliary server receives the data sent by the management server, the auxiliary server can write data to the auxiliary server itself and other expansion servers; Whether the storage space occupancy ratios of the auxiliary server and the other expansion servers reach the second threshold.

If the second threshold is not reached, continue to write data to the expansion server that does not reach the second threshold; when both reach the second threshold, the storage pressure (i.e. storage space) of the at least two expansion servers occupancy ratio) reaches the first balance, at this time, continue to write data to the auxiliary server itself and the other expansion servers; then, the auxiliary server detects whether the storage space occupancy ratios of itself and other expansion servers have reached The first threshold, if the first threshold is not reached, then continue to write data to the expansion server that has not reached the first threshold; when both reach the first threshold, make the at least two expansion servers The storage pressure reaches the second equalization, and the storage pressure of the at least two expansion servers smoothly transitions from the second threshold to the first threshold, and at this time, stop writing data to the auxiliary server and other expansion servers.

It should be noted that, the other capacity expansion servers are: all capacity expansion servers except the auxiliary server among at least two capacity expansion services registered to the management server within a preset time.

It should also be noted that, in order to make the storage pressure of the at least two expanded servers transition to the first threshold more smoothly, a third threshold, a fourth threshold, a fifth threshold, etc. may also be preset, which all is reasonable. Wherein, the third threshold, the fourth threshold and the fifth threshold are all smaller than the first threshold.

In addition, when the at least two expansion servers are abnormal, the storage space occupancy ratio of the at least two servers is usually very high. Therefore, in order to detect whether the at least two expansion servers are abnormal, those skilled in the art may set an abnormality threshold according to actual conditions. When the storage space occupancy ratio of any one of the at least two expansion servers exceeds the abnormal threshold, it is determined that the expansion server is abnormal and a technician is notified.

Wherein, those skilled in the art can understand that the abnormality threshold is greater than the first threshold.

The method for expanding the capacity of the cloud storage system provided by the embodiment of the present invention will be further described below with reference to FIG. 2 .

Referring to Fig. 2, the cloud storage system expansion method provided by the embodiment of the present invention may include the following steps:

S1: Start at least two expansion servers;

S2: The at least two expansion servers register with the management server of the cloud storage system within a preset time;

S3: The management server returns the number of expansion servers registered to the management server and storage performance parameters of each expansion server registered to the management server to each expansion server of the at least two expansion servers;

S4: The at least two expansion servers select an auxiliary server according to the storage performance parameters of each expansion server;

S5: The expansion servers except the auxiliary server among the at least two expansion servers report information such as their online status and disk parameters to the auxiliary server;

S6: After receiving information such as online status and disk parameters reported by other expansion devices, the auxiliary server initializes each expansion server registered to the management server within the preset time;

S7: After completing the initialization operation, the auxiliary server formats each expansion server registered to the management server within the preset time;

S8: After completing the formatting operation, the auxiliary server sends a write data request to the management server;

S9: After receiving the data write request, the management server writes data to the auxiliary server;

S10: After the auxiliary server receives the data written by the management server, the auxiliary server writes data to itself and other expansion servers;

S11: The auxiliary server detects whether the storage space occupancy ratios of itself and other expansion servers reach a second threshold;

S12: When the auxiliary server detects that the storage space occupancy ratios of itself and other expansion servers reach a second threshold, the auxiliary server continues to write data to itself and other expansion servers;

S13: The auxiliary server detects whether the storage space occupancy ratios of itself and other expansion servers reach a first threshold;

S14: When the auxiliary server detects that the storage space occupancy ratios of itself and other expansion servers reach a first threshold, the auxiliary server transfers management authority to the management server.

Corresponding to the above method embodiment, the embodiment of the present invention also provides a cloud storage system expansion device, the device is applied to the management server in the cloud storage system, see Figure 3, the device may include:

A determining unit 301, configured to determine at least two capacity expansion servers registered to the management server within a preset time;

A selection unit 302, configured to select an auxiliary server from the at least two expansion servers;

An instructing unit 303, configured to instruct the auxiliary server to manage the at least two expansion servers, wherein the management server does not register with the management server within the preset time before the auxiliary server is determined. Any expansion server of the server writes data;

A write data unit 304, configured to write data to the auxiliary server when a data write request is detected, so that the auxiliary server writes the received data into the at least two expansion servers according to the load balancing principle;

A monitoring unit 305, configured to monitor the storage space occupancy ratio of the at least two expansion servers through the auxiliary server;

The acquiring unit 306 is configured to acquire management authority to manage the at least two expansion servers when it is detected that the storage space occupancy ratios of the at least two expansion servers reach a first threshold.

In the embodiment of the present invention, the management server in the cloud storage system can register to the expansion servers of the management server within a preset time, and select an expansion server as the auxiliary server; Writing data to any expansion server avoids the problem of soaring storage pressure when the expansion server is connected to the cloud storage system; after selecting the auxiliary server, instruct the auxiliary server to register to the specified The at least two expansion servers of the management server are managed; when a write data request is detected, data is written to the auxiliary server, and the auxiliary server smoothly writes data to the expansion server; the management server can also pass The auxiliary server monitors the storage space occupancy ratio of each expansion server; when the storage space occupancy ratio of each expansion server is monitored by the auxiliary server and reaches the first threshold, the management server obtains the management authority for each expansion server. At this time, the management The server can write data to the expansion server smoothly, that is, the expansion server is smoothly added to the cloud storage system.

Optionally, in an implementation manner, the selecting unit 302 is specifically configured to:

Determining a target expansion server among the at least two expansion servers as an auxiliary server, and the target expansion server is the first expansion server registered with the management server within the preset time.

Optionally, in another implementation manner, the selecting unit 302 is specifically configured to:

selecting the expansion server selected by the at least two expansion servers as an auxiliary server, wherein the auxiliary server is selected by the at least two expansion servers based on the received storage performance parameters of each expansion server .

Optionally, in one embodiment of the present invention, the device further includes:

a sending unit, before the write data unit writes data to the auxiliary server, send an initialization and/or formatting instruction to the auxiliary server, so that the auxiliary server can use the received initialization and/or formatting instruction Instructions to initialize and/or format each expansion server.

Optionally, after the writing data unit 304 writes data to the auxiliary server, the step of the auxiliary server writing the received data into the at least two expansion servers according to the load balancing principle may include:

The auxiliary server writes the received data into the auxiliary server itself and other expansion servers, and detects whether the storage space occupancy ratios of the auxiliary server and the other expansion servers reach a second threshold;

If not, continue to write data to the expansion server that has not reached the second threshold;

If both reach the second threshold, write data to the auxiliary server itself and the other expansion servers, and stop writing data to the auxiliary server and other expansion servers until the storage space occupancy ratios of the auxiliary server and other expansion servers reach the first threshold. The auxiliary server and other expansion servers write data, wherein the second threshold is smaller than the first threshold.

Corresponding to the above method and device embodiments, an embodiment of the present invention also provides a cloud storage system, the cloud storage system includes a management server and multiple expansion servers, and the management server is used for:

determining at least two expansion servers registered to the management server within a preset time;

Select an auxiliary server from the at least two expansion servers, and instruct the auxiliary server to manage the at least two expansion servers, wherein, before the auxiliary server is determined, the management server does not send to the preset Write data to any expansion server registered to the management server within a certain period of time;

When a write data request is detected, write data to the auxiliary server, so that the auxiliary server writes the received data into the at least two expansion servers according to the load balancing principle;

Monitoring the storage space occupancy ratio of the at least two expansion servers through the auxiliary server;

When it is detected that the storage space occupancy ratios of the at least two expansion servers reach a first threshold, the management authority for managing the at least two expansion servers is acquired.

Optionally, in an implementation manner, the management server is specifically configured to: determine a target expansion server among the at least two expansion servers as an auxiliary server, and the target expansion server is the second server within the preset time A scaling server registered to the management server.

Optionally, in another implementation manner, the management server is specifically configured to: select an expansion server selected by the at least two expansion servers as an auxiliary server, wherein the auxiliary server is the at least The two expansion servers are selected based on the received storage performance parameters of the respective expansion servers.

Optionally, the management server is specifically configured to: before the step of writing data to the auxiliary server, send an initialization and/or formatting instruction to the auxiliary server, for the auxiliary server to use according to the received The initialization and/or formatting instructions are used to initialize and/or format each expansion server.

Optionally, the auxiliary server is specifically configured to: the auxiliary server writes the received data into the auxiliary server itself and other expansion servers, and detects the storage space occupancy ratio of the auxiliary server and the other expansion servers Whether it reaches the second threshold;

If not, continue to write data to the expansion server that has not reached the second threshold;

If both reach the second threshold, write data to the auxiliary server itself and the other expansion servers, and stop writing data to the auxiliary server and other expansion servers until the storage space occupancy ratios of the auxiliary server and other expansion servers reach the first threshold. The auxiliary server and other expansion servers write data, wherein the second threshold is smaller than the first threshold.

The management server and auxiliary server in the cloud storage system will be further described below in conjunction with FIG. 4 .

Referring to Fig. 4, since the management server in the cloud storage system needs to manage the storage servers in the system, the management server may include:

A first data writing module, the first data writing module includes a first receiving unit and a first forwarding unit. The first receiving unit is used to receive data from the user, wherein the data includes file data, picture data and video data; the first forwarding unit is used to receive the scheduling instruction issued by the first data scheduling module , responsible for forwarding data;

The first data scheduling module is configured to schedule the data received by the first data writing module into a storage server in the cloud storage system, wherein the first data scheduling module includes: a data writing unit 304 and the first monitoring unit. Wherein, the write data unit 304 may write data to the storage server when detecting a request to write data to the storage server and the first monitoring unit detects that the storage server is in an online state; the write data The unit 304 may also write data to the auxiliary server when a request for writing data to the auxiliary server is detected, and the first monitoring unit detects that the operation state of the auxiliary server is online;

The first expansion server management module is configured to, according to the determination unit 301, the selection unit 302, the indication unit 303, the monitoring unit 305, the acquisition unit 306 and the sending unit included in the first expansion management module, within a preset time Registered to the expansion server of the management server for management, wherein, the functions of the determination unit 301, the selection unit 302, the indication unit 303, the monitoring unit 305, the acquisition unit 306 and the sending unit have been described in detail above, and here I won't go into details.

The secondary servers may include:

The second data writing module, the second data writing module includes a second receiving unit and a second forwarding unit; the second receiving unit is used to: receive the data written by the writing data unit 304 in the first expansion server management module The incoming data; the second forwarding unit is configured to forward the received data when receiving the scheduling instruction sent by the second data scheduling module;

The second data scheduling module is configured to schedule the data received by the second data writing module into a corresponding expansion server, wherein the second data scheduling module includes: a target write data unit and a second monitoring unit; the target write data unit can write data to the expansion server when detecting a write data request for writing data to the expansion server, and the second monitoring unit detects that the operation status of the expansion server is online;

An auxiliary server election module, configured to elect an auxiliary server from the at least two expansion servers;

The second expansion server management module is configured to receive the instruction issued by the first expansion server management module, and manage the second data writing module, data scheduling module, and auxiliary server election module according to the instruction, and is used for The storage space occupancy ratio of each expansion server is monitored, and the monitoring result is sent to the monitoring unit 305 in the management module of the first expansion server.

It should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is a relationship between these entities or operations. There is no such actual relationship or order between them. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.

Each embodiment in this specification is described in a related manner, the same and similar parts of each embodiment can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, as for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for the related parts, please refer to the part of the description of the method embodiment.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principles of the present invention are included in the protection scope of the present invention.

Claims (11)

1. A method for expanding capacity of a cloud storage system, characterized in that it is applied to a management server in the cloud storage system, comprising: determining at least two expansion servers registered to the management server within a preset time; Select an auxiliary server from the at least two expansion servers, and instruct the auxiliary server to manage the at least two expansion servers, wherein, before the auxiliary server is determined, the management server does not send to the preset Write data to any expansion server registered to the management server within a certain period of time; When a write data request is detected, write data to the auxiliary server, so that the auxiliary server writes the received data into the at least two expansion servers according to the load balancing principle; Monitoring the storage space occupancy ratio of the at least two expansion servers through the auxiliary server; When it is detected that the storage space occupancy ratios of the at least two expansion servers reach a first threshold, the management authority for managing the at least two expansion servers is acquired. 2. The method according to claim 1, wherein the step of selecting an auxiliary server from the at least two expansion servers comprises: Determining a target expansion server among the at least two expansion servers as an auxiliary server, and the target expansion server is the first expansion server registered with the management server within the preset time. 3. The method according to claim 1, wherein the step of selecting an auxiliary server from the at least two expansion servers comprises: selecting the expansion server selected by the at least two expansion servers as an auxiliary server, wherein the auxiliary server is selected by the at least two expansion servers based on the received storage performance parameters of each expansion server . 4. The method according to any one of claims 1-3, further comprising: before the step of writing data to the auxiliary server: Sending an initialization and/or formatting instruction to the auxiliary server, so that the auxiliary server can initialize and/or format each expansion server according to the received initialization and/or formatting instruction. 5. The method according to any one of claims 1-3, wherein the step of the auxiliary server writing the received data into the at least two expansion servers according to the load balancing principle comprises: The auxiliary server writes the received data into the auxiliary server itself and other expansion servers, and detects whether the storage space occupancy ratios of the auxiliary server and the other expansion servers reach a second threshold; If not, continue to write data to the expansion server that has not reached the second threshold; If both reach the second threshold, write data to the auxiliary server itself and the other expansion servers, and stop writing data to the auxiliary server and other expansion servers until the storage space occupancy ratios of the auxiliary server and other expansion servers reach the first threshold. The auxiliary server and other expansion servers write data, wherein the second threshold is smaller than the first threshold. 6. A cloud storage system expansion device, characterized in that it is applied to the management server in the cloud storage system, including: A determining unit, configured to determine at least two expansion servers registered to the management server within a preset time; a selection unit, configured to select an auxiliary server from the at least two expansion servers; An instructing unit, configured to instruct the auxiliary server to manage the at least two capacity expansion servers, wherein the management server does not register with the management server within the preset time before the auxiliary server is determined. Any expansion server writes data; A write data unit, configured to write data to the auxiliary server when a write data request is detected, so that the auxiliary server writes the received data into the at least two expansion servers according to the load balancing principle; A monitoring unit, configured to monitor the storage space occupancy ratio of the at least two expansion servers through the auxiliary server; The acquiring unit is configured to acquire management authority to manage the at least two expansion servers when it is detected that the storage space occupancy ratios of the at least two expansion servers reach a first threshold. 7. The device according to claim 6, wherein the selecting unit is specifically used for: Determining a target expansion server among the at least two expansion servers as an auxiliary server, and the target expansion server is the first expansion server registered with the management server within the preset time. 8. The device according to claim 6, wherein the selecting unit is specifically used for: selecting the expansion server selected by the at least two expansion servers as an auxiliary server, wherein the auxiliary server is selected by the at least two expansion servers based on the received storage performance parameters of each expansion server . 9. The device according to any one of claims 6-8, wherein the device further comprises: a sending unit, before the write data unit writes data to the auxiliary server, send an initialization and/or formatting instruction to the auxiliary server, so that the auxiliary server can use the received initialization and/or formatting instruction Instructions to initialize and/or format each expansion server. 10. The device according to any one of claims 6-8, wherein after the write data unit writes data to the auxiliary server, the auxiliary server writes the received data according to the principle of load balancing The step of adding the at least two expansion servers includes: The auxiliary server writes the received data into the auxiliary server itself and other expansion servers, and detects whether the storage space occupancy ratios of the auxiliary server and the other expansion servers reach a second threshold; If not, continue to write data to the expansion server that has not reached the second threshold; If both reach the second threshold, write data to the auxiliary server itself and the other expansion servers, and stop writing data to the auxiliary server and other expansion servers until the storage space occupancy ratios of the auxiliary server and other expansion servers reach the first threshold. The auxiliary server and other expansion servers write data, wherein the second threshold is smaller than the first threshold. 11. A cloud storage system, comprising a management server and multiple expansion servers, characterized in that the management server is used for: determining at least two expansion servers registered to the management server within a preset time; Select an auxiliary server from the at least two capacity expansion servers, and instruct the auxiliary server to manage the at least two capacity expansion servers, wherein the management server does not send information to the preset server before the auxiliary server is determined. Write data to any expansion server registered to the management server within a certain period of time; When a write data request is detected, write data to the auxiliary server, so that the auxiliary server writes the received data into the at least two expansion servers according to the load balancing principle; Monitoring the storage space occupancy ratio of the at least two expansion servers through the auxiliary server; When it is detected that the storage space occupancy ratios of the at least two expansion servers reach a first threshold, the management authority for managing the at least two expansion servers is obtained.