CN105516242A - Storage resource distribution method and storage resource distribution system - Google Patents

Abstract

The embodiment of the invention discloses a storage resource allocation method and a storage resource allocation system. The method includes: receiving a storage resource allocation request (carrying service type and service characteristic data), selecting a resource allocation algorithm for the target service from preset resource allocation algorithms according to the service type of the target service, and using the The service characteristic data of the target business is input, and the storage resource configuration data of the target business is calculated by using the selected resource allocation algorithm, and then the storage system is instructed to allocate storage resources conforming to the storage resource configuration data to the target business. The solution of the invention can automatically allocate storage resources for each business in the business system, thereby improving the efficiency of resource allocation.

Description

Method for allocating storage resources and system for allocating storage resources

technical field

The invention relates to the technical field of data center storage, in particular to a storage resource allocation method and a storage resource allocation system.

Background technique

The storage system is the core infrastructure of the data center (DataCenterNetwork, DCN) environment and the ultimate carrier of data access in the data center. With the development of cloud computing, the storage system can no longer be simply built according to general business operation requirements, but to achieve flexible resource scheduling, good scalability, flexibility for business expansion, and fast delivery for various business systems.

In the existing technology, in order to allocate different storage resources to different businesses and ensure the normal operation of each business system, the administrator needs to evaluate the storage resources required by each business according to the past usage of storage resources by each business, and then pass The manual configuration method allocates storage resources to each business.

However, to allocate storage resources through manual configuration, the administrator needs to spend a lot of time analyzing the past storage resource usage of each business, and the configuration process is complicated and inefficient.

Contents of the invention

Embodiments of the present invention provide a method for allocating storage resources and a system for allocating storage resources, which can automatically allocate storage resources for each service in the service system according to service characteristics, thereby improving the efficiency of resource allocation.

In the first aspect, a method for allocating storage resources is provided, including:

The storage resource allocation system receives the resource allocation request for the target business (including the business type of the target business and the service characteristic data of the target business), and selects from the preset algorithm set according to the business type of the target business A storage resource allocation algorithm for the target business; then, taking the service characteristic data of the target business as input, the storage resource allocation system uses the storage resource allocation algorithm corresponding to the target business to calculate the storage resource corresponding to the target business Resource configuration data; finally, the storage resource allocation system sends a resource configuration request to the storage system, the resource configuration request includes the storage resource configuration data, and the resource configuration request is used to indicate that the storage system will comply with the storage resource configuration Data storage resources are allocated to the target business.

Specifically, the preset algorithm set includes a plurality of storage resource allocation algorithms, wherein each storage resource allocation algorithm corresponds to a service type, and is used to calculate and obtain the storage resource configuration data corresponding to the service of the corresponding service type; the storage The resource configuration data may include: a first value for configuring storage capacity and a second value for configuring storage performance.

It can be understood that the method for allocating storage resources described in the first aspect can automatically allocate storage resources for the target service, improving the efficiency of resource allocation.

Specifically, after sending the storage resource configuration data to the storage system, the storage resource allocation system may also receive the storage resource configuration result returned by the storage system, and send the storage resource configuration result to the business system to allocate the allocated Notifying the service system of the storage resource of the target service, so that the target service running on the service system can use the storage resource represented by the storage resource configuration result.

With reference to the first aspect, in a first possible implementation manner, after sending a resource configuration request to a storage system, the storage resource allocation system may further: monitor usage of the allocated storage resources by the target service ; adjust the storage resource configuration data corresponding to the target service according to the usage; resend a resource configuration request to the storage system, the resent resource configuration request includes the adjusted storage resource configuration data, the The resent resource configuration request is used to instruct the storage system to allocate storage resources conforming to the adjusted storage resource configuration data to the target service.

It can be understood that by monitoring the actual usage of the allocated storage resources by the target business after allocating the storage resources to the target business, and adjusting the storage resources corresponding to the target business according to the actual usage, the final allocation can be guaranteed. The storage resources can meet the requirements of the target business, avoid waste of resources, and realize rational use of resources.

With reference to the first possible implementation manner of the first aspect, in a second possible implementation manner, the adjusting the storage resource configuration data corresponding to the target service according to the usage situation includes: adjusting the storage resource configuration data according to the usage situation A storage resource allocation algorithm corresponding to the target service; taking the service characteristic data of the target service as input, and calculating the adjusted storage resource configuration data corresponding to the target service by using the adjusted storage resource allocation algorithm.

It can be understood that by adjusting the storage resource allocation algorithm corresponding to the target service according to the actual use of the allocated storage resources by the target service, the storage resource allocation algorithm can be trained so that the storage resource allocation The calculation result of the algorithm is closer to the storage resources actually required by the target business, which further ensures the reasonable allocation and utilization of storage resources.

With reference to the second possible implementation of the first aspect, the adjusting the storage resource allocation algorithm corresponding to the target service according to the usage may include the following possible implementations:

If the usage situation indicates that the allocated storage capacity of the storage resource does not meet the requirements of the target business, then in the storage resource allocation algorithm corresponding to the target business, increase the positive correlation variable of the storage capacity and the storage The degree of positive correlation of capacity, or, the variable that reduces the negative correlation of storage capacity and the degree of negative correlation of storage capacity.

If the usage situation shows that the storage performance of the allocated storage resource does not meet the requirements of the target business, then in the storage resource allocation algorithm corresponding to the target business, the positively correlated variable that improves the storage performance and the storage The degree of positive correlation of performance, or the degree of negative correlation of variables that reduce storage performance and the degree of negative correlation of storage performance.

If the usage situation indicates that the ratio of the storage capacity of the storage resource actually used by the target service to the allocated storage capacity of the storage resource is lower than the first threshold, then the allocation of the storage resource corresponding to the target service In the algorithm, the degree of positive correlation between the positive correlation variable of storage capacity and storage capacity is reduced, or the negative correlation degree of negative correlation variable of storage capacity and storage capacity is increased.

If the usage situation indicates that the ratio of the storage performance of the storage resource actually used by the target business to the storage performance of the allocated storage resource is lower than a second threshold, then allocate the storage resource corresponding to the target business In the algorithm, the positive correlation variable that reduces the storage performance is positively correlated with the storage performance, or the negative correlation variable that improves the storage performance is negatively correlated with the storage performance.

In combination with the third possible implementation of the first aspect, improving the degree of positive correlation between the positively correlated variable of the calculation result (storage capacity or storage performance) and the calculation result may include at least the following two possible implementations: by increasing the The coefficient of the positive correlation variable is used to increase the degree of positive correlation between the positive correlation variable and the calculation result; the degree of positive correlation between the positive correlation variable and the calculation result is increased by increasing the index of the positive correlation variable.

Reducing the degree of positive correlation between the positive correlation variable of the calculation result (storage capacity or storage performance) and the calculation result may include at least the following two possible implementations: reducing the coefficient of the positive correlation variable and The positive correlation degree of the calculation result; the positive correlation degree between the positive correlation variable and the calculation result is reduced by reducing the index of the positive correlation variable.

Similarly, improving the degree of negative correlation between the negative correlation variable of the calculation result (storage capacity or storage performance) and the calculation result may include at least the following two possible implementations: increasing the coefficient of the negative correlation variable to increase the negative correlation The degree of negative correlation between the related variable and the calculation result; the degree of negative correlation between the negative related variable and the calculation result is changed by increasing the index of the negative related variable.

Reducing the degree of negative correlation between the negative correlation variable of the calculation result (storage capacity or storage performance) and the calculation result may include at least the following two possible implementations: reduce the negative correlation variable and the negative correlation variable by reducing the coefficient of the negative correlation variable The degree of negative correlation of the calculation result; reducing the negative correlation degree of the negative correlation variable and the calculation result by reducing the index of the negative correlation variable.

In a second aspect, a storage resource allocation system is provided, and the storage resource allocation system includes a module for executing the method described in the first aspect.

A third aspect provides a server configured to execute the method for allocating storage resources described in the first aspect. The server includes: an input device, an output device, a transceiver device, a memory, and a processor coupled to the memory, wherein the input device is used to receive input data from an administrator, and the output device is used to output data externally, The transceiver device is used for data communication with the business system or the storage system, the memory is used to store the implementation code of the storage resource allocation method described in the first aspect, and the processor is used to execute the The program code executes the storage resource allocation method described in the first aspect.

According to a fourth aspect, a computer-readable storage medium is provided, the program code for implementing the storage resource allocation method described in the first aspect is stored on the readable storage medium, and the program code includes running the storage resource allocation method described in the first aspect Method execution instructions.

In the fifth aspect, a preset algorithm set is provided, and the preset algorithm set may include multiple storage resource allocation algorithms, and the multiple storage resource allocation algorithms are based on empirical data of each service type (including service characteristic data, existing The storage capacity and storage performance of the allocated storage resources) are obtained through analysis and modeling. Wherein, each storage resource allocation algorithm corresponds to a business type, and is used to calculate the storage resource configuration data corresponding to the business of the corresponding business type; the storage resource allocation algorithm may include: a first algorithm and a second algorithm, wherein: the first An algorithm is used to calculate storage capacity, that is, the first value in the storage resource configuration data, and a second algorithm is used to calculate storage performance, that is, the second value in the storage resource configuration data.

In some possible implementations of the present invention, the storage resource allocation request may be a request sent by the administrator to the storage resource allocation system through the working software provided by the storage resource allocation system, or it may be a request sent directly from the business system to the storage resource allocation system The request sent.

In some possible implementations of the present invention, the business characteristic data may include: business scale, data representing business volatility (such as the daily peak transaction volume of online banking business), business data storage time and other data representing business characteristics .

In some possible implementations of the present invention, the storage capacity may be represented by the capacity of a single storage volume and the number of storage volumes; the storage performance may include: input/output operations per second (IOPS), bandwidth, I /O delay, etc.

Implementing the embodiment of the present invention, after the storage resource allocation system receives the storage resource allocation request (carrying service type and service characteristic data), according to the service type of the target service, it selects the resource allocation algorithm for the target according to the service type of the target service. The resource allocation algorithm of the business, and use the business characteristic data of the target business as input, use the selected resource allocation algorithm to calculate the storage resource configuration data of the target business, and then instruct the storage system to conform to the storage resource configuration data Storage resources for configuration data are allocated to the target service. The scheme of the invention can automatically allocate storage resources for each business in the business system according to the business characteristics, thereby improving the efficiency of resource allocation.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present invention more clearly, the following will briefly introduce the drawings that need to be used in the description of the embodiments.

FIG. 1 is a schematic diagram of a network architecture of a data center involved in an embodiment of the present invention;

FIG. 2 is a schematic flowchart of a method for allocating storage resources provided by an embodiment of the present invention;

FIG. 3 is a schematic diagram of service characteristic data of several service types involved in an embodiment of the present invention;

FIG. 4 is a schematic flowchart of another method for allocating storage resources provided by an embodiment of the present invention;

FIG. 5 is a block diagram of a storage resource allocation system provided by an embodiment of the present invention;

Fig. 6 is a schematic structural diagram of a server provided by an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention will be clearly described below with reference to the drawings in the embodiments of the present invention. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them.

In order to facilitate the understanding of the embodiments of the present invention, the application scenarios involved in the embodiments of the present invention and the technical problems existing in the application scenarios will be described in detail below with reference to FIG. 1 .

FIG. 1 shows a basic network architecture of a data center involved in an embodiment of the present invention, where a storage system provides storage support for a business system.

The storage architecture of the storage system may be cloud storage to implement distributed data storage and management. More optimally, the storage architecture of the storage system can also be software-defined storage (SoftwareDefinedStorage, SDS), that is, the separation of software and hardware in the storage architecture, that is, the separation of the data layer and the control layer, and the management of storage resources is realized through software. And scheduling, such as flexible volume migration, without considering the hardware device itself.

In the embodiment of the present invention, the network structure of the storage system may include: direct-attached storage (DirectAttachedStorage, DAS), network-attached storage (NetworkAttachedStorage, NAS), and storage area network (StorageAreaNetwork, SAN). At present, for the working environment with large storage capacity such as data center, SAN is usually widely used. As shown in Figure 1, the SAN can be an IPSAN whose transmission medium is an IP network, or an FC (Fiber Channel) SAN whose transmission medium is an optical fiber.

In the embodiment of the present invention, the storage array in the storage system may include storage media of various storage types, such as solid state drives (Solid State Drive, SSD), serial attached SCSI (Serial Attached SCSI, SAS) hard drives, mechanical hard drives, and the like.

Business systems usually include multiple business platforms to meet various business needs of users. It is understandable that different types of services usually have different requirements for storage resources, which are mainly reflected in storage capacity and storage performance. For example, financial services have relatively high requirements for data storage response speed, that is, high requirements for input/output operations per second (IOPS) of storage resources. For another example, due to the large amount of service data, the storage capacity required by the video surveillance service is relatively large.

In the prior art, when allocating storage resources, an administrator needs to fully consider the requirements of different types of services on storage capacity and storage performance. In the embodiment of the present invention, in addition to the aforementioned IOPS, the storage performance of the storage resource also includes: read and write bandwidth, fault tolerance performance (that is, fault recovery capability), and the like.

In practice, the administrator needs to collect the actual usage of storage resources by each business in the past, and analyze the storage resource requirements of each business based on this. Obviously, this way of working takes a lot of time and the analysis process is complicated.

Aiming at the problems existing in the prior art, as shown in FIG. 1 , the embodiment of the present invention adds a storage resource allocation system to the existing data center network architecture, and provides a storage resource allocation method. In the solution of the present invention, after the storage resource allocation system receives the storage resource allocation request (carrying the service type and service feature data), it selects the target service from the preset resource allocation algorithm according to the service type of the target service resource allocation algorithm, and use the service characteristic data of the target business as input, use the selected resource allocation algorithm to calculate the storage resource configuration data of the target business, and then instruct the storage system to conform to the storage resource configuration data The storage resources allocated to the target business. The scheme of the invention can automatically allocate storage resources for each business in the business system according to the business characteristics, thereby improving the efficiency of resource allocation. Each will be described in detail below.

Referring to FIG. 2 , FIG. 2 shows a schematic flowchart of a method for allocating storage resources provided by an embodiment of the present invention. The methods include:

S101, the administrator sends a storage resource allocation request for a target service to the storage resource allocation system through working software provided by the storage resource allocation system. Correspondingly, the storage resource allocation system receives a storage resource allocation request for the target service. The request includes: the service type of the target service and the service feature data of the target service.

In a possible implementation manner of the embodiment of the present invention, the storage resource allocation request may also be sent by the service system.

S103. After receiving the storage resource allocation request, the storage resource allocation system may select a storage resource allocation algorithm for the target service from a preset algorithm set according to the service type of the target service. Specifically, the preset algorithm set includes a plurality of storage resource allocation algorithms, wherein each storage resource allocation algorithm corresponds to a service type, and is used to calculate storage resource configuration data corresponding to the service of the corresponding service type. Here, the storage resource configuration data may include: a first value for configuring storage capacity and a second value for configuring storage performance.

S105, the storage resource allocation system may use the service characteristic data of the target service as input, and use the storage resource allocation algorithm selected in S103 to calculate and obtain the storage resource configuration data corresponding to the target service. Here, the business characteristic data may include: business scale, data representing business volatility (such as daily peak transaction volume of online banking business), business data storage time and other data representing business characteristics, etc.

S107, the storage resource allocation system may send a resource configuration request to the storage system, where the resource configuration request includes the storage resource configuration data.

S109. Correspondingly, the storage system receives the resource configuration request sent by the storage resource allocation system, and in response to the resource configuration request, allocates storage resources conforming to the storage resource configuration data to the target service.

Specifically, before allocating storage resources to the target service, the storage system may obtain status information of all storage arrays in the storage system, and select storage resources that conform to the storage resource configuration data according to the status information. For example, the state information of the storage array in the storage system is shown in Table 1:

storage volume bandwidth media type RAID level writable capacity Network Type Volume 1 0.1GB/S SSD RAID0 8.5GB IP SAN Volume 2 0.5GB/S SAS RAID3 15GB FC SAN … … … … … …

Table 1

For example, the first value in the storage resource configuration data indicates that the storage capacity required by the target service is: 8GB, and the second value in the storage resource configuration data indicates that the storage bandwidth required by the target service is: 0.3 GB/S, then, according to the storage status information of the storage system shown in Table 1, the storage system can allocate "Volume 2" to the target service. The example is only an implementation of the embodiment of the present invention, which may be different in actual applications. For example, the storage system may also allocate multiple storage volumes to one service, which should not be construed as a limitation.

It should be noted that Table 1 is only an implementation manner of the embodiment of the present invention, which may be different in actual applications and should not be construed as a limitation.

S111. After allocating storage resources to the target service, the storage system may also return a storage resource configuration result to the storage resource allocation system. Specifically, the storage resource configuration result may mainly include: capacity information and location information of the allocated storage resources. Further, the storage resource configuration result may also include: storage type of the allocated storage resource, read/write performance (such as IOPS, I/O delay, bandwidth), interface type, and the like.

S113. Correspondingly, the storage resource allocation system receives the storage resource configuration result returned by the storage system, and sends the storage resource configuration result to the business system, so as to inform the business system of the storage resource allocated to the target business, so that The target service running on the service system can use the storage resource represented by the storage resource configuration result.

For example, the service system determines the address for reading and writing data according to the location information of the allocated storage resources (such as the number of the storage volume) in the configuration result. For another example, the service system determines the appropriate storage protocol according to the storage type and interface type of the allocated storage resources. The example is only an implementation of the embodiment of the present invention, which may be different in actual application, and should not be construed as a limitation.

S115. Preferably, after receiving the storage resource configuration result, the business system can also generate a mapping item of the allocated storage resource according to the storage resource configuration result, so that the target business can intuitively use the allocated storage resources. It should be understood that the mapping item is a reference to the allocated storage resource. In a specific implementation, the mapping item may be represented as a virtual storage disk (such as a virtual disk letter) on the service system server.

S117. Optionally, after generating the mapping item of the allocated storage resource, the business system may return the execution result to the storage resource allocation system. Optionally, if the service system does not execute S115, the service system may only return a reception response for the storage resource configuration result to the storage resource allocation system.

S119, finally, optionally, the storage resource allocation system may return the storage resource configuration result to the administrator.

In an implementation manner, the administrator's work software (software for submitting resource allocation requests of various services) can directly run on the storage resource allocation system. The storage resource allocation system may output the storage resource configuration result to the working software.

In another implementation manner, the administrator's working software may run on a communication device interconnected with the storage resource allocation system. The storage resource allocation system may send the storage resource configuration result to the communication device. Here, interconnection means that there is a communication connection between the communication device and the storage resource allocation system.

The storage resource allocation algorithm in the embodiment of the present invention is described in detail below.

In the embodiment of the present invention, the storage resource allocation algorithm is used to calculate the storage resource configuration data required by a service. The storage resource configuration data includes: a first value for configuring storage capacity and a second value for configuring storage performance.

In the embodiment of the present invention, the storage capacity can be represented by the capacity of a single storage volume and the number of storage volumes; the storage performance can include: the number of input and output operations per second, bandwidth, I/O delay, and the like. Then, the first numerical value above can be expressed as: {LunSize,LunNum}, where LunSize represents the capacity of a single storage disk, and LunNum represents the number of storage disks; the second numerical value above can be represented as: {rIOPS, wIOPS, BandWidth, ioDelay,...}, rIOPS represents the number of read operations per second, wIOPS represents the number of write operations per second, BandWidth represents bandwidth, and ioDelay represents I/O delay.

It can be understood that the storage resources required by a service are related to the service characteristics of the service. Therefore, the storage capacity and storage performance required by a business can be expressed by the following mathematical model:

Storage capacity = f (service characteristic data)

Storage performance = g (business characteristic data)

Wherein, f and g respectively indicate that the variable is a function of the service characteristic data.

The service feature data can be represented by a set C, namely: C={c1, c2, c3, . . . }. For services of different service types, the service feature data may be different, that is, the elements in the set C are different. As shown in Figure 3, the business characteristic data of online banking business includes not only the business scale, but also business characteristics such as the number of single transactions, the data volume of each user for 3 years, and the percentage of peak active users; the business characteristic data of the video business not only includes the business scale , also includes: storage time, bit rate fluctuation coefficient and other service characteristics. It can be understood that the required storage capacity and storage performance of the online banking service are related to the service characteristic data of the aforementioned online banking service, and the required storage capacity and storage performance of the service characteristic data of the video service are related to the aforementioned service characteristic data of the video service.

During specific implementation, the storage resource allocation algorithm corresponding to each business type can be established based on the empirical data of each business type, namely: historical service characteristic data and the storage capacity and storage performance of the allocated historical storage resources.

For example, after analyzing the empirical data of the online banking business, the storage resource allocation algorithm for the online banking business is established as follows:

LunSize=businessScale*10000*numPerBusiness/10^6)*2*120%;

LunNum＝((businessScale*10000*numPerBusiness/10^6)*2*120%)/240;

rIOPS=(businessScale*10000*numPerBusiness*pctPeak*elpsPerTran/peakHour/60)*0.5*0.1;

wIOPS=(businessScale*10000*numPerBusiness*pctPeak*elpsPerTran/peakHour/60)*0.5*2;

Among them, businessScale represents the number of registered users, numPerBusiness represents the daily transaction volume per person, pctPeak represents the percentage of peak active users, elpsPerTran represents the online time per transaction, and peakHour represents the daily peak time.

It should be noted that the foregoing example is only an implementation manner of the embodiment of the present invention, which may be different in actual applications, and should not be construed as a limitation. In addition to the above-mentioned rIOPS and wIOPS, other storage performance (such as BandWidth and ioDelay) required by the online banking business can also be obtained by modeling the empirical data of the online banking business.

It can be seen from the above that the storage resource allocation algorithm in the embodiment of the present invention may include: a first algorithm and a second algorithm, wherein: the first algorithm is used to calculate the storage capacity, that is, the first value in the storage resource configuration data , the second algorithm is used to calculate the storage performance, that is, the second value in the storage resource configuration data. Specifically, for the online banking business of the aforementioned example, the first algorithm can be expressed as an algorithm set A1={a11, a12}, where a11 and a12 can represent algorithms for calculating LunSize and LunNum respectively; the same , the second algorithm can be expressed as an algorithm set A2={a21, a22, a23, a24}, where a21, a22, a23 and a24 can respectively represent algorithms for calculating rIOPS, wIOPS, BandWidth and ioDelay.

It should be noted that for services of different service types, the algorithm set A1 representing the first algorithm may be different, and the algorithm set A2 representing the second algorithm may also be different.

Since the storage resource allocation algorithm in the preset algorithm set is obtained by analyzing and modeling empirical data of each service type, the storage resource allocation algorithm corresponding to the target service in the preset algorithm set is used to calculate There may be a discrepancy between the storage resource represented by the obtained storage resource configuration data and the storage resource currently actually required by the target service.

In order to ensure reasonable allocation and utilization of storage resources, in a further embodiment, a storage resource allocation algorithm for the target service is selected from the preset algorithm set, and the target service is calculated according to the selected algorithm. After storing the resource configuration data and instructing the storage system to allocate storage resources conforming to the storage resource configuration data to the target service, the storage resource allocation system may also: monitor the actual allocation of the target service to the allocated storage resource usage, adjust the storage resource configuration data corresponding to the target business according to the actual usage, and finally send the adjusted storage resource configuration data to the storage system, so that the storage system will comply with the adjusted configuration data The storage resource of the storage resource configuration data is allocated to the target service.

Specifically, as shown in FIG. 4, after allocating the storage resource conforming to the storage resource configuration data to the target service, the storage resource allocation method provided by the embodiment of the present invention may further include:

S121. The storage resource allocation system collects the actual use of storage resources by the target service from the storage system.

S123. Correspondingly, the storage system returns the actual usage of the storage resource by the target service to the storage resource allocation system.

In a specific implementation, the storage system may record the actual usage of the storage resource by the target business (occupied capacity, data reading and writing log information, etc.) in a log file. Further, in order to verify the use of storage resources collected from the storage system, the storage resource allocation system may also collect the actual use of storage resources by the target business from the business system, and compare the data collected from the above two places. Whether the actual usage conditions are consistent, if they are consistent, it is determined that the collected actual usage conditions are correct, otherwise, S121 may be re-executed until the collection result is correct.

S125. After receiving the actual usage of storage resources by the target business, the storage resource allocation system may adjust the storage resource allocation algorithm corresponding to the target business according to the actual usage, and use the adjusted storage resource allocation algorithm After calculating the adjusted storage resource configuration data corresponding to the target service, the storage resource configuration data corresponding to the target service can be adjusted according to the actual usage, and the storage resource allocation algorithm can be trained, so that The calculation result of the storage resource allocation algorithm is closer to the storage resources actually required by the target business, further improving the reasonable allocation and utilization of storage resources.

S127. The storage resource allocation system may resend a resource configuration request to the storage system, and the resent resource configuration request includes the adjusted storage resource configuration data corresponding to the target service, and is used to reconfigure the storage resource corresponding to the target service. resource.

S129. Correspondingly, the storage system receives the resent resource configuration request, responds to the resource configuration request, and adjusts the storage resource corresponding to the target service according to the adjusted storage resource configuration data.

S131. After adjusting the storage resource corresponding to the target service, the storage system may also return the adjustment result to the storage resource allocation system. Specifically, the adjustment result may mainly include: capacity information and location information of the storage resource after adjustment. Further, the adjustment result may further include: storage type of the adjusted storage resource, read/write performance (such as IOPS, I/O delay, bandwidth), interface type, and the like.

S133. After receiving the adjustment result returned by the storage system, the storage resource allocation system may send the adjustment result to the business system, so as to inform the business system of the adjusted storage resources of the target business, so that the running The target service on the system can use the adjusted storage resources.

S135. Optionally, the storage resource allocation system may also send the adjustment result to the service system.

It should be understood that if the adjustment result indicates that the storage system reclaims or expands storage resources for the target business, the business system only needs to change the mapping relationship between the target business and the storage resources in the storage system without changing the business system The mapping item (such as a virtual drive letter) of the allocated storage resource generated on the above.

In the embodiment of the present invention, the storage resource allocation system can generally adjust the storage resource allocation algorithm corresponding to the target service through the following implementation methods:

If the actual usage shows that the storage capacity of the storage resources allocated to the target business does not meet the needs of the target business, then in the storage resource allocation algorithm corresponding to the target business, increase the positive correlation variable of storage capacity The degree of positive correlation with storage capacity, or, the variable that reduces the negative correlation with storage capacity.

If the actual usage shows that the storage performance allocated to the target business does not meet the needs of the target business, then in the storage resource allocation algorithm corresponding to the target business, the positive correlation variable and storage performance of the storage performance are improved The degree of positive correlation of , or, the degree of negative correlation between variables that reduce storage performance and the degree of negative correlation of storage performance.

If the actual usage indicates that the ratio of the storage capacity of the storage resources actually used by the target business to the storage capacity of the storage resources allocated to the target business is lower than the first threshold, that is, the target business is not fully utilized allocated storage capacity, in the storage resource allocation algorithm corresponding to the target business, reduce the degree of positive correlation between the positive correlation variable of storage capacity and storage capacity, or increase the negative correlation between the negative correlation variable of storage capacity and storage capacity Relevance.

If the actual usage indicates that the ratio of the storage performance of the storage resource actually used by the target service to the storage performance of the allocated storage resource is lower than the second threshold, that is, the target service does not fully utilize the If the allocated storage performance is allocated, in the storage resource allocation algorithm corresponding to the target business, the degree of positive correlation between the positively correlated variable of storage performance and storage performance is reduced, or the degree of negative correlation between the negatively correlated variable of storage performance and storage performance is increased .

It should be understood that a positive correlation means that one variable changes in the same direction as another variable changes (two variables become larger or smaller at the same time). For example, y=a*x (the constant a is greater than 0), then the variable y is positively correlated with the variable x, wherein the larger a is, the higher the degree of positive correlation between y and x. For another example, g=x ^b (the constant b is greater than 0), then the variable g is positively correlated with the variable x (x>0), wherein the larger b is, the higher the degree of positive correlation between g and x is.

It should be understood that a negative correlation means that one variable changes in the opposite direction as another variable changes. For example, y=a*x (the constant a is less than 0), then the variable y is negatively correlated with the variable x, wherein the smaller a is, the higher the degree of negative correlation between y and x. For another example, g=x ^b (the constant b is less than 0), then the variable g is negatively correlated with the variable x (x>0), wherein the smaller b is, the higher the negative correlation between g and x is.

The following uses the storage resource allocation algorithm corresponding to the aforementioned online banking business as an example to illustrate:

From the storage capacity calculation algorithm: LunSize=businessScale*10000*numPerBusiness/10^6)*2*120%, it can be known that businessScale and numPerBusiness are positively correlated variables of LunSize.

In the specific implementation, if the LunSize calculated by the storage capacity algorithm cannot meet the storage capacity requirements of the online banking service, then, it can be increased by "10000", "2", "1/10^6" and "120%" Equal constant coefficients to improve the positive correlation between LunSize and businessScale and numPerBusiness.

In the specific implementation, if the online banking service cannot make full use of the storage capacity represented by LunSize, then it can be reduced by reducing constant coefficients such as "10000", "2", "1/10^6" and "120%". The degree of positive correlation between LunSize and businessScale, numPerBusiness.

In practical applications, in addition to changing the positive correlation degree between the positive correlation variable and the calculation result by changing the coefficient of the positive correlation variable, the positive correlation degree between the positive correlation variable and the calculation result can also be changed by changing the index of the positive correlation variable.

For example, by changing the aforementioned storage capacity algorithm to: LunSize=businessScale ² *10000*numPerBusiness ² /10^6)*2*120%, the degree of positive correlation between LunSize, businessScale and numPerBusiness is increased. For another example, the degree of positive correlation between LunSize, businessScale and numPerBusiness is reduced by changing the aforementioned storage capacity algorithm to: LunSize=businessScale ^0.5 *10000*numPerBusiness ^0.5 /10^6)*2*120%. The example is only an implementation of the embodiment of the present invention, which may be different in actual application, and should not be construed as a limitation. In practical applications, other ways can also be adopted to change the degree of positive correlation between the positive correlation variable and the calculation result, which is not limited by the embodiment of the present invention.

Similarly, from the calculation algorithm of the number of read operations per second (one of storage performance): rIOPS=(businessScale*10000*numPerBusiness*pctPeak*elpsPerTran/peakHour/60)*0.5*0.1, businessScale, numPerBusiness, pctPeak and elpsPerTran are all is a positively correlated variable of rIOPS, and peakHour is a negatively correlated variable of rIOPS.

In specific implementation, if the rIOPS calculated by the aforementioned algorithm cannot meet the requirements of the online banking service for storage read performance, then the degree of positive correlation between the positive correlation variable and rIOPS can be improved by increasing the constant coefficient (or index) of the positive correlation variable , the degree of negative correlation between the negative correlation variable and rIOPS can also be reduced by reducing the constant coefficient (or index) of the negative correlation variable.

In specific implementation, if the actual number of read operations per second of the online banking service is far less than the rIOPS calculated by the aforementioned algorithm, then the positive relationship between the positive correlation variable and rIOPS can be reduced by reducing the constant coefficient (or index) of the positive correlation variable. The degree of correlation can also be increased by increasing the constant coefficient (or index) of the negative correlation variable to increase the negative correlation between the negative correlation variable and rIOPS.

Similarly, other storage resource allocation algorithms (such as calculation algorithms such as LunNum, wIOPS, BandWidth, and ioDelay) can also be adjusted with reference to the above-mentioned implementation methods, and details will not be repeated here.

In a possible implementation of the present invention, after the actual use of storage resources by the target service is collected, in addition to adjusting the storage resource allocation algorithm corresponding to the target service and recalculating the target service In addition to the storage resource configuration data (i.e. S125), the storage resource allocation system can also directly adjust (directly increase or decrease the value) the storage resource configuration data calculated in S105 according to the actual usage of the storage resources by the target business , and send the adjusted storage resource configuration data to the storage system, so that the storage system adjusts the storage resource corresponding to the target service.

Implementing the embodiment of the present invention, after receiving the storage resource allocation request, the storage resource allocation system selects a resource allocation algorithm for the target service from preset resource allocation algorithms according to the service type of the target service, and uses the The service characteristic data of the target business is input, and the storage resource configuration data of the target business is calculated by using the selected resource allocation algorithm, and then the storage system is instructed to allocate storage resources conforming to the storage resource configuration data to the The target business can automatically allocate storage resources for each business in the business system, improving the efficiency of resource allocation. In addition, after allocating storage resources conforming to the storage resource configuration data to the target business, the storage resource allocation algorithm corresponding to the target business may also be adjusted according to the actual usage of the allocated storage resources by the target business , the storage resource allocation algorithm can be trained, so that the calculation result of the storage resource allocation algorithm is closer to the storage resources actually required by the target business, further ensuring the reasonable allocation and utilization of storage resources.

In order to cooperate with the implementation of the storage resource allocation algorithm provided by the embodiment of the present invention, the embodiment of the present invention provides a storage resource allocation system, which is used to implement the specific steps in the method embodiments respectively corresponding to FIG. 2 or FIG. 4 . As shown in FIG. 5 , the storage resource allocation system may include: a receiving module 501 , an algorithm selection module 503 , a calculation module 505 and a resource configuration module 507 . in:

A receiving module 501, configured to receive a resource allocation request for a target service; the request includes a service type of the target service and service characteristic data of the target service;

The algorithm selection module 503 is configured to select a storage resource allocation algorithm for the target service from the preset algorithm set 520 according to the service type of the target service; the preset algorithm set 520 includes a plurality of storage resource allocation algorithms, wherein , each storage resource allocation algorithm corresponds to a business type, and is used to calculate storage resource configuration data corresponding to the business of the corresponding business type; the storage resource configuration data may include: a first value for configuring storage capacity and a value for configuring a second value for storage performance;

The calculation module 505 is configured to use the service characteristic data of the target service as input, and use the storage resource allocation algorithm corresponding to the target service to calculate and obtain the storage resource configuration data corresponding to the target service;

The resource configuration module 507 is configured to send the storage resource configuration data to a storage system, so that the storage system allocates storage resources conforming to the storage resource configuration data to the target service.

Since the storage resource allocation algorithm in the preset algorithm set 520 is obtained by analyzing and modeling empirical data of each business type, the calculation module 505 uses the storage resource allocation algorithm corresponding to the target business in the preset algorithm set 520 There may be discrepancies between the storage resources represented by the calculated storage resource configuration data and the storage resources currently actually required by the target business.

In order to ensure reasonable allocation and utilization of storage resources, further, the storage resource allocation system may further include: a monitoring module 509 and Adjustment module 511, wherein:

The monitoring module 509 is configured to monitor the storage resource configuration data after the resource configuration module 507 sends the storage resource configuration data to the storage system, so that the storage system allocates storage resources conforming to the storage resource configuration data to the target service data. The usage of the allocated storage resources by the target business;

The adjustment module 511 is configured to adjust the storage resource configuration data corresponding to the target service according to the actual usage monitored by the monitoring module 509, and trigger the resource configuration module 507 to send the adjusted storage resource configuration data to the storage system, The storage system is configured to allocate storage resources conforming to the adjusted storage resource configuration data to the target service.

In a specific implementation, the adjustment module 511 can adjust the storage resource allocation algorithm corresponding to the target service according to the actual usage monitored by the monitoring module 509, and trigger the calculation module 505 to take the service characteristic data of the target service as input, and use the adjusted The adjusted storage resource configuration data corresponding to the target service is calculated by the storage resource allocation algorithm, which can adjust the storage resource configuration data corresponding to the target service according to the actual usage situation, and can realize the allocation of the storage resource The algorithm is trained so that the calculation result of the storage resource allocation algorithm is closer to the storage resources actually required by the target business, further improving the reasonable allocation and utilization of storage resources.

Specifically, reference may be made to the relevant content in the embodiment in FIG. 2 for several implementation manners of adjusting the storage resource allocation algorithm corresponding to the target service by the adjustment module 511 , which will not be repeated here.

It should be noted that each software module described above may be composed of submodules that execute more detailed substeps in the method embodiment in FIG. 2 or FIG. 4 , which is not limited here.

In order to facilitate the implementation of the embodiments of the present invention, the present invention provides a server configured to implement the method for allocating storage resources described in the embodiment in FIG. 2 or FIG. 4 . Referring to Fig. 6, the server 60 may include: an input device 603, an output device 604, a transceiver 605, a memory 602 and a processor 601 coupled with the memory 602 (the number of processors 601 in the server 60 may be one or more, Fig. 6 with one processor as an example). In some embodiments of the present invention, the input device 603 , the output device 604 , the transceiver device 605 , the memory 602 and the processor 601 may be connected via a bus or in other ways, wherein connection via a bus is taken as an example in FIG. 6 .

Wherein, the input device 603 is used for receiving external input data. In a specific implementation, the input device 101 may include a keyboard, a mouse, a photoelectric input device, an audio input device, a touch input device, a scanner, and the like. The output device 604 is configured to output data externally. In a specific implementation, the output device 604 may include a display, a speaker, a printer, and the like. Transceiving means 605, configured to send data to other devices or receive data from other devices. In a specific implementation, the transceiver device 605 may include a wireless transceiver module, a wired transceiver module and other transceiver devices. The memory 602 is used to store program codes. In a specific implementation, the memory 602 can be a read-only memory (ReadOnlyMemory, ROM), which can be used to store program codes for implementing the method embodiments respectively corresponding to the aforementioned FIG. 2 or FIG. 4 . The processor 601, such as a CPU, is used to call the program code stored in the memory 602 to perform the following steps:

Receive the resource allocation request for the target business submitted by the administrator through the input device 603; the request includes the business type of the target business and the business characteristic data of the target business;

According to the business type of the target business, select a storage resource allocation algorithm for the target business from a preset algorithm set; the preset algorithm set includes a plurality of storage resource allocation algorithms, wherein each storage resource allocation algorithm Corresponding to a business type, it is used to calculate the storage resource configuration data corresponding to the business of the corresponding business type; the storage resource configuration data may include: a first value for configuring storage capacity and a second value for configuring storage performance ;

Using the service characteristic data of the target service as input, using the storage resource allocation algorithm corresponding to the target service, to calculate and obtain the storage resource configuration data corresponding to the target service;

The storage resource configuration data is sent to the storage system through the transceiver 605, so that the storage system allocates storage resources conforming to the storage resource configuration data to the target service.

In the embodiment of the present invention, after sending the storage resource configuration data to the storage system through the transceiver device 605, the processor 601 can also receive the storage resource configuration result sent by the storage system through the transceiver device 605, and send the data to the business system through the transceiver device 605. Sending the storage resource configuration result is used to inform the service system of the storage resource allocated to the target service, so that the target service running on the service system can use the storage resource indicated by the storage resource configuration result.

It should be noted that the business system is the business system in FIG. 1 , and the storage system is the storage system in FIG. 1 .

In the embodiment of the present invention, the storage resource allocation algorithm is used to calculate the storage resource configuration data required by a service. It can be understood that the storage resources required by a service are related to the service characteristics of the service. During specific implementation, a storage resource allocation model corresponding to each type of business can be established based on the empirical data of each type of business, namely: historical service characteristic data and the storage capacity and storage performance of the allocated historical storage resources.

Since the storage resource allocation algorithm in the preset algorithm set is obtained by analyzing and modeling empirical data of each service type, the processor 601 uses the storage resource corresponding to the target service in the preset algorithm set There may be discrepancies between the storage resources represented by the storage resource configuration data calculated by the allocation algorithm and the storage resources actually required by the target business at present.

In order to ensure reasonable allocation and utilization of storage resources, after allocating storage resources conforming to the storage resource configuration data to the target service, the processor 601 may also monitor the allocation of the storage resources by the target service actual usage, and adjust the storage resource configuration data corresponding to the target service according to the actual usage, and finally send the adjusted storage resource configuration data to the storage system through the transceiver device 605, so that the storage system will The storage resources conforming to the adjusted storage resource configuration data are allocated to the target service.

Specifically, the processor 601 may adjust the storage resource allocation algorithm corresponding to the target service according to the actual usage, and use the adjusted storage resource allocation algorithm to calculate the adjusted storage resource configuration data corresponding to the target service, It is possible to adjust the storage resource configuration data corresponding to the target business according to the actual usage, and to train the storage resource allocation algorithm so that the calculation result of the storage resource allocation algorithm is closer to the actual situation of the target business. It can further improve the reasonable allocation and utilization of storage resources.

Specifically, for an implementation manner in which the processor 601 adjusts the storage resource allocation algorithm corresponding to the target service, reference may be made to relevant content in the embodiment in FIG. 2 , which will not be repeated here.

It can be understood that, for the detailed steps executed by the processor 601, reference may also be made to the specific content in the method embodiments respectively corresponding to FIG. 2 or FIG. 4 , which will not be repeated here.

To sum up, implementing the embodiment of the present invention, the storage resource allocation system selects the resource allocation for the target service from the preset resource allocation algorithm according to the service type of the target service after receiving the storage resource allocation request algorithm, and take the service characteristic data of the target business as input, use the selected resource allocation algorithm to calculate the storage resource configuration data of the target business, and then instruct the storage system to store the storage resources that meet the storage resource configuration data The allocation of resources to the target business can automatically allocate storage resources for each business in the business system according to the business characteristics, thereby improving the efficiency of resource allocation.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented through computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. During execution, it may include the processes of the embodiments of the above-mentioned methods. Wherein, the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM) or a random access memory (Random Access Memory, RAM) and the like.

Claims (14)

1. A method for allocating storage resources, comprising: receiving a resource allocation request for the target service; the request includes the service type of the target service and the service characteristic data of the target service; According to the business type of the target business, select a storage resource allocation algorithm for the target business from a preset algorithm set; the preset algorithm set includes a plurality of storage resource allocation algorithms, wherein each storage resource allocation algorithm Corresponding to a business type; Taking the service characteristic data of the target business as input, using the storage resource allocation algorithm corresponding to the target business, calculating and obtaining the storage resource configuration data corresponding to the target business, the storage resource configuration data may include: a first value for capacity and a second value for configuring storage performance; sending a resource configuration request to the storage system, where the resource configuration request includes the storage resource configuration data, and the resource configuration request is used to instruct the storage system to allocate storage resources conforming to the storage resource configuration data to the target service . 2. The method of claim 1, further comprising: monitoring the usage of the allocated storage resource by the target service; adjusting the storage resource configuration data corresponding to the target service according to the usage; Resending a resource configuration request to the storage system, the resent resource configuration request includes the adjusted storage resource configuration data, and the resent resource configuration request is used to indicate that the storage system will comply with the adjusted The storage resource of the storage resource configuration data is allocated to the target service. 3. The method according to claim 2, wherein the adjusting the storage resource configuration data corresponding to the target service according to the usage situation comprises: Adjusting the storage resource allocation algorithm corresponding to the target service according to the usage; Taking the service characteristic data of the target service as input, the adjusted storage resource configuration data corresponding to the target service is calculated by using the adjusted storage resource allocation algorithm. 4. The method according to claim 3, wherein the adjusting the storage resource allocation algorithm corresponding to the target service according to the usage situation comprises: If the usage situation indicates that the allocated storage capacity of the storage resource does not meet the requirements of the target business, then in the storage resource allocation algorithm corresponding to the target business, increase the positive correlation variable of the storage capacity and the storage The degree of positive correlation of capacity, or, the variable that reduces the negative correlation of storage capacity and the degree of negative correlation of storage capacity. 5. The method according to claim 3 or 4, wherein the adjusting the storage resource allocation algorithm corresponding to the target service according to the usage situation comprises: If the usage situation shows that the storage performance of the allocated storage resource does not meet the requirements of the target business, then in the storage resource allocation algorithm corresponding to the target business, the positively correlated variable that improves the storage performance and the storage The degree of positive correlation of performance, or the degree of negative correlation of variables that reduce storage performance and the degree of negative correlation of storage performance. 6. The method according to any one of claims 3-5, wherein the adjusting the storage resource allocation algorithm corresponding to the target service according to the usage situation comprises: If the usage situation indicates that the ratio of the storage capacity of the storage resource actually used by the target service to the allocated storage capacity of the storage resource is lower than the first threshold, then the allocation of the storage resource corresponding to the target service In the algorithm, the degree of positive correlation between the positive correlation variable of storage capacity and storage capacity is reduced, or the negative correlation degree of negative correlation variable of storage capacity and storage capacity is increased. 7. The method according to any one of claims 3-6, wherein the adjusting the coefficients of variables in the storage resource allocation algorithm corresponding to the target service according to the usage conditions comprises: If the usage situation indicates that the ratio of the storage performance of the storage resource actually used by the target business to the storage performance of the allocated storage resource is lower than the second threshold, then allocate the storage resource corresponding to the target business In the algorithm, the positive correlation variable that reduces the storage performance is positively correlated with the storage performance, or the negative correlation variable that improves the storage performance is negatively correlated with the storage performance. 8. A storage resource allocation system, comprising: A receiving module, configured to receive a resource allocation request for a target service; the request includes a service type of the target service and service characteristic data of the target service; An algorithm selection module, configured to select a storage resource allocation algorithm for the target service from a preset algorithm set according to the service type of the target service; the preset algorithm set includes a plurality of storage resource allocation algorithms, wherein, Each storage resource allocation algorithm corresponds to a business type; A calculation module, configured to use the service characteristic data of the target service as input, and use the storage resource allocation algorithm corresponding to the target service to calculate and obtain the storage resource configuration data corresponding to the target service, and the storage resource configuration data may include : the first value used to configure the storage capacity and the second value used to configure the storage performance; A resource configuration module, configured to send a resource configuration request to a storage system, where the resource configuration request includes the storage resource configuration data, and the resource configuration request is used to indicate that the storage system will conform to the storage resources of the storage resource configuration data assigned to the target business. 9. The system of claim 8, further comprising: a monitoring module and an adjustment module, wherein: The monitoring module is configured to, after the resource configuration module sends the storage resource configuration data to the storage system, so that the storage system allocates storage resources conforming to the storage resource configuration data to the target service data, monitor Usage of the allocated storage resources by the target business; The adjustment module is configured to adjust the storage resource configuration data corresponding to the target service according to the usage monitored by the monitoring module, and trigger the resource configuration module to resend a resource configuration request to the storage system, the The resent resource configuration request includes the adjusted storage resource configuration data, and the resent resource configuration request is used to instruct the storage system to allocate storage resources conforming to the adjusted storage resource configuration data to the storage system. the target business. 10. The system according to claim 9, the adjustment module is specifically configured to: adjust the storage resource allocation algorithm corresponding to the target service according to the usage monitored by the monitoring module, and trigger the calculation module Taking the service characteristic data of the target service as input, the adjusted storage resource configuration data corresponding to the target service is calculated by using the adjusted storage resource allocation algorithm. 11. The system according to claim 10, the adjustment module is specifically configured to: if the usage situation indicates that the allocated storage capacity of the storage resource does not meet the requirements of the target service, then in the In the storage resource allocation algorithm corresponding to the above-mentioned target business, the degree of positive correlation between positively correlated variables of storage capacity and storage capacity is increased, or the degree of negative correlation between variables negatively correlated with storage capacity and storage capacity is decreased. 12. The system according to claim 10 or 11, wherein the algorithm adjustment module is specifically configured to: if the usage situation indicates that the storage performance of the allocated storage resources does not meet the requirements of the target business, Then, in the storage resource allocation algorithm corresponding to the target service, the degree of positive correlation between the positively correlated variable of storage performance and storage performance is increased, or the degree of negative correlation between the negatively correlated variable of storage performance and storage performance is reduced. 13. The system according to any one of claims 10-12, the algorithm adjustment module is specifically configured to: if the usage situation shows that the storage capacity of the storage resources actually used by the target service is different from the allocated If the ratio of the storage capacity of the storage resource is lower than the first threshold, then in the storage resource allocation algorithm corresponding to the target service, reduce the positive correlation between the positive correlation variable of the storage capacity and the storage capacity, or increase the storage capacity The degree of negative correlation between the negatively correlated variable and the storage capacity. 14. The system according to any one of claims 10-13, the algorithm adjustment module is specifically configured to: if the usage situation shows that the storage performance of the storage resources actually used by the target service is different from the allocated If the ratio of the storage performance of the storage resource is lower than the second threshold, then in the storage resource allocation algorithm corresponding to the target service, reduce the positive correlation between the positive correlation variable of storage performance and the storage performance, or improve the storage performance The negative correlation variable of is negatively correlated with storage performance.