CN1258145C - System of intelligent network storage device based on virtual storage - Google Patents

Abstract

A system of intelligent network storage devices based on virtual storage, comprising: an intelligent virtual routing device for supporting the mapping of virtual resources to network storage devices and load balancing among multiple network storage devices; a global resource management device for Unified allocation and management of storage resources in multiple network storage devices; network storage devices are used to store massive physical storage resources and computing resources. In the present invention, the comprehensive service performance of all devices can be exerted through the load balancing within and between network storage devices, the virtual storage improves the utilization efficiency and manageability of storage devices and resources, and the global resource management ensures the scalability of storage capacity Scalability and I/O performance.

Description

System of intelligent network storage device based on virtual storage

technical field

The invention relates to the field of information technology, in particular to an intelligent mass network storage device system based on virtual storage.

Background technique

The network storage device system is the carrier of massive data information. It is mainly used in the network storage environment to provide high-availability and high-performance data services to the outside through the network. Currently, the leader in the field of network storage devices is the MAGNITUDE system of XIOtech.

As shown in Figure 1, the virtual storage structure of MAGNITUDE organizes multiple physical disks in the storage device into multiple virtual disks for users to use. Each virtual disk can contain part or all of the storage space of multiple physical disks, and can be defined into different types, such as RAID0, RAID0+1, etc. Users can define the capacity and type of virtual disks and use virtual disks as physical disks without caring about the specific physical storage structure. Users can easily expand the capacity of the virtual disk without caring about the stored content.

The biggest advantage of the MAGNITUDE virtual storage structure is that it provides users with an easy-to-understand interface for managing storage systems. However, since its virtual disk storage is in one-to-one correspondence with physical storage (the allocation and configuration of physical storage is completed when the virtual disk is defined), the following problems inevitably exist:

1 When a virtual disk is full, other virtual disks are rarely used and the system has no available physical resources, idle storage resources are not effectively utilized.

2 Since the external interface of the network device is a virtual disk, the user's access to a virtual disk will be bound to the physical storage mapped to this virtual disk. When the load is too heavy, the load cannot be transferred to other virtual disks. This is a load balancing issue within the storage device.

3 This structure does not involve the resource sharing and load balancing issues of multiple storage devices.

Contents of the invention

The object of the present invention is to provide a virtual storage-based intelligent network storage device system to solve the problems of low utilization efficiency of physical storage resources and resource sharing and load balancing among multiple storage devices in the existing system.

In order to achieve the above purpose, the system of intelligent network storage devices based on virtual storage includes:

The intelligent virtual routing device includes a virtual resource mapping table, a resource and load table, and is used to support mapping of virtual resources to network storage devices and load balancing among multiple network storage devices;

Global resource management device, used for unified allocation and management of storage resources in multiple network storage devices;

Network storage devices, all storage devices use a unified virtual storage space for storing massive physical storage resources and computing resources.

In the present invention, the comprehensive service performance of all devices can be brought into play through the load balance within and between network storage devices, the virtual storage improves the utilization efficiency and manageability of storage devices and resources, and the global resource management ensures the scalability of storage capacity Scalability and I/O performance.

Description of drawings

Fig. 1 is a structural diagram of the prior art.

Fig. 2 is a logical structure diagram of the present invention.

Detailed ways

As shown in Fig. 2, the present invention includes intelligent virtual routing, global resource management, network storage equipment, and provides data services to the outside through the network. The outside accesses the network storage device through intelligent virtual routing, and the network storage device directly returns data and processing results to the outside.

In the system, the intelligent virtual router is responsible for forwarding external data requests to corresponding network storage devices. There is a virtual resource mapping table (such as Table 1) in the intelligent virtual routing, which describes the mapping relationship between virtual resources and network devices. By querying this table, the intelligent virtual router can locate the network device where the external request data (represented by the virtual resource) is located, so as to complete the forwarding function. When the resource mapping relationship changes (increase, decrease or change), the global resource management updates the virtual resource mapping table of the intelligent virtual routing through the storage routing update protocol, so as to ensure the correctness and completeness of the mapping.

Another task of intelligent virtual routing is to complete resource and load balancing between storage devices together with storage devices. There is a resource and load table (such as Table 2) in the intelligent virtual router, which describes the physical resource and load of the network equipment. When an external resource is requested, the intelligent virtual router queries this table, and sends the resource request to the corresponding storage device according to the resource and load of the storage device. In this way, resource usage balance and load balance are completed. The storage device is responsible for reflecting its own resources and load conditions in the resource and load table. You can turn off and open the entries in the resource and load table. For example, if the two entries of device 1 in Table 2 are closed, the resource allocation More requests will be made to device 2. In this way, through the cooperation of storage devices and intelligent virtual routers, the balance of resources and loads can be flexibly and effectively completed, ensuring that all devices in the system can exert comprehensive overall service performance.

In the storage system, all storage devices use a unified virtual storage space, and the allocation of the virtual storage space is completed by global resource management. When a network storage device needs new virtual storage resources, it requests from the global resource management. According to the situation of resource allocation, global resource management allocates new virtual storage idle resources for it, and updates virtual intelligent routing. The allocation and recycling of virtual storage space is done dynamically, that is, it is allocated when needed and released when not in use, thus ensuring the effectiveness of the use of virtual storage space.

Network storage devices organize physical resources into resource groups to provide external storage services. A resource group is a collection of virtual resources with the same attributes, which is a complete division of resources. Attributes include physical attributes and user attributes. The physical attribute reflects the physical characteristics of the physical medium, and the user attribute reflects the user-related characteristics. A resource group can span multiple network storage devices.

The whole system provides users with a single virtual disk interface and multiple resource groups with different attributes, such as RAID0 resource group, RAID5 resource group, etc. Resource groups provide users with a variety of options and flexibility in using space. Users can organize resource groups according to their needs and build their own resource management subsystems on them. Resource groups provide users with a common platform for resource usage.

Users use resources through resource groups. When a user needs resources, the user applies to the system for free resources. According to the needs of users and the usage of resources, the system allocates virtual resources in corresponding resource groups and configures corresponding physical resources for them (the mapping between virtual resources and physical resources can also be completed when external access occurs, which can improve resource usage. Efficiency, but will reduce system service performance), and then return the virtual resources to the user. When user resources are excessive, the user releases idle resources to the system for other users to use. When the virtual resources in the resource group cannot meet the allocation requirements, the network storage device applies to the global resource management for new virtual resources. The two-level progressive resource allocation, use and release (recycling) make the system have good scalability and flexibility. When the system allocates resources to users, it takes into account the usage of user resources and physical resources. When user resources are frequently requested and consumed quickly, the resources allocated to the user will gradually increase. Moreover, the number of resources allocated each time is smaller than the disk capacity. This small amount of multiple allocation strategy based on user conditions enables the system to make full use of physical resources and avoid the situation that a large number of physical resources are occupied by a small number of users.

The invention provides good parallel access performance through the load balancing strategy in the system. When the load of a certain resource group is too heavy, at first the storage device where this resource group is located will turn off some or all resource request routes of this resource group in the resource and load table of intelligent virtual routing (resource access still works normally). At this time, resource requests for this resource group will be transferred to other resource groups, thereby transferring the load to other resource groups. When the load of this resource group drops to a certain level, it will open some or all of its resource request routes in the resource and load table of intelligent virtual routing, so as to provide resource services to the outside.

Load balancing in a storage device can occur between physical media within a storage device and across multiple storage devices. For a resource group with heavy load, if the storage device where the resource group is located is not heavily loaded, the resource group will transfer its load to other physical media of the storage device to provide parallel access services as much as possible; if so If the load of the storage device is also heavy, the load of the resource group is shifted to other storage devices with a lighter load. At this point the resource group may span multiple storage devices. It can be seen that through the load balancing strategy in the system, the load can be well adjusted within and between the storage devices, so that the problems of resource sharing and access performance can be well solved.

The present invention has good manageability, what the user sees is a simple and standard disk interface, and can choose to use or not use the resource group. Users only need to configure network storage devices simply, and do not need to manage disk space division, space expansion, resource mapping, etc.

Virtual resources The mapped device block: 10000-19999 10.10.20.20 block: 20000-29999 10.10.20.21 block: 30000-39999 10.10.20.22 block: 40000-49999 10.10.20.20 inodes: 10000-49999 10.10.20.20 inodes: 50000-99999 10.10.20.21

Table 1 Virtual resource mapping table

Table 2 Resource load table

Claims (4)

1 one kinds of intelligent mass network memory apparatus systems based on virtual store, comprise: the intelligent virtual route device, comprise virtual resource mapping table, resource and loading liquifier, be used for the virtual support resource to the mapping of the network storage equipment and the load balance between a plurality of network storage equipment;

The global resource management devices is used for unified distribution and management at a plurality of network storage equipment storage resources;

The network storage equipment, all memory devices use unified virtual memory space, are used to store the physical store resource and the computational resource of magnanimity.

2. by the described system of claim 1, it is characterized in that the described network storage equipment comprises physical disk and resource group.

3. by the described system of claim 2, it is characterized in that described resource group is the set of the virtual resource of same alike result.

4. by the described system of claim 1, it is characterized in that also comprising that total system provides single virtual disk interface and a plurality of resource group with same alike result to the user.

Images