[go: up one dir, main page]

CN103347082A - Storage framework virtualizing system - Google Patents

Storage framework virtualizing system Download PDF

Info

Publication number
CN103347082A
CN103347082A CN201310289576XA CN201310289576A CN103347082A CN 103347082 A CN103347082 A CN 103347082A CN 201310289576X A CN201310289576X A CN 201310289576XA CN 201310289576 A CN201310289576 A CN 201310289576A CN 103347082 A CN103347082 A CN 103347082A
Authority
CN
China
Prior art keywords
storage
metadata
file
virtualization
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201310289576XA
Other languages
Chinese (zh)
Inventor
康启旭
唐远琳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
IEIT Systems Co Ltd
Original Assignee
Inspur Electronic Information Industry Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur Electronic Information Industry Co Ltd filed Critical Inspur Electronic Information Industry Co Ltd
Priority to CN201310289576XA priority Critical patent/CN103347082A/en
Publication of CN103347082A publication Critical patent/CN103347082A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention provides a storage framework virtualizing system which comprises a file system and a storage system, wherein the file system and the storage system are both connected with a local area network through Ethernet switches, the file system is further connected with a plurality of client sides through another local area network, the file system comprises a file server used for block-level volume management and metadata saving and a file server used for file service, and the storage system comprises a storage resource pool which is formed after virtualized storage of several storage devices is provided outwards uniformly. Compared with the prior art, the storage framework virtualizing system has the advantages that virtulization of more than two kinds of storage frameworks is achieved, expansibility and flexibility of the storage system are strengthened finally, cost is reduced, maintenance is improved, practicality is strong, and popularization is easy to achieve.

Description

一种存储构架的虚拟化系统A Virtualization System of Storage Architecture

技术领域 technical field

本发明涉及计算机存储虚拟化技术领域,具体的说是一种采用外部文件元数据和块数据分开处理,对磁盘阵列进行外部整合,最终实现SAN存储虚拟化的存储构架的虚拟化系统。 The invention relates to the technical field of computer storage virtualization, and specifically relates to a virtualization system of a storage framework that uses external file metadata and block data to be separately processed, externally integrates disk arrays, and finally realizes SAN storage virtualization.

背景技术 Background technique

SAN存储具有很多的有点,在高性能、高可靠性、高可扩展性、易管理维护等有很多优势,同时在实际的生产环境中也有不少的缺点,主要体现在存储设备与客户端之间的操作性较差、构建费用较高、数据文件不能实现有效共享等;而NAS存储结构中文件系统是和存储子系统紧密相连的,两者连为一体,使用时同样十分不便。基于NAS和SAN的结构特点,设计一种将NAS存储结构分开处理,实现SAN存储虚拟化的系统,同时兼容两者优点,是十分必要的。 SAN storage has many advantages, such as high performance, high reliability, high scalability, and easy management and maintenance. At the same time, there are also many shortcomings in the actual production environment, mainly reflected in the relationship between storage devices and clients. The interoperability is poor, the construction cost is high, and data files cannot be effectively shared. In the NAS storage structure, the file system is closely connected with the storage subsystem, and the two are integrated, which is also very inconvenient to use. Based on the structural characteristics of NAS and SAN, it is very necessary to design a system that separates the NAS storage structure and realizes the virtualization of SAN storage, and is compatible with the advantages of both.

发明内容 Contents of the invention

本发明的技术任务是解决现有技术的不足,提供一种采用外部文件元数据和块数据分开处理,对磁盘阵列进行外部整合,最终实现SAN存储虚拟化的存储构架的虚拟化系统。 The technical task of the present invention is to solve the deficiencies of the prior art, and provide a virtualization system that uses external file metadata and block data to be separately processed, externally integrates disk arrays, and finally realizes storage architecture of SAN storage virtualization.

本发明的技术方案是按以下方式实现的,该一种存储构架的虚拟化系统,其结构包括均通过以太网交换机连接局域网的文件系统和存储系统,其中文件系统还通过另一局域网连接有若干客户端,所述文件系统包括可用于块级的卷管理且对元数据保存的文件服务器、可用于文件服务的文件服务器,所述存储系统包括存储资源池,该存储资源池是由若干存储设备进行虚拟化之后的存储统一向外提供形成的。 The technical scheme of the present invention is realized in the following manner. The virtualization system of this storage framework includes a file system and a storage system connected to a local area network through an Ethernet switch, wherein the file system is also connected to several The client, the file system includes a file server that can be used for block-level volume management and metadata storage, and a file server that can be used for file services, and the storage system includes a storage resource pool, which is composed of several storage devices The storage after virtualization is uniformly provided externally.

所述存储资源池对外进行存储空间的提供,对内进行存储的统一管理,客户端对存储空间进行数据的读写等IO操作时,I/O命令先送至专用的元数据服务器,在元数据服务器上首先获得元数据和存储数据的视图,专用的元数据服务器根据元数据和数据视图通过存储构架得到所需要的数据,之后将这些数据传送给客户端,满足IO请求,上述专用的元数据服务器是指存放有整个后端虚拟池的全部数据视图且处理元数据的访问的元数据服务器。 The storage resource pool provides storage space externally and manages storage internally. When the client performs IO operations such as reading and writing data on the storage space, the I/O command is first sent to a dedicated metadata server. The data server first obtains the metadata and the view of the stored data, and the dedicated metadata server obtains the required data through the storage framework according to the metadata and the data view, and then transmits the data to the client to meet the IO request. The data server refers to a metadata server that stores all data views of the entire backend virtual pool and handles metadata access.

所述存储构架的虚拟化实现由两部分组成,一部分是位于元数据服务器,负责后端存储的虚拟化;另一部分位于客户端部分,对IO请求的重定向操作:当客户端的IO请求不在本地存储时,虚拟化机制将IO命令发往元数据服务器,元数据服务器接收到IO请求后将对应的数据视图和元数据部分返回给客户端。 The virtualization implementation of the storage architecture consists of two parts, one part is located in the metadata server, which is responsible for the virtualization of the back-end storage; the other part is located in the client part, and redirects the IO request: when the client's IO request is not locally When storing, the virtualization mechanism sends the IO command to the metadata server, and the metadata server returns the corresponding data view and metadata part to the client after receiving the IO request.

本发明与现有技术相比所产生的有益效果是: The beneficial effect that the present invention produces compared with prior art is:

本发明的一种存储构架的虚拟化系统融合了SAN和NAS的技术特点,实现对磁盘阵列的存储虚拟化,保障了SAN的诸多优点的同时实现了对磁盘阵列的虚拟化管理。本设计将传统NAS结构中的文件系统和存储子系统分开,将两者分开之后分别用一个服务器构成,其中具有文件系统功能的服务器主要任务就是对元数据的保存、文件系统的功能执行等;承载存储子系统服务器的主要作用是完成存储阵列的高级功能;采用上述结构,实现多两种存储架构的虚拟化。最终增强了存储系统的扩展性和灵活性,在成本、维护等方面有一定的降低和改进,实用性强,易于推广。 The virtualization system of a storage framework of the present invention integrates the technical features of SAN and NAS, realizes the storage virtualization of the disk array, guarantees many advantages of the SAN, and realizes the virtualization management of the disk array at the same time. This design separates the file system and the storage subsystem in the traditional NAS structure, and after separating the two, it is composed of a server respectively. The main task of the server with the file system function is to save the metadata and execute the function of the file system, etc.; The main function of the server carrying the storage subsystem is to complete the advanced functions of the storage array; the above-mentioned structure is adopted to realize the virtualization of more than two storage architectures. Finally, the scalability and flexibility of the storage system are enhanced, and the cost and maintenance are reduced and improved to a certain extent. It is practical and easy to popularize.

附图说明 Description of drawings

    附图1是本发明的结构示意图。 Accompanying drawing 1 is a structural representation of the present invention.

具体实施方式 Detailed ways

下面结合附图对本发明的一种存储构架的虚拟化系统作以下详细说明。 A storage architecture virtualization system of the present invention will be described in detail below in conjunction with the accompanying drawings.

如附图1所示,一种存储构架的虚拟化系统,其结构包括均通过以太网交换机连接局域网的文件系统和存储系统,其中文件系统还通过另一局域网连接有若干客户端,所述文件系统包括可用于块级的卷管理且对元数据保存的文件服务器、可用于文件服务的文件服务器,所述存储系统包括存储资源池,该存储资源池是由若干存储设备进行虚拟化之后的存储统一向外提供形成的。 As shown in Figure 1, a virtualization system of a storage framework includes a file system and a storage system connected to a local area network through an Ethernet switch, wherein the file system is also connected to several clients through another local area network. The system includes a file server that can be used for volume management at the block level and saves metadata, and a file server that can be used for file services. The storage system includes a storage resource pool, which is a storage resource pool that is virtualized by several storage devices Formed by unified external provision.

所述存储资源池对外进行存储空间的提供,对内进行存储的统一管理,客户端对存储空间进行数据的读写等IO操作时,I/O命令先送至专用的元数据服务器,在元数据服务器上首先获得元数据和存储数据的视图,专用的元数据服务器根据元数据和数据视图通过存储构架得到所需要的数据,之后将这些数据传送给客户端,满足IO请求,上述专用的元数据服务器是指存放有整个后端虚拟池的全部数据视图且处理元数据的访问的元数据服务器。 The storage resource pool provides storage space externally and manages storage internally. When the client performs IO operations such as reading and writing data on the storage space, the I/O command is first sent to a dedicated metadata server. The data server first obtains the metadata and the view of the stored data, and the dedicated metadata server obtains the required data through the storage framework according to the metadata and the data view, and then transmits the data to the client to meet the IO request. The data server refers to a metadata server that stores all data views of the entire backend virtual pool and handles metadata access.

所述存储构架的虚拟化实现由两部分组成,一部分是位于元数据服务器,负责后端存储的虚拟化;另一部分位于客户端部分,对IO请求的重定向操作:当客户端的IO请求不在本地存储时,虚拟化机制将IO命令发往元数据服务器,元数据服务器接收到IO请求后将对应的数据视图和元数据部分返回给客户端。 The virtualization implementation of the storage architecture consists of two parts, one part is located in the metadata server, which is responsible for the virtualization of back-end storage; the other part is located in the client part, and redirects the IO request: when the client's IO request is not locally When storing, the virtualization mechanism sends IO commands to the metadata server, and the metadata server returns the corresponding data view and metadata part to the client after receiving the IO request.

在本设计中,在SAN这一级中单独增加一台服务器专门提供虚拟化服务,通过虚拟化功能,将SAN后端的各种存储设备进行虚拟化,将虚拟化之后的存储统一向外提供,形成以存储资源池。 In this design, a separate server is added at the SAN level to provide virtualization services. Through the virtualization function, various storage devices at the back end of the SAN are virtualized, and the virtualized storage is uniformly provided externally. Formed to store resource pools.

为实现统一存储,完成NAS和SAN的进一步融合。两台专用服务器的使用,一台元数据服务器和一台文件服务器,前者用于块级的卷管理,后者用于文件服务。在此架构的基础之上系统可以同时提供File IO和BLOCK IO两种类型的服务。在存储端,结合NAS和SAN结构的融合,存储系统可以同时提供文件服务的File space和提供数据块服务的BLOCK space两个存储部分。 In order to achieve unified storage, complete the further integration of NAS and SAN. The use of two dedicated servers, a metadata server and a file server, the former is used for block-level volume management, and the latter is used for file services. Based on this architecture, the system can provide both File IO and BLOCK IO services. On the storage side, combined with the integration of NAS and SAN structures, the storage system can simultaneously provide two storage parts: File space for file services and BLOCK space for data block services.

除说明书所述的技术特征外,均为本专业技术人员的公知技术。 Except for the technical features described in the description, all are well-known technologies of those skilled in the art.

Claims (3)

1.一种存储构架的虚拟化系统,其特征在于:其结构包括均通过以太网交换机连接局域网的文件系统和存储系统,其中文件系统还通过另一局域网连接有若干客户端,所述文件系统包括可用于块级的卷管理且对元数据保存的文件服务器、可用于文件服务的文件服务器,所述存储系统包括存储资源池,该存储资源池是由若干存储设备进行虚拟化之后的存储统一向外提供形成的。 1. A virtualization system of a storage framework, characterized in that: its structure includes a file system and a storage system all connected to a local area network through an Ethernet switch, wherein the file system is also connected to several clients through another local area network, and the file system It includes a file server that can be used for block-level volume management and saves metadata, and a file server that can be used for file services. The storage system includes a storage resource pool, which is a unified storage after virtualization of several storage devices. Provided externally. 2.根据权利要求1所述的一种存储构架的虚拟化系统,其特征在于:所述存储资源池对外进行存储空间的提供,对内进行存储的统一管理,客户端对存储空间进行数据的读写等IO操作时,I/O命令先送至专用的元数据服务器,在元数据服务器上首先获得元数据和存储数据的视图,专用的元数据服务器根据元数据和数据视图通过存储构架得到所需要的数据,之后将这些数据传送给客户端,满足IO请求,上述专用的元数据服务器是指存放有整个后端虚拟池的全部数据视图且处理元数据的访问的元数据服务器。 2. The virtualization system of a storage framework according to claim 1, characterized in that: the storage resource pool provides external storage space, internally performs unified storage management, and the client performs data storage for the storage space During IO operations such as reading and writing, the I/O command is first sent to the dedicated metadata server, and the metadata and the view of the stored data are first obtained on the metadata server. The dedicated metadata server obtains the metadata and data view through the storage architecture. The required data is then transmitted to the client to meet the IO request. The above-mentioned dedicated metadata server refers to a metadata server that stores all data views of the entire back-end virtual pool and handles metadata access. 3.根据权利要求1所述的一种存储构架的虚拟化系统,其特征在于:所述存储构架的虚拟化实现由两部分组成,一部分是位于元数据服务器,负责后端存储的虚拟化;另一部分位于客户端部分,对IO请求的重定向操作:当客户端的IO请求不在本地存储时,虚拟化机制将IO命令发往元数据服务器,元数据服务器接收到IO请求后将对应的数据视图和元数据部分返回给客户端。 3. The virtualization system of a kind of storage framework according to claim 1, it is characterized in that: the virtualization realization of described storage framework is made up of two parts, and a part is positioned at metadata server, is responsible for the virtualization of back-end storage; The other part is located in the client part, which is the redirection operation of IO requests: when the client's IO request is not stored locally, the virtualization mechanism sends the IO command to the metadata server, and the metadata server sends the corresponding data view after receiving the IO request and the metadata part are returned to the client.
CN201310289576XA 2013-07-11 2013-07-11 Storage framework virtualizing system Pending CN103347082A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310289576XA CN103347082A (en) 2013-07-11 2013-07-11 Storage framework virtualizing system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310289576XA CN103347082A (en) 2013-07-11 2013-07-11 Storage framework virtualizing system

Publications (1)

Publication Number Publication Date
CN103347082A true CN103347082A (en) 2013-10-09

Family

ID=49281856

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310289576XA Pending CN103347082A (en) 2013-07-11 2013-07-11 Storage framework virtualizing system

Country Status (1)

Country Link
CN (1) CN103347082A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107168793A (en) * 2017-05-10 2017-09-15 郑州云海信息技术有限公司 A kind of dynamic current method of virtual memory space
CN108899078A (en) * 2018-06-27 2018-11-27 郑州云海信息技术有限公司 A kind of health and fitness information processing system based on cloud storage

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1688981A (en) * 2002-08-09 2005-10-26 网络装置公司 Storage virtualization by layering virtual disk objects on a file system
US20120284234A1 (en) * 2011-05-03 2012-11-08 Vmware, Inc. Live migration of virtual machine persistent data using mirrored input-output operations
CN202856789U (en) * 2012-08-17 2013-04-03 广州中长康达信息技术有限公司 Data resource storage system integrating NAS and SAN
US9262346B2 (en) * 2010-06-21 2016-02-16 Hewlett Packard Enterprises Development LP Prioritizing input/outputs at a host bus adapter

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1688981A (en) * 2002-08-09 2005-10-26 网络装置公司 Storage virtualization by layering virtual disk objects on a file system
US9262346B2 (en) * 2010-06-21 2016-02-16 Hewlett Packard Enterprises Development LP Prioritizing input/outputs at a host bus adapter
US20120284234A1 (en) * 2011-05-03 2012-11-08 Vmware, Inc. Live migration of virtual machine persistent data using mirrored input-output operations
CN202856789U (en) * 2012-08-17 2013-04-03 广州中长康达信息技术有限公司 Data resource storage system integrating NAS and SAN

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
黄巍 等: "一种基于iSCSI 的SAN 存储虚拟化实现", 《华中科技大学学报》 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107168793A (en) * 2017-05-10 2017-09-15 郑州云海信息技术有限公司 A kind of dynamic current method of virtual memory space
CN108899078A (en) * 2018-06-27 2018-11-27 郑州云海信息技术有限公司 A kind of health and fitness information processing system based on cloud storage
CN108899078B (en) * 2018-06-27 2021-10-22 郑州云海信息技术有限公司 A health information processing system based on cloud storage

Similar Documents

Publication Publication Date Title
EP2972893B1 (en) Caching content addressable data chunks for storage virtualization
CN103503414B (en) A cluster system integrating computing and storage
CN104156216B (en) A kind of memory management system and method towards cloud computing
CN103561101A (en) Network file system
WO2013004136A1 (en) Distributed storage method, device and system
CN102868727B (en) Method for realizing high availability of logical volume
WO2015066980A1 (en) Software/hardware compression configurable big data processing system
CN105657057A (en) Calculation and storage fused cluster system
WO2023000770A1 (en) Method and apparatus for processing access request, and storage device and storage medium
CN102760045B (en) Intelligent storage device and data processing method thereof
CN105516313A (en) Distributed storage system used for big data
CN105573672B (en) A kind of virtualization storage method and system based on NFS
CN103984507A (en) Storage configuration and optimizing strategy for bioinformatics high-performance computing platform
CN103347082A (en) Storage framework virtualizing system
CN103209219A (en) Distributed cluster file system
WO2015067128A1 (en) Stackable data duplication file system
Park et al. An Analysis of Replication Enhancement for a High Availability Cluster.
CN103220333A (en) Distributed storing system device
CN106911598B (en) Xen virtualization environment monitoring extension method and system
KR20160127449A (en) Distributed file system based clustering using high speed semiconductor storage device
CN204650521U (en) A kind of TB DBMS library storage system
Arteaga et al. Dynamic block-level cache management for cloud computing systems
Poat et al. Achieving cost/performance balance ratio using tiered storage caching techniques: A case study with CephFS
CN103986755A (en) A high-security full-redundancy parallel file system implementation method
Yu et al. Design, implementation, and evaluation of transparent pnfs on lustre

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20131009

WD01 Invention patent application deemed withdrawn after publication