CN104407915A - Node feature mechanism for distributed virtual machine monitor - Google Patents
Node feature mechanism for distributed virtual machine monitor Download PDFInfo
- Publication number
- CN104407915A CN104407915A CN201410717181.XA CN201410717181A CN104407915A CN 104407915 A CN104407915 A CN 104407915A CN 201410717181 A CN201410717181 A CN 201410717181A CN 104407915 A CN104407915 A CN 104407915A
- Authority
- CN
- China
- Prior art keywords
- node
- dvmm
- ncm
- operating system
- nodes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000007246 mechanism Effects 0.000 title claims abstract description 15
- 238000000034 method Methods 0.000 claims description 6
- 238000004891 communication Methods 0.000 claims description 3
- 230000006870 function Effects 0.000 claims 2
- 230000008447 perception Effects 0.000 claims 2
- 238000005516 engineering process Methods 0.000 description 6
- 238000011161 development Methods 0.000 description 4
- 238000011160 research Methods 0.000 description 3
- 238000012512 characterization method Methods 0.000 description 2
- 230000007812 deficiency Effects 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Landscapes
- Debugging And Monitoring (AREA)
Abstract
本发明提供一种面向分布式虚拟机监视器的节点特征机制,实施步骤如下:四个节点组成的机器群,通过DVMM系统虚拟成一台物理机器,其上运行操作系统;节点0拥有较多内存资源,节点1拥有较多PCI/E设备,节点2拥有较多CPU资源,节点3有较多存储资源;本发明和现有技术相比,有针对性地提出了基于DVMM的节点特征描述机制,在DVMM架构中增加一个新的模块NCM,模块作为DVMM的一部分,收集且以良好设计的格式描述各个节点上计算资源的特征信息。在系统软件中,可以根据这些信息对资源调度的算法实施优化,与DVMM协作使资源得到更合理的调度,从而使得整个系统具有更高的性能和效率。The present invention provides a node feature mechanism oriented to a distributed virtual machine monitor, and the implementation steps are as follows: a machine group composed of four nodes is virtualized into a physical machine through a DVMM system, and an operating system runs on it; node 0 has more memory resources, node 1 has more PCI/E devices, node 2 has more CPU resources, and node 3 has more storage resources; compared with the prior art, the present invention specifically proposes a node feature description mechanism based on DVMM , a new module NCM is added to the DVMM architecture. As a part of DVMM, the module collects and describes characteristic information of computing resources on each node in a well-designed format. In the system software, the algorithm of resource scheduling can be optimized according to these information, and cooperate with DVMM to make resource scheduling more reasonable, so that the whole system has higher performance and efficiency.
Description
技术领域 technical field
本发明涉及虚拟化技术以及操作系统领域,具体地说是一种面向分布式虚拟机监视器的节点特征机制。 The invention relates to the field of virtualization technology and operating system, in particular to a distributed virtual machine monitor-oriented node feature mechanism.
背景技术 Background technique
随着虚拟化技术的逐步发展,其性能和可靠性越来越高,潜在的商业和学术价值逐渐被发掘。近年来云计算概念逐渐火热,国内外众多厂商纷纷发布云计算战略和产品,这为虚拟化技术带来了巨大的机遇和挑战。 With the gradual development of virtualization technology, its performance and reliability are getting higher and higher, and its potential commercial and academic value is gradually being discovered. In recent years, the concept of cloud computing has become increasingly popular, and many manufacturers at home and abroad have released cloud computing strategies and products, which have brought great opportunities and challenges to virtualization technology.
目前,虚拟化技术存在两个大的方向。其一是在一台物理机器上,运行多个虚拟机,将物理机资源分配给多个虚拟机使用。其二则是将多台物理机的硬件资源整合,呈现给单个操作系统使用。目前各云计算厂商采用的虚拟化技术均是基于第一个方向的研究成果,也就是在一台物理机器上运行多个虚拟机,这样能保证各个虚拟机之间的资源隔离,同时使得物理机的资源得到充分的使用。对第二个方向的研究,主要是分布式虚拟机监视器DVMM(Distributed Virtual Machine Monitor)架构的提出,以及相关的研究。 Currently, virtualization technology has two major directions. One is to run multiple virtual machines on one physical machine, and allocate physical machine resources to multiple virtual machines. The second is to integrate the hardware resources of multiple physical machines and present them to a single operating system. At present, the virtualization technology adopted by various cloud computing vendors is based on the research results of the first direction, that is, running multiple virtual machines on one physical machine, which can ensure the resource isolation between each virtual machine and make the physical Machine resources are fully utilized. The research on the second direction is mainly the proposal of the distributed virtual machine monitor DVMM (Distributed Virtual Machine Monitor) architecture and related research.
发明内容 Contents of the invention
本发明的目的是克服现有技术中存在的不足,提供 一种面向分布式虚拟机监视器的节点特征机制。 The purpose of the present invention is to overcome the deficiencies in the prior art and provide a node feature mechanism oriented to distributed virtual machine monitors.
本发明的技术方案是按以下方式实现的,实施步骤如下: Technical scheme of the present invention is realized in the following manner, and implementation steps are as follows:
1)四个节点组成的机器群,通过DVMM系统虚拟成一台物理机器,其上运行操作系统; 1) The machine group composed of four nodes is virtualized into a physical machine through the DVMM system, and the operating system runs on it;
2)节点0拥有较多内存资源,节点1拥有较多 PCI/E设备,节点2拥有较多CPU资源,节点3有较多存储资源; 2) Node 0 has more memory resources, node 1 has more PCI/E devices, node 2 has more CPU resources, and node 3 has more storage resources;
3)通过每个节点上的VMM组成DVMM,DVMM描述了系统硬件资源,将信息提供给操作系统; 3) DVMM is composed of VMM on each node, and DVMM describes system hardware resources and provides information to the operating system;
4)作为DVMM的一部分,NCM收集了各个节点的特征信息,形成NCM表,提供接口访问NCM表; 4) As part of DVMM, NCM collects the characteristic information of each node, forms an NCM table, and provides an interface to access the NCM table;
5)操作系统根据DVMM提交上来的资源表,管理资源和调度任务; 5) The operating system manages resources and schedules tasks according to the resource table submitted by DVMM;
6)在操作系统初始化过程中,通过NCM和DVMM提供的接口,访问NCM表,获得和格式化各个节点的NCM信息,从而得知物理节点的特征; 6) During the initialization process of the operating system, through the interface provided by NCM and DVMM, access the NCM table, obtain and format the NCM information of each node, so as to know the characteristics of the physical node;
7)当操作系统感知将要调度的任务对内存的需求量比较大,就将其调度到拥有较多内存的0号节点运行,不轻易调度到其他节点; 7) When the operating system perceives that the task to be scheduled requires a relatively large amount of memory, it schedules it to run on node 0 with more memory, and does not easily schedule it to other nodes;
8)当操作系统感知将要调度的任务属于计算型,就将其调度到拥有较多CPU的2号节点运行,不轻易调度到其他节点; 8) When the operating system perceives that the task to be scheduled is computational, it schedules it to run on node 2 with more CPUs, and does not easily schedule it to other nodes;
9)当用户告知操作系统将要进行的任务需要较大的磁盘存储空间,就将其调度到拥有较多存储资源的3号节点运行,不轻易调度到其他节点; 9) When the user informs the operating system that the task to be performed requires a large disk storage space, it will be scheduled to run on the No. 3 node with more storage resources, and it is not easy to schedule to other nodes;
10)当有任务需要使用大量PCI/E设备时,可将其调度到节点1运行,不轻易调度到其他节点; 10) When there is a task that needs to use a large number of PCI/E devices, it can be scheduled to run on node 1, and it is not easy to schedule to other nodes;
像7)、8)、9)、10)描述的调度策略使得相应任务高效运行,同时也使得整个系统高效运行;在没有NCM的情况下,做不到这样的调度,当这些任务在不适合的节点运行时,将导致大量的节点间通信,造成系统效率低下。 The scheduling strategies described in 7), 8), 9), and 10) make the corresponding tasks run efficiently, and at the same time make the entire system run efficiently; in the absence of NCM, such scheduling cannot be achieved, when these tasks are not suitable for When the nodes are running, it will lead to a large amount of inter-node communication, resulting in low system efficiency. the
本发明的优点是: The advantages of the present invention are:
本发明的面向分布式虚拟机监视器的节点特征机制和现有技术相比,有针对性地提出了基于DVMM的节点特征描述机制,在DVMM架构中增加一个新的模块NCM,模块作为DVMM的一部分,收集且以良好设计的格式描述各个节点上计算资源的特征信息,并将此信息通过适当机制暴露给DVMM其他模块和上层系统软件。在系统软件中,尤其是操作系统,可以根据这些信息对资源调度的算法实施优化,与DVMM协作使资源得到更合理的调度,从而使得整个系统具有更高的性能和效率。 Compared with the prior art, the distributed virtual machine monitor-oriented node feature mechanism of the present invention specifically proposes a DVMM-based node feature description mechanism, and adds a new module NCM in the DVMM framework, and the module is used as a DVMM Part of it is to collect and describe the characteristic information of computing resources on each node in a well-designed format, and expose this information to other modules of DVMM and upper-level system software through appropriate mechanisms. In the system software, especially the operating system, the algorithm of resource scheduling can be optimized according to these information, and cooperate with DVMM to make resource scheduling more reasonable, so that the whole system has higher performance and efficiency.
具体实施方式 Detailed ways
下面对本发明的面向分布式虚拟机监视器的节点特征机制作以下详细说明。 The node feature mechanism oriented to the distributed virtual machine monitor of the present invention will be described in detail below.
本发明的面向分布式虚拟机监视器的节点特征机制,实施步骤如下: The node feature mechanism facing the distributed virtual machine monitor of the present invention, the implementation steps are as follows:
1)四个节点组成的机器群,通过DVMM系统虚拟成一台物理机器,其上运行操作系统; 1) The machine group composed of four nodes is virtualized into a physical machine through the DVMM system, and the operating system runs on it;
2)节点0拥有较多内存资源,节点1拥有较多 PCI/E设备,节点2拥有较多CPU资源,节点3有较多存储资源; 2) Node 0 has more memory resources, node 1 has more PCI/E devices, node 2 has more CPU resources, and node 3 has more storage resources;
3)通过每个节点上的VMM组成DVMM,DVMM描述了系统硬件资源,将信息提供给操作系统; 3) DVMM is composed of VMM on each node, and DVMM describes system hardware resources and provides information to the operating system;
4)作为DVMM的一部分,NCM收集了各个节点的特征信息,形成NCM表,提供接口访问NCM表; 4) As part of DVMM, NCM collects the characteristic information of each node, forms an NCM table, and provides an interface to access the NCM table;
5)操作系统根据DVMM提交上来的资源表,管理资源和调度任务; 5) The operating system manages resources and schedules tasks according to the resource table submitted by DVMM;
6)在操作系统初始化过程中,通过NCM和DVMM提供的接口,访问NCM表,获得和格式化各个节点的NCM信息,从而得知物理节点的特征; 6) During the initialization process of the operating system, through the interface provided by NCM and DVMM, access the NCM table, obtain and format the NCM information of each node, so as to know the characteristics of the physical node;
7)当操作系统感知将要调度的任务对内存的需求量比较大,就将其调度到拥有较多内存的0号节点运行,不轻易调度到其他节点; 7) When the operating system perceives that the task to be scheduled requires a relatively large amount of memory, it schedules it to run on node 0 with more memory, and does not easily schedule it to other nodes;
8)当操作系统感知将要调度的任务属于计算型,就将其调度到拥有较多CPU的2号节点运行,不轻易调度到其他节点; 8) When the operating system perceives that the task to be scheduled is computational, it schedules it to run on node 2 with more CPUs, and does not easily schedule it to other nodes;
9)当用户告知操作系统将要进行的任务需要较大的磁盘存储空间,就将其调度到拥有较多存储资源的3号节点运行,不轻易调度到其他节点; 9) When the user informs the operating system that the task to be performed requires a large disk storage space, it will be scheduled to run on the No. 3 node with more storage resources, and it is not easy to schedule to other nodes;
10)当有任务需要使用大量PCI/E设备时,可将其调度到节点1运行,不轻易调度到其他节点; 10) When there is a task that needs to use a large number of PCI/E devices, it can be scheduled to run on node 1, and it is not easy to schedule to other nodes;
像7)、8)、9)、10)描述的调度策略使得相应任务高效运行,同时也使得整个系统高效运行;在没有NCM的情况下,做不到这样的调度,当这些任务在不适合的节点运行时,将导致大量的节点间通信,造成系统效率低下。 The scheduling strategies described in 7), 8), 9), and 10) make the corresponding tasks run efficiently, and at the same time make the entire system run efficiently; in the absence of NCM, such scheduling cannot be achieved, when these tasks are not suitable for When the nodes are running, it will lead to a large amount of inter-node communication, resulting in low system efficiency.
面向分布式虚拟机监视器DVMM(Distributed Virtual Machine Monitor)的节点特征描述机制NCM(Node Characterization Mechanism)。 NCM (Node Characterization Mechanism), a node characterization mechanism for distributed virtual machine monitor DVMM (Distributed Virtual Machine Monitor).
在前述的DVMM架构中增加一个新的模块NCM,模块作为DVMM的一部分,收集且以良好设计的格式描述各个节点上计算资源的特征信息,并将此信息通过适当机制暴露给DVMM其他模块和上层系统软件。在系统软件中,尤其是操作系统,可以根据这些信息对资源调度的算法实施优化,与DVMM协作使资源得到更合理的调度,从而使得整个系统具有更高的性能和效率。 Add a new module NCM to the aforementioned DVMM architecture. As a part of DVMM, the module collects and describes the characteristic information of computing resources on each node in a well-designed format, and exposes this information to other modules and upper layers of DVMM through appropriate mechanisms system software. In the system software, especially the operating system, the algorithm of resource scheduling can be optimized according to these information, and cooperate with DVMM to make resource scheduling more reasonable, so that the whole system has higher performance and efficiency.
NCM在初始化过程中探测和识别系统中各节点的物理资源特征信息、拓扑结构,并以特定格式形成节点特征描述表,即NCM表。 During the initialization process, NCM detects and identifies the physical resource feature information and topology structure of each node in the system, and forms a node feature description table in a specific format, that is, the NCM table.
NCM表分为两部分,第一部分描述每个节点所拥有的资源,第二部分描述单项物理资源属于哪个节点。 The NCM table is divided into two parts. The first part describes the resources owned by each node, and the second part describes which node a single physical resource belongs to.
第一部分由各个节点的描述信息组成,每个节点的描述格式相同。每个节点的描述信息中,第一项为该节点的类型,类型可以分为计算型、主存型、存储型、网络型、PCI/PCIE型、PC和移动设备,各个类型的具体说明见后。类型之间互不排斥,每个节点可以属于多项类型。第二项为对该节点CPU的描述,包括节点中各个CPU的各项参数规格规格等。第三项为对该节点主存的描述,包括主存的各项参数规格。第四项为对该节点存储资源的描述,包括存储设备的各项参数规格。第五项为对该节点PCI/PCIE设备的描述,包括个数、类型、用途等。此表表项可以根据需要和技术发展参照以上进行扩充。 The first part is composed of description information of each node, and the description format of each node is the same. In the description information of each node, the first item is the type of the node, which can be divided into computing type, main memory type, storage type, network type, PCI/PCIE type, PC and mobile device. For the specific description of each type, see back. The types are not mutually exclusive, and each node can belong to multiple types. The second item is a description of the CPU of the node, including various parameter specifications of each CPU in the node. The third item is a description of the main memory of the node, including various parameter specifications of the main memory. The fourth item is a description of the node's storage resources, including various parameter specifications of the storage device. The fifth item is the description of the PCI/PCIE device of the node, including number, type, purpose, etc. The items in this table can be expanded with reference to the above according to needs and technical development.
节点的类型可分为计算型、主存型、存储型、网络型、PCI/PCIE型、PC和移动设备等。计算型是指该节点上有较多的CPU,具有较强的计算能力;主存型是指该节点有较多的内存,具有较大的内存吞吐能力;存储型是指该节点有较多的存储资源,较大的存储空间;网络型是指该节点有较多的网卡等设备,具有较强的网络吞吐能力;PCI/PCIE型是指该节点有较多的PCI/PCIE设备;PC是指该节点为PC,资源配置为典型的PC配置;移动设备是指该节点为移动设备,资源配置有限。节点的类型可以根据需要和技术发展参照以上进行扩充。 The types of nodes can be divided into computing type, main memory type, storage type, network type, PCI/PCIE type, PC and mobile devices, etc. The computing type means that there are more CPUs on the node and has strong computing power; the main memory type means that the node has more memory and has greater memory throughput; the storage type means that the node has more storage resources, larger storage space; network type means that the node has more network cards and other devices, with strong network throughput; PCI/PCIE type means that the node has more PCI/PCIE devices; PC It means that the node is a PC, and the resource configuration is a typical PC configuration; a mobile device means that the node is a mobile device, and the resource configuration is limited. The types of nodes can be expanded according to the needs and technical development referring to the above.
NCM表的第二部分由机群内硬件资源的分类描述组成,主要描述某项资源与各个节点的从属关系。第一大类为CPU资源,其中每一项为物理CPU的编号与其所在节点的节点号的对应关系。第二大类为主存资源,其中每一项为内存DIMM的编号与其所在节点的节点号的对应关系。第三大类为硬盘资源,其中每一项为硬盘的编号与其所在节点的节点号的对应关系。第四大类为PCI资源,其中每一项为PCI/PCIE设备的编号与其所在节点的节点号的对应关系。此表表项可以根据需要和技术发展参照以上进行扩充。 The second part of the NCM table is composed of the classification description of the hardware resources in the cluster, mainly describing the affiliation relationship between a certain resource and each node. The first category is CPU resources, and each item is the corresponding relationship between the number of the physical CPU and the node number of the node where it is located. The second category is main memory resources, and each item is the corresponding relationship between the number of the memory DIMM and the node number of the node where it is located. The third category is hard disk resources, each of which is the corresponding relationship between the number of the hard disk and the node number of the node where it is located. The fourth category is PCI resources, each of which is the corresponding relationship between the number of the PCI/PCIE device and the node number of the node where it is located. The items in this table can be expanded with reference to the above according to needs and technical development.
NCM表存储在固件中,与固件呈现给操作系统的资源表是同类资源。固件通过相应的接口访问NCM表,同时提供各种接口和例程以响应操作系统对NCM表的访问请求。操作系统通过特定的调用,向固件请求对NCM表资源的访问。 The NCM table is stored in the firmware and is the same type of resource as the resource table that the firmware presents to the operating system. The firmware accesses the NCM table through the corresponding interface, and provides various interfaces and routines to respond to the operating system's access request to the NCM table. The operating system requests access to the NCM table resource from the firmware through a specific call.
本发明的面向分布式虚拟机监视器的节点特征机制其加工制作非常简单方便,按照说明书所示即可加工。 The processing and manufacture of the distributed virtual machine monitor-oriented node feature mechanism of the present invention is very simple and convenient, and can be processed as shown in the manual.
除说明书所述的技术特征外,均为本专业技术人员的已知技术。 Except for the technical features described in the instructions, all are known technologies by those skilled in the art.
Claims (1)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410717181.XA CN104407915A (en) | 2014-12-03 | 2014-12-03 | Node feature mechanism for distributed virtual machine monitor |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410717181.XA CN104407915A (en) | 2014-12-03 | 2014-12-03 | Node feature mechanism for distributed virtual machine monitor |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104407915A true CN104407915A (en) | 2015-03-11 |
Family
ID=52645548
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410717181.XA Pending CN104407915A (en) | 2014-12-03 | 2014-12-03 | Node feature mechanism for distributed virtual machine monitor |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104407915A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106155807A (en) * | 2015-04-15 | 2016-11-23 | 阿里巴巴集团控股有限公司 | A kind of method and apparatus realizing scheduling of resource |
| CN111338580A (en) * | 2020-02-29 | 2020-06-26 | 苏州浪潮智能科技有限公司 | A method and device for optimizing disk performance |
| CN114968580A (en) * | 2022-05-26 | 2022-08-30 | 深信服科技股份有限公司 | A cloud host scheduling method, device, equipment and storage medium |
-
2014
- 2014-12-03 CN CN201410717181.XA patent/CN104407915A/en active Pending
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106155807A (en) * | 2015-04-15 | 2016-11-23 | 阿里巴巴集团控股有限公司 | A kind of method and apparatus realizing scheduling of resource |
| US10789100B2 (en) | 2015-04-15 | 2020-09-29 | Alibaba Group Holding Limited | System, apparatus and method for resource provisioning |
| CN111338580A (en) * | 2020-02-29 | 2020-06-26 | 苏州浪潮智能科技有限公司 | A method and device for optimizing disk performance |
| CN114968580A (en) * | 2022-05-26 | 2022-08-30 | 深信服科技股份有限公司 | A cloud host scheduling method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103870314B (en) | Method and system for simultaneously operating different types of virtual machines by single node | |
| US11128555B2 (en) | Methods and apparatus for SDI support for automatic and transparent migration | |
| CA2962999A1 (en) | Diagnosing slow tasks in distributed computing | |
| CN102521055B (en) | Virtual machine resource allocating method and virtual machine resource allocating system | |
| WO2012087767A3 (en) | Scheduling and management in a personal datacenter | |
| CN102404385A (en) | Virtual cluster deployment system and deployment method for high performance computing | |
| CN105786619B (en) | Virtual machine allocation method and device | |
| CN103064733A (en) | Cloud computing virtual machine live migration technology | |
| TW201248420A (en) | Incorporating memory and IO cycle information into compute usage determinations | |
| CN104112049B (en) | Based on the MapReduce task of P2P framework across data center scheduling system and method | |
| WO2013097396A1 (en) | Virtual cluster integration method, device, and system | |
| TW201324187A (en) | System and method for deploying virtual machines | |
| CN102426475A (en) | Energy saving method, energy saving management server and system under desktop virtual environment | |
| CN103595773A (en) | System performance optimization method based on cloud desktop | |
| CN104360724B (en) | A kind of heat dissipating method of the blade server based on job scheduling | |
| CN103309833A (en) | Equipment integrating method, terminal device and distributed multi-terminal device system | |
| CN104407915A (en) | Node feature mechanism for distributed virtual machine monitor | |
| CN112433823A (en) | Apparatus and method for dynamically virtualizing physical card | |
| CN102521102A (en) | Monitoring management method of physical multi-partition computer system based on Non Uniform Memory Access (NUMA) | |
| TW201327205A (en) | Managing method for hardware performance and cloud computing system | |
| CN110532150B (en) | Case management method and device, storage medium and processor | |
| US20250306950A1 (en) | Servicing nodes participating in inter-node communications in a firmware framework | |
| CN111143057A (en) | Heterogeneous cluster data processing method and system based on multiple data centers and electronic equipment | |
| CN104391546A (en) | Elastic configuration-variable cloud server system architecture | |
| WO2015102008A1 (en) | Capability determination for computing resource allocation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20150311 |
|
| WD01 | Invention patent application deemed withdrawn after publication |