WO2012152153A1 - Method, monitor and system for seamless migration of virtual machine - Google Patents
Method, monitor and system for seamless migration of virtual machine Download PDFInfo
- Publication number
- WO2012152153A1 WO2012152153A1 PCT/CN2012/073352 CN2012073352W WO2012152153A1 WO 2012152153 A1 WO2012152153 A1 WO 2012152153A1 CN 2012073352 W CN2012073352 W CN 2012073352W WO 2012152153 A1 WO2012152153 A1 WO 2012152153A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- virtual machine
- migration
- active virtual
- active
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/4557—Distribution of virtual machine instances; Migration and load balancing
Definitions
- the present invention relates to the field of cloud computing virtualization, and in particular, to a method, a manager and a system for seamless migration of virtual machines. Background technique
- Cloud Computing is an emerging shared infrastructure computing method that connects huge pools of system resources to provide information (IT) services.
- Cloud computing is a product of the convergence of traditional computer technologies and network technologies such as grid computing, distributed computing, parallel computing, utility computing, network storage, virtualization, and load balancing. It aims to integrate multiple relatively low-cost computing entities into a powerful system through the network, and with software-as-a-service (SaaS, Platform as a Service) (PaaS, Platform as a Service) Business models such as IaaS (Isolated Infrastructure as a Service) distribute various capabilities and services to end users.
- SaaS Software-as-a-service
- PaaS Platform as a Service
- IaaS Isolated Infrastructure as a Service
- a cloud computing data center based on virtual cluster technology is an existing business model. It leases virtual machines and networks of large cloud computing data centers to deploy various business networks, which can achieve rapid deployment and reduce operating costs.
- the cloud computing data center is composed of a virtual cluster management server (DCMP, Data Center Management Platform) 10, a network storage device (NAS), and a plurality of physical servers 3 supporting virtualization technologies.
- the virtual cluster management server 10 is responsible for unified scheduling, allocation, and management of virtual machine resources in the cloud computing data center; the network storage device 20 provides high-speed reading and writing of virtual disk external virtual disk files through the Fibre Channel.
- the physical server of the cloud computing data center virtualizes local physical resources through a virtual machine manager (VMM) 40, and supports running multiple virtual machines (VMs) on the same set of physical resources.
- VMM virtual machine manager
- the virtual disk file required for the virtual machine 50 to run is stored on the NAS 20.
- the virtual disk file content is read from the NAS 20 to the memory, and the virtual disk is read.
- the file is read and written to the external NAS 20.
- Online migration of virtual machine 50 is accomplished by copying memory between the source and destination servers. The specific steps for online migration of existing virtual machines include:
- Step S1 Migration preparation. Plan to migrate the active virtual machine VM1 on the source server to the destination server;
- Step S2 The destination server resource is reserved. Reserve the resources required for VM1 running on the destination server, including memory, CPU, network, etc. If the resource reservation fails, stop the VM migration and feed back the result.
- Step S3 Memory cycle pre-copy. First, copy the memory page of the virtual machine VM1 running on the source server to the destination server, and then copy the modified memory page (dirty page) during the previous round of memory copy each time;
- Step S4 Stop copying.
- the circular copy is stopped, the source virtual machine is suspended, and the remaining The memory page and the virtual machine's status data (CPU status and non-contiguous memory pages) are synchronized to the destination server at one time; and the active ARP is sent to the network. Request to update the network location to the destination server;
- Step S5 Confirm. After receiving all the memory pages and the virtual machine state data, the destination server notifies the source server to complete the virtual machine migration, and the source server confirms and releases the resources occupied by the virtual machine VM1;
- Step S6 Activate.
- the destination server activates the migrated VM VM1 and connects to the local device, such as the I/O port, to resume normal operation.
- step S4 when performing step S4 to step S5, the virtual machine VM1 is in a suspended state on both the source server and the destination server, and the virtual machine VM1 is suspended according to the amount of data to be copied and the transmission bandwidth in step S4.
- the length of time varies, resulting in a small amount of packet loss during this time.
- the source address server sends an Active Address Resolution Protocol (ARP) request, and some network devices may refuse to respond to this. Therefore, the network device can completely perceive the change of the location of the virtual machine VM1 until the virtual machine VM1 on the destination server initiates the first data packet to the network. Therefore, the existing virtual machine migration technology has a disruption between the virtual machine and the network connection, thereby affecting the continuity of the virtual machine running service.
- ARP Active Address Resolution Protocol
- the main purpose of the present invention is to provide a method, a manager, and a system for seamlessly migrating virtual machines to solve the problem of loss of service packets caused by virtual machine suspension during virtual machine online migration.
- the present invention provides a method for seamless migration of a virtual machine, the method comprising:
- the related migration information of the active virtual machine includes: before the active virtual machine is migrated And/or migrated Internet Protocol (IP, Internet Protocol) addresses, Media Access Control (MAC, Medium/Media Access Control) addresses, and/or migrations.
- IP Internet Protocol
- MAC Media Access Control
- the related network element includes: a service function module, a router, a switch, a related gateway device, and/or a source server virtual machine manager.
- the method before the receiving the data packet sent by the relevant network element, the method further includes: obtaining, by the related network element, the virtual machine by using a pre-configuration manner or a domain name resolution service (DNS) mechanism
- DNS domain name resolution service
- the address information of the migrated manager sends the data packet according to the address information.
- the method before the forwarding the data packet to the active virtual machine, the method further includes: receiving an active virtual machine activation notification sent by the destination server.
- the data packet sent by the related network element includes: the data packet sent by using a source routing manner or an IP tunneling manner.
- the present invention also provides a manager for seamless migration of a virtual machine, the manager comprising: an address obtaining block, a receiving buffer module, and a message forwarding module;
- An address obtaining module configured to acquire an active migration information receiving cache module of the active virtual machine located on the source server, configured to receive a data packet sent by the related network element and cache the active virtual machine during the suspension;
- a message forwarding module configured to: when the active virtual machine is migrated from the source server to the destination server and reactivated, according to the related migration information of the active virtual machine saved in the address obtaining module, the receiving cache module is cached The data message is forwarded to the active virtual machine.
- the message forwarding module is further configured to: when the active virtual machine is served from the source When the device migrates to the destination server and is reactivated, it receives an active virtual machine activation notification sent by the destination server.
- the address obtaining module is specifically configured to save the pre-migration and/or post-migration IP address, MAC address, and/or migration status of the active virtual machine as related migration information of the active virtual machine.
- the invention also provides a system for seamless migration of a virtual machine, the system comprising: a source server, a destination server and a seamless migration manager of the virtual machine; wherein:
- the source server suspends the active virtual machine after the copying of the scheduled memory page of the active virtual machine to the destination server before the active virtual machine is migrated, and suspends the remaining unmigrated memory pages and activities
- the state data of the virtual machine is synchronized to the destination server;
- the virtual machine seamless migration manager is configured to acquire related migration information of the active virtual machine located on the source server; receive the data packet sent by the relevant network element and cache the active virtual machine during the suspension; When the active virtual machine is migrated from the source server to the destination server and is reactivated, forwarding the data packet to the active virtual machine in the destination server according to the related migration information;
- the destination server is configured to activate the active virtual machine when the active virtual machine completes the migration, and receive and save the data packet sent by the manager that the virtual machine seamlessly migrates.
- the source server is further configured to copy a memory page run by the active virtual machine to the destination server, and subsequently copy the modified memory page during a previous round of memory copy each time;
- the circular copy is stopped.
- the destination server is further configured to: when the active virtual machine is activated, send an active virtual machine activation notification to a manager that seamlessly migrates the source server and the virtual machine;
- the source server is further configured to release the resources occupied by the active virtual machine after receiving the active virtual machine activation notification;
- the manager for seamlessly migrating the virtual machine is specifically configured to: when receiving the active virtual machine activation notification sent by the destination server, forward the data packet to the active virtual in the destination server according to the related migration information. machine.
- the method, the manager and the system for seamlessly migrating a virtual machine the related migration of the active virtual machine before the active virtual machine is suspended by deploying the centralized virtual machine seamless migration manager on the network
- the manager informs the virtual machine of the seamless migration of the virtual machine; the active virtual machine hangs on the manager that is sent to the virtual machine for seamless migration; the virtual machine seamless migration manager receives and caches the related data message, and is active in the virtual machine.
- the data packet is forwarded to the active VM. This ensures the continuity of the running of the VM during the VM migration process. This solves the problem of loss of service data packets caused by VM migration and improves network performance. . DRAWINGS
- FIG. 1 is a schematic diagram of a network architecture of an existing cloud computing data center
- FIG. 2 is a schematic diagram of a network architecture of a cloud computing data center in the present invention.
- FIG. 3 is a schematic flow chart of an embodiment of a method for seamlessly migrating a virtual machine according to the present invention
- 4a is a flowchart of processing in an active virtual machine network migration in an embodiment of a method for seamlessly migrating a virtual machine according to the present invention
- FIG. 4b is a flowchart of a process for moving an active virtual machine across network segments in an embodiment of a method for seamlessly migrating a virtual machine according to the present invention
- FIG. 5 is a schematic structural diagram of an embodiment of a seamless migration of a virtual machine according to the present invention
- FIG. 6 is a schematic structural diagram of an embodiment of a system for seamless migration of a virtual machine according to the present invention.
- the solution of the embodiment of the present invention is mainly: collecting, caching, and forwarding service data packets on the network during the suspension of the active virtual machine by deploying the centralized virtual machine seamless migration manager on the network, to solve the problem due to the active virtual machine The loss of service data packets caused by the migration.
- Cloud computing The network architecture of the cloud computing data center involved in the embodiment of the present invention is as shown in FIG. 2 .
- Cloud computing mainly includes the following devices or network elements: virtual cluster management server, network storage device, physical server (including source server and destination server), virtual machine seamless migration manager, network connection device and other networks. among them:
- the virtual cluster management server is responsible for managing the management of all resources in the virtual cluster, including physical resources (including processors, memory, network interfaces, etc.), storage devices, network devices, and other physical resources, as well as virtual resources such as virtual machines and virtual networks. Provide external management and scheduling of virtual resources, such as virtual machine application, creation, update, deletion, and virtual network configuration.
- a network storage device that provides templates and image files required for virtual machine installation, storage of virtual disk files outside the virtual machine, and storage of data blocks.
- network storage devices are connected to the network through fiber optic equipment to provide high-speed, high-bandwidth external storage channels.
- the physical server which supports the virtualized server device, can share the hardware resources of one physical server through the virtual machine manager (VMM) 304, and supports the running of multiple virtual machines.
- VMM virtual machine manager
- the virtual machine seamless migration manager is responsible for receiving, caching, and forwarding data packets during the virtual machine hang caused by the virtual machine migration to ensure the continuity of the service running by the migrated virtual machine.
- the virtual machine seamless migration manager is deployed as a public network element, and can be exposed through a cloud computing data center configuration file, or can be queried by other means such as DNS.
- the physical servers in one network segment form a group and connect devices and other networks through the network.
- the network connection device is generally a router or switch or other gateway device.
- an embodiment of the present invention provides a method for seamlessly migrating a virtual machine, including:
- Step S101 The virtual machine seamless migration manager acquires related migration information of the active virtual machine located on the source server.
- the related migration information of the active virtual machine is address information of the active virtual machine at the destination server, specifically:
- the related migration information of the active virtual machine is the address and status information of the active virtual machine, such as active virtual IP address, MAC address, migration status (suspended or reactivated);
- the related migration information of the active virtual machine is the address and status information before and after the active virtual machine migration, such as an activity. IP address and MAC address before virtual machine migration, IP address and MAC address after migration of active virtual machine, migration status (suspended or reactivated).
- the obtaining may be: sending, by the virtual cluster management server, the virtual machine manager of the source server, or the virtual machine manager of the destination server, the related migration information of the active virtual machine to be migrated to the manager of the virtual machine seamless migration.
- the related migration information of the active virtual machine may be saved in a migration virtual machine information table, so as to perform data packet forwarding according to the related migration information in the migration virtual machine information table.
- step S101 Before the step S101 is started, it is required to determine whether the active virtual machine is suspended, including: determining, by the source server, whether the active virtual machine is suspended, and notifying the virtual machine to migrate the manager, the destination server, and the related network by the source server. yuan.
- the resources required for the active virtual machine to run including the memory and the central processing unit, need to be reserved on the destination server. (CPU, Computer Process Unit), network, etc. If the resource reservation fails, the virtual machine migration is stopped and the result is fed back;
- the memory loop pre-copy needs to be completed, including: copying the memory page of the active virtual machine running on the source server to the destination server, and then copying the modified memory during the previous round of memory copy every subsequent cycle. Page (dirty page);
- Page dirty page
- the source server Before the end of the circular copy, the source server notifies the virtual machine to migrate seamlessly.
- the active virtual machine migrates between the source server and the destination server and is about to hang.
- the manager of the virtual machine seamless migration will be active.
- the related migration information of the virtual machine is recorded in the migration virtual machine information table, and is ready to receive the data packet whose destination address is the active virtual machine.
- the manager active virtual machine that notifies the virtual machine to migrate seamlessly migrates between the source server and the destination server and is about to hang, and may be managed by the virtual cluster management server (if the virtual cluster management server participates in the virtual machine migration process) Completed, either by the source or destination server.
- the hang is: when the number of memory pages to be copied or the dirty page rate of the memory (the number of pages of dirty memory during each cycle divided by the number of pages of the required copy), when the predetermined threshold is met, the circular copy is stopped, and the source server is active.
- the virtual machine hangs and synchronizes the remaining memory pages and the status data (CPU status and non-contiguous memory pages) of the active virtual machine to the destination server at one time.
- Step S102 During the suspension of the active virtual machine, the manager that seamlessly migrates the virtual machine receives the data packet sent by the related network element and caches the data packet.
- the related network element includes: a service function module, a router, a switch, a related gateway device, and/or a source server virtual machine manager;
- the data packet is: the related network element acquires the address information of the manager that seamlessly migrates the virtual machine through the pre-configuration mode or the DNS mechanism, so as to seamlessly migrate to the virtual machine according to the address information of the manager that the virtual machine seamlessly migrates.
- the manager sends the data message.
- the data packet is sent in the following manner:
- the related network element forwards the data packet to the seamless migration manager of the virtual machine, and can adopt a source routing technology, such as a LSRR (Loose Source and Record Route).
- LSRR Local Area Network Routing Protocol
- Either an IP tunneling technology (such as an IP packet) is sent to the destination VM or other data packet forwarding technology is used.
- the cache is: The time for the virtual machine seamless migration manager to cache the data messages sent to the active virtual machine can be pre-configured.
- Step S103 When the active virtual machine is migrated from the source server to the destination server and reactivated, the manager of the seamless migration of the virtual machine forwards the data packet to the active virtual machine according to the relevant migration information.
- the source server is notified to complete the virtual machine migration, and the source server confirms and releases the resources occupied by the active virtual machine.
- the destination server activates the migrated active virtual machine, and connects the local device, such as the I/O port, to notify the related network element that the active virtual machine resumes normal operation; the active virtual machine on the destination server, that is, the migrated active virtual machine receives the virtual machine.
- the data packet forwarded by the seamlessly migrated manager continues to process the corresponding service.
- the active VM receives subsequent data packets sent by the relevant NE.
- the forwarding channel of the data packet forwarded by the manager that receives the virtual machine seamlessly migrated by the migrated active virtual machine is: a mechanism used by the virtual machine seamless migration manager to send data packets to the active virtual machine.
- the seamless migration manager of the VM can directly forward the original data packet (for sending, receiving, or forwarding data packets).
- the related network element to the virtual machine seamless migration manager adopts the source routing technology), or may forward the original packet after the IP packet is forwarded (for the network element to send, receive or forward the related network element to the virtual machine)
- the seamless migration manager uses IP tunneling technology, or other data packet forwarding technologies.
- the IP address and/or MAC address of the active VM changes.
- the manager that seamlessly migrates VMs uses source routing technology, or uses IP tunneling technology, or uses other data packets. Forwarding technology, sending raw data messages to the new address of the active virtual machine.
- the policy of the seamless migration of the virtual machine forwards the cached data packet to the reactivated active virtual machine, including a caching mechanism, a forwarding mechanism, and a data packet forwarding technology. If the manager that seamlessly migrates the virtual machine caches the data packet for a certain period of time, it directly forwards the data packet to the migrated active virtual machine; or the manager that seamlessly migrates the virtual machine completes the processing and immediately moves to the migrated activity.
- the virtual machine forwards the data packet and ensures the reliability of the packet transmission by increasing the number of retransmissions or extending the retransmission timer. Or the manager of the seamless migration of the virtual machine specifies that the active virtual machine after the migration is received is re-established. After the activation notification, the data is forwarded to the active virtual machine.
- the following takes a detailed example to describe the process of seamless migration of active VMs during intra-network migration and cross-network segment migration.
- FIG. 4a is a flowchart of a process for seamless migration of an active virtual machine (indicated by virtual machine VM1 in FIG. 4a) during intra-network migration in this embodiment.
- the IP address and MAC address of the VM are not changed.
- the external disk file of the VM system does not need to be migrated.
- the VM hang time is usually within 100 milliseconds during the migration.
- the manager of the virtual machine seamless migration needs to receive, cache, and forward data packets sent to the migrated virtual machine during the virtual machine suspension.
- the data packet processing process during the virtual machine suspension period is described as follows:
- Step S201 The virtual machine VM1 is pre-migrated, and completes copying of most memory pages.
- Step S202 The source server 1 notifies the virtual machine that the seamless migration of the virtual machine VM1 is suspended, and informs the address information of the VM 1 of the virtual machine.
- the address information includes an IP address and a MAC address of the virtual machine VM1.
- Step S203 The source server 1 notifies the related network element that the virtual machine VM1 is about to hang.
- Step S204 The virtual machine VM1 on the source server 1 is suspended, and the last unmigrated memory page and all the virtual machine state data are synchronized to the destination server 2.
- the virtual machine state data includes a CPU state and a discontinuous memory page.
- Step S205 During the suspension of the virtual machine VM1, the related network element finds that the data packet sent to the virtual machine VM1 is unreachable, or the virtual machine VM1 is in the suspended state.
- a virtual machine in a group interacts with an external network through a fixed gateway device, and the fixed gateway device can perceive the virtual machine VM1 to hang through the above mechanism; for example, the virtual machine manager of the source server receives the virtual server The data packet of the machine VM1 triggers the data packet forwarding mechanism of step S206.
- Step S206 The related network element forwards the data packet of the virtual machine VM1 to the manager of the seamless migration of the virtual machine.
- the manner in which the data packet is forwarded may be multiple, such as a source routing technology, a loose source and record route (LSRR), or an IP tunneling technology (such as an IP packet) sent to the destination virtual machine. Or other data packet forwarding technology.
- a source routing technology such as a loose source and record route (LSRR), or an IP tunneling technology (such as an IP packet) sent to the destination virtual machine.
- LSRR loose source and record route
- IP tunneling technology such as an IP packet sent to the destination virtual machine.
- IP tunneling technology such as an IP packet
- Step S207 The manager that seamlessly migrates the virtual machine receives and caches the data packet whose destination address is the virtual machine VM1.
- Step S208 The virtual machine VM1 migration of the source server 1 is completed, and the virtual machine VM1 on the destination server 2 is activated.
- Step S209 The destination server 2 notifies the virtual machine that the seamless migration of the virtual machine VM1 migration is completed and has been activated.
- Step S210 The destination server 2 notifies the related network element that the virtual machine VM1 migration is completed and has been activated.
- Step S211 The virtual machine seamless migration manager receives the virtual VM1 activation notification, and sends the original data packet to the virtual machine VM1 on the destination server 2.
- Step S212 The virtual machine VM1 on the destination server 2 returns a response message to the relevant network element according to the data packet type.
- Step S213 The related network element directly sends the subsequent data packet to the virtual machine VM1 on the destination server 2.
- FIG. 4b is a process flow diagram of seamless migration of the active virtual machine (represented by the virtual machine VM1 in FIG. 4b) when the cross-network segment is migrated in this embodiment.
- the IP address and/or MAC address of the VM before and after VM migration will change.
- the external disk file of the VM system needs to be migrated to another network segment.
- the VM hang time is relatively relative during the migration process. Longer.
- the manager for seamless migration of virtual machines needs to receive, cache, and forward data packets destined for the migrated virtual machine during the suspension of the migrated virtual machine.
- the data packet processing process during the suspension of the virtual machine in the network is described as follows:
- Step S301 The virtual machine VM1 is pre-migrated, and completes the external disk image file and a copy of most of the memory pages;
- Step S302 The source server 1 notifies the virtual machine VM1 that the seamless migration of the virtual machine is about to hang, and informs the virtual machine VM1 of the address information before and after the migration, including the IP address and MAC address before the migration of the virtual machine VM1, and the virtual machine VM1.
- Step S303 the same step S203;
- Step S304 The virtual machine VM1 on the source server 1 hangs, and synchronizes the last unmigrated memory page and all the virtual machine state data to the destination server 2, including the CPU state and the discontinuous memory page, and the external disk mirroring.
- File write operation
- Steps S305 ⁇ 310 the same steps S205 ⁇ S210;
- Step S311 The virtual machine seamless migration manager receives the virtual VM1 activation notification, establishes an IP tunnel with the virtual machine VM1 on the destination server 2, and encapsulates the original data packet according to the content of the recorded migration virtual machine information table. deal with;
- Step S312 The virtual machine seamless migration manager encapsulates the buffered data packet and sends it to the destination server 2;
- Step S313 The virtual machine manager in the destination server 2 unpacks the IP packet and delivers it to the virtual machine VM1.
- Step S315 The subsequent data packet of the relevant network element is directly sent to the virtual machine VM1 on the destination server 2.
- the data packet forwarding process in steps S311-S312 can also be implemented by using a source routing technology.
- the virtual machine seamless migration manager inserts the destination server 2 into the cached routing path of the original data packet sent to the virtual machine VM1. After receiving the packet, the virtual machine manager on the destination server identifies that the packet should be sent to the local virtual machine VM 1 and passed to the virtual machine VM 1.
- the manager of the seamless migration of the virtual machine is notified of the address information of the active virtual machine that needs to be migrated before the active virtual machine of the source server is suspended, and the virtual machine has no virtual machine.
- the migration manager receives, caches, and forwards the data packets of the active virtual machine running the service during the suspension of the active virtual machine to ensure the continuity of the running of the active virtual machine, thereby solving the business data caused by the active virtual machine migration. Message loss problem.
- an embodiment of the present invention provides a manager for seamless migration of a virtual machine, including: an address obtaining module 401, a receiving buffer module 402, and a packet forwarding module 403.
- the address obtaining module 401 is configured to: Obtain related migration information of the active virtual machine located on the source server;
- the receiving buffer module 402 is configured to receive a data packet sent by the related network element and cache the active virtual machine during the suspension period;
- the message forwarding module 403 is configured to receive the data packet buffered by the buffer module 402 according to the related migration information of the active virtual machine saved in the address obtaining module 401 when the active virtual machine is migrated from the source server to the destination server and is reactivated. Forward to the active virtual machine.
- the message forwarding module 403 is further configured to: when the active virtual machine is migrated from the source server to the destination server and reactivated, receive the active virtual machine activation notification sent by the destination server.
- the address obtaining module 401 needs to be notified of the related migration information of the migrated active virtual machine, that is, the address information of the active virtual machine at the destination server.
- the address obtaining module 401 may notify the virtual cluster manager of the virtual cluster management server, the virtual machine manager of the source server, or the virtual machine manager of the destination server of the relevant migration information of the active virtual machine that needs to be migrated.
- the address obtaining module 401 may save the obtained related migration information in a migration virtual machine information table, so as to perform data packet forwarding and the like according to the related migration information in the migration virtual machine information table.
- the related migration information of the active virtual machine is mainly the address and status information of the active virtual machine, such as the active virtual machine. IP address, MAC address, migration status (suspended or reactivated).
- the related migration information of the active virtual machine is the address and status information before and after the active virtual machine migration, such as active virtual machine migration.
- the source server Whether the active virtual machine is suspended by the source server, and the source server notifies the address acquisition module 401 of the manager of the seamless migration of the virtual machine. Before the active VM is suspended, you need to reserve the resources required for the active VM to run on the destination server, including memory, CPU, network, etc. If the resource reservation fails, stop the VM migration and feed back the result.
- the address obtaining module 401 is specifically configured to: before the active virtual machine is suspended, before the end of the cyclic copy, the notification that the active virtual machine sent by the source server migrates between the source server and the destination server and is about to hang, The related information is recorded in the migration virtual machine information table, and the receiving buffer module 402 is configured to receive the data packet whose destination address is the active virtual machine.
- the receiving buffer module 402 is further configured to receive the preparation sent by the address obtaining module 401.
- Receiving destination address is active Notification of the packet of the virtual machine.
- the receiving buffer module 402 is specifically configured to receive a data packet sent by the related network element and cache the data packet.
- the packet forwarding module 403 is configured to receive, after receiving the status data of all the memory pages and the active virtual machine, the notification that the destination server successfully migrates.
- the packet forwarding channel between the packet forwarding module 403 and the active virtual machine is a mechanism used for sending data packets to the active virtual machine.
- the original virtual data packet can be forwarded directly because the IP address and MAC address of the active virtual machine are unchanged.
- the source routing technology is used for the data packets sent or forwarded by the related NE.
- the original packet may be extracted from the IP packet and then forwarded (for the case where the data packet sent or forwarded by the relevant network element adopts the IP tunnel technology) or other data packet forwarding technology.
- the IP address and/or MAC address of the active VM is changed, or the source routing technology is used, or the IP tunneling technology is used, or other data packet forwarding technologies are used to transmit the original data packet.
- the new address to the active virtual machine is changed, or the source routing technology is used, or the IP tunneling technology is used, or other data packet forwarding technologies are used to transmit the original data packet.
- the new address to the active virtual machine is changed, or the source routing technology is used, or the IP tunneling technology is used, or other data packet forwarding technologies are used to transmit the original data packet.
- the new address to the active virtual machine.
- the policy of the packet forwarding module 403 for forwarding the buffered data packet to the reactivated active virtual machine includes a caching mechanism, a forwarding mechanism, and a data packet forwarding technology. After the receiving buffer module 402 caches the data packet for a certain period of time, the packet forwarding module 403 directly forwards the data packet to the migrated active virtual machine; or after receiving the processing, the receiving buffer module 402 immediately passes the report. The forwarding module 403 forwards the data packet to the migrated active virtual machine, and ensures the reliability of the packet transmission by increasing the number of retransmissions or extending the retransmission timer; or receiving the buffer module 402, after receiving the migration After the active virtual machine is reactivated, the data message is forwarded to the active virtual machine.
- the present invention further provides a system for seamless migration of a virtual machine, including: a source server 501, a destination server 502, and a manager for seamless migration of virtual machines 503;
- the source server 501 is configured to complete the copy active virtual machine before the active virtual machine is migrated. After the predetermined memory page of the row reaches the destination server 502, the active virtual machine is suspended, and the remaining unmigrated memory pages and the state data of the active virtual machine are synchronized to the destination server 502;
- a virtual machine seamless migration manager 503, configured to acquire related migration information of the active virtual machine located on the source server 501; receive the data packet sent by the relevant network element and cache the active virtual machine during the suspension; When the virtual machine is migrated from the source server 501 to the destination server 502 and reactivated, the data packet is forwarded to the active virtual machine according to the relevant migration information;
- the destination server 502 is configured to activate the active virtual machine when the active virtual machine completes the migration. Further, the source server 501 is further configured to copy the memory page run by the active virtual machine to the destination server 502, and then copy the modified memory page during the previous round of memory copy each time; when the memory page needs to be copied When the number or the memory dirty page rate meets the predetermined threshold, the cyclic copy is stopped; correspondingly, the destination server 502 is further configured to receive and save the memory page of the active virtual machine sent by the source server 501.
- the destination server 502 is further configured to send an active virtual machine activation notification to the source server 501 and the virtual machine seamlessly migrated manager 503 when the active virtual machine is activated; correspondingly, the source server 501 is further configured to receive After the active virtual machine activates the notification, the resources occupied by the active virtual machine are released.
- the source server 501, the destination server 502, and the seamless migration manager 503 of the virtual machine are combined with the related network elements to implement the seamless migration of the virtual machine.
- the source server 501, the destination server 502, and the seamless migration manager 503 of the virtual machine are combined with the related network elements to implement the seamless migration of the virtual machine.
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
Description
虚拟机无缝迁移的方法、 管理器及系统 技术领域 Method, manager and system for seamless migration of virtual machines
本发明涉及云计算虚拟化领域, 尤其涉及一种虚拟机无缝迁移的方法、 管理器及系统。 背景技术 The present invention relates to the field of cloud computing virtualization, and in particular, to a method, a manager and a system for seamless migration of virtual machines. Background technique
云计算(Cloud Computing )是一种新兴的共享基础架构计算方法, 其 可以将巨大的系统资源池连接在一起提供信息产业 (IT , Information Technology )服务。 云计算是网格计算、分布式计算、 并行计算、效用计算、 网络存储、 虚拟化及负载均衡等传统计算机技术和网络技术融合发展的产 物。 它旨在通过网络把多个成本相对较低的计算实体整合成一个强大的系 统, 并借助软件即服务(SaaS, Software-as-a-service ), 平台即服务(PaaS, Platform as a Service )、 基石出设备即月良务 ( IaaS, Infrastructure as a Service ) 等商业模式将各种能力及服务分布到终端用户中。 例如, 基于虚拟集群技 术的云计算数据中心即是一种现有的商业模式, 其租用大型云计算数据中 心的虚拟机及网络部署各种业务网络, 可达到快速部署、 降低运营成本的 目的。 Cloud Computing is an emerging shared infrastructure computing method that connects huge pools of system resources to provide information (IT) services. Cloud computing is a product of the convergence of traditional computer technologies and network technologies such as grid computing, distributed computing, parallel computing, utility computing, network storage, virtualization, and load balancing. It aims to integrate multiple relatively low-cost computing entities into a powerful system through the network, and with software-as-a-service (SaaS, Platform as a Service) (PaaS, Platform as a Service) Business models such as IaaS (Isolated Infrastructure as a Service) distribute various capabilities and services to end users. For example, a cloud computing data center based on virtual cluster technology is an existing business model. It leases virtual machines and networks of large cloud computing data centers to deploy various business networks, which can achieve rapid deployment and reduce operating costs.
在上述的云计算数据中心的商业模式中, 虚拟机动态在线迁移对云计 算数据中心的高可用性( High Availability )、 弹性( Rapid Elasticity )以及节 能( Economization ) 的实现至关重要。 例如, 在物理服务器需要维护时, 可以将其上的虚拟机迁移到其他物理服务器上, 保证物理服务器维护过程 中不影响业务; 又如, 在虚拟机负载较轻时, 可以将多个物理服务器上的 虚拟机迁移到少数几台物理服务器上, 关闭其他物理服务器的电源, 在不 影响业务的情况下可节省能耗。 现有技术中, 云计算数据中心的典型网络架构如图 1 所示。 云计算数 据中心由虚拟集群管理服务器( DCMP , Data Center Management Platform ) 10、 网络存储设备(NAS, Network Access Storage ) 20以及若干支持虚拟 化技术的物理服务器 3组成。 其中虚拟集群管理服务器 10负责云计算数据 中心虚拟机资源的统一调度、 分配及管理; 网络存储设备 20通过光纤通道 提供虚拟机外部虚拟磁盘文件高速读写。 云计算数据中心的物理服务器通 过虚拟机管理器( VMM, Virtual Machine Monitor ) 40将本地物理资源虚拟 化, 支持同一套物理资源上运行多个虚拟机 ( VM, Virtual Machine ) 50。 In the business model of the cloud computing data center described above, dynamic online migration of virtual machines is critical to the realization of high availability, rapid Elasticity, and Economization of cloud computing data centers. For example, when a physical server needs to be maintained, you can migrate the virtual machine to another physical server to ensure that the physical server does not affect the service during the maintenance process. For example, when the virtual machine load is light, multiple physical servers can be used. The virtual machine on the migration migrates to a few physical servers, shutting down the power of other physical servers, and saving energy without affecting the service. In the prior art, a typical network architecture of a cloud computing data center is shown in FIG. 1 . The cloud computing data center is composed of a virtual cluster management server (DCMP, Data Center Management Platform) 10, a network storage device (NAS), and a plurality of physical servers 3 supporting virtualization technologies. The virtual cluster management server 10 is responsible for unified scheduling, allocation, and management of virtual machine resources in the cloud computing data center; the network storage device 20 provides high-speed reading and writing of virtual disk external virtual disk files through the Fibre Channel. The physical server of the cloud computing data center virtualizes local physical resources through a virtual machine manager (VMM) 40, and supports running multiple virtual machines (VMs) on the same set of physical resources.
在上述云计算数据中心的网络环境下, 虚拟机 50运行所需的磁盘虚拟 文件存储在 NAS 20上, 虚拟机 50启动时, 从 NAS 20读取虚拟磁盘文件 内容到内存, 并将对虚拟磁盘文件的读写更新到外部 NAS 20。 虚拟机 50 的在线迁移是通过在源服务器和目的服务器之间拷贝内存来实现的。 现有 的虚拟机在线迁移的具体步驟包括: In the network environment of the cloud computing data center, the virtual disk file required for the virtual machine 50 to run is stored on the NAS 20. When the virtual machine 50 starts, the virtual disk file content is read from the NAS 20 to the memory, and the virtual disk is read. The file is read and written to the external NAS 20. Online migration of virtual machine 50 is accomplished by copying memory between the source and destination servers. The specific steps for online migration of existing virtual machines include:
步驟 S1 : 迁移准备。 计划将源服务器上的活动虚拟机 VM1 迁移到目 的服务器上; Step S1: Migration preparation. Plan to migrate the active virtual machine VM1 on the source server to the destination server;
步驟 S2: 目的服务器资源预留。 在目的服务器上预留虚拟机 VM1运 行所需的资源, 包括内存、 CPU, 网络等, 若资源预留失败, 则停止虚拟 机迁移并反馈结果; Step S2: The destination server resource is reserved. Reserve the resources required for VM1 running on the destination server, including memory, CPU, network, etc. If the resource reservation fails, stop the VM migration and feed back the result.
步驟 S3: 内存循环预拷贝。 首先将源服务器上虚拟机 VM1运行的内 存页拷贝到目的服务器上, 后续每次循环拷贝上一轮内存拷贝期间修改过 的内存页 (脏页); Step S3: Memory cycle pre-copy. First, copy the memory page of the virtual machine VM1 running on the source server to the destination server, and then copy the modified memory page (dirty page) during the previous round of memory copy each time;
步驟 S4: 停止拷贝。 当需要拷贝的内存页数或内存脏页率 (每次循环 期间内存脏页数除以所需拷贝的内存页数) 满足预定阈值时, 停止循环拷 贝, 将源虚拟机挂起, 并将剩余的内存页及虚拟机的状态数据(CPU状态 及不连续的内存页)一次性同步到目的服务器上; 且向网络发送主动 ARP 请求更新网络位置到目的服务器; Step S4: Stop copying. When the number of memory pages to be copied or the dirty page rate of memory (the number of pages of dirty memory during each cycle divided by the number of pages of the required copy) meets the predetermined threshold, the circular copy is stopped, the source virtual machine is suspended, and the remaining The memory page and the virtual machine's status data (CPU status and non-contiguous memory pages) are synchronized to the destination server at one time; and the active ARP is sent to the network. Request to update the network location to the destination server;
步驟 S5: 确认。 目的服务器接收完所有内存页及虚拟机状态数据后, 通知源服务器完成虚拟机迁移, 源服务器确认后释放虚拟机 VM1占用的资 源; Step S5: Confirm. After receiving all the memory pages and the virtual machine state data, the destination server notifies the source server to complete the virtual machine migration, and the source server confirms and releases the resources occupied by the virtual machine VM1;
步驟 S6: 激活。 目的服务器激活迁移后的虚拟机 VM1 ,连接本地设备, 如 I/O端口等, 恢复正常运行; Step S6: Activate. The destination server activates the migrated VM VM1 and connects to the local device, such as the I/O port, to resume normal operation.
在上述流程中,执行步驟 S4至步驟 S5时, 虚拟机 VM1在源服务器和 目的服务器上均处于挂起状态, 根据步驟 S4中需要拷贝的数据量大小和传 输带宽, 虚拟机 VM1挂起状态持续的时间长短有所不同, 在此期间会造成 少量的数据包丟失。并且,源服务器发出的主动地址解析协议( ARP, Address Resolution Protocol )请求, 某些网络设备可能对此拒绝响应。 由此进一步 导致, 直到目的服务器上的虚拟机 VM1向网络发起第一个数据报文开始, 网络设备才能完全感知虚拟机 VM1的位置变化。 因此, 现有虚拟机迁移技 术存在虚拟机与网络连接的中断现象, 从而影响了虚拟机运行业务的连续 性。 发明内容 In the above process, when performing step S4 to step S5, the virtual machine VM1 is in a suspended state on both the source server and the destination server, and the virtual machine VM1 is suspended according to the amount of data to be copied and the transmission bandwidth in step S4. The length of time varies, resulting in a small amount of packet loss during this time. Moreover, the source address server sends an Active Address Resolution Protocol (ARP) request, and some network devices may refuse to respond to this. Therefore, the network device can completely perceive the change of the location of the virtual machine VM1 until the virtual machine VM1 on the destination server initiates the first data packet to the network. Therefore, the existing virtual machine migration technology has a disruption between the virtual machine and the network connection, thereby affecting the continuity of the virtual machine running service. Summary of the invention
本发明的主要目的在于提供一种虚拟机无缝迁移的方法、 管理器及系 统, 以解决虚拟机在线迁移过程中虚拟机挂起引起的业务报文丟失问题。 The main purpose of the present invention is to provide a method, a manager, and a system for seamlessly migrating virtual machines to solve the problem of loss of service packets caused by virtual machine suspension during virtual machine online migration.
为了达到上述目的, 本发明提出一种虚拟机无缝迁移的方法, 该方法 包括: In order to achieve the above object, the present invention provides a method for seamless migration of a virtual machine, the method comprising:
获取位于源服务器上的活动虚拟机的相关迁移信息; Obtain related migration information of the active virtual machine located on the source server;
在所述活动虚拟机被挂起期间, 接收相关网元发来的数据报文并緩存; 当所述活动虚拟机从所述源服务器迁移到目的服务器且重新激活时, 按照所述相关迁移信息将所述数据报文转发给所述活动虚拟机。 Receiving, during the suspension of the active virtual machine, a data packet sent by the relevant network element, and caching; when the active virtual machine is migrated from the source server to the destination server and is reactivated, according to the related migration information. Forwarding the data message to the active virtual machine.
优选地, 所述活动虚拟机的相关迁移信息, 包括: 活动虚拟机迁移前 和 /或迁移后的互联网协议 ( IP , Internet Protocol ) 地址、 介质访问控制 ( MAC , Medium/Media Access Control )地址和 /或迁移 ^态。 Preferably, the related migration information of the active virtual machine includes: before the active virtual machine is migrated And/or migrated Internet Protocol (IP, Internet Protocol) addresses, Media Access Control (MAC, Medium/Media Access Control) addresses, and/or migrations.
优选地, 所述获取位于源服务器上的活动虚拟机的相关迁移信息, 包 括: 由虚拟集群管理服务器、 源服务器虚拟机管理器或者目的服务器发来 需要迁移的活动虚拟机的所述相关迁移信息。 Preferably, the acquiring, by the virtual cluster management server, the source server, the virtual machine manager, or the destination server, the related migration information of the active virtual machine that needs to be migrated, where the related migration information of the active virtual machine located on the source server is obtained. .
优选地, 所述相关网元包括: 业务功能模块、 路由器、 交换机、 相关 网关设备和 /或者源服务器虚拟机管理器。 Preferably, the related network element includes: a service function module, a router, a switch, a related gateway device, and/or a source server virtual machine manager.
优选地, 所述接收相关网元发来的数据报文之前, 该方法还包括: 所 述相关网元通过预配置方式或域名解析服务( DNS , Domain Name Service ) 机制获取所述虚拟机无缝迁移的管理器的地址信息, 根据所述地址信息发 送所述数据报文。 Preferably, before the receiving the data packet sent by the relevant network element, the method further includes: obtaining, by the related network element, the virtual machine by using a pre-configuration manner or a domain name resolution service (DNS) mechanism The address information of the migrated manager sends the data packet according to the address information.
优选地, 所述将数据报文转发给所述活动虚拟机之前, 该方法还包括: 接收所述目的服务器发送的活动虚拟机激活通知。 Preferably, before the forwarding the data packet to the active virtual machine, the method further includes: receiving an active virtual machine activation notification sent by the destination server.
优选地, 所述相关网元发来的数据报文, 包括: 通过源路由方式或 IP 隧道方式发来的所述数据报文。 Preferably, the data packet sent by the related network element includes: the data packet sent by using a source routing manner or an IP tunneling manner.
本发明还提出一种虚拟机无缝迁移的管理器, 该管理器包括: 地址获 耳4莫块、 接收緩存模块和报文转发模块; 其中, The present invention also provides a manager for seamless migration of a virtual machine, the manager comprising: an address obtaining block, a receiving buffer module, and a message forwarding module;
地址获取模块, 用于获取位于源服务器上的活动虚拟机的相关迁移信 接收緩存模块, 用于在所述活动虚拟机被挂起期间, 接收相关网元发 来的数据报文并緩存; An address obtaining module, configured to acquire an active migration information receiving cache module of the active virtual machine located on the source server, configured to receive a data packet sent by the related network element and cache the active virtual machine during the suspension;
报文转发模块, 用于当所述活动虚拟机从所述源服务器迁移到目的服 务器且重新激活时, 按照地址获取模块中保存的所述活动虚拟机的相关迁 移信息, 将接收緩存模块緩存的所述数据报文转发给所述活动虚拟机。 a message forwarding module, configured to: when the active virtual machine is migrated from the source server to the destination server and reactivated, according to the related migration information of the active virtual machine saved in the address obtaining module, the receiving cache module is cached The data message is forwarded to the active virtual machine.
优选地, 所述报文转发模块, 还用于当所述活动虚拟机从所述源服务 器迁移到目的服务器且重新激活时, 接收所述目的服务器发来的活动虚拟 机激活通知。 Preferably, the message forwarding module is further configured to: when the active virtual machine is served from the source When the device migrates to the destination server and is reactivated, it receives an active virtual machine activation notification sent by the destination server.
优选地, 所述地址获取模块, 具体用于将活动虚拟机迁移前和 /或迁移 后的 IP地址、 MAC地址和 /或迁移状态作为该活动虚拟机的相关迁移信息 保存。 Preferably, the address obtaining module is specifically configured to save the pre-migration and/or post-migration IP address, MAC address, and/or migration status of the active virtual machine as related migration information of the active virtual machine.
本发明还提出一种虚拟机无缝迁移的系统, 该系统包括: 源服务器、 目的服务器及虚拟机无缝迁移的管理器; 其中: The invention also provides a system for seamless migration of a virtual machine, the system comprising: a source server, a destination server and a seamless migration manager of the virtual machine; wherein:
所述源服务器, 用于活动虚拟机发生迁移前, 完成拷贝所述活动虚拟 机运行的预定内存页至目的服务器后, 将所述活动虚拟机挂起, 并将剩余 未迁移的内存页及活动虚拟机的状态数据同步到目的服务器上; The source server suspends the active virtual machine after the copying of the scheduled memory page of the active virtual machine to the destination server before the active virtual machine is migrated, and suspends the remaining unmigrated memory pages and activities The state data of the virtual machine is synchronized to the destination server;
所述虚拟机无缝迁移的管理器, 用于获取位于源服务器上的活动虚拟 机的相关迁移信息; 在所述活动虚拟机被挂起期间, 接收相关网元发送的 数据报文并緩存; 当所述活动虚拟机从所述源服务器迁移到目的服务器且 重新激活时, 按照所述相关迁移信息将所述数据报文转发给所述目的服务 器中的活动虚拟机; The virtual machine seamless migration manager is configured to acquire related migration information of the active virtual machine located on the source server; receive the data packet sent by the relevant network element and cache the active virtual machine during the suspension; When the active virtual machine is migrated from the source server to the destination server and is reactivated, forwarding the data packet to the active virtual machine in the destination server according to the related migration information;
所述目的服务器, 用于当所述活动虚拟机完成迁移时, 激活所述活动 虚拟机, 以及接收并保存虚拟机无缝迁移的管理器发来的数据报文。 The destination server is configured to activate the active virtual machine when the active virtual machine completes the migration, and receive and save the data packet sent by the manager that the virtual machine seamlessly migrates.
优选地, 所述源服务器, 还用于将所述活动虚拟机运行的内存页拷贝 到所述目的服务器上, 后续每次循环拷贝上一轮内存拷贝期间修改过的内 存页; 当需要拷贝的内存页数或内存脏页率满足预定阈值时, 停止循环拷 贝。 Preferably, the source server is further configured to copy a memory page run by the active virtual machine to the destination server, and subsequently copy the modified memory page during a previous round of memory copy each time; When the number of memory pages or memory dirty page rate meets a predetermined threshold, the circular copy is stopped.
优选地, 所述目的服务器还用于在激活所述活动虚拟机时, 向所述源 服务器及虚拟机无缝迁移的管理器发送活动虚拟机激活通知; Preferably, the destination server is further configured to: when the active virtual machine is activated, send an active virtual machine activation notification to a manager that seamlessly migrates the source server and the virtual machine;
相应的, 所述源服务器, 还用于收到所述活动虚拟机激活通知后, 释 放所述活动虚拟机占用的资源; 所述虚拟机无缝迁移的管理器, 具体用于接收到目的服务器发来的活 动虚拟机激活通知时, 按照所述相关迁移信息将所述数据报文转发给所述 目的服务器中的活动虚拟机。 Correspondingly, the source server is further configured to release the resources occupied by the active virtual machine after receiving the active virtual machine activation notification; The manager for seamlessly migrating the virtual machine is specifically configured to: when receiving the active virtual machine activation notification sent by the destination server, forward the data packet to the active virtual in the destination server according to the related migration information. machine.
本发明提出的一种虚拟机无缝迁移的方法、 管理器及系统, 通过在网 络上部署集中的虚拟机无缝迁移的管理器, 在活动虚拟机挂起前, 将活动 虚拟机的相关迁移信息告知虚拟机无缝迁移的管理器; 在活动虚拟机挂起 送到虚拟机无缝迁移的管理器上; 虚拟机无缝迁移的管理器接收并緩存相 关的数据报文, 并在活动虚拟机重新激活后, 将数据报文转发到活动虚拟 机上, 由此保证虚拟机迁移过程中其运行业务的连续性, 从而解决了由于 虚拟机迁移引起的业务数据报文丟失问题, 提高网络性能。 附图说明 The method, the manager and the system for seamlessly migrating a virtual machine according to the present invention, the related migration of the active virtual machine before the active virtual machine is suspended by deploying the centralized virtual machine seamless migration manager on the network The manager informs the virtual machine of the seamless migration of the virtual machine; the active virtual machine hangs on the manager that is sent to the virtual machine for seamless migration; the virtual machine seamless migration manager receives and caches the related data message, and is active in the virtual machine. After the device is reactivated, the data packet is forwarded to the active VM. This ensures the continuity of the running of the VM during the VM migration process. This solves the problem of loss of service data packets caused by VM migration and improves network performance. . DRAWINGS
图 1是现有的云计算数据中心的一种网络架构示意图; 1 is a schematic diagram of a network architecture of an existing cloud computing data center;
图 2是本发明中云计算数据中心的网络架构示意图; 2 is a schematic diagram of a network architecture of a cloud computing data center in the present invention;
图 3是本发明虚拟机无缝迁移的方法一实施例流程示意图; 3 is a schematic flow chart of an embodiment of a method for seamlessly migrating a virtual machine according to the present invention;
图 4a是本发明虚拟机无缝迁移的方法一实施例中活动虚拟机网内迁移 的处理流程图; 4a is a flowchart of processing in an active virtual machine network migration in an embodiment of a method for seamlessly migrating a virtual machine according to the present invention;
图 4b是本发明虚拟机无缝迁移的方法一实施例中活动虚拟机跨网段迁 移的处理流程图; FIG. 4b is a flowchart of a process for moving an active virtual machine across network segments in an embodiment of a method for seamlessly migrating a virtual machine according to the present invention; FIG.
图 5是本发明虚拟机无缝迁移的管理器一实施例的结构示意图; 图 6是本发明虚拟机无缝迁移的系统一实施例的结构示意图。 5 is a schematic structural diagram of an embodiment of a seamless migration of a virtual machine according to the present invention; and FIG. 6 is a schematic structural diagram of an embodiment of a system for seamless migration of a virtual machine according to the present invention.
为了使本发明的技术方案更加清楚、 明了, 下面将结合附图作进一步 评述。 具体实施方式 In order to make the technical solutions of the present invention clearer and clearer, the following will be further reviewed in conjunction with the accompanying drawings. detailed description
本发明实施例解决方案主要是: 通过在网络上部署集中的虚拟机无缝 迁移的管理器, 接收、 緩存并转发活动虚拟机挂起期间网络上的业务数据 报文, 以解决由于活动虚拟机迁移引起的业务数据报文丟失问题。 The solution of the embodiment of the present invention is mainly: collecting, caching, and forwarding service data packets on the network during the suspension of the active virtual machine by deploying the centralized virtual machine seamless migration manager on the network, to solve the problem due to the active virtual machine The loss of service data packets caused by the migration.
本发明实施例涉及的云计算数据中心的网络架构如图 2所示。 云计算 数据中心主要包括以下设备或网元: 虚拟集群管理服务器、 网络存储设备、 物理服务器(包括源服务器及目的服务器)、 虚拟机无缝迁移的管理器以及 网络连接设备及其他网络。 其中: The network architecture of the cloud computing data center involved in the embodiment of the present invention is as shown in FIG. 2 . Cloud computing The data center mainly includes the following devices or network elements: virtual cluster management server, network storage device, physical server (including source server and destination server), virtual machine seamless migration manager, network connection device and other networks. among them:
虚拟集群管理服务器, 负责管理虚拟集群内所有资源的管理, 包括物 理服务器(包括处理器、 内存、 网络接口等资源)、 存储设备、 网络设备等 物理资源, 以及虚拟机、 虚拟网络等虚拟资源; 对外提供虚拟资源的管理 与调度, 如虚拟机的申请、 创建、 更新、 删除, 虚拟网络的配置等操作。 The virtual cluster management server is responsible for managing the management of all resources in the virtual cluster, including physical resources (including processors, memory, network interfaces, etc.), storage devices, network devices, and other physical resources, as well as virtual resources such as virtual machines and virtual networks. Provide external management and scheduling of virtual resources, such as virtual machine application, creation, update, deletion, and virtual network configuration.
网络存储设备, 负责提供虚拟机安装所需的模板及镜像文件、 虚拟机 外部的虚拟磁盘文件的存储, 以及数据块的存储等。 一般地, 网络存储设 备通过光纤设备与网络相连, 提供高速率高带宽的外部存储通道。 A network storage device that provides templates and image files required for virtual machine installation, storage of virtual disk files outside the virtual machine, and storage of data blocks. Generally, network storage devices are connected to the network through fiber optic equipment to provide high-speed, high-bandwidth external storage channels.
物理服务器, 支持虚拟化的服务器设备, 通过虚拟机管理器(VMM ) 304能够对一个物理服务器的硬件资源进行共享, 支持多个虚拟机的运行。 一般地, 云计算数据中心存在多台物理服务器。 The physical server, which supports the virtualized server device, can share the hardware resources of one physical server through the virtual machine manager (VMM) 304, and supports the running of multiple virtual machines. Generally, there are multiple physical servers in a cloud computing data center.
虚拟机无缝迁移的管理器, 在虚拟机迁移造成的虚拟机挂起期间, 负 责接收、 緩存、 转发业务的数据报文, 保证被迁移虚拟机运行业务的连续 性。 在本发明中, 虚拟机无缝迁移的管理器作为一个公共网元部署, 可以 通过云计算数据中心配置文件公开, 也可以通过其他方式如 DNS等方式查 询。 The virtual machine seamless migration manager is responsible for receiving, caching, and forwarding data packets during the virtual machine hang caused by the virtual machine migration to ensure the continuity of the service running by the migrated virtual machine. In the present invention, the virtual machine seamless migration manager is deployed as a public network element, and can be exposed through a cloud computing data center configuration file, or can be queried by other means such as DNS.
另外, 大型的数据中心还可能需要进行跨网段、 跨地域的网络划分, 一个网段内的物理服务器组成一个群组, 并通过网络连接设备和其他网络 相连, 网络连接设备一般为路由器或交换机或其他网关设备。 In addition, large data centers may also need to divide networks across network segments and regions. The physical servers in one network segment form a group and connect devices and other networks through the network. Connected, the network connection device is generally a router or switch or other gateway device.
如图 3 所示, 基于上述网络架构, 本发明一实施例提出一种虚拟机无 缝迁移的方法, 包括: As shown in FIG. 3, based on the foregoing network architecture, an embodiment of the present invention provides a method for seamlessly migrating a virtual machine, including:
步驟 S101: 虚拟机无缝迁移的管理器获取位于源服务器上的活动虚拟 机的相关迁移信息。 Step S101: The virtual machine seamless migration manager acquires related migration information of the active virtual machine located on the source server.
这里, 所述活动虚拟机的相关迁移信息为活动虚拟机在目的服务器的 地址信息, 具体的: Here, the related migration information of the active virtual machine is address information of the active virtual machine at the destination server, specifically:
对于网内的虚拟机迁移, 即活动虚拟机在迁移前后不改变 IP地址和 / 或 MAC地址的情况下,所述活动虚拟机的相关迁移信息为活动虚拟机的地 址和状态信息, 如活动虚拟机的 IP地址、 MAC地址、 迁移状态 (挂起或 重新激活); For the virtual machine migration in the network, that is, if the active virtual machine does not change the IP address and/or the MAC address before and after the migration, the related migration information of the active virtual machine is the address and status information of the active virtual machine, such as active virtual IP address, MAC address, migration status (suspended or reactivated);
对于跨网段的虚拟机迁移, 即活动虚拟机迁移前后改变 IP地址和 /或 MAC地址的情况下, 所述活动虚拟机的相关迁移信息为活动虚拟机迁移前 后的地址和状态信息, 如活动虚拟机迁移前的 IP地址和 MAC地址、 活动 虚拟机迁移后的 IP地址和 MAC地址、 迁移状态 (挂起或重新激活)。 For the virtual machine migration across the network segment, that is, when the active virtual machine changes the IP address and/or the MAC address before and after the migration, the related migration information of the active virtual machine is the address and status information before and after the active virtual machine migration, such as an activity. IP address and MAC address before virtual machine migration, IP address and MAC address after migration of active virtual machine, migration status (suspended or reactivated).
所述获取可以为: 由虚拟集群管理服务器、 源服务器的虚拟机管理器 或者目的服务器的虚拟机管理器, 将需要迁移的活动虚拟机的相关迁移信 息发给虚拟机无缝迁移的管理器。 The obtaining may be: sending, by the virtual cluster management server, the virtual machine manager of the source server, or the virtual machine manager of the destination server, the related migration information of the active virtual machine to be migrated to the manager of the virtual machine seamless migration.
上述步驟 S101完成后, 可以将活动虚拟机的相关迁移信息保存在一张 迁移虚拟机信息表中, 以便后续依据该迁移虚拟机信息表中的相关迁移信 息进行数据报文转发等。 After the foregoing step S101 is completed, the related migration information of the active virtual machine may be saved in a migration virtual machine information table, so as to perform data packet forwarding according to the related migration information in the migration virtual machine information table.
上述步驟 S101开始之前, 需要判断活动虚拟机是否被挂起, 包括: 通 过源服务器来判断活动虚拟机是否被挂起, 并由源服务器通知虚拟机无缝 迁移的管理器、 目的服务器及相关网元。 在活动虚拟机被挂起前, 需要在 目的服务器上预留活动虚拟机运行所需的资源, 包括内存、 中央处理器 ( CPU, Computer Process Unit ), 网络等, 若资源预留失败, 则停止虚拟机 迁移并反馈结果; Before the step S101 is started, it is required to determine whether the active virtual machine is suspended, including: determining, by the source server, whether the active virtual machine is suspended, and notifying the virtual machine to migrate the manager, the destination server, and the related network by the source server. yuan. Before the active virtual machine is suspended, the resources required for the active virtual machine to run, including the memory and the central processing unit, need to be reserved on the destination server. (CPU, Computer Process Unit), network, etc. If the resource reservation fails, the virtual machine migration is stopped and the result is fed back;
在活动虚拟机被挂起前, 还需完成内存循环预拷贝, 包括: 将源服务 器上活动虚拟机运行的内存页拷贝到目的服务器, 后续每次循环拷贝上一 轮内存拷贝期间修改过的内存页 (脏页); 在循环拷贝截止前, 源服务器通 知虚拟机无缝迁移的管理器活动虚拟机在源服务器与目的服务器之间迁移 并即将挂起, 虚拟机无缝迁移的管理器将活动虚拟机的相关迁移信息记入 迁移虚拟机信息表, 并准备接收目的地址为活动虚拟机的数据包。 Before the active virtual machine is suspended, the memory loop pre-copy needs to be completed, including: copying the memory page of the active virtual machine running on the source server to the destination server, and then copying the modified memory during the previous round of memory copy every subsequent cycle. Page (dirty page); Before the end of the circular copy, the source server notifies the virtual machine to migrate seamlessly. The active virtual machine migrates between the source server and the destination server and is about to hang. The manager of the virtual machine seamless migration will be active. The related migration information of the virtual machine is recorded in the migration virtual machine information table, and is ready to receive the data packet whose destination address is the active virtual machine.
其中, 所述源服务器通知虚拟机无缝迁移的管理器活动虚拟机在源服 务器与目的服务器之间迁移并即将挂起, 可以由虚拟集群管理服务器(如 果虚拟集群管理服务器参与虚拟机迁移流程) 完成, 或者由源服务器或目 的服务器完成。 The manager active virtual machine that notifies the virtual machine to migrate seamlessly migrates between the source server and the destination server and is about to hang, and may be managed by the virtual cluster management server (if the virtual cluster management server participates in the virtual machine migration process) Completed, either by the source or destination server.
所述挂起为: 当需要拷贝的内存页数或内存脏页率 (每次循环期间内 存脏页数除以所需拷贝的内存页数) 满足预定阈值时, 停止循环拷贝, 源 服务器将活动虚拟机挂起, 并将剩余的内存页及活动虚拟机的状态数据 ( CPU状态及不连续的内存页)一次性同步到目的服务器上。 The hang is: when the number of memory pages to be copied or the dirty page rate of the memory (the number of pages of dirty memory during each cycle divided by the number of pages of the required copy), when the predetermined threshold is met, the circular copy is stopped, and the source server is active. The virtual machine hangs and synchronizes the remaining memory pages and the status data (CPU status and non-contiguous memory pages) of the active virtual machine to the destination server at one time.
步驟 S102: 在活动虚拟机被挂起期间, 虚拟机无缝迁移的管理器接收 相关网元发来的数据报文并緩存。 Step S102: During the suspension of the active virtual machine, the manager that seamlessly migrates the virtual machine receives the data packet sent by the related network element and caches the data packet.
这里, 所述相关网元包括: 业务功能模块、 路由器、 交换机、 相关网 关设备和 /或者源服务器虚拟机管理器; Here, the related network element includes: a service function module, a router, a switch, a related gateway device, and/or a source server virtual machine manager;
所述数据报文为: 相关网元通过预配置方式或 DNS机制获取虚拟机无 缝迁移的管理器的地址信息, 以便根据该虚拟机无缝迁移的管理器的地址 信息向虚拟机无缝迁移的管理器发送所述数据报文。 所述数据报文的发送 方式为: 相关网元将数据报文转发到虚拟机无缝迁移的管理器, 可以通过 源路由技术, 如 散源记录路由 (LSRR, Loose Source and Record Route ) 或者 IP隧道技术(如 IP封包)发往目的虚拟机, 或者采用其它数据报文转 发技术。 The data packet is: the related network element acquires the address information of the manager that seamlessly migrates the virtual machine through the pre-configuration mode or the DNS mechanism, so as to seamlessly migrate to the virtual machine according to the address information of the manager that the virtual machine seamlessly migrates. The manager sends the data message. The data packet is sent in the following manner: The related network element forwards the data packet to the seamless migration manager of the virtual machine, and can adopt a source routing technology, such as a LSRR (Loose Source and Record Route). Either an IP tunneling technology (such as an IP packet) is sent to the destination VM or other data packet forwarding technology is used.
所述緩存为: 虚拟机无缝迁移的管理器緩存发往活动虚拟机的数据报 文的时间可以预配置设定。 The cache is: The time for the virtual machine seamless migration manager to cache the data messages sent to the active virtual machine can be pre-configured.
步驟 S103:当活动虚拟机从源服务器迁移到目的服务器且重新激活时, 虚拟机无缝迁移的管理器按照相关迁移信息将数据报文转发给活动虚拟 机。 Step S103: When the active virtual machine is migrated from the source server to the destination server and reactivated, the manager of the seamless migration of the virtual machine forwards the data packet to the active virtual machine according to the relevant migration information.
在本步驟中, 当目的服务器接收完所有内存页及活动虚拟机的状态数 据后, 通知源服务器完成虚拟机迁移, 源服务器确认后释放活动虚拟机占 用的资源。 同时目的服务器激活迁移后的活动虚拟机, 连接本地设备, 如 I/O端口等, 通知相关网元活动虚拟机恢复正常运行; 目的服务器上的活动 虚拟机即迁移后的活动虚拟机接收虚拟机无缝迁移的管理器转发的数据报 文, 继续进行相应的业务处理, 后续流程中, 活动虚拟机接收相关网元发 送的后续数据报文。 In this step, after the destination server receives the status data of all the memory pages and the active virtual machine, the source server is notified to complete the virtual machine migration, and the source server confirms and releases the resources occupied by the active virtual machine. At the same time, the destination server activates the migrated active virtual machine, and connects the local device, such as the I/O port, to notify the related network element that the active virtual machine resumes normal operation; the active virtual machine on the destination server, that is, the migrated active virtual machine receives the virtual machine. The data packet forwarded by the seamlessly migrated manager continues to process the corresponding service. In the subsequent process, the active VM receives subsequent data packets sent by the relevant NE.
其中, 所述迁移后的活动虚拟机接收虚拟机无缝迁移的管理器转发的 数据报文的转发通道为: 虚拟机无缝迁移的管理器将数据报文发往活动虚 拟机所采用的机制 , 对于网内虚拟机迁移的情况, 由于活动虚拟机的 IP地 址和 MAC地址均保持不变,虚拟机无缝迁移的管理器可以直接转发原始数 据报文(针对数据报文发送、 接收或转发的相关网元到虚拟机无缝迁移的 管理器采用源路由技术的情况),或者可以从 IP封包中提取原始报文后转发 (针对数据报文发送、 接收或转发的相关网元到虚拟机无缝迁移的管理器 采用 IP隧道技术的情况),或其它数据报文转发技术。对于跨网段虚拟机迁 移的情况, 活动虚拟机的 IP地址和 /或 MAC地址发生变化, 虚拟机无缝迁 移的管理器或者采用源路由技术, 或者通过 IP隧道技术, 或者采用其它数 据报文转发技术, 将原始数据报文发往活动虚拟机的新地址。 其中, 虚拟机无缝迁移的管理器将緩存的数据报文转发到重新激活的 活动虚拟机上的策略, 包括緩存机制、 转发机制、 以及所采用的数据报文 转发技术等。 如虚拟机无缝迁移的管理器将数据报文緩存一定的时间后, 直接向迁移后的活动虚拟机转发数据报文; 或者虚拟机无缝迁移的管理器 完成处理后立即向迁移后的活动虚拟机转发数据报文, 通过增加重发次数 或延长重发定时器的方式保证报文传输的可靠性; 或者虚拟机无缝迁移的 管理器规定, 在收到迁移后的活动虚拟机被重新激活的通知后, 再将数据 才艮文转发到该活动虚拟机。 The forwarding channel of the data packet forwarded by the manager that receives the virtual machine seamlessly migrated by the migrated active virtual machine is: a mechanism used by the virtual machine seamless migration manager to send data packets to the active virtual machine. For the virtual machine migration in the network, because the IP address and MAC address of the active VM remain unchanged, the seamless migration manager of the VM can directly forward the original data packet (for sending, receiving, or forwarding data packets). The related network element to the virtual machine seamless migration manager adopts the source routing technology), or may forward the original packet after the IP packet is forwarded (for the network element to send, receive or forward the related network element to the virtual machine) The seamless migration manager uses IP tunneling technology, or other data packet forwarding technologies. For the migration of virtual machines across network segments, the IP address and/or MAC address of the active VM changes. The manager that seamlessly migrates VMs uses source routing technology, or uses IP tunneling technology, or uses other data packets. Forwarding technology, sending raw data messages to the new address of the active virtual machine. The policy of the seamless migration of the virtual machine forwards the cached data packet to the reactivated active virtual machine, including a caching mechanism, a forwarding mechanism, and a data packet forwarding technology. If the manager that seamlessly migrates the virtual machine caches the data packet for a certain period of time, it directly forwards the data packet to the migrated active virtual machine; or the manager that seamlessly migrates the virtual machine completes the processing and immediately moves to the migrated activity. The virtual machine forwards the data packet and ensures the reliability of the packet transmission by increasing the number of retransmissions or extending the retransmission timer. Or the manager of the seamless migration of the virtual machine specifies that the active virtual machine after the migration is received is re-established. After the activation notification, the data is forwarded to the active virtual machine.
以下以具体实例分别详细介绍网内迁移和跨网段迁移时, 活动虚拟机 无缝迁移的处理流程。 The following takes a detailed example to describe the process of seamless migration of active VMs during intra-network migration and cross-network segment migration.
图 4a是本实施例中网内迁移时, 活动虚拟机(图 4a中以虚拟机 VM1 表示)无缝迁移的处理流程图。 FIG. 4a is a flowchart of a process for seamless migration of an active virtual machine (indicated by virtual machine VM1 in FIG. 4a) during intra-network migration in this embodiment.
对于网内虚拟机迁移, 虚拟机迁移前后的 IP地址和 MAC地址一般不 发生改变, 虚拟机系统的外部磁盘文件也不需要迁移, 迁移过程中虚拟机 的挂起时间一般在百毫秒以内。 虚拟机无缝迁移的管理器需要在虚拟机挂 起期间接收、 緩存、 转发发往迁移后的虚拟机的数据报文。 网内迁移时, 虚拟机挂起期间的数据报文处理流程具体描述如下: For the virtual machine migration in the network, the IP address and MAC address of the VM are not changed. The external disk file of the VM system does not need to be migrated. The VM hang time is usually within 100 milliseconds during the migration. The manager of the virtual machine seamless migration needs to receive, cache, and forward data packets sent to the migrated virtual machine during the virtual machine suspension. During the intranet migration, the data packet processing process during the virtual machine suspension period is described as follows:
步驟 S201: 虚拟机 VM1预迁移, 并完成大部分内存页的拷贝。 Step S201: The virtual machine VM1 is pre-migrated, and completes copying of most memory pages.
步驟 S202: 源服务器 1通知虚拟机无缝迁移的管理器虚拟机 VM1即 将挂起, 并告知虚拟机 VM 1的地址信息。 Step S202: The source server 1 notifies the virtual machine that the seamless migration of the virtual machine VM1 is suspended, and informs the address information of the VM 1 of the virtual machine.
其中, 所述地址信息包括虚拟机 VM1的 IP地址和 MAC地址。 The address information includes an IP address and a MAC address of the virtual machine VM1.
步驟 S203: 源服务器 1通知相关网元虚拟机 VM1即将挂起。 Step S203: The source server 1 notifies the related network element that the virtual machine VM1 is about to hang.
步驟 S204: 源服务器 1上的虚拟机 VM1挂起, 向目的服务器 2同步 最后的未迁移的内存页以及所有的虚拟机状态数据。 Step S204: The virtual machine VM1 on the source server 1 is suspended, and the last unmigrated memory page and all the virtual machine state data are synchronized to the destination server 2.
其中,所述所有的虚拟机状态数据包括 CPU状态及不连续的内存页等; 步驟 S205: 虚拟机 VM1挂起期间, 相关网元发现发往虚拟机 VM1的 数据报文不可达, 或虚拟机 VM1为挂起状态。 The virtual machine state data includes a CPU state and a discontinuous memory page. Step S205: During the suspension of the virtual machine VM1, the related network element finds that the data packet sent to the virtual machine VM1 is unreachable, or the virtual machine VM1 is in the suspended state.
比如: 一个群组内的虚拟机通过固定网关设备与外部网络进行数据交 互, 该固定网关设备可以通过上述机制感知虚拟机 VM1挂起; 又如, 源服 务器的虚拟机管理器收到发往虚拟机 VM1的数据报文,即可触发步驟 S206 的数据报文转发机制。 For example: a virtual machine in a group interacts with an external network through a fixed gateway device, and the fixed gateway device can perceive the virtual machine VM1 to hang through the above mechanism; for example, the virtual machine manager of the source server receives the virtual server The data packet of the machine VM1 triggers the data packet forwarding mechanism of step S206.
步驟 S206: 相关网元转发目的地为虚拟机 VM1 的数据报文到虚拟机 无缝迁移的管理器。 Step S206: The related network element forwards the data packet of the virtual machine VM1 to the manager of the seamless migration of the virtual machine.
其中, 所述转发数据报文的方式可以有多种, 如源路由技术, 松散源 记录路由 (LSRR , Loose Source and Record Route, ), 或 IP隧道技术(如 IP封包)发往目的虚拟机, 或其他数据报文转发技术。 The manner in which the data packet is forwarded may be multiple, such as a source routing technology, a loose source and record route (LSRR), or an IP tunneling technology (such as an IP packet) sent to the destination virtual machine. Or other data packet forwarding technology.
步驟 S207: 虚拟机无缝迁移的管理器接收并緩存目的地址为虚拟机 VM1的数据报文。 Step S207: The manager that seamlessly migrates the virtual machine receives and caches the data packet whose destination address is the virtual machine VM1.
步驟 S208: 源服务器 1的虚拟机 VM1迁移完成, 目的服务器 2上的 虚拟机 VM1被激活。 Step S208: The virtual machine VM1 migration of the source server 1 is completed, and the virtual machine VM1 on the destination server 2 is activated.
步驟 S209: 目的服务器 2通知虚拟机无缝迁移的管理器虚拟机 VM1 迁移完成, 已经激活。 Step S209: The destination server 2 notifies the virtual machine that the seamless migration of the virtual machine VM1 migration is completed and has been activated.
步驟 S210: 目的服务器 2通知相关网元虚拟机 VM1迁移完成, 已经 激活。 Step S210: The destination server 2 notifies the related network element that the virtual machine VM1 migration is completed and has been activated.
步驟 S211 :虚拟机无缝迁移的管理器收到虚拟 VM1激活通知,发送原 始数据报文到目的服务器 2上的虚拟机 VM1。 Step S211: The virtual machine seamless migration manager receives the virtual VM1 activation notification, and sends the original data packet to the virtual machine VM1 on the destination server 2.
步驟 S212: 目的服务器 2上的虚拟机 VM1根据数据报文类型, 向相 关网元返回响应消息。 Step S212: The virtual machine VM1 on the destination server 2 returns a response message to the relevant network element according to the data packet type.
步驟 S213: 相关网元将后续数据报文直接发送给目的服务器 2上的虚 拟机 VM1。 图 4b是本实施例中跨网段迁移时,活动虚拟机(图 4b中以虚拟机 VM1 表示)无缝迁移的处理流程图。 Step S213: The related network element directly sends the subsequent data packet to the virtual machine VM1 on the destination server 2. FIG. 4b is a process flow diagram of seamless migration of the active virtual machine (represented by the virtual machine VM1 in FIG. 4b) when the cross-network segment is migrated in this embodiment.
对于跨网段虚拟机迁移, 虚拟机迁移前后的 IP地址和 /或 MAC地址会 发生改变, 虚拟机系统的外部磁盘文件也需要迁移到另一个网段, 迁移过 程中虚拟机的挂起时间相对较长。 虚拟机无缝迁移的管理器需要在被迁移 虚拟机挂起期间接收、 緩存、 转发发往被迁移虚拟机的数据报文。 网内迁 移虚拟机挂起期间的数据报文处理流程具体描述如下 For cross-segment VM migration, the IP address and/or MAC address of the VM before and after VM migration will change. The external disk file of the VM system needs to be migrated to another network segment. The VM hang time is relatively relative during the migration process. Longer. The manager for seamless migration of virtual machines needs to receive, cache, and forward data packets destined for the migrated virtual machine during the suspension of the migrated virtual machine. The data packet processing process during the suspension of the virtual machine in the network is described as follows:
步驟 S301: 虚拟机 VM1预迁移, 并完成外部磁盘镜像文件以及大部 分内存页的拷贝; Step S301: The virtual machine VM1 is pre-migrated, and completes the external disk image file and a copy of most of the memory pages;
步驟 S302: 源服务器 1通知虚拟机无缝迁移的管理器虚拟机 VM1即 将挂起, 并告知虚拟机 VM1迁移前后的地址信息, 包括虚拟机 VM1迁移 前的 IP地址和 MAC地址, 以及虚拟机 VM1迁移后的 IP地址和 MAC地 址; Step S302: The source server 1 notifies the virtual machine VM1 that the seamless migration of the virtual machine is about to hang, and informs the virtual machine VM1 of the address information before and after the migration, including the IP address and MAC address before the migration of the virtual machine VM1, and the virtual machine VM1. The migrated IP address and MAC address;
步驟 S303: 同步驟 S203; Step S303: the same step S203;
步驟 S304: 源服务器 1上的虚拟机 VM1挂起, 向目的服务器 2同步 最后的未迁移的内存页以及所有的虚拟机状态数据, 包括 CPU状态及不连 续的内存页等, 以及对外部磁盘镜像文件的写操作; Step S304: The virtual machine VM1 on the source server 1 hangs, and synchronizes the last unmigrated memory page and all the virtual machine state data to the destination server 2, including the CPU state and the discontinuous memory page, and the external disk mirroring. File write operation;
步驟 S305~310, 同步驟 S205~S210; Steps S305~310, the same steps S205~S210;
步驟 S311 :虚拟机无缝迁移的管理器收到虚拟 VM1激活通知,建立与 目的服务器 2上虚拟机 VM1之间的 IP隧道, 根据记录的迁移虚拟机信息 表的内容将原始数据报文进行封包处理; Step S311: The virtual machine seamless migration manager receives the virtual VM1 activation notification, establishes an IP tunnel with the virtual machine VM1 on the destination server 2, and encapsulates the original data packet according to the content of the recorded migration virtual machine information table. deal with;
步驟 S312: 虚拟机无缝迁移的管理器将緩存的数据报文封包后发往目 的服务器 2; Step S312: The virtual machine seamless migration manager encapsulates the buffered data packet and sends it to the destination server 2;
步驟 S313: 目的服务器 2中的虚拟机管理器将 IP报文解封后传递给虚 拟机 VM1 ; 步驟 S314: 目的服务器 2中的虚拟机 VM1运行的业务根据步驟 S313 的数据报文类型, 向相关网元返回响应消息; Step S313: The virtual machine manager in the destination server 2 unpacks the IP packet and delivers it to the virtual machine VM1. Step S314: The service running by the virtual machine VM1 in the destination server 2 returns a response message to the relevant network element according to the data packet type in step S313.
步驟 S315: 相关网元后续数据报文直接发送给目的服务器 2上的虚拟 机 VM1; Step S315: The subsequent data packet of the relevant network element is directly sent to the virtual machine VM1 on the destination server 2.
其中, 步驟 S311-S312 的数据报文转发流程还可以采用源路由技术实 现, 虚拟机无缝迁移的管理器将目的服务器 2 插入到緩存的发往虚拟机 VM1的原始数据报文的路由路径中, 目的服务器 上的虚拟机管理器收到 报文后识别该报文应发往本地的虚拟机 VM 1 , 并传递给虚拟机 VM 1。 The data packet forwarding process in steps S311-S312 can also be implemented by using a source routing technology. The virtual machine seamless migration manager inserts the destination server 2 into the cached routing path of the original data packet sent to the virtual machine VM1. After receiving the packet, the virtual machine manager on the destination server identifies that the packet should be sent to the local virtual machine VM 1 and passed to the virtual machine VM 1.
本实施例通过在网络上部署虚拟机无缝迁移的管理器, 在源服务器的 活动虚拟机挂起前告知虚拟机无缝迁移的管理器该需要迁移的活动虚拟机 的地址信息, 虚拟机无缝迁移的管理器接收、 緩存、 转发活动虚拟机挂起 期间的该活动虚拟机运行业务的数据报文, 保证活动虚拟机运行业务的连 续性, 从而解决了由于活动虚拟机迁移引起的业务数据报文丟失问题。 In this embodiment, by deploying a seamless migration manager of the virtual machine on the network, the manager of the seamless migration of the virtual machine is notified of the address information of the active virtual machine that needs to be migrated before the active virtual machine of the source server is suspended, and the virtual machine has no virtual machine. The migration manager receives, caches, and forwards the data packets of the active virtual machine running the service during the suspension of the active virtual machine to ensure the continuity of the running of the active virtual machine, thereby solving the business data caused by the active virtual machine migration. Message loss problem.
如图 5 所示, 本发明一实施例提出一种虚拟机无缝迁移的管理器, 包 括: 地址获取模块 401、 接收緩存模块 402以及报文转发模块 403; 其中, 地址获取模块 401 ,用于获取位于源服务器上的活动虚拟机的相关迁移 信息; As shown in FIG. 5, an embodiment of the present invention provides a manager for seamless migration of a virtual machine, including: an address obtaining module 401, a receiving buffer module 402, and a packet forwarding module 403. The address obtaining module 401 is configured to: Obtain related migration information of the active virtual machine located on the source server;
接收緩存模块 402, 用于在活动虚拟机被挂起期间,接收相关网元发送 的数据报文并緩存; The receiving buffer module 402 is configured to receive a data packet sent by the related network element and cache the active virtual machine during the suspension period;
报文转发模块 403 ,用于当活动虚拟机从源服务器迁移到目的服务器且 重新激活时, 按照地址获取模块 401中保存的活动虚拟机的相关迁移信息, 将接收緩存模块 402緩存的数据报文转发给活动虚拟机。 The message forwarding module 403 is configured to receive the data packet buffered by the buffer module 402 according to the related migration information of the active virtual machine saved in the address obtaining module 401 when the active virtual machine is migrated from the source server to the destination server and is reactivated. Forward to the active virtual machine.
进一步的, 所述报文转发模块 403,还用于当活动虚拟机从源服务器迁 移到目的服务器且重新激活时, 接收目的服务器发送的活动虚拟机激活通 知。 在本实施例中, 在位于源服务器的活动虚拟机挂起前, 需要告知地址 获取模块 401 准备迁移的活动虚拟机的相关迁移信息, 即活动虚拟机在目 的服务器的地址信息。 Further, the message forwarding module 403 is further configured to: when the active virtual machine is migrated from the source server to the destination server and reactivated, receive the active virtual machine activation notification sent by the destination server. In this embodiment, before the active virtual machine located at the source server is suspended, the address obtaining module 401 needs to be notified of the related migration information of the migrated active virtual machine, that is, the address information of the active virtual machine at the destination server.
所述地址获取模块 401 可以由虚拟集群管理服务器、 源服务器的虚拟 机管理器或者目的服务器的虚拟机管理器通知其需要迁移的活动虚拟机的 相关迁移信息。 The address obtaining module 401 may notify the virtual cluster manager of the virtual cluster management server, the virtual machine manager of the source server, or the virtual machine manager of the destination server of the relevant migration information of the active virtual machine that needs to be migrated.
所述地址获取模块 401 可以将获取的相关迁移信息保存在一张迁移虚 拟机信息表中, 以便后续依据该迁移虚拟机信息表中的相关迁移信息进行 数据报文转发等。 The address obtaining module 401 may save the obtained related migration information in a migration virtual machine information table, so as to perform data packet forwarding and the like according to the related migration information in the migration virtual machine information table.
对于网内的虚拟机迁移, 即活动虚拟机在迁移前后不改变 IP地址和 / 或 MAC地址的情况下,活动虚拟机的相关迁移信息主要为活动虚拟机的地 址和状态信息, 如活动虚拟机的 IP地址、 MAC地址、 迁移状态 (挂起或 重新激活)。对于跨网段的虚拟机迁移, 即活动虚拟机迁移前后改变 IP地址 和 /或 MAC地址的情况, 活动虚拟机的相关迁移信息为活动虚拟机迁移前 后的地址和状态信息, 如活动虚拟机迁移前的 IP地址和 MAC地址、 活动 虚拟机迁移后的 IP地址和 MAC地址、 迁移状态 (挂起或重新激活)。 For virtual machine migration in the network, that is, if the active virtual machine does not change the IP address and/or MAC address before and after the migration, the related migration information of the active virtual machine is mainly the address and status information of the active virtual machine, such as the active virtual machine. IP address, MAC address, migration status (suspended or reactivated). For virtual machine migration across network segments, that is, changing the IP address and/or MAC address before and after the active virtual machine migration, the related migration information of the active virtual machine is the address and status information before and after the active virtual machine migration, such as active virtual machine migration. The previous IP address and MAC address, the IP address and MAC address of the active virtual machine after migration, and the migration status (suspended or reactivated).
活动虚拟机是否被挂起通过源服务器来完成, 并由源服务器通知虚拟 机无缝迁移的管理器的地址获取模块 401。在活动虚拟机被挂起前, 需要在 目的服务器上预留活动虚拟机运行所需的资源, 包括内存、 CPU, 网络等, 若资源预留失败, 则停止虚拟机迁移并反馈结果。 Whether the active virtual machine is suspended by the source server, and the source server notifies the address acquisition module 401 of the manager of the seamless migration of the virtual machine. Before the active VM is suspended, you need to reserve the resources required for the active VM to run on the destination server, including memory, CPU, network, etc. If the resource reservation fails, stop the VM migration and feed back the result.
所述地址获取模块 401 , 具体用于在活动虚拟机被挂起前,循环拷贝截 止前, 接收源服务器发来的活动虚拟机在源服务器与目的服务器之间迁移 并即将挂起的通知, 将相关信息记入迁移虚拟机信息表, 并通知接收緩存 模块 402准备接收目的地址为活动虚拟机的数据包; 相应的, 所述接收緩 存模块 402,还用于接收地址获取模块 401发来的准备接收目的地址为活动 虚拟机的数据包的通知。 The address obtaining module 401 is specifically configured to: before the active virtual machine is suspended, before the end of the cyclic copy, the notification that the active virtual machine sent by the source server migrates between the source server and the destination server and is about to hang, The related information is recorded in the migration virtual machine information table, and the receiving buffer module 402 is configured to receive the data packet whose destination address is the active virtual machine. Correspondingly, the receiving buffer module 402 is further configured to receive the preparation sent by the address obtaining module 401. Receiving destination address is active Notification of the packet of the virtual machine.
所述接收緩存模块 402, 具体用于接收相关网元发送的数据报文并緩 存。 The receiving buffer module 402 is specifically configured to receive a data packet sent by the related network element and cache the data packet.
所述报文转发模块 403 ,具体用于当目的服务器接收完所有内存页及活 动虚拟机的状态数据后, 接收目的服务器发来的迁移成功的通知。 The packet forwarding module 403 is configured to receive, after receiving the status data of all the memory pages and the active virtual machine, the notification that the destination server successfully migrates.
其中, 所述报文转发模块 403 与活动虚拟机之间的报文转发通道, 为 将数据报文发往活动虚拟机所采用的机制。 对于网内虚拟机迁移的情况, 由于活动虚拟机的 IP地址和 MAC地址均保持不变, 可以直接转发原始数 据报文(针对相关网元发送或转发的数据报文采用源路由技术的情况), 或 者可以从 IP封包中提取原始报文后转发(针对相关网元发送或转发的数据 报文采用 IP隧道技术的情况),或其它数据报文转发技术。对于跨网段虚拟 机迁移的情况, 活动虚拟机的 IP地址和 /或 MAC地址发生变化, 或者采用 源路由技术, 或者通过 IP隧道技术, 或者采用其它数据报文转发技术, 将 原始数据报文发往活动虚拟机的新地址。 The packet forwarding channel between the packet forwarding module 403 and the active virtual machine is a mechanism used for sending data packets to the active virtual machine. For the virtual machine migration in the network, the original virtual data packet can be forwarded directly because the IP address and MAC address of the active virtual machine are unchanged. The source routing technology is used for the data packets sent or forwarded by the related NE. Alternatively, the original packet may be extracted from the IP packet and then forwarded (for the case where the data packet sent or forwarded by the relevant network element adopts the IP tunnel technology) or other data packet forwarding technology. For the case of virtual machine migration across network segments, the IP address and/or MAC address of the active VM is changed, or the source routing technology is used, or the IP tunneling technology is used, or other data packet forwarding technologies are used to transmit the original data packet. The new address to the active virtual machine.
其中, 所述报文转发模块 403 的将緩存的数据报文转发到重新激活的 活动虚拟机上的策略, 包括緩存机制、 转发机制、 以及所采用的数据报文 转发技术等。 如接收緩存模块 402将数据报文緩存一定的时间后, 直接通 过所述报文转发模块 403 向迁移后的活动虚拟机转发数据报文; 或者接收 緩存模块 402完成处理后, 立即通过所述报文转发模块 403向迁移后的活 动虚拟机转发数据报文, 通过增加重发次数或延长重发定时器的方式保证 报文传输的可靠性; 或者接收緩存模块 402规定, 在收到迁移后的活动虚 拟机被重新激活的通知后, 再将数据报文转发到该活动虚拟机。 The policy of the packet forwarding module 403 for forwarding the buffered data packet to the reactivated active virtual machine includes a caching mechanism, a forwarding mechanism, and a data packet forwarding technology. After the receiving buffer module 402 caches the data packet for a certain period of time, the packet forwarding module 403 directly forwards the data packet to the migrated active virtual machine; or after receiving the processing, the receiving buffer module 402 immediately passes the report. The forwarding module 403 forwards the data packet to the migrated active virtual machine, and ensures the reliability of the packet transmission by increasing the number of retransmissions or extending the retransmission timer; or receiving the buffer module 402, after receiving the migration After the active virtual machine is reactivated, the data message is forwarded to the active virtual machine.
如图 6所示, 本发明还提出一种虚拟机无缝迁移的系统, 包括: 源服 务器 501、 目的服务器 502及虚拟机无缝迁移的管理器 503; 其中: As shown in FIG. 6, the present invention further provides a system for seamless migration of a virtual machine, including: a source server 501, a destination server 502, and a manager for seamless migration of virtual machines 503;
源服务器 501 , 用于在活动虚拟机发生迁移前, 完成拷贝活动虚拟机运 行的预定内存页至目的服务器 502后, 将活动虚拟机挂起, 并将剩余未迁 移的内存页及活动虚拟机的状态数据同步到目的服务器 502上; The source server 501 is configured to complete the copy active virtual machine before the active virtual machine is migrated. After the predetermined memory page of the row reaches the destination server 502, the active virtual machine is suspended, and the remaining unmigrated memory pages and the state data of the active virtual machine are synchronized to the destination server 502;
虚拟机无缝迁移的管理器 503 ,用于获取位于源服务器 501上的活动虚 拟机的相关迁移信息; 在活动虚拟机被挂起期间, 接收相关网元发送的数 据报文并緩存; 当活动虚拟机从源服务器 501迁移到目的服务器 502且重 新激活时, 按照相关迁移信息将所述数据报文转发给活动虚拟机; a virtual machine seamless migration manager 503, configured to acquire related migration information of the active virtual machine located on the source server 501; receive the data packet sent by the relevant network element and cache the active virtual machine during the suspension; When the virtual machine is migrated from the source server 501 to the destination server 502 and reactivated, the data packet is forwarded to the active virtual machine according to the relevant migration information;
目的服务器 502, 用于当活动虚拟机完成迁移时, 激活活动虚拟机。 进一步的, 所述源服务器 501 ,还用于将活动虚拟机运行的内存页拷贝 到目的服务器 502上, 后续每次循环拷贝上一轮内存拷贝期间修改过的内 存页; 当需要拷贝的内存页数或内存脏页率满足预定阈值时, 停止循环拷 贝; 相应的, 所述目的服务器 502, 还用于接收源服务器 501发来的活动虚 拟机运行的内存页并保存。 The destination server 502 is configured to activate the active virtual machine when the active virtual machine completes the migration. Further, the source server 501 is further configured to copy the memory page run by the active virtual machine to the destination server 502, and then copy the modified memory page during the previous round of memory copy each time; when the memory page needs to be copied When the number or the memory dirty page rate meets the predetermined threshold, the cyclic copy is stopped; correspondingly, the destination server 502 is further configured to receive and save the memory page of the active virtual machine sent by the source server 501.
所述目的服务器 502,还用于在激活活动虚拟机时, 向源服务器 501及 虚拟机无缝迁移的管理器 503发送活动虚拟机激活通知; 相应的, 所述源 服务器 501还用于收到活动虚拟机激活通知后, 释放活动虚拟机占用的资 源。 The destination server 502 is further configured to send an active virtual machine activation notification to the source server 501 and the virtual machine seamlessly migrated manager 503 when the active virtual machine is activated; correspondingly, the source server 501 is further configured to receive After the active virtual machine activates the notification, the resources occupied by the active virtual machine are released.
本实施例中源服务器 501、 目的服务器 502及虚拟机无缝迁移的管理器 503 结合相关网元实现虚拟机无缝迁移的基本原理请参照上述各实施例所 述的内容, 在此不作详述。 In this embodiment, the source server 501, the destination server 502, and the seamless migration manager 503 of the virtual machine are combined with the related network elements to implement the seamless migration of the virtual machine. For details, refer to the content described in the foregoing embodiments, and details are not described herein. .
以上所述仅为本发明的优选实施例, 并非因此限制本发明的专利范 围, 凡是利用本发明说明书及附图内容所作的等效结构或流程变换, 或直 接或间接运用在其它相关的技术领域, 均同理包括在本发明的专利保护范 围内。 The above is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention, and equivalent structural or process changes made by the present specification and drawings may be directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of the present invention.
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110119642XA CN102185774A (en) | 2011-05-10 | 2011-05-10 | Method, monitor and system for seamless migration of virtual machine |
| CN201110119642.X | 2011-05-10 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2012152153A1 true WO2012152153A1 (en) | 2012-11-15 |
Family
ID=44571845
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2012/073352 Ceased WO2012152153A1 (en) | 2011-05-10 | 2012-03-30 | Method, monitor and system for seamless migration of virtual machine |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN102185774A (en) |
| WO (1) | WO2012152153A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107643937A (en) * | 2016-07-22 | 2018-01-30 | 北京金山云网络技术有限公司 | A kind of virtual machine monitor upgrade method and device |
| US10146594B2 (en) | 2014-12-31 | 2018-12-04 | International Business Machines Corporation | Facilitation of live virtual machine migration |
Families Citing this family (54)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102185774A (en) * | 2011-05-10 | 2011-09-14 | 中兴通讯股份有限公司 | Method, monitor and system for seamless migration of virtual machine |
| CN102333037A (en) * | 2011-10-20 | 2012-01-25 | 中兴通讯股份有限公司 | Method and device for migrating virtual machine |
| CN102413183B (en) * | 2011-11-22 | 2014-07-16 | 中国联合网络通信集团有限公司 | Cloud intelligence switch and processing method and system thereof |
| CN103164167B (en) * | 2011-12-15 | 2016-03-23 | 深圳市腾讯计算机系统有限公司 | A kind of data migration method and device |
| CN103534994B (en) | 2011-12-26 | 2017-08-25 | 华为技术有限公司 | The method, apparatus and system of communication are realized after a kind of virtual machine (vm) migration |
| US8990371B2 (en) * | 2012-01-31 | 2015-03-24 | International Business Machines Corporation | Interconnecting data centers for migration of virtual machines |
| CN102594881B (en) * | 2012-02-08 | 2017-10-17 | 中兴通讯股份有限公司 | A kind of virtual machine load-balancing method, management module and virtual machine cluster system |
| CN103365704B (en) * | 2012-03-26 | 2016-12-14 | 中国移动通信集团公司 | Internal memory pre-copy method in virtual machine (vm) migration and perform device and the system of the method |
| CN103379185B (en) | 2012-04-26 | 2016-08-03 | 华为技术有限公司 | A kind of method, apparatus and system of network address translation |
| WO2014000292A1 (en) * | 2012-06-30 | 2014-01-03 | 华为技术有限公司 | Migration method, serving control gateway and system for virtual machine across data centres |
| CN102801806A (en) * | 2012-08-10 | 2012-11-28 | 薛海强 | Cloud computing system and cloud computing resource management method |
| CN103631633B (en) * | 2012-08-20 | 2017-04-12 | 中国电信股份有限公司 | Virtual machine total-system online migration method, device and system |
| CN102833171B (en) * | 2012-09-10 | 2015-05-13 | 杭州华三通信技术有限公司 | Data center-cross MAC (Media Access Control) migration processing method and device |
| CN102821000B (en) * | 2012-09-14 | 2015-12-09 | 乐视致新电子科技(天津)有限公司 | Improve the method for usability of PaaS platform |
| CN102917025B (en) * | 2012-09-21 | 2015-06-10 | 苏州盈联智能科技股份有限公司 | Method for business migration based on cloud computing platform |
| CN102932409B (en) * | 2012-09-21 | 2015-09-09 | 中国电信股份有限公司 | The method and system that a kind of virtual machine moves online |
| CN102970204B (en) * | 2012-10-24 | 2017-09-01 | 曙光信息产业(北京)有限公司 | A kind of distribution switch system and its implementation based on xen virtual platforms |
| CN102917072B (en) * | 2012-10-31 | 2016-07-13 | 北京奇虎科技有限公司 | Device, system and method for data migration between data server clusters |
| CN103825915B (en) * | 2012-11-16 | 2017-08-22 | 中国电信股份有限公司 | Service mobility management method and system under virtualized environment |
| US8910162B2 (en) * | 2012-11-30 | 2014-12-09 | International Business Machines Corporation | User datagram protocol (UDP) packet migration in a virtual machine (VM) migration |
| CN103051479B (en) * | 2012-12-24 | 2016-01-20 | 北京启明星辰信息技术股份有限公司 | The emigration processing method of virtual machine network control strategy and system |
| CN103905303B (en) * | 2012-12-28 | 2018-02-23 | 中国移动通信集团公司 | Data processing method, apparatus and system after a kind of virtual machine VM across-the-wire migrations |
| CN103916320B (en) * | 2012-12-28 | 2017-09-15 | 中国移动通信集团公司 | Message processing method and device after a kind of VM equipment across-the-wire migration |
| CN106452857B (en) * | 2013-02-18 | 2021-01-05 | 华为技术有限公司 | Method for generating configuration information and network control unit |
| US9282033B2 (en) * | 2013-08-06 | 2016-03-08 | Cisco Technology, Inc. | Intelligent handling of virtual machine mobility in large data center environments |
| US9253052B2 (en) * | 2013-08-28 | 2016-02-02 | Institute For Information Industry | Integration network device and service integration method thereof |
| CN103491070B (en) * | 2013-09-06 | 2016-09-21 | 广东工业大学 | A kind of vehicle method for secret protection in real-time migration of virtual machine |
| CN103532815B (en) * | 2013-10-09 | 2017-03-15 | 中国联合网络通信集团有限公司 | Message transmitting method and device based on virtual machine (vm) migration |
| CN104684068B (en) * | 2013-11-29 | 2018-06-26 | 中国移动通信集团公司 | The method and apparatus that a kind of data synchronize |
| CN109101318B (en) * | 2014-03-12 | 2022-04-05 | 华为技术有限公司 | Virtual machine migration control method and device |
| CN103955399B (en) * | 2014-04-30 | 2017-06-20 | 华为技术有限公司 | A kind of virtual machine migration method and device and physical host |
| CN104123171B (en) * | 2014-06-10 | 2017-05-10 | 浙江大学 | Virtual machine migrating method and system based on NUMA architecture |
| CN104158732B (en) * | 2014-08-22 | 2017-11-28 | 成都致云科技有限公司 | A kind of intelligent cloud service dynamic routing strategy |
| CN105490908A (en) * | 2014-09-16 | 2016-04-13 | 中兴通讯股份有限公司 | Method and device for processing occupied conditions of target resource |
| CN105528234A (en) * | 2014-10-24 | 2016-04-27 | 中兴通讯股份有限公司 | Virtual machine migration processing method and device |
| CA2901223C (en) | 2014-11-17 | 2017-10-17 | Jiongjiong Gu | Method for migrating service of data center, apparatus, and system |
| CN104780109B (en) * | 2015-04-27 | 2019-03-15 | 新华三技术有限公司 | Virtual machine migration method and device |
| CN106330650B (en) * | 2015-06-25 | 2019-12-03 | 中兴通讯股份有限公司 | Method and device for IP migration, and virtualized network system |
| CN106959950B (en) * | 2016-01-08 | 2021-02-26 | 北京京东尚科信息技术有限公司 | Method and device for migrating data between application clusters |
| CN105763440B (en) * | 2016-01-29 | 2019-04-09 | 新华三技术有限公司 | A kind of method and apparatus of message forwarding |
| CN107453888B (en) * | 2016-05-31 | 2020-11-20 | 深信服科技股份有限公司 | High-availability virtual machine cluster management method and device |
| CN106161439B (en) * | 2016-06-30 | 2019-11-26 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| CN107885758B (en) * | 2016-09-30 | 2021-11-19 | 华为技术有限公司 | Data migration method of virtual node and virtual node |
| CN106982244B (en) * | 2016-12-30 | 2020-10-23 | 中国银联股份有限公司 | Method and device for realizing packet mirroring of dynamic traffic in cloud network environment |
| CN107147516B (en) * | 2017-03-22 | 2020-04-28 | 华为技术有限公司 | Server, storage system and related method |
| CN107479944B (en) * | 2017-07-20 | 2021-11-30 | 上海交通大学 | Virtual machine memory self-adaptive thermal migration scheduling method and system in hybrid cloud mode |
| CN108287733A (en) * | 2017-12-19 | 2018-07-17 | 广东睿江云计算股份有限公司 | A kind of virtual machine load startup method |
| CN108874506B (en) | 2018-06-08 | 2020-07-24 | 北京百度网讯科技有限公司 | Live migration method and device of virtual machine direct connection equipment |
| CN110300260A (en) * | 2019-06-27 | 2019-10-01 | 深圳中兴网信科技有限公司 | Camera control method, device, terminal, server and storage medium |
| CN111338806B (en) * | 2020-05-20 | 2020-09-04 | 腾讯科技(深圳)有限公司 | Service control method and device |
| CN113852590B (en) * | 2020-06-28 | 2025-09-16 | 中兴通讯股份有限公司 | Method, device, equipment and storage medium for supporting TCP dynamic migration by high-capacity equipment |
| CN113656184B (en) * | 2021-08-31 | 2025-09-12 | 北京沃东天骏信息技术有限公司 | Data processing method and device |
| CN114760242B (en) * | 2022-03-30 | 2024-04-09 | 深信服科技股份有限公司 | Migration method and device of virtual router, electronic equipment and storage medium |
| CN120560772A (en) * | 2024-02-28 | 2025-08-29 | 华为技术有限公司 | Virtual machine migration method, device, uninstall card, equipment and system |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070169121A1 (en) * | 2004-05-11 | 2007-07-19 | International Business Machines Corporation | System, method and program to migrate a virtual machine |
| US20090089781A1 (en) * | 2007-09-30 | 2009-04-02 | Symantec Corporation | System for and Method of Migrating One or More Virtual Machines |
| US20090125904A1 (en) * | 2002-12-12 | 2009-05-14 | Michael Nelson | Virtual machine migration |
| CN101465812A (en) * | 2009-01-06 | 2009-06-24 | 北京航空航天大学 | Redirection method for virtual machine network connection when on-line migrating striding sub network |
| CN101605084A (en) * | 2009-06-29 | 2009-12-16 | 北京航空航天大学 | Method and system for processing virtual network packets based on virtual machine |
| CN101876883A (en) * | 2009-11-30 | 2010-11-03 | 英业达股份有限公司 | Method for Keeping Remote Operation of Virtual Machine Uninterrupted |
| CN102185774A (en) * | 2011-05-10 | 2011-09-14 | 中兴通讯股份有限公司 | Method, monitor and system for seamless migration of virtual machine |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5446040B2 (en) * | 2009-09-28 | 2014-03-19 | 日本電気株式会社 | Computer system and virtual machine migration method |
| CN101859263B (en) * | 2010-06-12 | 2012-07-25 | 中国人民解放军国防科学技术大学 | Quick communication method between virtual machines supporting online migration |
-
2011
- 2011-05-10 CN CN201110119642XA patent/CN102185774A/en active Pending
-
2012
- 2012-03-30 WO PCT/CN2012/073352 patent/WO2012152153A1/en not_active Ceased
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090125904A1 (en) * | 2002-12-12 | 2009-05-14 | Michael Nelson | Virtual machine migration |
| US20070169121A1 (en) * | 2004-05-11 | 2007-07-19 | International Business Machines Corporation | System, method and program to migrate a virtual machine |
| US20090089781A1 (en) * | 2007-09-30 | 2009-04-02 | Symantec Corporation | System for and Method of Migrating One or More Virtual Machines |
| CN101465812A (en) * | 2009-01-06 | 2009-06-24 | 北京航空航天大学 | Redirection method for virtual machine network connection when on-line migrating striding sub network |
| CN101605084A (en) * | 2009-06-29 | 2009-12-16 | 北京航空航天大学 | Method and system for processing virtual network packets based on virtual machine |
| CN101876883A (en) * | 2009-11-30 | 2010-11-03 | 英业达股份有限公司 | Method for Keeping Remote Operation of Virtual Machine Uninterrupted |
| CN102185774A (en) * | 2011-05-10 | 2011-09-14 | 中兴通讯股份有限公司 | Method, monitor and system for seamless migration of virtual machine |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10146594B2 (en) | 2014-12-31 | 2018-12-04 | International Business Machines Corporation | Facilitation of live virtual machine migration |
| US10915374B2 (en) | 2014-12-31 | 2021-02-09 | International Business Machines Corporation | Method of facilitating live migration of virtual machines |
| CN107643937A (en) * | 2016-07-22 | 2018-01-30 | 北京金山云网络技术有限公司 | A kind of virtual machine monitor upgrade method and device |
| CN107643937B (en) * | 2016-07-22 | 2020-07-03 | 北京金山云网络技术有限公司 | A kind of virtual machine monitor upgrade method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102185774A (en) | 2011-09-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2012152153A1 (en) | Method, monitor and system for seamless migration of virtual machine | |
| CN118102380B (en) | Mobility of cloud computing instances hosted within a communication service provider's network | |
| US11336721B2 (en) | Dynamic resource movement in heterogeneous computing environments including cloud edge locations | |
| US10965737B1 (en) | Cloud computing in communications service provider networks | |
| EP4049139B1 (en) | Latency-based placement of cloud compute instances within communications service provider networks | |
| Wood et al. | CloudNet: dynamic pooling of cloud resources by live WAN migration of virtual machines | |
| US8812566B2 (en) | Scalable storage for virtual machines | |
| US10628273B2 (en) | Node system, server apparatus, scaling control method, and program | |
| US20220121473A1 (en) | Method For Migrating Virtual Machine And Apparatus | |
| US9354905B2 (en) | Migration of port profile associated with a target virtual machine to be migrated in blade servers | |
| US8533713B2 (en) | Efficent migration of virtual functions to enable high availability and resource rebalance | |
| WO2013044828A1 (en) | Virtual cluster system, processing method and device thereof | |
| JP5804189B2 (en) | Information processing system, information processing method, program | |
| JP2008225546A (en) | Virtual device configuration system and method thereof | |
| CN105187512A (en) | Method and system for load balancing of virtual machine clusters | |
| JPWO2019100984A5 (en) | ||
| WO2016154801A1 (en) | Wireless access network device, configuration method and configuration apparatus | |
| Eswaran et al. | Tackling memory footprint expansion during live migration of virtual machines | |
| KR102012604B1 (en) | Scalable network connected storage apparatus and method for virtualization | |
| Liu et al. | Network state consistency of virtual machine in live migration | |
| CN107391236B (en) | A method and device for realizing cluster block storage | |
| Liao et al. | AdaptIDC: Adaptive inter-domain communication in virtualized environments | |
| CN120492082A (en) | Virtual machine scheduling method and device and computing equipment | |
| Zhang et al. | DLSM: Decoupled Live Storage Migration with Distributed Device Mapper Storage |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 12782804 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 12782804 Country of ref document: EP Kind code of ref document: A1 |