CN107479832A - A kind of storage off-line data moving method based on CA ports - Google Patents
A kind of storage off-line data moving method based on CA ports Download PDFInfo
- Publication number
- CN107479832A CN107479832A CN201710712399.XA CN201710712399A CN107479832A CN 107479832 A CN107479832 A CN 107479832A CN 201710712399 A CN201710712399 A CN 201710712399A CN 107479832 A CN107479832 A CN 107479832A
- Authority
- CN
- China
- Prior art keywords
- data
- storage
- destination device
- application server
- port
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/064—Management of blocks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
- G06F3/0619—Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0683—Plurality of storage devices
- G06F3/0689—Disk arrays, e.g. RAID, JBOD
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
技术领域technical field
本发明涉及数据迁移技术，尤其涉及一种基于CA端口的存储离线数据迁移方法。The invention relates to data migration technology, in particular to a storage off-line data migration method based on a CA port.
背景技术Background technique
全新的IT发展趋势正在对存储系统构成新的挑战，数据成为用户最大的无形资产，各存储厂商每年都会推出自己的高规格、高性能得磁盘阵列来满足客户对数据量/性能的要求，由此，对于客户来讲将原有磁盘阵列的数据迁移到最新的设备上尤为重要。在现有技术背景下，数据迁移方案中，用户及厂商一般会借助第三软件将原存储磁盘阵列中的数据读出后再写入到新存储设备中。在数据的多次读写之间，并不能完全保证数据的一致性，所以在数据迁移方案之前要先进行原磁盘阵列的数据备份，还要为第三方软件支付相应的费用，耗费大量的物力财力，同时并不能保证数据迁移一次性可用。The new IT development trend is posing new challenges to storage systems. Data has become the largest intangible asset of users. Every year, storage manufacturers launch their own high-specification, high-performance disk arrays to meet customers' data volume/performance requirements. Therefore, it is particularly important for customers to migrate the data of the original disk array to the latest equipment. Under the background of the prior art, in the data migration solution, the user and the manufacturer usually read the data in the original storage disk array with the help of third software and then write it into the new storage device. Data consistency cannot be completely guaranteed between multiple reads and writes of data. Therefore, before the data migration plan, the data backup of the original disk array must be performed first, and corresponding fees must be paid for third-party software, which consumes a lot of material resources. Financial resources, and at the same time, there is no guarantee that data migration will be available at one time.
现有方式的缺点在于存储端只能被定于为目标端，只能被动的接收来自应用服务器的读写要求，而不能主动发起数据请求。The disadvantage of the existing method is that the storage end can only be set as the target end, and can only passively receive read and write requests from the application server, but cannot actively initiate data requests.
发明内容Contents of the invention
为了解决以上技术问题，本发明提出了一种基于CA端口的存储离线数据迁移方法。In order to solve the above technical problems, the present invention proposes a storage offline data migration method based on a CA port.
本发明的技术方案是：Technical scheme of the present invention is:
一种基于CA端口的存储离线数据迁移方法，在两台存储磁盘阵列之间通过光纤/网络连接，从而以块数据的形式将源存储的卷数据拷贝到目标存储端，拷贝期间会暂停应用服务器对存储的访问，当数据拷贝完成后，应用服务器即可随时访问目标存储端。A storage offline data migration method based on a CA port. Two storage disk arrays are connected through an optical fiber/network, so that the source storage volume data is copied to the target storage terminal in the form of block data, and the application server will be suspended during the copy process. For storage access, after the data copy is completed, the application server can access the target storage terminal at any time.
具体包括如下几个方面：Specifically include the following aspects:
1、CA端口有 “CA模式”和“启动器”两种模式，当选择“CA模式”时，存储端只能被动的接收来自应用服务器的数据写/读请求，此时，CA端口只能作为目标端1. The CA port has two modes: "CA mode" and "Initiator". When "CA mode" is selected, the storage terminal can only passively receive data write/read requests from the application server. At this time, the CA port can only as target
2、当客户需要进行数据迁移时，将两台磁盘阵列通过直连或交换机的方式连接到一起，并将目的地设备的CA端口设置为“启动器”模式，便可将目的地设备当做一台应用服务器，目的地设备便会向来源设备发起数据读写请求，将来源设备的卷数据以块的形式拷贝到目的地设备上，从而实现数据迁移；但在数据迁移的过程中暂停应用服务器的访问；2. When the customer needs to perform data migration, connect the two disk arrays together through a direct connection or a switch, and set the CA port of the destination device to "initiator" mode, then the destination device can be used as a If there is no application server, the destination device will initiate a data read and write request to the source device, and copy the volume data of the source device to the destination device in the form of blocks, thereby realizing data migration; however, the application server is suspended during the data migration process Access;
3、来源设备和目的地设备之间通过数条路径进行数据传输，同时在存储软件系统的GUI界面上随时查看数据迁移的过程，随时暂停和开启数据拷贝过程；3. Data transmission is carried out between the source device and the destination device through several paths, and at the same time, the process of data migration can be checked at any time on the GUI interface of the storage software system, and the process of data copying can be paused and started at any time;
4、当完成数据拷贝之后，目的地设备会与来源设备进行数据对比；两种对比方式：快速对比和全面对比；4. After the data copy is completed, the destination device will compare the data with the source device; two comparison methods: quick comparison and comprehensive comparison;
快速对比仅对比卷顶部的数据块；Quick compare only compares the data blocks at the top of the volume;
全面对比是指对卷中的数据块进行全面的对比。A comprehensive comparison refers to a comprehensive comparison of the data blocks in the volume.
5、在上述动作完成后，数据迁移彻底完成，此时即可将目的地设备CA端口切回至“CA模式”，应用服务器即可访问目的地设备。5. After the above actions are completed, the data migration is completely completed. At this time, the CA port of the destination device can be switched back to "CA mode", and the application server can access the destination device.
本发明的有益效果是The beneficial effect of the present invention is
节约成本，该方法不需再借助第三方软件，只需两台存储设备即可完成数据迁移；Cost saving, this method does not need third-party software, and only two storage devices are needed to complete data migration;
数据完整性有保障，在该迁移方法中，直接有目的地设备向来源设备发起拷贝请求，卷数据以块形式直接拷贝到目的地设备上，并在拷贝完成后对卷数据进行全面比对，有效的保障了数据的完成性和一致性。Data integrity is guaranteed. In this migration method, the destination device directly initiates a copy request to the source device, and the volume data is directly copied to the destination device in block form, and the volume data is fully compared after the copy is completed. Effectively guarantee the completeness and consistency of data.
附图说明Description of drawings
图1是CA模式下数据流示意图；Figure 1 is a schematic diagram of data flow in CA mode;
图2是启动器模式下数据流示意图。Fig. 2 is a schematic diagram of data flow in the initiator mode.
具体实施方式detailed description
下面对本发明的内容进行更加详细的阐述：The content of the present invention is described in more detail below:
本发明提出的基于CA端口的存储离线数据迁移方法主要包含以下过程：The storage offline data migration method based on the CA port proposed by the present invention mainly includes the following processes:
1、在本发明中存储CA端口有 “CA模式”和“启动器”两种模式，当选择“CA模式”时，存储端只能被动的接收来自应用服务器的数据写/读请求，如图1所示，此时，CA端口只能作为目标端。1. In the present invention, the storage CA port has two modes: "CA mode" and "initiator". When the "CA mode" is selected, the storage terminal can only passively receive data write/read requests from the application server, as shown in the figure 1, at this time, the CA port can only serve as the target end.
2、当客户需要进行数据迁移时，只需将两台磁盘阵列通过直连或交换机的方式连接到一起，如图2所示，并将目的地设备的CA端口设置为“启动器”模式，便可将目的地设备当做一台应用服务器，目的地设备便会向来源设备发起数据读写请求，将来源设备的卷数据以块的形式拷贝到目的地设备上，从而实现数据迁移。但在数据迁移的过程中会暂停应用服务器的访问。2. When customers need to perform data migration, they only need to connect two disk arrays together through direct connection or switch, as shown in Figure 2, and set the CA port of the destination device to "initiator" mode. The destination device can be regarded as an application server, and the destination device will initiate a data read and write request to the source device, and copy the volume data of the source device to the destination device in the form of blocks, thereby realizing data migration. However, the access to the application server will be suspended during the data migration process.
3、来源设备和目的地设备之间可以通过多条路径进行数据传输从而保证数据的传输的高效性和可靠性。同时在存储软件系统的GUI界面上可以随时查看数据迁移的过程也可随时暂停和开启数据拷贝过程，以保证客户应用的随时启动。3. Multiple paths can be used for data transmission between the source device and the destination device to ensure the efficiency and reliability of data transmission. At the same time, on the GUI interface of the storage software system, the process of data migration can be viewed at any time, and the process of data copying can be paused and started at any time to ensure that customer applications can be started at any time.
4、当完成数据拷贝之后，为保证数据一致性，目的地设备会与来源设备进行数据对比，两种对比方式：快速对比和全面对比。快速对比仅对比卷顶部的几个数据块，此种方式下可以尽快恢复生产。全面对比是指对卷中的数据块进行全面的对比，此种方式有助于确保数据迁移之后的完整性。4. After the data copy is completed, in order to ensure data consistency, the destination device will compare the data with the source device. There are two comparison methods: quick comparison and comprehensive comparison. Quick compare only compares the top few data blocks of the volume, this way production can be resumed as quickly as possible. Full comparison refers to a comprehensive comparison of the data blocks in the volume, which helps to ensure the integrity of the data after migration.
5、在上述动作完成后，数据迁移彻底完成，此时即可将目的地设备CA端口切回至“CA模式”，应用服务器即可访问目的地设备。5. After the above actions are completed, the data migration is completely completed. At this time, the CA port of the destination device can be switched back to "CA mode", and the application server can access the destination device.
Claims (3)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710712399.XA CN107479832A (en) | 2017-08-18 | 2017-08-18 | A kind of storage off-line data moving method based on CA ports |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710712399.XA CN107479832A (en) | 2017-08-18 | 2017-08-18 | A kind of storage off-line data moving method based on CA ports |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107479832A true CN107479832A (en) | 2017-12-15 |
Family
ID=60600802
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710712399.XA Pending CN107479832A (en) | 2017-08-18 | 2017-08-18 | A kind of storage off-line data moving method based on CA ports |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107479832A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1830180A (en) * | 2003-07-31 | 2006-09-06 | Nec电子（欧洲）有限责任公司 | Device and method for diagnostics in multi-channel CAN applications |
| CN101436166A (en) * | 2007-11-14 | 2009-05-20 | 信亿科技股份有限公司 | Data transmission device and control method |
| US8301811B1 (en) * | 2010-03-30 | 2012-10-30 | Emc Corporation | Techniques for performing online data migration while effectively migrating SCSI reservations between source and target arrays |
| CN103052938A (en) * | 2010-10-14 | 2013-04-17 | 株式会社日立制作所 | Data migration system and data migration method |
| CN106445421A (en) * | 2016-10-14 | 2017-02-22 | 郑州云海信息技术有限公司 | Storage system data migration method and system |
| CN106648468A (en) * | 2016-12-29 | 2017-05-10 | 郑州云海信息技术有限公司 | Control method and system for IO request during data migration process |
| CN106775476A (en) * | 2016-12-19 | 2017-05-31 | 中国人民解放军理工大学 | Mixing memory system and its management method |
| CN107015890A (en) * | 2015-12-01 | 2017-08-04 | 三星电子株式会社 | Storage device, the server system with it and its operating method |
-
2017
- 2017-08-18 CN CN201710712399.XA patent/CN107479832A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1830180A (en) * | 2003-07-31 | 2006-09-06 | Nec电子（欧洲）有限责任公司 | Device and method for diagnostics in multi-channel CAN applications |
| CN101436166A (en) * | 2007-11-14 | 2009-05-20 | 信亿科技股份有限公司 | Data transmission device and control method |
| US8301811B1 (en) * | 2010-03-30 | 2012-10-30 | Emc Corporation | Techniques for performing online data migration while effectively migrating SCSI reservations between source and target arrays |
| CN103052938A (en) * | 2010-10-14 | 2013-04-17 | 株式会社日立制作所 | Data migration system and data migration method |
| CN107015890A (en) * | 2015-12-01 | 2017-08-04 | 三星电子株式会社 | Storage device, the server system with it and its operating method |
| CN106445421A (en) * | 2016-10-14 | 2017-02-22 | 郑州云海信息技术有限公司 | Storage system data migration method and system |
| CN106775476A (en) * | 2016-12-19 | 2017-05-31 | 中国人民解放军理工大学 | Mixing memory system and its management method |
| CN106648468A (en) * | 2016-12-29 | 2017-05-10 | 郑州云海信息技术有限公司 | Control method and system for IO request during data migration process |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10379964B2 (en) | Integrating resources at a backup site | |
| US11880280B2 (en) | Variable number and size of put operations for storage backup | |
| CN111913663A (en) | Method and device for online storage volume migration, and system for online storage volume migration | |
| US8732429B2 (en) | Preserving a deleted data volume | |
| US20140059308A1 (en) | Automated migration to a new target volume via merged bitmaps to maintain consistency | |
| CN101945131B (en) | Storage virtualization-based data migration method | |
| JP2013520747A (en) | System and method for enabling a replication target to reuse unused storage space on a thin provisioning storage system | |
| US20140109095A1 (en) | Seamless extension of local computing power | |
| CN102611745A (en) | On-line file moving method, device and system | |
| CN110413590A (en) | Data migration method, device, equipment and medium | |
| CN103118073A (en) | Virtual machine data persistence storage system and method in cloud environment | |
| US9917740B2 (en) | Reducing internodal communications in a clustered system | |
| US9037821B1 (en) | Systems and methods for replicating snapshots across backup domains | |
| WO2016066081A1 (en) | Data writing method and device | |
| WO2022262510A1 (en) | Method and apparatus for synchronizing cross-blockchain transactions | |
| CN107704206B (en) | Method, device, equipment and storage medium for online migration of heterogeneous system data | |
| CN107273258A (en) | Method of testing and system are restarted in the automation of interchanger built in a kind of blade server | |
| WO2015054832A1 (en) | Two-level cloud system migration | |
| CN108200151B (en) | ISCSI Target load balancing method and device in distributed storage system | |
| CN107479832A (en) | A kind of storage off-line data moving method based on CA ports | |
| CN106547485B (en) | Data migration method and device | |
| CN102708035A (en) | Cluster system monitoring system based on pattern matching | |
| CN115766405B (en) | A fault handling method, device, equipment and storage medium | |
| CN104461817B (en) | A kind of method and server for detecting key | |
| CN114896334B (en) | A database configuration method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171215 |