CN104573122A - Oracle database migration tool for migrating from AIX platform to K-UX platform - Google Patents

Abstract

The invention particularly relates to an Oracle database migration tool for migrating from an AIX platform to a K-UX platform. The Oracle database migration tool for migrating from the AIX platform to the K-UX platform, the software architecture of the migration tool is based on the JAVA platform, and is divided into a source end and a target end, wherein the AIX platform is the source end, and the K-UX platform is the target end. The source and target communicate through Ethernet. The Oracle database migration tool for migrating from the AIX platform to the K-UX platform has a simple and reasonable structure, which realizes the migration of the Oracle database from the AIX platform to the K-UX platform, greatly reduces the difficulty of database migration, reduces the workload, and shortens the Working hours, improve work efficiency.

Description

An Oracle database migration tool for migrating from AIX platform to K-UX platform

technical field

The invention relates to the technical field of cross-platform migration of databases, in particular to an Oracle database migration tool for migrating from an AIX platform to a K-UX platform.

Background technique

High-end servers carry the core applications of the industry and are widely used in key application fields such as finance, telecommunications, energy, and transportation. Their operation is directly related to the normal operation of society and the economy. For a long time, due to the lack of high-end server design and manufacturing capabilities, my country's high-end server market has been dominated by foreign manufacturers, of which HP has long occupied more than 20% of the domestic market. With the support of the "Eleventh Five-Year" 863 plan of the Ministry of Science and Technology, and the active cooperation of relevant departments and scientific research units, Inspur has successfully developed a 32-channel high-end fault-tolerant computer system, with an availability of 99.999%, and the system's online transaction processing capacity has reached the world's advanced level. In order to improve the independent controllability of major equipment for information construction, more and more information systems tend to use independent products. Therefore, for a relatively long period of time in the future, domestic IT system construction will face localization changes. The specific level of information system construction and implementation is reflected in more and more cross-platform migration work, including considerable migration work It is from the AIX platform to the Inspur K-UX platform.

Database is the core software of IT system, and database migration is also an extremely important part of IT system construction. Due to differences in CPU instruction sets, operating systems, and compilers of heterogeneous server platforms, cross-platform migration of databases is difficult and requires a lot of work. How to reduce the difficulty of transplantation and reduce the workload is the key problem to be solved in database cross-platform migration.

Contents of the invention

In order to make up for the defects of the prior art, the present invention provides a simple and efficient Oracle database migration tool for migrating from the AIX platform to the K-UX platform.

The present invention is achieved through the following technical solutions:

A kind of Oracle database migration tool that migrates to K-UX platform from AIX platform, it is characterized in that: the software framework of described migration tool is based on JAVA platform, is divided into source end and target end, wherein AIX platform is source end, K-UX The platform is the target end, and the communication between the source end and the target end is realized through Ethernet; the source end and the target end scan their respective platform environments, and generate migration evaluation reports and migration plan suggestions according to the scanning results and migration algorithms; The screening and migration algorithm suggested by the migration plan generates a migration wizard. Through the migration wizard's prompts and guidance to users, the cross-platform and cross-version semi-automatic migration of Oracle database data from other server platforms to the K-UX platform is realized.

The source end includes communication module a (1), analysis module a (2), backup module (3) and console module a (4), and the target end includes communication module b (5), analysis module b (6 ), a recovery module (7) and a console module b (8); the console module (4, 8) is used to realize human-computer interaction, and the first communication port of the console module (4, 8) and the communication module (1 , 5) The first communication port is connected, the second communication port of the console module (4, 8) is connected to the first communication port of the analysis module (2, 6), the third communication port of the console module a (4) is connected to the backup module ( 3) connected, the third communication port of the console module b (8) is connected to the recovery module (7), the second communication port of the communication module (1, 5) is connected to the second communication port of the analysis module (2, 6), the communication module a(1) The third communication port is connected to the second communication port of the backup module (3), communication module b(5) The third communication port is connected to the second communication port of the recovery module (7), the source communication module a(1) The fourth communication port is connected to the fourth port of the target end communication module b (5) via Ethernet; the communication module (1, 5) connects the analysis module a (2), the backup module (3) and the console module a (4 ) and the information of the analysis module b (6), the recovery module (7) and the console module b (8) interact through the Ethernet to realize the communication and control between the source end and the target end.

The analysis module a (2) collects source platform information and database information, and the analysis module a (2) receives the target platform information collected by the analysis module b (6) through the communication module a (1), and compares the source platform information with the Based on the target platform information, the source and target platform difference analysis table is output to the console module a (4); the analysis module formulates a migration plan based on the platform difference analysis table, the collected source database information and the migration algorithm, and outputs it to the control panel The platform module (1) generates a migration wizard to guide the migration according to the manual intervention information fed back by the console module a (4); the analysis module a (2) integrates the source platform information, source database information, platform difference analysis table, and migration plan , the migration wizard sends to the communication module a (1); the analysis module b (6) collects the target platform information and the restored database information; the analysis module b (6) receives the source analysis module through the communication module b (5) a(2) Collect the source database information, compare the source database information with the target database information, get the source database, target database consistency checklist output to the console module b (8); analysis module b(6) Send the target-side platform information, target-side database information, and database consistency checklist to communication module b(5).

The platform information includes processor architecture information, instruction set information, byte order information, compiler information, operating system information, system variable information and file system information, and the database information and restored database information include database version information, Data volume information, table information, index information, stored procedure information, user information, and log information.

The backup module (3) executes the source Oracle database backup operation according to the migration wizard, the migration algorithm, and the manual intervention information sent by the console module a (4), and feeds back the results of each step of the operation to the console module a (4) and The communication module a (1); the recovery module (7) executes the source-end Oracle database recovery operation according to the migration wizard, the migration algorithm, and the manual intervention information sent by the console module b (8), and feeds back the results of each step of the operation to the control Station module b (8) and communication module b (5).

The migration algorithm includes a migration wizard generation algorithm, an import/export backup recovery algorithm, an XTTS backup recovery algorithm, and a data pump backup recovery algorithm.

The algorithm steps for generating the migration wizard are as follows:

1) Formulate the format of the source-end and target-end platform difference analysis table and the migration proposal corresponding to each difference;

2) When the source database version is Oracle 9i, use the import/export backup recovery algorithm for migration;

3) When the source database version is Oracle 10g or Oracle 11g, select different migration methods and different dump file transfer suggestions according to different data volumes and time windows;

When the amount of data is <1T and the time window is 8h~12h, use the XTTS backup recovery algorithm to perform data migration, and use FTP transmission or NFS transfer server to move data files;

When the amount of data is less than 1T and the time window is 12h~48h, the data pump backup and recovery algorithm is used to perform data migration;

When the amount of data is 1T~5T, and the time window is 8h~24h, use the XTTS backup recovery algorithm to perform data migration, and use FTP transmission or NFS transfer server to move data files;

When the data volume is 1T~5T and the time window is 24h~48h, the data pump backup and recovery algorithm is used to perform data migration;

When the data volume is 5T~10T, and the time window is 8h~48h, use the XTTS backup recovery algorithm to perform data migration, and use NFS transfer server or storage remount to move data files;

When the amount of data is >10T and the time window is 8h~48h, the XTTS backup and recovery algorithm is used to perform data migration, and the data files are moved by means of storage remounting;

5) Estimate migration time based on table information, user information, and stored process information, including database backup time, dump file transfer time, and database recovery time;

6) The analysis module a (2) generates a migration proposal based on the above information, and sends the migration proposal to the console module a (4) and the communication module a (1);

7) Finally, a migration wizard is generated according to the user's decision on the migration proposal.

The steps of the import/export backup recovery algorithm are as follows:

1) The backup module (3) executes the consistency check of the user database at the source end;

2) Backup module (3) Back up the source database, generate dump files, and feedback the results;

3) Prompt the user to transfer the dump file;

4) The user confirms that the transfer of the dump file is completed through the source console module a (4) or the target console module b (8);

5) The recovery module (7) imports the user library on the target side and feeds back the results;

6) The recovery module (7) performs a consistency check on the target database and feeds back the check result.

The steps of the XTTS backup recovery algorithm are as follows:

1) Create the target database

Using the DBCA method to create the target database using the template generated when the source database was created, the parameters of the created target database and the source database are the same, reducing manual intervention such as subsequent target database optimization;

2) Environmental verification

Verify the various options of the source database and the target database, including: system platform, byte order, character set, time zone version, listener, TNS;

3) Initialize, generate migration scripts, and modify the default tablespace of the target database system;

4) Delete the target database user tablespace;

5) Create a mapping user;

6) Export the source database metabase;

7) User tablespace self-contained check;

8) Change the status of the source database user table space;

9) Export source database user table space metadata;

10) Use FTP transmission, NFS as an intermediate server or storage remounting to move metadata files and data files in a new format;

11) Convert the byte order of the source database data file;

12) Import source database user table space metadata;

13) Restore the state of the target database user table space;

14) Import source database metadata;

15) Subsequent processing of the target database, including restoring the system default tablespace and compiling invalid objects;

16) Restore the state of the source database user table space.

The steps of the data pump backup recovery algorithm are as follows:

1) Export data to a dump file in the source database;

2) Move the dump file to the target library;

3) Import the data in the dump file to the target library.

The beneficial effect of the present invention is: this Oracle database migration tool that migrates from AIX platform to K-UX platform, structure is simple and reasonable, has realized the migration of Oracle database from AIX platform to K-UX platform, has greatly reduced database migration difficulty, The workload is reduced, the working hours are shortened, and the work efficiency is improved.

Description of drawings

Accompanying drawing 1 is the schematic diagram of the architecture of the invention Oracle database migration tool.

Detailed ways

The present invention will be described in detail below in conjunction with the accompanying drawings.

The Oracle database migration tool for migrating from the AIX platform to the K-UX platform, its software architecture is based on the JAVA platform, which is divided into a source end and a target end, where the AIX platform is the source end, and the K-UX platform is the target end, which is realized through Ethernet The source end communicates with the target end; the source end and the target end scan their respective platform environments, and generate a migration assessment report and a migration plan suggestion based on the scanning results and migration algorithm; generate a migration plan based on the user's selection of the migration plan suggestion and a migration algorithm Migration wizard, through the migration wizard's prompts and guidance to users, realizes the cross-platform and cross-version semi-automatic migration of Oracle database data from other server platforms to the K-UX platform.

The source end includes communication module a (1), analysis module a (2), backup module (3) and console module a (4), and the target end includes communication module b (5), analysis module b (6 ), a recovery module (7) and a console module b (8); the console module (4, 8) is used to realize human-computer interaction, and the first communication port of the console module (4, 8) and the communication module (1 , 5) The first communication port is connected, the second communication port of the console module (4, 8) is connected to the first communication port of the analysis module (2, 6), the third communication port of the console module a (4) is connected to the backup module ( 3) connected, the third communication port of the console module b (8) is connected to the recovery module (7), the second communication port of the communication module (1, 5) is connected to the second communication port of the analysis module (2, 6), the communication module a(1) The third communication port is connected to the second communication port of the backup module (3), communication module b(5) The third communication port is connected to the second communication port of the recovery module (7), the source communication module a(1) The fourth communication port is connected to the fourth port of the target end communication module b (5) via Ethernet; the communication module (1, 5) connects the analysis module a (2), the backup module (3) and the console module a (4 ) and the information of the analysis module b (6), the recovery module (7) and the console module b (8) interact through the Ethernet to realize the communication and control between the source end and the target end.

The analysis module a (2) collects source platform information and database information, and the analysis module a (2) receives the target platform information collected by the analysis module b (6) through the communication module a (1), and compares the source platform information with the Based on the target platform information, the source and target platform difference analysis table is output to the console module a (4); the analysis module formulates a migration plan based on the platform difference analysis table, the collected source database information and the migration algorithm, and outputs it to the control panel The platform module (1) generates a migration wizard to guide the migration according to the manual intervention information fed back by the console module a (4); the analysis module a (2) integrates the source platform information, source database information, platform difference analysis table, and migration plan , the migration wizard sends to the communication module a (1); the analysis module b (6) collects the target platform information and the restored database information; the analysis module b (6) receives the source analysis module through the communication module b (5) a(2) Collect the source database information, compare the source database information with the target database information, get the source database, target database consistency checklist output to the console module b (8); analysis module b(6) Send the target-side platform information, target-side database information, and database consistency checklist to communication module b(5).

The platform information includes processor architecture information, instruction set information, byte order information, compiler information, operating system information, system variable information and file system information, and the database information and restored database information include database version information, Data volume information, table information, index information, stored procedure information, user information, and log information.

The backup module (3) executes the source Oracle database backup operation according to the migration wizard, the migration algorithm, and the manual intervention information sent by the console module a (4), and feeds back the results of each step of the operation to the console module a (4) and The communication module a (1); the recovery module (7) executes the source-end Oracle database recovery operation according to the migration wizard, the migration algorithm, and the manual intervention information sent by the console module b (8), and feeds back the results of each step of the operation to the control Station module b (8) and communication module b (5).

The migration algorithm includes a migration wizard generation algorithm, an import/export backup recovery algorithm, an XTTS backup recovery algorithm, and a data pump backup recovery algorithm.

The algorithm steps for generating the migration wizard are as follows:

1) Formulate the format of the source-end and target-end platform difference analysis table and the migration proposal corresponding to each difference;

2) When the source database version is Oracle 9i, use the import/export backup recovery algorithm for migration;

3) When the source database version is Oracle 10g or Oracle 11g, select different migration methods and different dump file transfer suggestions according to different data volumes and time windows;

When the amount of data is <1T and the time window is 8h~12h, use the XTTS backup recovery algorithm to perform data migration, and use FTP transmission or NFS transfer server to move data files;

When the amount of data is less than 1T and the time window is 12h~48h, the data pump backup and recovery algorithm is used to perform data migration;

When the amount of data is 1T~5T, and the time window is 8h~24h, use the XTTS backup recovery algorithm to perform data migration, and use FTP transmission or NFS transfer server to move data files;

When the data volume is 1T~5T and the time window is 24h~48h, the data pump backup and recovery algorithm is used to perform data migration;

When the data volume is 5T~10T, and the time window is 8h~48h, use the XTTS backup recovery algorithm to perform data migration, and use NFS transfer server or storage remount to move data files;

When the amount of data is >10T and the time window is 8h~48h, the XTTS backup and recovery algorithm is used to perform data migration, and the data files are moved by means of storage remounting;

5) Estimate migration time based on table information, user information, and stored process information, including database backup time, dump file transfer time, and database recovery time;

6) The analysis module a (2) generates a migration proposal based on the above information, and sends the migration proposal to the console module a (4) and the communication module a (1);

7) Finally, a migration wizard is generated according to the user's decision on the migration proposal.

The steps of the import/export backup recovery algorithm are as follows:

1) The backup module (3) executes the consistency check of the user database at the source end;

2) Backup module (3) Back up the source database, generate dump files, and feedback the results;

3) Prompt the user to transfer the dump file;

4) The user confirms that the transfer of the dump file is completed through the source console module a (4) or the target console module b (8);

5) The recovery module (7) imports the user library on the target side and feeds back the results;

6) The recovery module (7) performs a consistency check on the target database and feeds back the check result.

The steps of the XTTS backup recovery algorithm are as follows:

1) Create the target database

Using the DBCA method to create the target database using the template generated when the source database was created, the parameters of the created target database and the source database are the same, reducing manual intervention such as subsequent target database optimization;

2) Environmental verification

Verify the various options of the source database and the target database, including: system platform, byte order, character set, time zone version, listener, TNS;

3) Initialize, generate migration scripts, and modify the default tablespace of the target database system;

4) Delete the target database user tablespace;

5) Create a mapping user;

6) Export the source database metabase;

7) User tablespace self-contained check;

8) Change the status of the source database user table space;

9) Export source database user table space metadata;

10) Use FTP transmission, NFS as an intermediate server or storage remounting to move metadata files and data files in a new format;

11) Convert the byte order of the source database data file;

12) Import source database user table space metadata;

13) Restore the state of the target database user table space;

14) Import source database metadata;

15) Subsequent processing of the target database, including restoring the system default tablespace and compiling invalid objects;

16) Restore the state of the source database user table space.

The steps of the data pump backup recovery algorithm are as follows:

1) Export data from the source database to a dump file. When migrating from Oracle 11g to Oracle 10g, you need to specify the parameter version when exporting. For example, when migrating from 11g to Oracle 10.2.0.1.0, the export statement is:

EXPDP USERID='test/testorcl as sysdba' schemas=test directory=DATA_PUMP_DIR dumpfile=test.dmp logfile=test.log version=10.2.0.1.0

2) Move the dump file to the target library;

3) Import the data in the dump file to the target library.

Claims (10)

1. one kind from AIX platform to the oracle database Migration tools of K-UX platform migration, it is characterized in that: the software architecture of described Migration tools is based on JAVA platform, be divided into source and destination end, wherein AIX platform is source, K-UX platform is destination end, realizes source communicate with destination end by Ethernet; Described source and destination end scan respective place platform environment, according to scanning result and migration algorithm, generate migration assessment report and migration scheme proposals; According to user, Migration Wizard is generated to the screening of migration scheme proposals and migration algorithm, by Migration Wizard to the prompting of user and guidance, realize the cross-platform cross version semi automatic migration of oracle database data from other server platforms to K-UX platform.

2. the oracle database Migration tools from AIX platform to K-UX platform migration according to claim 1, it is characterized in that: described source comprises communication module a(1), analysis module a(2), backup module (3) and control desk module a(4), described destination end comprises communication module b(5), analysis module b(6), recover module (7) and control desk module b(8), described control desk module (4, 8) for realizing man-machine interaction, control desk module (4, 8) the first communication port and communication module (1, 5) the first communication port is connected, control desk module (4, 8) second communication port and analysis module (2, 6) the first communication port is connected, control desk module a(4) third communication port is connected with backup module (3), control desk module b(8) third communication port with recovery module (7) be connected, communication module (1, 5) second communication port and analysis module (2, 6) second communication port is connected, communication module a(1) third communication port is connected with backup module (3) second communication port, communication module b(5) third communication port with recovery module (7) second communication port be connected, source communications module a(1) the 4th communication port and destination end communication module b(5) the 4th port is connected by Ethernet, described communication module (1,5) by analysis module a(2), backup module (3) and control desk module a(4) information and analysis module b(6), recover module (7) and control desk module b(8) information realize alternately, realizing source and destination end communication and control by Ethernet.

3. according to the oracle database Migration tools from AIX platform to K-UX platform migration according to claim 2, it is characterized in that: described analysis module a(2) collect source platform information and database information, analysis module a(2) by communication module a(1) receiving and analyzing module b(6) the destination end platform information collected, contrast source platform information and destination end platform information, draws source, destination end platform variance analysis table exports control desk module a(4 to); Analysis module, according to the source database information of platform variance analysis table, collection and migration algorithm, is formulated migration scheme and is exported control desk module (1) to, according to control desk module a(4) the manual intervention information fed back, generate Migration Wizard and instruct migration; Analysis module a(2) source platform information, source database information, platform variance analysis table, migration scheme, Migration Wizard are sent to communication module a(1); Described analysis module b(6) collect destination end platform information and the database information recovered; Analysis module b(6) by communication module b(5) receive source analysis module a(2) the source database information collected, contrast source database information and the database information that recovered of destination end, draw source database, destination end Database Consistency Checking table export control desk module b(8 to); Analysis module b(6) by destination end platform information, destination end database information, Database Consistency Checking table, be sent to communication module b(5).

4. according to the oracle database Migration tools from AIX platform to K-UX platform migration according to claim 3, it is characterized in that: described platform information comprises processor architecture information, instruction set information, syllable sequence information, compiler information, operation system information, system variable information and filesystem information, described database information and the database information recovered comprise database version information, data amount information, table information, index information, storing process information, user profile, log information.

5. according to the oracle database Migration tools from AIX platform to K-UX platform migration according to claim 2, it is characterized in that: described backup module (3) is according to Migration Wizard, migration algorithm and control desk module a(4) the manual intervention information and executing source oracle database backup operation that sends, and feedback often walks the result of operation to control desk module a(4) with communication module a(1); Described recovery module (7) is according to Migration Wizard, migration algorithm and control desk module b(8) the manual intervention information and executing source oracle database recovery operation that sends, and feedback often walks the result of operation to control desk module b(8) with communication module b(5).

6. the oracle database Migration tools from AIX platform to K-UX platform migration according to claim 1 or 3 or 5, is characterized in that: described migration algorithm comprises Migration Wizard generating algorithm, importing/derivation Backup and Restore algorithm, XTTS Backup and Restore algorithm and data pump Backup and Restore algorithm.

7. the oracle database Migration tools from AIX platform to K-UX platform migration according to claim 3 or 6, is characterized in that: described Migration Wizard generating algorithm step is as follows:

1) migration scheme proposals corresponding to source, destination end platform variance analysis tableau format and each difference is formulated;

2) when source database version is Oracle 9i, then importing/derivation Backup and Restore algorithm is used to move;

3) when source database version is Oracle 10g or Oracle 11g, then different moving methods and different dump files transmission suggestion is selected according to different data volumes and time window;

As data volume <1T, when time window is 8h ~ 12h, adopts XTTS Backup and Restore algorithm to perform Data Migration, and adopt the mode Mobile data file of FTP transmission or NFS transfer server;

As data volume <1T, when time window is 12h ~ 48h, data pump Backup and Restore algorithm is adopted to perform Data Migration;

As data volume 1T ~ 5T, when time window is 8h ~ 24h, adopts XTTS Backup and Restore algorithm to perform Data Migration, and adopt the mode Mobile data file of FTP transmission or NFS transfer server;

As data volume 1T ~ 5T, when time window is 24h ~ 48h, data pump Backup and Restore algorithm is adopted to perform Data Migration;

As data volume 5T ~ 10T, when time window is 8h ~ 48h, adopt XTTS Backup and Restore algorithm to perform Data Migration, and adopt NFS transfer server or store again the mode Mobile data file of carry;

As data volume >10T, when time window is 8h ~ 48h, adopts XTTS Backup and Restore algorithm to perform Data Migration, and adopt the mode Mobile data file storing again carry;

5) estimate transit time according to table information, user profile, storing process information, comprise DB Backup time, dump file transmission time, database recovery time;

6) analysis module a(2) generate migration scheme proposals according to above information, and migration scheme proposals is sent to control desk module a(4) and communication module a(1);

7) finally according to the decision-making of user to migration scheme proposals, Migration Wizard is generated.

8. the oracle database Migration tools from AIX platform to K-UX platform migration according to claim 5 or 6 or 7, is characterized in that: described importing/derivation Backup and Restore algorithm steps is as follows:

1) backup module (3) performs originating mobile subscriber Database Consistency Checking;

2) backup module (3) backup source client database, generates dump file, feedback result;

3) user is pointed out to transmit dump file;

4) user is by source control desk module a(4) or destination end control desk module b(8) confirm dump file end of transmission;

5) recover module (7) and import user library in destination end, and feedback result;

6) recover module (7) and perform consistency check in target database, feedback check result.

9. the oracle database Migration tools from AIX platform to K-UX platform migration according to claim 5 or 6 or 7, is characterized in that: described XTTS Backup and Restore algorithm steps is as follows:

1) target database is created

The template establishment target database generated when adopting the mode of DBCA to use storehouse, source to create, the object library created out with this is identical with storehouse, source parameters, decreases the manual intervention such as succeeding target storehouse optimization;

2) environment checking

Checking source database and target database the respective option, comprising: system platform, syllable sequence, character set, time zone version, audiomonitor, TNS;

3) initialization, generates migration script, modifying target storehouse system default table space;

4) target database subscriber's meter space is deleted;

5) map user is created;

6) source database metadatabase is derived;

7) the self-contained inspection in subscriber's meter space;

8) source database subscriber's meter spatiality is changed;

9) source database subscriber's meter Metadata is derived;

10) adopt the mode of FTP transmission, the mode that NFS does intermediate server or the mode storing again carry move the data file of meta data file and format;

11) converting source data database data file syllable sequence;

12) source database subscriber's meter Metadata is imported;

13) restore target database user table space state;

14) source database metadata is imported;

15) target database subsequent treatment, comprises restoring system default table space and invalidated object compiling;

16) reduction source database subscriber's meter spatiality.

10. the oracle database Migration tools from AIX platform to K-UX platform migration according to claim 5 or 6 or 7, is characterized in that: described data pump Backup and Restore algorithm steps is as follows:

1) at source database derived data to dump file;

2) mobile dump file is to object library;

3) data are imported in dump file to object library.