CN101859303A - Metadata management method and management system - Google Patents
Metadata management method and management system Download PDFInfo
- Publication number
- CN101859303A CN101859303A CN200910131570A CN200910131570A CN101859303A CN 101859303 A CN101859303 A CN 101859303A CN 200910131570 A CN200910131570 A CN 200910131570A CN 200910131570 A CN200910131570 A CN 200910131570A CN 101859303 A CN101859303 A CN 101859303A
- Authority
- CN
- China
- Prior art keywords
- metadata
- mapping relationship
- code
- sql statement
- management
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007726 management method Methods 0.000 title claims abstract description 48
- 238000013507 mapping Methods 0.000 claims abstract description 32
- 238000004458 analytical method Methods 0.000 claims description 16
- 238000000034 method Methods 0.000 abstract description 16
- 238000004519 manufacturing process Methods 0.000 abstract description 14
- 238000012423 maintenance Methods 0.000 abstract description 13
- 238000011161 development Methods 0.000 abstract description 12
- 230000008569 process Effects 0.000 abstract description 12
- 230000001360 synchronised effect Effects 0.000 abstract description 7
- 230000000694 effects Effects 0.000 abstract description 3
- 238000012544 monitoring process Methods 0.000 abstract description 3
- 230000009286 beneficial effect Effects 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000002950 deficient Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 238000007596 consolidation process Methods 0.000 description 1
- 230000002354 daily effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 230000005284 excitation Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000009897 systematic effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
本发明公开了一种元数据管理方法及管理系统。其中元数据管理方法包括：A、提取根据元数据库中已有的元数据进行开发而形成的代码；B、解析所述代码的映射关系信息，生成新的元数据；C、将所述新的元数据存储到元数据库中。本发明的元数据管理方法和管理系统，通过在编写开发数据处理程序的同时对开发过程中代码的解析，提取元数据，可以使得元数据信息维护与实际生产数据能够及时同步，内容信息一致，元数据手工维护工作量减少；同时提高了元数据与生产结合提供应用效果与价值；并且有利于需求开发过程中的质量管理、流程监控和维护管理。
The invention discloses a metadata management method and a management system. Wherein the metadata management method includes: A. extracting the code formed according to the existing metadata in the metadata database; B. parsing the mapping relationship information of the code to generate new metadata; C. Metadata is stored in the metadata repository. The metadata management method and management system of the present invention, by analyzing the code in the development process and extracting metadata while writing the development data processing program, can make the maintenance of metadata information and the actual production data synchronized in time, and the content information is consistent. The workload of metadata manual maintenance is reduced; at the same time, the application effect and value provided by the combination of metadata and production are improved; and it is beneficial to quality management, process monitoring and maintenance management in the process of demand development.
Description
Technical field
The present invention relates to a kind of business support technology, relate in particular to a kind of metadata management method and management system.
Background technology
In the data warehouse field, metadata is defined as: the data of data of description and environment thereof.In general, it has the purposes of two aspects.At first, metadata can provide the information based on the user, can help the user to use data as the metadata of the business description information of record data items.Secondly, metadata can back-up system to the administering and maintaining of data, as can back-up system about the metadata of store data items method with effective and efficient manner visit data.Specifically, in data warehouse, the following five type systematic management functions of the main support of metadata mechanism: which data (1) describes in data warehouse; (2) define the data that will enter the data in the data warehouse and from data warehouse, produce; (3) writing down the data pick-up working time of thereupon carrying out according to the business event generation arranges; (4) requirement and the implementation status of record and detection system data consistency; (5) weigh the quality of data.
Existing routine data warehouse metadata schema (Common WarehouseMetamodel in the prior art, be called for short CWM) the international standard theory, but, CWM can not realize between whole systems or intrasystem metadata is obtained, and there is big technical difficulty in existing metadata acquisition methods, is difficult for realizing.Simultaneously, utilize CWM can only be afterwards production information to be integrated and provide the metadata Back ground Information, and because information is difficult to consolidation or postpones omit, can't not realize that because of imperfect and progress catch up with metadata manages accurately easily.
Therefore, provide a kind of can obtaining automatically to concern between the production system data that getting the maintenance of solution metadata develops the metadata management method of asynchronous problem and the technical matters that system becomes urgent need solution in the prior art with production.
Summary of the invention
First purpose of the present invention is, safeguard, content information inconsistent defective asynchronous at metadata information in the prior art, the metadata management method that a kind of metadata information is synchronous with the online production data message and content information is consistent is provided with the actual production data.
Second purpose of the present invention is, safeguard, content information inconsistent defective asynchronous at metadata information in the prior art, the metadata management system that a kind of metadata information is synchronous with the online production data message and content information is consistent is provided with the actual production data.
According to first purpose of the present invention, a kind of metadata management method is provided, comprise A, extract and develop the code that forms according to existing metadata in the metadatabase; The mapping relations information of B, resolving code generates new metadata; C, with new metadata store in metadatabase.
According to second purpose of the present invention, a kind of metadata management system is provided, comprising: the performance analysis device is used for storing according to the existing metadata of metadatabase and develops the code that the back forms; Resolver is used to extract described code, resolves the mapping relations information of described code, generates new metadata; Metadatabase is used to store described metadata.
Among the present invention, the code that the performance analysis device generates is a SQL statement.
Metadata management method of the present invention and management system, by when writing the development data handling procedure to performance history in the parsing of code, extract metadata, can be so that metadata information be safeguarded and the actual production data can be in time synchronous, the content information unanimity, the manual maintenance workload of metadata reduces; Improve metadata simultaneously and provide effect and value with producing to combine; And help quality management, flow monitoring and maintenance management in the demand performance history.
Description of drawings
Fig. 1 is the structural drawing of embodiment of the invention metadata management system;
Fig. 2 is the structural drawing of embodiment of the invention resolver;
Fig. 3 is the process flow diagram of embodiment of the invention metadata management method;
Fig. 4 is the software synoptic diagram of embodiment of the invention SQL resolver operational process input SQL statement;
Fig. 5 is the software synoptic diagram that embodiment of the invention SQL resolver operational process is set up grammar book;
Fig. 6 is embodiment of the invention SQL resolver operational process output result's a software synoptic diagram;
Fig. 7 is the application synoptic diagram of embodiment of the invention metadata management system.
Embodiment
The present invention is described in detail below in conjunction with accompanying drawing.
As shown in Figure 1, the metadata management system of the embodiment of the invention comprises: performance analysis device 20 is used for storing according to the existing metadata of metadatabase and develops the code that the back forms; Resolver 40 is used to extract described code, resolves the mapping relations information of described code, generates new metadata; Metadatabase 60 is used to store described metadata.In the present embodiment, the code that the performance analysis device generates is a SQL statement.
As shown in Figure 2, resolver 40 comprises: analysis module 42 is used to resolve the mapping relations information of SQL statement; Metadata generation module 44 is used for generating corresponding new metadata according to described mapping relations information.Analysis module 42 comprises: field analysis module and/or table level are analyzed a module, and the field analysis submodule is used to resolve the mapping relations between the field of SQL statement; The table level is analyzed submodule, is used to resolve the source table of SQL statement and the mapping relations between the object table.
SQL statement in 40 pairs of performance historyes of resolver is analyzed, set up table level and field mappings relation, generate corresponding metadata information and be stored in metadatabase, performance analysis device 20 is published on corresponding environment and the operation module by will produce the configuration key element to the issue of metadata, make that the metadata information maintenance can be in time synchronous with the actual production data, the content information unanimity, the manual maintenance workload of metadata reduces.
As shown in Figure 3, the metadata management system management method of the embodiment of the invention comprises:
A, extraction are developed the code that forms according to existing metadata in the metadatabase;
The mapping relations information of B, resolving code generates new metadata;
C, with new metadata store in metadatabase.
In the present embodiment, this code is a SQL statement.Wherein, step B specifically comprises: step b12, resolve the table level mapping relations information of described SQL statement; Step b14 sets up mapping relations between source table and the object table according to described table level mapping relations information, generates corresponding new metadata.Above-mentioned table level mapping relations are meant the mapping relations between source table and the object table, and the source table is the basic data set that object table forms, and the source table generates object table by certain field mappings, rule condition, transformation rule etc. according to certain SQL disposal route.
Step B also comprises: step b22, the field mappings relation information of parsing SQL statement; Step b24 sets up mapping relations between the field according to the field mappings relation information, generates corresponding new metadata.
In the present embodiment, resolver 40 can be Structured Query Language (SQL) (Structured QueryLanguage is called for short SQL) resolver.
The concrete operational process of SQL resolver is as follows in the present embodiment:
(1) as shown in Figure 4, input SQL statement;
(2) as shown in Figure 5, set up mutually deserved grammar database;
(3) as shown in Figure 6, the output result can select output table level relation or field level relation.
By the SQL resolver, as long as there is the place of SQL statement just can resolve the output field map information.Obtain the SQL statement of operation system every day, every month, with these SQL statement by the SQL resolver resolves complete after, just can set up the mapping relations of comprehensive table grade and/or field.The SQL resolver be can call in the process of program development or when reaching the standard grade and new procedures, newly-built table etc. and the table of storage or the relation of program built.For the SQL program, transform the original public function of carrying out SQL statement, make it when carrying out SQL statement, write down normalized more detailed logging simultaneously, resolve according to the SQL statement in the daily record again.
When setting up the demand development management, on the demand development platform, finish program development simultaneously by setting up SQL statement, to set up concerning between each table in the metadata automatically by the SQL resolver, when finishing etc. development process, relation is also just set up automatically between table.Solved the problem that original Mr. metadata management safeguards postpartum.An and unified demand development platform that also offers business personnel and the common maintenance and management of developer.
As shown in Figure 7, embodiment of the invention metadata management system is in concrete application process, obtain exploitation code from the development management platform, resolve back generator data storage in metadatabase, by issuing these metadata, can be published on corresponding environment and the operation module producing the configuration key element, make that the metadata information maintenance can be in time synchronous with the actual production data, the content information unanimity, the manual maintenance workload of metadata reduces.Wherein, the development management platform is a business platform, adopts the management of plug-in type, only the plug-in unit of functions of modules need be configured, and just can make development platform have function corresponding.
In the present embodiment, shown in the whole performance history table specific as follows:
In the demand performance history, can instruct, retrain the developer and how on existing metadata basis, constantly, reasonably create new metadata; Workflow control has guaranteed the standardization of performance history; Various developing instruments make the developer develop easily, guarantee the efficient and the quality of metadata output; By the issue means that provide will develop the output metadata be published to test environment, production environment finish test, on line process; By calculating assessment to the workload of the metadata type correspondence of output, make the development amount assess that more science is accurate, optimize and the cooperating of developer, communication, excitation, guiding.
Metadata management method of the present invention and management system can be so that metadata information be safeguarded and the actual production data can be in time synchronous, the content information unanimity, and the manual maintenance workload of metadata reduces; Improve metadata simultaneously and provide effect and value with producing to combine; And help quality management, flow monitoring and maintenance management in the demand performance history.
It should be noted that: above embodiment is only unrestricted in order to explanation the present invention, and the present invention also is not limited in above-mentioned giving an example, and all do not break away from the technical scheme and the improvement thereof of the spirit and scope of the present invention, and it all should be encompassed in the claim scope of the present invention.
Claims (8)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910131570A CN101859303A (en) | 2009-04-07 | 2009-04-07 | Metadata management method and management system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910131570A CN101859303A (en) | 2009-04-07 | 2009-04-07 | Metadata management method and management system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101859303A true CN101859303A (en) | 2010-10-13 |
Family
ID=42945219
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200910131570A Pending CN101859303A (en) | 2009-04-07 | 2009-04-07 | Metadata management method and management system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101859303A (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102289460A (en) * | 2011-07-13 | 2011-12-21 | 中国工商银行股份有限公司 | Method and system for performing report metadata synchronization on testing environments |
| CN102567430A (en) * | 2010-12-31 | 2012-07-11 | 中国移动通信集团湖北有限公司 | Method and device for graphical display of metadata relationship |
| CN103186541A (en) * | 2011-12-27 | 2013-07-03 | 阿里巴巴集团控股有限公司 | Generation method and device for mapping relationship |
| CN103902653A (en) * | 2014-02-28 | 2014-07-02 | 珠海多玩信息技术有限公司 | Method and device for creating data warehouse table blood relationship graph |
| CN103927323A (en) * | 2014-02-26 | 2014-07-16 | 浪潮软件股份有限公司 | Information system value domain data management method |
| WO2017097125A1 (en) * | 2015-12-07 | 2017-06-15 | 阿里巴巴集团控股有限公司 | Executive code generation method and device |
| CN107239968A (en) * | 2017-05-12 | 2017-10-10 | 浙江绿森数码科技有限公司 | A kind of data management system based on big data |
| CN107657052A (en) * | 2017-10-17 | 2018-02-02 | 上海计算机软件技术开发中心 | A kind of data governing system based on metadata management |
| CN109739893A (en) * | 2018-12-28 | 2019-05-10 | 上海连尚网络科技有限公司 | A kind of metadata management method, equipment and computer-readable medium |
| CN110807033A (en) * | 2019-10-12 | 2020-02-18 | 中思博安科技（北京）有限公司 | Data management method, device and system |
| CN111767266A (en) * | 2020-05-15 | 2020-10-13 | 杭州传化智能制造科技有限公司 | Entity relationship model design method, device, computer equipment and storage medium |
| CN112347124A (en) * | 2020-11-12 | 2021-02-09 | 浙江百应科技有限公司 | Metadata management platform and metadata management method |
| CN115794214A (en) * | 2023-02-09 | 2023-03-14 | 中邮消费金融有限公司 | Application module metadata management method, device, storage medium and device |
| CN117056312A (en) * | 2023-08-17 | 2023-11-14 | 安徽派偌汇科技咨询有限公司 | Quick development platform based on metadata model |
-
2009
- 2009-04-07 CN CN200910131570A patent/CN101859303A/en active Pending
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102567430A (en) * | 2010-12-31 | 2012-07-11 | 中国移动通信集团湖北有限公司 | Method and device for graphical display of metadata relationship |
| CN102567430B (en) * | 2010-12-31 | 2014-10-01 | 中国移动通信集团湖北有限公司 | Graphical display method and device for metadata relationship |
| CN102289460B (en) * | 2011-07-13 | 2013-03-27 | 中国工商银行股份有限公司 | Method and system for performing report metadata synchronization on testing environments |
| CN102289460A (en) * | 2011-07-13 | 2011-12-21 | 中国工商银行股份有限公司 | Method and system for performing report metadata synchronization on testing environments |
| CN103186541A (en) * | 2011-12-27 | 2013-07-03 | 阿里巴巴集团控股有限公司 | Generation method and device for mapping relationship |
| CN103186541B (en) * | 2011-12-27 | 2016-08-24 | 阿里巴巴集团控股有限公司 | A kind of mapping relations generate method and device |
| CN103927323A (en) * | 2014-02-26 | 2014-07-16 | 浪潮软件股份有限公司 | Information system value domain data management method |
| CN103902653B (en) * | 2014-02-28 | 2017-08-01 | 珠海多玩信息技术有限公司 | A kind of method and apparatus for building data warehouse table genetic connection figure |
| CN103902653A (en) * | 2014-02-28 | 2014-07-02 | 珠海多玩信息技术有限公司 | Method and device for creating data warehouse table blood relationship graph |
| WO2017097125A1 (en) * | 2015-12-07 | 2017-06-15 | 阿里巴巴集团控股有限公司 | Executive code generation method and device |
| CN107239968A (en) * | 2017-05-12 | 2017-10-10 | 浙江绿森数码科技有限公司 | A kind of data management system based on big data |
| CN107657052A (en) * | 2017-10-17 | 2018-02-02 | 上海计算机软件技术开发中心 | A kind of data governing system based on metadata management |
| CN109739893A (en) * | 2018-12-28 | 2019-05-10 | 上海连尚网络科技有限公司 | A kind of metadata management method, equipment and computer-readable medium |
| CN110807033A (en) * | 2019-10-12 | 2020-02-18 | 中思博安科技（北京）有限公司 | Data management method, device and system |
| CN111767266A (en) * | 2020-05-15 | 2020-10-13 | 杭州传化智能制造科技有限公司 | Entity relationship model design method, device, computer equipment and storage medium |
| CN112347124A (en) * | 2020-11-12 | 2021-02-09 | 浙江百应科技有限公司 | Metadata management platform and metadata management method |
| CN115794214A (en) * | 2023-02-09 | 2023-03-14 | 中邮消费金融有限公司 | Application module metadata management method, device, storage medium and device |
| CN117056312A (en) * | 2023-08-17 | 2023-11-14 | 安徽派偌汇科技咨询有限公司 | Quick development platform based on metadata model |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101859303A (en) | Metadata management method and management system | |
| Li | Transforming relational database into HBase: A case study | |
| CN111078729B (en) | Medical data tracing method, device, system, storage medium and electronic equipment | |
| CN109299074B (en) | Data verification method and system based on templated database view | |
| CN101699444B (en) | Ontology Construction Method of Remote Sensing Information Processing Service Classification Based on Formal Concept Analysis | |
| CN106469064A (en) | Code generating method and code generating unit | |
| CN104050161B (en) | Dynamic bridging of application and data servers | |
| US10924551B2 (en) | IRC-Infoid data standardization for use in a plurality of mobile applications | |
| CN105354036A (en) | Database operation code generating method and apparatus | |
| CN103186541A (en) | Generation method and device for mapping relationship | |
| CN102110102A (en) | Data processing method and device, and file identifying method and tool | |
| CN103294724A (en) | Method for managing database structures and system for method | |
| CN114116691B (en) | Data import verification method, system, device and computer readable medium | |
| CN103744651A (en) | Method for automatically generating business processing model oriented to business requirements | |
| CN106503019A (en) | A kind of method and apparatus for obtaining databases comparison information | |
| CN102122280A (en) | Method and system for intelligently extracting content object | |
| CN111061739A (en) | Method and device for warehousing massive medical data, electronic equipment and storage medium | |
| CN118939839A (en) | Data lineage full-link monitoring method, system, terminal and storage medium | |
| CN104156198A (en) | Method and device for automatically generating software integration version updating description | |
| CN116384333A (en) | Method and system for extracting and filling unstructured document data | |
| CN113486022B (en) | A data consistency verification method and related device | |
| CN120631915A (en) | An automated NL2SQL dataset construction method and system based on a large language model | |
| CN110647518B (en) | Data source fusion calculation method, component and device | |
| CN113792048B (en) | Form verification rule generation method and system for non-relational database | |
| CN117493575A (en) | Highway water transport engineering management method based on artificial intelligence and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20101013 |