CN109241358A - Metadata management method, device, computer equipment and storage medium - Google Patents
Metadata management method, device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN109241358A CN109241358A CN201810924937.6A CN201810924937A CN109241358A CN 109241358 A CN109241358 A CN 109241358A CN 201810924937 A CN201810924937 A CN 201810924937A CN 109241358 A CN109241358 A CN 109241358A
- Authority
- CN
- China
- Prior art keywords
- metadata
- access
- data
- information
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007726 management method Methods 0.000 title claims abstract description 72
- 238000012545 processing Methods 0.000 claims abstract description 40
- 238000000034 method Methods 0.000 claims abstract description 32
- 238000004590 computer program Methods 0.000 claims description 17
- 230000008676 import Effects 0.000 claims description 14
- 238000012217 deletion Methods 0.000 claims description 11
- 230000037430 deletion Effects 0.000 claims description 11
- 238000010586 diagram Methods 0.000 description 12
- 230000008569 process Effects 0.000 description 10
- 238000012544 monitoring process Methods 0.000 description 4
- 238000013500 data storage Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000013475 authorization Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000007418 data mining Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention discloses a kind of metadata management method, device, computer equipment and storage mediums.The described method includes: request of data is sent to data source, with the metadata imported in the data source；Corresponding label binding is carried out to the metadata according to preset rules；All tag types are obtained, corresponding access authority is respectively associated in different tag types；If receiving metadata access request, judge whether the metadata access request meets access authority；If metadata access request meets access authority, the access information of metadata is obtained and determined, the access information includes the content of the inquiry of metadata, calling, the time of inquiry, the content of inquiry, the time of calling and calling.Method by implementing the embodiment of the present invention such as can be imported to the metadata in database, mark, detect at the automatic management, reduce manual intervention, consequently facilitating user carries out data processing and analysis use.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a metadata management method and apparatus, a computer device, and a storage medium.
Background
With the reduction of computer hardware cost and the increase of data importance, a platform capable of supporting mass data storage and providing high-performance computation is increasingly required, and a large data platform mainly based on Hadoop comes along with the increase of data importance. On these platforms, various types of data, including structured, semi-structured, or even unstructured data, can be efficiently and conveniently processed to obtain hidden information therefrom. With the exponential increase of data volume, the importance of data management, such as importance of data, source flow of data, and management and control of confidential data, is increasing, so that metadata as data describing data is more concerned with management of metadata.
However, the existing metadata management tool of the open source community has a single function and different short boards and defects, for example, apache atlas (referred to as the open source metadata management tool) is an open source item generated by the Hadoop community for solving the metadata management problem of the Hadoop ecosystem, and provides metadata management core capability including data classification, a centralized policy engine, data blooding margin, security and life cycle management for the Hadoop cluster, but the problems that the change and use of metadata are difficult for a user, and the management efficiency of the metadata is not high are also caused.
Disclosure of Invention
The embodiment of the invention provides a metadata management method, a metadata management device, computer equipment and a storage medium, and aims to solve the problem of convenience for a user to manage, use and process metadata.
In a first aspect, an embodiment of the present invention provides a metadata management method, including:
sending a data request to a data source to import metadata in the data source;
performing corresponding label binding on the metadata according to a preset rule;
acquiring all tag types, and associating different tag types with corresponding access rights respectively;
if a metadata access request is received, judging whether the metadata access request accords with the access authority; and
and if the metadata access request accords with the access authority, acquiring and determining the access information of the metadata, wherein the access information comprises the query, the call, the query time, the query content, the call time and the call content of the metadata.
In a second aspect, an embodiment of the present invention further provides a metadata management apparatus, where an importing unit is configured to send a data request to a data source to import metadata in the data source;
the label binding unit is used for carrying out corresponding label binding on the metadata according to a preset rule;
the association unit is used for acquiring all the label types and associating different label types with corresponding access rights respectively;
the judging unit is used for judging whether the metadata access request accords with the access authority or not if the metadata access request is received;
and the determining unit is used for acquiring and determining the access information of the metadata if the metadata access request accords with the access authority, wherein the access information comprises the query, the call, the query time, the query content, the call time and the call content of the metadata.
In a third aspect, an embodiment of the present invention further provides a computer device, which includes a memory and a processor, where the memory stores a computer program, and the processor implements the above method when executing the computer program.
In a fourth aspect, an embodiment of the present invention further provides a storage medium, where the storage medium stores a computer program, and the computer program, when executed by a processor, can implement the above method.
The embodiment of the invention provides a metadata management method, a metadata management device, computer equipment and a storage medium. Wherein the method comprises the following steps: sending a data request to a data source to import metadata in the data source; performing corresponding label binding on the metadata according to a preset rule; acquiring all tag types, and associating different tag types with corresponding access rights respectively; if a metadata access request is received, judging whether the metadata access request accords with the access authority; and if the metadata access request accords with the access authority, acquiring and determining the access information of the metadata, wherein the access information comprises the query, the call, the query time, the query content, the call time and the call content of the metadata. The embodiment of the invention reduces manual intervention by automatically managing the metadata in the database such as importing, marking, detecting and the like, can improve line monitoring for increasing and deleting data related to the metadata, analyzes query and update sentences, and ensures that the monitoring granularity reaches the level of fields and files, thereby facilitating the use and processing of data by users.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flowchart of a metadata management method according to an embodiment of the present invention;
fig. 1a is a schematic view of an application scenario of a metadata management method according to an embodiment of the present invention;
FIG. 2 is a diagram illustrating a data storage relationship in an embodiment of the present invention;
FIG. 3 is a sub-flow diagram of a metadata management method according to an embodiment of the present invention;
FIG. 4 is a schematic sub-flow chart of a metadata management method according to an embodiment of the present invention;
FIG. 5 is a schematic sub-flow chart of a metadata management method according to an embodiment of the present invention;
FIG. 6 is a flowchart illustrating a metadata management method according to another embodiment of the present invention;
fig. 7 is a schematic block diagram of a metadata management apparatus provided by an embodiment of the present invention;
fig. 8 is a schematic block diagram of a tag binding unit of a metadata management apparatus according to an embodiment of the present invention;
fig. 9 is another schematic block diagram of a tag binding unit of a metadata management apparatus according to an embodiment of the present invention;
fig. 10 is another schematic block diagram of a tag binding unit of a metadata management apparatus according to an embodiment of the present invention;
fig. 11 is a schematic block diagram of a metadata management apparatus according to another embodiment of the present invention; and
FIG. 12 is a schematic block diagram of a computer device provided by an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It is also to be understood that the terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the specification of the present invention and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should be further understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
Referring to fig. 1 and fig. 1a, fig. 1 is a schematic flowchart of a metadata management method according to an embodiment of the present application, and fig. 1a is a schematic view of a scenario of the metadata management method according to the embodiment of the present application. The life insurance reporting method is applied to the management server 10. The management server 10 may import the metadata from the terminal 20 according to the life insurance reporting method, and correspondingly manage the metadata. In general, the terminal 20 is provided with a metadata source, and is capable of transmitting metadata in the metadata source to the management server 10 after receiving a data request transmitted from the management server 10. The respective steps of the metadata management method will be described in detail below from the perspective of the management server 10.
Fig. 1 is a flowchart illustrating a metadata management method according to an embodiment of the present invention. As shown, the method includes the following steps S101-S105.
S101, sending a data request to a data source to import metadata in the data source.
In this embodiment, the data source is a source of metadata, which may be a database, and the database may be a traditional relational database or a non-relational database in a big data platform, or may be a database in a terminal, that is, the data source is stored in the terminal.
As shown in fig. 2, in general, only the related database and table are stored in the data storage, and only the database name and the table name are correspondingly stored in the metadata storage. In order to facilitate the management and use of the data in the database, the management of the data in the database can be realized by managing the metadata, and the management efficiency and quality of the data are greatly improved.
Generally, in order to manage the metadata in the database accordingly, a data request may be sent to the database, that is, to a data source of a terminal. Generally, according to the data request, metadata can be extracted and transmitted through a plug-in or a process for extracting metadata arranged in a data source, so that the metadata transmitted by the plug-in or the process can be received and imported.
For example, the open source metadata management tool apache Atlas (hereinafter Atlas) as a plug-in for extracting metadata can support integration with many data sources and can capture and import metadata in bulk in real time by Bridge. Atlas operates only on the metadata layer and does not operate directly on the data layer. The Bridge (Bridge) mainly realizes metadata acquisition through Hook mechanisms in respective processes of storage and calculation engines, such as Post execution hooks (Post execution Hook) of a data warehouse tool (Hive SQL), coprocessors (coprocessors) of an open source non-relational distributed database (HBase), Topology job submission (Topology submit) of a data stream processing system (Storm), and the like; the metadata collected by Bridge is transmitted to Atlas or other subscribers (Ranger) for management through a message queue in the open source streaming platform (Kafka).
And S102, performing corresponding label binding on the metadata according to a preset rule.
In this embodiment, when the data source is a database, the database name of the database is corresponding metadata, in general, the database may include a plurality of tables, at this time, the table name of each table is also corresponding metadata, and the preset rule refers to performing corresponding tag binding on the metadata according to the related attribute of the metadata. For example, the tag binding may be performed according to the data source of the metadata, or may be performed according to the technical use of the metadata. After the label is bound, a user can conveniently retrieve and check the label.
In an embodiment, as shown in fig. 3, the step S102 may include the following steps:
step S201, obtaining and analyzing the attribute information of the metadata.
In this embodiment, the attribute information of the metadata refers to the related feature information of the metadata. In general, source information related to the metadata can also be imported in the import process of the metadata.
Step S202, if the attribute information includes source information of the metadata, performing preset technical label binding on the metadata according to the source information of the metadata.
In this embodiment, the source information of the metadata refers to information of a table, a database, and the like related to the metadata. In order to facilitate management of metadata and further understand changes of data of corresponding tables and databases, source information needs to be determined, and preset technical label binding can be performed on the metadata according to the source information, so that metadata with the same source information can be classified and managed uniformly.
For example, when metadata is imported from a channel a, the channel a is source information of the metadata, and the metadata is bound with a corresponding preset X tag according to the source information; when another metadata is imported from the channel B, the channel B is the source information of the another metadata, and the another metadata is bound with a corresponding preset Y label according to the source information at the moment, so that the technical label can be correspondingly bound according to a database or a table corresponding to the metadata and the preset technical label.
In another embodiment, as shown in fig. 4, the step S102 may include the steps of:
step S301, obtains and analyzes attribute information of the metadata.
In this embodiment, the attribute information of the metadata refers to relevant characteristic information of the metadata, and a field type of data described by the metadata may also be imported in the import process of the metadata.
Step S302, if the attribute information includes the field type of the data described by the metadata, performing preset type tag binding on the metadata according to the field type of the data described by the metadata.
In the present embodiment, the field type of the data is also a data type, which may include a number, a date and time, a character string, and the like. Generally, the metadata can be classified according to the field type of the data described by the metadata, and corresponding preset type tags are bound, wherein different field types are preset with different type tags. For example, when the field type of the data described by the metadata is a number, a preset first type tag may be bound to the corresponding metadata; when the field type of the data described by the metadata is date and time, a preset second type tag can be bound to the corresponding metadata; when the field type of the data described by the metadata is a character string, a preset third type tag may be bound to the corresponding metadata.
In another embodiment, as shown in fig. 5, the step S102 may include the steps of:
step S401, acquiring and analyzing attribute information of the metadata.
In this embodiment, the attribute information of the metadata refers to the related feature information of the metadata. In general, source information related to the metadata can also be imported in the import process of the metadata.
Step S402, according to the preset service usage rule, the corresponding metadata is bound with the preset technical label.
In this embodiment, the user may perform corresponding processing on different metadata according to the need of the user, for example, data mining or data analysis may be performed according to different metadata. The preset service usage rule refers to presetting service usage of a certain metadata, each service usage corresponds to a preset technical label, and if the imported metadata is the certain metadata, binding the imported metadata with the corresponding preset technical label.
For example, as shown in table one.
| Number learning | Name (I) | Mathematical achievement |
| 1001 | Zhang three | 98 |
Watch 1
The imported metadata is table names such as a school number, a name and a mathematic score, the preset business application rule is to perform data analysis on the mathematic score, the preset technical label corresponding to the data distraction is a first technical label, and the first technical label is bound to the metadata of the mathematic score when the data score is imported.
S103, all the label types are obtained, and different label types are respectively associated with corresponding access rights.
In this embodiment, after the corresponding tag binding is performed on different metadata, the current tag type may be counted, and corresponding access rights may be associated with different tag types according to the needs of the user. The access authority means that a certain label is set to be only accessible by a certain user name or account. For example, when metadata is imported from the channel a, the metadata is bound with a corresponding preset X tag, and at this time, it may be set that the metadata bound with the X flag is only accessible by a certain user, for example, in an insurance system, the metadata bound with the X flag is only accessible by a salesperson or a system administrator, and the insurance user is restricted from accessing.
Therefore, a lot of convenience can be provided for the access authority by controlling the tags associated with the metadata instead of the metadata, especially Atlas can be used with range, range is allowed to perform dynamic authorization management work on the metadata in the form of user-defined tags in Atlas, and compared with a way of performing static authorization in the form of path-based or table name/file name, the way based on tags can sometimes more flexibly process the authority management work in some specific scenarios.
S104, if the metadata access request is received, judging whether the metadata access request accords with the access authority.
In this embodiment, the metadata access request includes access information, where the access information may include a user name or an account number, and if the user name or the account number conforms to the access authority, it indicates that the metadata access request conforms to the access authority, the user name or the account number may access the metadata under the tag associated with the access authority, and if not, the metadata access request is rejected.
Therefore, according to the preset authority control model, the access to the metadata corresponding to the label type associated with the preset authority control model is controlled, the security of metadata access can be ensured, the privacy of a user can be ensured, and the management of the metadata is more accurate.
And S105, if the metadata access request accords with the access authority, acquiring and determining the access information of the metadata, wherein the access information comprises the query, the call, the query time, the query content, the call time and the call content of the metadata.
In this embodiment, in order to facilitate management of metadata, if metadata is accessed, access information of the corresponding metadata needs to be activated, and generally, the access information of the metadata may include query and call of the metadata. In order to analyze the performance of the metadata, the time and specific content of the query of the metadata and the time and specific content of the invoked metadata need to be recorded.
Fig. 6 is a flowchart illustrating a metadata management method according to another embodiment of the present invention. As shown in fig. 6, the metadata management method of the present embodiment includes steps S501 to S507. Steps S501 to S505 are similar to steps S101 to S105 in the above embodiments, and are not described herein again. The added steps S506 to S507 in the present embodiment are explained in detail below.
Further, the method further comprises:
step S506, if data update information is received, generating corresponding metadata processing information according to the update information, where the metadata processing information includes a processing mode, a processing time, and a processing content.
In this embodiment, the data update information refers to that data in a database or a table changes, for example, the data is added, deleted, modified, and the like, and at this time, corresponding metadata processing information may be generated according to the received update information, so that the corresponding metadata is processed. The metadata processing information may be a processing manner of data change and a processing time and content, for example, the processing manner may include adding, deleting, modifying, and the like, and the processing time and content are the time and content of adding, deleting, modifying, and the like, so that a user can conveniently view the processing manner and further manage the metadata.
Further, the method further comprises:
step S507, if a metadata identification instruction or a deletion instruction is received, the identification instruction or the deletion instruction is analyzed to identify corresponding metadata or delete corresponding metadata.
In this embodiment, the user can adjust the metadata according to the needs of the user, so that the content of the metadata is more accurate. Therefore, if a metadata mark instruction or a deleting instruction is received, corresponding metadata can be identified or deleted by analyzing the identification instruction or the deleting instruction, so that the comprehensive management of the metadata is improved, and omission and misjudgment are reduced.
In summary, in the embodiment, by automatically managing the metadata in the database, such as importing, marking, detecting, and the like, manual intervention is reduced, and the monitoring of the increase and deletion of data related to the metadata can be improved, and the query and update statements are analyzed, and the monitoring granularity reaches the field and file level, so that the user can use and process the data conveniently.
Fig. 7 is a schematic block diagram of a metadata management apparatus according to an embodiment of the present invention. As shown in fig. 5, the present invention also provides a metadata management apparatus corresponding to the above metadata management method. The metadata management device comprises a unit for executing the metadata management method, and the device can be configured in a desktop computer, a tablet computer, a portable computer and other terminals. Specifically, referring to fig. 7, the metadata management apparatus 100 includes an importing unit 101, a tag binding unit 102, an associating unit 103, a judging unit 104, and a determining unit 105.
The importing unit 101 is configured to send a data request to a data source to import metadata in the data source.
The tag binding unit 102 is configured to perform corresponding tag binding on the metadata according to a preset rule.
In one embodiment, as shown in fig. 8, the tag binding unit 102 may include the following units: a parsing unit 201 and a first binding unit 202.
The parsing unit 201 is configured to obtain and parse attribute information of the metadata.
The first binding unit 202 is configured to, if the attribute information includes source information of metadata, perform preset technical label binding on the metadata according to the source information of the metadata.
In another embodiment, as shown in fig. 9, the tag binding unit 102 may include a parsing unit 301 and a second binding unit 302. Wherein,
the parsing unit 301 is configured to obtain and parse attribute information of the metadata.
The second binding unit 302 is configured to, if the attribute information includes a field type of data described by the metadata, perform preset type tag binding on the metadata according to the field type of the data described by the metadata.
In another embodiment, as shown in fig. 10, the tag binding unit 102 may include a parsing unit 401 and a third binding unit 402.
The parsing unit 401 is configured to obtain and parse attribute information of the metadata.
The third binding unit 402 is configured to perform preset technical label binding on corresponding metadata according to a preset service usage rule.
The associating unit 103 is configured to obtain all tag types, and associate different tag types with corresponding access rights, respectively.
The determining unit 104 is configured to determine whether the metadata access request meets the access right if the metadata access request is received.
The determining unit 105 is configured to obtain and determine access information of the metadata if the metadata access request conforms to the access right, where the access information includes a query, a call, a query time, query content, a call time, and call content of the metadata.
Fig. 11 is a schematic block diagram of a metadata management apparatus according to another embodiment of the present invention. As shown in fig. 11, the metadata management apparatus 500 of the present embodiment mainly includes: an importing unit 501, a label binding unit 502, an associating unit 503, a judging unit 504, a determining unit 505, a processing unit 506, and an adjusting unit 507. The importing unit 501, the tag binding unit 502, the associating unit 503, the determining unit 504, and the determining unit 505 are similar to the corresponding units in the above embodiments, and are not described herein again. The processing unit 506 and the adjusting unit 507 added in the present embodiment are described in detail below.
The processing unit 506 is configured to generate corresponding metadata processing information according to the update information if data update information is received, where the metadata processing information includes a processing mode, processing time, and content.
The adjusting unit 507 is configured to, if a metadata identification instruction or a deletion instruction is received, parse the identification instruction or the deletion instruction to identify corresponding metadata or delete corresponding metadata.
It should be noted that, as can be clearly understood by those skilled in the art, the specific implementation processes of the metadata management apparatus and each unit may refer to the corresponding descriptions in the foregoing method embodiments, and for convenience and brevity of description, no further description is provided herein.
The above-described metadata management apparatus may be implemented in the form of a computer program that can be run on a computer device as shown in fig. 12.
Referring to fig. 12, fig. 12 is a schematic block diagram of a computer device according to an embodiment of the present application. The computer device 600 may be a terminal or a server, where the terminal may be an electronic device with a communication function, such as a smart phone, a tablet computer, a notebook computer, a desktop computer, a personal digital assistant, and a wearable device. The server may be an independent server or a server cluster composed of a plurality of servers.
Referring to fig. 12, the computer device 600 includes a processor 602, memory, and a network interface 605 connected by a system bus 601, where the memory may include a non-volatile storage medium 603 and an internal memory 604.
The non-volatile storage medium 603 may store an operating system 6031 and computer programs 6032. The computer program 6032 includes program instructions that, when executed, may cause the processor 602 to perform a method of metadata management.
The processor 602 is used to provide computing and control capabilities to support the operation of the overall computer device 600.
The internal memory 604 provides an environment for the execution of a computer program 6032 on the non-volatile storage medium 603, which computer program 6032, when executed by the processor 602, causes the processor 602 to perform a method of metadata management.
The network interface 605 is used for network communication with other devices. Those skilled in the art will appreciate that the architecture shown in fig. 12 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing device 600 to which the disclosed aspects apply, as a particular computing device 600 may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
Wherein the processor 602 is configured to execute the computer program 6032 stored in the memory to perform the steps of: sending a data request to a data source to import metadata in the data source; performing corresponding label binding on the metadata according to a preset rule; acquiring all tag types, and associating different tag types with corresponding access rights respectively; if a metadata access request is received, judging whether the metadata access request accords with the access authority; and if the metadata access request accords with the access authority, acquiring and determining the access information of the metadata, wherein the access information comprises the query, the call, the query time, the query content, the call time and the call content of the metadata.
In an embodiment, the processor 602 further implements the steps of: and if data updating information is received, generating corresponding metadata processing information according to the updating information, wherein the metadata processing information comprises a processing mode, processing time and content.
In an embodiment, the processor 602 further implements the steps of: and if a metadata identification instruction or a deletion instruction is received, analyzing the identification instruction or the deletion instruction to identify corresponding metadata or delete the corresponding metadata.
In an embodiment, when implementing the step of performing corresponding tag binding on the metadata according to the preset rule, the processor 602 specifically implements the following steps: acquiring and analyzing attribute information of the metadata; and if the attribute information comprises the source information of the metadata, performing preset technical label binding on the metadata according to the source information of the metadata.
In an embodiment, before implementing the step of performing corresponding tag binding on the metadata according to the preset rule, the processor 602 further implements the following steps: acquiring and analyzing attribute information of the metadata; and if the attribute information comprises the field type of the data described by the metadata, performing preset type label binding on the metadata according to the field type of the data described by the metadata.
In an embodiment, after implementing the step of performing corresponding tag binding on the metadata according to the preset rule, the processor 602 further implements the following steps: acquiring and analyzing attribute information of the metadata; and performing preset technical label binding on corresponding metadata according to a preset service use rule.
It should be understood that, in the embodiment of the present Application, the Processor 602 may be a Central Processing Unit (CPU), and the Processor 602 may also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field-Programmable gate arrays (FPGAs) or other Programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and the like. Wherein a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
It will be understood by those skilled in the art that all or part of the flow of the method implementing the above embodiments may be implemented by a computer program instructing associated hardware. The computer program may be stored in a storage medium, which is a computer-readable storage medium. The computer program is executed by at least one processor in the computer system to implement the flow steps of the embodiments of the method described above.
Accordingly, the present invention also provides a storage medium. The storage medium may be a computer-readable storage medium. The storage medium stores a computer program that, when executed by a processor, causes the processor to perform the steps of: sending a data request to a data source to import metadata in the data source; performing corresponding label binding on the metadata according to a preset rule; acquiring all tag types, and associating different tag types with corresponding access rights respectively; if a metadata access request is received, judging whether the metadata access request accords with the access authority; and if the metadata access request accords with the access authority, acquiring and determining the access information of the metadata, wherein the access information comprises the query, the call, the query time, the query content, the call time and the call content of the metadata.
In one embodiment, the processor, when executing the program instructions, performs the steps of: and if data updating information is received, generating corresponding metadata processing information according to the updating information, wherein the metadata processing information comprises a processing mode, processing time and content.
In one embodiment, the processor, when executing the program instructions, performs the steps of: and if a metadata identification instruction or a deletion instruction is received, analyzing the identification instruction or the deletion instruction to identify corresponding metadata or delete the corresponding metadata.
In an embodiment, when the processor executes the program instruction to implement the step of performing the corresponding tag binding on the metadata according to the preset rule, the following steps are specifically implemented: acquiring and analyzing attribute information of the metadata; and if the attribute information comprises the source information of the metadata, performing preset technical label binding on the metadata according to the source information of the metadata.
In an embodiment, before the step of performing the corresponding tag binding on the metadata according to the preset rule by executing the program instructions, the processor further performs the following steps: acquiring and analyzing attribute information of the metadata; and if the attribute information comprises the field type of the data described by the metadata, performing preset type label binding on the metadata according to the field type of the data described by the metadata.
In an embodiment, after the processor executes the program instructions to implement the step of performing the corresponding tag binding on the metadata according to the preset rule, the processor further implements the following steps: acquiring and analyzing attribute information of the metadata; and performing preset technical label binding on corresponding metadata according to a preset service use rule.
The storage medium may be a usb disk, a removable hard disk, a Read-Only Memory (ROM), a magnetic disk, or an optical disk, which can store various computer readable storage media.
Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the examples described in connection with the embodiments disclosed herein may be embodied in electronic hardware, computer software, or combinations of both, and that the components and steps of the examples have been described in a functional general in the foregoing description for the purpose of illustrating clearly the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative. For example, the division of each unit is only one logic function division, and there may be another division manner in actual implementation. For example, various elements or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented.
The steps in the method of the embodiment of the invention can be sequentially adjusted, combined and deleted according to actual needs. The units in the device of the embodiment of the invention can be merged, divided and deleted according to actual needs. In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a storage medium. Based on such understanding, the technical solution of the present invention essentially or partially contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a terminal, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention.
While the invention has been described with reference to specific embodiments, the invention is not limited thereto, and various equivalent modifications and substitutions can be easily made by those skilled in the art within the technical scope of the invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. A metadata management method, comprising:
sending a data request to a data source to import metadata in the data source;
performing corresponding label binding on the metadata according to a preset rule;
acquiring all tag types, and associating different tag types with corresponding access rights respectively;
if a metadata access request is received, judging whether the metadata access request accords with the access authority; and
and if the metadata access request accords with the access authority, acquiring and determining the access information of the metadata, wherein the access information comprises the query, the call, the query time, the query content, the call time and the call content of the metadata.
2. The metadata management method according to claim 1, characterized in that the method further comprises:
and if data updating information is received, generating corresponding metadata processing information according to the updating information, wherein the metadata processing information comprises a processing mode, processing time and content.
3. The metadata management method according to claim 1, characterized in that the method further comprises:
and if a metadata identification instruction or a deletion instruction is received, analyzing the identification instruction or the deletion instruction to identify corresponding metadata or delete the corresponding metadata.
4. The metadata management method according to claim 1, wherein the performing the corresponding tag binding on the metadata according to the preset rule comprises:
acquiring and analyzing attribute information of the metadata;
and if the attribute information comprises the source information of the metadata, performing preset technical label binding on the metadata according to the source information of the metadata.
5. The metadata management method according to claim 1, wherein the performing the corresponding tag binding on the metadata according to the preset rule comprises:
acquiring and analyzing attribute information of the metadata;
and if the attribute information comprises the field type of the data described by the metadata, performing preset type label binding on the metadata according to the field type of the data described by the metadata.
6. The metadata management method according to claim 1, wherein the performing the corresponding tag binding on the metadata according to the preset rule comprises:
acquiring and analyzing attribute information of the metadata;
and performing preset technical label binding on corresponding metadata according to a preset service use rule.
7. A metadata management apparatus, characterized by comprising:
the data importing device comprises an importing unit, a processing unit and a processing unit, wherein the importing unit is used for sending a data request to a data source so as to import metadata in the data source;
the label binding unit is used for carrying out corresponding label binding on the metadata according to a preset rule;
the association unit is used for acquiring all the label types and associating different label types with corresponding access rights respectively;
the judging unit is used for judging whether the metadata access request accords with the access authority or not if the metadata access request is received;
and the determining unit is used for acquiring and determining the access information of the metadata if the metadata access request accords with the access authority, wherein the access information comprises the query, the call, the query time, the query content, the call time and the call content of the metadata.
8. The metadata management apparatus of claim 7, wherein the apparatus further comprises:
the analysis unit is used for acquiring and analyzing the attribute information of the metadata;
and the binding unit is used for binding the metadata with a preset technical label according to the source information of the metadata if the attribute information comprises the source information of the metadata.
9. A computer device, comprising a memory and a processor coupled to the memory; the memory is used for storing a computer program; the processor is configured to execute a computer program stored in the memory to perform the method of any one of claims 1-6.
10. A storage medium, characterized in that the storage medium stores a computer program which, when executed by a processor, causes the processor to carry out the method according to any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810924937.6A CN109241358A (en) | 2018-08-14 | 2018-08-14 | Metadata management method, device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810924937.6A CN109241358A (en) | 2018-08-14 | 2018-08-14 | Metadata management method, device, computer equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109241358A true CN109241358A (en) | 2019-01-18 |
Family
ID=65071354
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810924937.6A Pending CN109241358A (en) | 2018-08-14 | 2018-08-14 | Metadata management method, device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109241358A (en) |
Cited By (36)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109815219A (en) * | 2019-02-18 | 2019-05-28 | 国家计算机网络与信息安全管理中心 | Support the implementation method of the Data lifecycle management of multiple database engine |
| CN110018845A (en) * | 2019-04-16 | 2019-07-16 | 成都四方伟业软件股份有限公司 | Metadata version control methods and device |
| CN110096518A (en) * | 2019-04-04 | 2019-08-06 | 华东理工大学 | Knowledge base metadata sending method and device, readable storage medium storing program for executing |
| CN110795387A (en) * | 2019-09-26 | 2020-02-14 | 广州市玄武无线科技股份有限公司 | Data import method, data export method, device and data processing system |
| CN110879799A (en) * | 2019-11-15 | 2020-03-13 | 北京明略软件系统有限公司 | Method and apparatus for managing technical metadata |
| CN110928979A (en) * | 2019-11-11 | 2020-03-27 | 北京明略软件系统有限公司 | Method and apparatus for managing technical metadata |
| CN110968592A (en) * | 2019-12-06 | 2020-04-07 | 深圳前海环融联易信息科技服务有限公司 | Metadata acquisition method and device, computer equipment and computer-readable storage medium |
| CN111064718A (en) * | 2019-12-09 | 2020-04-24 | 国网河北省电力有限公司信息通信分公司 | A dynamic authorization method and system based on user context and policy |
| CN111124394A (en) * | 2019-11-26 | 2020-05-08 | 泰康保险集团股份有限公司 | Form configuration method and device based on metadata, equipment and medium |
| CN111159509A (en) * | 2019-12-31 | 2020-05-15 | 深圳云天励飞技术有限公司 | Data processing methods and related products |
| CN111522840A (en) * | 2020-04-27 | 2020-08-11 | 平安科技（深圳）有限公司 | Label configuration method, device, equipment and computer readable storage medium |
| CN111666186A (en) * | 2020-04-26 | 2020-09-15 | 杭州数梦工场科技有限公司 | Data access abnormity detection method and device, storage medium and computer equipment |
| CN111680030A (en) * | 2019-03-11 | 2020-09-18 | 阿里巴巴集团控股有限公司 | Data fusion method and device, data processing method and device based on meta-information |
| CN111858584A (en) * | 2020-06-22 | 2020-10-30 | 中国平安财产保险股份有限公司 | Metadata management method, system and storage medium |
| CN112016116A (en) * | 2019-05-30 | 2020-12-01 | 阿里巴巴集团控股有限公司 | Data management and access method, device, electronic equipment and readable storage medium |
| CN112069148A (en) * | 2019-06-10 | 2020-12-11 | 贵阳海信网络科技有限公司 | Scenic spot data access method and device |
| CN112100661A (en) * | 2020-09-16 | 2020-12-18 | 深圳集智数字科技有限公司 | Data processing method and device |
| CN112395287A (en) * | 2019-08-19 | 2021-02-23 | 北京国双科技有限公司 | Table classification method, table creation method, device, equipment and medium |
| CN112433888A (en) * | 2020-12-02 | 2021-03-02 | 网易（杭州）网络有限公司 | Data processing method and device, storage medium and electronic equipment |
| CN112506895A (en) * | 2020-12-17 | 2021-03-16 | 成都四方伟业软件股份有限公司 | Control method and device based on row-column-level authority of data table |
| CN112597510A (en) * | 2020-12-16 | 2021-04-02 | 中国工商银行股份有限公司 | Access control method and device |
| CN112596806A (en) * | 2020-12-04 | 2021-04-02 | 光大科技有限公司 | Data lake data loading script generation method and system |
| CN113297139A (en) * | 2021-04-28 | 2021-08-24 | 上海淇玥信息技术有限公司 | Metadata query method and system and electronic equipment |
| CN113360800A (en) * | 2021-06-03 | 2021-09-07 | 深圳红途科技有限公司 | Method and device for processing featureless data, computer equipment and storage medium |
| CN113392076A (en) * | 2021-07-08 | 2021-09-14 | 网银在线（北京）科技有限公司 | Method, device, electronic equipment and medium for acquiring metadata quality information |
| CN113778831A (en) * | 2021-09-27 | 2021-12-10 | 广州文远知行科技有限公司 | Data application performance analysis method, device, equipment and medium |
| CN113806366A (en) * | 2021-09-07 | 2021-12-17 | 浪潮云信息技术股份公司 | Atlas-based method for realizing multidimensional metadata joint query |
| CN114254081A (en) * | 2021-12-22 | 2022-03-29 | 中冶赛迪重庆信息技术有限公司 | Enterprise big data search system and method and electronic equipment |
| CN114356898A (en) * | 2021-11-22 | 2022-04-15 | 青岛海尔科技有限公司 | Data storage method and device, electronic equipment and storage medium |
| CN115186020A (en) * | 2022-07-15 | 2022-10-14 | 深圳安巽科技有限公司 | A data access storage processing method, system and storage medium |
| CN115481439A (en) * | 2022-09-21 | 2022-12-16 | 航天信息股份有限公司 | Data processing method and device, electronic equipment and computer storage medium |
| CN115510121A (en) * | 2022-10-08 | 2022-12-23 | 上海数禾信息科技有限公司 | Method, device and equipment for managing business form data and readable storage medium |
| CN115757526A (en) * | 2022-12-02 | 2023-03-07 | 广州市玄武无线科技股份有限公司 | Metadata management method, device, equipment and computer storage medium |
| CN117746999A (en) * | 2024-02-20 | 2024-03-22 | 之江实验室 | Data processing method and device, storage medium and electronic equipment |
| CN118349557A (en) * | 2024-04-17 | 2024-07-16 | 北京东方通科技股份有限公司 | A method for synchronously identifying industrial data identifiers during lineage update |
| CN118503505A (en) * | 2024-05-20 | 2024-08-16 | 中信出版集团股份有限公司 | Book database construction method and system based on metadata management |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103078859A (en) * | 2012-12-31 | 2013-05-01 | 普天新能源有限责任公司 | Service system authority management method, equipment and system |
| US20140096265A1 (en) * | 2012-09-28 | 2014-04-03 | M-Files Oy | Method and a technical equipment for controlling metadata access |
| CN105912949A (en) * | 2016-04-13 | 2016-08-31 | 北京京东尚科信息技术有限公司 | Data permission management method, data permission management system and service management system |
| CN107153701A (en) * | 2017-05-10 | 2017-09-12 | 焦点科技股份有限公司 | A kind of IT system management and method for managing and monitoring based on metadata |
| CN107729394A (en) * | 2017-09-20 | 2018-02-23 | 北京京东尚科信息技术有限公司 | Data Mart management system and its application method based on Hadoop clusters |
-
2018
- 2018-08-14 CN CN201810924937.6A patent/CN109241358A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140096265A1 (en) * | 2012-09-28 | 2014-04-03 | M-Files Oy | Method and a technical equipment for controlling metadata access |
| CN103078859A (en) * | 2012-12-31 | 2013-05-01 | 普天新能源有限责任公司 | Service system authority management method, equipment and system |
| CN105912949A (en) * | 2016-04-13 | 2016-08-31 | 北京京东尚科信息技术有限公司 | Data permission management method, data permission management system and service management system |
| CN107153701A (en) * | 2017-05-10 | 2017-09-12 | 焦点科技股份有限公司 | A kind of IT system management and method for managing and monitoring based on metadata |
| CN107729394A (en) * | 2017-09-20 | 2018-02-23 | 北京京东尚科信息技术有限公司 | Data Mart management system and its application method based on Hadoop clusters |
Cited By (55)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109815219A (en) * | 2019-02-18 | 2019-05-28 | 国家计算机网络与信息安全管理中心 | Support the implementation method of the Data lifecycle management of multiple database engine |
| CN111680030A (en) * | 2019-03-11 | 2020-09-18 | 阿里巴巴集团控股有限公司 | Data fusion method and device, data processing method and device based on meta-information |
| CN110096518A (en) * | 2019-04-04 | 2019-08-06 | 华东理工大学 | Knowledge base metadata sending method and device, readable storage medium storing program for executing |
| CN110018845A (en) * | 2019-04-16 | 2019-07-16 | 成都四方伟业软件股份有限公司 | Metadata version control methods and device |
| CN112016116A (en) * | 2019-05-30 | 2020-12-01 | 阿里巴巴集团控股有限公司 | Data management and access method, device, electronic equipment and readable storage medium |
| CN112016116B (en) * | 2019-05-30 | 2025-08-19 | 阿里巴巴集团控股有限公司 | Data management and access method, device, electronic equipment and readable storage medium |
| CN112069148A (en) * | 2019-06-10 | 2020-12-11 | 贵阳海信网络科技有限公司 | Scenic spot data access method and device |
| CN112395287A (en) * | 2019-08-19 | 2021-02-23 | 北京国双科技有限公司 | Table classification method, table creation method, device, equipment and medium |
| CN110795387B (en) * | 2019-09-26 | 2020-11-03 | 广州市玄武无线科技股份有限公司 | Data import method, data export device and data processing system |
| CN110795387A (en) * | 2019-09-26 | 2020-02-14 | 广州市玄武无线科技股份有限公司 | Data import method, data export method, device and data processing system |
| CN110928979B (en) * | 2019-11-11 | 2022-12-20 | 北京明略软件系统有限公司 | Method and apparatus for managing technical metadata |
| CN110928979A (en) * | 2019-11-11 | 2020-03-27 | 北京明略软件系统有限公司 | Method and apparatus for managing technical metadata |
| CN110879799B (en) * | 2019-11-15 | 2023-04-07 | 北京明略软件系统有限公司 | Method and device for labeling technical metadata |
| CN110879799A (en) * | 2019-11-15 | 2020-03-13 | 北京明略软件系统有限公司 | Method and apparatus for managing technical metadata |
| CN111124394A (en) * | 2019-11-26 | 2020-05-08 | 泰康保险集团股份有限公司 | Form configuration method and device based on metadata, equipment and medium |
| CN110968592B (en) * | 2019-12-06 | 2023-11-21 | 深圳前海环融联易信息科技服务有限公司 | Metadata acquisition method, metadata acquisition device, computer equipment and computer readable storage medium |
| CN110968592A (en) * | 2019-12-06 | 2020-04-07 | 深圳前海环融联易信息科技服务有限公司 | Metadata acquisition method and device, computer equipment and computer-readable storage medium |
| CN111064718A (en) * | 2019-12-09 | 2020-04-24 | 国网河北省电力有限公司信息通信分公司 | A dynamic authorization method and system based on user context and policy |
| CN111159509A (en) * | 2019-12-31 | 2020-05-15 | 深圳云天励飞技术有限公司 | Data processing methods and related products |
| CN111159509B (en) * | 2019-12-31 | 2023-06-09 | 深圳云天励飞技术有限公司 | Data processing method and related product |
| CN111666186B (en) * | 2020-04-26 | 2023-09-15 | 杭州数梦工场科技有限公司 | Method and device for detecting data access abnormality, storage medium and computer equipment |
| CN111666186A (en) * | 2020-04-26 | 2020-09-15 | 杭州数梦工场科技有限公司 | Data access abnormity detection method and device, storage medium and computer equipment |
| CN111522840B (en) * | 2020-04-27 | 2023-08-11 | 平安科技（深圳）有限公司 | Label configuration method, device, equipment and computer readable storage medium |
| CN111522840A (en) * | 2020-04-27 | 2020-08-11 | 平安科技（深圳）有限公司 | Label configuration method, device, equipment and computer readable storage medium |
| CN111858584A (en) * | 2020-06-22 | 2020-10-30 | 中国平安财产保险股份有限公司 | Metadata management method, system and storage medium |
| CN112100661B (en) * | 2020-09-16 | 2024-03-12 | 深圳集智数字科技有限公司 | Data processing method and device |
| CN112100661A (en) * | 2020-09-16 | 2020-12-18 | 深圳集智数字科技有限公司 | Data processing method and device |
| CN112433888A (en) * | 2020-12-02 | 2021-03-02 | 网易（杭州）网络有限公司 | Data processing method and device, storage medium and electronic equipment |
| CN112433888B (en) * | 2020-12-02 | 2023-06-30 | 网易（杭州）网络有限公司 | Data processing method and device, storage medium and electronic equipment |
| CN112596806A (en) * | 2020-12-04 | 2021-04-02 | 光大科技有限公司 | Data lake data loading script generation method and system |
| CN112597510B (en) * | 2020-12-16 | 2024-01-30 | 中国工商银行股份有限公司 | Access control method and device |
| CN112597510A (en) * | 2020-12-16 | 2021-04-02 | 中国工商银行股份有限公司 | Access control method and device |
| CN112506895A (en) * | 2020-12-17 | 2021-03-16 | 成都四方伟业软件股份有限公司 | Control method and device based on row-column-level authority of data table |
| CN113297139A (en) * | 2021-04-28 | 2021-08-24 | 上海淇玥信息技术有限公司 | Metadata query method and system and electronic equipment |
| CN113297139B (en) * | 2021-04-28 | 2024-08-16 | 上海淇玥信息技术有限公司 | Metadata query method and system and electronic equipment |
| CN113360800B (en) * | 2021-06-03 | 2025-04-01 | 深圳红途科技有限公司 | Featureless data processing method, device, computer equipment and storage medium |
| CN113360800A (en) * | 2021-06-03 | 2021-09-07 | 深圳红途科技有限公司 | Method and device for processing featureless data, computer equipment and storage medium |
| CN113392076A (en) * | 2021-07-08 | 2021-09-14 | 网银在线（北京）科技有限公司 | Method, device, electronic equipment and medium for acquiring metadata quality information |
| CN113806366A (en) * | 2021-09-07 | 2021-12-17 | 浪潮云信息技术股份公司 | Atlas-based method for realizing multidimensional metadata joint query |
| CN113778831A (en) * | 2021-09-27 | 2021-12-10 | 广州文远知行科技有限公司 | Data application performance analysis method, device, equipment and medium |
| CN113778831B (en) * | 2021-09-27 | 2024-07-23 | 广州文远知行科技有限公司 | Data application performance analysis method, device, equipment and medium |
| CN114356898A (en) * | 2021-11-22 | 2022-04-15 | 青岛海尔科技有限公司 | Data storage method and device, electronic equipment and storage medium |
| CN114254081A (en) * | 2021-12-22 | 2022-03-29 | 中冶赛迪重庆信息技术有限公司 | Enterprise big data search system and method and electronic equipment |
| CN114254081B (en) * | 2021-12-22 | 2024-06-04 | 中冶赛迪信息技术(重庆)有限公司 | Enterprise big data search system, method and electronic equipment |
| CN115186020A (en) * | 2022-07-15 | 2022-10-14 | 深圳安巽科技有限公司 | A data access storage processing method, system and storage medium |
| CN115481439A (en) * | 2022-09-21 | 2022-12-16 | 航天信息股份有限公司 | Data processing method and device, electronic equipment and computer storage medium |
| CN115510121B (en) * | 2022-10-08 | 2024-01-05 | 上海数禾信息科技有限公司 | List data management method, device, equipment and readable storage medium |
| CN115510121A (en) * | 2022-10-08 | 2022-12-23 | 上海数禾信息科技有限公司 | Method, device and equipment for managing business form data and readable storage medium |
| CN115757526B (en) * | 2022-12-02 | 2023-08-15 | 广州市玄武无线科技股份有限公司 | Metadata management method, device, equipment and computer storage medium |
| CN115757526A (en) * | 2022-12-02 | 2023-03-07 | 广州市玄武无线科技股份有限公司 | Metadata management method, device, equipment and computer storage medium |
| CN117746999B (en) * | 2024-02-20 | 2024-05-03 | 之江实验室 | A data processing method, device, storage medium and electronic device |
| CN117746999A (en) * | 2024-02-20 | 2024-03-22 | 之江实验室 | Data processing method and device, storage medium and electronic equipment |
| CN118349557A (en) * | 2024-04-17 | 2024-07-16 | 北京东方通科技股份有限公司 | A method for synchronously identifying industrial data identifiers during lineage update |
| CN118349557B (en) * | 2024-04-17 | 2025-09-09 | 北京东方通科技股份有限公司 | Industrial data identification synchronous identification method in blood margin updating process |
| CN118503505A (en) * | 2024-05-20 | 2024-08-16 | 中信出版集团股份有限公司 | Book database construction method and system based on metadata management |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109241358A (en) | Metadata management method, device, computer equipment and storage medium | |
| CN110362727A (en) | Third party for search system searches for application | |
| CN107622084A (en) | Log management method, system, and computer-readable storage medium | |
| US11416631B2 (en) | Dynamic monitoring of movement of data | |
| US9471665B2 (en) | Unified system for real-time coordination of content-object action items across devices | |
| CN112162965A (en) | Log data processing method and device, computer equipment and storage medium | |
| US10747786B2 (en) | Spontaneous networking | |
| CN113010494B (en) | A database audit method, device and database proxy server | |
| CN110956431A (en) | Data rights management method and system, computer device and readable storage medium | |
| CN111666298A (en) | Method and device for detecting user service class based on flink, and computer equipment | |
| CN115033876A (en) | Log processing method, log processing device, computer equipment and storage medium | |
| CN111078980A (en) | Management method, device, equipment and storage medium based on credit investigation big data | |
| CN115238247A (en) | Data processing method based on zero trust data access control system | |
| CN109359251A (en) | Audit method for early warning, device and the terminal device of application system service condition | |
| WO2025124273A1 (en) | Security audit method for distributed database and related device | |
| CN111209284B (en) | Meta-data-based sub-table method and device | |
| CN114357032A (en) | Data quality monitoring method and device, electronic equipment and storage medium | |
| CN109446054B (en) | Processing method and terminal equipment for override operation request based on big data | |
| CN110851346A (en) | Method, device and equipment for detecting boundary problem of query statement and storage medium | |
| CN116186777A (en) | A method and device for auditing an MPP database | |
| CN117390410A (en) | Data identification method, device, equipment and storage medium | |
| US8868485B2 (en) | Data flow cost modeling | |
| CN116501733A (en) | Data product generation method, device, equipment and storage medium | |
| CN114168599A (en) | Data summarizing method and device and terminal equipment | |
| CN117057776B (en) | Intelligent content inspection and correction method, device, equipment and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190118 |