WO2018032948A1 - Data-oriented architecture (doa) system - Google Patents

Abstract

Embodiments of the present invention relate to a DOA system, comprising: a data resource pool, comprising a plurality of data management modules for storing data; and a DOA resource bus, comprising a plurality of data interfaces, each data interface corresponding to a data management module. The DOA resource bus configures internal data interfaces for the data management modules and obtains route information of requested data according to data request information. The data request information comprises attribute information of an application initiating the data request information. The data interfaces acquire requested data stored in the data management modules according to the route information and compile the requested data according to the attribute information, to obtain data of a data structure supported by the application. The data is transmitted to the application by means of the DOA resource bus.

Description

A data-oriented architecture DOA system Technical field

The present invention relates to the field of computers, and in particular, to a Data Oriented Architecture (DOA) system.

Background technique

In recent years, Service-oriented Architecture (SOA) has been widely used. It sends application functionality as a service to end users or other services. It can distribute, combine, and use loosely coupled coarse-grained application components over the network as needed. The service layer is the foundation of SOA and can be directly invoked by the application to effectively control the human dependency of the interaction with the software agent in the system.

However, in the era of big data, due to the limitations of architecture, the long-standing problems in the field of information technology are becoming more and more prominent in the era of big data: the information between systems is difficult to share; the function expansion of established systems is difficult; massive, heterogeneous, multi-source, dynamic Real-time changes and explosive growth of big data are difficult to manage, difficult to analyze, difficult to mine; business-oriented software engineering development process is complex, maintenance is difficult, life cycle is short; information security is related to national security, social stability, corporate interests and personal privacy In the open environment of the Internet, the problem is more prominent; the interests of data providers are not guaranteed. Even the loosely coupled approach provided by SOA does not meet the needs of the big data era.

Summary of the invention

The embodiment of the invention provides a DOA system, in which data in the system resource pool is completely decoupled, which facilitates data sharing. When the application data is called, the data interface configured by the DOA resource bus can directly call the corresponding data from the data management module to implement different functional applications. The expansion of the system function is not limited by the relationship between the traditional data, and the maintenance cost is low. Good sex.

Embodiments of the present invention provide a data-oriented architecture DOA system, including:

a data resource pool, comprising a plurality of data management modules, configured to store data; the data includes metadata and service data;

The DOA resource bus includes multiple data interfaces, and each data interface corresponds to one data management module;

The DOA resource bus is configured with an internal data interface for the data management module, and obtains routing information of the requested data according to the data request information; the data request information includes an application that initiates the data request information. Attribute information

The data interface acquires the requested data stored in the data management module according to the routing information, and compiles the requested data according to the attribute information to obtain data of a data structure supported by the application. Transfer to the application over the DOA resource bus.

Preferably, the system further comprises: a data registry for constructing data storage logic of the data resource pool.

Further preferably, the DOA resource bus is connected to the data registration center;

The DOA resource bus acquires the data storage logic from the data registration center, and generates routing information of the to-be-stored data transmitted on the DOA resource bus according to the data storage logic;

Determining, according to the routing information, a first data interface for capturing the data to be stored;

The first data interface acquires the data to be stored from the DOA resource bus, and encapsulates the data into a standardized data structure, and sends the data to a data management module connected to the first data interface for storage.

Preferably, the system further includes: a data authority center, configured to perform rights management on the data;

The rights management includes: data security attribute definition, data legality identification, data access authority definition, user authority authentication, application authorization, and user authorization.

Preferably, the system further includes: a data abnormality control center, configured to process data consistency of the data stored in the plurality of data management modules.

Preferably, the system further comprises: an application interface unit, configured to provide an application oriented interface.

Further preferably, the application interface unit is connected to the DOA resource bus;

The application interface unit receives data request information sent by the application, and sends the data request information to the DOA resource bus.

Preferably, the DOA resource bus is further configured to capture information of a line on the data management module in the DOA system.

Preferably, the DOA resource bus is further configured to acquire information about the offline of the data management module in the DOA system.

In the DOA system provided by the embodiment of the present invention, data in the system resource pool is completely decoupled, which facilitates data sharing. When the application data is called, the data interface configured by the DOA resource bus can directly call the corresponding data from the data management module to implement different functional applications. The expansion of the system function is not limited by the relationship between the traditional data, and the maintenance cost is low. Good sex.

DRAWINGS

FIG. 1 is a schematic diagram of a DOA system according to Embodiment 1 of the present invention.

detailed description

In order to make the objects, technical solutions and advantages of the present invention more clear, the following embodiments of the present invention are made in conjunction with the accompanying drawings. Further detailed description.

The DOA system provided by the embodiment of the present invention is described in detail below by taking FIG. 1 as an example.

As shown in FIG. 1, the DOA system of this embodiment includes:

The data resource pool 1 includes a plurality of data management modules 10-1, 10-2, ..., 10-N for storing data including metadata and service data. Each resource management module can be composed of one or a group of data storage servers or a cluster of data storage servers.

The DOA resource bus 2 includes a plurality of data interfaces 20-1, 20-2, ..., 20-N, and each data interface corresponds to a data management module;

The DOA resource bus 2 configures an internal corresponding data interface for the data management module, and obtains routing information of the requested data according to the data request information when the application requests the data; the data request information includes attribute information of the application that initiates the data request information.

In a specific implementation, the routing information is sent to the corresponding data interface, for example, the routing information points to the data management module 10-2, and the routing information is sent to the data interface 20-2.

The data interface acquires the requested data stored in the data management module according to the routing information, and compiles the requested data according to the attribute information of the application that initiates the data request information, and obtains data of the data structure supported by the application, and passes the data structure. The DOA resource bus 2 is transmitted to the application.

Therefore, the isolation between the application and the data is substantially realized by the DOA resource bus 2, regardless of the data structure supported by the application, the data storage is based on the data structure of the standardized language data, so the data stored in the system is Can be shared by different applications. Data and data are discretely decoupled, and there is no coupling relationship between them. Therefore, when the application is added or subtracted in the system, the data storage will not be affected.

In the system, if it is necessary to increase the data storage space and add a new data management module, the DOA resource bus 2 captures the information of the online management of the data management module in the DOA system.

For example, when the data management module 10-2 is online in the system, an online prompt message is sent to the DOA resource bus 2, thereby obtaining information of the online management of the data management module 10-2.

The DOA resource bus 2 configures the data interface of the data management module 10-2, and configures the data interface 20-2 for the interface management module 21.

In the system, if a data management module fails to be offline, the interface management module 21 acquires the information of the offline management of the data management module in the DOA system.

In a specific implementation manner, the DOA resource bus 2 periodically polls and sends a message to each data management module in the system, and receives feedback information of each data management module, when the data management module is not received within the set time. When the feedback information is obtained, it is determined that the data management module is offline. In order to avoid misjudgment, preferably, the data management module may send a message to the data management module multiple times within a set time.

When the DOA resource bus 2 determines that a data management module is offline, information on the data failure stored in the data management module is generated and recorded.

In addition, the system further includes: a data registration center 3, a data authority center 4, a data anomaly control center 5, and an application interface unit 6. The following is a description of each of these modules.

Data registry 3 is used to build data storage logic for data resource pools.

The DOA resource bus 2 is connected to the data registry 3.

When storing data into the data management module, the DOA resource bus 2 acquires data storage logic from the data registry 3 and generates routing information of the data to be stored according to the data storage logic.

Determining, by the plurality of data interfaces, a first data interface for capturing data to be stored according to the routing information; the first data interface acquiring data to be stored from the DOA resource bus 2, and encapsulating the data into a standardized data structure, sending the data to A data management module connected to the data interface is stored.

Data Privilege Center 4 is used to manage rights for data.

The scope of rights management may include: data security attribute definition, data legality authentication, data access permission definition, user authority authentication, application authorization, and user authorization.

The rights management of the data may be completed while the data is written into the data management module, or may be directly operated on the data in the data management module.

The data abnormality control center 5 is configured to process data consistency of the service data stored in the plurality of data management modules.

Specifically, the data abnormality control center can be used to detect various abnormal conditions in the data management module, and perform corresponding abnormal processing actions on the abnormal conditions according to the set processing mechanism.

The exception processing action includes issuing an abnormal signal, replacing the abnormal data with the preliminary data, and requesting the data registration center 3 to refresh the corresponding information and the like.

The application interface unit 6 is configured to provide an application oriented interface.

The application interface unit 6 is connected to the DOA resource bus 2, and the application interface unit 6 receives the data request information transmitted by the application and transmits the data request information to the DOA resource bus 2.

The embodiment of the invention provides a DOA system, in which data in the system resource pool is completely decoupled, which facilitates data sharing. When the application calls the data, the data can be directly called through the management center to implement different functional applications. The expansion of the system function is not limited by the coupling relationship between the traditional data, and the maintenance cost is low and the scalability is good.

A person skilled in the art should further appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both, in order to clearly illustrate hardware and software. Interchangeability, the composition and steps of the various examples have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods to implement the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the embodiments of the invention.

The steps of a method or algorithm described in connection with the embodiments disclosed herein can be implemented in hardware, a software module executed by a processor, or a combination of both. The software module can be placed in random access memory (RAM), memory, read only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or technical field. Any other form of storage medium known.

The embodiments and the beneficial effects of the embodiments of the present invention are further described in detail. The foregoing description is only specific embodiments of the embodiments of the present invention, and is not intended to be limited. The scope of the present invention is intended to be included within the scope of the embodiments of the present invention. Any modifications, equivalents, improvements, etc., are included in the scope of the present invention.

Claims (9)

A data-oriented architecture DOA system, characterized in that the system comprises: a data resource pool, comprising a plurality of data management modules, configured to store data; the data includes metadata and service data; The DOA resource bus includes multiple data interfaces, and each data interface corresponds to one data management module; The DOA resource bus configures an internal data interface for the data management module, and obtains routing information of the requested data according to the data request information; the data request information includes attribute information of an application that initiates the data request information; The data interface acquires the requested data stored in the data management module according to the routing information, and compiles the requested data according to the attribute information to obtain data of a data structure supported by the application. Transfer to the application over the DOA resource bus. The DOA system of claim 1 wherein said system further comprises: a data registry for constructing data storage logic for said data resource pool. The DOA system of claim 2 wherein said DOA resource bus is coupled to said data registry; The DOA resource bus acquires the data storage logic from the data registration center, and generates routing information of the to-be-stored data transmitted on the DOA resource bus according to the data storage logic; Determining, according to the routing information, a first data interface for capturing the data to be stored; The first data interface acquires the data to be stored from the DOA resource bus, and encapsulates the data into a standardized data structure, and sends the data to a data management module connected to the first data interface for storage. The DOA system according to claim 1, wherein the system further comprises: a data authority center for performing rights management on the data; The rights management includes: data security attribute definition, data legality identification, data access authority definition, user authority authentication, application authorization, and user authorization. The DOA system according to claim 1, wherein the system further comprises: a data anomaly control center for processing data consistency of data stored in the plurality of data management modules. The DOA system according to claim 1, wherein said system further comprises: an application interface unit, Provide an application-oriented interface. The DOA system of claim 6 wherein said application interface unit is coupled to said DOA resource bus; The application interface unit receives data request information sent by the application, and sends the data request information to the DOA resource bus. The DOA system according to claim 1, wherein the DOA resource bus is further configured to capture information of a line on the data management module in the DOA system. The DOA system according to claim 1, wherein the DOA resource bus is further configured to acquire information of a downlink of the data management module in the DOA system.

Images