CN115168460A

CN115168460A - Data processing method, data transaction system, device and storage medium

Info

Publication number: CN115168460A
Application number: CN202110370059.XA
Authority: CN
Inventors: 孙傲冰; 滕一帆; 史双; 骆雄辉; 王世清
Original assignee: Tencent Cloud Computing Beijing Co Ltd
Current assignee: Tencent Cloud Computing Beijing Co Ltd
Priority date: 2021-04-06
Filing date: 2021-04-06
Publication date: 2022-10-11

Abstract

The embodiments of the present application provide a data processing method, a data transaction system, a device and a storage medium, which are applied to a data transaction system, and the data transaction system is used to provide a data transaction platform. The method specifically includes: collecting business data on a data trading platform; obtaining business rules adapted to the business data, and using the adapted business rules to review and manage the business data; Converting the business data under review and management to obtain data elements corresponding to the business data; and updating the data map of the data transaction system according to the data elements corresponding to the business data. Through this solution, business data and business processes on the data trading platform can be globally managed.

Description

Data processing method, data transaction system, device and storage medium

Technical Field

The present invention relates to the field of internet technologies, and in particular, to a data processing method, a data transaction system, a device, and a storage medium.

Background

The data transaction system is used for providing a data transaction platform, and aims to promote data circulation, standardize data transaction behaviors, maintain data transaction market order, protect legitimate rights and interests of all data transaction parties, provide services such as perfect data transaction, settlement, delivery, safety guarantee and the like for the whole society and meet partial data processing functions.

The current data transaction system only considers partial links of data transaction, for example, only considers how to realize data transaction between a data supplier and a data demander; the architecture of the data transaction system is designed based on the consideration of local links, so that the data transaction system cannot carry out global management on data and data transaction on a data transaction platform, the data transaction requirements are increased day by day along with the rapid development of big data, and how to realize global management is a problem to be solved urgently in the data transaction system at present.

Disclosure of Invention

The embodiment of the application provides a data processing method, a data transaction system, equipment and a storage medium, which can perform global management on service data and a service flow on a data transaction platform.

In a first aspect, an application embodiment provides a data processing method, which is applied to a data transaction system, where the data transaction system is used to provide a data transaction platform; the data processing method comprises the following steps:

collecting service data on a data transaction platform;

acquiring a service rule matched with the service data, and auditing and managing the service data by adopting the matched service rule;

converting the service data which passes the auditing management according to the standard data specification of the data transaction system to obtain a data element corresponding to the service data; and the number of the first and second groups,

and updating the data map of the data transaction system according to the data elements corresponding to the service data.

In a second aspect, an application embodiment provides a data transaction system, including:

the data transaction mall module is used for displaying a service interface of the data transaction platform and collecting service data on the data transaction platform in the service interface;

the operation management module is used for acquiring the service rule matched with the service data and auditing and managing the service data by adopting the matched service rule;

the data map module is used for converting the service data which passes the auditing management according to the standard data specification of the data transaction system to obtain a data element corresponding to the service data; and updating the data map of the data transaction system according to the data elements corresponding to the service data.

In a possible implementation manner, the data map module is further configured to obtain a database of the data transaction system, where the database stores a plurality of data elements, each data element corresponds to one service data, and each data element includes one or more tags; combing the database according to the label of each data element to construct a data map of the data transaction system;

wherein the label comprises any one of the following: the label is used for representing the service type of the data element, the source directory label is used for representing the service data corresponding to the data element, and the label is used for representing the open authority of the data element.

In one possible implementation, the data transaction system further includes:

the data processing module is used for preprocessing the acquired service data;

the pre-treatment comprises at least one of: technical processing of a data warehouse, desensitization processing of data and cleaning processing of data.

In one possible implementation, the service data includes payment data to be processed, and the data transaction system further includes:

the clearing and settling module is used for determining a target payment system according to the payment data, the data transaction system is connected with at least one payment system, and each payment system provides a payment interface for the data transaction system;

calling a payment interface of the target payment system to send the payment data to the target payment system for settlement processing; and receiving a processing result returned by the target payment system.

In a possible implementation manner, the data transaction mall module is further configured to detect a transaction requirement for any data element in the data map, and send the transaction requirement to the operation management module for auditing management; if the transaction requirements pass the audit management, the operation management module sends the transaction requirements to the data map module, the data map module converts the required data elements into corresponding service data and returns the service data to the operation management platform, and the service data returned by the operation management platform is sent to the data transaction mall module and is output by the data transaction mall module; or,

the data transaction mall module is also used for detecting a calling request for any data element in the data map and sending the calling request to the operation management module for auditing management; if the transaction requirements pass the audit management, the operation management module sends the calling request to the data map module, the data map module carries out statistical analysis on the requested data elements, a statistical report about the requested data elements is generated and returned to the operation management platform, and the statistical report of the operation management platform is sent to the data transaction mall module and is output by the data transaction mall module.

In one possible implementation, the data transaction system is deployed using a cascaded architecture; the cascade architecture comprises a presentation layer, a business service layer and a data service layer; wherein,

the data transaction mall module is arranged on the presentation layer; the operation management module, the data processing module and the settlement module are integrated in a business service layer; the data map module is arranged on the data service layer.

In one possible implementation, the data transaction system is deployed using a service-oriented distributed architecture; the service-oriented distributed architecture comprises an application layer, a flow layer, a service layer, a component layer and a resource layer; wherein,

the data transaction mall module is arranged on the application layer; the operation management module, the data processing module and the settlement module are distributed on the flow layer, the service layer and the component layer; the data map module is arranged on the resource layer.

In a third aspect, an embodiment of the present application provides a data processing apparatus, where the data processing apparatus carries a data transaction system, and the data processing apparatus includes:

the data map module is used for converting the service data which passes the auditing management according to the standard data specification of the data transaction system to obtain a data element corresponding to the service data; updating a data map of the data transaction system according to the data elements corresponding to the service data;

the data processing module is used for preprocessing the acquired service data;

and the clearing and settling module is used for determining a target payment system according to the payment data.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where a computer program is stored, and when the computer program is read and executed by a processor of a computer device, the computer device is caused to execute the data processing method of the first aspect.

In a fifth aspect, embodiments of the present application provide a computer program product or a computer program comprising computer instructions stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the data processing method of the first aspect.

In the embodiment of the application, the data transaction system provides a data transaction platform, various adaptive business rules can be formulated for various businesses in the data transaction platform according to needs, and when the business data are collected, the business data can be globally and effectively audited and managed through the adaptive business rules, so that the effective management of the whole process of each business in the data transaction platform can be realized, and the business safety and the management strength are improved; in addition, the business data which is managed through auditing can be converted into standard data elements according to standard data specifications in the data transaction system and added into a data map of the data transaction system, so that the standardized and unified management of the business data can be realized, and the monitoring management of the business data from data acquisition to the whole life cycle of data transaction is realized.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the description below are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.

Fig. 1 is a schematic structural diagram of a blockchain network according to an embodiment of the present disclosure;

fig. 2 is a schematic diagram of a block structure according to an embodiment of the present disclosure;

fig. 3 is a schematic architecture diagram of a data transaction system according to an embodiment of the present application;

fig. 4a is a schematic flow chart of member authentication according to an embodiment of the present application;

FIG. 4b is a schematic flow chart of data distribution provided in the embodiment of the present application;

FIG. 4c is a schematic flow chart of data customization provided by an embodiment of the present application;

FIG. 4d is a schematic diagram of a user interface of a data transaction mall module according to an embodiment of the present application;

fig. 5 is a schematic flowchart of a data processing method according to an embodiment of the present application;

FIG. 6 is a block diagram of a data processing platform according to an embodiment of the present application;

FIG. 7 is a schematic diagram of a cascading architecture of a data transaction system according to an embodiment of the present disclosure;

fig. 8 is a schematic diagram of a distributed architecture of a data transaction system according to an embodiment of the present application;

FIG. 9 is a schematic diagram of an architecture of service administration provided in an embodiment of the present application;

fig. 10 is a schematic structural diagram of a distributed service component provided in an embodiment of the present application;

fig. 11 is a network deployment diagram of a data transaction system according to an embodiment of the present application;

fig. 12 is a schematic architecture diagram of a load balancing system according to an embodiment of the present application;

FIG. 13 is a block diagram of a database read/write separation architecture according to an embodiment of the present disclosure;

fig. 14 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present application.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

The following describes technical terms related to the embodiments of the present application:

1. block chains:

the block chain is a novel application mode of computer technologies such as distributed data storage, point-to-point transmission, a consensus mechanism, an encryption algorithm and the like. A block chain (Blockchain), which is essentially a decentralized database, is a string of data blocks associated by using a cryptographic method, and each data block contains information of a batch of network transactions, which is used for verifying the validity (anti-counterfeiting) of the information and generating a next block. The blockchain may include a blockchain underlying platform, a platform product service layer, and an application service layer.

Because a large amount of data calculation and data storage services are involved in the block chain, and a large amount of computer operation cost is needed for the data calculation and the data storage services, the transaction data related to the application can be realized by a cloud storage technology in the cloud technology. The block chain is stored on the cloud through a cloud storage technology, when transaction data need to be stored in the block chain, the data can be uploaded to the block chain on the cloud through the cloud storage technology, and when the data need to be read, the data can be read from the block chain on the cloud at any time, so that the storage requirement on the terminal equipment can be reduced, and the application range of the block chain is expanded.

Referring To fig. 1, fig. 1 shows a schematic structural diagram of a blockchain network provided in an exemplary embodiment of the present application, where the blockchain network 100 (or referred To as a distributed system 100) is formed by a plurality of nodes (any type of computing device in an access network, such as a server and a user terminal) and a client, a Peer-To-Peer (P2P) network is formed between the nodes, and a P2P Protocol is an application layer Protocol operating on a Transmission Control Protocol (TCP) Protocol. In a distributed system, any machine, such as a server or a terminal, can join to become a node, and the node comprises a hardware layer, a middle layer, an operating system layer and an application layer.

Referring to the functions of each node in the blockchain network shown in fig. 1, the functions involved may include:

(1) Routing, a basic function that a node has, is used to support communication between nodes.

(2) The application is used for being deployed in a block chain, realizing specific services according to actual service requirements, recording data related to the realization function to form recording data, carrying a digital signature in the recording data to represent a source of task data, and sending the recording data to other nodes in the block chain network, so that the other nodes add the recording data to a temporary block when the source and integrity of the recording data are verified successfully.

For example, the services implemented by the application include:

(1) the wallet is used for providing a function of carrying out transactions of electronic money, and comprises a transaction initiating function (namely sending a transaction record of the current transaction to other nodes in the blockchain network), and after the other nodes are successfully verified, the other nodes store the record data of the transaction into a temporary block of the blockchain as a response for confirming that the transaction is valid; of course, the wallet also supports the querying of the remaining electronic money in the electronic money address;

(2) the shared account book is used for providing functions of operations such as storage, query and modification of account data, record data of the operations on the account data are sent to other nodes in the block chain network, the record data are stored in the temporary block as a response for acknowledging that the account data are valid after the other nodes verify the validity, and confirmation can be sent to the node initiating the operations.

(3) Intelligent contracts, computerized agreements that can execute the terms of a contract, implemented by code deployed on a shared ledger for execution when certain conditions are met, for completing automated transactions according to actual business requirement code; that is, an intelligent contract is a piece of executable program running on a blockchain that is triggered to execute automatically when a transaction is made on the blockchain. For example, inquiring the logistics state of the goods purchased by the buyer, and transferring the electronic money of the buyer to the address of the merchant after the buyer signs the goods; of course, smart contracts are not limited to executing contracts for trading, but may also execute contracts that process received information.

(4) The Block chain (Blockchain) comprises a series of blocks (blocks) which are mutually connected according to the generated chronological order, once a new Block is added into the Block chain, the new Block cannot be removed any more, and the blocks record the record data submitted by the nodes in the Block chain network.

The blockchain is essentially a decentralized database, and as an underlying technology of bitcoin, is a string of data blocks generated by using cryptography correlation, and each data block is linked by a random hash algorithm (also called hash algorithm), and the next block contains the hash value of the previous block. The block chain technology is widely applied to the scenes of digital assets, intelligent contracts, logistics tracking, product protection and the like.

Referring to fig. 2, fig. 2 is a schematic diagram of a Block Structure according to an exemplary embodiment of the present application, such as the Block Structure (Block Structure) shown in fig. 2, where each Block includes a hash value of a transaction record stored in the Block (hash value of the Block) and a hash value of a previous Block, and the blocks are connected by the hash value to form a Block chain. The block may also include information such as a time stamp at the time of block generation. The blockchain is essentially a decentralized database, which is a string of data blocks associated by cryptographic methods, each data block containing relevant information for verifying the validity of the information (anti-counterfeiting) and generating the next block.

2. A data transaction system:

a data transaction system: the system is used for providing a data transaction platform and aims to promote data circulation, standardize data transaction behaviors, maintain data transaction market order, protect legitimate rights and interests of all data transaction parties and provide services such as perfect data transaction, settlement, delivery, safety guarantee and the like for the whole society; and simultaneously satisfies partial data processing functions. The data transaction system composition architecture can comprise a data transaction mall module, an operation management module, a data processing module, a data map module, a settlement module and the like, and can also comprise payment interfaces, such as various bank channel interfaces, third party payment interfaces and the like. Wherein:

data mapping: and combing the data resource catalog according to national, industrial and local standards to form a data map of the transaction center, thereby realizing standard editing, intelligent management, associated application and sharing opening of data.

And (3) data transaction process: the method comprises the functions of identity authentication of transaction parties, supply and demand information release, supply and demand information auditing, supply and demand information listing, transaction matching, guarantee payment, commission calculation, data escrow, transaction auditing, goods return and refund, transaction evaluation and the like.

Data processing: data desensitization, cleaning, removing/completing missing data, removing/modifying data format/content errors/logical errors, etc., data re-examining and verifying data, deleting duplicate information, correcting erroneous data, etc.

Auditing and managing data: the system comprises functions of data loading, extraction, conversion, storage and the like of different channels, and realizes the management of the whole data life cycle from acquisition, processing, storage, safety, updating, destruction and the like.

Clearing and settling the transaction: the operation unit of the data transaction system and the bank adopt a bank-enterprise direct connection cooperation mode, and the clearing and settlement platform is directly connected with the existing bank channel or can open a third party payment channel such as WeChat and the like according to business development to realize multi-channel payment. The functions of payment, account checking, clearing, settlement and the like of data transaction funds are supported.

Transaction operation report form: the method comprises the functions of visual analysis and BI report output. The service objects of the report comprise data transaction system operation management personnel and external clients. Firstly, the operation management personnel are helped to know the whole operation condition of the trading center through the visual chart, secondly, the report with large solidified demand is developed according to the requirements of external clients (enterprises or governments) and the condition of data sources, the enterprises are helped to make intelligent business operation decisions, and the decision efficiency and decision scientificity of governments are improved.

The embodiment of the application provides a data transaction system, which provides a data transaction platform, can make various adaptive business rules for various businesses in the data transaction platform as required, and can carry out global effective audit management on business data through the adaptive business rules when the business data are collected, so that the effective management on the whole flow of each business in the data transaction platform can be realized, and the business safety and the management strength are improved; in addition, the business data managed by auditing can be converted into standard data elements according to standard data specifications in the data transaction system and added into a data map of the data transaction system, so that the standardized and unified management of the business data can be realized, and the monitoring management of the business data from data acquisition to the whole life cycle of data transaction is realized.

In one implementation, the data transaction system in the embodiment of the present application may be combined with a blockchain technology, for example, the service data, the data elements corresponding to the service data, and the data map of the data transaction system may be uploaded to a blockchain for storage, so as to ensure that the data on the blockchain is not easily tampered. The following steps are repeated: the data transaction system can be deployed at the nodes of the block chain, so that all the management processes of the service data on the data transaction platform by the modules (including but not limited to the data transaction mall module, the operation management module, the data map module, the data processing module and the settlement module) of the data transaction system can be executed on the block chain, thereby ensuring the fairness and the justice of the management processes, simultaneously ensuring the traceability of the management processes and improving the safety of the management processes.

The data transaction system and the data processing method implemented based on the data transaction system according to the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

The embodiment of the application provides a data transaction system, which comprises a data transaction mall module, an operation management module, a data processing module, a data map module, a settlement module and a bank channel interface. The data transaction system provides a data transaction platform for both data supply and demand parties, issues supply and demand information in aspects of data products, data professional talents and the like, and the data transaction platform provides comprehensive services such as identity authentication, transaction matching, transaction settlement and delivery, data hosting, safety guarantee, financial services and the like for all parties, promotes data asset circulation, establishes a sound data asset transaction mechanism and a pricing mechanism, and standardizes transaction behaviors.

Further, a data transaction platform is established based on a data transaction system, hardware manufacturers, software manufacturers, application service providers, data source acquisition service providers and the like of a data ecosphere are integrated, information resources in the aspects of platforms, technologies, data (including internet data, government shared data and the like), talents and the like are provided for data innovation and creation, innovation application of the data in various industries is promoted, rapid and healthy development of data industries is promoted, and cooperation and win-win of the data industries are realized. A data transaction support platform is built based on functions of data storage, data processing, data mining, data analysis and the like, and the comprehensive Application support service is provided for vast data transaction service developers around the requirements of providing customized data transaction service, application Programming Interface (API) service and the like for governments and enterprises. For example, on the basis of data acquisition, cleaning and processing, a data rapid application support service such as data modeling, mining, analysis and presentation of a specific application scene is provided for a developer. The data transaction is surrounded by the data transaction, and the data asset management and value increment of the whole data life cycle such as data acquisition, processing, storage, analysis, sharing, opening, safety, filing, destruction and the like are provided for government departments and enterprises and public institutions.

Referring to fig. 3, fig. 3 is a system architecture diagram of a data transaction system according to an embodiment of the present application. The data transaction system can be used for realizing basic functions of data transaction, including identity authentication of data supply and demand parties, supply and demand data release and audit, data transaction match, data purchase, goods return and refund, transaction evaluation, online consultation, commission calculation, online payment and the like, and simultaneously providing fund clearing and settlement capacity. As shown in fig. 3, the data transaction system may include a data transaction subsystem, a settlement module, and a banking channel interface. Each submodule in the data transaction system is introduced one by one as follows:

(1) Data transaction subsystem

The data transaction subsystem specifically comprises a data transaction mall module, an operation management module, a data processing module and a data map module.

(1) The data transaction mall module provides functions of data publishing, data customization, data navigation, search engine, data marketing, intelligent recommendation and the like for data supply and demand parties. Further, the data transaction mall module may specifically include functions of data information, member authentication, user center, data distribution, data customization, search engine, data hall, data marketing, intelligent recommendation, and the like. Next, each function provided by the data transaction mall module is introduced one by one:

1.1 data information

The data transaction mall center home page construction data information function comprises announcement in an XX province data transaction platform, news of the XX province data transaction platform, data industry information and the like. The data information can be managed in the background, such as the distribution, modification, verification, deletion, etc. of the data information.

1.2 Member authentication

The member refers to a user who is registered in the data transaction platform in advance and passes authentication. The data transaction system provided by the application is opened to an enterprise only temporarily without opening the data transaction system for individuals, both parties of a data supply and demand need to register on a platform before data transaction, and can register in a mailbox mode, a mobile phone mode and the like (after a password is forgotten, the user can find the password back through the mailbox or the mobile phone), after the registration is successful, enterprise information needs to be supplemented after logging in the platform, the enterprise information comprises information such as a business license, a legal person and a public account, and the data transaction platform can be used after the data transaction platform is approved. An electronic certificate system is used to establish a member electronic certificate database. Referring to fig. 4a, fig. 4a is a schematic flow chart of member authentication according to an embodiment of the present disclosure. As shown in fig. 4a, for a certain enterprise, if it wants to publish data in the data transaction mall module, it needs to register and authenticate a member first, and the authentication process is shown in fig. 4a, which includes registering- > login- > supplement of enterprise information- > platform review- > authentication is successful.

1.3 user centers

After the member successfully logs in the system through authentication, the member can check and modify related information including enterprise information, sub-user information (an enterprise user administrator can add, inquire, modify and log out sub-users), login password modification and the like in the user center module. For an enterprise, an enterprise user administrator can view the public information of enterprise employees and set employee permissions in the user center of the enterprise.

1.4 data distribution

The data supplier can publish data on the data transaction platform, and the data can be an API (application program interface) interface and can also be data in other formats such as documents, videos, audios and pictures. The data supplier writes the details of the issued data, such as data type, data price, data details, data case, code example and the like, according to the platform module, simultaneously selects related protocols of data issuing of the data transaction platform, submits the contents to the shelf for platform checking after the contents are filled, and the data passing through the checking can be checked under the query conditions of 'my data' input issuing time, data type and the like. Meanwhile, the data provider may view the transaction record and the transaction amount of the data in my data.

Referring to fig. 4b, fig. 4b is a schematic flow chart of data publishing provided in the embodiment of the present application. As shown in fig. 4b, the process of the data supplier publishing data in the data trading platform may include: and setting data release- > data uploading- > platform auditing- > release success.

The data issued by the data supplier on the data transaction platform according to the embodiment of the application can be stored on the block chain. In one possible implementation, after the data supplier publishes the data on the data transaction platform, the data supplier may perform uplink processing on the published data. The uplink processing procedure may specifically include: and the data supplier sends the release data to each block chain node device in the block chain network, each block chain node device carries out block chain consensus on the release data after receiving the release data uploaded by the data supplier, and if the block chain consensus passes, the release data is released and stored in the block chain network. By the scheme, the data issued by the data supplier is not easy to be tampered, and the reliability of the data is guaranteed.

1.5 data customization

When a user does not find needed data on the data transaction platform, the data request of the user can be published in data customization, basic data information, data expression, data types, contact ways and the like are filled for the data transaction platform to examine, the data passing the examination and examination are displayed in a 'my customization' list, and when the data transaction platform has related data, the platform can recommend the user. Meanwhile, the user can view and modify all data requirements published by the user in My customization.

Please refer to fig. 4c, fig. 4c is a schematic flow chart of data customization according to an embodiment of the present application. As shown in fig. 4c, the process of publishing its own data requirement in "data customization" may include: setting requirement data- > submitting requirement- > platform auditing- > successfully issuing.

The data customized by the user on the data transaction platform provided by the embodiment of the application can be stored on the block chain. In one possible implementation, after the user customizes the data on the data transaction platform, the uplink processing may be performed on the customization data. The uplink processing procedure may specifically include: the user sends the customized data to each block chain node point device in the block chain network, after each block chain node point device receives the customized data uploaded by the user, block chain consensus is conducted on the customized data, and if the block chain consensus passes, the customized data are issued and stored in the block chain network. By the scheme, the data customized by the user can be guaranteed not to be easily tampered, and the credibility of the data is guaranteed.

1.6 search Engine

The data transaction platform supports search services accurate to data content, namely, provides search services accurate to each character, and therefore search experience of the data transaction platform is improved. And mining and analyzing according to the transaction records of the members, and automatically recommending appropriate data to the members. The search engine searches data fragment copies through horizontal expansion of search nodes and an election mechanism of the nodes, and reliability and stability of accurate search are guaranteed.

1.7 data lobby

The data hall refers to a data classification module provided in the data transaction mall module. The data detail page comprises detailed information, cases, code examples (API data)/data samples (documents, videos, audios, pictures and other data), online API tests, payment needs to be known and the like of the data. After the user purchases the data, the user can access various platforms, and can charge in a plurality of ways such as real-time or time-by-time, day-by-day, month-by-month, year-by-year and the like (the real-time price of the data is automatically generated by matching the data trading platforms).

In addition, the user is confused about data of the data transaction platform, and can consult platform customer service staff on line. After the user purchases the data, the evaluation can be left below the data purchase page.

1.8 data marketing

The data transaction platform recommends high-quality and hot data at the front end of a page of the data transaction mall module according to comprehensive factors such as data quality and data sales, and meanwhile, the page rolls the data which are recently accessed to the platform, so that the exposure of the high-quality data is improved, the purchase quantity of the high-quality data is increased, the rapid circulation and the change of the data are realized, and the value of the data transaction platform is reflected.

1.9 Intelligent recommendation

The data transaction platform can conduct mining analysis according to multiple dimensions such as transaction records of the members, data labels of the members, collection data of the members and the like, and intelligently recommends appropriate data to the members.

In a possible implementation manner, please refer to fig. 4d, and fig. 4d is a schematic user interface diagram of a data transaction mall module according to an embodiment of the present application. As shown in FIG. 4d, the user's home page of XX province data information center is shown in the user interface, which may include a "member center" option (10), a "data publish" option (20), a "data customize" option (30), and a "search engine" option (40). Each option corresponds to a specific function, for example, a user can click a data publishing option, that is, data can be published in the data transaction mall module, where details of a specific process of data publishing may refer to the detailed description of data publishing in the foregoing 1.4, and details of the application are not described herein again. For another example, the user may also click a data customization option, that is, data customization may be performed in the data transaction mall module according to a requirement of the user, where details of a specific data customization process may be described in detail in the foregoing 1.5, and details of the data customization are not repeated here again. Some specific hot-selling items and item contents are also included in the user interface, and are presented in a hot-selling area of the user interface, and the browsing amount or clicking amount of other users of each specific module is displayed. In addition, the user interface can also comprise a message option (50), a My option (60), a classification option (70) and a trading center option (80), and each option can correspond to a specific function similarly.

(2) The operation management module is used for providing functions of auditing management, evaluation management, order management, risk control, report management and the like. The background operation management system is provided for the operators of the property right trading group to use and mainly provides all-dimensional operation support management functions of trading rules, data, auditing, orders, reports and the like. Next, each function provided by the large operation management module is introduced one by one:

2.1 service management

The business management is used as a core module of the data transaction subsystem and is responsible for setting a transaction mode, a pricing mode, a transaction rule, a settlement and transaction rule and the like, meanwhile, the transaction center module needs to determine the data transaction rule such as a data quality system, a data transaction standard system, a data transaction safety system and the like, and the data transaction subsystem can guarantee the data transaction behavior of the data transaction subsystem, maintain the data transaction market order and protect the legal rights and interests of all parties of data transaction.

2.2 data management

On one hand, the data management module manages a data tag library, namely, the data management module supports the establishment of tags for transaction data from multiple dimensions, meanwhile, the tags are classified to form the tag library, and then the tag library is documented to form the metadata specification in an XML format. With the development of data transaction business, the label library and metadata specification will be continuously perfectly adjusted. Based on the metadata specification, the data transaction subsystem provides more convenience for data publishing, demand publishing and data retrieval of both the supply and demand parties.

And on the other hand, the data template issued by the data supply and demand party is managed, and comprises data types, data details, data cases, interface details, sample information, data prices and the like.

2.3 marketing management

The method mainly carries out page configuration on a data transaction platform, such as banner (banner), icon (icon), tab (label) and the like, carries out marketing configuration and recommendation on data, and comprises latest data, popular data, recommended data and the like imported into the platform, and can also consider adding advertising management such as promotion activities, full reduction, coupons and the like a common E-commerce platform.

2.4 wind management

On one hand, the wind control management strictly supervises the data transaction, avoids the business crisis brought by the risk of the illegal data transaction, such as tracking management of data of transaction, strict control of transaction membership, supervision of data quality and safety and the like, implements risk supervision into the management and business process of a data transaction platform, and ensures the openness, fairness and justice of the data transaction market environment.

And on the other hand, the wind control management controls transaction abnormal risks, system risks, account fund risks and the like, and ensures the stable operation of the whole platform.

2.5 Member management

The method mainly manages the relevant information of the members of the data transaction platform, such as member grades, member rights and interests, points and the like.

2.6 order management

The method comprises the steps of managing order types and order states, recording order real-time data such as order purchasing users, payment information, preference information and the like, and managing data transaction volume, data calling times, data calling states and the like.

2.7 report management

And statistical analysis reports of transactions, orders, funds, accounts, users and the like are provided, and convenience is provided for later operation and popularization of the data transaction subsystem.

2.8 Audit management

The data transaction subsystem establishes a set of strict auditing mechanism of data and supply-demand membership, and ensures that the data is transacted in a legal, fair and fair sound environment. Note: it should be considered to establish a workflow-based audit approval management operation mechanism.

2.9 evaluation management

Management data evaluation and user feedback relate to screening of sensitive words or pictures and management of reply contents.

2.10 rights management

And controlling the user authority of the data transaction platform and managing the operation authority of a back-end operation manager.

2.11 Log management

And providing log, operation log, server log, log backup and statistical analysis functions of the data transaction platform.

2.12 System management

Providing the functions of personnel organization management, role management, menu management and the like.

(3) The data processing module is used for providing functions of data ETL processing, data desensitization, data cleaning, visual chart processing and the like. The national data transaction system is still in the initial stage, and the private underlying data sold in black market still exists in the market at present, so that the data transaction platform provided by the application never allows the transaction to touch the data of the private or national security, and can be applied to the urban data transaction platform. As an asset, most of data can be traded after desensitization, cleaning and the like, and the data of governments, financial institutions and other various industrial institutions are ensured to circulate in a healthy and safe trading environment.

3.1ETL treatment

Data is extracted (extract), converted (transform) and loaded (load) from the source to the destination.

3.2 data cleansing

In order to ensure the accuracy, consistency and integrity of data, it is necessary to clean the underlying data, i.e. review and check the data, such as filling up defective data, deleting duplicate data, and correcting erroneous data. Meanwhile, if the data has multiple sources, relevance verification is required.

3.3 data desensitization

Data desensitization refers to data deformation of some sensitive information through desensitization rules, and reliable protection of sensitive private data is achieved. Under the condition of relating to client safety data or some business sensitive data, under the condition of not violating transaction rules of a data transaction platform, real data needs to be modified and provided for test use, personal information such as identification numbers, mobile phone numbers, card numbers, client numbers and the like, and relating to fund limit and the like, data desensitization is needed.

(4) The data map module is used for providing data element standardization management, information resource catalogue management and information resource correlation analysis functions.

The data map is a core technical system which can realize free editing, extraction, copying and related application of data on the basis of standardized coding of data elements and metadata. The method is a bottom logic and key rule for realizing data cross-system sharing exchange and innovative application.

The data map realizes the standard editing, intelligent management, associated application and sharing openness of data by standardizing data elements and metadata and making data templates according to national, industrial and local standards so as to improve the data resource activation and management energy levels of various industrial fields; the system is a bottom logic and key rule system for realizing data cross-system shared exchange and innovative application, is a premise for solving data mixing, improving data quality and promoting data innovative application, is a three-in-one management platform integrating an information resource directory system, an exchange system and an open system, and lays a foundation for optimizing a data system, exploring a data relationship and driving data services.

4.1 data element standardization management

The method comprises the steps of screening out main data of commonality and key in various industry fields around information resource acquisition requirements, establishing a field pool related to core data, standardizing attributes such as naming, format and length of fields, cataloging information items of information resources by relying on a data element pool, strictly controlling newly added fields and realizing unified standard standardization of commonality data elements.

4.2 information resource catalog management

Providing metadata management, and realizing the custom configuration of information resources and data metadata directories; providing the functions of information resource registration, release, audit, logout and the like; providing directory browsing and retrieval service, and realizing retrieval of keywords, classifications, information resource codes and the like; providing resource service, realizing sharing and demand application; and providing a resource statistical service, and realizing statistical analysis of information resources and data elements according to different dimensions.

4.3 information resource Association analysis

The method provides functions of frequency analysis, subset analysis, association analysis and the like of the data elements, counts the use frequency of a certain data element, analyzes the relation between the same type items of the data elements, and analyzes the association between the information resources and the data elements.

(2) Clearing module

The clearing module may include a clearing portal, a management platform, and a payment platform. The group and the bank adopt a bank-enterprise direct connection cooperation mode, and the clearing and settling platform directly realizes the functions of payment, account checking, clearing, settlement and the like of data transaction funds by directly butting the existing 13 bank channels (the third party payment such as WeChat, payment treasure and the like can be opened according to business development in the later period to realize multi-channel payment). The clearing module may specifically include a funds clearing portal, a management platform, and a payment platform.

(1) Settlement portal

The clearing and settlement portal mainly aims at providing an Internet access channel for data transaction members, namely data supply and demand parties to complete various services and payment requirements, and has the functions of account management (binding cards, unbinding, payment password modification and the like), settlement management (charging for deposit, withdrawal for deposit, invoice confirmation and the like), settlement inquiry (order inquiry, invoice inquiry, deposit and withdrawal inquiry, detail inquiry and the like), electronic receipt, fund management, system management (account management, role management, authority management and the like) and the like.

(2) Management platform

The management platform mainly provides a unified management function for the data transaction platform operator and the service supervisor, and the unified management function comprises services such as service inquiry, statistics, charging, member service and the like.

(3) Payment platform

The payment platform is mainly used for connecting each external payment channel to provide various payment services for the data transaction system, and mainly comprises services of account deposit and withdrawal, fund accounting, account clearing, settlement, account checking and the like.

(3) Bank channel interface

(1) Transaction system and third party service data interface

The data transaction system needs to be connected with a data interface of a data supplier, provides data interface service for a data demand side and guarantees smooth circulation and use of data.

(2) Transaction system and settlement module interface

The trading system transmits order information, invoice information and the like to the settlement module, and the settlement platform transfers funds for the data supply and demand party according to the order invoice and other information; the settlement module returns payment information to the transaction system, and the transaction system determines whether to provide data to the data demander according to whether the payment is successful or not.

(3) Settlement module and bank channel interface

According to the butt joint mode of the bank-enterprise direct connection, a bank-enterprise interface is established by negotiation between the group and the bank to complete the business required by the data transaction. And the settlement platform calls interfaces for the group to talk with 13 banks, and the interfaces comprise account binding, binding release, payment, deduction, account checking, account adjustment, inquiry and the like.

In the embodiment of the application, the data transaction system provides a data transaction platform for supply and demand parties and issues supply and demand information in aspects of data products, data professional talents and the like, and the data transaction platform provides comprehensive services such as identity authentication, transaction matching, transaction settlement and delivery, data hosting, safety guarantee, financial services and the like for the parties, promotes data asset circulation, establishes a sound data asset transaction mechanism and a pricing mechanism, and standardizes transaction behaviors. Further, a data transaction platform is established based on a data transaction system, hardware manufacturers, software manufacturers, application service providers, data source acquisition service providers and the like of a data ecosphere are integrated, information resources in the aspects of platforms, technologies, data (including internet data, government shared data and the like), talents and the like are provided for data innovation and creation, innovation application of the data in various industries is promoted, rapid and healthy development of data industries is promoted, and cooperation and win-win of the data industries are realized. A data transaction support platform is built based on functions of data storage, data processing, data mining, data analysis and the like, and the comprehensive application support service is provided for vast data transaction service developers around the requirements of providing customized data transaction service, API service and the like for governments and enterprises. For example, on the basis of data acquisition, cleaning and processing, a data rapid application support service such as data modeling, mining, analysis and presentation of a specific application scene is provided for a developer. The data transaction is surrounded by the data transaction, and the data asset management and value increment of the whole data life cycle such as data acquisition, processing, storage, analysis, sharing, opening, safety, filing, destruction and the like are provided for government departments and enterprises and public institutions.

Based on the data transaction system provided in the embodiment of fig. 3, a detailed description will be given next to a data processing method implemented based on the data transaction system.

Referring to fig. 5, fig. 5 is a schematic flowchart of a data processing method according to an embodiment of the present disclosure. The data processing method can be applied to a data transaction system, and the data transaction system is used for providing a data transaction platform. The data processing method may include the following steps S510 to S540:

step S510: and collecting service data on the data transaction platform.

The service data refers to service data included in any service executed on the data transaction platform, and here, the service executed on the data transaction platform may include, but is not limited to: data supply and demand service, identity authentication service for both data supply and demand parties, auditing service for supply and demand data, service for matching data transactions between supply and demand parties, data hosting service, evaluation service for data transactions, payment service and the like. In a possible implementation manner, after the service data on the data transaction platform is collected, before the service rule adapted to the service data is acquired, the collected service data may be preprocessed. Wherein the pre-treatment comprises at least one of: technical processing of a data warehouse, desensitization processing of data and cleaning processing of data.

The data warehouse technology process may include an ETL technology process, which refers to extracting (extract), converting (transform) and loading (load) data from a source to a destination.

Data desensitization processing refers to data deformation of certain sensitive information through desensitization rules to realize reliable protection of sensitive private data, under the condition of relating to client security data or some commercial sensitive data, real data needs to be modified and test use needs to be provided under the condition of not violating transaction rules of a data transaction platform, and data desensitization needs to be performed on personal information such as identity numbers, mobile phone numbers, card numbers, client numbers and the like, relating to fund amount and the like.

The data cleansing process may include re-examining and verifying the data, such as filling in missing data, deleting duplicate data, and correcting erroneous data. Meanwhile, if the data has multiple sources, relevance verification is required.

In the application, a data processing module in the data transaction system needs to perform cleaning, desensitization, analysis and other processing on the service data acquired on the data transaction platform. In one possible approach, the data processing module may provide a data processing platform, and the cleaning, desensitization, analysis, and other processes of the service data are performed on the data processing platform. Referring to fig. 6, fig. 6 is a schematic diagram of an architecture of a data processing platform according to an embodiment of the present disclosure. As shown in FIG. 6, the data processing platform architecture diagram may include an application layer, a query layer, a storage layer, a compute layer, a synchronization layer, and a source data layer.

The data processing platform adopts a mature Hadoop architecture, provides various computing frameworks such as offline computing, online computing, stream computing, memory computing and the like, can process mass data, has the capability of faster data integration development and the capability of automatic scheduling/monitoring and management of mass tasks, and supports enterprise-level mass data application.

The following respectively describes the application layer, query layer, storage layer, computation layer, synchronization layer, and source data layer:

(1) An application layer: the system comprises application products such as data products, reports, open interfaces and the like, and can realize product embodiment capable of directly interacting with users.

(2) Big data processing platform

(1) And (3) a query layer: for providing data caching or unified query functionality.

(2) A storage layer: including relational databases such as Oracle master or distributed MySQL or SQLServer, etc., and non-relational databases such as MongoDB, redis, KV, etc. A relational database is a type of database that stores and provides access to data points that are related to one another. Relational databases are based on relational models, which is an intuitive, straightforward way to represent data in tables. In a relational database, each row in a table is a record with a unique ID (called a key). The columns of the table hold attributes of the data, with each record typically having a value for each attribute, which facilitates establishing relationships between data points. The non-relational database may include: document databases, key-value databases, wide-column stores, graphic databases, and the like. The data access control proxy gateway obtains a data format corresponding to the data operation request according to plaintext data in the data operation request, determines a target resolver of a data operation request pair according to the data format, and then resolves the plaintext data in the data operation request through the target resolver to obtain an indication message of the data to be operated, wherein the indication message can be a type and a metadata structure of the data. The indication message may specifically be: which tables need to be accessed, which fields in the tables, etc.

(3) Calculating a layer: including a distributed resource management framework or computing framework, such as the hadoop2.X framework.

(4) A synchronous layer: including structured data synchronization as well as unstructured data synchronization.

(5) Source data layer: including databases, HTTP protocols, log files, and messages, etc.

In the embodiment of the application, the accuracy, consistency and integrity of the service data can be guaranteed by preprocessing the collected service data.

Step S520: and acquiring a service rule matched with the service data, and auditing and managing the service data by adopting the matched service rule.

Different service data correspond to different service rules, so after the service data are obtained, an operation management module in the data transaction system can analyze the service data, so that the service rule matched with the service data is obtained, and then the matched service rule is adopted to carry out auditing management on the service data.

For example, the service data is collected from a certain e-commerce platform, so the service rule adapted to the service data may be an e-commerce specification criterion, and then the operation management module in the data transaction system performs audit management on the service data by using the relevant e-commerce specification criterion. For another example, the business data is collected from the official network of an educational administration in a province, so the business rules adapted to the business data can be the educational standard, and then the operation management module in the data transaction system adopts the relevant educational standard to perform audit management on the business data.

Further, if the service data carries a data tag, the corresponding service rule may be matched with the data tag according to the data tag. If the service data carries the corresponding data tag, the data tag to which the service data belongs can be further analyzed according to the source of the service data or a data processing mode such as characteristic engineering and the like on the service data, then, the service rule adapted to the service data is obtained according to the data tag of the service data obtained through analysis, and the service data is audited and managed by adopting the adapted service rule.

In one possible implementation manner, the auditing management manner may at least include one or more of the following: business management, data management, marketing management, wind control management, member management, order management, report management, auditing management, evaluation management, authority management, log management, system management and the like. Each audit management mode is introduced one by one as follows:

On one hand, data management manages a data tag library, namely, the data tag library is supported to be created for transaction data from multiple dimensions, meanwhile, tags are classified and classified to form the tag library, and then the tag library is documented to form a metadata specification in an XML format. With the development of data transaction business, the label library and metadata specifications will be continuously perfected and adjusted. Based on the metadata specification, the data transaction subsystem provides more convenience for data publishing, demand publishing and data retrieval of the supply and demand parties. And on the other hand, the data template issued by the data supply and demand party is managed, and comprises data types, data details, data cases, interface details, sample information, data prices and the like.

Marketing management mainly carries out page configuration such as banner (banner), icon (icon), tab (label) and the like on a data transaction platform, carries out marketing configuration and recommendation on data simultaneously, comprises latest data, popular data, recommended data and the like imported into the platform, and can also consider adding advertising management such as promotion activities, reduction of full charge, coupons and the like on a common power provider platform.

Wind management refers to risk control management. On one hand, the method strictly monitors data transaction, avoids commercial crisis brought by improper data transaction risks, such as tracking management of data of transaction, strict clearance of transaction membership, supervision of data quality and safety and the like, implements risk supervision into management and business processes of a data transaction platform, and guarantees the openness, fairness and justness of data transaction market environment. And on the other hand, the wind control management controls transaction abnormal risks, system risks, account fund risks and the like, and ensures the stable operation of the whole platform.

The member management mainly manages the relevant information of the data transaction platform members, such as member grades, member rights and interests, points and the like.

The order management mainly manages the order type and the order state, records order real-time data such as order purchasing users, payment information, preferential information and the like, and manages information such as data transaction volume, data calling times, data calling state and the like.

The report management provides statistical analysis reports of transactions, orders, funds, accounts, users and the like, and provides convenience for later operation and popularization of the data transaction subsystem.

And the auditing management establishes an auditing, approving and managing operation mechanism based on workflow. The system is used for establishing a set of strict auditing mechanism of data and supply and demand membership for the data transaction subsystem, and ensuring that the data is transacted in a legal, fair and fair sound environment.

The evaluation management comprises management data evaluation and user feedback, and relates to screening of sensitive words or pictures and management of reply contents.

The authority management refers to the control of the data transaction platform user authority and the management of the back-end operation administrator operation authority.

The log management means providing log, operation log, server log, log backup and statistical analysis functions of the data transaction platform.

The system management is used for providing functions of personnel organization management, role management, menu management and the like.

According to the scheme, the adaptive business rules are adopted to carry out audit management on the business data, and all-dimensional operation support management functions such as transaction rules, data, audit, orders, reports and the like can be provided for the data transaction platform, so that the data transaction platform is maintained and managed.

Step S530: and converting the service data which is managed through the examination according to the standard data specification of the data transaction system to obtain the data element corresponding to the service data.

The standard data specification of the data transaction system refers to screening out common and key main data of various industry fields around the information resource acquisition requirement, establishing a field pool related to core data, standardizing attributes such as naming, format, length and the like of fields, cataloging information items of information resources by means of a data element pool, strictly controlling newly added fields and realizing uniform standard specification of common data elements.

In a possible implementation manner, the service data that is managed through the auditing is converted according to the standard data specification of the data transaction system, so that the data element corresponding to the service data can be obtained. Where a data element refers to a data element that describes definitions, identifications, representations, and allowed values with a set of attributes. Data elements, also called data types, are data units described by a series of attributes, such as definition, identification, representation, and allowable values. The smallest unit of data that is considered to be non-separable in a particular semantic context. In addition, a data element generally consists of three parts: object, property, representation.

In addition, the role of the data elements may include at least the following:

1. the data elements themselves are also data units, i.e. also data.

2. Data elements are a method or set of guidelines for self-normalizing data in various industries.

3. The method is used for standardizing and classifying the industry data according to the name, type and value.

4. After the industry data elements are planned, a foundation can be laid for the industry to construct a unified, integrated and stable data model, and a foundation is laid for data exchange.

Step S540: and updating the data map of the data transaction system according to the data elements corresponding to the service data.

The data map is a core technical system which can realize free editing, extraction, copying and associated application of data on the basis of standardized coding of data elements and metadata. The method realizes the standard editing, intelligent management, associated application and sharing openness of data by standardizing data elements and metadata and making data templates according to national, industrial and local standards so as to improve the data resource activation and management level in various industrial fields. The marked data specification is a bottom logic and key rule system for realizing cross-system shared exchange and innovative application of data, is a premise for solving data mixing, improving data quality and promoting data innovative application, is a management platform integrating three functions of an information resource directory system, an exchange system and an open system, and lays a foundation for optimizing a data system, exploring data relationships and driving data services.

In a possible implementation manner, before updating the data map of the data transaction system according to the data element corresponding to the service data, the data map of the data transaction system needs to be constructed, which may specifically include: firstly, a database of a data transaction system is obtained, wherein a plurality of data elements are stored in the database, each data element corresponds to one service data, and each data element comprises one or more tags; and then, combing the database according to the label of each data element to construct a data map of the data transaction system. Wherein the label comprises any one of the following: the label is used for indicating the type of the service to which the data element belongs, the label is used for indicating the source of the service data corresponding to the data element, and the label is used for indicating the open authority of the data element.

The databases of the data transaction system may include, for example, relational or non-relational databases. A relational database is a type of database that stores and provides access to data points that are related to one another. Relational databases are based on relational models, which is an intuitive, straightforward way to represent data in tables. In a relational database, each row in a table is a record with a unique ID (called a key). The columns of the table hold attributes of the data, with one value for each attribute typically being recorded, which makes it easy to establish relationships between data points. The non-relational database may include: a document database, a key-value database, a wide-column storage and graph database, etc. The data access control proxy gateway obtains a data format corresponding to the data operation request according to the plaintext data in the data operation request, determines a target resolver corresponding to the data operation request according to the data format, and then resolves the plaintext data in the data operation request through the target resolver to obtain an indication message of the data to be operated, wherein the indication message can be the type and the metadata structure of the data. The indication message may specifically be: which tables need to be accessed, which fields in the tables, etc. For example, relational databases may include Oracle master or distributed MySQL or SQLServer, etc., and non-relational databases may include MongoDB, redis, and KV databases, etc.

The database stores a plurality of data elements, each data element comprises one or more tags, and each data element corresponds to one service data. The tags may be labeled according to the type of the service to which the data elements belong, for example, if the type of the service to which the data elements belong is a sales service, the tags may be sales, and if the type of the service to which the data elements belong is a training service, the tags may be education. Certainly, the service types may be more finely divided according to different actual service scenarios, for example, for a sales service, the service types may be further divided into restaurants, clothing, home appliances, and the like, and further, the service types are further divided into finer service types, and the corresponding tags may also correspond to the finer service types correspondingly, for example, if the service types are clothing sales services under the sales service, the tags may be clothing sales.

In addition, the tag may also be labeled according to the source of the service data corresponding to the data element. If the source of the business data corresponding to the data element is an e-commerce data transaction platform, the label can be an e-commerce, and if the source of the business data corresponding to the data element is a government organ, the label can be a government. Similarly, the sources of the service data corresponding to the data elements may be further divided according to actual situations, for example, provinces and cities may be further divided according to different places in the case where the sources are government agencies. Such as a governmental agency in guangzhou, guangdong province, and of course, may further distinguish which government agency, division, etc., is the governmental agency.

In addition, the tag may be labeled according to the open authority of the data element. Because a large amount of data is stored in the data map of the data transaction system, not all people can view all the data, and therefore, corresponding labels can be set for the opening authority of certain specific data. For example, all relevant data of XXX tax authority is only open to local tax authority relevant authority units, so the label set to indicate that only relevant authority units with view rights can view.

In a possible implementation manner, the updating the data map of the data transaction system according to the data element corresponding to the service data specifically may include: adding the data elements of the business data into a data map of the data transaction system according to the labels of the data elements of the business data; or, according to the label of the data element of the business data, the business data matched with the label of the data element is obtained from the data map of the data transaction system, and the like.

In one possible implementation manner, when a transaction requirement for any data element in the data map exists, the required data element is converted into corresponding service data to be output; when a call request for any data element in the data map exists, the requested data element is subjected to statistical analysis based on the data map, and a statistical report about the requested data element is generated and output.

For example, if a user needs to perform a transaction request on a certain data element in the data map, the target data element required by the user may be obtained from the data map according to a tag of the required data element, the target data element is converted into corresponding target service data according to a standard data specification of a data transaction system corresponding to the target data element, and finally the target service data is output to the user.

For another example, when a user needs to search or obtain a certain data element in the data map, a statistical analysis may be performed on the number of times of invoking the data element according to the data map (where the number of times of invoking each data element is recorded in the data map), for example, how many times the data element is invoked by the user in a target time period, or how many times the data element is updated by the user in the target time period, and so on. And finally, obtaining a statistical result according to the statistical analysis of the data element, and outputting the statistical result in a statistical form. Subsequently, the user can view the call request service related to the data element directly based on the statistical form.

In one possible implementation, the service data comprises payment data to be processed. Determining a target payment system according to the payment data, wherein the data transaction system is connected with at least one payment system, and each payment system provides a payment interface for the data transaction system; and then, calling a payment interface of the target payment system to send the payment data to the target payment system for clearing and settlement processing, and receiving a processing result returned by the target payment system.

For example, if the service data is payment data between the user a and the platform B, a specific amount of money that the user a needs to pay the platform B may be determined according to the payment data, and the payment channel may be a bank cooperating with or interfacing with the platform B, the interfacing bank includes one or more banks, then the user a may select from the one or more banks interfacing with the platform B, assuming that the bank a is used, and then the user a pays the platform a through the bank a, and if the payment is successful, the bank a returns a message indicating that the payment is successful to the user a and the platform B. Subsequently, related transaction orders or transaction certificates and the like can be provided according to the transaction between the user A and the platform B. Of course, in addition to using a bank interfacing with the platform, the data transaction system may also customize the payment channels available for selection by the user, such as a payment treasure or the like.

In order to implement the data transaction system provided in the embodiment of fig. 3, the overall framework of the data transaction system adopts the cascading architecture shown in fig. 7, and the cascading architecture may be a three-layer technical structure. The external system can also call the interface function of the data transaction system provided by the application in a data mode of a Hypertext Transfer Protocol (HTTP) Protocol JSON (JavaScript Object Notation). Referring to fig. 7, fig. 7 is a schematic diagram of a cascading architecture of a data transaction system according to an embodiment of the present disclosure. As shown in fig. 7, the three-layer technical architecture diagram may specifically include a presentation layer, a business service layer, and a data service layer. The data transaction mall module is arranged on the presentation layer; the operation management module, the data processing module and the settlement module are integrated in a business service layer; the data map module is arranged on the data service layer.

In the three-layer technical architecture diagram shown in fig. 7, the data trading system in the embodiment shown in fig. 3 can be deployed, and the data trading system can be deployed in a city-level data trading platform, and provides information resources in the aspects of platforms, technologies, data (including internet data, government shared data, and the like), talents, and the like for data innovation and creation by integrating hardware manufacturers, software manufacturers, application service providers, data source acquisition service providers, and the like of a data ecosphere, so as to promote innovation application of data in various industries, promote rapid and healthy development of data industries, and realize cooperation and win-win of data industries. A data transaction support platform is built based on functions of data storage, data processing, data mining, data analysis and the like, and the comprehensive application support service is provided for vast data transaction service developers around the requirements of providing customized data transaction service, API service and the like for governments and enterprises. For example, on the basis of data acquisition, cleaning and processing, a data rapid application support service such as data modeling, mining, analysis and presentation of a specific application scene is provided for a developer. The data transaction is surrounded to provide the asset management of the whole data life cycle such as data acquisition, processing, storage, analysis, sharing, opening, safety, archiving, destruction and the like for government departments and enterprises and public institutions, so that the data asset management and value increment are realized.

The following introduces the functional functions of the presentation layer, the business service layer and the data service layer and the detailed process of data interaction among the presentation layer, the business service layer and the data service layer respectively:

(1) Introduction to the function of each layer

(1) The presentation layer is a first layer and comprises a foreground mall (namely a data transaction mall module), a background management system, a mobile client, a search system, an order system, a member system and an external open interface API service. The main function is to realize user interaction and data representation, collect data for subsequent processing, request the service logic service layer of the second layer to call core service processing, and return the processing result.

(2) The business service layer is a second layer and comprises commodity service, order service, payment service, settlement service and search system service. The business service component is formed by calling a plurality of business logic components and managed by the middleware, core business logic services are realized, the services are broadcasted according to names, the service request of the front end is managed and accepted, data operation is submitted to the data service layer, and the processing result is returned to a requester, namely a public front end or other servers.

The search system mainly realizes the search function by calling Solr service, wherein Solr is an independent enterprise-level search application server and provides an API (application programming interface) similar to Web-service for the outside. A user can submit an XML file with a certain format to a search engine server through an http request to generate an index; and a search request can also be provided through an Http Get operation, and a return result in an XML format is obtained.

(3) The data service layer is a third layer and comprises a database and a data service component. The database is responsible for managing the data resources of the application system and completing data operation, and the data service component accesses the data managed by the database manager in the process of completing service.

(2) Calling relation of each layer

(1) The presentation layer realizes data exchange between the system and the outside. For a system user, the presentation layer receives data input of the user, realizes specific business functions by calling business logic components and business logic components of the business service layer, returns a processing result to the contact interface layer, and utilizes an interactive interface to represent the processing result. For the external system, the business process completes data exchange with the external system through the interface service of the contact interface layer.

(2) The business logic component of the business logic layer accesses the business data through the data service component of the data service layer. The service logic components finish basic service functions by calling the service logic components, and a group of service logic components realize specific service functions. The business service layer realizes the sharing of business logic by providing a uniform business process to the presentation layer.

(3) The data service component of the data service layer provides uniform and standard database access service for the service platform, shields details of storage, organization and access of the service data, and realizes full sharing of the service data. The business service layer accesses business data through the data service component.

In the embodiment of the application, the data transaction system deployed by adopting the three-layer technical architecture can provide a data transaction platform for a data supplier and a data demander, and release supply and demand information in aspects of data products and the like. The method can promote the circulation of data elements, standardize data transaction behaviors, maintain the market order of data transaction, protect the legal rights and interests of all data transaction parties, create an industry ecosphere of data service, provide comprehensive services such as information release, transaction match, transaction settlement, delivery, data processing, data hosting, safety guarantee, financial service and the like for all data transaction parties, and provide guarantee measures such as law, technology, authenticity certification and the like for data transaction; based on data circulation, assist the government to accelerate the open sharing of government affair data, realize the maximize that government data value released, cultivate novel attitude, helping hand economy changes, leads data industry development.

In addition, the data transaction system provided in the embodiment of fig. 3 may also adopt a Service-Oriented Architecture (SOA) distributed Architecture, in addition to the implementation of deployment by using a cascaded Architecture diagram. A Service Oriented Architecture (SOA) is a component model that splits different functional units of an application (called services) and ties them together by defining well defined interfaces and protocols between them. The interface is defined in a neutral manner and should be independent of the hardware platform, operating system, and programming language in which the service is implemented. This allows services built into a wide variety of systems to interact in a uniform and versatile manner.

Referring to fig. 8, fig. 8 is a schematic diagram illustrating a distributed architecture of a data transaction system according to an embodiment of the present application. In the embodiment of the application, a service-oriented idea can be realized by adopting an SOA distributed architecture, the middleware uses a core framework for Dubbo service governance released by Alibab to manage the services of the whole system, and a zookeeper is selected as a registration center, so that the architecture supports a virtualized environment and can be deployed on a cloud platform. The system is designed for a distributed architecture of microservice, and the business function can be expanded by adding a service interface. In the SOA distributed architecture diagram shown in fig. 8, the SOA distributed architecture diagram may specifically include a resource layer, a building layer, a service layer, a flow layer, and an application layer. The data transaction mall module is arranged on the application layer; the operation management module, the data processing module and the settlement module are distributed on the process layer, the service layer and the component layer; the data map module is arranged on the resource layer.

The SOA distributed architecture diagram shown in fig. 8 may be used to deploy the data transaction system in the embodiment of fig. 3, the data transaction system may be deployed in a city-level data transaction platform, and a hardware manufacturer, a software manufacturer, various application service providers, a data source acquisition service provider, and the like that integrate a data ecosystem provide information resources in the aspects of a platform, technology, data (including internet data, government shared data, and the like), talents, and the like for data innovation and business, so as to promote innovative application of data in various industries, promote rapid and healthy development of data industries, and realize cooperative win-win of data industries. A data transaction support platform is built based on functions of data storage, data processing, data mining, data analysis and the like, and all-round application support services are provided for vast data transaction service developers around the requirements of providing customized data transaction services, API services and the like for governments and enterprises. For example, on the basis of data acquisition, cleaning and processing, a data rapid application support service such as data modeling, mining, analysis and presentation of a specific application scene is provided for a developer. The data transaction is surrounded to provide the asset management of the whole data life cycle such as data acquisition, processing, storage, analysis, sharing, opening, safety, archiving, destruction and the like for government departments and enterprises and public institutions, so that the data asset management and value increment are realized.

The following introduces the functional roles of the resource layer, the construction layer, the service layer, the process layer and the application layer and the detailed process of data interaction among the resource layer, the construction layer, the service layer, the process layer and the application layer respectively:

(1) Resource layer

And the data access outside the system is adapted, the data is converted and encapsulated, a uniform data interface is realized, and the inside of the system is divided into an access part, a push part and a resource access part.

(2) Application layer

By encapsulating and sharing system services, application systems with different sizes and scales can be constructed, such as portal systems, application systems, unified authentication, single sign-on and other applications. Corresponding to the service reuse and the service integration realized by the service layer, the application layer adopts Portal technology to realize the integration of application and the integration of an interface. The Portal technology can conveniently integrate information data which are needed by employees and come from various channels into a unified desktop window.

(3) Service management

The component layer, the service layer and the process layer jointly realize the function of service management and provide complete SOA service management capability, including the functions of service monitoring, resource monitoring, rule management, dynamic scheduling, service deployment, log analysis and the like. Therefore, effective monitoring and management of the service are realized, and the operation and maintenance efficiency of the IT department is improved. The component layer may include an Enterprise Service Bus (ESB), business Process Management (BPM), a search component, and an infrastructure component library, etc., so as to provide an infrastructure of the Service component for the Service. The service layer comprises basic service components, business service components, service assembly, protocol binding and the like, so that unified protocols and interconnection and interworking are realized. The process layer may include process orchestration, business rules, process management, and process monitoring to implement service orchestration functions.

In a possible implementation manner, please refer to fig. 9, and fig. 9 is a schematic structural diagram of a service administration provided in an embodiment of the present application. As shown in fig. 9, the SOA service governance may include functional links such as service definition, service security, service test, service ownership, service monitoring, message model, registry, service migration, service version, and service deployment. And then, introducing each functional link of each service governance one by one:

service definition: for defining the scope, interface and boundaries of the service.

Service security: the method is used for realizing service consumer authorization on different services and defining access rules.

And (3) service test: the service after the scale update of the service consumer and the service provider is tested from the respective layer.

Service ownership: the method is used for determining the service responsible person, and is convenient for confirming the maintenance responsibility of the service.

Service monitoring: and the service running state monitoring and alarming are beneficial to service scheduling management.

And (3) message model: a data model is defined, and the service provider shares usage with the service consumer.

The registration center: and information such as service state, version, provider and the like is stored, service consumer searching is provided, and the distributed cluster deployment is facilitated.

Service migration: the version compatibility of the service is easy, and the new version service and the old version service are started and retired.

Service version: and simultaneously coexisting the versions of the service and managing the multiple versions.

Service deployment: managing deployment of service plans, tests, releases, logouts, and the like throughout the life cycle.

In conclusion, all links are mutually matched and linked to provide service management capability for the data transaction system together, so that the normal operation of the data transaction system deployed by adopting the SOA distributed architecture is realized.

In the embodiment of the application, the data trading system deployed by adopting the service-oriented distributed architecture can provide a data trading platform for a data supplier and a data demander and issue supply and demand information in aspects of data products and the like. The method can promote the circulation of data elements, standardize data transaction behaviors, maintain the market order of data transaction, protect the legal rights and interests of all data transaction parties, create an industry ecosphere of data service, provide comprehensive services such as information release, transaction match, transaction settlement, delivery, data processing, data hosting, safety guarantee, financial service and the like for all data transaction parties, and provide guarantee measures such as law, technology, authenticity certification and the like for data transaction; based on data circulation, assist the government to accelerate the open sharing of government affair data, realize the maximize that government data value releases, cultivate novel attitude, helping hand economy transformation, lead data industry development.

Referring to fig. 10, fig. 10 is a schematic structural diagram of a distributed service component according to an embodiment of the present application. The data transaction system provided by the application mainly uses a distributed architecture to meet system requirements, realizes the output and input functions of the RPC service with high application performance by using a dubbo, can be seamlessly integrated with a spring frame, is loosely coupled, is easy to integrate and highly available.

By using the registry, a service provider publishes services to the registry, and a service consumer can subscribe services through the registry and receive service change notifications of the service provider, so that the details of the service provider, including sensitive information such as server addresses, can be hidden, and the service consumer can only obtain registered provider services through the registry and cannot directly cross over the registry to be directly connected with the service provider. The mode can use the service of the monitoring center, can monitor and analyze the calling condition of the service, and can use the Dubbo service management center, thereby facilitating the management of the service. The structure of a Dubbo distributed service assembly using a registry is shown in fig. 10 below. The structure diagram of the distributed service component shown in the embodiment of the application has the following four characteristics:

(1) Connectivity

The registration center is responsible for registration and search of service addresses, is equivalent to directory service, and the service providers and the service consumers only interact with the registration center when starting, and the registration center does not forward requests and has low pressure.

The monitoring center is responsible for counting the calling times, calling time and the like of each service, counting the number of times of calling each service is sent to the monitoring center server once every minute after the services are summarized in the memory, and displaying the statistics by a report. The service provider registers the services it provides with the registry and reports the invocation time to the monitoring center, which time does not involve network overhead. The service consumer obtains the address list of the service provider from the registration center, directly calls the provider according to the load algorithm, and simultaneously reports the calling time to the monitoring center, wherein the time comprises network overhead.

The registration center, the service provider and the service consumer are all in long connection, except the monitoring center. The registration center senses the existence of the service provider through the long connection, the service provider goes down, and the registration center immediately pushes the event to notify the consumer. The registry and the monitoring center are all down, the operated providers and the operated consumers are not affected, and the consumers cache the provider list locally. The registration center and the monitoring center are optional, and the service consumer can directly connect with the service provider.

(2) Robustness

The monitoring center is down, the use is not influenced, and only part of sampling data is lost. After the database is crashed, the registration center can still provide service list query through the cache, but new services cannot be registered, the registration center peer-to-peer clusters automatically switch to another cluster after any one cluster is crashed. After the registration center is completely stopped, the service provider and the service consumer can still communicate through the local cache. The service provider is in a non-state, and the use is not influenced after any one service provider is in a downtime state. After the service provider is completely down, the service consumer application will not be used and reconnects indefinitely to wait for the service provider to recover.

(3) Elasticity and flexibility

The registry is a peer-to-peer cluster, machine deployment instances can be dynamically added, and all clients can automatically discover a new registry.

The service provider is stateless, machine deployment instances can be dynamically added, and the registry pushes new service provider information to the consumer.

(4)Zookeeper

Apache zookeeper is adopted by the registration center, is a reliable coordination system for a large-scale distributed system, and is used for maintaining the service state of each service node in the distributed system. zookeeper supports clustering, a main registration center is down and automatically switched to a standby registration center, and single-point faults are eliminated. Most of large Internet companies adopt zookeeper, and the stability and reliability are verified.

Referring to fig. 11, fig. 11 is a network deployment diagram of a data transaction system according to an embodiment of the present application. The network deployment map provided by the embodiment of the application can be based on a machine room of a square in group times, a server, network equipment and the like are added on the basis of the existing network environment, and the network deployment map is shown in fig. 11. Wherein, a DMZ zone (isolated zone) may correspond to a presentation layer (i.e. front end) in the cascaded architecture diagram of fig. 7, or a DMZ zone may correspond to an application layer in the distributed architecture diagram of fig. 8; the application server cluster may correspond to a business service layer in the cascaded architecture diagram of fig. 7, or the application server cluster may correspond to a flow layer, a service layer, and a component layer in the distributed architecture diagram of fig. 8; the database server may correspond to a data services layer in the cascaded architecture diagram of FIG. 7, or the database server may correspond to a resource layer in the distributed architecture diagram of FIG. 8; the large data processing server cluster may correspond to the data processing platform of fig. 6.

In order to achieve the purposes of server sharing of different applications, single-point failure avoidance, centralized management, unified configuration and the like, the servers are not divided by the applications, all the servers are used in a unified mode, each server can provide services for a plurality of applications, and when the access amount of some applications is increased, the performance of the whole server cluster is improved by adding server nodes. The data transaction system provided by the application adopts a service-oriented distributed architecture design, so that the system supports the service function expansion by adding a service interface on service; the technology supports horizontal extension, and the performance level of the system is improved by adding servers.

IT should be noted that the goal of the SOA distributed service framework is to make the IT infrastructure more flexible and reusable to ultimately achieve business agility. Cloud computing includes IaaS, paaS, and SaaS, and aims to improve the utilization rate of IT resources and reduce IT costs. The SOA distributed service framework is only a framework technology of cloud computing, and is not necessary, and the development of the distributed technology is the basis of the cloud computing. The SOA architecture can be based on the cloud, the service of the cloud can be packaged and arranged by adopting the SOA technical architecture, and the PaaS layer of the cloud computing can provide calls in a service form. The two are not in one layer, have not much comparability, but can be fused with each other.

The network deployment diagram of the data transaction system provided by the embodiment of the application supports business function expansion by adding a service interface on business; the technology supports horizontal expansion, and the performance level of the system is improved by adding servers.

Referring to fig. 12, a network deployment diagram of the data transaction system based on fig. 11 is shown, and fig. 12 is a schematic structural diagram of a load balancing system according to an embodiment of the present disclosure. The load balancing system is constructed on the basis of the original network structure, and provides a transparent, cheap and effective method for expanding the bandwidth of the server and the network equipment, enhancing the network data processing capacity, increasing the throughput and improving the availability and the flexibility of the network.

As shown in fig. 12, the load balancing system is divided into hardware and software. Hardware load balancing is efficient but expensive, such as F5. The software load balancing system is low in price and low in efficiency compared with a hardware load balancing system. The network deployment diagram of the data transaction system provided by the embodiment of the application mainly combines a hardware load balancing system and a software load balancing system, so that the operation efficiency of the data transaction system can be improved, and the cost can be controlled.

Further, based on the architecture diagram of the load balancing system provided in fig. 12, please refer to fig. 13, where fig. 13 is an architecture diagram of a database read-write separation provided in an embodiment of the present application. Because the Web front end of the data transaction system provided by the embodiment of the application adopts the load balancing cluster structure to improve the effectiveness and the expansibility of the service, the database must be high-reliability to ensure the high reliability of the whole service system, and the characteristic that the database of Web application reads more and writes less is considered.

In summary, data transaction is a new thing, and the circulation mechanism, pricing mechanism, transaction rule, data authority, laws and regulations of data are all advancing in exploration. The data transaction system provided by the embodiment of the application provides a data transaction platform for supply and demand parties and issues supply and demand information in aspects of data products and the like. The data transaction platform provides comprehensive services such as identity authentication, transaction matching, transaction settlement and delivery, data hosting, security assurance, financial services and the like for all parties. The data trading platform establishes a healthy data asset trading matching mechanism and a pricing mechanism and standardizes trading behaviors. Further, the data transaction system provided by the embodiment of the application provides effective support for the transaction and circulation of data elements in China, and at least has the following effects:

(1) Government data sharing is facilitated. It is estimated that 80% of data is government data, and how to legally and safely open government organization data to serve the society is a crucial link for data opening.

(2) The establishment of the data transaction system promotes the integration and the opening of government data, releases the value of the government data and organization data and encourages the cross-border application based on an open platform and integrated data by establishing a data open standard, defining relevant specifications such as a classification standard, an open catalogue, a data format standard, an interface standard and the like.

(3) Government data does not have obvious commercial value per se, but can generate huge commercial value and social value after being processed by some companies.

(4) And (4) creating a data ecological circle and promoting the recruitment and quotation. The establishment of the data transaction platform not only creates considerable tax for the local, contributes to the public function exertion of the government, but also exerts the driving and gathering effect of the data transaction platform on member units, and serves as an assistant for local government to recruit and quote.

(5) The data transaction system gathers the induced funds, improves the local investment level, brings employment posts for local residents, and on the other hand, directly and indirectly pulls local consumption and promotes the local economic development.

Referring to fig. 14, a schematic structural diagram of a data processing device provided in an exemplary embodiment of the present application is shown, where the data processing device 140 includes at least a processor 1401, a computer-readable storage medium 1402, and a communication interface 1403. The processor 1201, the computer readable storage medium 1402, and the communication interface 1403 may be connected by a bus or other means, among others. Communication interface 1403 may be used to receive or transmit data. A computer readable storage medium 1402 may be stored in the memory, the computer readable storage medium 1402 for storing a computer program for a cross-chain cooperative remediation system, i.e. the cross-chain cooperative remediation system is deployed in the form of a computer program in the computer readable storage medium 1402, the computer program comprising computer instructions. Processor 1401 is configured to execute computer instructions. The processor 1401 (or CPU) is a computing core and a control core of the data Processing apparatus 140, and is adapted to implement one or more computer instructions, and specifically to load and execute the one or more computer instructions so as to implement the corresponding method flow or the corresponding function.

Embodiments of the present application also provide a computer-readable storage medium (Memory), which is a Memory device in the data processing device 140 and is used for storing programs and data. It will be appreciated that the computer readable storage medium 1402 herein may comprise a built-in storage medium in the data processing apparatus 140, and may of course also comprise an extended storage medium supported by the data processing apparatus 140. The computer readable storage medium provides a storage space that stores an operating system of the data processing apparatus 140. Also stored in this memory space are one or more computer instructions, which may be one or more computer programs (including program code), suitable for loading and execution by processor 1401. Note that the computer-readable storage medium 1402 may be a high-speed RAM (Random Access Memory) or a Non-Volatile Memory (Non-Volatile Memory), such as at least one disk Memory; and optionally at least one computer readable storage medium located remotely from the aforementioned processor 1401.

Stored in computer-readable storage medium 1402 is a computer program comprising one or more computer instructions; one or more computer instructions are loaded and executed by processor 1401 to implement the corresponding steps in the method embodiment of fig. 5; in particular implementations, computer instructions in the computer-readable storage medium 1402 are loaded by the processor 1401 and perform the following steps:

collecting service data on a data transaction platform;

In one possible implementation, after one or more computer instructions in the computer-readable storage medium 1202 are loaded and executed by the processor 1201, and before a business rule adapted to business data is obtained, the following steps are further performed:

preprocessing the collected service data;

the pre-treatment comprises at least one of: technical processing of a data warehouse, data desensitization processing and data cleaning processing.

In one possible implementation, one or more computer instructions in the computer-readable storage medium 1202 are used by the processor 1201 to further load and perform the steps of:

the method comprises the steps of obtaining a database of a data transaction system, wherein a plurality of data elements are stored in the database, each data element corresponds to one service data, and each data element comprises one or more tags;

combing the database according to the label of each data element to construct a data map of the data transaction system;

wherein the label comprises any one of: a label used for representing the type of the service to which the data element belongs, a label used for representing the source of the service data corresponding to the data element, and a label used for representing the open authority of the data element.

In one possible implementation, the business data comprises payment data to be processed, and the one or more computer instructions in the computer-readable storage medium 1202 are further used by the processor 1201 to load and execute the steps of:

determining a target payment system according to the payment data, wherein the data transaction system is connected with at least one payment system, and each payment system provides a payment interface for the data transaction system;

calling a payment interface of the target payment system to send the payment data to the target payment system for settlement processing; and (c) a second step of,

and receiving a processing result returned by the target payment system.

In one possible implementation, one or more computer instructions in the computer-readable storage medium 1202 are also used by the processor 1201 to load and perform the steps of:

when the transaction requirement for any data element in the data map exists, converting the required data element into corresponding service data and outputting the service data;

when a call request for any data element in the data map exists, the requested data element is subjected to statistical analysis based on the data map, and a statistical report about the requested data element is generated and output.

In the embodiment of the application, the data transaction system provides a data transaction platform, various adaptive business rules can be formulated for various businesses in the data transaction platform according to needs, and when the business data are collected, the business data can be globally and effectively audited and managed through the adaptive business rules, so that the effective management of the whole process of each business in the data transaction platform can be realized, and the business safety and the management strength are improved; in addition, the business data managed by auditing can be converted into standard data elements according to standard data specifications in the data transaction system and added into a data map of the data transaction system, so that the standardized and unified management of the business data can be realized, and the monitoring management of the business data from data acquisition to the whole life cycle of data transaction is realized.

According to an aspect of the application, there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. A processor of a computer device (which may be, for example, the cross-chain cooperative governance device described above) reads the computer instructions from the computer readable storage medium, and executes the computer instructions, so that the computer device executes the cross-chain cooperative governance method provided in the various alternatives described above.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A data processing method is characterized in that the method is applied to a data transaction system, and the data transaction system is used for providing a data transaction platform; the method comprises the following steps:

collecting service data on a data transaction platform;

and updating the data map of the data transaction system according to the data element corresponding to the service data.

2. The method of claim 1, wherein after collecting the business data on the data transaction platform and before obtaining the business rules adapted to the business data, further comprising:

preprocessing the acquired service data;

the pretreatment comprises at least one of the following: technical processing of a data warehouse, data desensitization processing and data cleaning processing.

3. The method of claim 1, wherein the method further comprises:

acquiring a database of the data transaction system, wherein a plurality of data elements are stored in the database, each data element corresponds to one service data, and each data element comprises one or more tags;

wherein the tag comprises any one of: the label is used for indicating the type of the service to which the data element belongs, the label is used for indicating the source of the service data corresponding to the data element, and the label is used for indicating the open authority of the data element.

4. The method of claim 1, wherein the transaction data comprises pending payment data, the method further comprising:

and receiving a processing result returned by the target payment system.

5. The method of any one of claims 1-4, further comprising:

when a call request for any data element in the data map exists, performing statistical analysis on the requested data element based on the data map, and generating and outputting a statistical report about the requested data element.

6. A data transaction system, characterized in that the data transaction system comprises:

the data transaction mall module is used for displaying a service interface of a data transaction platform and collecting service data on the data transaction platform in the service interface;

the operation management module is used for acquiring the service rule adapted to the service data and adopting the adapted service rule to carry out auditing management on the service data;

the data map module is used for converting the service data which passes the auditing management according to the standard data specification of the data transaction system to obtain a data element corresponding to the service data; and updating the data map of the data transaction system according to the data element corresponding to the service data.

7. The system of claim 6, wherein the data trafficking system further comprises:

the data processing module is used for preprocessing the acquired business data;

the pretreatment comprises at least one of the following: technical processing of a data warehouse, desensitization processing of data and cleaning processing of data.

8. The system of claim 6, wherein the data map module is further configured to obtain a database of the data transaction system, the database storing a plurality of data elements, each data element corresponding to one service data, and each data element comprising one or more tags; the database is combed according to the label of each data element, and a data map of the data transaction system is constructed;

wherein the tag comprises any one of: the label is used for representing the service type of the data element, the source directory label is used for representing the service data corresponding to the data element, and the label is used for representing the open authority of the data element.

9. The system of claim 6, wherein the transaction data includes pending payment data, the data transaction system further comprising:

the settlement module is used for determining a target payment system according to the payment data, the data transaction system is connected with at least one payment system, and each payment system provides a payment interface for the data transaction system; calling a payment interface of the target payment system to send the payment data to the target payment system for settlement processing; and receiving a processing result returned by the target payment system.

10. The system of any one of claims 6 to 9, wherein the data transaction mall module is further configured to detect a transaction requirement for any data element in the data map, and send the transaction requirement to the operation management module for audit management; if the transaction requirement passes the audit management, the operation management module sends the transaction requirement to a data map module, the data map module converts the required data elements into corresponding service data and returns the service data to the operation management platform, and the returned service data of the operation management platform is sent to a data transaction mall module and is output by the data transaction mall module; or,

the data transaction mall module is also used for detecting a calling request for any data element in the data map and sending the calling request to the operation management module for auditing management; if the transaction requirement passes the audit management, the operation management module sends the calling request to a data map module, the data map module performs statistical analysis on the requested data elements, a statistical report about the requested data elements is generated and returned to the operation management platform, and the statistical report is sent to a data transaction mall module and output by the data transaction mall module by the operation management platform.

11. The system of claim 9, wherein the data trafficking system is deployed in a cascaded architecture; the cascade type architecture comprises a presentation layer, a business service layer and a data service layer; wherein,

the data transaction mall module is arranged on the presentation layer; the operation management module, the data processing module and the settlement module are integrated in the business service layer; the data map module is arranged on the data service layer.

12. The system of claim 9, wherein the data trafficking system is deployed using a service-oriented distributed architecture; the service-oriented distributed architecture comprises an application layer, a flow layer, a service layer, a component layer and a resource layer; wherein,

13. A data processing apparatus, characterized in that the data processing apparatus carries therein a data trafficking system according to any one of claims 6 to 12 for performing the data processing method according to any one of claims 1 to 5.

14. A computer-readable storage medium, characterized in that the computer-readable storage medium comprises a computer program, which is adapted to be loaded by a processor and to carry out the data processing method of any one of claims 1-5.