CN113987088A - A data file generation method, device, device and storage medium - Google Patents

Abstract

The invention discloses a data file generation method, a data file generation device, data file generation equipment and a storage medium. The method comprises the following steps: receiving original transaction information, wherein the original transaction information carries identification information; screening the original transaction information according to a preset pushing range to obtain target transaction information; acquiring transaction subject information from at least one transaction subject system by calling a real-time interface according to the identification information; and generating a first target data file according to the target transaction information and the transaction main body information. By the technical scheme, timely and accurate data used for enterprise statistical analysis or external supervision can be ensured.

Description

A data file generation method, device, device and storage medium

technical field

The embodiments of the present invention relate to the technical fields of software engineering, information security and data processing, and in particular, to a method, apparatus, device and storage medium for generating a data file.

Background technique

With the growth of enterprise operation time and the expansion of business scale, the amount of data stored by the enterprise is also increasing. Processing and summarizing various data is an essential step for enterprise decision analysis.

In the prior art solution, data is collected from different systems, uniformly sorted and stored in the data warehouse, extracted and processed by the market under the data warehouse, converted into a required format, and sent to the exchange platform. The exchange platform receives the corresponding signal file and transmits the data to the corresponding reporting system according to the established route. Finally, the data is processed by the reporting system to generate a submission file, which is sent to the regulatory agency.

The data warehouse greatly facilitates the integration and utilization of data between multiple systems, but on this platform where a large number of data are stored together, every change in data specifications or parameters requires all the use or processing of these data in the entire data supply and demand chain. The data system is adjusted accordingly. If there are objective or subjective reasons for a system not to be adjusted accordingly at the same time, data inconsistencies between systems will occur. This kind of data inconsistency is usually the more common the difference is, the easier it is to be found. For the change of special data, the less frequent it occurs and the less affected the scope is, the less likely it is to be found. At the same time, the data warehouse takes a lot of time to load, organize and store data. Once there are resources or other problems in the intermediate process, all subsequent processes need to wait, which has a huge impact on the timeliness of data.

SUMMARY OF THE INVENTION

Embodiments of the present invention provide a method, device, device and storage medium for generating a data file, so as to ensure timely and accurate data used in enterprise statistical analysis or external supervision.

In a first aspect, an embodiment of the present invention provides a method for generating a data file, including:

receiving original transaction information, wherein the original transaction information carries identification information;

Screening the original transaction information according to the preset push range to obtain target transaction information;

Obtain transaction subject information from at least one transaction subject system by calling a real-time interface according to the identification information;

A first target data file is generated according to the target transaction information and the transaction subject information.

In a second aspect, an embodiment of the present invention also provides a data file generating device, the device comprising:

a first receiving module, configured to receive original transaction information, wherein the original transaction information carries identification information;

a screening module, configured to screen the original transaction information according to a preset push range to obtain target transaction information;

an acquisition module, configured to acquire transaction subject information from at least one transaction subject system by calling a real-time interface according to the identification information;

The first generating module is configured to generate a first target data file according to the target transaction information and the transaction subject information.

In a third aspect, an embodiment of the present invention further provides an electronic device, including a memory, a processor, and a computer program stored in the memory and running on the processor, the processor implementing the program as described in the present invention when the processor executes the program The data file generation method described in any one of the embodiments.

In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, implements the method for generating a data file according to any one of the embodiments of the present invention.

In this embodiment of the present invention, the original transaction information is received, wherein the original transaction information carries identification information; the original transaction information is screened according to a preset push range to obtain target transaction information; according to the identification information, the real-time interface is called from the Obtain transaction subject information in at least one transaction subject system; generate a first target data file according to the target transaction information and the transaction subject information. The technical scheme of the present invention can ensure that the data used in enterprise statistical analysis or external supervision is timely and accurate.

Description of drawings

In order to illustrate the technical solutions of the embodiments of the present invention more clearly, the following briefly introduces the accompanying drawings used in the embodiments. It should be understood that the following drawings only show some embodiments of the present invention, and therefore do not It should be regarded as a limitation of the scope, and for those of ordinary skill in the art, other related drawings can also be obtained according to these drawings without any creative effort.

1 is a flowchart of a method for generating a data file according to Embodiment 1 of the present invention;

2 is a flowchart of generating new link data in a data file generating method provided in Embodiment 1 of the present invention;

3 is a schematic diagram of a process of forming a new link and an original link and a comparison operation in a method for generating a data file provided in Embodiment 1 of the present invention;

4 is a flowchart of a comparison between a first target data file and a second target data file in a data file generation method provided in Embodiment 1 of the present invention;

5 is a schematic structural diagram of a data file generating apparatus provided in Embodiment 2 of the present invention;

6 is a schematic structural diagram of an electronic device according to Embodiment 3 of the present invention;

FIG. 7 is a schematic structural diagram of a computer-readable storage medium containing a computer program according to Embodiment 4 of the present invention.

Detailed ways

The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention. In addition, it should be noted that, for the convenience of description, the drawings only show some but not all structures related to the present invention. Furthermore, the embodiments of the invention and the features of the embodiments may be combined with each other without conflict.

Before discussing the exemplary embodiments in greater detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart depicts various operations (or steps) as a sequential process, many of the operations may be performed in parallel, concurrently, or concurrently. Additionally, the order of operations can be rearranged. The process may be terminated when its operation is complete, but may also have additional steps not included in the figures. The processes may correspond to methods, functions, procedures, subroutines, subroutines, and the like. Furthermore, the embodiments of the invention and the features of the embodiments may be combined with each other without conflict.

The term "including" and its variants used in the present invention are open to include, ie, "including but not limited to". The term "based on" is "based at least in part on." The term "one embodiment" means "at least one embodiment."

It should be noted that like numerals and letters refer to like items in the following figures, so once an item is defined in one figure, it does not require further definition and explanation in subsequent figures. Meanwhile, in the description of the present invention, the terms "first", "second", etc. are only used to distinguish the description, and cannot be understood as indicating or implying relative importance.

Example 1

FIG. 1 is a flowchart of a method for generating a data file provided in Embodiment 1 of the present invention. This embodiment is applicable to the case of generating a data file. The method can be executed by the device for generating a data file in the embodiment of the present invention. The device It can be implemented in software and/or hardware, as shown in Figure 1, the method specifically includes the following steps:

S101. Receive original transaction information.

The original transaction information carries identification information.

It should be noted that the original transaction information refers to transaction data, for example, a customer purchased a certain commodity of a certain merchant through a bank card payment on a certain day of a certain year in a certain month. The original transaction information carries identification information, and the identification information may be, for example, the bank card and transaction information (information such as bank card number and transaction number) of the original transaction information.

In the actual operation process, the reporting system can directly receive the original transaction information sent by the trading system, or the trading system can send the original transaction information to the exchange platform, and the reporting system can receive the original transaction information forwarded by the exchange platform.

S102. Screen the original transaction information according to a preset push range to obtain target transaction information.

The push range may be preset by the reporting system, for example, all transactions with a transaction amount greater than 1,000 yuan, or all transactions before a certain day of a certain year in a certain year.

In this embodiment, the target transaction information refers to transaction information that conforms to the push range obtained after screening the original transaction information according to the preset push range.

In the actual operation process, the reporting system filters the original transaction information according to the push range preset by the reporting system to obtain the target transaction information. For example, the push range may be all transaction information with a transaction amount greater than 1,000 yuan. After screening the original transaction information, all the obtained transaction information with a transaction amount greater than 1,000 yuan is the target transaction information.

S103: Acquire transaction subject information from at least one transaction subject system by calling a real-time interface according to the identification information.

In this embodiment, the real-time interface called is the ESB real-time data interface. The full name of ESB is EnterpriseService Bus, which is an enterprise service bus. loosely coupled.

It should be explained that the transaction subject system refers to a system that stores subjects involved in the transaction (customer information and financial card information, etc.), and the transaction subject system may be one or more. Transaction subject information refers to customer personal information (card account ID, country and ID card, etc.) and financial card information (bank card type, card issuer, institution code of the card issuing outlet, etc.) involved in the original transaction information. For example, if the original transaction information is that a customer purchased a certain commodity from a certain merchant through a bank card payment on a certain day in a certain year, the transaction subject information stored in the main system is the bank card information involved in the transaction and the cardholder's customer. personal information.

In the actual operation process, the reporting system obtains transaction subject information from at least one transaction subject system by invoking the ESB real-time data interface according to the identification information carried by the original transaction information.

S104. Generate a first target data file according to the target transaction information and the transaction subject information.

In this embodiment, the first target data file refers to the generated data file for reporting to supervision.

In the actual operation process, the reporting system filters the original transaction information according to the preset push range to obtain the target transaction information, and obtains the transaction subject information from at least one transaction subject system by calling the ESB real-time interface according to the identification information carried in the original transaction information. A first target data file is generated according to the target transaction information and the transaction subject information.

Optionally, generating the first target data file according to the target transaction information and transaction subject information includes:

The target transaction information and the transaction subject information are spliced to obtain target data.

It should be noted that splicing refers to after the reporting system obtains the target transaction information, according to the identification information carried by the target transaction information (the original transaction information carries the identification information, and the target transaction information is obtained by filtering the original transaction information according to the preset push range. , so the target transaction information also carries the identification information) by calling the real-time interface to obtain the transaction subject information matching the target transaction information from at least one transaction subject system, and compare the transaction information contained in the target transaction information with the customer personal information contained in the transaction subject information. Information and financial card information are spliced, and the data formed after splicing is the target data.

A first target data file is generated according to the data collection rule and target data.

It should be explained that the data collection rules are the daily data collection specifications set by the target organization and pre-stored in the reporting system.

Specifically, the target organization requires to generate a data interface file and use a dedicated network line to report data through the message transmission system. The target organization has specific requirements for the reporting specifications of various business data. Different business data needs to be classified and submitted, and the codes of various data codes are unified. Therefore, it is necessary to generate a data interface file that meets the requirements of the target organization according to the data collection rules for reporting. deliver.

Optionally, after generating the first target data file according to the target transaction information and the transaction subject information, the method further includes:

A second target data file is received.

It should be noted that the second target data file refers to the data collected from different systems in the prior art received by the reporting system, sorted and stored in the data warehouse in a unified manner, and then marketed by the data warehouse (different systems correspond to different sets of data). City, equivalent to a sub-database) for extraction and processing, convert it into the required format, and send it to the exchange platform. The exchange platform receives the corresponding signal file, and transmits the data to the corresponding reporting system according to the established route. Perform processing to generate a report file, and send the data file of the target organization.

The first target data file and the second target data file are sorted according to the keywords.

Exemplarily, the keyword may be a transaction number.

In this embodiment, sorting refers to sorting both the first target data file and the second target data file according to keywords. For example, the first target data file contains data files with transaction numbers 001-099, and the second target data file also contains data files with transaction numbers 001-099. Sort from 001 to 099.

If there is a difference between the sorted first target data file and the sorted second target data file, prompt information is generated according to the difference between the sorted first target data file and the sorted second target data file.

The prompt information refers to the instruction information generated when there is a difference between the first target data file and the second target data file, for example, it may be a text prompt, or may be digital or graphic information.

In the actual operation process, after the first target data file and the second target data file are obtained, in order to ensure the accuracy of the data, the reporting system will parse the keywords of the first target data file and the second target data file, and will press the key Word sorting generates the sorted files for line-by-line comparison, and generates a comparison difference file. When there is data inconsistency, the reporting system will issue an early warning notice to the relevant business and technical personnel to ensure that the data discrepancy can be manually intervened before T+0.5 days, and the correction and processing of the problem data and the data logic optimization of the corresponding link will also be performed. can be expanded as soon as possible.

In order to ensure the timeliness of data submission, the submission system will process the second target data file into the warehouse according to the normal batch time every morning, and send the target institution after generating the submission file. If the exchange platform cannot deliver the second target data file on time, the first target data file is put into storage, and the report file is generated and sent to the target organization. The double-target data file comparison ensures the timeliness and accuracy of the submitted data.

Optionally, receiving the second target data file includes:

Receive the second target data file forwarded by the exchange platform, wherein the second target data file is the first data file stored in the data warehouse, the first data file is a data file generated based on the first data, and the first data is from the transaction system. and data obtained from the system of at least one transaction subject.

Exemplarily, the second target data file forwarded by the exchange platform is accepted, wherein the second target data file is the first data file generated by the marketplace under the data warehouse based on the first data screening and splicing, and the first data is the first data file analyzed by the data warehouse. The data file is the data stored in the data warehouse after the data file, and the first data file is a file generated by extracting and formatting the data in the transaction system and the transaction subject system.

It should be noted that the exchange platform refers to the above exchange platform, which is used to transmit data files.

In this embodiment, the data warehouse can be understood as a database, which is a subject-oriented, integrated and relatively stable data collection created to solve the online analysis processing and data mining of data between different systems, and can store a large number of The data is used for analysis and allows the use of various access technologies.

Among them, the transaction system refers to the system that stores transaction information in the source information system. The source information system includes 3 systems: transaction system, customer system and financial card system, wherein the transaction system stores the original transaction information described in the above S101, and the customer system stores the customer's personal information (card account ID, country and identity card). and other information), the financial card system stores transaction bank card information (bank card type, card issuer code, institution code of the card issuing outlet, etc.).

The first data is obtained from the transaction system and at least one transaction subject system, the data warehouse parses and stores the first data file generated based on the first data in the warehouse basic information database, and is extracted and processed by the market under the data warehouse, and converted into required data. format to obtain the second target data file. The data warehouse sends the second target data file to the exchange platform, and the exchange platform receives the corresponding second target data file and transmits it to the corresponding reporting system according to a predetermined route.

Optionally, receive raw transaction information, including:

Receive the original transaction information sent by the transaction system;

or,

Receive the original transaction information forwarded by the exchange platform.

The reporting system can directly receive the original transaction information sent by the trading system, or the trading system can send the original transaction information to the exchange platform, and the reporting system can receive the original transaction information forwarded by the exchange platform.

Wherein, the original transaction information is the transaction information of the previous day pushed by the transaction system.

It should be explained that the transaction information of the previous day refers to all the transaction information of the previous day pushed by the transaction system. Since the bank adopts daily settlement, the source information system pushes all the data of the previous day involved in the regulatory submission to the exchange platform every morning, and then the exchange platform sends the data files to the reporting system according to the rules determined by the reporting system. , sent to the target organization to ensure the timeliness of data reporting.

In the technical solution of this embodiment, the original transaction information is received, wherein the original transaction information carries identification information; the original transaction information is screened according to a preset push range to obtain the target transaction information; according to the identification information, the target transaction information is obtained by calling The real-time interface acquires transaction subject information from at least one transaction subject system; and generates a first target data file according to the target transaction information and the transaction subject information. It can ensure the timely and accurate data used in enterprise statistical analysis or external supervision.

As an exemplary description of this embodiment, FIG. 2 is a flowchart of generating new link data in a method for generating a data file provided in Embodiment 1 of the present invention. The new link is a link composed of the above-mentioned source information system, the above-mentioned exchange platform, and the above-mentioned reporting system. Correspondingly, the original link is a link composed of the above-mentioned source information system, the above-mentioned data warehouse, the above-mentioned exchange platform, and the above-mentioned reporting system.

As shown in Figure 2, the process of generating new link data in a data file generating method includes the following operations:

The transaction system in the source information system extracts all the original transaction information that should be reported the day before and sends it to the exchange platform.

The exchange platform pushes the original transaction information to the designated directory of the exchange platform. Each line in the file is a piece of transaction information, and each field of the transaction information is divided according to the agreed delimiter, and the file format and character set settings also need to be set according to the agreed format (the format and routing are agreed in advance between the source information system and the exchange platform. information).

The exchange platform receives the signal flag file that the transaction system operation is completed in the source information system (the transaction system will send the signal flag file after the data file is sent to the exchange platform, and when the exchange platform receives the signal flag file, it means that the transmission of all data files is over. ), start the file scheduling job. Send the files to be transmitted in the transaction system in the source information system to the file collection directory of the reporting system according to the specified format (the format and routing information are agreed in advance between the exchange platform and the reporting system). The reporting system is in Quartz (an open source job scheduling framework completely written in Java, for job scheduling in Java applications, allowing program developers to schedule jobs according to time intervals) timed tasks specify time points to batch execute file collection tasks , store the original transaction information in the data table, start screening, remove the transactions that do not need to be reported and the transactions that are positive and negative in the original transaction information of the previous day, and generate the target transaction information that needs to be reported.

According to the target transaction information that needs to be reported after screening, according to the identification information carried by the original transaction information, call the ESB real-time data interface one by one to obtain the target transaction information from the transaction subject system in the source information system. The corresponding transaction involves financial card information, cardholders information on customers and card issuers.

The target transaction information to be reported and the transaction subject information obtained by the ESB are spliced and stored in the same data table, and the first target data file is generated according to the daily data collection specifications. At this point, new link data is generated.

As an exemplary description of this embodiment, FIG. 3 is a schematic diagram of a process of forming a new link and an original link and a comparison operation in a method for generating a data file provided in Embodiment 1 of the present invention. This preferred embodiment is a detailed description of the formation process of the above-mentioned first target data file and the above-mentioned second target data file, and the comparison of the above-mentioned first target data file and the above-mentioned second target data file to generate prompt information.

The source information system in the original link transfers the data to the data warehouse in batches, and the data warehouse batches operate to normalize the data into the warehouse. The exchange platform is finally sent to the reporting system by the exchange platform. Due to the influence of the quality of data of each system on the original link, the frequency of logical update, the hidden problem of inventory, and the long transmission path of the link, the quality of the data obtained through the data warehouse link is poor.

In order to improve the accuracy of data reporting, the embodiment of the present invention proposes a method for adding data sources to the reporting system, directly supplying the source information system data to the reporting system, and replicating the data filtering and splicing logic of the data warehouse to the reporting system. Send the system to generate the first target data file as a new link for data supply. The new link cancels the intermediate nodes such as the data warehouse, and avoids the impact of changes in the basic information of the data warehouse and data model information on the final data. At the same time, the change of any node in the middle process of the original link and the new link can be reflected in the final data comparison, which is convenient for timely discovery and correction. The method of dual-link simultaneous supply provides an additional supply channel on the basis of maintaining the stable supply of the original link, which is used for emergency backup, abnormal detection, etc., ensuring the timeliness and integrity of data.

In Fig. 3, the source information system 1 is a transaction system, the source information systems 2 and 3 are the customer system and the financial card system, the data information 1 is the transaction information, and the data information 2 and 3 are the customer information and the financial card information.

As shown in Figure 3, the new link and the original link formation process and comparison operation in a data file generation method are as follows:

The transaction information of the new link (the vertical data information 1 in Figure 3) is sent to the reporting system by the exchange platform, and the customer information and financial card information (the vertical data information 2 and 3 in Figure 3) are sent through the enterprise service The bus is transmitted to the reporting system, and the reporting system executes the file collection task in batches at the time specified by the Quartz timing task, and stores the customer information and financial card information in the detailed data table to form the first target data file.

In order to ensure stable data submission and supervision, the original link does not make major logical modifications, and the original data flow is retained. The original data files (the horizontal data information 1, 2 and 3 in Figure 3) are composed of the basic data that has been entered into the warehouse by the market under the data warehouse, and then sent to the reporting system through the exchange platform to form the second target data document.

After the data files of the two links are obtained, by configuring cron (scheduled task, which is a timing task execution tool under Linux, it can specify the time and the specified number of times to execute the timing task, and can execute most commands under Linux) timing task. Compare data files with the help of Linux commands. Before file comparison, it is necessary to sort the first target data file and the second target data file according to the keywords, and then compare the file contents line by line, skip the same data line, and store the difference data line or another file in one file. The data lines that do not exist in the two files are output to the specified comparison result file. If there are no difference lines in the two files, the result file is an empty file; if there are different lines in the two files, the result file saves the difference lines, and generates an error report according to the difference. and data processing and reporting.

The data processing logic of the data warehouse is relatively complex, and the data accuracy is highly dependent on the data processing logic, data model design, and basic data information. By shortening the data transmission link, it reduces the problem of large data differences from the source information system due to data conversion, and at the same time realizes the shortest link supply, improves the integrity and accuracy of data reporting, and achieves the purpose of error-free data reporting. Later, dual-link synchronization comparison was added, and the two links were master and backup, which ensured the stability of the supply and enhanced the abnormal response of the supply link.

As an exemplary description of this embodiment, FIG. 4 is a flowchart of a comparison between a first target data file and a second target data file in a data file generation method provided in Embodiment 1 of the present invention. This preferred embodiment is a detailed description of the comparison process between the above-mentioned first target data file and the above-mentioned second target data file.

As shown in Figure 4, the process of comparing the first target data file and the second target data file in a data file generation method includes the following operations:

After the first target data file is generated, the first target data file is sorted according to the keywords, the second target data file is sorted according to the keywords after the second target data file is generated, and then the first target data file and the second target data file are sorted. Files are compared row by row. If there are difference lines in the two files, output the difference data lines or data lines that do not exist in the other file in one file to the specified comparison result file, and the result file saves the difference lines; if there are no difference lines in the two files, then The resulting file is an empty file.

In order to let business personnel and scientific and technical personnel know the difference of file comparison in time, in this embodiment of the present invention, after the data comparison result is generated, a Quartz timed task is added to be configured to notify the file comparison result. The task firstly judges whether the comparison result file is empty. If the comparison file is empty, there is no difference in the data of the two links. At this time, the program will notify the dual-link comparison that there is no abnormality; if the comparison file is not empty, the program will parse it. Data comparison results, get the keywords and difference fields of the difference data, and notify the relevant personnel of the difference information.

In order to ensure the timeliness of data submission, regardless of whether there are differences in the comparison results, the program will prioritize the second target data files sent from the original link into the warehouse before 7:00 in the morning on the same day to generate submission files. Send it to the target institution to ensure that large batches of data can be submitted normally. If there is a discrepancy in the data comparison of the day, after receiving the abnormal notice, the relevant personnel should investigate the reason for the discrepancy in a timely manner. After correcting as appropriate, the revised data can be re-reported before 12:00 noon on the same day to ensure that the data problem can be resolved on the same day.

For the abnormal situation where the supply of the single link is delayed or not supplied, the dual-link comparison method can enable the backup link in time after the warning that the second target data file of the original link has not arrived, and put the new link first The target data files are collected and put into the warehouse to generate the submission files, and they will be submitted first. The dual-link reporting ensures the complementary reporting of the active and standby links, so that the data is normally delivered to the supervision, and the robustness of the data reporting path is improved.

The timeliness of regulatory data submission is relatively high, and the dual-link comparison method can complete data accuracy verification before data storage. If there is abnormal data in the verification, an early warning mechanism will be triggered, and the relevant person in charge can be notified to check and correct the data, which shortens the time for manual maintenance of the data, and ensures that the data can be maintained and submitted within the time limit required by the regulatory requirements. . The embodiment of the present invention improves the quality of the data submitted for supervision, and ensures the consistency, integrity, timeliness and security of the data in the parallel process of the dual links through the dual link comparison technology.

Embodiment 2

FIG. 5 is a schematic structural diagram of a data file generating apparatus according to Embodiment 2 of the present invention. This embodiment can be applied to the case of data file generation, the device can be implemented in software and/or hardware, and the device can be integrated in any device that provides a data file generation function, as shown in FIG. 5 , the data file The generating apparatus specifically includes: a first receiving module 210 , a screening module 220 , an obtaining module 230 and a first generating module 240 .

The first receiving module 210 is configured to receive original transaction information, wherein the original transaction information carries identification information;

A screening module 220, configured to screen the original transaction information according to a preset push range to obtain target transaction information;

an acquisition module 230, configured to acquire transaction subject information from at least one transaction subject system by invoking a real-time interface according to the identification information;

The first generating module 240 is configured to generate a first target data file according to the target transaction information and the transaction subject information.

Further, the first generation module 240 includes:

a splicing unit for splicing the target transaction information and the transaction subject information to obtain target data;

A generating unit, configured to generate a first target data file according to the data collection rule and the target data.

Further, the above-mentioned device also includes:

a second receiving module, configured to receive a second target data file after generating the first target data file according to the target transaction information and the transaction subject information;

a sorting module, configured to sort the first target data file and the second target data file according to keywords after generating the first target data file according to the target transaction information and the transaction subject information; wherein, The keyword includes: transaction number.

The second generating module is configured to, after generating the first target data file according to the target transaction information and the transaction subject information, if there is a difference between the sorted first target data file and the sorted second target data file, then The prompt information is generated according to the difference between the sorted first target data file and the sorted second target data file.

Further, the second receiving module is specifically used for:

Receive the second target data file forwarded by the exchange platform, wherein the second target data file is the first data file stored in the data warehouse, the first data file is a data file generated based on the first data, and the first data file is One data is data obtained from the transaction system and at least one transaction subject system.

Further, the first receiving module 210 includes:

a first receiving unit, configured to receive the original transaction information sent by the transaction system;

or,

The second receiving unit is configured to receive the original transaction information forwarded by the exchange platform, wherein the original transaction information is the transaction information of the previous day pushed by the transaction system.

The above product can execute the data file generation method provided by any embodiment of the present invention, and has corresponding functional modules and beneficial effects for executing the data file generation method.

In the technical solution of this embodiment, the original transaction information is received, wherein the original transaction information carries identification information; the original transaction information is screened according to a preset push range to obtain the target transaction information; according to the identification information, the target transaction information is obtained by calling The real-time interface acquires transaction subject information from at least one transaction subject system; and generates a first target data file according to the target transaction information and the transaction subject information. It can ensure the timely and accurate data used in enterprise statistical analysis or external supervision.

Embodiment 3

FIG. 6 is a schematic structural diagram of an electronic device according to Embodiment 3 of the present invention. Figure 6 shows a block diagram of an electronic device 312 suitable for use in implementing embodiments of the present invention. The electronic device 312 shown in FIG. 6 is only an example, and should not impose any limitation on the function and scope of use of the embodiment of the present invention. Device 312 is a typical data file generation function computing device.

As shown in FIG. 6, electronic device 312 takes the form of a general-purpose computing device. Components of electronic device 312 may include, but are not limited to, one or more processors 316, storage 328, and a bus 318 that connects various system components including storage 328 and processor 316.

The bus 318 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of a variety of bus structures. For example, these architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, enhanced ISA bus, Video Electronics Standards Association (Video Electronics Standards Association) , VESA) local bus and peripheral component interconnect (Peripheral Component Interconnect, PCI) bus.

Electronic device 312 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by electronic device 312, including both volatile and nonvolatile media, removable and non-removable media.

Storage 328 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 330 and/or cache memory 332 . Electronic device 312 may further include other removable/non-removable, volatile/non-volatile computer system storage media. For example only, storage system 334 may be used to read and write to non-removable, non-volatile magnetic media (not shown in FIG. 6, commonly referred to as a "hard disk drive"). Although not shown in FIG. 6, a magnetic disk drive for reading and writing to removable non-volatile magnetic disks (eg "floppy disks") and removable non-volatile optical disks (eg Compact Disc-Read only) may be provided. Read Only Memory, CD-ROM), Digital Video Disc (Digital Video Disc-Read Only Memory, DVD-ROM) or other optical media) read and write optical disc drives. In these cases, each drive may be connected to bus 318 through one or more data media interfaces. Storage 328 may include at least one program product having a set (eg, at least one) of program modules configured to perform the data file generation functions of various embodiments of the present invention.

A program 336 having a set (at least one) of program modules 326, which may be stored, for example, in a storage device 328, such program modules 326 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, which An implementation of a network environment may be included in each or some combination of the examples. Program modules 326 generally perform the functions and/or methods of the described embodiments of the present invention.

The electronic device 312 may also communicate with one or more external devices 314 (eg, a keyboard, pointing device, camera, display 324, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 312, and/or Or with any device (eg, network card, modem, etc.) that enables the electronic device 312 to communicate with one or more other computing devices. Such communication may take place through input/output (I/O) interface 322 . Also, the electronic device 312 may communicate with one or more networks (eg, Local Area Network (LAN), Wide Area Network, WAN) and/or a public network such as the Internet through a network adapter 320 . As shown, network adapter 320 communicates with other modules of electronic device 312 via bus 318 . It should be understood that, although not shown, other hardware and/or software modules may be used in conjunction with electronic device 312, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, Redundant Arrays of Independent Disks, RAID) systems, tape drives, and data backup storage systems.

The processor 316 executes various functional applications and data processing by running the programs stored in the storage device 328, such as implementing the data file generation method provided by the above-mentioned embodiments of the present invention;

receiving original transaction information, wherein the original transaction information carries identification information;

Screening the original transaction information according to the preset push range to obtain target transaction information;

Obtain transaction subject information from at least one transaction subject system by calling a real-time interface according to the identification information;

A first target data file is generated according to the target transaction information and the transaction subject information.

Embodiment 4

FIG. 7 is a schematic structural diagram of a computer-readable storage medium containing a computer program according to Embodiment 4 of the present invention. Embodiments of the present invention provide a computer-readable storage medium 61 on which a computer program 610 is stored, and when the program is executed by one or more processors, implements the data file generation methods provided by all the inventive embodiments of this application:

receiving original transaction information, wherein the original transaction information carries identification information;

Screening the original transaction information according to the preset push range to obtain target transaction information;

Obtain transaction subject information from at least one transaction subject system by calling a real-time interface according to the identification information;

A first target data file is generated according to the target transaction information and the transaction subject information.

Any combination of one or more computer-readable media may be employed. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium or any combination of the two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples (a non-exhaustive list) of computer readable storage media include: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), Erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above. In this document, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

A computer-readable signal medium may include a propagated data signal in baseband or as part of a carrier wave, with computer-readable program code embodied thereon. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device .

Program code embodied on a computer readable medium may be transmitted using any suitable medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

In some embodiments, the client and server can use any currently known or future developed network protocol such as HTTP (Hyper Text Transfer Protocol) to communicate, and can communicate with digital data in any form or medium Communication (eg, a communication network) interconnects. Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the Internet (eg, the Internet), and peer-to-peer networks (eg, ad hoc peer-to-peer networks), as well as any currently known or future development network of.

The above-mentioned computer-readable medium may be included in the above-mentioned electronic device, or may exist independently without being assembled into the electronic device.

Computer program code for carrying out operations of the present invention may be written in one or more programming languages, including object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedures, or a combination thereof programming language - such as "C" or a similar programming language. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. Where a remote computer is involved, the remote computer may be connected to the user's computer through any kind of network including a local area network (LAN) or wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider to connect over the Internet) .

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more logical functions for implementing the specified functions executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented in dedicated hardware-based systems that perform the specified functions or operations , or can be implemented in a combination of dedicated hardware and computer instructions.

The units involved in the embodiments of the present disclosure may be implemented in a software manner, and may also be implemented in a hardware manner. Among them, the name of the unit does not constitute a limitation of the unit itself under certain circumstances.

The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), Systems on Chips (SOCs), complex programmable Logical Devices (CPLDs) and more.

In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in connection with the instruction execution system, apparatus or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), fiber optics, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.

Note that the above are only preferred embodiments of the present invention and applied technical principles. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments, and can also include more other equivalent embodiments without departing from the concept of the present invention. The scope is determined by the scope of the appended claims.

Claims (10)

1. a data file generation method, is characterized in that, comprises: receiving original transaction information, wherein the original transaction information carries identification information; Screening the original transaction information according to the preset push range to obtain target transaction information; Obtain transaction subject information from at least one transaction subject system by calling a real-time interface according to the identification information; A first target data file is generated according to the target transaction information and the transaction subject information. 2. The method according to claim 1, wherein generating the first target data file according to the target transaction information and the transaction subject information comprises: Splicing the target transaction information and the transaction subject information to obtain target data; A first target data file is generated according to the data collection rule and the target data. 3. The method according to claim 1, wherein after generating the first target data file according to the target transaction information and the transaction subject information, the method further comprises: receiving the second target data file; Sort the first target data file and the second target data file according to keywords; If there is a difference between the sorted first target data file and the sorted second target data file, prompt information is generated according to the difference between the sorted first target data file and the sorted second target data file. 4. The method according to claim 3, wherein the keyword comprises: a transaction number. 5. The method according to claim 3, wherein receiving the second target data file comprises: Receive the second target data file forwarded by the exchange platform, wherein the second target data file is the first data file stored in the data warehouse, the first data file is a data file generated based on the first data, and the first data file is One data is data obtained from the transaction system and at least one transaction subject system. 6. The method according to claim 1, wherein receiving the original transaction information comprises: Receive the original transaction information sent by the transaction system; or, The original transaction information forwarded by the exchange platform is received, wherein the original transaction information is the transaction information of the previous day pushed by the transaction system. 7. A device for generating data files, comprising: a first receiving module, configured to receive original transaction information, wherein the original transaction information carries identification information; a screening module, configured to screen the original transaction information according to a preset push range to obtain target transaction information; an acquisition module, configured to acquire transaction subject information from at least one transaction subject system by calling a real-time interface according to the identification information; The first generating module is configured to generate a first target data file according to the target transaction information and the transaction subject information. 8. The apparatus according to claim 7, wherein the first generating module comprises: a splicing unit for splicing the target transaction information and the transaction subject information to obtain target data; A generating unit, configured to generate a first target data file according to the data collection rule and the target data. 9. An electronic device, characterized in that, comprising: one or more processors; memory for storing one or more programs; The one or more programs, when executed by the one or more processors, cause the processors to implement the method of any of claims 1-6. 10. A computer-readable storage medium comprising a computer program, on which the computer program is stored, characterized in that, when the program is executed by one or more processors, the method as claimed in any one of claims 1-6 is implemented .

Images