CN111200624B - Cross-gatekeeper data transmission method and system - Google Patents

Abstract

The invention discloses a data transmission method and a data transmission system across a network gate. In the invention, data is transmitted unidirectionally in a file form, so that the characteristics of the network gate are ensured. The adoption of the internal intermediate device as data transfer reduces the damage to the storage hard disk. Meanwhile, files under abnormal conditions of the network gate cannot be accumulated, and the file writing is performed by the transmission equipment again, so that the real-time transmission of data is strongly ensured. In addition, the invention is independent of the network gate and the networks on two sides, can be rapidly developed based on the protocol form of each manufacturer, and realizes the data transmission of different manufacturers.

Description

A method and system for cross-gateway data transmission

technical field

The invention belongs to the technical field of network gatekeeper data transmission, and in particular relates to a cross-network gatekeeper data transmission method and system.

Background technique

IP network-based video surveillance has gradually developed into a mainstream solution in the security industry. Regardless of large-scale projects such as highways, parks, and safety projects, because of the standards and openness of IP, and considering the security of network communication transmission, in various networks In the integration of isolated islands, technologies such as NAT, firewalls, and security isolation gatekeepers are widely used in major projects. Among them, the technical application of gatekeeper equipment, its core technical concept is to achieve physical isolation, physically isolate and block all connections with potential attacks, so that "hackers" cannot invade, attack, or destroy, and realize real security. Safety. This isolation technology does achieve network security, but it also introduces a new problem, because high real-time performance is required for data transmission such as vehicle information and deployment control information, so that the timely performance of data transmission between network segments , Complete performance has new challenges.

In the existing application of the security isolation gatekeeper in the video surveillance system, there are often two methods of Oracle database transmission or file transmission:

Among them, when the Oracle database is used for transmission, when the database stores the URL of the data picture, the gatekeeper implements the data transmission in the form of an IP address agent, that is, the traffic from the video private network or the public external network is first sent to an agent of the gatekeeper IP, the gatekeeper modifies the destination IP and then forwards it to the intranet. When the intranet needs to obtain pictures through the URL address, then return to the IP address that has been modified to the intranet, and then return to the video private network or public through the port mapped by the gatekeeper. The external network, then obtain the picture stream, and then transmit it to the internal network; or deploy Oracle database on both sides of the gatekeeper. The Oracle database supports direct writing of picture streams into the database, and the gatekeeper supports direct transmission of picture streams between two databases.

However, most manufacturers in the video surveillance system industry do not use Oracle databases. The above solutions need to directly apply the Oracle database on the private video network or the public external network, and then upload to the platforms of the manufacturers involved in various projects on the intranet. The operating performance pressure of the Oracle database on the network or the public external network is affected. In the case of huge data volume storage and frequent database I/O operations, the performance of the database will be bottlenecked. When transmitting in the form of image streams, for each write to the database is a single piece of data, and the daily processing volume exceeds 5 million pieces of data, the performance of single write and intranet query will be severely tested. Moreover, the Oracle database is a database that needs to be paid, and it is not widely used by most manufacturers in the monitoring system industry. Most of the databases used by each manufacturer are different. Every time a new feature or new demand is developed, a new docking is required. Cost quite expensive.

Another way is the file transfer method. The network gatekeeper transfers the files to the intranet in the form of private network ferry, and each manufacturer will store the data in the form of writing files in the video private network and public video network according to their own protocols and connection methods. In the devices in the external network and other environments, the gatekeeper will transfer the files in the directory where the device stores the files to the specific directory of the specified device on another network segment in the way of the gatekeeper transferring files, for another network segment of the gatekeeper (temporarily named Intranet) devices, read, parse, and upload according to the receiving method of the intranet platform.

However, when using the file transfer method, the actual gatekeeper will not distinguish the real-time nature of the files, that is, how many files have been successfully ferried. There is no guarantee that real-time data files will be ferried first; in addition, the gatekeeper continuously writes files to the disk, and will clean up the disk after the ferry is successful, which means that the disk has frequent read, write, and cleanup operations. The storage will generate file fragments due to such frequent operations, which will cause great damage to the storage disk; in addition, because the file transfer scheme is more inclined to real-time transmission under normal conditions (the gatekeeper has no abnormal conditions), and because there is no database Yes, files are deleted during the transmission process. Once an abnormal situation occurs during the transmission process (the upper-level platform of the intranet is powered off, restarted, etc.), the data will fail to be uploaded repeatedly, and the integrity of the data cannot be guaranteed.

Contents of the invention

The purpose of the present invention is to provide a cross-gateway data transmission method and system to overcome the above-mentioned problems in the prior art, meet the cross-gateway data transmission between different manufacturers, and ensure the real-time and integrity of data transmission.

In order to achieve the above object, the technical scheme of the present invention is as follows:

A cross-gateway data transmission method, used to realize cross-gateway data transmission between a first network and a second network, a gatekeeper is set between the first network and the second network, and the first network A first transmission device is provided inside, and the first transmission device is provided with a first database and a first cache, and the cross-gateway data transmission method includes:

The first transmission device receives the data from the data source, generates a corresponding data record in the first database, and stores the data in the setting directory of the first cache in the form of a file, and initially sets the flag bit in the data record as the first state;

The first transmission device receives the access from the gatekeeper, and transfers the data to the second network through the gatekeeper;

After the data is taken away by the gatekeeper, the first transmission device updates the corresponding flag bit in the data record to the second state.

Further, the cross-gatekeeper data transmission method also includes:

When the first transmission device restarts, it reads the data record whose flag bit is the first state from the first database, and stores the data in the set directory of the first cache in the form of a file.

Further, the cross-gatekeeper data transmission method also includes:

When the remaining space of the first cache is less than the set first threshold, the first transmission device no longer stores the data in the set directory of the first cache in the form of files.

Further, a second transmission device is provided in the second network, the second transmission device is provided with a second database and a second cache, and the cross-gateway data transmission method further includes:

The second transmission device receives the data ferried by the gatekeeper, and stores the data in the setting directory of the second cache;

The second transmission device reads the data stored in the second cache to generate a data record in the second database, and generates a deduplication table corresponding to the data and stores it in the second database, so as to avoid repeated writing of data;

The second transmission device forwards the data stored in the second cache to the third-party platform, and updates the flag in the data record to the second state after forwarding;

According to the sending failure information fed back by the third-party platform, the second transmission device updates the flag bit in the data record to the first state, so as to retransmit the corresponding data to the third-party platform.

Further, the cross-gatekeeper data transmission method also includes:

When the remaining space of the second cache is less than the set second threshold, the second transmission device stores the data exceeding the third threshold of the second cache storage space to the hard disk, generates a data record in the second database, and generates deduplication corresponding to the data The tables are stored in the second database to avoid repeated writing of data.

The present invention also proposes a cross-network gatekeeper data transmission system, which is used to realize cross-network gatekeeper data transmission between the first network and the second network, and a gatekeeper is set between the first network and the second network. The cross-network data transmission system includes a first transmission device located in the first network, the first transmission device is provided with a first database and a first cache, and the first transmission device includes:

The first data receiving module is used to receive the data of the data source, generate corresponding data records in the first database, and store the data in the setting directory of the first cache in the form of files, and initialize the flag bits in the data records set to the first state;

The first data ferry module is used to receive the access of the gatekeeper, and ferry the data to the second network through the gatekeeper;

The first state update module is used to update the corresponding flag bit in the data record to the second state after the data is taken away by the gatekeeper.

Further, the first transmission device also includes:

The first retransmission module is used to read the data record whose flag is in the first state from the first database when restarting, and store the data in the set directory of the first cache in the form of a file.

Further, the first data receiving module is further configured to no longer store data in the set directory of the first cache in the form of files when the remaining space of the first cache is less than the set first threshold.

Further, the cross-gateway data transmission system also includes a second transmission device set in the second network, the second transmission device is provided with a second database and a second cache, and the second transmission device includes:

The second data receiving module is used to receive the data ferried by the gatekeeper, and store the data in the setting directory of the second cache;

The database record module is used to read the data stored in the second cache to generate data records in the second database, and generate a deduplication table corresponding to the data and store it in the second database, so as to avoid repeated writing of data;

A forwarding module, configured to forward the data stored in the second cache to a third-party platform, and update the flag in the data record to the second state after forwarding;

The second retransmission module is used to update the flag bit in the data record to the first state according to the sending failure information fed back by the third-party platform, so as to retransmit the corresponding data to the third-party platform.

Further, the second transmission device also includes:

The monitoring and early warning module is used to store data exceeding the third threshold of the second cache storage space to the hard disk when the remaining space of the second cache is insufficient to set the second threshold, generate data records in the second database, and generate data corresponding The deduplication table is stored in the second database to avoid repeated writing of data.

The present invention proposes a data transmission method and system across a network gatekeeper. First and second transmission devices are set on both sides of the network gatekeeper, and a database and a cache are set in the transmission equipment, and flag bits are set in the database, so that when the In case of abnormality, data recovery and retransmission are performed to ensure data integrity. In the present invention, data is transmitted in one direction in the form of files, which guarantees the characteristics of the gatekeeper. The use of memory as an intermediate device for data transfer reduces damage to storage hard disks. At the same time, the abnormal files of the network gatekeeper will not form a pile, and the transmission device will also write the file in real time first, so there is a strong guarantee for the real-time transmission of data. In addition, the invention is independent of the gatekeeper and the networks on both sides, and can be quickly developed based on the protocol form of each manufacturer to realize data transmission of different manufacturers.

Description of drawings

FIG. 1 is a schematic diagram of a network structure according to an embodiment of the present invention;

FIG. 2 is a schematic flow diagram of a cross-gateway data transmission method on the first network side according to an embodiment of the present invention;

FIG. 3 is a schematic flowchart of a method for transmitting data across gatekeepers on the second network side according to an embodiment of the present invention.

Detailed ways

The technical solution of the present invention will be described in further detail below in conjunction with the accompanying drawings and embodiments, and the following embodiments do not constitute a limitation of the present invention.

Taking the video monitoring system shown in FIG. 1 as an example, the first network and the second network are physically isolated through a security gate. In this embodiment, the second network is used as a safety network that needs to be isolated, which is also commonly called an intranet, such as an intranet of a traffic management center or an intranet of a city security monitoring center. The first network may be a private video network or some social resources on an extranet, such as a private video network of an enterprise. This forms the docking of the two networks, which are usually physically separated by a security gatekeeper to ensure network security.

As shown in Figure 2, an embodiment of a cross-gateway data transmission method is used to realize cross-gateway data transmission between the first network and the second network, and there is a network between the first network and the second network. A gate, the first network is provided with a first transmission device, the first transmission device is provided with a first database and a first cache, and the cross-gateway data transmission method includes:

The first transmission device receives the data from the data source, generates a corresponding data record in the first database, and stores the data in the setting directory of the first cache in the form of a file, and initially sets the flag bit in the data record as the first state;

The first transmission device receives the access from the gatekeeper, and transfers the data to the second network through the gatekeeper;

After the data is taken away by the gatekeeper, the first transmission device updates the corresponding flag bit in the data record to the second state.

Specifically, the data collected by the video front-end equipment in the first network, the data take the snapshot data of the road checkpoint as an example, including structural data such as the license plate number, vehicle color, vehicle type, elapsed time, lane position, etc., as well as the captured pictures . In this embodiment, the video front-end devices in the first network are collectively referred to as a data source, and the data source may also be other data sources, such as data sent by other storage devices, which is not limited in the present invention.

The first transmission device receives the data sent by the data source, and generates a corresponding data record in the first database. When the corresponding data record is generated in the first database, the data record contains the fields corresponding to the above-mentioned structured data. For The data records of the database are designed according to actual application scenarios, which is not required by the present invention, but the data records include the content of structured data.

The data received by the first transmission device in this embodiment also needs to be written into the first cache in the form of a file. In the first cache, the data is stored in the form of a file. The naming method of the data file name corresponding to the structured data in this embodiment is as follows : relative path + unique ID; the naming method of the picture name corresponding to the picture is: unique ID + tail number, the tail number included in the file name corresponding to the picture, which can ensure the storage of multiple pictures. The unique ID is a unique ID corresponding to the piece of data. Therefore, the data record also includes the data file name and picture name, as well as their corresponding paths.

In this embodiment, data is written into the first cache according to the time order and real-time priority according to the data records. The first cache is to draw a part of the space from the memory as a cache. Due to the fast read and write performance of the memory, it supports high-speed data reading. Write.

In this embodiment, the data record also includes a flag bit field. In this embodiment, the flag bit indicates two states, wherein the first state is the initial state, and the second state is the state that the data has been taken away by the gatekeeper. The flag bits can be represented by numbers, for example, 0 is used to represent the first state, and 2 is used to represent the second state. The present invention is not limited to the specific flag representation method adopted.

In this embodiment, the data source sends the data to the first transmission device, and the first transmission device records the data in the first database and the first cache, so that the gatekeeper can retrieve the accessed data from the first cache. The first transmission device receives the access of the network gatekeeper, and ferries the data to the second network through the network gatekeeper. The present invention is not limited to the ferrying method of the network gatekeeper. For example, the setting directory of the first transmission device can be accessed through FTP, which is the same as the second network. The storage directories in the two networks are consistent, so as to ensure that the gatekeeper can smoothly transfer data to the corresponding directory in the second network through FTP.

In this embodiment, after the data is taken away by the gatekeeper, the first transmission device updates the corresponding flag bit in the data record to the second state to indicate that the data has been taken away from the first cache. The specific implementation method can query the data record in real time, find out whether the file still exists in the first cache, if it does not exist, it will be determined that it has been taken away by the gatekeeper, and the flag bit will be updated to the second state, otherwise it will not be processed.

Based on the above method, the first transmission device uses the database and the first cache to realize the data transfer to the second network through the gatekeeper in the form of files. Since there is a database in the first transmission device, when the first transmission device restarts, it can read the data record whose flag is the first state from the first database, and store the data in the first cache setting in the form of a file in the directory. After the data is stored in the first cache in the form of a file, it can be read by the gatekeeper and transferred to the second network, which will not be repeated here.

It should be noted that when the first transmission device is restarted, the data in its first cache does not necessarily disappear. It will only disappear when a power failure occurs and restarts. However, no matter what kind of restart occurs, the data can be recovered from the database, ensuring Data Integrity.

In an embodiment of the present invention, when the remaining space of the first cache is less than the set first threshold, the first transmission device no longer stores the data in the set directory of the first cache in the form of files.

In order to prevent the first cache from being full of data and cause data overflow, the first transmission device in this embodiment also implements a monitoring warning, that is, when the remaining space of the first cache is less than the first threshold set, it will no longer store data in the form of a file Go to the setting directory of the first cache, preventing data loss caused by data overflow.

It should be noted that in this technical solution, a hard disk can also be set in the first transmission device, and when the remaining space of the first cache is less than the set first threshold, the data is stored in the set directory of the hard disk in the form of a file, To further enhance the data transmission capability. That is, when the gatekeeper finds that the data is no longer transmitted to the second transmission device, it will trigger the first cache monitoring warning, and the data and pictures will be temporarily transferred to the hard disk of the first transmission device. After returning to normal, the data and pictures will be gradually transferred Transfer to the first cache.

Further in the technical solution, a second transmission device is provided in the second network, and the second transmission device is provided with a second database and a second cache, and the cross-gateway data transmission method further includes:

The second transmission device receives the data ferried by the gatekeeper, and stores the data in the setting directory of the second cache;

The second transmission device reads the data stored in the second cache to generate a data record in the second database, and generates a deduplication table corresponding to the data and stores it in the second database, so as to avoid repeated writing of data;

The second transmission device forwards the data stored in the second cache to the third-party platform, and updates the flag in the data record to the second state after forwarding;

According to the sending failure information fed back by the third-party platform, the second transmission device updates the flag bit in the data record to the first state, so as to retransmit the corresponding data to the third-party platform.

Specifically, a second transmission device is set in the second network, and the data transferred from the gatekeeper is first archived in the directory of the second cache, and the directory of the second cache is consistent with the directory of the first cache.

In this embodiment, the second transmission device reads the data stored in the second cache to generate a data record in the second database, and generates a deduplication table corresponding to the data and stores it in the second database, so as to avoid repeated writing of data. The data records in the second database are consistent with the data records in the first database, and will not be repeated here. The difference is that in the second database, a de-duplication table is also generated, which includes the unique ID of the data pair. By comparing the unique ID, when duplicate data is found to be written, it is no longer written into the database.

When an exception occurs, the data that the first transmission device has been ferried by the gatekeeper may not have updated the flag bit, which will cause it to be sent again when restarting. At this time, setting the deduplication table is beneficial to prevent repeated writing of data.

In this embodiment, the second transmission device forwards the data stored in the second cache to the third-party platform, and updates the flag bit in the data record to the second state after forwarding to indicate that the data is sent to the third-party platform.

In this embodiment, in order to prevent data from failing in the process of sending data to the third-party platform, when the sending fails, the second transmission device updates the flag bit in the data record to the first state according to the sending failure information fed back by the third-party platform. Thereby, the second transmission device thinks that the data has not been sent successfully, and can retransmit the corresponding data to the third-party platform. When retransmitting, it can read from the second cache or hard disk according to the file name and picture name recorded in the data in the second database. Fetch data and send it to a third-party platform.

This embodiment also sets a monitoring warning for the second transmission device, that is, the cross-gateway data transmission method also includes:

When the remaining space of the second cache is less than the set second threshold, the second transmission device stores the data exceeding the third threshold of the second cache storage space to the hard disk, generates a data record in the second database, and generates deduplication corresponding to the data The tables are stored in the second database to avoid repeated writing of data.

It should be noted that when the second transmission device fails to upload data and pictures to the third-party platform due to abnormal circumstances, the accumulation of the second cache will eventually trigger the second cache monitoring warning, and new data and pictures will be written to the hard disk for temporary storage. When the data written to the hard disk is restored and can be transferred on the third-party platform, the accumulated data will be uploaded to the third-party platform.

In the technical solution of the present invention, when a general abnormality occurs, the data in the first cache and the second cache will not be lost, and the data stored in the hard disk will not be lost. When retransmitting, data can be read from the cache or hard disk for retransmission. When a power failure occurs, the data in the cache will be lost, but there are data records in the database, which can be used for recovery. At this time, only the structured data can be retransmitted, and the pictures cannot be retransmitted, and need to be obtained from the data source again. . By reasonably setting the relationship between writing and reading data in the first cache and the second cache, the accumulated data in the cache can be very small, reducing the risk of loss of pictures due to power failure.

Corresponding to the above method, an embodiment of a cross-gateway data transmission system is also provided here, which is used to realize cross-gateway data transmission between the first network and the second network, and the first network and the second network A gatekeeper is provided between the two networks, and the cross-network gatekeeper data transmission system includes a first transmission device in the first network, the first transmission device is provided with a first database and a first cache, and the first Transmission equipment includes:

The first data receiving module is used to receive the data of the data source, generate corresponding data records in the first database, and store the data in the setting directory of the first cache in the form of files, and initialize the flag bits in the data records set to the first state;

The first data ferry module is used to receive the access of the gatekeeper, and ferry the data to the second network through the gatekeeper;

The first state update module is used to update the corresponding flag bit in the data record to the second state after the data is taken away by the gatekeeper.

In this embodiment, the first transmission device further includes:

The first retransmission module is used to read the data record whose flag is in the first state from the first database when restarting, and store the data in the set directory of the first cache in the form of a file.

In this embodiment, the first data receiving module is further configured to no longer store data in the form of files in the set directory of the first cache when the remaining space of the first cache is less than the set first threshold.

In this embodiment, the cross-gateway data transmission system further includes a second transmission device set in the second network, the second transmission device is provided with a second database and a second cache, and the second transmission device ,include:

The second data receiving module is used to receive the data ferried by the gatekeeper, and store the data in the setting directory of the second cache;

The database record module is used to read the data stored in the second cache to generate data records in the second database, and generate a deduplication table corresponding to the data and store it in the second database, so as to avoid repeated writing of data;

A forwarding module, configured to forward the data stored in the second cache to a third-party platform, and update the flag in the data record to the second state after forwarding;

The second retransmission module is used to update the flag bit in the data record to the first state according to the sending failure information fed back by the third-party platform, so as to retransmit the corresponding data to the third-party platform.

In this embodiment, the second transmission device further includes:

The monitoring and early warning module is used to store data exceeding the third threshold of the second cache storage space to the hard disk when the remaining space of the second cache is insufficient to set the second threshold, generate data records in the second database, and generate data corresponding The deduplication table is stored in the second database to avoid repeated writing of data.

The above embodiments are only used to illustrate the technical solutions of the present invention and not to limit them. Without departing from the spirit and essence of the present invention, those skilled in the art can make various corresponding changes and changes according to the present invention. deformation, but these corresponding changes and deformations should belong to the scope of protection of the appended claims of the present invention.

Claims (10)

1. The utility model provides a cross-gatekeeper data transmission method, is used for realizing the data transmission of crossing the gatekeeper between first network and second network, be equipped with the gatekeeper between first network and the second network, its characterized in that, be equipped with first transmission equipment in the first network, first transmission equipment is equipped with first database and first buffering, cross-gatekeeper data transmission method includes:

the first transmission equipment receives data of a data source, generates a corresponding data record in a first database, stores the data in a setting directory of a first cache in a file form, and initially sets a flag bit in the data record to be in a first state;

the first transmission equipment receives the access of the gatekeeper and ferrys the data to a second network through the gatekeeper;

after the first transmission equipment is taken away by the network gate, updating the corresponding zone bit in the data record to be in a second state;

storing the data in a file form into a setting catalog of a first cache, wherein the method comprises the following steps:

storing the structured data and the picture data in a file form;

the generating a corresponding data record in the first database includes:

for structured data, the data record contains a field corresponding to the structured data, and a data file name and a corresponding path;

for picture data, the data record contains a data file name and a corresponding path.

2. The method for transmitting data across a gatekeeper according to claim 1, further comprising:

when the first transmission device is restarted, the data record with the flag bit in the first state is read from the first database, and the data is stored in a file form in a setting directory of the first cache.

3. The method for transmitting data across a gatekeeper according to claim 1, further comprising:

when the residual space of the first buffer is insufficient to set a first threshold value, the first transmission device does not store the data in the set directory of the first buffer in the form of a file.

4. The method for transmitting data across a network gate according to claim 1, wherein a second transmission device is provided in the second network, the second transmission device is provided with a second database and a second cache, and the method for transmitting data across a network gate further comprises:

the second transmission equipment receives the data of the gate ferry and stores the data into a setting catalog of a second cache;

the second transmission equipment reads the data stored in the second cache to generate a data record in the second database, generates a duplicate removal table corresponding to the data and stores the duplicate removal table in the second database so as to avoid repeated writing of the data;

the second transmission equipment forwards the data stored in the second cache to the third party platform, and after forwarding, the flag bit in the data record is updated to be in a second state;

and the second transmission equipment updates the flag bit in the data record to be in a first state according to the sending failure information fed back by the third-party platform so as to retransmit the corresponding data to the third-party platform.

5. The method for transmitting data across a gatekeeper according to claim 4, further comprising:

when the remaining space of the second cache is not enough to set a second threshold value, the second transmission device stores the data exceeding a third threshold value of the storage space of the second cache to the hard disk, generates a data record in the second database, generates a duplicate removal table corresponding to the data and stores the duplicate removal table in the second database so as to avoid repeated writing of the data.

6. The utility model provides a stride floodgate data transmission system for realize crossing the data transmission of floodgate between first network and second network, be equipped with the floodgate between first network and the second network, its characterized in that, stride floodgate data transmission system including locating the first transmission equipment in the first network, first transmission equipment is equipped with first database and first buffer memory, first transmission equipment includes:

the first data receiving module is used for receiving data of a data source, generating a corresponding data record in a first database, storing the data in a setting catalog of a first cache in a file form, and initially setting a flag bit in the data record to be in a first state;

the first data ferrying module is used for receiving the access of the gatekeeper and ferrying the data to the second network through the gatekeeper;

the first state updating module is used for updating the corresponding flag bit in the data record to be in the second state after the data is taken away by the network gate;

storing the data in a file form into a setting catalog of a first cache, wherein the method comprises the following steps:

storing the structured data and the picture data in a file form;

the generating a corresponding data record in the first database includes:

for structured data, the data record contains a field corresponding to the structured data, and a data file name and a corresponding path;

for picture data, the data record contains a data file name and a corresponding path.

7. The cross-gatekeeper data transmission system of claim 6, wherein the first transmission apparatus further comprises:

and the first retransmission module is used for reading the data record with the flag bit in the first state from the first database when restarting, and storing the data in a file form into a setting directory of the first cache.

8. The cross-gatekeeper data transmission system according to claim 6, wherein the first data receiving module is further configured to not store the data in the set directory of the first cache in a file form when the remaining space of the first cache is less than the set first threshold.

9. The cross-gatekeeper data transmission system according to claim 6, further comprising a second transmission device provided in a second network, the second transmission device being provided with a second database and a second cache, the second transmission device comprising:

the second data receiving module is used for receiving the data of the gate ferry and storing the data into a setting catalog of the second cache;

the database recording module is used for reading the data stored in the second cache to generate a data record in the second database, generating a duplicate removal table corresponding to the data and storing the duplicate removal table into the second database so as to avoid repeated writing of the data;

the forwarding module is used for forwarding the data stored in the second cache to the third party platform, and updating the flag bit in the data record to be in a second state after forwarding;

and the second retransmission module is used for updating the flag bit in the data record to be in a first state according to the sending failure information fed back by the third party platform so as to retransmit the corresponding data to the third party platform.

10. The cross-gatekeeper data transmission system of claim 9, wherein said second transmission apparatus further comprises:

and the monitoring early warning module is used for storing the data exceeding a third threshold value of the second cache storage space into the hard disk when the remaining space of the second cache is insufficient to the set second threshold value, generating a data record in the second database, generating a duplicate removal table corresponding to the data and storing the duplicate removal table into the second database so as to avoid the repeated writing of the data.

Images