CN103067483B - Teledata increment synchronization method based on packet - Google Patents
Teledata increment synchronization method based on packet Download PDFInfo
- Publication number
- CN103067483B CN103067483B CN201210568861.0A CN201210568861A CN103067483B CN 103067483 B CN103067483 B CN 103067483B CN 201210568861 A CN201210568861 A CN 201210568861A CN 103067483 B CN103067483 B CN 103067483B
- Authority
- CN
- China
- Prior art keywords
- data
- packet
- ftp
- database
- sql statement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 19
- 230000008859 change Effects 0.000 claims abstract description 36
- 238000012986 modification Methods 0.000 claims description 13
- 230000004048 modification Effects 0.000 claims description 13
- 238000012544 monitoring process Methods 0.000 claims description 3
- 230000001360 synchronised effect Effects 0.000 claims description 3
- 238000012546 transfer Methods 0.000 claims description 3
- 238000005314 correlation function Methods 0.000 claims description 2
- 239000006227 byproduct Substances 0.000 abstract description 3
- 230000005540 biological transmission Effects 0.000 description 9
- 238000000605 extraction Methods 0.000 description 5
- 239000000284 extract Substances 0.000 description 4
- 238000007726 management method Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 238000013480 data collection Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 208000027418 Wounds and injury Diseases 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000009412 basement excavation Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 230000006378 damage Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 208000014674 injury Diseases 0.000 description 1
- 210000003739 neck Anatomy 0.000 description 1
- 230000002688 persistence Effects 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to the teledata increment synchronization method based on packet, including step：Obtain the DML of source database；DML is exported as into packet；By packet remote synchronization to target database；By resolve packet into SQL statement and change data；SQL statement and change data are updated to target database.The record for occurring increase, delete, changing in data base regularly can be extracted to form the packet comprising incremental record by the present invention, then according to network condition and data synchronisation requirement, by packet in the way of JMS or FTP, using message-oriented middleware or ftp client/server side product, and in the case where certain configuration management is supported, packet is transferred to into target database system, so as to keep remote, near end data database data concordance.
Description
Technical field
The present invention relates to database technical field, more particularly to a kind of teledata increment synchronization side based on packet
Method.
Background technology
Teledata synchronously refers to that two Database Systems of cross-network segment keep the concordance of data.Origin system is generally portion
The operation system data base in front end is affixed one's name to, and purpose system is generally used for supporting OLAP data fairground or the number of decision analysis
According to warehouse system.Front end service system data base needs firewall-penetrating with the connection at Back end data center.Existing long-range number
Problems be there are according to synchronization system：
1st, remote data transmission means fixed single, it is impossible to tackle various complex situations.
Remote data transmission can be with using various modes such as Web service, JMS message-oriented middlewares and FTP.Web service
Mode can realize the real-time synchronization transmission of data, but can only transmit low volume data, it is adaptable to the scene that data sporadicly change, and
The quality of data delivery cannot be ensured；JMS message-oriented middlewares are general suitable for transmitting low volume data, but can ensure that data are being disliked
Can also achieve the goal under bad network environment；FTP can transmit fairly large data volume, it is possible to support breakpoint transmission.This
Three kinds of modes respectively have quality, and existing remote data transmission method can only take one way in which, it is impossible to tackle different nets
Various complicated situations under network environment and data synchronisation requirement.
2nd, the incremental data harvester that remote data transmission front end adopts has certain limitation.
In data base, it is often necessary to operation, the object of these operations such as carry out inserting to initial data, be deleted or modified
It is referred to as incremental data.In certain situations it is desirable to the incremental data of some original tables is synchronized in some other table, this is made
The data of a little tables are consistent；Also certain situation, needs to understand the change of some original tables in detail, changes these in time
Data are submitted in data warehouse, for data analysiss and excavation, it is above-mentioned in the case of, need to carry out incremental data collection.
The method that existing incremental data collection is realized mainly has trigger, timestamp, full table to extract, full table is compared, day
Will table, flashback query (flashback) etc..These mechanism are suffered from the drawback that and not enough：
Trigger mode needs origin system to be invaded, the performance of meeting major injury origin system, and this intrusion sometimes
Forbidden by client.
The mode of timestamp requires that all of table of origin system needs to have timestamp field, if not needing additionally to add
Plus, the intrusion to origin system is larger, or even needs to change the service code of origin system.Additionally, which is to data deletion action
Judgement with update realize it is more complicated.
Full table extracts the thinking for actually abandoning increment extraction, directly carries out full table extraction, extracts for big table
Efficiency is very low.
The mode that full table is compared needs to compare the record of original table and object table one by one, and record that is newly-increased and changing is read
Out, efficiency is minimum.
The way of log sheet is the establishment business diary table in source database, when the business datum of specific needs monitoring occurs
During change, updating maintenance log sheet content is come by corresponding operation system program module.During increment extraction, by reading log sheet number
Which data is loaded according to decision and how to be loaded.The maintenance needs of log sheet are completed with code by operation system program.To source
System has great invasive, increment extraction efficiency high but realization complexity.
Flashback query (flashback)：The Database Systems of Oracle 9i above versions provide flashback query mechanism,
Allow user's inquiry database positioning at a certain time in the past.So, extract process can by the current state of source database and
Last time is extracted the state at moment and is contrasted, and quickly draws the situation of change of source table data record.But this mode needs specific
The dependence of DBMS (Database management system, data base management system), and need origin system to support flash back
Inquiry, range of application are narrower.
The content of the invention
Present invention is primarily targeted at, for above-mentioned deficiency of the prior art, there is provided a kind of based on the remote of packet
Journey incremental synchronization method for data, by the Operation Log for analyzing source database, the note that regularly will occur increase, delete, changing in data base
Record extract to form the packet comprising incremental record, then according to network condition and data synchronisation requirement, by packet with
The mode of FTP, using message-oriented middleware or ftp client/server side product, and in the case where certain configuration management is supported, will
Packet is transferred to target database system.
For achieving the above object, the present invention is employed the following technical solutions.
The present invention provides a kind of teledata increment synchronization method based on packet, comprises the following steps：
Obtain the DML of source database；
The DML is exported as into packet；
By the packet remote synchronization to target database；
By the resolve packet into SQL statement and change data；
The SQL statement and change data are updated to target database.
Compared to above-mentioned prior art, the invention has the advantages that.
The packet that front end extraction program of the present invention is formed, can select to be sent to destination in the way of JMS or FTP.
JMS is based on message-oriented middleware, it is ensured that the long-range real-time delivery of fragmentary and low volume data；FTP supports breakpoint transmission, is adapted to big
The remote transmission of scale data, both complement one another, it is ensured that the stability of remote synchronization process.And, before packet is both
The interface point of section extraction program and remote synchronization program, and as the backup of source end system incremental data, can be risen with persistence
Come, accordingly even when in the case where the extremely severe even network access of network environment is limited, can also take the mode under line protect
The physical medium for having packet is sent to destination, with the function not available for traditional Remote data syn-chronization or transmitting device.
Description of the drawings
Fig. 1 is the flow chart of the teledata increment synchronization method in the embodiment of the present invention based on packet.
Fig. 2 is the flow chart of the DML of acquisition source database in embodiment illustrated in fig. 1.
Fig. 3 is the structure chart of the teledata increment synchronization device in the embodiment of the present invention based on packet.
The realization of the object of the invention, functional characteristics and advantage will be described further in conjunction with the embodiments referring to the drawings.
Specific embodiment
Technical scheme is described in detail below with reference to drawings and the specific embodiments, to become apparent from, intuitively
Understand the invention essence of the present invention.
Fig. 1 is the flow chart of the incremental data acquisition method captured based on daily record in the embodiment of the present invention；Fig. 2 is Fig. 1 institutes
The flow chart that the DML of source database is obtained in showing embodiment.
Shown in seeing figures.1.and.2, the embodiment of the present invention provides a kind of teledata increment synchronization based on packet first
Method, comprises the following steps：
S1：Obtain the DML of source database；
S2：DML is exported as into packet；
S3：By the packet remote synchronization to target database；
S4：By the resolve packet into SQL statement and change data；
S5：The SQL statement and change data are updated to target database.
DML refers to Data Manipulation Language, i.e. DML, and it is one of classification of SQL, uses
In the state change of database of record.SQL statement refers to database statement, the data in data base is increased for record
Plus, delete, modification and inquire about etc. operation and operation object.
In step sl, the step of DML for obtaining source database, specifically includes following sub-step：
S11：The table monitored needed for obtaining, and create list of modification；
S12：Log sheet is created, for recording DML；
S13：The log recording of source database is monitored, data is obtained and is updated operation；
S14：Data are updated into operation and is reduced to complete SQL statement and change data；
S15：Change data are write into list of modification, SQL statement is write into log sheet.
In above steps, the table of required monitoring is referred to as object table.Object table can be specific in source database system
The batch of data table of some tables of data, or all specified types.List of modification is corresponded with object table to be monitored,
Structure is identical, for the change data that interim storage object table is produced in this snoop procedure.
In step sl, the table monitored needed for obtaining, and the step of create list of modification be by reading database dictionary with
The structure of object table is obtained, the list of modification corresponding with object table is then created.
The step for implementing in oracle database, needs to perform following sentence：
Select table_name from dba_tables where owner=....
Select name, length, type#, charsetform from sys.col $ where obj#=(select
obj#...)order by intcol#
If data base is SQL server, following sentence need to be performed：
Select name from sysobjects where xtype='U'and uid=(select uid from
Sysuse rs where name=...)
Select name, length, xtype from syscolumns where id=(select id frmo
Sysobject s where name=tableName and uid=(select uid from sysusers where
Name=userna me)).
In fact, before step S1 is carried out, data base administrator also needs to carry out register, carries out identification,
Guarantee the safety of Database Systems.
In step s 12, the log sheet of entitled MY_CDC_LOG_TABLE is created in source database, for blotter
Increment DML.
In step s 13, monitor source database log recording concrete operations be：
According to the listening period that user is arranged, start watcher thread.For ORACLE data bases, watcher thread is used
LOGMNR bag correlation functions, monitor the log recording of ORACLE, obtain data change operation (including insert, update and
Delete sentences)；For SQL SERVER, watcher thread monitor log recording using related data dictionary, data change is obtained
Operation.
Log information is read in oracle database to be needed to perform following sentence：
select name,COMPLETION_TIME from v$archived_log where...
Select v $ logfile.member from v $ logfile, v $ log where v $ logfile.group#=
V $ log.group#and v $ logfile.status='CURRENT'
select seg_owner,table_name,sql_redo,timestamp,row_id,operation,data_
O bj#from v $ logmnr_contents where DATA_OBJ#in (table sequence number ..) and operation in ('
INSERT','DELETE','UPDATE')
select seg_owner,seg_name,sql_redo,timestamp,row_id,operation,data_
obj#from...。
Log information is read in SQL Server data bases to be needed to perform following sentence：
select allocunitname,operation,[Rowlog Contents 0]as r0,[Rowlog
Contents1]as r1,[Rowlog Contents 2].....[R...4]as r4,[Current LSN]from::fn_
dblog(null,null)where allocunitname like userName.tableName and not
allocunitname like us erName.tableName_cdc and operation in('Lop_Insert_
Rows','Lop_Delete_Rows','Lop_Modify_Row','Lop_Modify_Columns')...
select[object Name],operation,[Current LSN]frmo::fn_dblog(null,null)
whe re[object Name]like...。
In step S14, by data update operation be reduced to complete SQL statement and change data the step of specifically,
Data change operation is reduced to complete SQL statement and change number by analyzing daily record and related data dictionary by watcher thread
According to.
Change data convert SQL statement, needs to perform following sentence in Oracle：
Select obj#from sys.obj $ where name='table_name'and owner#=(select
User#from sys.user $ where name='user_name')
select c.column_name from dba_cons_columns c,dba_constraints t where
C.constraint_name=t.constraint_name and t.constraint_type='P'and t.table_
Name='ta ble_name'and c.owner='user_name'.
SQL Server then need to perform following sentence：
select column_name from information_schema.constraint_column_usage
Whe re constraint_name=(select constraint_name from information_
Schema.table_cons traints where constraint_type='PRIMARY KEY'and table_
Schema=userName.tab leName).
In step S15, will change data write list of modification, when SQL statement is write log sheet, watcher thread is according to one
The change data for getting are write list of modification by fixed cycle, and SQL statement is write MY_CDC_LOG_TABLE log sheets.
In step s 2, packet is exported as, the packet includes XML file and csv file, wherein XML file record
All data update the SQL statement of operation, and CSV records all increases and the change data changed.Packet can be answered as downstream
Processed with completing follow-up data transfer and extraction with the input of program.
In step s3, the step of by packet remote synchronization to target database, specifically includes：
According to network condition and synchronous urgency demand, selection carries out remote synchronization by the way of FTP.
Specifically, for FTP modes, set up packet catalogue in target database, deployment ftp client program and
Ftp server end program, ftp client perform data scanning according to cycle regular hour, if depositing in finding packet catalogue
In new data APMB package, first the fileinfo of new data APMB package is recorded in source database, is then assisted by FTP
View, accesses long-range ftp server end, by packet files passe to ftp server end, and waits ftp server end to reply letter
Breath.After ftp server end receives the data APMB package, data APMB package is preserved and the fileinfo is recorded into reception
In the target database of end, then receipt is fed back to ftp client by way of FTP orders, that is, send confirmation.
It is as follows based on File Transfer Protocol data remote synchronization handling process：
1st, ftp client scan data；
2nd, packet information to be sent is counted the repository of ftp client, for error correction or re-transmission；
3rd, connect ftp server；
4th, packet is uploaded, and sends order；
5th, ftp server receives mentioned order, and downloading data bag；
6th, FTP connections are disconnected；
The 7th, the packet information for receiving is counted the repository of ftp server, for error correction or re-transmission；
8th, preserve packet.
In above-mentioned steps S4 and S5, resolve packet into SQL statement and change data and by SQL statement and is changed into number
The step of according to renewal to target database, is specially：
After target database receives packet, for XML format, SQL statement is parsed, and is converted into according to pre-defined rule
Put in storage after the database format of itself；For CSV forms, then according to the corresponding data dictionary information structuring warehouse-in of target database
Action statement performs in-stockroom operation.
By the above, the teledata increment synchronization method of the present embodiment passes through the operation day for analyzing source database
The record for occurring increase, delete, changing in data base regularly not only can be extracted to form the packet comprising incremental record by will,
And can according to network condition and data synchronisation requirement, by packet in the way of JMS or FTP, using message-oriented middleware or
Ftp client/server side product, and in the case where certain configuration management is supported, packet is transferred to into target database system.
In sum, the packet that front end extraction program of the present invention is formed, can select to send in the way of JMS or FTP
Up to destination.JMS is based on message-oriented middleware, it is ensured that the long-range real-time delivery of fragmentary and low volume data；FTP supports that breakpoint continues
Pass, be adapted to the remote transmission of large-scale data, both complement one another, it is ensured that the stability of remote synchronization process.And, data
Bag is both the interface point of leading portion extraction program and remote synchronization program, and as the backup of source end system incremental data, Ke Yiyong
Kubo is stored away, accordingly even when in the case where the extremely severe even network access of network environment is limited, can also take under line
The physical medium for preserving packet is sent to destination by mode, with not available for traditional Remote data syn-chronization or transmitting device
Function.
The preferred embodiments of the present invention are the foregoing is only, its scope of the claims is not thereby limited, it is every using the present invention
Equivalent structure or equivalent flow conversion that description and accompanying drawing content are made, are directly or indirectly used in other related technology necks
Domain, is included within the scope of the present invention.
Claims (2)
1. a kind of teledata increment synchronization method based on packet, it is characterised in that comprise the following steps：
S1, the DML for obtaining source database；The step of DML for obtaining source database, specifically includes following sub-step：
S11 the table monitored needed for) obtaining, and create list of modification；Specially：By reading database dictionary obtaining object table
Structure, then creates the list of modification corresponding with object table；
S12 log sheet is created), for recording DML；Specially：Create entitled MY_CDC_LOG_TABLE's in source database
Log sheet, for blotter increment DML；
S13 the log recording of source database) is monitored, data is obtained and is updated operation；Specially：According to the monitoring week that user is arranged
Phase, start watcher thread, for ORACLE data bases, watcher thread use LOGMNR bag correlation functions, monitor the day of ORACLE
Will is recorded, and obtains data change operation；For SQL SERVER, watcher thread monitors log recording using related data dictionary,
Obtain data change operation；
S14 data are updated into operation) and is reduced to complete SQL statement and change data；Specially：Watcher thread is by analyzing day
Data change operation is reduced to complete SQL statement and change data by will and related data dictionary；
S15 change data are write into list of modification), SQL statement is write into log sheet, and data write list of modification will be changed, by SQL
During sentence write log sheet, the change data for getting are write list of modification according to some cycles by watcher thread, and SQL statement is write
Enter MY_CDC_LOG_TABLE log sheets；
S2, the DML is exported as into packet；The packet includes XML file and csv file, and wherein XML file record is all
Data update the SQL statement of operation, and CSV records all increases and the change data changed；
S3, by the packet remote synchronization to target database；Specially：According to network condition and synchronous urgency demand,
Selection carries out remote synchronization by the way of FTP；For FTP modes, packet catalogue is set up in target database, disposed
Ftp client program and ftp server end program, ftp client perform data scanning according to cycle regular hour, if sending out
There is new data APMB package in existing packet catalogue, the fileinfo of new data APMB package is recorded into source database first
In, then by File Transfer Protocol, long-range ftp server end is accessed, by packet files passe to ftp server end, and is waited
Ftp server end return information, after ftp server end receives the data APMB package, data APMB package is preserved and will be described
Fileinfo is recorded in target database, then feeds back receipt to ftp client by way of FTP orders, that is, send true
Recognize information；
S4, by the resolve packet into SQL statement and change data；
S5, the SQL statement and change data are updated to target database.
2. teledata increment synchronization method as claimed in claim 1, it is characterised in that described by the SQL statement and change
The step of more data are updated to target database includes：
After target database receives packet, for XML format, SQL statement is parsed, and itself is converted into according to pre-defined rule
Database format after put in storage；For CSV forms, then according to the corresponding data dictionary information structuring in-stockroom operation of target database
Sentence performs in-stockroom operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210568861.0A CN103067483B (en) | 2012-12-25 | 2012-12-25 | Teledata increment synchronization method based on packet |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210568861.0A CN103067483B (en) | 2012-12-25 | 2012-12-25 | Teledata increment synchronization method based on packet |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103067483A CN103067483A (en) | 2013-04-24 |
| CN103067483B true CN103067483B (en) | 2017-04-05 |
Family
ID=48109937
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210568861.0A Active CN103067483B (en) | 2012-12-25 | 2012-12-25 | Teledata increment synchronization method based on packet |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103067483B (en) |
Families Citing this family (34)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103607470A (en) * | 2013-11-29 | 2014-02-26 | 北京中电普华信息技术有限公司 | File transfer system and method |
| CN105335170A (en) * | 2014-06-05 | 2016-02-17 | 阿里巴巴集团控股有限公司 | Distributed system and incremental data updating method |
| CN105205060A (en) * | 2014-06-12 | 2015-12-30 | 中兴通讯股份有限公司 | Method and device for generating word document database dictionary |
| CN104063301A (en) * | 2014-07-02 | 2014-09-24 | 网神信息技术（北京）股份有限公司 | Monitoring method and device |
| CN104317921B (en) * | 2014-10-29 | 2017-10-17 | 北京思特奇信息技术股份有限公司 | A kind of integration across database data synchronous system and method |
| CN104468274A (en) * | 2014-12-16 | 2015-03-25 | 深圳大学 | Cluster monitor and management method and system |
| CN104618434A (en) * | 2014-12-23 | 2015-05-13 | 上海斐讯数据通信技术有限公司 | Synchronization method and system for mPortal system data |
| CN105183860B (en) * | 2015-09-10 | 2018-10-19 | 北京京东尚科信息技术有限公司 | Method of data synchronization and system |
| CN105391791A (en) * | 2015-11-26 | 2016-03-09 | 努比亚技术有限公司 | Upgrade system and upgrade method thereof |
| CN105373621A (en) * | 2015-12-07 | 2016-03-02 | 高新兴科技集团股份有限公司 | Rapid database-system-across data increment migration method |
| CN106682098A (en) * | 2016-12-01 | 2017-05-17 | 无线生活（杭州）信息科技有限公司 | DML processing method and device |
| CN107357848B (en) * | 2017-06-27 | 2019-11-26 | 中国电子科技集团公司第二十八研究所 | Database synchronization method based on driving encapsulation |
| CN107562883B (en) * | 2017-09-04 | 2018-10-26 | 马上消费金融股份有限公司 | Data synchronization method and system |
| CN107491558B (en) * | 2017-09-08 | 2020-09-15 | 北京奇艺世纪科技有限公司 | Metadata updating method and device |
| CN108052681B (en) * | 2018-01-12 | 2020-05-26 | 毛彬 | Method and system for synchronizing structured data between relational databases |
| CN108334621B (en) * | 2018-02-08 | 2021-05-04 | 平安科技（深圳）有限公司 | Database operation method, device, equipment and computer readable storage medium |
| CN108200220B (en) * | 2018-04-08 | 2021-07-23 | 武汉斗鱼网络科技有限公司 | Data synchronization method, server and storage medium |
| CN108733823A (en) * | 2018-05-22 | 2018-11-02 | 浪潮软件股份有限公司 | A kind of system and method that ORACLE database intranet and extranet data double-ways are synchronized |
| CN110543513B (en) * | 2018-05-29 | 2024-03-15 | 金篆信科有限责任公司 | Incremental data synchronization method, equipment and storage medium for distributed database |
| CN110084335A (en) * | 2019-03-26 | 2019-08-02 | 天津大学 | A kind of both-end commodity information management system based on bar code scanning |
| CN110134851B (en) * | 2019-05-05 | 2021-10-15 | 北京科技大学 | A search engine system and construction method based on domain intranet |
| CN110232097A (en) * | 2019-06-21 | 2019-09-13 | 北京奇艺世纪科技有限公司 | A kind of method of data synchronization and device |
| CN110502584B (en) * | 2019-08-28 | 2021-09-28 | 北京三快在线科技有限公司 | Data synchronization method and device |
| CN110569142A (en) * | 2019-08-29 | 2019-12-13 | 天津大学 | A system and method for incremental synchronization of ORACLE data |
| CN112163037A (en) * | 2020-09-17 | 2021-01-01 | 彩讯科技股份有限公司 | Data synchronization method and device, computer equipment and storage medium |
| CN113641751A (en) * | 2021-07-01 | 2021-11-12 | 中科恒运股份有限公司 | Data increment synchronization method and device and terminal equipment |
| CN113641753A (en) * | 2021-07-01 | 2021-11-12 | 中科恒运股份有限公司 | Data increment synchronization method and device and terminal equipment |
| CN113656366B (en) * | 2021-08-03 | 2024-05-03 | 北京数码大方科技股份有限公司 | Data processing method and device for electronic warehouse |
| CN113986914B (en) * | 2021-09-30 | 2023-01-24 | 华东计算技术研究所（中国电子科技集团公司第三十二研究所） | System and method for synchronizing tree cascaded databases based on data increment |
| CN114996239A (en) * | 2022-04-28 | 2022-09-02 | 上海浦东发展银行股份有限公司 | Double-stage data migration method based on incremental data |
| CN115391457B (en) * | 2022-08-23 | 2023-09-12 | 昆仑数智科技有限责任公司 | Cross-database data synchronization method, device and storage medium |
| CN115442361B (en) * | 2022-08-30 | 2024-06-04 | 重庆长安汽车股份有限公司 | Synchronous transmission method, system, equipment and medium for large-batch files |
| CN115827649A (en) * | 2022-11-16 | 2023-03-21 | 浪潮通用软件有限公司 | Incremental data update method and storage medium based on event extension |
| CN116414813B (en) * | 2023-02-13 | 2025-01-17 | 中国人民财产保险股份有限公司 | Multi-source data acquisition method, system and equipment based on increment |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102289469B (en) * | 2011-07-26 | 2013-01-30 | 国电南瑞科技股份有限公司 | A method for supporting general-purpose databases to synchronize data based on physically isolated devices |
| CN102752372A (en) * | 2012-06-18 | 2012-10-24 | 天津神舟通用数据技术有限公司 | File based database synchronization method |
-
2012
- 2012-12-25 CN CN201210568861.0A patent/CN103067483B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN103067483A (en) | 2013-04-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103067483B (en) | Teledata increment synchronization method based on packet | |
| US11573938B2 (en) | Systems and methods for indexing source code in a search engine | |
| US11709821B2 (en) | Tracking change data in a database | |
| US9251236B2 (en) | Document synchronization solution | |
| US20120023116A1 (en) | System and method for conversion of jms message data into database transactions for application to multiple heterogeneous databases | |
| CN108647237A (en) | Method of data synchronization between isomeric relationship type database | |
| US8146100B2 (en) | System and method for event-based information flow in software development processes | |
| US20070255763A1 (en) | Database replication method and system | |
| US11900083B2 (en) | Systems and methods for indexing source code in a search engine | |
| US20060020616A1 (en) | Indexing operational logs in a distributed processing system | |
| US10417256B2 (en) | Synchronization adapter for synchronizing application data | |
| CA2526882A1 (en) | Method and system for reducing information latency in a business enterprise | |
| EP2047382A1 (en) | Two-way and multi-master synchronization over web syndications | |
| US9971779B2 (en) | Automated data intake system | |
| CN114691704A (en) | A metadata synchronization method based on MySQL binlog | |
| US9177001B2 (en) | Data index using a linked data standard | |
| US20180046779A1 (en) | Caching technology for clinical data sources | |
| KR100521742B1 (en) | Xml database duplicating apparatus for copying xml document to remote server without loss of structure and attribute information of xml document and method therefor | |
| US7610304B2 (en) | Techniques for performing file operations involving a link at a database management system | |
| CN103425673A (en) | Method and device for synchronously searching indexes on basis of Lucene | |
| US20050171969A1 (en) | Computer network security data management system and method | |
| US11829343B2 (en) | Generating a business object | |
| CN112948490B (en) | Data synchronization method, device, equipment and storage medium based on kafka and redis | |
| WO2018031012A1 (en) | Caching technology for clinical data sources | |
| CN119377315A (en) | A data synchronization method, system, device and medium for a big data platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |