CN101876996A - Method and system for synchronizing data from main memory data bank to file data bank - Google Patents
Method and system for synchronizing data from main memory data bank to file data bank Download PDFInfo
- Publication number
- CN101876996A CN101876996A CN2009102460992A CN200910246099A CN101876996A CN 101876996 A CN101876996 A CN 101876996A CN 2009102460992 A CN2009102460992 A CN 2009102460992A CN 200910246099 A CN200910246099 A CN 200910246099A CN 101876996 A CN101876996 A CN 101876996A
- Authority
- CN
- China
- Prior art keywords
- data bank
- memory database
- document data
- data
- transaction journal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a method and a system for synchronizing data from a main memory data bank to a file data bank. The method comprises the following steps of: A, writing traction log records into a log cache region by using the main memory data bank; B, defining the correspondence between the main memory data bank and a data list of the file data bank; and C, refreshing a process according to traction logs, asynchronously synchronizing the information in the traction logs in the log cache region into the file data bank according to the correspondence between the main memory data bank and the data list of the data bank. The method and the system for synthesizing the data from the main memory data bank to the file data bank realize data synchronization on the premise of not influencing the performance of the main memory data bank.
Description
Technical field
The present invention relates to database field, particularly relate to method of data synchronization and the system of a kind of memory database to document data bank.
Background technology
Write formula daily record (Write-Ahead Logging in advance, WAL) be a kind of standard method that realizes transaction journal, the central idea of WAL is must be can only occur in these modifications to have write down after the daily record to the data file modifying carrier of index (table and), promptly after log record is washed into permanent storage.If follow this process, so just need when submitting to, each affairs all not be washed into disk to data page, because under the situation that collapse occurs, can come restore database with daily record: any record that does not append to data page as yet all will be reformed from log record earlier, and (this cries to roll forward and recovers, also be called the REDO daily record), the modification made of those affairs of not submitting to will be by deletion from data page (this cries the recovery of rolling backward, also is called the UNDO daily record) then.
Using first tangible benefit of WAL is exactly to have reduced the number of times that disk is write significantly, because have only journal file to need flush to disk when daily record is submitted to; In multi-user environment, the submission of many affairs can be finished with a synchronous function (fsync ()) of journal file.And journal file is that order writes disk, and data file is often made amendment between hereof, so the expense of synchronization log is little more than the expense of synchrodata page or leaf.
Using the another one benefit of WAL is the integrality of data page.No matter be business database, or increase income database such as MySQL, PostgreSQL or the like commonly used, before using the WAL principle, can not guarantee the integrality of data page under the situation of collapse.
Before using WAL, any collapse in the process of writing all may cause:
Index record points to a row that does not have table.Perhaps, index record is lost in splitting operation.Perhaps, the content of Beng Kui table and index page fully is because data page is only write the situation of a part.
Index record points to a row that does not have table; Perhaps, index record is lost in splitting operation and may be called repairing well by extra fsync (), if but there is not WAL, there are not effectively to handle the third situation i.e. table of collapse and the content of index page fully so, because data page is only write the method for a part of this situation.If need to guarantee the integrality of data page in the recovery after collapse, WAL preserves the content of whole data page in daily record.
WAL also provides database online backup and recovery, and (backup and restore, new method BAR) need regularly be saved in data file another one disk, tape or an other main frame and will back up the WAL journal file.Database file copy and daily record archive file just can be used for restore data as disaster recovery.Finish after the new database file, this old journal file just can be deleted at every turn.So just may need the daily record of recording data files and index creation and deletion; Also need to develop a kind of method simultaneously and come copies data file (this is because the operating system copy command is inappropriate).
Difficulty is to require to preserve in the appreciable time period WAL daily record (that is to say, the UNDO of affairs if desired, the same long with the time of possible the longest affairs so).The volume of the WAL form of database use at present is quite big, because comprise the mirror image of a plurality of disk pages or leaves.
Because the time interval that these daily records only need keep one to two checkpoint; But, may need the WAL form of certain compression in order to realize the daily record preservation.
Memory database is in the process of using, and the data importing that often needs regularly to show in the memory database is in the document data bank based on disk, as Oracle, DB2 etc.Because the application of memory database and document data bank is different, way commonly used is to adopt the mode of full dose table and incremental data.Adopt this mode, in the operation memory database, in an incremental data table, insert corresponding data, regularly after the incremental data table reads, be inserted into the document data bank by a service processes.
Memory database for data sync in document data bank, must set up an incremental data table to the synchronous table of needs.To each operation of memory database, as long as relate to the data of revising this table, then must increase a record in incremental data table the inside simultaneously, come the content of record modification.Therefore, an operation to memory database is evolved into now for a plurality of operations, and must finish in affairs.This has just influenced the performance of memory database greatly.
Summary of the invention
The purpose of this invention is to provide method of data synchronization and the system of a kind of memory database, under the prerequisite of the performance that does not influence memory database, realize data sync to document data bank.
The invention provides the method for data synchronization of a kind of memory database, said method comprising the steps of to document data bank:
A, memory database write the log buffer district with transaction log record;
The corresponding relation of B, definition memory database and document data bank tables of data;
C, refresh process according to transaction journal, with information in the described transaction journal in the described log buffer district, the corresponding relation according to described memory database and document data bank tables of data is synchronized in the document data bank asynchronously.
Preferably, described transaction journal is a WAL transaction journal file, is used to write down the transaction information of memory database.
Preferably, the described transaction journal of described step C is unformatted transaction journal file.
Preferably, described document data bank is Oracle or DB2 or Informix.
The present invention also provides the data synchronous system of a kind of memory database to document data bank, and described system comprises:
Memory database writes the log buffer district with transaction log record;
Document data bank;
Schema file is used to define the corresponding relation of memory database and document data bank tables of data;
The data transmission agency, be used for refreshing process according to transaction journal, with information in the described transaction journal in the described log buffer district, the corresponding relation according to memory database that defines in the described schema file and document data bank tables of data is synchronized in the described document data bank asynchronously.
Preferably, described transaction journal is a WAL transaction journal file, is used to write down the transaction information of memory database.
Preferably, the transaction journal in the described log buffer district is unformatted transaction journal file.
Preferably, described document data bank is 0racle or DB2 or Informix.
Compared with prior art, the present invention has the following advantages:
The described memory database of the embodiment of the invention is to the method for data synchronization of document data bank, owing to can define the corresponding relation of memory database and document data bank tables of data as required, so the corresponding relation of memory database and document data bank tables of data is configurable.The method of the invention is to refresh process according to transaction journal in addition, and with information in the described transaction journal in the described log buffer district, the corresponding relation according to described memory database and document data bank tables of data is synchronized in the document data bank asynchronously.Therefore, can guarantee that memory database is consistent with the document data bank constraint.Constraint database is a cover mechanism that realizes for the integrality that guarantees data.Mainly include NOT NULL constraint, UNIQUE constraints, PRIMARY KEY constraint, FOREIGN KEY constraint.
Description of drawings
Fig. 1 is that the described memory database of the embodiment of the invention is to document data bank method of data synchronization process flow diagram;
Fig. 2 is the corresponding relation synoptic diagram of described memory database of the embodiment of the invention and document data bank tables of data;
Fig. 3 is that the described memory database of the embodiment of the invention is to document data bank data synchronous system structural drawing.
Embodiment
The purpose of this invention is to provide the method for data synchronization of a kind of memory database, under the prerequisite that does not influence the memory database performance, realize data sync to document data bank.
For above-mentioned purpose of the present invention, feature and advantage can be become apparent more, memory database of the present invention is described in further detail to the document data bank method of data synchronization below in conjunction with the drawings and specific embodiments.
Referring to Fig. 1, this figure is that the described memory database of the embodiment of the invention is to document data bank method of data synchronization process flow diagram.
The described memory database of the embodiment of the invention may further comprise the steps to the document data bank method of data synchronization:
S100, memory database write the log buffer district with transaction log record.
Memory database is a kind of relational database system of internal memory optimization, all leaves in the physical memory by data and metadata, improves the operation response time of database.
Transaction journal is a file that separates with database file, all changes that storage is carried out database, and all write down insertion, renewal, deletion, submission, rollback and database schema variation.Under default situation, all databases all use transaction journal.The use of transaction journal is optionally, still, does not use except that the unprovoked cause specific, otherwise should use all the time.The database that operation has transaction journal can provide stronger failure protection function, more performance and data copy function.
Described transaction journal is specifically as follows WAL transaction journal file, is used to write down the transaction information of memory database.
WAL is a kind of standard method that realizes transaction journal.In brief, the central idea of WAL is must be can only occur in these modifications to have write down after the daily record to data file modifying (WAL is the table and the carrier of index).
Transaction journal in the log buffer district is unformatted transaction journal file.
For database,, must before affairs are submitted to, the affairs content be written in the transaction journal file with certain form in order to realize basic ACID characteristic.
ACID characteristic: atomicity, consistance, isolation and persistence that self-explanatory characters are engaged in.
The atomicity of affairs (Atomicity) is meant affairs or all carries out, or do not carry out.
The consistance of affairs (Consistency) be meant affairs database from the state-transition of a unanimity to another state.
The isolation of affairs (Isolation) is that other affairs are discovered the influence less than affairs before affairs are submitted to.The staggered state of carrying out can not appear in just plural affairs.Because may cause data inconsistent like this.
The persistence of affairs (Durability) is in case be meant the affairs submission, and it is permanent.After just affairs are moved successfully, be permanent with regard to the renewal of system, can unprovoked rollback.
And for memory database, in order to reach high performance, tend to reduce the requirement of " D " characteristic, promptly do not adopt such each transaction log record of document data bank at first must write disk file and write the submission affairs that success afterwards could be real, but earlier transaction log record is written to a transaction journal buffer area of operation systems share memory field, asynchronously transaction journal is brushed out on the disk transaction journal file by the log update process afterwards.Therefore, memory database and the undemanding ACID characteristic of observing.
The corresponding relation of S200, definition memory database and document data bank tables of data.
S300, transaction journal refresh process asynchronously with the information of the described transaction journal in the described log buffer district, and the corresponding relation according to described memory database and document data bank tables of data is synchronized in the document data bank.
Described document data bank can be Oracle or DB2 or Informix etc., be suitable for Transaction Processing (Online Transaction Processing, OLTP).
Described transaction journal in the described transaction journal buffer area is unformatted transaction journal file.
The described memory database of the embodiment of the invention is to the method for data synchronization of document data bank, owing to can define the corresponding relation of memory database and document data bank tables of data as required, so the corresponding relation of memory database and document data bank tables of data is configurable.The method of the invention is to refresh process according to transaction journal in addition, and asynchronously with the information in the described transaction journal in the described log buffer district, the corresponding relation according to described memory database and document data bank tables of data is synchronized in the document data bank.Therefore, can guarantee that memory database is consistent with the document data bank constraint.
Constraint database is a cover mechanism that realizes for the integrality that guarantees data.Mainly include NOTNULL constraint, UNIQUE constraints, PRIMARY KEY constraint, FOREIGN KEY constraint.
NOT NULL constraint applies is on single data rows, and the data rows of its protection must have data value.
UNIQUE constraints can be protected a plurality of data rows in the table, guarantees that the data of any two row in the data rows of protection are all inequality.
PRIMARY KYE constraint can be protected one or more row.PRIAMRY KEY constraint can retrain acting in conjunction in each data rows with NOT NULL.Table has unique major key constraint.
One or more data rows of FOREIGN KEY confining guard guarantees that the data of each data line comprise one or more null values, perhaps has major key constraint or unique constraint on the data rows of protection simultaneously.
Referring to Fig. 2, this figure is the corresponding relation synoptic diagram of described memory database of the embodiment of the invention and document data bank tables of data.
The corresponding relation of above-mentioned steps S200 definition memory database and document data bank tables of data defines by schema file (schema).
Table TBL_B promptly is equivalent to memory database among Fig. 2
TBL_A promptly is equivalent to document data bank
Schema has defined the parameter corresponding relation among TBL_B and the TBL_A.
The described memory database of the embodiment of the invention can carry out format conversion with unformatted transaction journal file by schema to the method for data synchronization of document data bank, is inserted in the document data bank.Guarantee consistent, the data type compatibility of constraint of memory database and document data bank by transmission agency (cache agent).
The invention provides the data synchronous system of a kind of memory database, under the prerequisite that does not influence the memory database performance, realize data sync to document data bank.
For above-mentioned purpose of the present invention, feature and advantage can be become apparent more, memory database of the present invention is described in further detail to the document data bank data synchronous system below in conjunction with the drawings and specific embodiments.
Referring to Fig. 3, this figure is that the described memory database of the embodiment of the invention is to document data bank data synchronous system structural drawing.
The described memory database of the embodiment of the invention comprises to the data synchronous system of document data bank:
Memory database 11 writes the log buffer district with transaction log record.
Transaction journal is specifically as follows WAL transaction journal file, is used to write down the transaction information of memory database 11.
Transaction journal in the described log buffer district is specially unformatted transaction journal file.
Document data bank 12 can be Oracle or DB2 or Informix etc., is suitable for OLTP and handles.
Schema file 14 is used to define the corresponding relation of described memory database 11 and described document data bank 12 tables of data.
Data transmission agency 13, be used for refreshing process according to transaction journal, with information in the described transaction journal in the described log buffer district, the corresponding relation according to memory database 11 that defines in the described schema file and document data bank 12 tables of data is synchronized in the described document data bank 12 asynchronously.
Described data transmission acts on behalf of 13, is used to guarantee consistent, the data type compatibility of constraint of memory database and document data bank.
The described memory database of the embodiment of the invention is to the data synchronous system of document data bank, because schema file 14 can define the corresponding relation of memory database 11 and document data bank 12 tables of data as required, so the corresponding relation of memory database 11 and document data bank 12 tables of data is configurable.The method of the invention is that data transmission agency 13 refreshes process according to transaction journal in addition, asynchronously with information in the described transaction journal in the described log buffer district, according to the described memory database 11 of schema file 14 definition and the corresponding relation of document data bank 12 tables of data, be synchronized in the document data bank 12.Therefore, can guarantee that memory database is consistent with the document data bank constraint.
More than memory database provided by the present invention is described in detail to document data bank method of data synchronization and system, used specific case herein principle of the present invention and embodiment are set forth, the explanation of above embodiment just is used for helping to understand method of the present invention and core concept thereof; Simultaneously, for one of ordinary skill in the art, according to thought of the present invention, the part that all can change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.
Claims (8)
1. a memory database is characterized in that to the method for data synchronization of document data bank, said method comprising the steps of:
A, memory database write the log buffer district with transaction log record;
The corresponding relation of B, definition memory database and document data bank tables of data;
C, refresh process according to transaction journal, with information in the described transaction journal in the described log buffer district, the corresponding relation according to described memory database and document data bank tables of data is synchronized in the document data bank asynchronously.
2. memory database according to claim 1 is characterized in that to the method for data synchronization of document data bank described transaction journal is a WAL transaction journal file, is used to write down the transaction information of memory database.
3. memory database according to claim 1 is characterized in that to the method for data synchronization of document data bank the described transaction journal of described step C is unformatted transaction journal file.
4. memory database according to claim 1 is characterized in that to the method for data synchronization of document data bank described document data bank is Oracle or DB2 or Informix.
5. a memory database is characterized in that to the data synchronous system of document data bank described system comprises:
Memory database writes the log buffer district with transaction log record;
Document data bank;
Schema file is used to define the corresponding relation of memory database and document data bank tables of data;
The data transmission agency, be used for refreshing process according to transaction journal, with information in the described transaction journal in the described log buffer district, the corresponding relation according to memory database that defines in the described schema file and document data bank tables of data is synchronized in the described document data bank asynchronously.
6. memory database according to claim 5 is characterized in that to the data synchronous system of document data bank described transaction journal is a WAL transaction journal file, is used to write down the transaction information of memory database.
7. memory database according to claim 5 is characterized in that to the data synchronous system of document data bank the transaction journal in the described log buffer district is unformatted transaction journal file.
8. memory database according to claim 5 is characterized in that to the data synchronous system of document data bank described document data bank is Oracle or DB2 or Informix.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009102460992A CN101876996A (en) | 2009-12-01 | 2009-12-01 | Method and system for synchronizing data from main memory data bank to file data bank |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009102460992A CN101876996A (en) | 2009-12-01 | 2009-12-01 | Method and system for synchronizing data from main memory data bank to file data bank |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101876996A true CN101876996A (en) | 2010-11-03 |
Family
ID=43019554
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2009102460992A Pending CN101876996A (en) | 2009-12-01 | 2009-12-01 | Method and system for synchronizing data from main memory data bank to file data bank |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101876996A (en) |
Cited By (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102521112A (en) * | 2011-11-18 | 2012-06-27 | 深圳中兴网信科技有限公司 | Memory-based reading and writing method of log information |
| CN103064761A (en) * | 2012-12-24 | 2013-04-24 | 华为技术有限公司 | Data synchronization method, device and system |
| CN103077187A (en) * | 2012-12-20 | 2013-05-01 | 曙光信息产业(北京)有限公司 | Log management method and log management system |
| CN103164384A (en) * | 2011-12-15 | 2013-06-19 | 中国银联股份有限公司 | Synchronous achieving method and system of multimachine system shared memory |
| CN103678638A (en) * | 2013-12-20 | 2014-03-26 | 厦门雅迅网络股份有限公司 | Object caching method based on disk |
| CN103812703A (en) * | 2014-02-20 | 2014-05-21 | 浪潮集团有限公司 | Asynchronous log saving method based on cloud computing |
| WO2014079290A1 (en) * | 2012-11-26 | 2014-05-30 | 腾讯科技（深圳）有限公司 | System and method for processing long relationship data chain of user |
| CN104572856A (en) * | 2014-12-17 | 2015-04-29 | 武汉科技大学 | Converged storage method of service source data |
| CN104657366A (en) * | 2013-11-18 | 2015-05-27 | 深圳市腾讯计算机系统有限公司 | Method and device for writing mass logs in database and log disaster-tolerant system |
| WO2015149461A1 (en) * | 2014-04-01 | 2015-10-08 | 中兴通讯股份有限公司 | Data synchronization method, device and server of database system |
| CN105701190A (en) * | 2016-01-07 | 2016-06-22 | 深圳市金证科技股份有限公司 | Data synchronizing method and device |
| CN105808638A (en) * | 2016-02-23 | 2016-07-27 | 平安科技（深圳）有限公司 | Data processing method and system |
| CN105989049A (en) * | 2015-02-05 | 2016-10-05 | 天脉聚源（北京）科技有限公司 | Data middle layer realizing method and system |
| CN103827865B (en) * | 2011-09-23 | 2016-12-28 | 国际商业机器公司 | Improve database caching with asynchronous log-based replication |
| CN106484869A (en) * | 2016-10-12 | 2017-03-08 | 北京集奥聚合科技有限公司 | A kind of distributed caching method based on mysql binlog and system |
| CN107133326A (en) * | 2017-05-05 | 2017-09-05 | 广州千淘信息技术有限公司 | A kind of asynchronous data storehouse and its data processing method |
| CN107577810A (en) * | 2017-09-27 | 2018-01-12 | 北京小米移动软件有限公司 | Data writing method, device and computer-readable storage medium |
| CN108170768A (en) * | 2017-12-25 | 2018-06-15 | 腾讯科技（深圳）有限公司 | database synchronization method, device and readable medium |
| CN108536845A (en) * | 2018-04-16 | 2018-09-14 | 中国刑事警察学院 | The incomplete data library file method of inspection |
| CN110597663A (en) * | 2019-09-16 | 2019-12-20 | 阿里巴巴集团控股有限公司 | Transaction processing method and device |
| CN112307060A (en) * | 2019-08-01 | 2021-02-02 | 北京京东振世信息技术有限公司 | Method and device for processing picking task |
| CN113360571A (en) * | 2021-06-03 | 2021-09-07 | 广东电网有限责任公司 | Characteristic mark-based power grid monitoring system memory database relation database synchronization method |
| CN114138565A (en) * | 2021-12-09 | 2022-03-04 | 瀚高基础软件股份有限公司 | Method and system for accelerating database backup |
| CN114490543A (en) * | 2022-01-12 | 2022-05-13 | 北京元年科技股份有限公司 | Transaction log implementation method, device, equipment and medium for memory multidimensional database |
| CN114647490A (en) * | 2022-03-14 | 2022-06-21 | 北京计算机技术及应用研究所 | A kind of embedded database highly reliable transaction processing method and device |
-
2009
- 2009-12-01 CN CN2009102460992A patent/CN101876996A/en active Pending
Cited By (33)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103827865B (en) * | 2011-09-23 | 2016-12-28 | 国际商业机器公司 | Improve database caching with asynchronous log-based replication |
| CN102521112A (en) * | 2011-11-18 | 2012-06-27 | 深圳中兴网信科技有限公司 | Memory-based reading and writing method of log information |
| CN103164384A (en) * | 2011-12-15 | 2013-06-19 | 中国银联股份有限公司 | Synchronous achieving method and system of multimachine system shared memory |
| US9754006B2 (en) | 2012-11-26 | 2017-09-05 | Tencent Technology (Shenzhen) Company Limited | System and method for processing long relation chain data of user |
| WO2014079290A1 (en) * | 2012-11-26 | 2014-05-30 | 腾讯科技（深圳）有限公司 | System and method for processing long relationship data chain of user |
| CN103838757A (en) * | 2012-11-26 | 2014-06-04 | 腾讯科技（深圳）有限公司 | System and method for processing long relation chain data of user |
| CN103838757B (en) * | 2012-11-26 | 2017-06-09 | 腾讯科技（深圳）有限公司 | To the processing system and method for the relation chain data long of user |
| CN103077187A (en) * | 2012-12-20 | 2013-05-01 | 曙光信息产业(北京)有限公司 | Log management method and log management system |
| CN103064761A (en) * | 2012-12-24 | 2013-04-24 | 华为技术有限公司 | Data synchronization method, device and system |
| CN104657366B (en) * | 2013-11-18 | 2019-05-24 | 深圳市腾讯计算机系统有限公司 | The method, apparatus and log disaster tolerance system of massive logs write-in database |
| CN104657366A (en) * | 2013-11-18 | 2015-05-27 | 深圳市腾讯计算机系统有限公司 | Method and device for writing mass logs in database and log disaster-tolerant system |
| CN103678638B (en) * | 2013-12-20 | 2018-10-19 | 厦门雅迅网络股份有限公司 | A kind of target cache method based on disk |
| CN103678638A (en) * | 2013-12-20 | 2014-03-26 | 厦门雅迅网络股份有限公司 | Object caching method based on disk |
| CN103812703A (en) * | 2014-02-20 | 2014-05-21 | 浪潮集团有限公司 | Asynchronous log saving method based on cloud computing |
| WO2015149461A1 (en) * | 2014-04-01 | 2015-10-08 | 中兴通讯股份有限公司 | Data synchronization method, device and server of database system |
| CN104572856A (en) * | 2014-12-17 | 2015-04-29 | 武汉科技大学 | Converged storage method of service source data |
| CN105989049A (en) * | 2015-02-05 | 2016-10-05 | 天脉聚源（北京）科技有限公司 | Data middle layer realizing method and system |
| CN105701190A (en) * | 2016-01-07 | 2016-06-22 | 深圳市金证科技股份有限公司 | Data synchronizing method and device |
| CN105808638B (en) * | 2016-02-23 | 2019-03-29 | 平安科技（深圳）有限公司 | Data processing method and system |
| CN105808638A (en) * | 2016-02-23 | 2016-07-27 | 平安科技（深圳）有限公司 | Data processing method and system |
| CN106484869A (en) * | 2016-10-12 | 2017-03-08 | 北京集奥聚合科技有限公司 | A kind of distributed caching method based on mysql binlog and system |
| CN107133326A (en) * | 2017-05-05 | 2017-09-05 | 广州千淘信息技术有限公司 | A kind of asynchronous data storehouse and its data processing method |
| CN107577810A (en) * | 2017-09-27 | 2018-01-12 | 北京小米移动软件有限公司 | Data writing method, device and computer-readable storage medium |
| CN108170768A (en) * | 2017-12-25 | 2018-06-15 | 腾讯科技（深圳）有限公司 | database synchronization method, device and readable medium |
| CN108536845A (en) * | 2018-04-16 | 2018-09-14 | 中国刑事警察学院 | The incomplete data library file method of inspection |
| CN112307060A (en) * | 2019-08-01 | 2021-02-02 | 北京京东振世信息技术有限公司 | Method and device for processing picking task |
| CN112307060B (en) * | 2019-08-01 | 2024-04-23 | 北京京东振世信息技术有限公司 | Method and device for processing picking task |
| CN110597663A (en) * | 2019-09-16 | 2019-12-20 | 阿里巴巴集团控股有限公司 | Transaction processing method and device |
| CN113360571A (en) * | 2021-06-03 | 2021-09-07 | 广东电网有限责任公司 | Characteristic mark-based power grid monitoring system memory database relation database synchronization method |
| CN113360571B (en) * | 2021-06-03 | 2024-08-16 | 广东电网有限责任公司 | Method for synchronizing memory library relation library of power grid monitoring system based on feature markers |
| CN114138565A (en) * | 2021-12-09 | 2022-03-04 | 瀚高基础软件股份有限公司 | Method and system for accelerating database backup |
| CN114490543A (en) * | 2022-01-12 | 2022-05-13 | 北京元年科技股份有限公司 | Transaction log implementation method, device, equipment and medium for memory multidimensional database |
| CN114647490A (en) * | 2022-03-14 | 2022-06-21 | 北京计算机技术及应用研究所 | A kind of embedded database highly reliable transaction processing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101876996A (en) | Method and system for synchronizing data from main memory data bank to file data bank | |
| US8977597B2 (en) | Generating and applying redo records | |
| CA2598584C (en) | Apparatus and method for identifying asynchronous data in redundant data stores and for re-synchronizing same | |
| US8429121B2 (en) | Apparatus and method for creating a real time database replica | |
| US6411964B1 (en) | Methods for in-place online reorganization of a database | |
| US6161109A (en) | Accumulating changes in a database management system by copying the data object to the image copy if the data object identifier of the data object is greater than the image identifier of the image copy | |
| EP1320802B1 (en) | A method and system for highly-parallel logging and recovery operation in main-memory transaction processing systems | |
| US7490113B2 (en) | Database log capture that publishes transactions to multiple targets to handle unavailable targets by separating the publishing of subscriptions and subsequently recombining the publishing | |
| US7200620B2 (en) | High availability data replication of smart large objects | |
| US6629110B2 (en) | Administration of a differential backup system in a client-server environment | |
| US6651073B1 (en) | Method and apparatus for insuring database data integrity without data recovery logging | |
| US20030074600A1 (en) | Data backup/recovery system | |
| US20080077636A1 (en) | Database backup system using data and user-defined routines replicators for maintaining a copy of database on a secondary server | |
| CN105574187B (en) | A method and system for ensuring consistency of replicated transactions in heterogeneous databases | |
| US20060235905A1 (en) | Method and system for preserving real-time access to a system in case of a disaster | |
| CN104881418B (en) | The method and apparatus in the quick recycling rollback space for MySQL | |
| CN101714169A (en) | Method and system for transmitting data on multiple nodes | |
| CN102388369A (en) | Granular application data lifecycle sourcing from a single backup | |
| JP2006018796A (en) | Data processing method and apparatus, storage apparatus and processing program therefor | |
| Ronstrom | On-line schema update for a telecom database | |
| JP2003532167A (en) | Database table recovery system | |
| CN120743905A (en) | OpenGauss database external table space compression backup and recovery method and system | |
| JP2004062759A (en) | Database log management method, its apparatus and its program | |
| KR20020030223A (en) | Logging and recovery method for supporting high performance transaction in main memory resident database system | |
| US6792435B1 (en) | Method and apparatus for recovering the definitions of dropped database objects |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20101103 |