[go: up one dir, main page]

CN101446966A - Data storage method and system - Google Patents

Data storage method and system Download PDF

Info

Publication number
CN101446966A
CN101446966A CNA200810192926XA CN200810192926A CN101446966A CN 101446966 A CN101446966 A CN 101446966A CN A200810192926X A CNA200810192926X A CN A200810192926XA CN 200810192926 A CN200810192926 A CN 200810192926A CN 101446966 A CN101446966 A CN 101446966A
Authority
CN
China
Prior art keywords
data
backup
task
filing
parts
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CNA200810192926XA
Other languages
Chinese (zh)
Inventor
郑承满
赵世辉
刘浩
王成名
邓杨
胡涛
李鹏
陈少静
李镜忠
董恒星
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Construction Bank Corp
Original Assignee
China Construction Bank Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Construction Bank Corp filed Critical China Construction Bank Corp
Priority to CNA200810192926XA priority Critical patent/CN101446966A/en
Publication of CN101446966A publication Critical patent/CN101446966A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a data storage method, comprising the following steps: the metadata information of data is provided, a filing task and/or a backup task of the data are/is formed according to the metadata information, the filing task and/or the backup task of the data are/is triggered, and the filing task and/or the backup task of the data are executed. The data storage method of the invention fully utilizes the action and advantage that the metadata can record the whole circulation process of the data, the filing task and/or the backup task of the data are/is formed according to the provided metadata information of the data, therefore, the online storage space using rate and the daily operation efficiency can be improved, the backup space and time is saved, the backup expense is reduced, and the visit of the filing and/or backup data is realized under the premise that the daily operation of the data storage system is not affected; in addition, the degree of automation of data storage is high and the data storage is not affected by manmade factors. The invention also discloses a data storage system.

Description

Date storage method and system
Technical field
The present invention relates to computer technology, more specifically, relate to the realization of data store strategy.
Background technology
As everyone knows, concern between the file that independently characteristic makes the classification stored energy of file pass through hierarchical storage management (Hierarchical Storage Management, HSM) technology realization.Described hierarchical storage management technology judges that by operating system described file is whether active, and in conjunction with the significance level of described file, forms the classification storage policy of filing, backup.
Yet, for data warehouse, its information storage means is different from ordinary file, and the data association in the described data warehouse is strong, and described operating system can't judge whether described data are active, and therefore existing hierarchical storage management technology can not realize the classification storage of data warehouse.At present, thus the information stores of data warehouse relies on the classification storage policy that the significance level of artificial cognition data forms filing, backup.
But because described Data Warehouse amount is huge, relation is complicated, and described data warehouse classification storage policy only is to tackle calamitous the recovery, can't satisfy and carry out historical data retrieval and analysis fast.In addition, because whether described data warehouse classification storage policy can not be judged described data active, therefore the data of classification storage comprise alive data and inactive data, and this visit that causes realizing described data can be wasted a large amount of processing resources, has a strong impact on the day-to-day operation of data warehouse.Moreover the existence of described inactive data makes the backup that realizes described data waste a large amount of room and times, and has increased the expense of described data backup.In addition, because the significance level of described Data Warehouse depends on artificial cognition, therefore described data warehouse classification storage policy is subjected to artificial factor, and it is big wrong possibility to occur, can not in time adjust under the situation of data change simultaneously.
Summary of the invention
The purpose of this invention is to provide a kind of date storage method and system, be used to solve available data warehouse classification storage policy can't judgment data the whether active and problem that influenced by human factor.
To achieve these goals, the invention provides a kind of date storage method, comprise the steps: to provide the metadata information of data; Form the filing task and/or the backup tasks of described data and trigger described filing task and/or backup tasks according to described metadata information; Execution is to the described filing task and/or the backup tasks of described data.
Wherein, described metadata information comprises the visiting frequency of described data.
In one embodiment of the invention, the described step that forms the filing task of described data according to described metadata information is specially: form filing task to described data according to the visiting frequency of described data and specific filing condition.
Wherein, described specific filing condition is the first holding time threshold value of the described data set and described data the shortest access cycle of the threshold value in the described first holding time threshold value.
In another embodiment of the present invention, described metadata information also comprises the holding time of described data.
Preferably, the described step that forms the backup tasks of described data according to described metadata information is specially: form incremental backup task to described data according to holding time of described data and particular delta backup condition.
Wherein, described particular delta backup condition is the second holding time threshold value of the described data of setting.
In another embodiment of the present invention, the described holding time is that described data have been performed the time of preserving after the described filing task.
In an embodiment of the present invention, described date storage method also comprises step: form the historical backup tasks that has been performed the data of described incremental backup task to described according to data that have been performed described incremental backup task and particular historical backup condition.
Wherein, the described significance level that be performed the data of described incremental backup task of described particular historical backup condition for setting.
In yet another embodiment of the present invention, the step of described filing task of described execution and/or backup tasks is specially: at the described filing task of carrying out on the data processing platform (DPP) and/or backup tasks or described filing task of execution and/or backup tasks on the common platform of setting up of database server, backup switch and backup server.
Correspondingly, the invention provides a kind of data-storage system, comprise first parts, second parts and the 3rd parts.Described first parts are used to provide the metadata information of data; Described second parts are used for forming the filing task and/or the backup tasks of described data and triggering described filing task and/or backup tasks according to described metadata information; Described the 3rd parts are used to carry out described filing task and/or backup tasks.
In one embodiment of the invention, described the 3rd parts are data processing platform (DPP).Described data processing platform (DPP) is carried out described filing task and described backup tasks.
In another embodiment of the present invention, described the 3rd parts comprise database server, backup switch and backup server, described database server is carried out described filing task and is provided data access interface for described first parts and described backup switch, described backup switch transmits described data by described data access interface, and described backup server is carried out described backup tasks to the data of described backup switch transmission.
Preferably, described data are stored in described first parts after described the 3rd parts are carried out described filing task to described data.
Wherein, described data-storage system also comprises the 4th parts, and described the 4th parts are used to store described the 3rd parts described data are carried out data behind the described backup tasks.
Compared with prior art, date storage method of the present invention makes full use of the effect and the advantage of the whole circulation process of metadata energy record data, its metadata information according to the data that provide forms filing task and/or the backup tasks to described data, therefore can be according to the activity of metadata information judgment data, thereby can not only promote online storage space utilization rate and day-to-day operation efficient, save backup space and time, reduce to back up expense, and can under the prerequisite of the day-to-day operation that does not influence data-storage system, realize the filing and/or the visit of Backup Data, the automaticity height of data storage is not subjected to artificial factor in addition.
By following description also in conjunction with the accompanying drawings, it is more clear that the present invention will become, and these accompanying drawings are used to explain embodiments of the invention.
Description of drawings
The present invention will be illustrated in the mode of example, and be not limited to the feature in the accompanying drawing, and identical in the accompanying drawings label is represented identity element.
Fig. 1 is the exemplary flow chart of an embodiment of date storage method of the present invention.
Fig. 2 is the exemplary flow chart of another embodiment of date storage method of the present invention.
Fig. 3 is the exemplary schematic representation of framework of an embodiment of data-storage system of the present invention.
Fig. 4 is the exemplary schematic representation of the framework of first parts of data-storage system shown in Figure 3 and the 4th parts.
Fig. 5 is the exemplary schematic representation of framework of another embodiment of data-storage system of the present invention.
Embodiment
The present invention will be described with reference to following details, and accompanying drawing can be set forth the present invention.Following description and accompanying drawing are elaborations of the present invention, and can not be interpreted as restriction of the present invention.Thereby being carried out to describe, a large amount of details provide complete understanding of the present invention.Yet under specific circumstances, known or traditional details is not carried out to be described so that can not cause unnecessary bluring in detail to the present invention.
Fig. 1 is the exemplary flow chart of an embodiment of date storage method of the present invention.As shown in Figure 1, described date storage method comprises the steps:
The metadata information (step S110) of data is provided;
Form filing task and/or backup tasks according to described metadata information, and trigger described filing task and/or backup tasks (step S120) described data;
Execution is to the described filing task and/or the backup tasks (step S130) of described data.
The present embodiment date storage method makes full use of the effect and the advantage of the whole circulation process of metadata energy record data, form filing task and/or backup tasks according to the metadata information of the data that provide to described data, therefore can be according to the activity of metadata information judgment data, thereby can not only promote online storage space utilization rate and day-to-day operation efficient, save backup space and time, reduce to back up expense, and can under the prerequisite of the day-to-day operation that does not influence data-storage system, realize the filing and/or the visit of Backup Data, the automaticity height of data storage is not subjected to artificial factor in addition.
It is pointed out that described step S130 can realize on the database service applicator platform, also can on the common platform of setting up of database server, backup switch and backup server, realize.
Fig. 2 is the exemplary flow chart of another embodiment of date storage method of the present invention.With reference to figure 2, will elaborate the date storage method of present embodiment below.
Step S210 provides the metadata information of data, and wherein said metadata information comprises the visiting frequency of described data.
Step S220 forms the filing task of described data and triggers described filing task according to the visiting frequency of described data and specific filing condition.
In described step S220, described specific filing condition is the first holding time threshold value of the described data set and described data the shortest access cycle of the threshold value in the described first holding time threshold value.For example, suppose that the described first holding time threshold value is 3 months, described the shortest access cycle, threshold value was 1 month, whether the visiting frequency of then judging described data is for preserving 3 months and no user visit in nearest 1 month, if, then meet described specific filing condition, form the filing task of described data and trigger described filing task.
Step S230 carries out the filing task to described data.
Wherein, described metadata information also comprises the holding time of described data.In the present embodiment, the described holding time is the holding time that described data have been performed becomes filing data after the described filing task.
Step S240 forms the incremental backup task of described filing data and triggers described incremental backup task according to holding time of described filing data and particular delta backup condition.
In described step S240, described particular delta backup condition is the second holding time threshold value of the described filing data of setting.Here, suppose that the described second holding time threshold value is 13 months, whether the holding time of then judging described filing data for preserving 13 months, if, then meet described particular delta backup condition, thereby form the incremental backup task of described filing data and trigger described incremental backup task.
Step S250 carries out the described incremental backup task to described filing data.
It must be noted that the described metadata information of the embodiment of the invention can be holding time of described data of filing not.At this moment, whether present embodiment reaches particular delta backup condition by the holding time of judging described data, if then form the incremental backup task of described data and trigger described incremental backup task, thereby realize carrying out incremental backup task to described data.
Step S260 forms the historical backup tasks of the described data that have been performed described incremental backup task and triggers described historical backup tasks according to the data that have been performed described incremental backup task and particular historical backup condition.
In step S260, the described significance level that be performed the data of described incremental backup task of described particular historical backup condition for setting.Present embodiment is by judging whether the described data that have been performed described incremental backup task meet described particular historical backup condition, thereby can classify to the described data that have been performed described incremental backup task, time segment preserves, be convenient to the data that historical statistics is analyzed thereby form, recover the described data that have been performed described incremental backup task simultaneously and also be easier to.
Step S270 carries out the described described historical backup tasks that has been performed the data of described incremental backup task.
In step S270, the data that have been performed described historical backup tasks can forever be preserved.
It must be noted that described metadata information also comprises the change record of described data.Therefore, present embodiment can in time be adjusted the storage mode of described data according to the change record in the metadata information under the situation of data change.
Step S280 regularly carries out the disaster recovery task to described data.
Fig. 3 is the exemplary schematic representation of framework of an embodiment of data-storage system of the present invention.As shown in Figure 3, described data-storage system comprises first parts 310, second parts 320 and the 3rd parts 330.
Described first parts 310 are used to provide the metadata information of data.
Described second parts 320 are used for forming the filing task and/or the backup tasks of described data and triggering described filing task and/or backup tasks according to described metadata information.Described second parts 320 can be for adopting common server, and software adopts data pick-up, conversion and loading (Extraction TransformationLoading, ETL) instrument DataStage and scheduling tool BMC Control-M.Thereby data pick-up, conversion and loading tool are used to analyze described metadata information forms described filing task and/or backup tasks, and it is described filing task and/or backup tasks configure trigger condition that scheduling tool is used for according to described metadata information.Above-mentioned two kinds of instruments provide good graphical interfaces and application programming interfaces, and (ApplicationProgramming Interface API) calls, and can adapt to the task of various complexity.
Described the 3rd parts 330 are used to carry out described filing task and/or backup tasks.
Described data-storage system also comprises the 4th parts 340, and described the 4th parts 340 are used to back up the data after 330 pairs of described data of described the 3rd parts are carried out described backup tasks.
In the present embodiment, described second parts 320 and the 3rd parts 330 by LAN (Local Area Network) (Local AreaNetwork, LAN) interconnected.
In the present embodiment, described the 3rd parts 330 are data processing platform (DPP), and described data processing platform (DPP) is not only born the filing task to described data, and bears the backup tasks to described data.Here, can be defined as Host Based (Host-Based) backup mode to the mode of carrying out described backup tasks by described database server.
On implementation, described data processing platform (DPP) can adopt many symmetrical multiprocessing (SymmetricMulti Processing, SMP) equipment, and form massively parallel processing (Massively Parallel Processing, MPP) system by dedicated network by the described equipment of symmetrical treatment more than many.Wherein every symmetrical multiprocessing facility has independent storage, described every symmetrical multiprocessing facility also links to each other with the storage of other symmetrical multiprocessing facility of part, when wherein a symmetrical multiprocessing facility breaks down, can take over by a described task that symmetrical multiprocessing moves like this by other symmetrical multiprocessing facility.
In the present embodiment, described data are stored in described first parts 310 after 330 pairs of described data of described the 3rd parts are carried out described filing task.It is pointed out that and described filing task executions can pass through Structured Query Language (SQL) (Structure Query Language, SQL) statement is finished.
Wherein, described metadata information comprises the visiting frequency of described data, and described second parts 320 form filing task to described data according to the visiting frequency of described data and specific filing condition.
With reference to figure 4, as detailed explanation, described first parts 310 can be divided into be used to provide user capture and store data and provide the visiting frequency of described data Runtime Library 311, form metadata information and preserve the metadatabase 312 of described metadata information and be used to preserve described data are carried out the data of filing after the filing task and cooperated described Runtime Library 311 to finish the filing storehouse 313 of the visit of the data that are performed described filing task according to the visiting frequency of described data according to described metadata information.In more detail, described specific filing condition is the first holding time threshold value of the described data set and described data the shortest access cycle of the threshold value in the described first holding time threshold value.For example, suppose that the described first holding time threshold value is 3 months, be 1 month the shortest described access cycle, whether the visiting frequency that then described second parts 320 are judged described data is for preserving 3 months but no user visit in nearest 1 month, if, then meet described specific filing condition, described second parts 320 form the filing task of described data and trigger described filing task, described database server is carried out the filing task to described data, and described filing storehouse 313 is arrived in the data filing that is stored in the described Runtime Library 311.
Wherein, described metadata information also comprises the holding time of described data.In the present embodiment, the described holding time is the time that described data have been performed becomes the preservation of filing data after the described filing task.Described second parts 320 form the incremental backup task of described filing data according to holding time of described filing data and particular delta backup condition and trigger described incremental backup task.
The described incremental backup task that described the 3rd parts 330 are carried out described filing data.Because described incremental backup task is the full backup to the increment of described filing data, can accurately locate when therefore recovering like this, recover the cost minimum.
It must be noted that the described metadata information of present embodiment can be holding time of described data of filing not.At this moment, described second parts 320 of present embodiment judge whether the holding time of described data reaches described particular delta backup condition, if, then form the described incremental backup task of described data and trigger described incremental backup task, thereby realize carrying out incremental backup task described data.
Described second parts 320 form the historical backup tasks of the described data that have been performed described incremental backup task according to the data that have been performed described incremental backup task and particular historical backup condition and trigger described historical backup tasks.Wherein, the described significance level that be performed the data of described incremental backup task of described particular historical backup condition for setting.Described the 3rd parts 330 are carried out the described described historical backup tasks that has been performed the data of described incremental backup task.Present embodiment judges by described second parts 320 whether the described data that have been performed described incremental backup task meet described particular historical backup condition, thereby can classify to the described data that have been performed described incremental backup task, time segment preserves, be convenient to the data that historical statistics is analyzed thereby form, recover the described data that have been performed described incremental backup task simultaneously and also be easier to.
With reference to figure 4, described the 4th parts 340 can be divided into the filing data that is used to back up 320 pairs of described filings of described second parts storehouse 313 and carry out the filing band group 341 of the data after the incremental backup task, are used to back up the calamity that described second parts have carried out the historical data band group 342 of the data behind the described historical backup tasks to the data of filing band group 341 and be used for the data of the described Runtime Library 311 of schedule backup and are equipped with band group 343.Described filing band group 341 is the full backup to the data increment in described filing storehouse 313, can accurately locate when therefore recovering, and recovers the cost minimum.The data of described historical data band group 342 need navigate to certain data time section in the filing storehouse 313 of described first parts 310 when recovering, it is less to guarantee to recover cost.Described calamity is equipped with the needs that band group 343 is mainly used in the recovery of suffering disaster property.
Fig. 5 is the exemplary schematic representation of framework of another embodiment of data-storage system of the present invention.Described data-storage system comprises first parts 310, second parts 320, the 3rd parts 350 and the 4th parts 340.Described first parts 310, second parts 320 and the 4th parts 340 are same as the previously described embodiments.Described the 3rd parts 350 comprise database server 330, backup switch 352 and backup server 353,330 pairs of described data of described database server are carried out described filing task and are provided data access interface for described first parts 310 and described backup switch 352, described backup switch 352 transmits described data by described data access interface, and the data of 353 pairs of described backup switch 352 transmission of described backup server are carried out described backup tasks.Here, can be defined as (LAN-BASE) backup mode to the mode of carrying out described backup tasks by described database server 330, backup switch 352 and backup server 353 based on LAN (Local Area Network).
In the present embodiment, described database server 330, backup server 353 adopts Ethernets to connect, the synchronous calamity that can realize the strange land be equipped with and the multisystem tape library shared.
In the data transmission procedure of described data-storage system, described first parts 310 adopt optical-fibre channel (FC with the transmission of described database server 330, Fiber Channel), described backup switch 352 adopts gigabit Ethernet (ETH with the transmission of described database server 330 and described backup server 353 respectively, EtherChannel), described backup server 353 adopts optical-fibre channel with the transmission of described the 4th parts 340.
The backup Control Software of described backup server 353 can use Netvault to realize, is connected with various first parts 310 by plug-in unit, can bring into play described first parts, 310 self-characteristics to greatest extent; Simultaneously, described backup server 353 utilizes it that described the 4th parts 340 are divided into groups and to the control function of described backup tasks priority, has guaranteed the parallel backup of big data quantity and the real time execution of vital task.
Thereby the date storage method of the embodiment of the invention and system utilize the effect of metadata aspect data management and the data storage scheme based on the data message content of advantage formation, with respect to present classification storage scheme based on file, its data locking is more accurate, automaticity is higher, is useful the replenishing of present hierarchical storage management technology.
The functions of components of the embodiment of the invention all adopts ripe third party's software and hardware to realize having good extendability and reusability.When using, can carry out cutting or increase to described function, set up the data-storage system that a cover is suitable for enterprises characteristics most according to characteristics separately.
In aforesaid specifying, the present invention is described with reference to specific embodiment wherein.Significantly, under the prerequisite of the spirit and scope of the broad of the present invention that does not break away from claim and proposed, multiple change can be made.Therefore, described specifying with accompanying drawing is considered to indicative implication, and nonrestrictive implication.

Claims (16)

1. a date storage method comprises the steps:
The metadata information of data is provided;
Form the filing task and/or the backup tasks of described data and trigger described filing task and/or backup tasks according to described metadata information;
Execution is to the described filing task and/or the backup tasks of described data.
2. date storage method as claimed in claim 1 is characterized in that described metadata information comprises the visiting frequency of described data.
3. date storage method as claimed in claim 2 is characterized in that, the described step that forms the filing task of described data according to described metadata information is specially:
Form filing task according to the visiting frequency of described data and specific filing condition to described data.
4. date storage method as claimed in claim 3 is characterized in that, described specific filing condition is the first holding time threshold value of the described data set and described data the shortest access cycle of the threshold value in the described first holding time threshold value.
5. date storage method as claimed in claim 1 is characterized in that described metadata information comprises the holding time of described data.
6. date storage method as claimed in claim 4 is characterized in that, the described step that forms the backup tasks of described data according to described metadata information is specially:
Form incremental backup task according to holding time of described data and particular delta backup condition to described data.
7. date storage method as claimed in claim 6 is characterized in that, described particular delta backup condition is the second holding time threshold value of the described data of setting.
8. as each described date storage method of claim 5-7, it is characterized in that the described holding time is that described data have been performed the time of preserving after the described filing task.
9. date storage method as claimed in claim 6 is characterized in that, also comprises step:
Form the historical backup tasks that has been performed the data of described incremental backup task to described according to data that have been performed described incremental backup task and particular historical backup condition.
10. date storage method as claimed in claim 9 is characterized in that, the described significance level that be performed the data of described incremental backup task of described particular historical backup condition for setting.
11. date storage method as claimed in claim 1 is characterized in that, the step of described filing task of described execution and/or backup tasks is specially:
Described filing task and/or the backup tasks on data processing platform (DPP), carried out; Or
On the common platform of setting up of database server, backup switch and backup server, carry out described filing task and/or backup tasks.
12. a data-storage system is characterized in that, comprising:
First parts are used to provide the metadata information of data;
Second parts are used for forming the filing task and/or the backup tasks of described data and triggering described filing task and/or backup tasks according to described metadata information;
The 3rd parts are used to carry out described filing task and/or backup tasks.
13. data-storage system as claimed in claim 12 is characterized in that, described the 3rd parts are data processing platform (DPP).
14. data-storage system as claimed in claim 12, it is characterized in that, described the 3rd parts comprise database server, backup switch and backup server, described database server is carried out described filing task and is provided data access interface for described first parts and described backup switch, described backup switch transmits described data by described data access interface, and described backup server is carried out described backup tasks to the data of described backup switch transmission.
15. data-storage system as claimed in claim 12 is characterized in that, described data are stored in described first parts after described the 3rd parts are carried out described filing task to described data.
16. data-storage system as claimed in claim 12 is characterized in that, also comprises:
The 4th parts are used to store described the 3rd parts described data are carried out data behind the described backup tasks.
CNA200810192926XA 2008-12-31 2008-12-31 Data storage method and system Pending CN101446966A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNA200810192926XA CN101446966A (en) 2008-12-31 2008-12-31 Data storage method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNA200810192926XA CN101446966A (en) 2008-12-31 2008-12-31 Data storage method and system

Publications (1)

Publication Number Publication Date
CN101446966A true CN101446966A (en) 2009-06-03

Family

ID=40742644

Family Applications (1)

Application Number Title Priority Date Filing Date
CNA200810192926XA Pending CN101446966A (en) 2008-12-31 2008-12-31 Data storage method and system

Country Status (1)

Country Link
CN (1) CN101446966A (en)

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102073712A (en) * 2010-12-31 2011-05-25 北京四方继保自动化股份有限公司 Holographic process data archiving and inverting method based on dynamic change frame
CN102231727A (en) * 2011-03-18 2011-11-02 杭州奕锐电子有限公司 Crypto-delta-transfer-based remote sharing backup recovery method
CN102238102A (en) * 2010-04-23 2011-11-09 微软公司 Quota-based archiving
CN102662890A (en) * 2012-02-28 2012-09-12 南京大学 Efficient method for data stream storage
CN102822792A (en) * 2010-01-27 2012-12-12 瓦欧尼斯系统有限公司 Data management utilizing access and content information
CN102937918A (en) * 2012-10-16 2013-02-20 西安交通大学 Data block balancing method in operation process of HDFS (Hadoop Distributed File System)
CN101719938B (en) * 2009-12-01 2013-04-24 中国建设银行股份有限公司 Method for acquiring content object, method for saving content object and corresponding system
CN101996214B (en) * 2009-08-27 2013-10-23 国际商业机器公司 Method and device for processing database operation request
CN103365744A (en) * 2012-04-04 2013-10-23 国际商业机器公司 System and method using metadata image backup and traditional backup
CN103617171A (en) * 2013-10-25 2014-03-05 芜湖大学科技园发展有限公司 Massive historical data fast enquiry system
CN103902404A (en) * 2012-12-26 2014-07-02 华为终端有限公司 Method, device and user equipment for media file backup
CN103929480A (en) * 2014-04-11 2014-07-16 北京智谷睿拓技术服务有限公司 Data backup method and device based on tasks
CN103942117A (en) * 2013-01-21 2014-07-23 中国移动通信集团河南有限公司 Data backup method, device and system
CN107239457A (en) * 2016-03-28 2017-10-10 阿里巴巴集团控股有限公司 Data archiving method and device
CN107239369A (en) * 2017-04-19 2017-10-10 中国建设银行股份有限公司 A kind of database filing standby system and method
CN107423426A (en) * 2017-08-02 2017-12-01 众安信息技术服务有限公司 A kind of data archiving method and electronic equipment of block chain block number evidence
CN107526775A (en) * 2017-07-18 2017-12-29 杭州趣链科技有限公司 A kind of method of block chain data filing
CN110059139A (en) * 2019-03-12 2019-07-26 平安普惠企业管理有限公司 Business datum archiving method, equipment, server and computer readable storage medium
CN117290329A (en) * 2023-02-15 2023-12-26 深圳市金鑫泉科技有限公司 Method for improving access concurrency performance of MPP data warehouse based on high-availability connection pool

Cited By (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101996214B (en) * 2009-08-27 2013-10-23 国际商业机器公司 Method and device for processing database operation request
US8626765B2 (en) 2009-08-27 2014-01-07 International Business Machines Corporation Processing database operation requests
CN101719938B (en) * 2009-12-01 2013-04-24 中国建设银行股份有限公司 Method for acquiring content object, method for saving content object and corresponding system
CN102822792A (en) * 2010-01-27 2012-12-12 瓦欧尼斯系统有限公司 Data management utilizing access and content information
CN102238102A (en) * 2010-04-23 2011-11-09 微软公司 Quota-based archiving
CN102238102B (en) * 2010-04-23 2016-01-20 微软技术许可有限责任公司 Based on the method and system of the file of quota
CN102073712A (en) * 2010-12-31 2011-05-25 北京四方继保自动化股份有限公司 Holographic process data archiving and inverting method based on dynamic change frame
CN102231727B (en) * 2011-03-18 2014-02-19 杭州奕锐电子有限公司 Crypto-delta-transfer-based remote sharing backup recovery method
CN102231727A (en) * 2011-03-18 2011-11-02 杭州奕锐电子有限公司 Crypto-delta-transfer-based remote sharing backup recovery method
CN102662890A (en) * 2012-02-28 2012-09-12 南京大学 Efficient method for data stream storage
CN103365744A (en) * 2012-04-04 2013-10-23 国际商业机器公司 System and method using metadata image backup and traditional backup
CN103365744B (en) * 2012-04-04 2015-12-23 国际商业机器公司 For mixing the system and method for metadata image backup and backup
CN102937918B (en) * 2012-10-16 2016-03-30 西安交通大学 A kind of HDFS runtime data block balance method
CN102937918A (en) * 2012-10-16 2013-02-20 西安交通大学 Data block balancing method in operation process of HDFS (Hadoop Distributed File System)
CN107704339B (en) * 2012-12-26 2021-06-15 华为终端有限公司 Media file backup method and device and user equipment
CN103902404A (en) * 2012-12-26 2014-07-02 华为终端有限公司 Method, device and user equipment for media file backup
CN107704339A (en) * 2012-12-26 2018-02-16 华为终端有限公司 A kind of method, apparatus and user equipment of media file backup
CN103942117A (en) * 2013-01-21 2014-07-23 中国移动通信集团河南有限公司 Data backup method, device and system
CN103617171A (en) * 2013-10-25 2014-03-05 芜湖大学科技园发展有限公司 Massive historical data fast enquiry system
CN103929480A (en) * 2014-04-11 2014-07-16 北京智谷睿拓技术服务有限公司 Data backup method and device based on tasks
CN107239457A (en) * 2016-03-28 2017-10-10 阿里巴巴集团控股有限公司 Data archiving method and device
CN107239369A (en) * 2017-04-19 2017-10-10 中国建设银行股份有限公司 A kind of database filing standby system and method
CN107526775A (en) * 2017-07-18 2017-12-29 杭州趣链科技有限公司 A kind of method of block chain data filing
CN107526775B (en) * 2017-07-18 2020-06-16 杭州趣链科技有限公司 Block chain data archiving method
CN107423426A (en) * 2017-08-02 2017-12-01 众安信息技术服务有限公司 A kind of data archiving method and electronic equipment of block chain block number evidence
CN107423426B (en) * 2017-08-02 2020-06-02 众安信息技术服务有限公司 A data filing method and electronic device for block chain block data
CN110059139A (en) * 2019-03-12 2019-07-26 平安普惠企业管理有限公司 Business datum archiving method, equipment, server and computer readable storage medium
WO2020181799A1 (en) * 2019-03-12 2020-09-17 平安普惠企业管理有限公司 Data archiving method and device, server, and computer readable storage medium
CN117290329A (en) * 2023-02-15 2023-12-26 深圳市金鑫泉科技有限公司 Method for improving access concurrency performance of MPP data warehouse based on high-availability connection pool
CN117290329B (en) * 2023-02-15 2025-03-14 深圳市金鑫泉科技有限公司 Method for improving access concurrency performance of MPP data warehouse based on high-availability connection pool

Similar Documents

Publication Publication Date Title
CN101446966A (en) Data storage method and system
Isah et al. A survey of distributed data stream processing frameworks
Marcu et al. Spark versus flink: Understanding performance in big data analytics frameworks
CN109756364B (en) Micro-service performance optimization system and analysis method based on log analysis
KR101956236B1 (en) Data replication technique in database management system
CN102521712B (en) A kind of process instance data processing method and device
CN105243155A (en) Big data extracting and exchanging system
CN105701190A (en) Data synchronizing method and device
CN107515933A (en) Change method, server, system and the storage medium of source data database table structure
CN103488564B (en) A kind of distributed real-time testing system multi-channel test data compression and merging method
Zvara et al. Optimizing distributed data stream processing by tracing
CN105069029B (en) A kind of real-time ETL system and method
CN102779138A (en) Hard disk access method of real time data
US10241716B2 (en) Global occupancy aggregator for global garbage collection scheduling
CN109635022B (en) Visual elastic search data acquisition method and device
CN107239369A (en) A kind of database filing standby system and method
US11416312B1 (en) Near-real-time data processing with partition files
CN111026764B (en) Data storage method and device, electronic product and storage medium
CN103927244A (en) Plug-in scheduling process monitoring method implemented based on dynamic proxy
CN107229657A (en) Data migration method and device
CN116166191A (en) Integrated system of lake and storehouse
CN105677853A (en) Data storage method and device based on big data technology framework
Marin et al. Reaching for the clouds: contextually enhancing smartphones for energy efficiency
CN110716976A (en) Distributed data access and storage system based on two interactive scenes
CN116795816A (en) A data warehouse construction method and system based on streaming processing

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Open date: 20090603