CN101446966A - Data storage method and system - Google Patents
Data storage method and system Download PDFInfo
- Publication number
- CN101446966A CN101446966A CNA200810192926XA CN200810192926A CN101446966A CN 101446966 A CN101446966 A CN 101446966A CN A200810192926X A CNA200810192926X A CN A200810192926XA CN 200810192926 A CN200810192926 A CN 200810192926A CN 101446966 A CN101446966 A CN 101446966A
- Authority
- CN
- China
- Prior art keywords
- data
- backup
- task
- filing
- parts
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data storage method, comprising the following steps: the metadata information of data is provided, a filing task and/or a backup task of the data are/is formed according to the metadata information, the filing task and/or the backup task of the data are/is triggered, and the filing task and/or the backup task of the data are executed. The data storage method of the invention fully utilizes the action and advantage that the metadata can record the whole circulation process of the data, the filing task and/or the backup task of the data are/is formed according to the provided metadata information of the data, therefore, the online storage space using rate and the daily operation efficiency can be improved, the backup space and time is saved, the backup expense is reduced, and the visit of the filing and/or backup data is realized under the premise that the daily operation of the data storage system is not affected; in addition, the degree of automation of data storage is high and the data storage is not affected by manmade factors. The invention also discloses a data storage system.
Description
Technical field
The present invention relates to computer technology, more specifically, relate to the realization of data store strategy.
Background technology
As everyone knows, concern between the file that independently characteristic makes the classification stored energy of file pass through hierarchical storage management (Hierarchical Storage Management, HSM) technology realization.Described hierarchical storage management technology judges that by operating system described file is whether active, and in conjunction with the significance level of described file, forms the classification storage policy of filing, backup.
Yet, for data warehouse, its information storage means is different from ordinary file, and the data association in the described data warehouse is strong, and described operating system can't judge whether described data are active, and therefore existing hierarchical storage management technology can not realize the classification storage of data warehouse.At present, thus the information stores of data warehouse relies on the classification storage policy that the significance level of artificial cognition data forms filing, backup.
But because described Data Warehouse amount is huge, relation is complicated, and described data warehouse classification storage policy only is to tackle calamitous the recovery, can't satisfy and carry out historical data retrieval and analysis fast.In addition, because whether described data warehouse classification storage policy can not be judged described data active, therefore the data of classification storage comprise alive data and inactive data, and this visit that causes realizing described data can be wasted a large amount of processing resources, has a strong impact on the day-to-day operation of data warehouse.Moreover the existence of described inactive data makes the backup that realizes described data waste a large amount of room and times, and has increased the expense of described data backup.In addition, because the significance level of described Data Warehouse depends on artificial cognition, therefore described data warehouse classification storage policy is subjected to artificial factor, and it is big wrong possibility to occur, can not in time adjust under the situation of data change simultaneously.
Summary of the invention
The purpose of this invention is to provide a kind of date storage method and system, be used to solve available data warehouse classification storage policy can't judgment data the whether active and problem that influenced by human factor.
To achieve these goals, the invention provides a kind of date storage method, comprise the steps: to provide the metadata information of data; Form the filing task and/or the backup tasks of described data and trigger described filing task and/or backup tasks according to described metadata information; Execution is to the described filing task and/or the backup tasks of described data.
Wherein, described metadata information comprises the visiting frequency of described data.
In one embodiment of the invention, the described step that forms the filing task of described data according to described metadata information is specially: form filing task to described data according to the visiting frequency of described data and specific filing condition.
Wherein, described specific filing condition is the first holding time threshold value of the described data set and described data the shortest access cycle of the threshold value in the described first holding time threshold value.
In another embodiment of the present invention, described metadata information also comprises the holding time of described data.
Preferably, the described step that forms the backup tasks of described data according to described metadata information is specially: form incremental backup task to described data according to holding time of described data and particular delta backup condition.
Wherein, described particular delta backup condition is the second holding time threshold value of the described data of setting.
In another embodiment of the present invention, the described holding time is that described data have been performed the time of preserving after the described filing task.
In an embodiment of the present invention, described date storage method also comprises step: form the historical backup tasks that has been performed the data of described incremental backup task to described according to data that have been performed described incremental backup task and particular historical backup condition.
Wherein, the described significance level that be performed the data of described incremental backup task of described particular historical backup condition for setting.
In yet another embodiment of the present invention, the step of described filing task of described execution and/or backup tasks is specially: at the described filing task of carrying out on the data processing platform (DPP) and/or backup tasks or described filing task of execution and/or backup tasks on the common platform of setting up of database server, backup switch and backup server.
Correspondingly, the invention provides a kind of data-storage system, comprise first parts, second parts and the 3rd parts.Described first parts are used to provide the metadata information of data; Described second parts are used for forming the filing task and/or the backup tasks of described data and triggering described filing task and/or backup tasks according to described metadata information; Described the 3rd parts are used to carry out described filing task and/or backup tasks.
In one embodiment of the invention, described the 3rd parts are data processing platform (DPP).Described data processing platform (DPP) is carried out described filing task and described backup tasks.
In another embodiment of the present invention, described the 3rd parts comprise database server, backup switch and backup server, described database server is carried out described filing task and is provided data access interface for described first parts and described backup switch, described backup switch transmits described data by described data access interface, and described backup server is carried out described backup tasks to the data of described backup switch transmission.
Preferably, described data are stored in described first parts after described the 3rd parts are carried out described filing task to described data.
Wherein, described data-storage system also comprises the 4th parts, and described the 4th parts are used to store described the 3rd parts described data are carried out data behind the described backup tasks.
Compared with prior art, date storage method of the present invention makes full use of the effect and the advantage of the whole circulation process of metadata energy record data, its metadata information according to the data that provide forms filing task and/or the backup tasks to described data, therefore can be according to the activity of metadata information judgment data, thereby can not only promote online storage space utilization rate and day-to-day operation efficient, save backup space and time, reduce to back up expense, and can under the prerequisite of the day-to-day operation that does not influence data-storage system, realize the filing and/or the visit of Backup Data, the automaticity height of data storage is not subjected to artificial factor in addition.
By following description also in conjunction with the accompanying drawings, it is more clear that the present invention will become, and these accompanying drawings are used to explain embodiments of the invention.
Description of drawings
The present invention will be illustrated in the mode of example, and be not limited to the feature in the accompanying drawing, and identical in the accompanying drawings label is represented identity element.
Fig. 1 is the exemplary flow chart of an embodiment of date storage method of the present invention.
Fig. 2 is the exemplary flow chart of another embodiment of date storage method of the present invention.
Fig. 3 is the exemplary schematic representation of framework of an embodiment of data-storage system of the present invention.
Fig. 4 is the exemplary schematic representation of the framework of first parts of data-storage system shown in Figure 3 and the 4th parts.
Fig. 5 is the exemplary schematic representation of framework of another embodiment of data-storage system of the present invention.
Embodiment
The present invention will be described with reference to following details, and accompanying drawing can be set forth the present invention.Following description and accompanying drawing are elaborations of the present invention, and can not be interpreted as restriction of the present invention.Thereby being carried out to describe, a large amount of details provide complete understanding of the present invention.Yet under specific circumstances, known or traditional details is not carried out to be described so that can not cause unnecessary bluring in detail to the present invention.
Fig. 1 is the exemplary flow chart of an embodiment of date storage method of the present invention.As shown in Figure 1, described date storage method comprises the steps:
The metadata information (step S110) of data is provided;
Form filing task and/or backup tasks according to described metadata information, and trigger described filing task and/or backup tasks (step S120) described data;
Execution is to the described filing task and/or the backup tasks (step S130) of described data.
The present embodiment date storage method makes full use of the effect and the advantage of the whole circulation process of metadata energy record data, form filing task and/or backup tasks according to the metadata information of the data that provide to described data, therefore can be according to the activity of metadata information judgment data, thereby can not only promote online storage space utilization rate and day-to-day operation efficient, save backup space and time, reduce to back up expense, and can under the prerequisite of the day-to-day operation that does not influence data-storage system, realize the filing and/or the visit of Backup Data, the automaticity height of data storage is not subjected to artificial factor in addition.
It is pointed out that described step S130 can realize on the database service applicator platform, also can on the common platform of setting up of database server, backup switch and backup server, realize.
Fig. 2 is the exemplary flow chart of another embodiment of date storage method of the present invention.With reference to figure 2, will elaborate the date storage method of present embodiment below.
Step S210 provides the metadata information of data, and wherein said metadata information comprises the visiting frequency of described data.
Step S220 forms the filing task of described data and triggers described filing task according to the visiting frequency of described data and specific filing condition.
In described step S220, described specific filing condition is the first holding time threshold value of the described data set and described data the shortest access cycle of the threshold value in the described first holding time threshold value.For example, suppose that the described first holding time threshold value is 3 months, described the shortest access cycle, threshold value was 1 month, whether the visiting frequency of then judging described data is for preserving 3 months and no user visit in nearest 1 month, if, then meet described specific filing condition, form the filing task of described data and trigger described filing task.
Step S230 carries out the filing task to described data.
Wherein, described metadata information also comprises the holding time of described data.In the present embodiment, the described holding time is the holding time that described data have been performed becomes filing data after the described filing task.
Step S240 forms the incremental backup task of described filing data and triggers described incremental backup task according to holding time of described filing data and particular delta backup condition.
In described step S240, described particular delta backup condition is the second holding time threshold value of the described filing data of setting.Here, suppose that the described second holding time threshold value is 13 months, whether the holding time of then judging described filing data for preserving 13 months, if, then meet described particular delta backup condition, thereby form the incremental backup task of described filing data and trigger described incremental backup task.
Step S250 carries out the described incremental backup task to described filing data.
It must be noted that the described metadata information of the embodiment of the invention can be holding time of described data of filing not.At this moment, whether present embodiment reaches particular delta backup condition by the holding time of judging described data, if then form the incremental backup task of described data and trigger described incremental backup task, thereby realize carrying out incremental backup task to described data.
Step S260 forms the historical backup tasks of the described data that have been performed described incremental backup task and triggers described historical backup tasks according to the data that have been performed described incremental backup task and particular historical backup condition.
In step S260, the described significance level that be performed the data of described incremental backup task of described particular historical backup condition for setting.Present embodiment is by judging whether the described data that have been performed described incremental backup task meet described particular historical backup condition, thereby can classify to the described data that have been performed described incremental backup task, time segment preserves, be convenient to the data that historical statistics is analyzed thereby form, recover the described data that have been performed described incremental backup task simultaneously and also be easier to.
Step S270 carries out the described described historical backup tasks that has been performed the data of described incremental backup task.
In step S270, the data that have been performed described historical backup tasks can forever be preserved.
It must be noted that described metadata information also comprises the change record of described data.Therefore, present embodiment can in time be adjusted the storage mode of described data according to the change record in the metadata information under the situation of data change.
Step S280 regularly carries out the disaster recovery task to described data.
Fig. 3 is the exemplary schematic representation of framework of an embodiment of data-storage system of the present invention.As shown in Figure 3, described data-storage system comprises first parts 310, second parts 320 and the 3rd parts 330.
Described first parts 310 are used to provide the metadata information of data.
Described second parts 320 are used for forming the filing task and/or the backup tasks of described data and triggering described filing task and/or backup tasks according to described metadata information.Described second parts 320 can be for adopting common server, and software adopts data pick-up, conversion and loading (Extraction TransformationLoading, ETL) instrument DataStage and scheduling tool BMC Control-M.Thereby data pick-up, conversion and loading tool are used to analyze described metadata information forms described filing task and/or backup tasks, and it is described filing task and/or backup tasks configure trigger condition that scheduling tool is used for according to described metadata information.Above-mentioned two kinds of instruments provide good graphical interfaces and application programming interfaces, and (ApplicationProgramming Interface API) calls, and can adapt to the task of various complexity.
Described the 3rd parts 330 are used to carry out described filing task and/or backup tasks.
Described data-storage system also comprises the 4th parts 340, and described the 4th parts 340 are used to back up the data after 330 pairs of described data of described the 3rd parts are carried out described backup tasks.
In the present embodiment, described second parts 320 and the 3rd parts 330 by LAN (Local Area Network) (Local AreaNetwork, LAN) interconnected.
In the present embodiment, described the 3rd parts 330 are data processing platform (DPP), and described data processing platform (DPP) is not only born the filing task to described data, and bears the backup tasks to described data.Here, can be defined as Host Based (Host-Based) backup mode to the mode of carrying out described backup tasks by described database server.
On implementation, described data processing platform (DPP) can adopt many symmetrical multiprocessing (SymmetricMulti Processing, SMP) equipment, and form massively parallel processing (Massively Parallel Processing, MPP) system by dedicated network by the described equipment of symmetrical treatment more than many.Wherein every symmetrical multiprocessing facility has independent storage, described every symmetrical multiprocessing facility also links to each other with the storage of other symmetrical multiprocessing facility of part, when wherein a symmetrical multiprocessing facility breaks down, can take over by a described task that symmetrical multiprocessing moves like this by other symmetrical multiprocessing facility.
In the present embodiment, described data are stored in described first parts 310 after 330 pairs of described data of described the 3rd parts are carried out described filing task.It is pointed out that and described filing task executions can pass through Structured Query Language (SQL) (Structure Query Language, SQL) statement is finished.
Wherein, described metadata information comprises the visiting frequency of described data, and described second parts 320 form filing task to described data according to the visiting frequency of described data and specific filing condition.
With reference to figure 4, as detailed explanation, described first parts 310 can be divided into be used to provide user capture and store data and provide the visiting frequency of described data Runtime Library 311, form metadata information and preserve the metadatabase 312 of described metadata information and be used to preserve described data are carried out the data of filing after the filing task and cooperated described Runtime Library 311 to finish the filing storehouse 313 of the visit of the data that are performed described filing task according to the visiting frequency of described data according to described metadata information.In more detail, described specific filing condition is the first holding time threshold value of the described data set and described data the shortest access cycle of the threshold value in the described first holding time threshold value.For example, suppose that the described first holding time threshold value is 3 months, be 1 month the shortest described access cycle, whether the visiting frequency that then described second parts 320 are judged described data is for preserving 3 months but no user visit in nearest 1 month, if, then meet described specific filing condition, described second parts 320 form the filing task of described data and trigger described filing task, described database server is carried out the filing task to described data, and described filing storehouse 313 is arrived in the data filing that is stored in the described Runtime Library 311.
Wherein, described metadata information also comprises the holding time of described data.In the present embodiment, the described holding time is the time that described data have been performed becomes the preservation of filing data after the described filing task.Described second parts 320 form the incremental backup task of described filing data according to holding time of described filing data and particular delta backup condition and trigger described incremental backup task.
The described incremental backup task that described the 3rd parts 330 are carried out described filing data.Because described incremental backup task is the full backup to the increment of described filing data, can accurately locate when therefore recovering like this, recover the cost minimum.
It must be noted that the described metadata information of present embodiment can be holding time of described data of filing not.At this moment, described second parts 320 of present embodiment judge whether the holding time of described data reaches described particular delta backup condition, if, then form the described incremental backup task of described data and trigger described incremental backup task, thereby realize carrying out incremental backup task described data.
Described second parts 320 form the historical backup tasks of the described data that have been performed described incremental backup task according to the data that have been performed described incremental backup task and particular historical backup condition and trigger described historical backup tasks.Wherein, the described significance level that be performed the data of described incremental backup task of described particular historical backup condition for setting.Described the 3rd parts 330 are carried out the described described historical backup tasks that has been performed the data of described incremental backup task.Present embodiment judges by described second parts 320 whether the described data that have been performed described incremental backup task meet described particular historical backup condition, thereby can classify to the described data that have been performed described incremental backup task, time segment preserves, be convenient to the data that historical statistics is analyzed thereby form, recover the described data that have been performed described incremental backup task simultaneously and also be easier to.
With reference to figure 4, described the 4th parts 340 can be divided into the filing data that is used to back up 320 pairs of described filings of described second parts storehouse 313 and carry out the filing band group 341 of the data after the incremental backup task, are used to back up the calamity that described second parts have carried out the historical data band group 342 of the data behind the described historical backup tasks to the data of filing band group 341 and be used for the data of the described Runtime Library 311 of schedule backup and are equipped with band group 343.Described filing band group 341 is the full backup to the data increment in described filing storehouse 313, can accurately locate when therefore recovering, and recovers the cost minimum.The data of described historical data band group 342 need navigate to certain data time section in the filing storehouse 313 of described first parts 310 when recovering, it is less to guarantee to recover cost.Described calamity is equipped with the needs that band group 343 is mainly used in the recovery of suffering disaster property.
Fig. 5 is the exemplary schematic representation of framework of another embodiment of data-storage system of the present invention.Described data-storage system comprises first parts 310, second parts 320, the 3rd parts 350 and the 4th parts 340.Described first parts 310, second parts 320 and the 4th parts 340 are same as the previously described embodiments.Described the 3rd parts 350 comprise database server 330, backup switch 352 and backup server 353,330 pairs of described data of described database server are carried out described filing task and are provided data access interface for described first parts 310 and described backup switch 352, described backup switch 352 transmits described data by described data access interface, and the data of 353 pairs of described backup switch 352 transmission of described backup server are carried out described backup tasks.Here, can be defined as (LAN-BASE) backup mode to the mode of carrying out described backup tasks by described database server 330, backup switch 352 and backup server 353 based on LAN (Local Area Network).
In the present embodiment, described database server 330, backup server 353 adopts Ethernets to connect, the synchronous calamity that can realize the strange land be equipped with and the multisystem tape library shared.
In the data transmission procedure of described data-storage system, described first parts 310 adopt optical-fibre channel (FC with the transmission of described database server 330, Fiber Channel), described backup switch 352 adopts gigabit Ethernet (ETH with the transmission of described database server 330 and described backup server 353 respectively, EtherChannel), described backup server 353 adopts optical-fibre channel with the transmission of described the 4th parts 340.
The backup Control Software of described backup server 353 can use Netvault to realize, is connected with various first parts 310 by plug-in unit, can bring into play described first parts, 310 self-characteristics to greatest extent; Simultaneously, described backup server 353 utilizes it that described the 4th parts 340 are divided into groups and to the control function of described backup tasks priority, has guaranteed the parallel backup of big data quantity and the real time execution of vital task.
Thereby the date storage method of the embodiment of the invention and system utilize the effect of metadata aspect data management and the data storage scheme based on the data message content of advantage formation, with respect to present classification storage scheme based on file, its data locking is more accurate, automaticity is higher, is useful the replenishing of present hierarchical storage management technology.
The functions of components of the embodiment of the invention all adopts ripe third party's software and hardware to realize having good extendability and reusability.When using, can carry out cutting or increase to described function, set up the data-storage system that a cover is suitable for enterprises characteristics most according to characteristics separately.
In aforesaid specifying, the present invention is described with reference to specific embodiment wherein.Significantly, under the prerequisite of the spirit and scope of the broad of the present invention that does not break away from claim and proposed, multiple change can be made.Therefore, described specifying with accompanying drawing is considered to indicative implication, and nonrestrictive implication.
Claims (16)
1. a date storage method comprises the steps:
The metadata information of data is provided;
Form the filing task and/or the backup tasks of described data and trigger described filing task and/or backup tasks according to described metadata information;
Execution is to the described filing task and/or the backup tasks of described data.
2. date storage method as claimed in claim 1 is characterized in that described metadata information comprises the visiting frequency of described data.
3. date storage method as claimed in claim 2 is characterized in that, the described step that forms the filing task of described data according to described metadata information is specially:
Form filing task according to the visiting frequency of described data and specific filing condition to described data.
4. date storage method as claimed in claim 3 is characterized in that, described specific filing condition is the first holding time threshold value of the described data set and described data the shortest access cycle of the threshold value in the described first holding time threshold value.
5. date storage method as claimed in claim 1 is characterized in that described metadata information comprises the holding time of described data.
6. date storage method as claimed in claim 4 is characterized in that, the described step that forms the backup tasks of described data according to described metadata information is specially:
Form incremental backup task according to holding time of described data and particular delta backup condition to described data.
7. date storage method as claimed in claim 6 is characterized in that, described particular delta backup condition is the second holding time threshold value of the described data of setting.
8. as each described date storage method of claim 5-7, it is characterized in that the described holding time is that described data have been performed the time of preserving after the described filing task.
9. date storage method as claimed in claim 6 is characterized in that, also comprises step:
Form the historical backup tasks that has been performed the data of described incremental backup task to described according to data that have been performed described incremental backup task and particular historical backup condition.
10. date storage method as claimed in claim 9 is characterized in that, the described significance level that be performed the data of described incremental backup task of described particular historical backup condition for setting.
11. date storage method as claimed in claim 1 is characterized in that, the step of described filing task of described execution and/or backup tasks is specially:
Described filing task and/or the backup tasks on data processing platform (DPP), carried out; Or
On the common platform of setting up of database server, backup switch and backup server, carry out described filing task and/or backup tasks.
12. a data-storage system is characterized in that, comprising:
First parts are used to provide the metadata information of data;
Second parts are used for forming the filing task and/or the backup tasks of described data and triggering described filing task and/or backup tasks according to described metadata information;
The 3rd parts are used to carry out described filing task and/or backup tasks.
13. data-storage system as claimed in claim 12 is characterized in that, described the 3rd parts are data processing platform (DPP).
14. data-storage system as claimed in claim 12, it is characterized in that, described the 3rd parts comprise database server, backup switch and backup server, described database server is carried out described filing task and is provided data access interface for described first parts and described backup switch, described backup switch transmits described data by described data access interface, and described backup server is carried out described backup tasks to the data of described backup switch transmission.
15. data-storage system as claimed in claim 12 is characterized in that, described data are stored in described first parts after described the 3rd parts are carried out described filing task to described data.
16. data-storage system as claimed in claim 12 is characterized in that, also comprises:
The 4th parts are used to store described the 3rd parts described data are carried out data behind the described backup tasks.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CNA200810192926XA CN101446966A (en) | 2008-12-31 | 2008-12-31 | Data storage method and system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CNA200810192926XA CN101446966A (en) | 2008-12-31 | 2008-12-31 | Data storage method and system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN101446966A true CN101446966A (en) | 2009-06-03 |
Family
ID=40742644
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CNA200810192926XA Pending CN101446966A (en) | 2008-12-31 | 2008-12-31 | Data storage method and system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN101446966A (en) |
Cited By (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102073712A (en) * | 2010-12-31 | 2011-05-25 | 北京四方继保自动化股份有限公司 | Holographic process data archiving and inverting method based on dynamic change frame |
CN102231727A (en) * | 2011-03-18 | 2011-11-02 | 杭州奕锐电子有限公司 | Crypto-delta-transfer-based remote sharing backup recovery method |
CN102238102A (en) * | 2010-04-23 | 2011-11-09 | 微软公司 | Quota-based archiving |
CN102662890A (en) * | 2012-02-28 | 2012-09-12 | 南京大学 | Efficient method for data stream storage |
CN102822792A (en) * | 2010-01-27 | 2012-12-12 | 瓦欧尼斯系统有限公司 | Data management utilizing access and content information |
CN102937918A (en) * | 2012-10-16 | 2013-02-20 | 西安交通大学 | Data block balancing method in operation process of HDFS (Hadoop Distributed File System) |
CN101719938B (en) * | 2009-12-01 | 2013-04-24 | 中国建设银行股份有限公司 | Method for acquiring content object, method for saving content object and corresponding system |
CN101996214B (en) * | 2009-08-27 | 2013-10-23 | 国际商业机器公司 | Method and device for processing database operation request |
CN103365744A (en) * | 2012-04-04 | 2013-10-23 | 国际商业机器公司 | System and method using metadata image backup and traditional backup |
CN103617171A (en) * | 2013-10-25 | 2014-03-05 | 芜湖大学科技园发展有限公司 | Massive historical data fast enquiry system |
CN103902404A (en) * | 2012-12-26 | 2014-07-02 | 华为终端有限公司 | Method, device and user equipment for media file backup |
CN103929480A (en) * | 2014-04-11 | 2014-07-16 | 北京智谷睿拓技术服务有限公司 | Data backup method and device based on tasks |
CN103942117A (en) * | 2013-01-21 | 2014-07-23 | 中国移动通信集团河南有限公司 | Data backup method, device and system |
CN107239457A (en) * | 2016-03-28 | 2017-10-10 | 阿里巴巴集团控股有限公司 | Data archiving method and device |
CN107239369A (en) * | 2017-04-19 | 2017-10-10 | 中国建设银行股份有限公司 | A kind of database filing standby system and method |
CN107423426A (en) * | 2017-08-02 | 2017-12-01 | 众安信息技术服务有限公司 | A kind of data archiving method and electronic equipment of block chain block number evidence |
CN107526775A (en) * | 2017-07-18 | 2017-12-29 | 杭州趣链科技有限公司 | A kind of method of block chain data filing |
CN110059139A (en) * | 2019-03-12 | 2019-07-26 | 平安普惠企业管理有限公司 | Business datum archiving method, equipment, server and computer readable storage medium |
CN117290329A (en) * | 2023-02-15 | 2023-12-26 | 深圳市金鑫泉科技有限公司 | Method for improving access concurrency performance of MPP data warehouse based on high-availability connection pool |
-
2008
- 2008-12-31 CN CNA200810192926XA patent/CN101446966A/en active Pending
Cited By (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101996214B (en) * | 2009-08-27 | 2013-10-23 | 国际商业机器公司 | Method and device for processing database operation request |
US8626765B2 (en) | 2009-08-27 | 2014-01-07 | International Business Machines Corporation | Processing database operation requests |
CN101719938B (en) * | 2009-12-01 | 2013-04-24 | 中国建设银行股份有限公司 | Method for acquiring content object, method for saving content object and corresponding system |
CN102822792A (en) * | 2010-01-27 | 2012-12-12 | 瓦欧尼斯系统有限公司 | Data management utilizing access and content information |
CN102238102A (en) * | 2010-04-23 | 2011-11-09 | 微软公司 | Quota-based archiving |
CN102238102B (en) * | 2010-04-23 | 2016-01-20 | 微软技术许可有限责任公司 | Based on the method and system of the file of quota |
CN102073712A (en) * | 2010-12-31 | 2011-05-25 | 北京四方继保自动化股份有限公司 | Holographic process data archiving and inverting method based on dynamic change frame |
CN102231727B (en) * | 2011-03-18 | 2014-02-19 | 杭州奕锐电子有限公司 | Crypto-delta-transfer-based remote sharing backup recovery method |
CN102231727A (en) * | 2011-03-18 | 2011-11-02 | 杭州奕锐电子有限公司 | Crypto-delta-transfer-based remote sharing backup recovery method |
CN102662890A (en) * | 2012-02-28 | 2012-09-12 | 南京大学 | Efficient method for data stream storage |
CN103365744A (en) * | 2012-04-04 | 2013-10-23 | 国际商业机器公司 | System and method using metadata image backup and traditional backup |
CN103365744B (en) * | 2012-04-04 | 2015-12-23 | 国际商业机器公司 | For mixing the system and method for metadata image backup and backup |
CN102937918B (en) * | 2012-10-16 | 2016-03-30 | 西安交通大学 | A kind of HDFS runtime data block balance method |
CN102937918A (en) * | 2012-10-16 | 2013-02-20 | 西安交通大学 | Data block balancing method in operation process of HDFS (Hadoop Distributed File System) |
CN107704339B (en) * | 2012-12-26 | 2021-06-15 | 华为终端有限公司 | Media file backup method and device and user equipment |
CN103902404A (en) * | 2012-12-26 | 2014-07-02 | 华为终端有限公司 | Method, device and user equipment for media file backup |
CN107704339A (en) * | 2012-12-26 | 2018-02-16 | 华为终端有限公司 | A kind of method, apparatus and user equipment of media file backup |
CN103942117A (en) * | 2013-01-21 | 2014-07-23 | 中国移动通信集团河南有限公司 | Data backup method, device and system |
CN103617171A (en) * | 2013-10-25 | 2014-03-05 | 芜湖大学科技园发展有限公司 | Massive historical data fast enquiry system |
CN103929480A (en) * | 2014-04-11 | 2014-07-16 | 北京智谷睿拓技术服务有限公司 | Data backup method and device based on tasks |
CN107239457A (en) * | 2016-03-28 | 2017-10-10 | 阿里巴巴集团控股有限公司 | Data archiving method and device |
CN107239369A (en) * | 2017-04-19 | 2017-10-10 | 中国建设银行股份有限公司 | A kind of database filing standby system and method |
CN107526775A (en) * | 2017-07-18 | 2017-12-29 | 杭州趣链科技有限公司 | A kind of method of block chain data filing |
CN107526775B (en) * | 2017-07-18 | 2020-06-16 | 杭州趣链科技有限公司 | Block chain data archiving method |
CN107423426A (en) * | 2017-08-02 | 2017-12-01 | 众安信息技术服务有限公司 | A kind of data archiving method and electronic equipment of block chain block number evidence |
CN107423426B (en) * | 2017-08-02 | 2020-06-02 | 众安信息技术服务有限公司 | A data filing method and electronic device for block chain block data |
CN110059139A (en) * | 2019-03-12 | 2019-07-26 | 平安普惠企业管理有限公司 | Business datum archiving method, equipment, server and computer readable storage medium |
WO2020181799A1 (en) * | 2019-03-12 | 2020-09-17 | 平安普惠企业管理有限公司 | Data archiving method and device, server, and computer readable storage medium |
CN117290329A (en) * | 2023-02-15 | 2023-12-26 | 深圳市金鑫泉科技有限公司 | Method for improving access concurrency performance of MPP data warehouse based on high-availability connection pool |
CN117290329B (en) * | 2023-02-15 | 2025-03-14 | 深圳市金鑫泉科技有限公司 | Method for improving access concurrency performance of MPP data warehouse based on high-availability connection pool |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN101446966A (en) | Data storage method and system | |
Isah et al. | A survey of distributed data stream processing frameworks | |
Marcu et al. | Spark versus flink: Understanding performance in big data analytics frameworks | |
CN109756364B (en) | Micro-service performance optimization system and analysis method based on log analysis | |
KR101956236B1 (en) | Data replication technique in database management system | |
CN102521712B (en) | A kind of process instance data processing method and device | |
CN105243155A (en) | Big data extracting and exchanging system | |
CN105701190A (en) | Data synchronizing method and device | |
CN107515933A (en) | Change method, server, system and the storage medium of source data database table structure | |
CN103488564B (en) | A kind of distributed real-time testing system multi-channel test data compression and merging method | |
Zvara et al. | Optimizing distributed data stream processing by tracing | |
CN105069029B (en) | A kind of real-time ETL system and method | |
CN102779138A (en) | Hard disk access method of real time data | |
US10241716B2 (en) | Global occupancy aggregator for global garbage collection scheduling | |
CN109635022B (en) | Visual elastic search data acquisition method and device | |
CN107239369A (en) | A kind of database filing standby system and method | |
US11416312B1 (en) | Near-real-time data processing with partition files | |
CN111026764B (en) | Data storage method and device, electronic product and storage medium | |
CN103927244A (en) | Plug-in scheduling process monitoring method implemented based on dynamic proxy | |
CN107229657A (en) | Data migration method and device | |
CN116166191A (en) | Integrated system of lake and storehouse | |
CN105677853A (en) | Data storage method and device based on big data technology framework | |
Marin et al. | Reaching for the clouds: contextually enhancing smartphones for energy efficiency | |
CN110716976A (en) | Distributed data access and storage system based on two interactive scenes | |
CN116795816A (en) | A data warehouse construction method and system based on streaming processing |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C12 | Rejection of a patent application after its publication | ||
RJ01 | Rejection of invention patent application after publication |
Open date: 20090603 |