CN103312815A - Cloud storage system and data access method thereof - Google Patents
Cloud storage system and data access method thereof Download PDFInfo
- Publication number
- CN103312815A CN103312815A CN2013102699285A CN201310269928A CN103312815A CN 103312815 A CN103312815 A CN 103312815A CN 2013102699285 A CN2013102699285 A CN 2013102699285A CN 201310269928 A CN201310269928 A CN 201310269928A CN 103312815 A CN103312815 A CN 103312815A
- Authority
- CN
- China
- Prior art keywords
- cloud
- cloud storage
- medium data
- control server
- cloud control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a cloud storage system and a data access method thereof, and belongs to the technical field of computers and network information. The cloud storage system comprises at least two cloud control servers. The control servers are determined by a collecting end according to preset hash functions and multimedia source identifications, and information of multimedia data blocks are stored into the determined cloud control servers. Multiple cloud control servers are used, so that read-write concurrence capability of the cloud storage system is improved; meanwhile, jurisdiction scope division of the cloud control servers are realized through the preset hush functions according to the multimedia sources, so that proportionality and uniformity of loads of the cloud control servers are guaranteed.
Description
Technical field
The present invention relates to computer and network information technology field, relate in particular to a kind of cloud storage system and date storage method thereof.
Background technology
Along with the development at computer and networking and popularizing of HD video, the required space of storage multimedia constantly increases, and traditional storage architecture has been difficult to satisfy the demands.Cloud storage is with the characteristics such as the memory space of its magnanimity, high reliability, high concurrent, enhanced scalability and high performance-price ratio start to excel gradually.
Main flow cloud memory file system take google file system GFS as representative for the consideration of data consistency, generally only has a cloud Control Server in logic in the whole cluster.Although the cloud Control Server is not stored real data, but the cloud Control Server need to be monitored the running status of cloud storage server, the read-write operation of file all needs the cloud Control Server to coordinate simultaneously, along with increasing of cloud storage server quantity, cloud Control Server load is heavy, thereby the performance of cloud Control Server is restricting the scale of cloud storage.
Summary of the invention
In view of this, the technical problem to be solved in the present invention provides a kind of cloud storage system and date storage method thereof, to alleviate cloud Control Server performance to the restriction of the concurrent ability of cloud storage system and scale.
It is as follows that the present invention solves the problems of the technologies described above the technical scheme that adopts:
According to an aspect of the present invention, a kind of cloud storage system that provides comprises by network connection: collection terminal, at least two cloud Control Servers and at least two cloud storage servers,
Collection terminal is used for storing at least two multi-medium data pieces that multi-medium data is divided into the energy independent play-out by the sampling time into different cloud storage server; Collection terminal also is used for determining the cloud Control Server according to default hash function and multimedia sources sign, and the information of multi-medium data piece is saved in the determined cloud Control Server.
The cloud storage server is used for storing multimedia data piece respectively and sends the multi-medium data piece of appointment according to the download request that receives;
The cloud Control Server is used for preserving the information of multi-medium data piece and feeds back the cloud storage server at the multi-medium data piece place of appointment according to the query requests that receives;
Preferably, collection terminal specifically is used for using default hash function to be mapped to the numbering of cloud Control Server the multimedia sources sign.
Preferably, hash function comprises: MD4, MD5 or SHA-1.
Preferably, cloud storage system also comprises and cloud Control Server and the cloud storage server client by network connection, client is used for determining the cloud Control Server according to the default hash function identical with collection terminal and multimedia sources sign, cloud storage server to the required multi-medium data piece place of determined cloud Control Server inquiry obtains required multi-medium data piece from the cloud storage server that inquires.
The data access method of a kind of cloud storage system that provides according to another aspect of the present invention, comprises:
When the storage data, collection terminal is determined the cloud Control Server according to default hash function and multimedia sources sign, the multi-medium data piece that multi-medium data is divided into the energy independent play-out by the sampling time stores in the different cloud storage servers, and the relevant information of multi-medium data piece is saved in definite cloud Control Server;
When obtaining data, client is determined the cloud Control Server according to the default hash function identical with collection terminal and multimedia sources sign, cloud storage server to the required multi-medium data piece place of the cloud Control Server inquiry of determining obtains required multi-medium data piece from the cloud storage server that inquires.
Preferably, the information of multi-medium data piece comprises: multi-medium data block identification, multimedia sources sign, cloud storage server sign, time started and concluding time.
Preferably, determine that according to default hash function and multimedia sources sign the cloud Control Server specifically comprises:
At least two cloud Control Servers are numbered; Use default hash function to be mapped to the numbering of cloud Control Server the multimedia sources sign.
Preferably, hash function comprises: MD4, MD5 or SHA-1.
Preferably, the cloud storage server to the required multi-medium data piece place of the cloud Control Server inquiry of determining comprises: cloud storage server from time started to the cloud Control Server that inquire about first multi-medium data piece place according to multimedia sources sign and; And/or inquire about the cloud storage server at next multi-medium data piece place to the cloud Control Server according to the concluding time of multimedia sources sign and a upper multi-medium data piece.
System and method provided by the invention, compare with prior art, owing to using a plurality of cloud Control Servers, improved the concurrent ability of read-write of cloud storage system, simultaneously, the cloud Control Server is carried out the compass of competency division of labor by multimedia sources by default hash function, guaranteed each cloud Control Server Balance of load and consistency.
Description of drawings
The structural representation of a kind of cloud storage system that Fig. 1 provides for the embodiment of the invention;
The modular structure figure of a kind of cloud storage system that Fig. 2 provides for the preferred embodiment of the present invention;
The flow chart of a kind of date storage method that Fig. 3 provides for the embodiment of the invention;
The flow chart of a kind of data capture method that Fig. 4 provides for the preferred embodiment of the present invention;
The flow chart of a kind of video data acquisition methods that Fig. 5 provides for the preferred embodiment of the present invention.
Embodiment
In order to make technical problem to be solved by this invention, technical scheme and beneficial effect clearer, clear, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explain the present invention, is not intended to limit the present invention.
See also Fig. 1 and Fig. 2, a kind of cloud storage system that the embodiment of the invention provides comprises client 40, collection terminal 30, at least two cloud Control Servers 20 and at least two the cloud storage servers 10 that link to each other by network, wherein:
Further, cloud storage server 10 comprises data memory module 101 and download module 102, data memory module 101 is used for the multi-medium data piece that storage of collected end 30 is uploaded, and download module 102 is used for receiving the request of client 40 to the required multi-medium data piece of client 40 transmissions.Data memory module 101 can be stored at least two multi-medium data pieces, and the total number of the multi-medium data piece of storage has determined the scale of cloud storage system on all cloud storage servers 10.
Cloud Control Server 20 is for the relevant information of the multi-medium data piece of preserving 10 storages of cloud storage server; Also be used for receiving the request of client 40 to the cloud storage server 10 at the multi-medium data piece place of client 40 feedback appointments.
Further, cloud Control Server 20 comprises information storage module 201 and information inquiry module 202, and information storage module 201 is used for the relevant information of the multi-medium data piece of preservation cloud storage server 10 storages; Wherein, the relevant information of multi-medium data piece comprises: multi-medium data block identification, multimedia sources sign, cloud storage server sign, time started and concluding time, specifically can utilize database to preserve the multi-medium data block message.Information inquiry module 202 is used for receiving the request of client 40 to the cloud storage server 10 at the multi-medium data piece place of client 40 feedback appointments.
Collection terminal 30, with multi-medium data by the sampling time be divided into can independent play-out the multi-medium data piece store in the different cloud storage servers 10, and the relevant information of multi-medium data piece is saved in the cloud Control Server 20 of determining according to default hash function and multimedia sources sign;
Specifically, every cloud Control Server is by 0 to n-1 numbering, and collection terminal uses default hash function, the multimedia sources sign is mapped to interval [0, n-1] on, obtain the numbering of cloud Control Server, the information of multi-medium data piece is saved in the corresponding cloud Control Server of described numbering.
Client 40, be used for determining cloud Control Server 20 according to the default hash function identical with collection terminal and multimedia sources sign, cloud storage server 10 to the required multi-medium data piece place of determined cloud Control Server 20 inquiries obtains required multi-medium data piece from the cloud storage server 10 that inquires.
System provided by the invention, owing to using a plurality of cloud Control Servers, having improved the concurrent ability of read-write of cloud storage system, simultaneously, the cloud Control Server is carried out the compass of competency division of labor by multimedia sources by default hash function, guaranteed each cloud Control Server Balance of load and consistency.
The flow chart of a kind of date storage method that provides for the embodiment of the invention such as Fig. 3, the method may further comprise the steps:
S301, default hash function and the multimedia sources sign of basis are determined the cloud Control Server;
Before this step, every cloud Control Server is numbered by 0 to n-1, default hash function, make result that its hash function obtains under any input parameter all [0, n-1] on the interval, guarantee like this multimedia sources sign can both be mapped on the numbering of server, obtain the numbering of cloud Control Server, the information of multi-medium data piece is saved in the corresponding cloud Control Server of described numbering.
Specifically, use default hash function, calculate the numbering of cloud Control Server according to the multimedia sources sign, thereby select corresponding cloud Control Server.That is to say and use default hash function to be mapped to the numbering of cloud Control Server the multimedia sources sign.Wherein, hash function can have multiple choices, such as MD4, MD5, SHA-1 etc.
S302, the multi-medium data piece that multi-medium data is divided into the energy independent play-out by the sampling time store in the different cloud storage servers, and the relevant information of multi-medium data piece are saved in the determined cloud Control Server.
By the present embodiment, select the cloud Control Server according to multimedia sources sign by hash function, so that the orderly division of labor management of each cloud Control Server, also balanced simultaneously load.
The flow chart of a kind of data capture method that provides for the embodiment of the invention such as Fig. 4, the method may further comprise the steps:
S401, default hash function and the multimedia sources sign of basis are determined the cloud Control Server;
Specifically, use pre-determined hash function, calculate the numbering of cloud Control Server according to the multimedia sources sign, thereby select corresponding cloud Control Server.Wherein, hash function can have multiple choices, such as MD4, MD5, SHA-1 etc.Need to prove, step S401 numbers consistent with the cloud Control Server that S301 must use identical hash function to guarantee that same multimedia sources sign calculates.
S402, to the cloud storage server at the required multi-medium data piece place of determined cloud Control Server inquiry;
Particularly, client can be inquired about according to multimedia sources sign and time started the cloud storage server at first multi-medium data piece place to the cloud Control Server; Can also inquire about according to the concluding time of multimedia sources sign and a upper multi-medium data piece cloud storage server at next multi-medium data piece place to the cloud Control Server.
S403, obtain required multi-medium data piece from the cloud storage server that inquires.
Particularly, after client is obtained the stores service at required multi-medium data piece place from the cloud Control Server, set up session with the cloud storage server at required multi-medium data piece place, receive required multi-medium data piece.
The flow chart of the acquisition methods of a kind of video data that provides for the preferred embodiment of the present invention such as Fig. 5, the method may further comprise the steps:
S501, client are determined the cloud Control Server according to the video source sign of default hash function and required video data;
This method is in the situation that do not carry out between each cloud Control Server that data are synchronous to be described, if can guarantee in the situation of each cloud Control Server data consistency, then can choose the cloud Control Server wantonly during read block, and that is to say does not need step S501.
S502, client are according to the video source sign of required video data and the time started cloud storage server to first block of video data place of cloud Control Server request;
Wherein, video source sign and time started are generally set by the user who has access to historical video.The user generally arranges the required video source sign of having access to video data, time started, deadline etc. by client.
S503, cloud Control Server are to the cloud storage server 1 at first data block place of client feedback;
S504, client and cloud storage server 1 are set up session, ask first block of video data;
S505, cloud storage server 1 send first data block to client;
S506 judges whether the concluding time of the current multi-medium data piece that gets access to is the deadline of presetting, execution in step S507 if not, otherwise process ends;
S507, client inquired about next block of video data place according to the video source sign of required video data and cloud storage server from a upper data block end time to the cloud Control Server;
S508, cloud Control Server are to the cloud storage server 2 at the next block of video data of client feedback place;
S509, client and cloud storage server 2 are set up session, ask next block of video data;
S510, cloud storage server 2 send next block of video data to client.
Circulation execution in step S506-S510 is until namely, receive till the required video data deadline of the concluding time of the current block of video data that gets access to for presetting.In order to save the resource of client, improve the efficient of client, after block of video data of the every reception of client is finished, can disconnect the session with current cloud storage server.
System and method provided by the invention, compare with prior art, owing to using a plurality of cloud Control Servers, improved the concurrent ability of read-write of cloud storage system, simultaneously, the cloud Control Server is carried out the compass of competency division of labor by multimedia sources by default hash function, guaranteed each cloud Control Server Balance of load and consistency.
Above with reference to the accompanying drawings of the preferred embodiments of the present invention, be not so limit to interest field of the present invention.Those skilled in the art do not depart from the scope and spirit of the present invention interior any modification of doing, are equal to and replace and improve, all should be within interest field of the present invention.
Claims (10)
1. cloud storage system, comprise: by collection terminal, cloud Control Server and at least two cloud storage servers of network connection, wherein, collection terminal is used for storing at least two multi-medium data pieces that multi-medium data is divided into the energy independent play-out by the sampling time into different cloud storage server; The multi-medium data piece that the cloud storage server is used for storing respectively described multi-medium data piece and sends appointment according to the download request that receives; The cloud Control Server is used for preserving the information of described multi-medium data piece and feeds back the cloud storage server at the multi-medium data piece place of appointment according to the query requests that receives;
It is characterized in that, the quantity of described cloud Control Server is at least two, described collection terminal also is used for determining the cloud Control Server according to default hash function and multimedia sources sign, and the information of described multi-medium data piece is saved in the determined cloud Control Server.
2. cloud storage system according to claim 1 is characterized in that, the information of multi-medium data piece comprises: multi-medium data block identification, multimedia sources sign, cloud storage server sign, time started and concluding time.
3. cloud storage system according to claim 1 is characterized in that, described collection terminal specifically is used for using default hash function to be mapped to the numbering of cloud Control Server the multimedia sources sign.
4. according to claim 1 and 2 or 3 described cloud storage systems, it is characterized in that, hash function comprises: MD4, MD5 or SHA-1.
5. cloud storage system according to claim 4 is characterized in that, described cloud storage system also comprises and described cloud Control Server and the cloud storage server client by network connection,
Described client, be used for determining the cloud Control Server according to the default hash function identical with described collection terminal and multimedia sources sign, cloud storage server to the required multi-medium data piece place of determined cloud Control Server inquiry obtains required multi-medium data piece from the cloud storage server that inquires.
6. the data access method of a cloud storage system is characterized in that, comprising:
When the storage data, collection terminal is determined the cloud Control Server according to default hash function and multimedia sources sign, the multi-medium data piece that multi-medium data is divided into the energy independent play-out by the sampling time stores in the different cloud storage servers, and the relevant information of multi-medium data piece is saved in definite cloud Control Server;
When obtaining data, client is determined the cloud Control Server according to the default hash function identical with collection terminal and multimedia sources sign, cloud storage server to the required multi-medium data piece place of the cloud Control Server inquiry of determining obtains required multi-medium data piece from the cloud storage server that inquires.
7. data access method according to claim 6 is characterized in that, the information of multi-medium data piece comprises: multi-medium data block identification, multimedia sources sign, cloud storage server sign, time started and concluding time.
8. data access method according to claim 6 is characterized in that, the hash function that described basis is default and multimedia sources sign determine that the cloud Control Server specifically comprises:
At least two cloud Control Servers are numbered;
Use default hash function to be mapped to the numbering of cloud Control Server the multimedia sources sign.
9. according to claim 6 or 7 or 8 described cloud storage systems, it is characterized in that, hash function comprises: MD4, MD5 or SHA-1.
10. data capture method according to claim 9 is characterized in that, described cloud storage server to the required multi-medium data piece place of the cloud Control Server inquiry of determining comprises:
Inquire about the cloud storage server at first multi-medium data piece place to the cloud Control Server according to multimedia sources sign and time started; And/or inquire about the cloud storage server at next multi-medium data piece place to the cloud Control Server according to the concluding time of multimedia sources sign and a upper multi-medium data piece.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2013102699285A CN103312815A (en) | 2013-06-28 | 2013-06-28 | Cloud storage system and data access method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2013102699285A CN103312815A (en) | 2013-06-28 | 2013-06-28 | Cloud storage system and data access method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103312815A true CN103312815A (en) | 2013-09-18 |
Family
ID=49137593
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2013102699285A Pending CN103312815A (en) | 2013-06-28 | 2013-06-28 | Cloud storage system and data access method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103312815A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103686447A (en) * | 2013-12-20 | 2014-03-26 | 广东威创视讯科技股份有限公司 | Video transmission method and system |
| CN103747054B (en) * | 2013-12-26 | 2017-04-12 | 福建伊时代信息科技股份有限公司 | Network data distribution device and system having the same |
| CN107948191A (en) * | 2017-12-14 | 2018-04-20 | 宁波升维信息技术有限公司 | A kind of cloud storage system and its data access method |
| CN109358977A (en) * | 2018-08-21 | 2019-02-19 | 中国科学院信息工程研究所 | A method and system applied to cloud storage redundancy verification |
| CN115421653A (en) * | 2022-08-25 | 2022-12-02 | 北京奥星贝斯科技有限公司 | Method and device for managing blocks in storage system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080065704A1 (en) * | 2006-09-12 | 2008-03-13 | Microsoft Corporation | Data and replica placement using r-out-of-k hash functions |
| CN101692239A (en) * | 2009-10-19 | 2010-04-07 | 浙江大学 | Method for distributing metadata of distributed type file system |
| CN102420854A (en) * | 2011-11-14 | 2012-04-18 | 西安电子科技大学 | Distributed file system for cloud storage |
| US20120166403A1 (en) * | 2010-12-24 | 2012-06-28 | Kim Mi-Jeom | Distributed storage system having content-based deduplication function and object storing method |
| CN103152423A (en) * | 2013-03-15 | 2013-06-12 | 安科智慧城市技术（中国）有限公司 | Cloud storage system and data access method thereof |
-
2013
- 2013-06-28 CN CN2013102699285A patent/CN103312815A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080065704A1 (en) * | 2006-09-12 | 2008-03-13 | Microsoft Corporation | Data and replica placement using r-out-of-k hash functions |
| CN101692239A (en) * | 2009-10-19 | 2010-04-07 | 浙江大学 | Method for distributing metadata of distributed type file system |
| US20120166403A1 (en) * | 2010-12-24 | 2012-06-28 | Kim Mi-Jeom | Distributed storage system having content-based deduplication function and object storing method |
| CN102420854A (en) * | 2011-11-14 | 2012-04-18 | 西安电子科技大学 | Distributed file system for cloud storage |
| CN103152423A (en) * | 2013-03-15 | 2013-06-12 | 安科智慧城市技术（中国）有限公司 | Cloud storage system and data access method thereof |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103686447A (en) * | 2013-12-20 | 2014-03-26 | 广东威创视讯科技股份有限公司 | Video transmission method and system |
| CN103686447B (en) * | 2013-12-20 | 2017-12-08 | 广东威创视讯科技股份有限公司 | Video transmission method and system |
| CN103747054B (en) * | 2013-12-26 | 2017-04-12 | 福建伊时代信息科技股份有限公司 | Network data distribution device and system having the same |
| CN107948191A (en) * | 2017-12-14 | 2018-04-20 | 宁波升维信息技术有限公司 | A kind of cloud storage system and its data access method |
| CN109358977A (en) * | 2018-08-21 | 2019-02-19 | 中国科学院信息工程研究所 | A method and system applied to cloud storage redundancy verification |
| CN109358977B (en) * | 2018-08-21 | 2020-12-22 | 中国科学院信息工程研究所 | A method and system applied to cloud storage redundancy verification |
| CN115421653A (en) * | 2022-08-25 | 2022-12-02 | 北京奥星贝斯科技有限公司 | Method and device for managing blocks in storage system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112000703B (en) | Data warehousing processing method and device, computer equipment and storage medium | |
| CN102411637B (en) | Metadata management method of distributed file system | |
| CN104967619B (en) | File push methods, devices and systems | |
| US20090119233A1 (en) | Power Optimization Through Datacenter Client and Workflow Resource Migration | |
| US20190102103A1 (en) | Techniques for storing and retrieving data from a computing device | |
| CN102801784A (en) | Distributed type data storing method and equipment | |
| CN103152423A (en) | Cloud storage system and data access method thereof | |
| CN103312815A (en) | Cloud storage system and data access method thereof | |
| US20140025723A1 (en) | Cloud storage system and data storage and sharing method based on the system | |
| CN104407879A (en) | A power grid timing sequence large data parallel loading method | |
| CN103227826A (en) | Method and device for transferring file | |
| CN105516284B (en) | A kind of method and apparatus of Cluster Database distributed storage | |
| CN102857578A (en) | File uploading method and file uploading system of network drive and network drive client | |
| US9071584B2 (en) | Multi-tier bandwidth-centric deduplication | |
| CN103607424A (en) | Server connection method and server system | |
| CN104182487A (en) | Unified storage method supporting various storage modes | |
| CN108804242A (en) | A kind of data counts De-weight method, system, server and storage medium | |
| WO2016095149A1 (en) | Data compression and storage method and device, and distributed file system | |
| CN108881379B (en) | Method and device for data synchronization between server clusters | |
| CN110231915A (en) | Data managing method, system, device, computer equipment and storage medium | |
| JP2013182509A (en) | Virtualization system, load distribution device, load distribution method and load distribution program | |
| CN204316546U (en) | A kind of middle-size and small-size cloud stores data synchronous system | |
| CN103220363A (en) | Distributed network training resource management system based on cloud computing and scheduling method | |
| CN103442034A (en) | Streaming media service method and system based on cloud computing technology | |
| Lee et al. | A big data management system for energy consumption prediction models |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20130918 |