CN108174136A - Cloud disk video coding and storage method - Google Patents
Cloud disk video coding and storage method Download PDFInfo
- Publication number
- CN108174136A CN108174136A CN201810211010.8A CN201810211010A CN108174136A CN 108174136 A CN108174136 A CN 108174136A CN 201810211010 A CN201810211010 A CN 201810211010A CN 108174136 A CN108174136 A CN 108174136A
- Authority
- CN
- China
- Prior art keywords
- video
- stored
- storage
- data
- cloud disk
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/78—Television signal recording using magnetic recording
- H04N5/781—Television signal recording using magnetic recording on disks or drums
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention provides a kind of cloud disk video coding and storage method, this method includes：Receive video storage request；Judge the volume of video stream data；The distributed storage position of video file is determined according to the volume of video stream data.The present invention proposes a kind of cloud disk video coding and storage method, can meet the storage demand that frequency file is neglected to magnanimity, moreover it is possible to ensure the treatment effeciency to super large video file, improve the performance of intelligent transportation data storage.
Description
Technical field
The present invention relates to video storage, more particularly to a kind of cloud disk video coding and storage method.
Background technology
Intelligent traffic monitoring network can generate the video file of a large amount of different-formats, different volumes all the time.These numbers
According to generally requiring to store for a long time.Therefore, how effectively to manage these files just becomes a major issue.The prior art utilizes
The relevant monitoring system cloud disk database of big data of rising in recent years carries out video file management.Monitoring system cloud disk data
The multiple data storage cells physically disperseed are connected the unified number in logic of composition one by library by computer network
It is stored in the data store in the form of video block according to library, and by file.Monitoring system cloud disk database, will in storage
Miniature video File is combined into the video block storage of bigger.But due in the storing process to Large video file,
It also needs to carry out video block frequently to divide and merge, intelligent traffic monitoring system can not be met simultaneously to different volumes video
The real-time demand of file storage.
Invention content
To solve the problems of above-mentioned prior art, the present invention proposes a kind of cloud disk video coding and storage method,
Including：
Receive video storage request；
Judge the volume of video stream data；
The distributed storage position of video file is determined according to the volume of video stream data.
Preferably, the video storage request carries monitoring video flow to be stored.
Preferably,
If the volume of the video stream data is less than first threshold, video file is committed to monitoring system cloud disk number
According to library storage.
Preferably,
If the volume of video stream data is more than second threshold, video file is stored in file server cluster.
Preferably, after video storage request is received, further comprise：
Request is stored to video and carries out Authority Verification, determines whether to deposit data according to the source of video storage request
It is stored in corresponding storage region；
When permission is verified, then continue data Stored Procedure.
Preferably, when Authority Verification is obstructed out-of-date, terminate data Stored Procedure.
Preferably, it is described that video file is committed to monitoring system cloud disk database purchase, further comprise：
When the volume of the monitoring video flow to be stored is less than first threshold, the monitoring video flow to be stored is stored
The region of memory block data directory is used for into monitoring system cloud disk database.
The present invention compared with prior art, has the following advantages：
The present invention proposes a kind of cloud disk video coding and storage method, can meet the storage need that frequency file is neglected to magnanimity
It asks, moreover it is possible to ensure the treatment effeciency to super large video file, improve the performance of intelligent transportation data storage.
Description of the drawings
Fig. 1 is the flow chart of cloud disk video coding and storage method according to embodiments of the present invention.
Specific embodiment
Retouching in detail to one or more embodiment of the invention is hereafter provided together with the attached drawing for illustrating the principle of the invention
It states.The present invention is described with reference to such embodiment, but the present invention is not limited to any embodiments.The scope of the present invention is only by right
Claim limits, and the present invention covers many replacements, modification and equivalent.Illustrate in the following description many details with
Just it provides a thorough understanding of the present invention.These details are provided for exemplary purposes, and without in these details
Some or all details can also realize the present invention according to claims.
An aspect of of the present present invention provides a kind of cloud disk video coding and storage method.Fig. 1 is according to embodiments of the present invention
Cloud disk video coding and storage method flow diagram.
Video stream data file is divided into three ranks by the present invention according to volume.When the volume of video stream data is less than first
During threshold value, submitted it as frequency file is neglected to monitoring system cloud disk database purchase；When the volume of video stream data is more than
During second threshold, then file server cluster is stored in as super large video file；When the volume of video stream data is in first
It when between second threshold, is then split according to predefined strategy, monitoring system cloud disk number is stored in a manner of video block
According in library.The following specifically describes the step of method：
Video storage request is received, the video storage request carries monitoring video flow to be stored；To ensure that data are deposited
The safety of storage carries out Authority Verification after video storage request is received, and is judged whether according to the source of video storage request
Allow to store data in corresponding storage region.When permission is verified, then continue subsequent step；Work as Authority Verification
It is obstructed out-of-date, then terminate data Stored Procedure.
Authority Verification after the entrained monitoring video flow to be stored of video storage request is added to caching, is pressed by rear
Storage according to monitoring video flow to be stored in the sequential processes caching of first in first out is asked.
Obtain the volume of the monitoring video flow to be stored；When the volume of the monitoring video flow to be stored is less than the first threshold
During value, the monitoring video flow to be stored is stored into monitoring system cloud disk database the area for memory block data directory
Domain.
When the volume of the monitoring video flow to be stored is more than second threshold, the monitoring video flow to be stored is stored
To file server cluster, and the first configuration information is stored to the monitoring system cloud disk database, described first and matches confidence
Breath includes the first URL, and the first URL is URL of the monitoring video flow to be stored in the file server cluster；
When super large video file need to be read, it is obtained from the block data directory of monitoring system cloud disk database first
URL further according to the URL, directly reads the video file from the file directory of file server cluster.In this way, subsequently grasping
In work, without being split combination to super large video file.
When the volume of the monitoring video flow to be stored is more than the first threshold and the monitoring video flow to be stored
When volume is less than the second threshold, according to predefined strategy, the monitoring video flow to be stored is divided into multiple video blocks
Afterwards, each video block is stored to monitoring system cloud disk database respectively, and according to each video block described to be stored
Putting in order in monitoring video flow stores the second configuration information of each video block to the monitoring system cloud disk number
According to library, second configuration information includes the 2nd URL, and the 2nd URL is the video block in the monitoring system cloud disk data
URL in library.
When big video file need to be read, it is every that it is obtained from the block data directory of monitoring system cloud disk database first
The URL of a video block obtains each video block from the video block table of monitoring system cloud disk database in order further according to URL,
It is combined into big video file.The configuration information of big video file includes its file name, video format, file description, video block
Sequence and file URL.
Since the issued transaction of storage operation cannot simply reliance server in itself, so the mechanism of caching need to be designed, be used
In the video file catalogue and data information of storage different scenes.I.e. this method further includes：
Interim URL and first-class address caching are generated, and the interim URL paths are delayed added to the first-class address
It deposits；When the volume of the monitoring video flow to be stored is greater than or equal to the first threshold, by the monitor video to be stored
The stream write-in interim URL storages；When the interim URL is written not successfully in the monitoring video flow to be stored, arbitration is performed
Mechanism is discussed in detail below.After execution during continuous specific storing step, the prison is directly obtained from first-class address caching
The URL of video flowing is controlled, and reads the monitoring video flow from interim URL on this basis.
When the monitoring video flow to be stored is stored not successfully to the monitoring system cloud disk database, second is generated
Address caching；Judge whether the monitoring video flow to be stored is successfully stored in the file server cluster；If it is, it obtains
The first URL is taken, and the first URL is added to second address caching；If it is not, then perform arbitration mechanism；
When monitoring video flow to be stored is stored not successfully in file server cluster, then follow-up storage step is no longer performed
Suddenly, after the monitoring video flow to be stored in performing arbitration mechanism and removing caching, terminate Stored Procedure.At this point, server set
Group is restored to the state before the storing step for performing the monitoring video flow to be stored.
Judge whether first configuration information is successfully stored to the monitoring system cloud disk database；If it is, it deletes
Except the monitoring video flow to be stored stored in the interim URL；If it is not, then perform arbitration mechanism；When the first configuration information
When success stores, which is successfully stored in server cluster.At this point, it can delete corresponding interim
URL。
When the first configuration information is stored not successfully in monitoring system cloud disk database, perform arbitration mechanism and remove caching
In monitoring video flow to be stored after, terminate Stored Procedure.
This method further includes, and generates third stream address caching；It is described to judge whether each video block is successfully stored in
Monitoring system cloud disk database；If it is, the 2nd URL of each video block is obtained, and according to each video block
2nd URL of each video block is added to third stream address by putting in order in the monitoring video flow to be stored
Caching；If it is not, then perform arbitration mechanism；
It, can be directly from third stream address caching after each video block is successfully stored in monitoring system cloud disk database
The 2nd URL of each video block is obtained, then is stored in sequence in the block data directory of monitoring system cloud disk database.When certain
One video block or certain several video block are stored not successfully in monitoring system cloud disk database, then no longer perform follow-up storage step
Suddenly, after the monitoring video flow to be stored in performing arbitration mechanism and removing caching, terminate Stored Procedure.
Judge whether the second configuration information of each video block is successfully stored to the monitoring system cloud disk database；If
It is then to delete corresponding interim URL；If it is not, then perform arbitration mechanism.
When the second configuration information also successfully stores, which is successfully stored in server cluster
In.At this point, the monitoring video flow to be stored in interim URL can be deleted.In addition, when the second configuration information is stored in not successfully
During monitoring system cloud disk database, then after performing arbitration mechanism and removing the monitoring video flow to be stored in caching, terminate storage
Flow.
For above-mentioned arbitration mechanism, its specific steps is described more detail below：
1：Check whether current video file is to neglect frequency file less than first threshold；If it is, perform step 2；
If it is not, then perform step 3；
2：The rollback of the monitoring system cloud disk database is performed, terminates arbitration mechanism；It is stored when neglecting frequency file
During failure, storing step is cancelled, deletes the partial data neglected and stored in frequency file in the database.
3：It checks in first-class address caching with the presence or absence of the interim URL for needing to clear up；If it is, according to described first
The interim URL in address caching is flowed, deletes the interim URL；
When interim URL failures are written in big video file, the interim URL for storing big video file is deleted, to prevent
Interim URL occupies system memory space.
Wherein, when affairs towards object be not to neglect frequency file when, the arbitration mechanism further includes：
4：It checks in second address caching with the presence or absence of the first URL for needing to clear up；If it is, according to described second
The first URL in address caching is flowed, deletes the monitoring video flow to be stored stored in the file server cluster；
5：It checks in third stream address caching with the presence or absence of the 2nd URL for needing to clear up；If it is, according to the third
The 2nd URL in address caching is flowed, deletes the video block stored in the monitoring system cloud disk database.
It is right in the URL deletion respective memory regions in first to third stream address caching respectively by above-mentioned steps
After the data answered, you can the state that server is made to be restored to before execution method so that ensure video stream data storage operation
Integrality.
It, respectively will be every after the monitoring video flow to be stored is divided at least one video block according to predefined strategy
A video block is stored to monitoring system cloud disk database, and the present invention further comprises：
The video file of acquisition is addressed to obtain the corresponding storage cell of video block.The acquisition video block corresponds to
Storage cell, including：
The hashed value of video block ID is calculated by hash function, to obtain the corresponding pseudorandom values of video block ID；It will obtain
The corresponding pseudorandom values of video block ID and mask step-by-step phase and operation, identified with obtaining the corresponding storage cell of video block.
The corresponding storage cell of video block that addressing obtains finally ensures the sum of the object stored in each storage cell
According to amount approaches uniformity, real-time storage efficiency and system performance are improved.
The corresponding storage cell of the video block of acquisition is addressed to obtain the corresponding monitoring cloud disk node of storage cell.
Multiple monitoring cloud disk nodes are collectively responsible for block all in the corresponding storage cell of storage and maintenance.
In the present embodiment, three corresponding monitoring cloud disk nodes are configured in each storage cell, realize user's storage file
Triple backups, while the monitoring cloud disk node configuration solid state disk realizes the fast reading and writing operation of data.
After the corresponding monitoring cloud disk node of storage cell is got, by the storage list of the video file write-in acquisition of acquisition
The corresponding monitoring cloud disk node in position.The video file write-in monitoring cloud disk node, including：
Step 1：The corresponding first monitoring cloud disk node of storage cell that the video file write-in of acquisition is obtained.
Step 2：By the video file object of the first monitoring cloud disk node write-in be respectively written into the second monitoring cloud disk node and
Third monitors cloud disk node.
Step 3：Video file, which is sent, to video acquisition terminal successfully stores information.
After three monitoring cloud disk nodes all complete write operation, control and successfully deposited to video acquisition terminal transmission storage file
Information is stored up, finally realizes three of video acquisition terminal storage file in three monitoring cloud disk nodes of cloud storage system server
Weight secure storage.
Wherein after video storage request is received, it will be regarded according to the monitor video stream information carried in video storage request
The storage of frequency flow data is further included to monitoring cloud disk node：Regard most recently used data as dsc data, it will nearest not used number
According to cold data is regarded as, dsc data is stored in high-speed hardware equipment, and cold data is stored in inactive memory node.Often
A new write-in data are regarded as dsc data, can be directly stored in monitoring cloud disk node, can directly to monitor next time
Target data is found in cloud disk node to prepare.It can be unified by that will be based on from the video storage request of different storage applications
Transformation standard, be converted into standard request so that the video storage request for coming from different storage applications can be applied
The system identification that the method for the present invention is cached, and then improve the versatility of this caching method.
Preferably embodiment, the invention also includes：Update cache management information.Calculate monitoring cloud disk node
Deposit data amount and the ratio of the capacity of monitoring cloud disk node.Judge whether ratio is greater than or equal to threshold value, if it is, utilizing
Lru algorithm removes the cold data monitored in cloud disk node according to cache management information, successively until ratio is less than threshold value.For
Data are not lost, can backed up to this compared with cold data before it will be deleted from monitoring cloud disk node successively compared with cold data
Inactive memory node.As preferred embodiment, according to cache management information by the cold data monitored in cloud disk node according to
Secondary removal specifically includes：Cold data is stored successively to inactive memory node, and delete and stored to inactive memory node
And be stored in monitoring cloud disk node in cold data.
When the storing process of monitoring system cloud disk database encounters mistake and terminates, the present invention is further by with lower section
Method confirms abort situation and then correctly retries write operation and perform data recovery.If monitoring system cloud disk database includes at least m
A memory node and q error correction node.Storing process then based on BMSR codings is as follows：
Step 1, memory node determines that the first storage is asked, and monitor video to be stored is carried in the first storage request
Stream and the first update mark, wherein first update mark be used for show video acquisition terminal storage by the prison to be stored
The update mark of video block that control video flowing is updated, the data volume of the monitoring video flow to be stored are less than a BMSR and compile
The data volume of code character；
Step 2, memory node response the first storage request, obtains the second update mark, second update mark
For showing the update mark of the video video block of itself storage.
Step 3, according to corresponding as a result, to the prison to be stored between first update mark and the second update mark
Control video flowing is handled, and further comprise：
Step 31, memory node judges whether the first update mark is identical with the second update mark, if identical, first
Update mark is corresponding with the second update mark, if it is not the same, then the first update mark and the second update mark be not corresponding.Second
Update mark is newest update mark, if the second update mark illustrates earlier than the first update mark in certain primary storage
Node do not update completion and video acquisition terminal to be completed for update, thus video acquisition terminal has updated the update of itself
Label, either the second update mark is later or earlier than the first update mark, as long as the two does not correspond to, memory node all can be to depositing
Storage system or video acquisition terminal send out error information.
Step 32, memory node is handled the monitoring video flow to be stored according to first judgment value.At this
In the further embodiment of invention, step 32 further includes：
Step 321, if first judgment value shows that first update mark and second update mark be not right
Should, the first update response is sent, update failure result is carried in the first update response；
Step 322, the monitoring video flow to be stored is abandoned.
Step 323, if first judgment value shows that first update mark is corresponding with second update mark,
Update video piece of collection { the Δ P of error correction increment is determined according to monitoring video flow to be stored and the video block1, Δ P2..., Δ
Pg..., Δ Pq, wherein, Δ PgFor the error correction increment of g-th of error correction node, 1≤g≤q, q are opposite with a BMSR coding
The quantity of verification video block answered；
Step 324, by the error correction increment Delta P of g-th of error correction nodegIt is carried in the second storage request, by described second
Storage request is sent to g-th of error correction node, and second storage asks to trigger g-th of error correction node according to
Error correction increment Delta PgThe verification data of itself storage is updated, and updates the version of g-th of error correction node itself storage
This vector.
It is described that the monitoring video flow to be stored is handled according to the first judgment value, it further includes：If described first
Judgment value shows that first update mark is corresponding with second update mark, using the monitoring video flow to be stored to institute
Video block is stated to be updated；After the completion of being updated to the video block, second update mark is updated.
After the completion of being updated to the video block, the first update response is sent, update is carried in the first update response
Successful result, it is described to be updated successfully result for triggering video acquisition terminal update first update mark.Furthermore, it is possible to it sets
Timer is put, before the deadline if be not updated successfully, video acquisition terminal can re-initiate storage request.
Memory node safeguards a update mark to each initial video block, and when there is write operation, memory node first can
Judge whether the update mark of data received and the update mark of itself storage correspond to, to it is corresponding when memory node just can be right
Data in storage request are updated, so as to avoid terminating when storing process encounters mistake.
In BMSR codings, it is assumed that the volume of video file is M, which is divided into multiple video blocks,
A volume is combined into per k video block, the encoding operation of BMSR codings is mutual indepedent in each volume.In order to maximize data
Reliability, n block after coding are stored in n different monitoring cloud disk nodes (including k video block and n-k encoding block)
In.
In monitoring system cloud disk database operational process, when r node failure, need to find other r replacement section
Put the data to restore failure.The restoration model that the present invention is represented using (n, k, r).Source node completes data segmentation, coding
With distributed tasks.X1, X2..., Xn-rThe memory node of expression activity, Y1, Y2..., YrRepresent r substitute node.Destination node
Arbitrary k node is read to complete the reconstruct of primary data.
Specifically, operational process includes 3 steps, initialization, data recovery and download.During initialization, at the beginning of volume is M
Beginning video file is divided into multiple video blocks, and a volume is formed per k video block.Assuming that video file M is divided into k video
Block.K video block generates n-k encoding block by coding.Assuming that k video block is expressed as (d1, d2..., dk), each block
Volume is M/k, and k video block generates n-k encoding block (p by coding1, p2..., pn-k)。
Wherein, each encoding block pi(1≤i≤n-k) is all by k video block coding generation, αI, jIt is piFrom j-th
Video block djCode coefficient.Finally, after the completion of coding, n block (k video block and n-k encoding block) is respectively stored into n
Memory node (X1, X2..., Xn), the data volume of each node storage is M/k.That is encoding block piRestored data PiFor
Wherein 1≤i≤n-r
As r memory node Xn-r+1, Xn-r..., XnAfter failure, in order to ensure the original redundancy of data, r is reselected
A substitute node completes the recovery Y of data1, Y2..., Yr.In recuperation, in r substitute node, a main section can be selected
Point Ymain.The node connects owner node and remaining substitute node simultaneously.Specifically, including：
First, k owner node is selected from the memory node of activity, and r are selected from other enabled nodes
Substitute node；A host node Y is elected from r substitute node simultaneouslymain.Secondly, host node YmainFrom k supplier
It reads k video block and passes through the block that the k video block restores r failure.Finally, YmainCorresponding recovery video block is stored
It is separately sent in corresponding r-1 substitute node in local, while by remaining r-1 recovery video block.Remaining substitute node
The data received are stored in local, complete recuperation.
It restores after completing, initial n-r active node X1, X2..., Xn-rWith r substitute node Y1, Y2..., YrComposition
New n memory node combination provides video storage service, and the access request of data can be by wherein arbitrary k node come weight
Build primary data.
For substitute node after selected, it is host node to select with the substitute node of other substitute node topology distance minimums.It is false
If active node XiWith supplier YjBetween topology distance be expressed as distanceI, j, then k is selected from n-r active node
Total shortest node of topology distance is as supplier in a to r substitute node.Active node XiWith supplier YjBetween total open up
Flutterring distance is：
In the selection process, n-r total topology distances are arranged by the way of ascending order, k have minimum before finally taking
The node of total topology distance is as supplier X1, X2..., Xk。
The selection of host node needs simultaneously to consider and topology distance between the two.Assuming that substitute node YiTo YjTopology
Distance is distance 'I, j, then substitute node YiTopology distance summation to other r-1 substitute node is
The node with the minimum total topology distance of other substitute nodes and supplier is selected as host node Ymain。
distancemain=min1≤i≤rdistance’i)
After selected substitute node and supplier, between supplier and host node, real between host node and other suppliers
Existing data transmission.Between supplier and host node, k all supplier X1, X2..., XkWith host node YmainConnection, and
Data are transmitted to it.Each supplier transmits the video block that a volume is M/k to host node.Host node is receiving supplier
Data after pass through coding with decoding operate complete r trouble block recovery operation.
Between host node and other suppliers, host node, first will be corresponding after the construction work for completing r trouble block
Block be stored in local, while remaining r-1 block is separately sent in corresponding substitute node.
Other substitute nodes are stored in local after the data for receiving substitute node.Data are completed in all substitute nodes to connect
After receiving and storing operation, recuperation terminates.
Host node YmainIn specific calculating process, the data according to failure are the specific feelings of video block or encoding block
Condition, correspondence do different calculating operations.Assuming that r invalid video video block number in the block and encoding block number are respectively r1With
r2, r=r1+r2。r1The video block of a failure is expressed as d1, d2..., dr1, r2The encoding block of a failure is expressed as p1, p2..., pr2,
The data that substitute node is read from k supplier are b=(b1, b2..., bk), then video block diWith encoding block pjCalculating such as
Under：
1) the k video block vector b=(b read1, b2..., bk) directly it can restore this in vain by decoding operate
Video block.Assuming that encoder matrix is P, then cataloged procedure can be expressed as P*D=C, wherein, D is video block；C for video block with
The corresponding matrix of encoding block.If the k video block extracted out from C is b=(b1, b2..., bk), corresponding matrix is matrix
P ' then can obtain matrix D=P ' by matrix operation-1*b.And all video blocks, therefore, d are included in matrix DiRecovery
Operation can be expressed as：
di=(λ1, λ2..., λk)T*(b1, b2..., bk)
Wherein, λiIt is P '-1Middle diCorresponding vector.
2) recovery operation of encoding block is the encoding operation that a corresponding position is remake on the basis of decoded.It is specific and
Speech, if the k video block extracted out from C is vector b=(b1, b2..., bk), corresponding matrix be matrix P ', decoding operate
It can be expressed as D=P '-1*b.And pjCalculating process can be expressed as pj=βj* D, wherein vector βjIt is pjCorresponding vector,
Then pjCalculating process can be expressed as：
pj=(β1, β2... βk)*P’-1*(b1, b2..., bk)
Complete all r block (r1A video block and r2A encoding block) recovery after, video that host node restores these
Block is sent in corresponding substitute node.It reads a data and r video block is built by different parameters simultaneously, meanwhile, it replaces
For the calculating in node using multithreading, the degree of parallelism of calculating process is increased.
In conclusion the present invention proposes a kind of cloud disk video coding and storage method, can meet to magnanimity small video text
The storage demand of part, moreover it is possible to ensure the treatment effeciency to super large video file, improve the performance of intelligent transportation data storage.
It obviously, can be with general it should be appreciated by those skilled in the art each module or each step of, the above-mentioned present invention
Computing system realize that they can concentrate in single computing system or be distributed in multiple computing systems and be formed
Network on, optionally, they can be realized with the program code that computing system can perform, it is thus possible to which they are stored
It is performed within the storage system by computing system.It to be combined in this way, the present invention is not limited to any specific hardware and softwares.
It should be understood that the above-mentioned specific embodiment of the present invention is used only for exemplary illustration or explains the present invention's
Principle, without being construed as limiting the invention.Therefore, that is done without departing from the spirit and scope of the present invention is any
Modification, equivalent replacement, improvement etc., should all be included in the protection scope of the present invention.In addition, appended claims purport of the present invention
Covering the whole variations fallen into scope and boundary or this range and the equivalent form on boundary and repairing
Change example.
Claims (7)
- A kind of 1. cloud disk video coding and storage method, which is characterized in that including：Receive video storage request；Judge the volume of video stream data；The distributed storage position of video file is determined according to the volume of video stream data.
- 2. according to the method described in claim 1, it is characterized in that, video storage request carries monitor video to be stored Stream.
- 3. it according to the method described in claim 1, it is characterized in that, further includes：If the volume of the video stream data is less than first threshold, video file is committed to monitoring system cloud disk database Storage.
- 4. it according to the method described in claim 1, it is characterized in that, further includes：If the volume of video stream data is more than second threshold, video file is stored in file server cluster.
- 5. according to the method described in claim 1, it is characterized in that, after video storage request is received, further comprise：Request is stored to video and carries out Authority Verification, determines whether to store data according to the source of video storage request Corresponding storage region；When permission is verified, then continue data Stored Procedure.
- 6. according to the method described in claim 5, it is characterized in that, when Authority Verification is obstructed out-of-date, terminate data Stored Procedure.
- 7. according to the method described in claim 3, it is characterized in that, described be committed to monitoring system cloud disk data by video file Library storage further comprises：When the volume of the monitoring video flow to be stored is less than first threshold, the monitoring video flow to be stored is stored to prison The region of memory block data directory is used in control system cloud disk database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810211010.8A CN108174136B (en) | 2018-03-14 | 2018-03-14 | Cloud disk video coding storage method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810211010.8A CN108174136B (en) | 2018-03-14 | 2018-03-14 | Cloud disk video coding storage method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108174136A true CN108174136A (en) | 2018-06-15 |
| CN108174136B CN108174136B (en) | 2021-03-02 |
Family
ID=62512034
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810211010.8A Active CN108174136B (en) | 2018-03-14 | 2018-03-14 | Cloud disk video coding storage method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108174136B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114422600A (en) * | 2021-12-31 | 2022-04-29 | 成都鲁易科技有限公司 | File scheduling system based on cloud storage and file scheduling method based on cloud storage |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104331428A (en) * | 2014-10-20 | 2015-02-04 | 暨南大学 | Storage and access method of small files and large files |
| CN104536959A (en) * | 2014-10-16 | 2015-04-22 | 南京邮电大学 | Optimized method for accessing lots of small files for Hadoop |
| CN104778229A (en) * | 2015-03-31 | 2015-07-15 | 南京邮电大学 | Telecommunication service small file storage system and method based on Hadoop |
| CN105183839A (en) * | 2015-09-02 | 2015-12-23 | 华中科技大学 | Hadoop-based storage optimizing method for small file hierachical indexing |
| CN105302496A (en) * | 2015-11-23 | 2016-02-03 | 浪潮(北京)电子信息产业有限公司 | Frame for optimizing read-write performance of colony storage system and method |
| CN106228074A (en) * | 2016-07-14 | 2016-12-14 | 广州华多网络科技有限公司 | storage object aging method and device |
| CN106484821A (en) * | 2016-09-27 | 2017-03-08 | 浪潮软件集团有限公司 | A hybrid cloud storage method under cloud computing architecture |
| CN106611135A (en) * | 2016-06-21 | 2017-05-03 | 四川用联信息技术有限公司 | Storage data integrity verification and recovery method |
| CN106775446A (en) * | 2016-11-11 | 2017-05-31 | 中国人民解放军国防科学技术大学 | Based on the distributed file system small documents access method that solid state hard disc accelerates |
| CN106899675A (en) * | 2017-02-28 | 2017-06-27 | 福建新和兴信息技术有限公司 | A file storage method and system based on application type |
| US20170302734A1 (en) * | 2016-04-18 | 2017-10-19 | Rancher Labs, Inc. | Cloud Computing Service Architecture |
| CN107665092A (en) * | 2016-07-28 | 2018-02-06 | 华为技术有限公司 | A kind of storage method and device |
-
2018
- 2018-03-14 CN CN201810211010.8A patent/CN108174136B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104536959A (en) * | 2014-10-16 | 2015-04-22 | 南京邮电大学 | Optimized method for accessing lots of small files for Hadoop |
| CN104331428A (en) * | 2014-10-20 | 2015-02-04 | 暨南大学 | Storage and access method of small files and large files |
| CN104778229A (en) * | 2015-03-31 | 2015-07-15 | 南京邮电大学 | Telecommunication service small file storage system and method based on Hadoop |
| CN105183839A (en) * | 2015-09-02 | 2015-12-23 | 华中科技大学 | Hadoop-based storage optimizing method for small file hierachical indexing |
| CN105302496A (en) * | 2015-11-23 | 2016-02-03 | 浪潮(北京)电子信息产业有限公司 | Frame for optimizing read-write performance of colony storage system and method |
| US20170302734A1 (en) * | 2016-04-18 | 2017-10-19 | Rancher Labs, Inc. | Cloud Computing Service Architecture |
| CN106611135A (en) * | 2016-06-21 | 2017-05-03 | 四川用联信息技术有限公司 | Storage data integrity verification and recovery method |
| CN106228074A (en) * | 2016-07-14 | 2016-12-14 | 广州华多网络科技有限公司 | storage object aging method and device |
| CN107665092A (en) * | 2016-07-28 | 2018-02-06 | 华为技术有限公司 | A kind of storage method and device |
| CN106484821A (en) * | 2016-09-27 | 2017-03-08 | 浪潮软件集团有限公司 | A hybrid cloud storage method under cloud computing architecture |
| CN106775446A (en) * | 2016-11-11 | 2017-05-31 | 中国人民解放军国防科学技术大学 | Based on the distributed file system small documents access method that solid state hard disc accelerates |
| CN106899675A (en) * | 2017-02-28 | 2017-06-27 | 福建新和兴信息技术有限公司 | A file storage method and system based on application type |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114422600A (en) * | 2021-12-31 | 2022-04-29 | 成都鲁易科技有限公司 | File scheduling system based on cloud storage and file scheduling method based on cloud storage |
| CN114422600B (en) * | 2021-12-31 | 2023-11-07 | 成都鲁易科技有限公司 | File scheduling system based on cloud storage and file scheduling method based on cloud storage |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108174136B (en) | 2021-03-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110169040B (en) | Distributed data storage method and system based on multilayer consistent hash | |
| EP3867759B1 (en) | Improving available storage space in a system with varying data redundancy schemes | |
| US20200117362A1 (en) | Erasure coding content driven distribution of data blocks | |
| CN102142006B (en) | File processing method and device of distributed file system | |
| US9874915B2 (en) | Extended file attributes for redundant data storage | |
| US10303570B2 (en) | Method and apparatus for managing data recovery of distributed storage system | |
| US8805902B2 (en) | Managing snapshot storage pools | |
| US20010042222A1 (en) | System and method for reconstructing data associated with protected storage volume stored in multiple modules of back-up mass data storage facility | |
| US10671501B2 (en) | Systems and methods for sequential resilvering | |
| CN107250986A (en) | Date classification, distribution and reconstruct | |
| CN113157715A (en) | Erasure code data center rack collaborative updating method | |
| US20080133967A1 (en) | Distributed object sharing system and method thereof | |
| CN112486942B (en) | Multi-copy storage method and multi-copy storage system for file data | |
| US8832395B1 (en) | Storage system, and method of storage control for storage system | |
| CN117971390A (en) | Virtual machine recovery method and server | |
| CN108174136A (en) | Cloud disk video coding and storage method | |
| CN111857939A (en) | Method, system, electronic device and storage medium for image deletion and push | |
| CN108366217A (en) | Monitor video acquisition and storage method | |
| CN120692287A (en) | A data self-healing method based on storage tiering | |
| US11645333B1 (en) | Garbage collection integrated with physical file verification | |
| CN117827097A (en) | A smart EC processing method and device | |
| US11494090B2 (en) | Systems and methods of maintaining fault tolerance for new writes in degraded erasure coded distributed storage | |
| CN111291126B (en) | Data recovery method, device, equipment and storage medium | |
| CN108491488B (en) | High-speed medium storing method | |
| CN117851132B (en) | Data recovery optimization method for distributed object storage |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |