CN104883381B - The data access method and system of distributed storage - Google Patents
The data access method and system of distributed storage Download PDFInfo
- Publication number
- CN104883381B CN104883381B CN201410229794.9A CN201410229794A CN104883381B CN 104883381 B CN104883381 B CN 104883381B CN 201410229794 A CN201410229794 A CN 201410229794A CN 104883381 B CN104883381 B CN 104883381B
- Authority
- CN
- China
- Prior art keywords
- data
- back end
- master control
- control server
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 238000012545 processing Methods 0.000 claims abstract description 9
- 230000011218 segmentation Effects 0.000 claims description 30
- 238000013500 data storage Methods 0.000 claims description 23
- 230000002159 abnormal effect Effects 0.000 claims description 8
- 238000012546 transfer Methods 0.000 claims description 7
- 230000010354 integration Effects 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 5
- 241001269238 Data Species 0.000 description 3
- 239000000203 mixture Substances 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 239000006185 dispersion Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000003455 independent Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000000306 recurrent effect Effects 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of data access method of distributed storage and systems.Wherein this method comprises the following steps：Master control server receives document access information, and sends document access information to index server；Index server finds the corresponding back end of document access information, and the information of returned data node is to master control server；Master control server connects back end and carries out data access.Its index server looks only for back end information, is subsequently directly connected to back end by master control server, alleviates the pressure of index server, the bottleneck of back end quantity caused by also having broken away from index server；And during more master control servers are carried out at the same time reading and writing data, it can be by more index server decentralized processings, the storage performance of the mode of distributed storage is promoted, simplifies the required equipment of running link with integration distributed storage, promotes the clock availability of distributed storage.
Description
Technical field
The present invention relates to the data access method of technical field of data storage more particularly to a kind of distributed storage and it is
System.
Background technology
Common distributed data access technical approach is received data write-in (storage) and is read by master control server
Demand, via index server position correspond to find the relevant back end of the data and Data Position, via dependency number
Data are written or read according to node, complete the access of data.Such function mode, major defect are actually data sections
In the case that point is more and more, such as back end increases meeting relative increase master control server in the environment of big data application
Bottleneck will be encountered with the performance of the pressure of index server, such overall operation.
Invention content
Based on this, it is necessary to provide one kind and can effectively solve the problem that index server and main control caused by back end is excessive
The data access method and system of the distributed storage of the big problem of server stress.
A kind of data access method for distributed storage that purpose provides to realize the present invention, includes the following steps：
Master control server receives document access information, and sends the document access information to index server；
The index server finds the corresponding back end of the document access information, and returns to the back end
Information to the master control server；
The master control server connects the back end and carries out data access.
As a kind of embodiment of the data access method of distributed storage, when the master control server receives number
When according to storage information, this method further includes that the master control server judges that the data to be stored are by the index server
It is no be new data the step of；
If so, it includes following step that the master control server, which connects the step of back end carries out data access,
Suddenly：
The data index value for the data to be stored described in the back end generation；
The back end stores the data index value into the index server；
The data to be stored described in back end storage are to local disk；
If it is not, it includes following step that then the master control server, which connects the step of back end carries out data access,
Suddenly：
The data index value of the back end data to be stored according to is found by the index server
The data to be stored are in the position of local disk；
The former data for the data cover local disk corresponding position to be stored described in the back end use.
As a kind of embodiment of the data access method of distributed storage, the method further includes the main control
The step of whether server needs segmentation by the data to be stored described in index server judgement；
If so, the multiple back end of master control server connection carry out data storage；
If it is not, then the single back end of master control server connection carries out data storage.
As a kind of embodiment of the data access method of distributed storage, when the data need segmentation, institute
It includes single index value and data combined value to state data index value.
As a kind of embodiment of the data access method of distributed storage, when the master control server receives number
When according to reading information, this method further includes that the master control server judges that the data to be read are by the index server
The step of no data for segmentation；
If so, the multiple back end of master control server connection carry out digital independent；
If it is not, then the single back end of master control server connection carries out digital independent.
As a kind of embodiment of the data access method of distributed storage, this method is further comprising the steps of：
The result data of the data transfer of data of the master control server real-time reception into line access, and according to described
Result data judges whether digital accessing apparatus is abnormal；
When the digital accessing apparatus exception, the master control server control starts corresponding agent equipment into line number
According to access；
The digital accessing apparatus is the index server and/or the back end and/or local disk.
A kind of data access arrangement of distributed storage based on same inventive concept, including master control server, index
Server and back end, wherein：
The master control server receives document access information, and sends the document access information to the index service
Device；
The index server finds the corresponding back end of the document access information, and returns to the data
The information of node is to the master control server；
The master control server connects the back end and carries out data access.
As a kind of embodiment of the data access arrangement of distributed storage, which further includes local disk, institute
It includes new data judgment module to state master control server, and the back end includes index value generation module, index value storage mould
Block, the first memory module, location lookup module and the second memory module；
When the master control server receives data storage information, the new data judgment module is taken by the index
Whether the device judgement data to be stored of being engaged in are new data；
According to the judging result of the new data judgment module, if so,
The data index value for the data to be stored described in the index value generation module generation；
The index value memory module stores the data index value into the index server；
The data to be stored described in first memory module storage are to local disk；
If it is not, then
The data index value of the location lookup module data to be stored according to is looked by the index server
The data to be stored are found in the position of local disk；
The former data for the data cover local disk corresponding position to be stored described in the second memory module use.
As a kind of embodiment of the data access arrangement of distributed storage, the master control server further includes
One data divide judgment module, more back end memory modules and forms data node memory module, wherein：
Whether the first data segmentation judgment module is needed by the data to be stored described in index server judgement
Divide；
If so, more multiple back end of back end memory module connection carry out data storage；
If it is not, then the single back end of forms data node memory module connection carries out data storage；
And when the data need segmentation, the data index value includes single index value and data combined value.
As a kind of embodiment of the data access arrangement of distributed storage, the master control server further includes
Two data divide judgment module, more back end read modules and forms data node read module；
When the master control server receives data read information, the second data segmentation judgment module passes through described
Index server judges the step of whether data to be read are segmentation data；
If so, more multiple back end of back end read module connection carry out digital independent；
If it is not, then the single back end of forms data node read module connection carries out digital independent.
As a kind of embodiment of the data access arrangement of distributed storage, the master control server further includes different
Normal judgment module and exception processing module, wherein：
The result data of the data transfer of data of the exception judgment module real-time reception into line access, and according to described
Result data judges whether digital accessing apparatus is abnormal；
When the digital accessing apparatus exception, the exception processing module control starts corresponding agent equipment into line number
According to access；
The digital accessing apparatus is the index server and/or the back end and/or local disk.
Beneficial effects of the present invention include：
The data access method and system of a kind of distributed storage provided by the invention, index server look only for data section
Point information, is subsequently directly connected to back end by master control server, to alleviate the pressure of index server, also breaks away from
The bottleneck of back end quantity caused by index server.And it is carried out at the same time the process of reading and writing data in more master control servers
In, the running bottleneck of index server can be substantially reduced by more index server decentralized processings.Distributed storage can be promoted
Mode storage performance, simplify with integrate distributed storage the required equipment of running link, promote distributed storage
Clock availability will be solved with majority according to node mode the problem of script Single Point of Faliure.
Description of the drawings
Fig. 1 is a kind of flow chart of a specific embodiment of the data access method of distributed storage of the present invention；
Fig. 2 is a kind of data write-in signal of a specific embodiment of the data access method of distributed storage of the present invention
Figure；
Fig. 3 is a kind of digital independent signal of a specific embodiment of the data access method of distributed storage of the present invention
Figure；
Fig. 4 is a kind of flow chart of the another specific embodiment of the data access method of distributed storage of the present invention；
Fig. 5 is a kind of flow chart of the still another embodiment of the data access method of distributed storage of the present invention；
Fig. 6 is a kind of flow chart of the still another embodiment of the data access method of distributed storage of the present invention；
Fig. 7 is that a kind of data Stored Procedure of a specific embodiment of the data access method of distributed storage of the present invention shows
It is intended to；
Fig. 8 is that a kind of digital independent flow of a specific embodiment of the data access method of distributed storage of the present invention is shown
It is intended to；
Fig. 9 is a kind of composition schematic diagram of a specific embodiment of the data access arrangement of distributed storage of the present invention；
Figure 10 is a kind of composition schematic diagram of the another specific embodiment of the data access arrangement of distributed storage of the present invention；
Figure 11 is a kind of composition schematic diagram of the still another embodiment of the data access arrangement of distributed storage of the present invention；
Figure 12 is a kind of master control server of a specific embodiment of the data access arrangement of distributed storage of the present invention
Constitute schematic diagram；
Figure 13 is a kind of main control service of the another specific embodiment of the data access arrangement of distributed storage of the present invention
Device constitutes schematic diagram.
Specific implementation mode
In order to make the purpose , technical scheme and advantage of the present invention be clearer, below in conjunction with attached drawing to the present invention's
The data access method of distributed storage and the specific implementation mode of system illustrate.It should be appreciated that tool described herein
Body embodiment is only used to explain the present invention, is not intended to limit the present invention.
The data access method of the distributed storage of the embodiment of the present invention, as shown in Figure 1, including the following steps：
S100, master control server receives document access information, and sends the document access information to index server.
S200, the index server finds the corresponding back end of the document access information, and returns to the number
According to the information of node to the master control server.
S300, the master control server connect the back end and carry out data access.
As shown in the write-in of Fig. 2 data and Fig. 3 digital independents, the data access side of the distributed storage of the embodiment of the present invention
In method, after master control server receives the client data write-in sent or the operation requests read, index server is arrived first
Middle search is related to the back end information of data, after finding back end information, master control server directly establish to it is related
The connection of back end, master control server completes reading or the write-in (storage) of related data with back end.With
It is different in the specific location of local disk directly to search related data for index server in traditional technology, in the embodiment of the present invention,
As shown in dotted outline in FIG., index server looks only for back end information, is subsequently directly connected to data by master control server
Node, to alleviate the pressure of index server, the bottleneck of back end quantity caused by also having broken away from index server.And
During more master control servers are carried out at the same time reading and writing data, can significantly it be dropped by more index server decentralized processings
The running bottleneck of low index server.The storage performance of the mode of distributed storage can be promoted, simplifies and is deposited with integration distribution
The required equipment of running link of storage, promotes the clock availability of distributed storage, more by being used the problem of script Single Point of Faliure
Back end mode solves.
Preferably, in the embodiment of the data access method of wherein one distributed storage, when the main control service
When device receives data storage information, as shown in figure 4, this method further includes step S030, master control server passes through index service
Device judges whether the data to be stored are new data, obtain judging result.
After master control server receives data write request, search index (metadata) server finds the data directory
It is worth one or more corresponding back end, and determines whether new data, if data, there are index value, data is existing
The update of data judges data for new data if data do not have corresponding index value.
According to judging result, when the data to be stored are new datas, above mentioned steps S3 00 includes the following steps：
S311, back end generate described in the data to be stored data index value.
S312, back end store the data index value into the index server.
S313, the data to be stored described in back end storage are to local disk.
After master control server establishes connection with back end, the storage of data is mainly handled by back end, and real
When return to the transmission result data of handled data to master control server.Corresponding data node generates the index value of new data,
And in the data storage to the corresponding position of this disk that index server is written in the index value, while will be stored.
According to judging result, when the data to be stored are not new datas, above mentioned steps S3 00 includes the following steps：
The data index value of S321, the back end data to be stored according to are looked by the index server
The data to be stored are found in the position of local disk；
S322, the back end use described in the data cover local disk corresponding position to be stored former data.When wanting
When the data of storage are not new datas, then it is corresponding old directly to find the data to be stored by index server for back end
The position of the corresponding local disk of data and corresponding data cover block, directly carrying out data cover in legacy data position is
It can.
Preferably, in the embodiment of the data access method of wherein one distributed storage, when the main control service
When device receives data storage information, as shown in figure 5, this method further includes step S031, master control server passes through the index
Whether the data to be stored need to divide described in server judgement, obtain judging result.
According to judging result, when the data to be stored need segmentation, if so, S301 is thened follow the steps, the main control
The multiple back end of server connection carry out data storage；
If it is not, thening follow the steps S302, the single back end of master control server connection carries out data storage.
Wherein, when the data need segmentation, the data index value includes single index value and data combined value.Its
In, single index value is made of index value header, back end mark and standard metadata information three parts.For the number of segmentation
According to data index value further includes by standard disperse in addition to the single index value including being reached as elucidated before by three parts
The data combined value that the data algorithm of formula obtains.
In the embodiment of the data access method of wherein one distributed storage, as shown in fig. 6, this method further include with
Lower step：
S400, the result data of the data transfer of data of the master control server real-time reception into line access, and root
Judge whether digital accessing apparatus is abnormal according to the result data, in digital accessing apparatus exception, control starts corresponding generation
It manages equipment and carries out data access.Wherein, digital accessing apparatus be the index server and/or the back end, and/or
Local disk.
In conjunction with previous embodiment, as shown in fig. 7, when each step combines in one embodiment, data storage is by following
Step carries out：
(1) when front-end server generates data write-in demand, master control server receives data above-mentioned and demand is written
In data storage information, and find according to data storage information search index (metadata) server the rope for the data to be stored
Draw the corresponding back end of value, and determines whether new data.
(2) if new data, then determine whether to carry out data segmentation, data segmentation can be by artificially because data cases be adjusted
It is whole, as a reference, can be cut in 4K~64M magnitude ranges, the data of segmentation are respectively written into each data section after cutting
Point, back end are computed each back end of rear recurrent wrIting and then inquire corresponding data via index service if legacy data
After node, determine whether after dividing data, transfers data to corresponding multiple back end.
(3) when each back end receives the data that master control server transmits, and demand is written, according to the number to be written
According to data index value search index server, find the position for the data to be written, if its index value is related combined value,
In the data to be written via re-writing and rewriting in Combination nova value to index server after covering its region, if new number
According to then after each back end receives data write service, the single index value for generating the data to be written is combined with data
Value, and the data to be written are written behind local, index service is written into the single index value of data and data combined value again
Device.
(4) need not be split to the data of write-in, and for new data when, then sent via master control server
Demand is written to the back end in data, in the data that will be written behind the data write-in local which will be written
Index server is written as data index value in single index value, if being written as overriding legacy data, rope is searched by back end
Draw server, it is local to find the partial write that will be override behind the position and region for the data to be written.
(5) result data can be all transmitted during each data action to master control server, if there is index server,
Back end, when being locally stored failure or when any data node failure, then master control server can be adjusted by agent equipment
Or back end substitutes its service.
Preferably, in the embodiment of the data access method of wherein one distributed storage, when the main control service
When device receives data read information, this method further includes step S032, and master control server is judged by the index server
Whether the data to be read are segmentation data, obtain judging result.
S303 is thened follow the steps, master control server connection is more when what is read is segmentation data according to judging result
A back end carries out digital independent.
According to judging result S304, master control server connection are thened follow the steps when what is read is not segmentation data
The single back end carries out digital independent.
In one of the embodiments, as shown in figure 8, the step of digital independent is as follows in detail：
When front-end server (client) generates digital independent demand, demand data is transferred at master control server
Reason, after master control server is connected to digital independent demand, search index (metadata) server finds data index value correspondence
Related data node.
(1) if segmentation data, then reading requirement is sent into the data and divides relevant each back end.
(2) when each back end receives the digital independent demand that master control server transmits, just according to its data directory
It is worth search index server, finds the position of the data, if data directory (unique) value is related data combined value for this, at this
Back end will read locally associated data according to combined value, and send to master control server.
(3) master control server receives each back end and reads and after the data responded, will be counted by the data combined value
After reformulating complete data, it is sent in the server of digital independent requirement.
(4) result data can be all transmitted during each data action to master control server, if there is index server,
Back end, when being locally stored failure or when any data node failure, then master control server can be adjusted by agent equipment
Or back end substitutes its service.
Based on same inventive concept, the embodiment of the present invention provides a kind of data access arrangement of distributed storage, due to this
The principle that system solves the problems, such as is similar to a kind of aforementioned method, and therefore, the implementation of the system can be according to the specific of preceding method
Step realizes that overlaps will not be repeated.
The data access arrangement of the distributed storage of the embodiment of the present invention, as shown in figure 9, including master control server 100,
Index server 200 and back end 300.Wherein：The master control server 100 receives document access information, and sends institute
Document access information is stated to the index server；It is corresponding that the index server 200 finds the document access information
The back end 300, and the information of the back end is returned to the master control server；The master control server connects
It connects the back end and carries out data access.
Wherein, the back end can be connected with the quantity of the index server according to actual demand, with distribution
The quantity of the growth of storage data quantity, back end and index server also can accordingly increase.Back end is actively by data phase
Information (e.g., title, only one number, the information such as position are written in index server) is closed, so even there are more indexes simultaneously
Server can be all synchronously written, and in master controller or the following memory technology for supporting index server, also can arbitrarily be visited
Ask that an index server finds the position of the data, also having disperseed the failure of index server in this way causes data that can not access
The problem of.
And in the embodiment of the present invention, index server looks only for back end information, subsequently direct by master control server
Connect back end, to alleviate the pressure of index server, back end quantity caused by also having broken away from index server
Bottleneck.It, can be by more index server dispersions and during more master control servers are carried out at the same time reading and writing data
Reason, substantially reduces the running bottleneck of index server.The storage performance of the mode of distributed storage can be promoted.
In the embodiment of the data access arrangement of wherein one distributed storage, as shown in Figure 10, which further includes
Local disk 400, the master control server include new data judgment module 110, and the back end includes that index value generates
Module 310, index value memory module 320, the first memory module 330, location lookup module 340 and the second memory module 350.
When the master control server receives data storage information, the new data judgment module 110 passes through the rope
Draw server and judges whether the data to be stored are new data；
According to the judging result of the new data judgment module, if so,
The index value generation module 310 generates the data index value of the data to be stored；
The index value memory module 320 stores the data index value into the index server；
First memory module 330 stores the data to be stored to local disk；
If it is not, then
The location lookup module 340 passes through the index server according to the data index value of the data to be stored
The data to be stored are found in the position of local disk；
The former data for the data cover local disk corresponding position to be stored described in the use of second memory module 350.
In the embodiment of the data access arrangement of wherein one distributed storage, as shown in figure 11, the master control uniform
Business device further includes the first data segmentation judgment module 120, more back end memory modules 130 and forms data node memory module
140.Wherein：First data divide judgment module 120
It is no to need to divide；If so, more back end memory modules 130, which connect multiple back end, carries out data storage；
If it is not, then the forms data node memory module 140 connects the single back end progress data storage；And work as the data
When needing segmentation, the data index value includes single index value and data combined value.
In the embodiment of the data access arrangement of wherein one distributed storage, as shown in figure 12, the master control uniform
Business device further includes the second data segmentation judgment module 150, more back end read modules 160 and forms data node read module
170。
When the master control server receives data read information, the second data segmentation judgment module 150 passes through
The index server judges the step of whether data to be read are segmentation data；If so, more back end are read
Module 160 connects multiple back end and carries out digital independent；If it is not, then the forms data node read module 170 connects
The single back end carries out digital independent.
In the embodiment of the data access arrangement of wherein one distributed storage, as shown in figure 13, the master control uniform
Business device further includes abnormal judgment module 180 and exception processing module 190.Wherein：It is described exception 180 real-time reception of judgment module into
The result data of the data transfer of the data of line access, and judge whether digital accessing apparatus is abnormal according to the result data；
When the digital accessing apparatus exception, the control of the exception processing module 190 starts corresponding agent equipment progress data and deposits
It takes.Wherein, the digital accessing apparatus is the index server and/or the back end and/or local disk.
Several embodiments of the invention above described embodiment only expresses, the description thereof is more specific and detailed, but simultaneously
Cannot the limitation to the scope of the claims of the present invention therefore be interpreted as.It should be pointed out that for those of ordinary skill in the art
For, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to the guarantor of the present invention
Protect range.Therefore, the protection domain of patent of the present invention should be determined by the appended claims.
Claims (9)
1. a kind of data access method of distributed storage, which is characterized in that include the following steps：
Master control server receives document access information, and sends the document access information to index server；
The index server finds the corresponding back end of the document access information, and returns to the letter of the back end
Cease the master control server；
The master control server connects the back end and carries out data access；
When the master control server receives data storage information, this method further includes the master control server described in
Index server judges the step of whether data to be stored are new data；
Include the following steps if so, the master control server connects the step of back end carries out data access：
The data index value for the data to be stored described in the back end generation；
The back end stores the data index value into the index server；
The data to be stored described in back end storage are to local disk；
If it is not, the step of then master control server connects the back end progress data access includes the following steps：
The data index value of the back end data to be stored according to is found described by the index server
The data to be stored are in the position of local disk；
The former data for the data cover local disk corresponding position to be stored described in the back end use.
2. the data access method of distributed storage according to claim 1, which is characterized in that the method further includes institute
The step of whether master control server needs segmentation by the data to be stored described in index server judgement stated；
If so, the multiple back end of master control server connection carry out data storage；
If it is not, then the single back end of master control server connection carries out data storage.
3. the data access method of distributed storage according to claim 2, which is characterized in that when the data need to divide
When cutting, the data index value includes single index value and data combined value.
4. the data access method of distributed storage according to claim 1, which is characterized in that when the main control service
When device receives data read information, this method further includes the master control server will be read by index server judgement
Data whether be segmentation data the step of；
If so, the multiple back end of master control server connection carry out digital independent；
If it is not, then the single back end of master control server connection carries out digital independent.
5. the data access method of distributed storage according to any one of claims 1 to 4, which is characterized in that this method
It is further comprising the steps of：
The result data of the data transfer of data of the master control server real-time reception into line access, and according to the result
Data judge whether digital accessing apparatus is abnormal；
When the digital accessing apparatus exception, the master control server control starts corresponding agent equipment progress data and deposits
It takes；
The digital accessing apparatus is the index server and/or the back end and/or local disk.
6. a kind of data access arrangement of distributed storage, which is characterized in that including master control server, index server sum number
According to node, wherein：
The master control server receives document access information, and sends the document access information to the index server；
The index server finds the corresponding back end of the document access information, and returns to the back end
Information to the master control server；
The master control server connects the back end and carries out data access；
The system further includes local disk, and the master control server includes new data judgment module, and the back end includes
Index value generation module, index value memory module, the first memory module, location lookup module and the second memory module；
When the master control server receives data storage information, the new data judgment module passes through the index server
Judge whether the data to be stored are new data；
According to the judging result of the new data judgment module, if so,
The data index value for the data to be stored described in the index value generation module generation；
The index value memory module stores the data index value into the index server；
The data to be stored described in first memory module storage are to local disk；
If it is not, then
The data index value of the location lookup module data to be stored according to is found by the index server
The data to be stored are in the position of local disk；
The former data for the data cover local disk corresponding position to be stored described in the second memory module use.
7. the data access arrangement of distributed storage according to claim 6, which is characterized in that the master control server
Further include the first data segmentation judgment module, more back end memory modules and forms data node memory module, wherein：
First data segmentation judgment module by the index server judge described in the data to be stored whether need point
It cuts；
If so, more multiple back end of back end memory module connection carry out data storage；
If it is not, then the single back end of forms data node memory module connection carries out data storage；
And when the data need segmentation, the data index value includes single index value and data combined value.
8. the data access arrangement of distributed storage according to claim 6, which is characterized in that the master control server
Further include the second data segmentation judgment module, more back end read modules and forms data node read module；
When the master control server receives data read information, the second data segmentation judgment module passes through the index
Server judges the step of whether data to be read are segmentation data；
If so, more multiple back end of back end read module connection carry out digital independent；
If it is not, then the single back end of forms data node read module connection carries out digital independent.
9. according to the data access arrangement of claim 6 to 8 any one of them distributed storage, which is characterized in that the master
Control server further includes abnormal judgment module and exception processing module, wherein：
The result data of the data transfer of data of the exception judgment module real-time reception into line access, and according to the result
Data judge whether digital accessing apparatus is abnormal；
When the digital accessing apparatus exception, the exception processing module control starts corresponding agent equipment progress data and deposits
It takes；
The digital accessing apparatus is the index server and/or the back end and/or local disk.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410229794.9A CN104883381B (en) | 2014-05-27 | 2014-05-27 | The data access method and system of distributed storage |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410229794.9A CN104883381B (en) | 2014-05-27 | 2014-05-27 | The data access method and system of distributed storage |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104883381A CN104883381A (en) | 2015-09-02 |
| CN104883381B true CN104883381B (en) | 2018-09-04 |
Family
ID=53950715
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410229794.9A Expired - Fee Related CN104883381B (en) | 2014-05-27 | 2014-05-27 | The data access method and system of distributed storage |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104883381B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6393784B2 (en) | 2015-09-07 | 2018-09-19 | シク ジュ，ハク | Electromagnetic wave absorption extinguishing and shielding sheet and electronic device high heat dissipation fusion sheet, and manufacturing method thereof |
| CN106473472A (en) * | 2016-10-20 | 2017-03-08 | 国网山东省电力公司菏泽供电公司 | A kind of storage cabinet, control system and data storage system |
| CN108121511B (en) * | 2017-12-21 | 2022-05-27 | 北京猫盘技术有限公司 | Data processing method, device and equipment in distributed edge storage system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6374253B1 (en) * | 1998-12-30 | 2002-04-16 | Microsoft Corporation | System and method for generating hierarchical forward knowledge |
| CN1859115A (en) * | 2006-01-24 | 2006-11-08 | 华为技术有限公司 | Distributing storage downloading system, device and method for network data |
| CN101901275A (en) * | 2010-08-23 | 2010-12-01 | 华中科技大学 | A distributed storage system and method thereof |
| CN102110146A (en) * | 2011-02-16 | 2011-06-29 | 清华大学 | Key-value storage-based distributed file system metadata management method |
| CN102387179A (en) * | 2010-09-02 | 2012-03-21 | 联想(北京)有限公司 | Distributed file system and nodes, saving method and saving control method thereof |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102694828B (en) * | 2011-03-23 | 2016-03-30 | 中兴通讯股份有限公司 | A kind of method of distributed cache system data access and device |
| CN102833352A (en) * | 2012-09-17 | 2012-12-19 | 深圳中兴网信科技有限公司 | Distributed cache management system and method for implementing distributed cache management |
-
2014
- 2014-05-27 CN CN201410229794.9A patent/CN104883381B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6374253B1 (en) * | 1998-12-30 | 2002-04-16 | Microsoft Corporation | System and method for generating hierarchical forward knowledge |
| CN1859115A (en) * | 2006-01-24 | 2006-11-08 | 华为技术有限公司 | Distributing storage downloading system, device and method for network data |
| CN101901275A (en) * | 2010-08-23 | 2010-12-01 | 华中科技大学 | A distributed storage system and method thereof |
| CN102387179A (en) * | 2010-09-02 | 2012-03-21 | 联想(北京)有限公司 | Distributed file system and nodes, saving method and saving control method thereof |
| CN102110146A (en) * | 2011-02-16 | 2011-06-29 | 清华大学 | Key-value storage-based distributed file system metadata management method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104883381A (en) | 2015-09-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103425538B (en) | Process communication method and system | |
| US8767564B2 (en) | Field communication system and field communication method | |
| CN103164202B (en) | A kind of gray scale dissemination method and device | |
| CN104219085A (en) | Proxy server and data processing method and system of database | |
| CN110222116B (en) | Control method and device for transaction data storage and storage medium | |
| US20030220951A1 (en) | Dynamic disk space management by multiple database server instances in a cluster configuration | |
| CN105653406B (en) | A kind of method and distributed memory system managing distributed memory system | |
| US9104338B2 (en) | Network storage system, disk array device, host device, access control method, and data access method | |
| EP2710477B1 (en) | Distributed caching and cache analysis | |
| US20090172322A1 (en) | Automatically Adjusting a Number of Backup Data Sources Concurrently Backed Up to a Storage Device on a Server Computer | |
| GB2359159A (en) | Method and apparatus for identifying changes to a logical object based on changes to the logical object at a physical level | |
| CN103139255B (en) | The method of Resources allocation mark and identification section | |
| CN104883381B (en) | The data access method and system of distributed storage | |
| WO1999054817A3 (en) | Method and apparatus for enabling a component in a first transaction processing environment to access a resource in another environment | |
| CN106911770A (en) | A kind of data sharing method and system based on many cloud storages | |
| CN106202416B (en) | Table data write method and device, table data read method and device | |
| CN105446889B (en) | A memory management method, device and memory controller | |
| CN105912425B (en) | Snapshot image foundation, rollback method and device | |
| CN106933868A (en) | A kind of method and data server for adjusting data fragmentation distribution | |
| CN106777085A (en) | A kind of data processing method, device and data query system | |
| CN115129618A (en) | Method and apparatus for optimizing data caching | |
| CN109445902A (en) | A kind of data manipulation method and system | |
| CN105657006A (en) | First visit acceleration method and system based on Internet acceleration network | |
| CN106708428A (en) | Data virtual storage method and apparatus | |
| US20120297010A1 (en) | Distributed Caching and Cache Analysis |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180904 |