CN105868342A - Cache-data query method and system for CDN system - Google Patents
Cache-data query method and system for CDN system Download PDFInfo
- Publication number
- CN105868342A CN105868342A CN201610183602.4A CN201610183602A CN105868342A CN 105868342 A CN105868342 A CN 105868342A CN 201610183602 A CN201610183602 A CN 201610183602A CN 105868342 A CN105868342 A CN 105868342A
- Authority
- CN
- China
- Prior art keywords
- blockette
- file
- inquiry
- array
- cdn
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/951—Indexing; Web crawling techniques
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
- G06F16/9574—Browsing optimisation, e.g. caching or content distillation of access to content, e.g. by caching
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a cache-data query method for a CDN system. The cache-data query method includes the steps that the to-be-set position in a first query array of a dispatching center is determined according to a first digit group, the determined to-be-set position is set, and a second query array is generated, wherein the first digit group is generated based on a file cached on a CDN node; a second digit group is generated based on a file in a source server; whether the position, corresponding to the second digit group, in the second query array is set or not is queried, and whether the file is cached on the CDN node or not is determined according to the query result. The invention further provides a cache-data query system for the CDN system. By means of the cache-data query method and system for the CDN system, the data querying speed of the dispatching center is increased, the speed of response to a user access request is increased, and therefore the user experience is improved.
Description
Technical field
The present invention relates to Internet technical field, particularly to a kind of data query cache method and system for CDN system.
Background technology
The full name of CDN is Content Delivery Network, i.e. content distributing network.Its objective is by increasing by one layer of new network architecture in existing Internet, the content of website is published to the network " edge " closest to user, make user can obtain required content nearby, solve Internet network congestion condition, improve user and access the response speed of website.
CDN technology is divided into dynamically to be accelerated and two kinds of technology of static acceleration, mostly commonly use at present is static acceleration, CDN node is i.e. disposed at the edge of network, when there being user to ask a certain service, CDN system is by scheduling, i.e. GSLB (Global Server Load Balance, GSLB) strategy directs the user to a fringe node of content that is nearest away from it and that be cached with user's request, and the content of caching is issued this user.This is accomplished by fringe node and synchronizes the information of all the elements that this node place caches to control centre, in case control centre is when receiving user to the access request of a certain service, the information of the cache contents that the fringe node stored by inquiry is synchronized is to determine the fringe node being cached with requested content accurately.
In prior art, fringe node synchronizes the method for this nodal cache content and is: store by the metadata of the All Files stored in fringe node is reached control centre nominally, to realize the information of fringe node cache file and the synchronization of control centre；The method whether being cached with a certain file in prior art in control centre's inquiry fringe node is: control centre is when receiving user access request, the fringe node of the request contrast control centre's storage according to user synchronizes the cache file information (the metadata title of file) of coming, to determine that user asks the fringe node at the file place accessed.
But, due to fringe node is numerous and at each fringe node the quantity of metadata of caching be also sizable (such as, video file is all presented in TS sheet), the most this traditional control centre that is uploaded to causes increasingly heavier pressure in the way of storage to control centre, and there is also owing to uploading file loss, the shortcoming causing synchronization failure in synchronizing process；In addition, owing to control centre storing the information of all of file of caching in all fringe nodes of the whole network with the form of the metadata title of file, therefore by traditional contrast one by one by the way of determine that the efficiency of the fringe node being cached with requested file is low-down, this also directly results in the time delay that user provides service, affect Consumer's Experience, be also to consume very much control centre's resource simultaneously.
Summary of the invention
The present invention provides a kind of data query cache method and system for CDN system, is used for solving inquiry workload technical problem big, inefficient in control centre's in prior art.
According to an aspect of the invention, it is provided a kind of data query method for CDN system, including:
Determine that according to the first blockette the numerical digit to be put in the first inquiry array of control centre is put, to determined by numerical digit to be put put number, generate the second inquiry array, described first blockette is based on the file generated being buffered in CDN node；
Based on a certain file generated the second blockette in described source server；
The position corresponding with the second blockette inquired about in described second inquiry array has been set to number the most, determines that described a certain file has been buffered in described CDN node according to Query Result.
According to another aspect of the present invention, it is provided that a kind of data query for CDN system synchronizes system, including:
Second inquiry array generation module, numerical digit to be put in the first inquiry array determining control centre according to the first blockette is put, numerical digit to be put determined by puts number, generates the second inquiry array, and described first blockette is based on the file generated being buffered in CDN node；
First hash module, for based on a certain file generated the second blockette in described source server；
Inquiry determines module, has the most been set to number for inquiring about the position corresponding with the second blockette in described second inquiry array, has determined that described a certain file has been buffered in described CDN node according to Query Result.
The data query cache synchronous method for CDN system of the embodiment of the present invention and system, by determining the first blockette based on the file being buffered in CDN node, and determine that according to the first blockette the numerical digit to be put in the first inquiry array of control centre is put, determined by, numerical digit to be put puts number, generate the second inquiry array, whether the corresponding positions having only to when control centre is inquired about to be determined by the second inquiry array is set to number can complete inquiry, so that inquiry becomes quickness and high efficiency, improve the speed of the response to user access request, thus promote Consumer's Experience.
Accompanying drawing explanation
In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, in describing embodiment below, the required accompanying drawing used is briefly described, apparently, accompanying drawing in describing below is some embodiments of the present invention, for those of ordinary skill in the art, on the premise of not paying creative work, it is also possible to obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the flow chart of an embodiment of the data query cache method for CDN system of the present invention；
Fig. 2 is the flow chart of another embodiment of the data query cache method for CDN system of the present invention；
Fig. 3 is the flow chart of the another embodiment of the data query cache method for CDN system of the present invention；
Fig. 4 is the schematic diagram of an embodiment of the data query cache system for CDN system of the present invention；
Fig. 5 is the schematic diagram of an embodiment of the data query cache system for CDN system in the present invention；
Fig. 6 is the schematic diagram of another embodiment of the data query cache system for CDN system in the present invention；
Fig. 7 is the schematic diagram of the whole zero setting in all positions in bit array；
Fig. 8 be k when taking 3 para-position array put the schematic diagram of several embodiments；
Fig. 9 is the schematic diagram of the embodiment judging whether element be present in bit array.
Specific embodiment
For making the purpose of the embodiment of the present invention, technical scheme and advantage clearer, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is a part of embodiment of the present invention rather than whole embodiments.Based on the embodiment in the present invention, the every other embodiment that those of ordinary skill in the art are obtained under not making creative work premise, broadly fall into the scope of protection of the invention.
It should be noted that in the case of not conflicting, the embodiment in the application and the feature in embodiment can be mutually combined.
The present invention can be used in numerous general or special purpose computing system environment or configuration.Such as: personal computer, server computer, handheld device or portable set, laptop device, multicomputer system, system based on microprocessor, set top box, programmable consumer-elcetronics devices, network PC, minicomputer, mainframe computer, the distributed computing environment including any of the above system or equipment etc..
The present invention can be described in the general context of computer executable instructions, such as program module.Usually, program module includes performing particular task or realizing the routine of particular abstract data type, program, object, assembly, data structure etc..The present invention can also be put into practice in a distributed computing environment, in these distributed computing environment, the remote processing devices connected by communication network perform task.In a distributed computing environment, during program module may be located at the local and remote computer-readable storage medium including storage device.
Finally, it can further be stated that, in this article, the relational terms of such as first and second or the like is used merely to separate an entity or operation with another entity or operating space, and not necessarily requires or imply the relation or sequentially that there is any this reality between these entities or operation.And, term " includes ", " comprising ", not only includes those key elements, but also includes other key elements being not expressly set out, or also includes the key element intrinsic for this process, method, article or equipment.In the case of there is no more restriction, statement " including ... " key element limited, it is not excluded that there is also other identical element in including the process of described key element, method, article or equipment.
As it is shown in figure 1, the data query method for CDN system of one embodiment of the invention, including:
S11, the numerical digit to be put determined according to the first blockette in the first inquiry array of control centre are put, to determined by numerical digit to be put put number, generate the second inquiry array, the first blockette is based on the file generated being buffered in CDN node；
S12, based on a certain file generated the second blockette in source server；
The position corresponding with the second blockette in S13, inquiry the second inquiry array has been set to number the most, determines that a certain file has been buffered in CDN node according to Query Result.
The first blockette in the present embodiment can be received from the blockette based on the file generated being buffered in CDN node of CND node, or the characteristic information of the file being buffered in CDN node uploaded according to the CDN node received generates.
Source server in the present embodiment is any one source server in CDN the whole network, a certain file in source server is arbitrary file, actual of a certain file in source server mentioned here is the arbitrary file in CDN the whole network, and it is not intended to be limited to the file taking from source server, for example, it may be the access request from client requires to access a certain file.
The data query cache method for CDN system of the present embodiment, by determining the first blockette based on the file being buffered in CDN node, and determine that according to the first blockette the numerical digit to be put in the first inquiry array of control centre is put, determined by, numerical digit to be put puts number, generate the second inquiry array, owing to the information that synchronized also is to store with the form of digit order number in control centre, save memory space, and also have only to be determined by inquire about the corresponding positions in array when control centre is inquired about and whether be set to number and can complete inquiry, so that inquiry also becomes quickness and high efficiency, improve the speed of the response to user access request, thus promote Consumer's Experience.
In certain embodiments, the first blockette based on the file generated being buffered in CDN node is: the characteristic information of the file that reception is buffered in CDN node carries out repeatedly Hash to determine the first blockette；
Based on a certain file generated the second blockette in described source server it is: the characteristic information of a certain file in described source server is carried out repeatedly Hash to determine the second blockette.
As in figure 2 it is shown, be the flow chart of another embodiment of the present invention, in this embodiment, the characteristic information of the file that reception is buffered in CDN node carries out repeatedly Hash to determine that the first blockette includes:
S21, determine the characteristic information of file；
S22, characteristic information carrying out repeatedly Hash, each Hash all generates a numeral；
S23, by generate all stored digital be the first blockette.
The data query cache method for CDN system of the present embodiment, by the characteristic information of the file being buffered in CDN node is carried out repeatedly Hash to determine the first blockette, and determine that according to the first blockette the numerical digit to be put in the first inquiry array of control centre is put, determined by, numerical digit to be put puts number, generate the second inquiry array, owing to the information that synchronized also is to store with the form of digit order number in control centre, save memory space, and also have only to be determined by inquire about the corresponding positions in array when control centre is inquired about and whether be set to number and can complete inquiry, so that inquiry also becomes quickness and high efficiency, improve the speed of the response to user access request, thus promote Consumer's Experience.
In addition, the present embodiment use hash algorithm the characteristic information of file carries out repeatedly Hash to be contained the first blockette of multiple numeral accordingly, for uniquely identifying this document, thus the data message of mark this document has been compressed to several numeral, greatly reduce the data volume that CDN node synchronizes to upload required for the fileinfo of local cache, and the reduction of the data volume owing to uploading, decrease the probability made mistakes in upload procedure (because it is inevitable the highest for the requirement of network environment to upload bigger file, upload less demanding to network environment of less file, therefore upload string number and be greatly reduced relative to the error probability uploading complete fileinfo).
Additionally, the number of times that the characteristic information of the file of be buffered in CDN node carries out Hash is at least 8 times, the blockette that the purpose of do so obtains after being to ensure the characteristic information of different files is carried out repeatedly Hash is different.nullThink，When the characteristic information of different files being carried out Hash (such as 3 times) of fewer number，Obtain only includes three digital blockettes，The probability that blockette that the blockette so obtained obtains with the characteristic information of other file carries out 3 Hash is identical is the biggest，So it is possible to there is the generation of the situation without inquiry in follow-up inquiry，Such as，Hash result to 3 times of A file and B file is all (4、9、13)，When certain nodal cache has A file and its characteristic information will carry out the result (4 of Hash、9、13) after synchronizing，If whether control centre's inquiry B file is buffered，The most at this moment owing to being also (4 to the 3 of the characteristic information of B file Hash result、9、13)，B file will be mistaken for and be buffered in some CDN node.
In order to further ensure that the characteristic information to file carries out the uniqueness of the blockette that Hash obtains, characteristic information uses the character string in the title of file or is the MD5 value of file, because the information of the MD5 value of the character string in the title of file and the file a certain file of a kind of unique mark, so it is carried out the probability that the blockette that Hash obtains comes across the characteristic information of other file identical the least, and then improve the accuracy of control centre's Query Result.
As it is shown on figure 3, be the flow chart of another embodiment of the present invention, in this embodiment, determine that according to the first blockette the numerical digit to be put in the first inquiry array of control centre is put, to determined by numerical digit to be put put number, generate the second inquiry array and include:
S31, the numeral read in described first blockette；
S32, to putting number with the corresponding position of described numeral read and obtain the second inquiry array in the first inquiry array.
For making the present embodiment clearer, illustrate in conjunction with the example below.
1) bit array (i.e., the first inquiry array):
Assuming that bit array uses the array of a m bit to preserve information, during original state, bit array is an array comprising m position, and each is all set to 0, and the element of the most whole array was both configured to for 0 (as shown in Figure 7).
2) k independent hash function (for repeatedly Hash)
In order to express S={x1,x2,…,xnThe set characteristic information of a file (each element be equivalent to) of such a n element, bit array uses k separate hash function (Hash Function), they respectively will set in each element be mapped to 1 ..., in the scope of m}.
When we are toward when increasing any one element x in bit array, we use k hash function that X carries out Hash to obtain k cryptographic Hash, then bit corresponding in array is set to 1.The position hash that i.e. i-th hash function mapsiX () will be set to 1 (1≤i≤k).Note, if a position is repeatedly set to 1, then only for the first time can work, after will there is no any effect several times.In fig. 8, k=3, and have two hash functions choose same position (from left side number the 5th, i.e. second " 1 " place).
3) judge whether element is present in bit array (that is, it is judged that whether some file is present in CDN node)
When judging whether element y belongs to this bit array, we have only to use k hash function to obtain k cryptographic Hash y, if all hashiY the position of () is all 1 (1≤i≤k), i.e. k position both is set to 1, so we are considered as y is the element (the most i.e. can determine that the file corresponding to element y is present in CDN node) in bit array, and being otherwise considered as y is not the element (the most i.e. can determine that in the no longer CDN node of the file corresponding to element y) in bit array.As it is shown in figure 9, y1It it not the most the element (because y1 has at has pointed to " 0 " position) in bit array.y2Or belong to this bit array.
Here the unit of m from n is different, m be bit be unit, n is then in units of element number the number of different element (say accurately be).The generally length of individual element all has a lot of bit.So making the characteristic information storing file in aforementioned manners is the most all to save on internal memory.
Method in above-described embodiment can be used for CDN control centre or CDN server.
The embodiment of the present invention can be passed through hardware processor (hardware processor) and realize related function module.
It should be noted that, for aforesaid each method embodiment, in order to be briefly described, therefore it is all expressed as a series of action and merges, but those skilled in the art should know, the present invention is not limited by described sequence of movement, because according to the present invention, some step can use other orders or carry out simultaneously.Secondly, those skilled in the art also should know, embodiment described in this description belongs to preferred embodiment, necessary to involved action and the module not necessarily present invention.
In the above-described embodiments, the description to each embodiment all emphasizes particularly on different fields, and does not has the part described in detail, may refer to the associated description of other embodiments in certain embodiment.
As shown in Figure 4, the schematic diagram of the data query system for CDN system of one embodiment of the invention, including:
Second inquiry array generation module, numerical digit to be put in the first inquiry array determining control centre according to the first blockette is put, numerical digit to be put determined by puts number, generates the second inquiry array, and described first blockette is based on the file generated being buffered in CDN node；
First hash module, for based on a certain file generated the second blockette in described source server；
Inquiry determines module, has the most been set to number for inquiring about the position corresponding with the second blockette in described second inquiry array, has determined that described a certain file has been buffered in described CDN node according to Query Result.
The data query cache for CDN system of the present embodiment synchronizes system, by determining the first blockette based on the file being buffered in CDN node, and the second inquiry array generation module determines that according to the first blockette the numerical digit to be put in the first inquiry array of control centre is put, determined by, numerical digit to be put puts number, generate the second inquiry array, owing to the information that synchronized also is to store with the form of digit order number in control centre, save memory space, and determine whether the corresponding positions that module also has only to when control centre is inquired about be determined by inquiry array is set to number and can complete inquiry by the first hash module and inquiry, so that inquiry also becomes quickness and high efficiency, improve the speed of the response to user access request, thus promote Consumer's Experience.
In certain embodiments, the second inquiry array generation module includes the second hash module, carries out repeatedly Hash to determine the first blockette for reception is buffered in the characteristic information of the file of CDN node；
Based on a certain file generated the second blockette in source server it is: the characteristic information of a certain file in source server is carried out repeatedly Hash to determine the second blockette.
As it is shown in figure 5, be the schematic diagram of one embodiment of the invention, wherein, the second hash module includes:
Characteristic information determines unit, for determining the characteristic information of described file；
Hash calculation unit, for described characteristic information is carried out repeatedly Hash, each Hash all generates a numeral；
First blockette signal generating unit, is the first blockette for all stored digital that will generate.
Characteristic information is the character string in the title of described file or the MD5 value for described file.
The number of times that the characteristic information of the file of be buffered in CDN node carries out Hash is at least 8 times.
The present embodiment use hash algorithm the characteristic information of file carries out repeatedly Hash to be contained the first blockette of multiple numeral accordingly, for uniquely identifying this document, thus the data message of mark this document has been compressed to several numeral, greatly reduce the data volume that CDN node synchronizes to upload required for the fileinfo of local cache, and the reduction of the data volume owing to uploading, decrease the probability made mistakes in upload procedure (because it is inevitable the highest for the requirement of network environment to upload bigger file, upload less demanding to network environment of less file, therefore upload string number and be greatly reduced relative to the error probability uploading complete fileinfo).
As shown in Figure 6, the schematic diagram of one embodiment of the invention, wherein the second inquiry array generation module includes:
Numeral reads unit, for reading the numeral in described first blockette；
Array signal generating unit, obtains described second inquiry array for the position corresponding with the described numeral read in described first inquiry array is put number.
System in above-described embodiment can be laid on CDN server and/or CDN control centre.
Embodiment of the method described above is only schematically, the wherein said unit illustrated as separating component can be or may not be physically separate, the parts shown as unit can be or may not be physical location, i.e. may be located at a place, or can also be distributed on multiple NE.Some or all of module therein can be selected according to the actual needs to realize the purpose of the present embodiment scheme.Those of ordinary skill in the art, in the case of not paying performing creative labour, are i.e. appreciated that and implement.
By the description of above embodiment, those skilled in the art is it can be understood that can add the mode of required general hardware platform by software to each embodiment and realize, naturally it is also possible to pass through hardware.Based on such understanding, the part that prior art is contributed by technique scheme the most in other words can embody with the form of software product, this computer software product can store in a computer-readable storage medium, such as ROM/RAM, magnetic disc, CD etc., including some instructions with so that a computer equipment (can be personal computer, server, or the network equipment etc.) perform the method described in some part of each embodiment or embodiment.
Those skilled in the art are it should be appreciated that embodiments of the invention can be provided as method, system or computer program.Therefore, the form of the embodiment in terms of the present invention can use complete hardware embodiment, complete software implementation or combine software and hardware.And, the present invention can use the form at one or more upper computer programs implemented of computer-usable storage medium (including but not limited to disk memory and optical memory etc.) wherein including computer usable program code.
The present invention is to describe with reference to method, equipment (system) and the flow chart of computer program according to embodiments of the present invention and/or block diagram.It should be understood that can be by the flow process in each flow process in computer program instructions flowchart and/or block diagram and/or square frame and flow chart and/or block diagram and/or the combination of square frame.These computer program instructions can be provided to produce a machine to the processor of general purpose computer, special-purpose computer, Embedded Processor or other programmable data processing device so that the instruction performed by the processor of computer or other programmable data processing device is produced for realizing the device of function specified in one flow process of flow chart or multiple flow process and/or one square frame of block diagram or multiple square frame.
These computer program instructions may be alternatively stored in and can guide in the computer-readable memory that computer or other programmable data processing device work in a specific way, the instruction making to be stored in this computer-readable memory produces the manufacture including command device, and this command device realizes the function specified in one flow process of flow chart or multiple flow process and/or one square frame of block diagram or multiple square frame.These computer program instructions also can be loaded in computer or other programmable data processing device, make to perform sequence of operations step on computer or other programmable devices to produce computer implemented process, thus the instruction performed on computer or other programmable devices provides the step of the function specified in one flow process of flow chart or multiple flow process and/or one square frame of block diagram or multiple square frame for realization.
Last it is noted that above example is only in order to illustrate technical scheme, it is not intended to limit；Although the present invention being described in detail with reference to previous embodiment, it will be understood by those within the art that: the technical scheme described in foregoing embodiments still can be modified by it, or wherein portion of techniques feature is carried out equivalent；And these amendments or replacement, do not make the essence of appropriate technical solution depart from the spirit and scope of various embodiments of the present invention technical scheme.
Claims (10)
1. for a data query cache method for CDN system, including:
Determine that according to the first blockette the numerical digit to be put in the first inquiry array of control centre is put, to really
Fixed numerical digit to be put is put and is carried out putting number, generates the second inquiry array, and described first blockette is based on being buffered in
The file generated of CDN node；
Based on a certain file generated the second blockette in described source server；
The position corresponding with the second blockette inquired about in described second inquiry array has been set to number, root the most
Determine that described a certain file has been buffered in described CDN node according to Query Result.
Method the most according to claim 1, wherein, described first blockette is based on being buffered in CDN
The file generated of node is: the characteristic information of the file that reception is buffered in CDN node is repeatedly breathed out
Uncommon to determine the first blockette；
Described based on a certain file generated the second blockette in described source server it is: described source is serviced
The characteristic information of a certain file in device carries out repeatedly Hash to determine the second blockette.
Method the most according to claim 2, wherein, described determines tune according to described first blockette
Degree center first inquiry array in numerical digit to be put put, to determined by numerical digit to be put put number,
Generate the second inquiry array to include:
Read the numeral in described first blockette；
Number is put in the position corresponding with the described numeral read in described first inquiry array and obtains institute
State the second inquiry array.
4. according to the method described in any one of claim 1-3, wherein, described characteristic information is described literary composition
Character string in the title of part or be the MD5 value of described file.
5. according to the method described in any one of claim 1-3, wherein, to be buffered in CDN node
The characteristic information of file carry out the number of times of Hash and be at least 8 times.
6. for a data query cache system for CDN system, including:
Second inquiry array generation module, for determining the first inquiry of control centre according to the first blockette
Numerical digit to be put in array is put, to determined by numerical digit to be put put number, generate the second inquiry array,
Described first blockette is based on the file generated being buffered in CDN node；
First hash module, for based on a certain file generated the second blockette in described source server；
Inquiry determines module, for inquiring about the position corresponding with the second blockette in described second inquiry array
Put and be the most set to number, determine that described a certain file has been buffered in described CDN according to Query Result
Node.
System the most according to claim 6, wherein, described second inquiry array generation module includes
Second hash module, repeatedly breathes out for reception is buffered in the characteristic information of the file of CDN node
Uncommon to determine the first blockette；
Described based on a certain file generated the second blockette in described source server it is: described source is serviced
The characteristic information of a certain file in device carries out repeatedly Hash to determine the second blockette.
System the most according to claim 7, wherein, described second inquiry array generation module includes:
Numeral reads unit, for reading the numeral in described first blockette；
Array signal generating unit, for corresponding to the described numeral with reading in described first inquiry array
Position carry out putting number and obtain described second inquiry array.
9. according to the system described in any one of claim 6-8, wherein, described characteristic information is described literary composition
Character string in the title of part or be the MD5 value of described file.
10. according to the system described in any one of claim 6-8, wherein, to be buffered in CDN node
The characteristic information of file carry out the number of times of Hash and be at least 8 times.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610183602.4A CN105868342A (en) | 2016-03-28 | 2016-03-28 | Cache-data query method and system for CDN system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610183602.4A CN105868342A (en) | 2016-03-28 | 2016-03-28 | Cache-data query method and system for CDN system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105868342A true CN105868342A (en) | 2016-08-17 |
Family
ID=56626144
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610183602.4A Pending CN105868342A (en) | 2016-03-28 | 2016-03-28 | Cache-data query method and system for CDN system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105868342A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101645921A (en) * | 2009-04-17 | 2010-02-10 | 中国科学院声学研究所 | Updating method of fragment popularity |
| CN103888999A (en) * | 2012-12-19 | 2014-06-25 | 中国移动通信集团公司 | WebCache service and CDN service fusion method and device |
| US20140195686A1 (en) * | 2013-01-09 | 2014-07-10 | Edgecast Networks, Inc. | Optimized Consistent Request Distribution for Balanced Load Distribution in a Content Delivery Network |
| CN104951480A (en) * | 2014-03-31 | 2015-09-30 | 杭州迪普科技有限公司 | Resource storage indexing device and method in CDN system |
-
2016
- 2016-03-28 CN CN201610183602.4A patent/CN105868342A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101645921A (en) * | 2009-04-17 | 2010-02-10 | 中国科学院声学研究所 | Updating method of fragment popularity |
| CN103888999A (en) * | 2012-12-19 | 2014-06-25 | 中国移动通信集团公司 | WebCache service and CDN service fusion method and device |
| US20140195686A1 (en) * | 2013-01-09 | 2014-07-10 | Edgecast Networks, Inc. | Optimized Consistent Request Distribution for Balanced Load Distribution in a Content Delivery Network |
| CN104951480A (en) * | 2014-03-31 | 2015-09-30 | 杭州迪普科技有限公司 | Resource storage indexing device and method in CDN system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9740706B2 (en) | Management of intermediate data spills during the shuffle phase of a map-reduce job | |
| CN105487818B (en) | For the efficient De-weight method of repeated and redundant data in cloud storage system | |
| US8972986B2 (en) | Locality-aware resource allocation for cloud computing | |
| US8442955B2 (en) | Virtual machine image co-migration | |
| CN104537076B (en) | A kind of file read/write method and device | |
| CN110287197A (en) | A data storage method, migration method and device | |
| US10534753B2 (en) | Caseless file lookup in a distributed file system | |
| US10909086B2 (en) | File lookup in a distributed file system | |
| US20090187588A1 (en) | Distributed indexing of file content | |
| US10019499B2 (en) | Adaptive payload management | |
| US20130339605A1 (en) | Uniform storage collaboration and access | |
| US9348855B2 (en) | Supporting big data in enterprise content management systems | |
| CN106934048A (en) | Online data moving method, agent node | |
| CN111324606B (en) | Data slicing method and device | |
| CN102567312A (en) | Machine translation method based on distributive parallel computation framework | |
| US10417192B2 (en) | File classification in a distributed file system | |
| CN109726004A (en) | A data processing method and device | |
| CN120123108B (en) | Data processing method and device for kafka memory calculation separation | |
| CN107180031A (en) | Distributed storage method and device, data processing method and device | |
| Elghamrawy et al. | A partitioning framework for Cassandra NoSQL database using Rendezvous hashing | |
| CN110502472A (en) | A kind of the cloud storage optimization method and its system of large amount of small documents | |
| CN110168513B (en) | Partial storage of large files in different storage systems | |
| CN113728304B (en) | Granular change detection in distributed storage systems | |
| CN105791370A (en) | A data processing method and related server | |
| CN109669987A (en) | A big data storage optimization method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160817 |