Classifications

• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
  • G06F16/10—File systems; File servers
  • G06F16/13—File access structures, e.g. distributed indices
  • G06F16/137—Hash-based

Definitions

• the present invention relates to the field of the Internet, and in particular, to a cloud storage method and apparatus. Background technique
• Embodiments of the present invention provide a cloud storage method and apparatus to provide efficient storage of massive data.
• Calculate the hash value of the file convert the hash value of the file into a string as the file name; calculate the storage path of the file by using the file hash value according to a predefined rule; and find the actual storage location of the storage path of the file in the index table
• the file is stored in the actual storage location.
• the mapping table of all possible storage paths and the actual location of the storage disk has been pre-stored in the index table.
• a first module configured to calculate a hash value of the file according to a predefined hash value algorithm
• a second module configured to convert the hash value of the file calculated according to the first module into a string Is the file name
• a third module configured to calculate a storage path of the file according to a predefined algorithm by using a hash value of the file calculated by the first module
• the fourth module is configured to store a mapping table of all possible storage paths and actual locations of the storage disks
• a fifth module configured to search, according to a storage path of the file calculated by the third module, an actual storage location of the storage path of the file in the fourth module;
• a sixth module configured to store the file on a storage disk found by the fifth module to store the file.
• a cloud storage method and device provided by the embodiment of the present invention stores a large amount of data storage, since the file name storage using the hash value is used, the non-repetitive storage of the massive data can be ensured. Calculating the storage path of the file according to the hash value, and ensuring that the quantity data is stored on each storage server to ensure the storage balance of the system. Even if the storage server of the cloud storage system is infinitely expanded, the method can be efficiently managed. The storage of the document. DRAWINGS
• FIG. 1 is a flowchart of a cloud storage method according to an embodiment of the present invention.
• FIG. 2 is a schematic structural diagram of a cloud storage device according to an embodiment of the present invention.
• BEST MODE FOR CARRYING OUT THE INVENTION will be further described in detail with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
• FIG. 1 is a flowchart of a cloud storage method according to an embodiment of the present invention. As shown in FIG. 1, when the file is stored in the cloud, the method includes the following steps:
• Step 101 Calculate the Hash value of the file, and convert the Hash value of the file into a string as the file name.
• different hash value algorithms can be selected according to the configuration of the system.
• a double hash algorithm may be adopted as the file name, that is, two different hash algorithms are used to calculate the hash value of the file, and the two hash values are connected as the hash value of the file.
• the Hash value of the file is converted into a hexadecimal string as a file name, for example, the converted file name is HiHzHg -> HNO
• Step 102 Calculate the storage path of the file by using the file Hash value according to a predefined rule.
• the predefined rule may be:
• the storage path of the file is composed of a secondary directory; for example, the first two bits of the file name may be directly used as a first-level directory for storing the file, and the file name is The third four bits are used as the second level directory for storing the file.
• H 3 H 4 will be used as the second level directory of the file, that is, the file name is H 2 H 3 ...
• H N has a storage path of 11 2 ⁇ 11 4 .
• the two-digit 36-level secondary directory storage provided by the embodiment of the present invention can theoretically store and manage more than 10 billion documents. .
• Step 103 Find an actual storage location of a storage path of the file in an index table, and store the file in the actual storage location.
• the mapping table of all possible storage paths and the actual location of the storage disk has been pre-stored in the index table.
• the storage disk location corresponding to the 1679616 storage path (second-level directory) is already recorded in the index table, for example, which volume of a storage directory is located in a secondary directory.
• index table usually needs a few megabytes of space, and can be in the form of a group, which can be directly obtained by subscripting.
• the index table records a primary directory named AB, and the secondary directory named CD is stored on the third logical volume of the first disk.
• Step 104 When looking up (calling) a file, according to the same predefined rules, use The file hash value calculates the file name and storage path of the file to be searched;
• the first four digits of the file name are extracted, and the primary storage directory and the secondary storage directory of the file are obtained.
• Step 105 Find a physical disk corresponding to the file to be searched in the index table according to the calculated storage path of the file to be searched;
• Step 106 Find the file to be searched in the physical disk corresponding to the storage path according to the file name of the file to be searched.
• the actual storage location of all possible storage paths is recorded in the index table in advance in order to speed up the storage and lookup.
• one storage server In actual operation, usually one storage server carries multiple storage disks. When you add a storage disk to the current storage server, copy some of the directories on the existing storage disk to the new storage disk. When adding a new storage server, you can insert some of the disks on the original storage server directly into the new storage server. Although the original storage server needs to add new storage disks, you need to leave it from the storage server. Copy the storage disk to the new disk, but copy it.
• the storage method provided by the embodiment of the present invention can be used for mass data storage.
• mass data storage when storing a large amount of data storage in this way, since the file name storage using the hash value is used, it is possible to ensure the non-repetitive storage of the massive data.
• the storage path of the file is calculated according to the hash value, and the quantity data is stored on each storage server to ensure the storage balance of the system, even if the storage server of the cloud storage system is infinitely expanded. This way, you can also efficiently manage the storage of documents.
• the index table can be stored in the web server, so that when the user needs to find a file, the file can be quickly found in the mass server.
• the first bit of the hash value is used as the primary directory
• the second three is used as the secondary directory
• the fourth is used as the tertiary directory.
• FIG. 2 is a schematic structural diagram of a cloud storage device according to an embodiment of the present invention. As shown in FIG. 2, the cloud storage device runs on a device having a processor and a storage module.
• the device includes:
• a Hash value calculation module configured to calculate a Hash value of the file according to a predefined hash value algorithm
• a file name calculation module configured to calculate a Hash value of the file calculated by the module according to the Hash value, and convert the file into a string as a file name
• a storage path calculation module configured to calculate a Hash value of the file calculated by the Hash value calculation module, and calculate a storage path of the file according to a predefined algorithm
• a table module for storing a mapping table of all possible storage paths and the actual location of the storage disk
• An index table searching module configured to search, according to a storage module, a storage path of the file calculated by the storage path calculation module, and find an actual storage location of the storage path of the file in the index table module;
• the storage module is configured to invoke an index table lookup module, and store the file on a storage disk returned by the index table lookup module to store the file.
• the Hash value calculation module calculates the file name to be searched
• the file name calculation module calculates the file name of the file to be searched
• the storage path calculation module calculates the storage path of the file to be searched
• the index table search module And the physical storage disk corresponding to the file to be searched is found in the index table module
• the cloud storage device further includes: a search module, configured to calculate a storage path of the file to be searched according to the storage path calculation module, and call an index table to search for a module; and calculate a file name of the file to be searched according to the file name calculation module, and find the physical disk corresponding to the storage path. The file to be found.

Landscapes

• Engineering & Computer Science (AREA)
• Theoretical Computer Science (AREA)
• Data Mining & Analysis (AREA)
• Databases & Information Systems (AREA)
• Physics & Mathematics (AREA)
• General Engineering & Computer Science (AREA)
• General Physics & Mathematics (AREA)
• Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Priority Applications (5)

Applications Claiming Priority (2)

Related Parent Applications (1)

Related Child Applications (2)

Publications (1)

Family

ID=49491950

Family Applications (1)

Country Status (2)

Families Citing this family (22)

Citations (3)

Family Cites Families (4)

• 2012
  • 2012-05-02 CN CN2012101329267A patent/CN103384256A/zh active Pending
  • 2012-05-22 WO PCT/CN2012/075841 patent/WO2013163832A1/fr not_active Ceased

Patent Citations (3)

Also Published As

Similar Documents

Legal Events