CN112866406A - Data storage method, system, device, equipment and storage medium - Google Patents
Data storage method, system, device, equipment and storage medium Download PDFInfo
- Publication number
- CN112866406A CN112866406A CN202110158232.XA CN202110158232A CN112866406A CN 112866406 A CN112866406 A CN 112866406A CN 202110158232 A CN202110158232 A CN 202110158232A CN 112866406 A CN112866406 A CN 112866406A
- Authority
- CN
- China
- Prior art keywords
- data
- storage
- server
- request
- storage server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1464—Management of the backup or restore process for networked environments
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention discloses a data storage method, a system, a device, equipment and a storage medium. The method comprises the following steps: when a data writing request issued by a load balancing server is received, acquiring an object name in the data writing request to perform request processing, and acquiring at least three storage server numbers; the storage servers corresponding to the storage server numbers are all deployed in different server clusters; and respectively sending the data writing request to the storage servers corresponding to the storage server numbers so that the storage servers perform data writing operation in the data writing request. The method can decouple the interface service and the data storage service, is easy to expand and realize the storage of a large amount of unstructured data, carries out multiple backup on the data, and can improve the reliability and the fault tolerance of the data.
Description
Technical Field
The embodiments of the present invention relate to the field of data processing technologies, and in particular, to a data storage method, system, apparatus, device, and storage medium.
Background
With the rapid development of computer technology and biometric technology, a large amount of unstructured data such as pictures, documents, audio and video are generated when a user performs identity authentication, and new challenges are generated on the storage performance and capacity.
In the financial field, in the prior art, a Network Attached Storage (NAS) external Storage device is used to place unstructured data. However, as the number of users and the corresponding data increase explosively, a single NAS may cause high delay in user access, and cannot satisfy data storage. The scheme of adopting a plurality of NAS external storage devices can cause higher complexity of storage management, and the data of the same application system may need to be stored in different devices to cause data fragmentation. In addition, the maintenance of data will become more complicated and the system will be less scalable.
Disclosure of Invention
Embodiments of the present invention provide a data storage method, system, apparatus, device, and storage medium, which are easy to expand a data storage system, implement storage of a large amount of unstructured data, and can improve reliability and fault tolerance of data.
In a first aspect, an embodiment of the present invention provides a data storage method, which is executed by a proxy server in a data storage system, where the data storage system includes: the method comprises the following steps that a load balancing server and at least one server cluster are adopted, each server cluster comprises a proxy server and at least one storage server, and the method comprises the following steps:
when a data writing request issued by a load balancing server is received, acquiring an object name in the data writing request to perform request processing, and acquiring at least three storage server numbers;
the storage server corresponding to each storage server number is deployed in different server clusters;
and respectively sending the data writing request to the storage servers corresponding to the storage server numbers so as to enable the storage servers to write data in the data writing request.
In a second aspect, an embodiment of the present invention further provides a data storage system, where the system includes: the system comprises a load balancing server and at least one server cluster, wherein each server cluster comprises a proxy server and at least one storage server;
the load balancing server is used for acquiring a data writing request of a user and distributing the data writing request to a proxy server for request processing;
the proxy server is used for acquiring an object name in a data writing request for request processing when receiving the data writing request issued by the load balancing server, and acquiring at least three storage server numbers; the data writing request is respectively sent to the storage servers corresponding to the storage server numbers;
the storage server corresponding to each storage server number is deployed in different server clusters;
and the storage server is used for storing the data in the data writing request when receiving the data writing request sent by the proxy server.
In a third aspect, an embodiment of the present invention further provides a data storage apparatus, which is executed by a proxy server in a data storage system, where the data storage system includes: load balancing server, at least one server cluster, each said server cluster including a proxy server and at least one storage server, the apparatus comprising:
the number acquisition module is used for acquiring an object name in a data writing request for request processing when the data writing request issued by a load balancing server is received, and acquiring the numbers of at least three storage servers;
the storage server corresponding to each storage server number is deployed in different server clusters;
and the data writing request sending module is used for sending the data writing request to the storage servers corresponding to the storage server numbers respectively so as to enable the storage servers to write data in the data writing request.
In a fourth aspect, an embodiment of the present invention further provides an electronic device, where the electronic device includes:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement a data storage method as in any embodiment of the invention.
In a fifth aspect, the embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a data storage method according to any embodiment of the present invention.
According to the technical scheme of the embodiment of the invention, when a data writing request issued by a load balancing server is received, an object name in the data writing request is obtained to perform request processing, and at least three storage server numbers are obtained; the storage servers corresponding to the storage server numbers are all deployed in different server clusters; the data writing requests are respectively sent to the storage servers corresponding to the storage server numbers, so that the storage servers perform data writing operation in the data writing requests, the storage problem of unstructured data in the financial field is solved, the decoupling of the interface service and the data storage service is realized, the storage of a large amount of unstructured data is easily expanded, the data is subjected to multiple backup, and the reliability and the fault tolerance of the data can be improved.
Drawings
FIG. 1a is a flowchart of a data storage method according to an embodiment of the present invention;
FIG. 1b is a schematic structural diagram of a data storage system according to an embodiment of the present invention;
FIG. 1c is a schematic diagram of determining a storage server number according to an embodiment of the present invention;
fig. 2 is a flowchart of a data storage method according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of a data storage device according to a fourth embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device according to a fifth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
Fig. 1a is a flowchart of a data storage method according to an embodiment of the present invention, which is applicable to a case where unstructured data is stored in the financial field, and the method may be executed by a data storage device, which may be implemented by software and/or hardware, and the device may be integrated in an electronic device, such as a server.
In particular, the data storage method may be performed by a proxy server in a data storage system. Fig. 1b is a schematic structural diagram of a data storage system according to an embodiment of the present invention. As shown in fig. 1b, the data storage system comprises: a load balancing server 110, at least one server cluster 120, each server cluster 120 comprising a proxy server 121 and at least one storage server 122. The division of the zones may be done for a cluster of servers. The region may be an abstract concept, may be a cluster within a machine, a rack, or a building, and facilitates the overall expansion of the data storage system. Wherein:
the load balancing server 110 may be configured to distribute the user request to the proxy servers 121 in the server cluster 120. The user request may include a write data request or a read data request of the user. The distribution can be performed according to a certain preset rule, for example, a polling manner; alternatively, there may be a mapping relationship between the user and the proxy server, such as a mapping relationship between the geographical location of the user and the area covered by the proxy server; or may be in a random manner, etc.
The server cluster 120 includes a proxy server 121 and at least one storage server 122 that can decouple the interface service from the data storage service. The proxy server 121 is used for processing the request of the user. The storage server 122 is used for storing or reading data. The NAS storage mode in the prior art can be separated into a special interface service and a data storage service through the arrangement of the server cluster. When the storage server 122 is fully loaded, a new storage server 122 may be added to implement the data storage expansion. When the storage device is added, the data migration is carried out without updating the NAS. When there are many requests from the user, the proxy server 121 can be added to perform horizontal expansion to balance the load.
Specifically, as shown in fig. 1a, the method specifically includes:
The user request may include various information. For example, the user request may include a user access object name, a user access data identifier, data, and the like. For example, the data writing request may include a user access object name, a user access data identifier, and update data corresponding to the data of the user access data identifier. The data may be structured data or unstructured data. Specifically, the data may be pictures, documents, audio or video, and the like.
Illustratively, when the user request is a Hypertext Transfer Protocol (HTTP) request, the object name may be a Uniform Resource Locator (URL) corresponding to the HTTP request; or it may be information following the domain name in the URL, such as after com.
The storage server number may be number information of the corresponding storage server. The manner of obtaining the plurality of storage server numbers by performing request processing according to the object name may be various. For example, the number may be obtained in such a way that a mapping relationship exists between the object name and the storage server number. For the same object name, or multiple object names, there may be at least three storage server numbers that are fixed. Illustratively, the object names a and B may each correspond to storage server numbers d0, d8, and d 16.
Alternatively, the manner of acquiring the number may be processing the object name, such as digitizing. The corresponding storage server number may be determined according to the result of the digitization process.
In this embodiment, the storage server corresponding to each storage server number obtained by request processing is deployed in different server clusters. Multiple storage servers can be determined, multiple backups of data can be achieved, and therefore reliability of the data is improved. Meanwhile, the redundancy of the highest level can be realized in a mode that the determined storage data device is deployed in different server clusters. For example, when each server cluster is deployed in different regions, multi-region quick access of users to data can be realized.
In an optional implementation manner of the embodiment of the present invention, when a data writing request issued by a load balancing server is received, obtaining an object name in the data writing request to perform request processing, and obtaining at least three storage server numbers, includes: performing numerical operation according to the object name in the data writing request to obtain a target numerical value corresponding to the object name; and shifting the target numerical value to obtain a partition index with a preset number, and determining the number of the storage server corresponding to the storage server partition matched with the partition index.
Fig. 1c is a schematic diagram of determining a storage server number according to an embodiment of the present invention. As shown in fig. 1c, the object name may be digitized to obtain a corresponding target value. The way of the numeralization operation may be various, and may be implemented by an algorithm, such as a hash algorithm, for example.
In an optional implementation manner of the embodiment of the present invention, performing a digitizing operation according to an object name in a data writing request to obtain a target value corresponding to the object name includes: and performing numerical operation by adopting a message digest algorithm according to the object name in the data writing request to obtain a target numerical value corresponding to the object name.
The fifth version of the Message Digest Algorithm (Message-Digest Algorithm 5, MD5) may change the object name operation to a fixed length value. The main steps of the MD5 algorithm include padding the data length of the object name by 1 and/or 0, recording the data length of the object name, loading a standard magic number, and four rounds of loop operations. The MD5 algorithm can prevent data from being tampered with, directly seeing plaintext, repudiation and the like. In the embodiment of the invention, through the MD5 algorithm, data related to multiple requests of the same object by a user can be written or read in a fixed storage server.
The target value may be a fixed length value. As shown in fig. 1c, the length of the target value may exceed the number of bits of the partition index. Thus, a shift operation, e.g. removal to the right, may be performed on the target value. And obtaining the partition index with preset digit after removing. The number of preset bits may be related to the number of partitions, for example, the number represented by the number of preset bits may satisfy the requirement of the number of partitions. Illustratively, the number of partitions is 8, the preset number of bits may be 3 bits, and the partition index may be represented in a binary manner.
The partition index is used to represent the partition of the storage server. Partitioning may be an abstract concept. The partitions may be partitions of the storage servers. In the embodiment of the present invention, the partition needs to satisfy: each storage server partition corresponds to at least three storage servers in different server clusters, all storage server partitions correspond to all storage servers, and the storage servers corresponding to any two storage server partitions are not repeated. The number of partitions may be related to the total number of storage servers and the number of storage servers in each partition.
Illustratively, as shown in FIG. 1c, for server cluster z1, z2 and z 3. There are 8 memory devices in each server cluster. For example, there are storage servers d0, d1, …, d7 in z 1; z2 has storage servers d8, d9, …, d 15; z3 has storage servers d16, d17, …, d 23. The partitions may be established according to the deployment of the storage servers.
For example, partitions p0, p1, …, p7 may be established where there may be a mapping table between the partitions and the storage server numbers. For example, it may be that partition p0 has a mapping with storage server numbers d0, d8, and d 16; it may be that partition p1 has a mapping with storage server numbers d1, d9, and d 17; by analogy, as shown in FIG. 1c, it may be that partition p7 has a mapping with storage server numbers d7, d15, and d 23. The preset number of bits may be 3, and the partitions p0, p1, … and p7 may be represented by binary.
As shown in FIG. 1c, the partition index is 000, and may correspond to partition p0, the corresponding storage server numbers may be d0, d8, and d16, and the corresponding storage servers are deployed in server clusters z1, z2, and z3, respectively.
In an optional implementation manner of the embodiment of the present invention, a structure of data corresponding to the write data request is a flat structure; the data of the flat structure comprises a key value and a numerical value, the key value corresponds to the number of the storage server, and the numerical value is real data corresponding to a data writing request or a data reading request.
When data is written by a user, the data can be written in a key value-numerical value mode; when data is read, the data can be searched according to the key value. The method can avoid maintaining a huge file directory table, performs data management in a metadata retrieval mode, only maintains the key value-numerical value relation for data query, avoids the multi-level relation in the traditional data storage system, simplifies the data query process, and meets the requirement of data management more easily.
And step 220, respectively sending the data writing request to the storage servers corresponding to the storage server numbers so that the storage servers perform data writing operation in the data writing request.
The storage server can acquire the data in the data writing request and perform data updating operation corresponding to the user access object. The storage servers in different service clusters store the same data, so that multiple backups of the data can be realized, and the reliability of the data is improved. The data storage mode can be a mode of saving the data in a file form to a disk in a storage server.
In an implementation manner of the embodiment of the present invention, optionally, the sending the write data request to the storage servers corresponding to the storage server numbers respectively, so that each storage server performs a write operation of data in the write data request, where the write operation includes: respectively sending the data writing request to a first storage server corresponding to the first target number set so as to enable the first storage server to perform data writing operation in the data writing request; and respectively sending the first target number set to a second storage server corresponding to the second target number set so as to enable the second storage server to perform data synchronization operation with the first storage server.
The first target number set comprises at least two storage server numbers, and the second target number set does not comprise the first target number set. For example, as shown in fig. 1c, the first target number set may include any two of d0, d8, and d16, and the second target number set may include storage server numbers of d0, d8, and d16 that are left by excluding elements in the first target set. For example, the first set of target numbers includes d8 and d16, and the second set of target numbers includes d 0.
The first storage server may be a write-type storage of data; the second storage server may be a synchronized form of storage of the data. Where the synchronization may be running in the background. When the first storage server realizes successful writing, feedback can be carried out to the proxy server, and the proxy server can feed back a writing success indication to a user through the load balancer. The data writing speed can be improved through the synchronous writing and background mode, so that a user can quickly obtain feedback, and the time delay is reduced.
In an implementation manner of the embodiment of the present invention, optionally, the sending the write data request to the storage servers corresponding to the storage server numbers respectively, so that each storage server performs a write operation of data in the write data request, where the write operation includes: and sending the data in the data writing request and the verification result corresponding to the data to a storage server corresponding to at least one storage server number so that the storage server performs data writing operation in the data writing request.
In order to improve the reliability of data storage, data can be recovered when the data is lost or damaged or other abnormalities occur. In the embodiment of the invention, the data can be verified, and the data and the verification result are stored in the storage server together. The check result may be used to recover the data. For example, when there is a partial loss of data, the lost data can be recovered by the check result and the data that is not lost. The verification result may be generated by verifying the data through an erasure code technique, such as erasure code encoding.
The data and the verification result can be stored in any storage server corresponding to the determined storage number, so that a small amount of storage space can be occupied, and the fault tolerance of the data can be improved. Or, the data and the verification result can be stored in all storage servers corresponding to the determined storage numbers, so that the fault tolerance of the data can be further improved. Alternatively, the data and the verification result may be stored in a plurality of storage servers corresponding to the determined storage numbers, instead of all the storage servers, so that a certain coordination between the occupation of the storage space and the fault tolerance capability can be obtained.
According to the technical scheme of the embodiment, when a data writing request issued by a load balancing server is received, an object name in the data writing request is acquired to perform request processing, and at least three storage server numbers are obtained; the storage servers corresponding to the storage server numbers are all deployed in different server clusters; the data writing requests are respectively sent to the storage servers corresponding to the storage server numbers, so that the storage servers perform data writing operation in the data writing requests, the storage problem of unstructured data in the financial field is solved, the decoupling of the interface service and the data storage service is realized, the storage of a large amount of unstructured data is easily expanded, the data is subjected to multiple backup, and the reliability and the fault tolerance of the data can be improved.
Example two
Fig. 2 is a flowchart of a data storage method according to a second embodiment of the present invention. The present embodiment is a further refinement of the above technical solutions, and the technical solutions in the present embodiment may be combined with various alternatives in one or more of the above embodiments. As shown in fig. 2, the method includes:
and 310, when a data writing request issued by the load balancing server is received, performing a digitizing operation according to the object name in the data writing request to obtain a target value corresponding to the object name.
In an optional implementation manner of the embodiment of the present invention, performing a digitizing operation according to an object name in a data writing request to obtain a target value corresponding to the object name includes: and carrying out numerical operation by adopting an MD5 algorithm according to the object name in the data writing request to obtain a target numerical value corresponding to the object name.
And 320, performing shifting operation on the target numerical value to obtain a partition index with a preset number, and determining a storage server number corresponding to a storage server partition matched with the partition index.
Each storage server partition corresponds to at least three storage servers in different server clusters, all the storage server partitions correspond to all the storage servers, and the storage servers corresponding to any two storage server partitions are not repeated.
And step 330, sending the data writing request to the first storage servers corresponding to the first target number set respectively, so that the first storage servers perform data writing operation in the data writing request.
In an optional implementation manner of the embodiment of the present invention, sending the data writing requests to the first storage servers corresponding to the first target number sets respectively includes: and respectively sending the data in the data writing request and the verification result corresponding to the data to the first storage server corresponding to the first target number set.
In an optional implementation manner of the embodiment of the present invention, a structure of data corresponding to the write data request is a flat structure; the data of the flat structure comprises a key value and a numerical value, the key value corresponds to the number of the storage server, and the numerical value is real data corresponding to a data writing request or a data reading request.
And 340, respectively sending the first target number sets to second storage servers corresponding to the second target number sets, so that the second storage servers perform data synchronization operation with the first storage servers.
The first target number set comprises at least two storage server numbers, and the second target number set does not comprise the first target number set.
And step 350, when a data reading request issued by the load balancing server is received, acquiring an object name in the data reading request to perform request processing, and obtaining at least three storage server numbers.
The process of determining the number of the storage server according to the read data request is similar to the process of determining the number of the storage server according to the write data request, and both refer to the process shown in fig. 1c, which is not described herein again. It should be noted that, when a user makes a data writing request or a data reading request for the same object, the determined numbers of the storage servers are the same, which can ensure that the storage servers corresponding to the read-write data of the same object are fixed by the user, and can effectively query or update the data.
And 360, respectively reading the data corresponding to the read data request in the storage servers corresponding to the at least two storage server numbers.
When a user inquires data, the proxy server can read the data in the at least two storage servers corresponding to the data reading request. The reliability of data can be ensured based on the reading of multi-copy data. For example, whether the data is the latest version may be determined by time stamp on the read data, and the latest version of the data may be determined as the data corresponding to the read data request.
In an optional implementation manner of the embodiment of the present invention, respectively reading data corresponding to a read data request in storage servers corresponding to at least two storage server numbers includes: acquiring at least two alternative data corresponding to the read data request in the storage servers corresponding to the at least two storage server numbers; if all the alternative data are consistent, reading the data by taking the alternative data as target data; otherwise, acquiring alternative data corresponding to the read data request in the storage servers corresponding to the at least one remaining storage server number, performing consistency judgment on each alternative data, acquiring the alternative data with the highest consistency as target data, and performing data reading operation.
In order to further improve the reliability of the query data, the data consistency judgment can be performed on the at least two read candidate data. The consistency judgment may be to determine whether the time stamp information of the data and the update information of the data are consistent. If the alternative data of the different copies are read consistently, the alternative data can be used as target data. If the read alternative data of different copies are not consistent, a new copy can be obtained again for data reading to obtain new alternative data, and consistency judgment is carried out to determine target data. The reliability of data reading can be improved through reading of multi-copy data and consistency judgment. In addition, for inconsistent data, data synchronization can be performed in a background synchronization mode, so that the consistency of data storage is ensured, and the reliability of data in the next query is facilitated.
In an optional implementation manner of the embodiment of the present invention, a structure of data corresponding to the read data request is a flat structure; the data of the flat structure comprises a key value and a numerical value, the key value corresponds to the number of the storage server, and the numerical value is real data corresponding to a data writing request or a data reading request. The data is written and read through the flat structure, and the data query process can be simplified.
According to the technical scheme of the embodiment, when a data writing request issued by a load balancing server is received, a numerical operation is carried out according to an object name in the data writing request to obtain a target numerical value corresponding to the object name; shifting the target numerical value to obtain a partition index with a preset number, and determining a storage server number corresponding to a storage server partition matched with the partition index; respectively sending the data writing request to a first storage server corresponding to the first target number set so as to enable the first storage server to perform data writing operation in the data writing request; respectively sending the first target number set to a second storage server corresponding to a second target number set so as to enable the second storage server to perform data synchronization operation with the first storage server; when a data reading request issued by a load balancing server is received, acquiring an object name in the data reading request to perform request processing, and obtaining at least three storage server numbers; the data corresponding to the read data request in the storage servers corresponding to the at least two storage server numbers are respectively read, the storage and query problems of unstructured data in the financial field are solved, the decoupling of the interface service and the data storage service is realized, the storage of a large amount of unstructured data is easily realized in an expanded mode, the data are subjected to multiple backup, and the reliability and the fault tolerance during data query can be improved.
EXAMPLE III
The embodiment of the invention provides a data storage system. As shown in fig. 1b, the data storage system comprises: a load balancing server 110, at least one server cluster 120, each server cluster comprising a proxy server 121 and at least one storage server 122. Wherein:
the load balancing server 110 is configured to obtain a data writing request of a user, and distribute the data writing request to a proxy server for request processing. The load balancing server 110 may communicate with the client to obtain the user's request or feed back the result to the user.
The proxy server 121 is configured to, when receiving a write data request issued by the load balancing server, obtain an object name in the write data request to perform request processing, and obtain at least three storage server numbers; and the data writing request is respectively sent to the storage servers corresponding to the storage server numbers. And the storage server corresponding to each storage server number is deployed in different server clusters.
Optionally, the proxy server 121 and the load balancer 110 may be connected through an interface. For example, it may be a RESTful application program interface of the HTTP protocol. The interface protocol is simple and the use is convenient. The user can conveniently acquire, create, modify, delete and the like the data through the interface connection. The user needs to adopt a customized client in an interface mode, and the use is light.
And the storage server 122 is configured to store the data in the write data request when receiving the write data request sent by the proxy server. Data synchronization may be performed for the storage servers 122 between different server clusters, for example, data synchronization may be performed by remote access. The proxy server can write and/or read data with the storage server in a remote access mode.
Optionally, the proxy server is specifically configured to: performing numerical operation according to the object name in the data writing request to obtain a target numerical value corresponding to the object name; and shifting the target numerical value to obtain a partition index with a preset number, and determining the number of the storage server corresponding to the storage server partition matched with the partition index.
Each storage server partition corresponds to at least three storage servers in different server clusters, all the storage server partitions correspond to all the storage servers, and the storage servers corresponding to any two storage server partitions are not repeated.
Optionally, the proxy server is specifically configured to: and carrying out numerical operation by adopting an MD5 algorithm according to the object name in the data writing request to obtain a target numerical value corresponding to the object name.
Optionally, the proxy server is specifically configured to: respectively sending the data writing request to a first storage server corresponding to the first target number set; the first storage server is used for storing the data in the data writing request according to the data writing request; the proxy server is specifically used for respectively sending the first target number sets to second storage servers corresponding to the second target number sets; and the second storage server is used for carrying out data synchronization operation with the first storage server according to the first target number set.
The first target number set comprises at least two storage server numbers, and the second target number set does not comprise the first target number set.
Optionally, the proxy server is specifically configured to: sending the data in the data writing request and a verification result corresponding to the data to a storage server corresponding to at least one storage server number; and the storage server is used for storing the data in the data writing request and the verification result corresponding to the data.
Optionally, the load balancing server is further configured to: and acquiring a data reading request of a user, and distributing the data reading request to a proxy server for request processing.
Optionally, the proxy server is further configured to, when receiving a data reading request issued by the load balancing server, obtain an object name in the data reading request to perform request processing, and obtain at least three storage server numbers; and respectively reading the data corresponding to the read data request in the storage servers corresponding to the at least two storage server numbers.
Optionally, the proxy server is specifically configured to: acquiring at least two alternative data corresponding to the read data request in the storage servers corresponding to the at least two storage server numbers; if all the alternative data are consistent, reading the data by taking the alternative data as target data; otherwise, acquiring alternative data corresponding to the read data request in the storage servers corresponding to the at least one remaining storage server number, performing consistency judgment on each alternative data, acquiring the alternative data with the highest consistency as target data, and performing data reading operation.
The proxy server in the data storage system provided by the embodiment of the invention can execute the data storage method provided by any embodiment of the invention, and has corresponding beneficial effects of the execution method.
Example four
Fig. 3 is a schematic structural diagram of a data storage device according to a fourth embodiment of the present invention. The data storage device is executed by a proxy server in a data storage system, the data storage system comprising: the system comprises a load balancing server and at least one server cluster, wherein each server cluster comprises a proxy server and at least one storage server. With reference to fig. 3, the apparatus comprises: a number acquisition module 410 and a write data request transmission module 420. Wherein:
a number obtaining module 410, configured to, when a data writing request issued by a load balancing server is received, obtain an object name in the data writing request to perform request processing, so as to obtain at least three storage server numbers;
the storage servers corresponding to the storage server numbers are all deployed in different server clusters;
and a write data request sending module 420, configured to send the write data request to the storage servers corresponding to the storage server numbers, respectively, so that each storage server performs a write operation on the data in the write data request.
Optionally, the number obtaining module 410 includes:
the target numerical value determining unit is used for performing numerical operation according to the object name in the data writing request to obtain a target numerical value corresponding to the object name;
the storage server number determining unit is used for carrying out shifting operation on the target numerical value to obtain a partition index with a preset number, and determining the number of the storage server corresponding to the storage server partition matched with the partition index;
each storage server partition corresponds to at least three storage servers in different server clusters, all the storage server partitions correspond to all the storage servers, and the storage servers corresponding to any two storage server partitions are not repeated.
Optionally, the target value determining unit is specifically configured to:
and carrying out numerical operation by adopting an MD5 algorithm according to the object name in the data writing request to obtain a target numerical value corresponding to the object name.
Optionally, the write data request sending module 420 includes:
the data writing request sending unit is used for respectively sending the data writing requests to the first storage servers corresponding to the first target number sets so that the first storage servers perform data writing operation in the data writing requests;
the number sending unit is used for respectively sending the first target number set to a second storage server corresponding to a second target number set so as to enable the second storage server to perform data synchronization operation with the first storage server;
the first target number set comprises at least two storage server numbers, and the second target number set does not comprise the first target number set.
Optionally, the write data request sending module 420 includes:
and the data and verification result sending unit is used for sending the data in the data writing request and the verification result corresponding to the data to the storage server corresponding to the at least one storage server number so as to enable the storage server to write the data in the data writing request.
Optionally, the apparatus further includes:
the second number acquisition module is used for acquiring the object name in the data reading request to perform request processing when receiving the data reading request issued by the load balancing server, so as to obtain the numbers of at least three storage servers;
and the data reading module is used for respectively reading data corresponding to the read data request in the storage servers corresponding to the at least two storage server numbers.
Optionally, the data reading module is specifically configured to:
acquiring at least two alternative data corresponding to the read data request in the storage servers corresponding to the at least two storage server numbers;
if all the alternative data are consistent, reading the data by taking the alternative data as target data;
otherwise, acquiring alternative data corresponding to the read data request in the storage servers corresponding to the at least one remaining storage server number, performing consistency judgment on each alternative data, acquiring the alternative data with the highest consistency as target data, and performing data reading operation.
Optionally, the structure of data corresponding to the data writing request or the data reading request is a flat structure;
the data of the flat structure comprises a key value and a numerical value, the key value corresponds to the number of the storage server, and the numerical value is real data corresponding to a data writing request or a data reading request.
The data storage device provided by the embodiment of the invention can execute the data storage method provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method.
EXAMPLE five
Fig. 4 is a schematic structural diagram of an electronic device according to a fifth embodiment of the present invention, and as shown in fig. 4, the electronic device includes:
one or more processors 510, one processor 510 being illustrated in FIG. 4;
a memory 520;
the apparatus may further include: an input device 530 and an output device 540.
The processor 510, the memory 520, the input device 530 and the output device 540 of the apparatus may be connected by a bus or other means, and fig. 4 illustrates the connection by a bus as an example.
The memory 520, which is a non-transitory computer-readable storage medium, may be used to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to a data storage method in an embodiment of the present invention (for example, the number obtaining module 410 and the write data request sending module 420 shown in fig. 3). The processor 510 executes various functional applications and data processing of the computer device by executing software programs, instructions and modules stored in the memory 520, namely, a data storage method for implementing the above method embodiments, that is:
when a data writing request issued by a load balancing server is received, acquiring an object name in the data writing request to perform request processing, and acquiring at least three storage server numbers;
the storage server corresponding to each storage server number is deployed in different server clusters;
and respectively sending the data writing request to the storage servers corresponding to the storage server numbers so as to enable the storage servers to write data in the data writing request.
The memory 520 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the computer device, and the like. Further, the memory 520 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, memory 520 may optionally include memory located remotely from processor 510, which may be connected to a terminal device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device 530 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the computer apparatus. The output device 540 may include a display device such as a display screen.
EXAMPLE six
A sixth embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a data storage method according to an embodiment of the present invention:
when a data writing request issued by a load balancing server is received, acquiring an object name in the data writing request to perform request processing, and acquiring at least three storage server numbers;
the storage server corresponding to each storage server number is deployed in different server clusters;
and respectively sending the data writing request to the storage servers corresponding to the storage server numbers so as to enable the storage servers to write data in the data writing request.
Any combination of one or more computer-readable media may be employed. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (18)
1. A data storage method performed by a proxy server in a data storage system, the data storage system comprising: the system comprises a load balancing server and at least one server cluster, wherein each server cluster comprises a proxy server and at least one storage server; characterized in that the method comprises:
when a data writing request issued by a load balancing server is received, acquiring an object name in the data writing request to perform request processing, and acquiring at least three storage server numbers;
the storage server corresponding to each storage server number is deployed in different server clusters;
and respectively sending the data writing request to the storage servers corresponding to the storage server numbers so as to enable the storage servers to write data in the data writing request.
2. The method of claim 1, wherein when receiving a write data request issued by a load balancing server, acquiring an object name in the write data request to perform request processing, and obtaining at least three storage server numbers, comprises:
performing numerical operation according to the object name in the data writing request to obtain a target numerical value corresponding to the object name;
shifting the target numerical value to obtain a partition index with a preset number, and determining a storage server number corresponding to a storage server partition matched with the partition index;
each storage server partition corresponds to at least three storage servers in different server clusters, all the storage server partitions correspond to all the storage servers, and the storage servers corresponding to any two storage server partitions are not repeated.
3. The method of claim 2, wherein performing a digitizing operation according to an object name in the write data request to obtain a target value corresponding to the object name comprises:
and performing numerical operation by adopting a message digest algorithm MD5 according to the object name in the data writing request to obtain a target numerical value corresponding to the object name.
4. The method of claim 1, wherein sending the write data request to the storage servers corresponding to the storage server numbers respectively to enable the storage servers to perform a write operation of data in the write data request comprises:
the data writing requests are respectively sent to first storage servers corresponding to a first target number set, so that the first storage servers perform data writing operation in the data writing requests;
respectively sending the first target number set to a second storage server corresponding to a second target number set so as to enable the second storage server to perform data synchronization operation with the first storage server;
wherein the first target number set includes at least two storage server numbers, and the second target number set does not include the first target number set.
5. The method of claim 1, wherein sending the write data request to the storage servers corresponding to the storage server numbers respectively to enable the storage servers to perform a write operation of data in the write data request comprises:
and sending the data in the data writing request and the verification result corresponding to the data to a storage server corresponding to at least one storage server number so that the storage server performs data writing operation in the data writing request.
6. The method of any one of claims 1-5, further comprising:
when a data reading request issued by a load balancing server is received, acquiring an object name in the data reading request to perform request processing, and obtaining at least three storage server numbers;
and respectively reading data corresponding to the read data request in the storage servers corresponding to the at least two storage server numbers.
7. The method according to claim 6, wherein reading the data corresponding to the read data request in the storage servers corresponding to at least two storage server numbers respectively comprises:
acquiring at least two alternative data corresponding to the read data request in the storage servers corresponding to the at least two storage server numbers;
if all the alternative data are consistent, taking the alternative data as target data to perform data reading operation;
otherwise, acquiring the alternative data corresponding to the read data request in the storage server corresponding to the number of the remaining at least one storage server, performing consistency judgment on each alternative data, acquiring the alternative data with the highest consistency as the target data, and performing data reading operation.
8. The method of claim 6, wherein the structure of the data corresponding to the write data request or the read data request is a flat structure;
the data of the flat structure comprises a key value and a numerical value, the key value corresponds to the number of the storage server, and the numerical value is real data corresponding to the write data request or the read data request.
9. A data storage system, comprising: the system comprises a load balancing server and at least one server cluster, wherein each server cluster comprises a proxy server and at least one storage server;
the load balancing server is used for acquiring a data writing request of a user and distributing the data writing request to a proxy server for request processing;
the proxy server is used for acquiring an object name in a data writing request for request processing when receiving the data writing request issued by the load balancing server, and acquiring at least three storage server numbers; the data writing request is respectively sent to the storage servers corresponding to the storage server numbers;
the storage server corresponding to each storage server number is deployed in different server clusters;
and the storage server is used for storing the data in the data writing request when receiving the data writing request sent by the proxy server.
10. The system of claim 9, wherein the proxy server is specifically configured to:
performing numerical operation according to the object name in the data writing request to obtain a target numerical value corresponding to the object name;
shifting the target numerical value to obtain a partition index with a preset number, and determining a storage server number corresponding to a storage server partition matched with the partition index;
each storage server partition corresponds to at least three storage servers in different server clusters, all the storage server partitions correspond to all the storage servers, and the storage servers corresponding to any two storage server partitions are not repeated.
11. The system of claim 10, wherein the proxy server is specifically configured to:
and performing numerical operation by adopting a message digest algorithm MD5 according to the object name in the data writing request to obtain a target numerical value corresponding to the object name.
12. The system of claim 9, wherein the proxy server is specifically configured to:
the data writing requests are respectively sent to first storage servers corresponding to the first target number sets;
the first storage server is used for storing the data in the data writing request according to the data writing request;
the proxy server is further specifically configured to send the first target number sets to second storage servers corresponding to second target number sets respectively;
the second storage server is used for carrying out data synchronization operation with the first storage server according to the first target number set;
wherein the first target number set includes at least two storage server numbers, and the second target number set does not include the first target number set.
13. The system of claim 9, wherein the proxy server is specifically configured to:
sending the data in the data writing request and a verification result corresponding to the data to a storage server corresponding to at least one storage server number;
and the storage server is used for storing the data in the data writing request and the verification result corresponding to the data.
14. The system according to any of claims 9-13, wherein the load balancing server is further configured to:
acquiring a data reading request of a user, and distributing the data reading request to a proxy server for request processing;
the proxy server is also used for acquiring an object name in a data reading request for request processing when receiving the data reading request issued by the load balancing server, and acquiring at least three storage server numbers; and respectively reading data corresponding to the read data request in the storage servers corresponding to the at least two storage server numbers.
15. The system of claim 14, wherein the proxy server is specifically configured to:
acquiring at least two alternative data corresponding to the read data request in the storage servers corresponding to the at least two storage server numbers;
if all the alternative data are consistent, taking the alternative data as target data to perform data reading operation;
otherwise, acquiring the alternative data corresponding to the read data request in the storage server corresponding to the number of the remaining at least one storage server, performing consistency judgment on each alternative data, acquiring the alternative data with the highest consistency as the target data, and performing data reading operation.
16. A data storage device for execution by a proxy server in a data storage system, the data storage system comprising: the system comprises a load balancing server and at least one server cluster, wherein each server cluster comprises a proxy server and at least one storage server; characterized in that the device comprises:
the number acquisition module is used for acquiring an object name in a data writing request for request processing when the data writing request issued by a load balancing server is received, and acquiring the numbers of at least three storage servers;
the storage server corresponding to each storage server number is deployed in different server clusters;
and the data writing request sending module is used for sending the data writing request to the storage servers corresponding to the storage server numbers respectively so as to enable the storage servers to write data in the data writing request.
17. An electronic device, comprising:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-8.
18. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110158232.XA CN112866406B (en) | 2021-02-04 | 2021-02-04 | Data storage method, system, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110158232.XA CN112866406B (en) | 2021-02-04 | 2021-02-04 | Data storage method, system, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112866406A true CN112866406A (en) | 2021-05-28 |
| CN112866406B CN112866406B (en) | 2023-03-24 |
Family
ID=75988963
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110158232.XA Active CN112866406B (en) | 2021-02-04 | 2021-02-04 | Data storage method, system, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112866406B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113590595A (en) * | 2021-09-30 | 2021-11-02 | 苏州浪潮智能科技有限公司 | Database multi-writing method and device and related equipment |
| CN117134918A (en) * | 2023-07-20 | 2023-11-28 | 威艾特科技(深圳)有限公司 | Distributed data signature verification method and device |
| CN117240917A (en) * | 2023-11-08 | 2023-12-15 | 阿里云计算有限公司 | Cache type cloud storage system, data read-write method, equipment and storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080282044A1 (en) * | 2007-05-09 | 2008-11-13 | Mitsuhiro Kimura | Data control system, control server, data control method, and program |
| CN103369051A (en) * | 2013-07-22 | 2013-10-23 | 中安消技术有限公司 | Data server cluster system and data synchronization method |
| CN104202375A (en) * | 2014-08-22 | 2014-12-10 | 广州华多网络科技有限公司 | Method and system for synchronous data |
| CN104378423A (en) * | 2014-11-13 | 2015-02-25 | 普华基础软件股份有限公司 | Metadata cluster distribution storage system and storage data reading and writing method |
| CN104679896A (en) * | 2015-03-18 | 2015-06-03 | 成都金本华科技股份有限公司 | Intelligent retrieval method under big data environment |
| CN109327539A (en) * | 2018-11-15 | 2019-02-12 | 上海天玑数据技术有限公司 | A kind of distributed block storage system and its data routing method |
| WO2019127915A1 (en) * | 2017-12-29 | 2019-07-04 | 北京奇虎科技有限公司 | Distributed consensus protocol-based data reading method and apparatus |
| CN110399097A (en) * | 2019-06-25 | 2019-11-01 | 苏州浪潮智能科技有限公司 | A kind of inspection method and device of distributed memory system data consistency |
| CN111031096A (en) * | 2019-11-15 | 2020-04-17 | 华东计算技术研究所（中国电子科技集团公司第三十二研究所） | Distributed storage system construction method based on mimicry defense |
| CN111343277A (en) * | 2020-03-04 | 2020-06-26 | 腾讯科技（深圳）有限公司 | Distributed data storage method, system, computer device and storage medium |
-
2021
- 2021-02-04 CN CN202110158232.XA patent/CN112866406B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080282044A1 (en) * | 2007-05-09 | 2008-11-13 | Mitsuhiro Kimura | Data control system, control server, data control method, and program |
| CN103369051A (en) * | 2013-07-22 | 2013-10-23 | 中安消技术有限公司 | Data server cluster system and data synchronization method |
| CN104202375A (en) * | 2014-08-22 | 2014-12-10 | 广州华多网络科技有限公司 | Method and system for synchronous data |
| CN104378423A (en) * | 2014-11-13 | 2015-02-25 | 普华基础软件股份有限公司 | Metadata cluster distribution storage system and storage data reading and writing method |
| CN104679896A (en) * | 2015-03-18 | 2015-06-03 | 成都金本华科技股份有限公司 | Intelligent retrieval method under big data environment |
| WO2019127915A1 (en) * | 2017-12-29 | 2019-07-04 | 北京奇虎科技有限公司 | Distributed consensus protocol-based data reading method and apparatus |
| CN109327539A (en) * | 2018-11-15 | 2019-02-12 | 上海天玑数据技术有限公司 | A kind of distributed block storage system and its data routing method |
| CN110399097A (en) * | 2019-06-25 | 2019-11-01 | 苏州浪潮智能科技有限公司 | A kind of inspection method and device of distributed memory system data consistency |
| CN111031096A (en) * | 2019-11-15 | 2020-04-17 | 华东计算技术研究所（中国电子科技集团公司第三十二研究所） | Distributed storage system construction method based on mimicry defense |
| CN111343277A (en) * | 2020-03-04 | 2020-06-26 | 腾讯科技（深圳）有限公司 | Distributed data storage method, system, computer device and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 赵春扬等: "一致性协议在分布式数据库系统中的应用", 《华东师范大学学报(自然科学版)》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113590595A (en) * | 2021-09-30 | 2021-11-02 | 苏州浪潮智能科技有限公司 | Database multi-writing method and device and related equipment |
| WO2023050706A1 (en) * | 2021-09-30 | 2023-04-06 | 苏州浪潮智能科技有限公司 | Database multi-write method and apparatus, and related device |
| CN117134918A (en) * | 2023-07-20 | 2023-11-28 | 威艾特科技(深圳)有限公司 | Distributed data signature verification method and device |
| CN117134918B (en) * | 2023-07-20 | 2024-09-24 | 威艾特科技(深圳)有限公司 | Distributed data signature verification method and device |
| CN117240917A (en) * | 2023-11-08 | 2023-12-15 | 阿里云计算有限公司 | Cache type cloud storage system, data read-write method, equipment and storage medium |
| CN117240917B (en) * | 2023-11-08 | 2024-04-05 | 阿里云计算有限公司 | Cache-type cloud storage system, data reading and writing method, device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112866406B (en) | 2023-03-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11985192B2 (en) | Synchronized content library | |
| JP6778795B2 (en) | Methods, devices and systems for storing data | |
| US7793112B2 (en) | Access to content addressable data over a network | |
| AU757667B2 (en) | Access to content addressable data over a network | |
| CN108683668B (en) | Resource checking method, device, storage medium and equipment in content distribution network | |
| CN112866406B (en) | Data storage method, system, device, equipment and storage medium | |
| CN104348859B (en) | File synchronisation method, device, server, terminal and system | |
| CN111225003B (en) | NFS node configuration method and device | |
| CN111338834B (en) | Data storage method and device | |
| US9509509B2 (en) | Random identifier generation for offline database | |
| CN108540510B (en) | A cloud host creation method, device and cloud service system | |
| CN118192897A (en) | Data storage system, method and device | |
| CN113535478B (en) | Data backup methods and devices, storage media and electronic equipment | |
| CN114490128A (en) | Data storage method and device under remote multi-active architecture | |
| EP3349416B1 (en) | Relationship chain processing method and system, and storage medium | |
| CN115510000B (en) | File merging method, device, electronic equipment, storage medium and program product | |
| CN114422538B (en) | Multi-cloud storage system, multi-cloud data reading and writing method and electronic equipment | |
| CN114547678A (en) | Risk control method and device | |
| CN114691727A (en) | A data processing method, device, system, electronic device and storage medium | |
| CN119363761B (en) | Resource transmission method, device, equipment and storage medium | |
| CN114338692A (en) | Data balancing method and equipment based on fragment cluster expansion | |
| CN118503325A (en) | Data processing method, apparatus, computer device, storage medium, and program product | |
| CN119003649A (en) | Data processing method and device | |
| CN118802887A (en) | A collaborative document processing method, device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20220920 Address after: 25 Financial Street, Xicheng District, Beijing 100033 Applicant after: CHINA CONSTRUCTION BANK Corp. Address before: 12 / F, 15 / F, 99 Yincheng Road, China (Shanghai) pilot Free Trade Zone, Pudong New Area, Shanghai, 200120 Applicant before: Jianxin Financial Science and Technology Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |