CN114968963A - File overwriting method, device and electronic device - Google Patents

Abstract

The invention provides a method and a device for overwriting a file and electronic equipment, wherein the method comprises the following steps: acquiring an overwriting instruction; the overwrite write instruction includes at least: the method comprises the steps that a file identifier of a target file needing to be overwritten, a storage position identifier of overwriting content and an overwriting position are obtained; and according to the overwriting instruction, writing the overwriting content into the overwriting position in the target file. According to the method, based on the data contained in the overwriting instruction, the overwriting content is written into the target file at the storage position of the target file to be overwritten, and the target file does not need to be overwritten after being read out from the storage position, so that the data volume of reading and writing data is reduced, and the overwriting performance is improved.

Description

File overwriting method, device and electronic device

technical field

The present invention relates to the technical field of file storage, and in particular, to a file overwriting method, device and electronic device.

Background technique

In the related art, the way of writing to a file in a distributed file system usually only supports append writing, and does not support overwriting. In order to overwrite the files in the distributed file system, the user usually needs to read the file to be overwritten from the distributed file system through the terminal device, and then the file to be overwritten and the preset overwrite write in the terminal device. The contents are merged, the merged file is written into the distributed file system, and the original file corresponding to the file to be overwritten in the distributed file system is deleted, so as to complete the overwrite of the file to be overwritten. However, when overwriting the file in this method, it needs to read the file in the distributed file system to the local terminal device to merge the file, and also write the local merged file into the distributed file system again, resulting in The amount of data read and written is large, which affects the overwrite performance.

SUMMARY OF THE INVENTION

The purpose of the present invention is to provide a file overwriting method, device and electronic device, so as to reduce the amount of data read and write when overwriting a file and improve the overwriting performance.

In a first aspect, an embodiment of the present invention provides a method for overwriting a file. The method includes: acquiring an overwriting instruction; wherein the overwriting instruction at least includes: a file identifier of a target file to be overwritten, an overwriting content Storage location identification and overwrite location; according to the overwrite instruction, write the overwrite content to the overwrite location in the target file.

In an optional embodiment, the above-mentioned overwriting position includes: an overwriting start address and an overwriting length; wherein, the overwriting length is the same as the length of the overwriting content; the overwriting content is written according to the overwriting instruction above. The steps on the overwriting position in the target file include: determining the target file and the overwriting content according to the file identifier of the target file and the storage location identifier of the overwriting content; starting from the overwriting starting address in the target file, adding The content of the overwrite length in the target file is replaced with the overwrite content.

In an optional implementation manner, the above-mentioned overwriting instruction is stored in a designated database; the above-mentioned step of obtaining an overwriting instruction includes: judging whether there is an overwriting instruction in the designated database; if so, acquiring the overwriting instruction.

In an optional implementation manner, the above-mentioned target file that needs to be overwritten is stored in a preset distributed file system; the overwrite instruction in the specified database is obtained in the following manner: if an overwrite request sent by a user is received , extract the overwriting content, the overwriting location and the file identifier of the target file to be overwritten from the overwriting request; write the overwriting content into the distributed file system to obtain the storage location identifier of the overwriting content; splicing the target The file identifier of the file, the storage location identifier of the overwritten content, and the overwritten location are used to obtain an overwritten instruction of the target file; the overwritten instruction is stored in a designated database.

In an optional implementation manner, after the above step of writing the overwriting content to the overwriting position in the target file according to the overwriting instruction, the method further includes: deleting the overwriting instruction, and identifying the file corresponding to the storage position Overwrite content in .

In an optional embodiment, the above method further includes: receiving a read request of the target file sent by the user; judging whether there is an overwrite instruction of the target file in the specified database; if there is, according to the overwrite instruction of the target file, from the distribution Read the overwrite content and target file corresponding to the overwrite instruction in the file system, merge the overwrite content and the target file, and return the merged target file to the user; if it does not exist, from the distributed file system The target file is read in, and the read target file is returned to the user.

In an optional embodiment, the overwrite version number of the target file is stored in the above-mentioned distributed file system; after the above-mentioned step of writing the overwrite content into the distributed file system and obtaining the storage location identifier of the overwrite content, the The method further includes: receiving an overwrite version number of the target file returned by the distributed file system; writing the overwrite version number into an overwrite instruction; and writing the overwrite content into the overwrite instruction in the target file according to the overwrite instruction. After the step on the location, the method further includes: updating the overwrite version number in the distributed file system to the sum of the overwrite version number and one in the overwrite instruction.

In an optional embodiment, the above-mentioned target file includes a plurality of duplicate files; according to the overwrite instruction, the step of writing the overwrite content to the overwrite position in the target file includes: for each duplicate file of the target file, According to the overwriting instruction, the overwriting content is written to the overwriting position in the current copy file.

In an optional embodiment, the above method further includes: for each copy file of the target file, judging whether the overwriting content is successfully written to the overwriting position in the current copy file; if it is not successfully written, automatically repairing the current copy file, and rewrite the overwritten content to the current copy file until the current copy file is overwritten successfully.

In a second aspect, an embodiment of the present invention provides a file overwriting device, the device includes: an instruction acquisition module for acquiring an overwriting instruction; wherein the overwriting instruction at least includes: a file of a target file that needs to be overwritten Identify, identify the storage location of the overwrite content and the overwrite location; the overwrite module is used to write the overwrite content to the overwrite location in the target file according to the overwrite instruction.

In a third aspect, an embodiment of the present invention provides an electronic device, the electronic device includes a processor and a memory, where the memory stores machine-executable instructions that can be executed by the processor, and the processor executes the machine-executable instructions to implement the foregoing The file overwriting method according to any one of the embodiments.

In a fourth aspect, embodiments of the present invention provide a machine-readable storage medium, where the machine-readable storage medium stores machine-executable instructions, and when the machine-executable instructions are called and executed by a processor, the machine-executable instructions The processor is caused to implement the file overwriting method described in any one of the foregoing embodiments.

The embodiments of the present invention have brought the following beneficial effects:

In a file overwriting method, device and electronic device provided by the present invention, an overwriting instruction is first obtained; the overwriting instruction at least includes a file identifier of a target file to be overwritten, a storage location identifier of the overwriting content and an overwriting location ; Then according to the overwriting instruction, write the overwriting content to the overwriting position in the target file. This method is based on the data contained in the overwrite instruction. In the storage location of the target file that needs to be overwritten, the overwrite content is written into the target file, and there is no need to read the target file from the storage location and then overwrite. , thereby reducing the amount of data read and written, and improving the overwrite performance.

Additional features and advantages of the present invention will be set forth in the description which follows, or some may be inferred or unambiguously determined from the description, or may be learned by practicing the above-described techniques of the present invention.

In order to make the above-mentioned objects, features and advantages of the present invention more clearly understood, the preferred embodiments are exemplified below, and are described in detail as follows in conjunction with the accompanying drawings.

Description of drawings

In order to illustrate the specific embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the specific embodiments or the prior art. Obviously, the accompanying drawings in the following description The drawings are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without creative efforts.

1 is a flowchart of a file overwriting method provided by an embodiment of the present invention;

2 is a flowchart of another method for overwriting a file provided by an embodiment of the present invention;

3 is a flowchart of another file overwriting method provided by an embodiment of the present invention;

FIG. 4 is a schematic diagram of file overwriting according to an embodiment of the present invention;

5 is a schematic structural diagram of a file overwriting device according to an embodiment of the present invention;

FIG. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed ways

In order to make the purposes, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments These are some embodiments of the present invention, but not all embodiments. The components of the embodiments of the invention generally described and illustrated in the drawings herein may be arranged and designed in a variety of different configurations.

Thus, the following detailed description of the embodiments of the invention provided in the accompanying drawings is not intended to limit the scope of the invention as claimed, but is merely representative of selected embodiments of the invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

Distributed File System (DFS) usually means that the physical storage resources managed by the file system are not necessarily directly connected to the local node, but are connected to the node (which can be simply understood as a computer) through a computer network; or It is a complete hierarchical file system formed by combining several different logical disk partitions or volume labels. For example, a distributed file system HDFS (Hadoop Distributed Filesystem) with a directory tree, the files on the HDFS are horizontally cut into fixed-length data blocks for storage; this type of distributed file system can store user uploads It can also provide users with corresponding file system operations, such as volume operations, directory operations, and file operations (create files, upload file content, read files, delete files, etc.).

The current distributed file system generally only supports append writing, but does not support overwriting. In order to overwrite the file in the distributed file system, it is usually necessary to read the file to be overwritten from the distributed file system through the terminal device, and then in the terminal device (equivalent to local), the file to be overwritten and the pre-written file need to be read out. The set overwrite content is merged, the merged file is written into the distributed file system, and the original file corresponding to the file to be overwritten in the distributed file system is deleted. Because this method needs to perform multiple read/write operations on the file from the distributed file system, the amount of data read and written is large, which affects the overwrite performance.

For example, the original file in the distributed file system is 1GB, and the overwritten content is 1MB. When overwriting the original file, the original file of 1GB needs to be read from the distributed file system, and the 1MB file needs to be read out on the terminal device. The overwritten content is overwritten to the corresponding position in the 1GB original file, and then the merged 1GB file is written into the distributed file system, and the 1GB original file in the distributed file system is deleted. This method is to overwrite 1MB The overwrite content of the 1GB file needs to be read and rewritten, which is equivalent to 1000 times of read and write, resulting in a large amount of data read and written, which can also be understood as the occurrence of read and write data. , Write enlargement problem.

Based on the above problems, embodiments of the present invention provide a file overwriting method, apparatus, and electronic device, and the technology can be applied to file overwriting scenarios in various distributed file systems. In order to facilitate the understanding of the embodiments of the present invention, a file overwriting method disclosed in the embodiments of the present invention is first introduced in detail. As shown in FIG. 1 , the method includes the following steps:

Step S102, acquiring an overwriting instruction; the overwriting instruction at least includes: a file identifier of a target file to be overwritten, a storage location identifier of the overwriting content, and an overwriting location.

The above-mentioned overwriting instruction may be data stored in a preset database or a storage system, and the data usually has an instruction attribute; the overwriting instruction may also be an instruction sent by a user through a terminal device, and the terminal device may be a mobile terminal (such as a mobile terminal). , mobile phone, tablet, etc.), or a computer. The above-mentioned overwriting instruction may include the file identifier of the target file to be overwritten, the storage location identifier of the overwriting content, and the overwriting location, and may also include other contents, which will not be listed one by one here.

In the specific implementation, the above-mentioned target file that needs to be overwritten is usually stored in a distributed file system, and the file identifier of the target file can be the file name of the target file or other code names used to uniquely identify the file, etc.; the above-mentioned overwrite The content can be understood as the content that the user wants to overwrite. The overwritten content can be uploaded to the distributed file system in advance by the user. The storage location identifier of the overwritten content is also the storage of the overwritten content in the distributed file system. The file identifier corresponding to the location. For example, when the user uploads the overwritten content, the server automatically writes the overwritten content as a temporary file into the distributed file system after receiving the overwritten content. At this time, the storage location identifier of the overwritten content is The file ID of this temporary file. The above-mentioned overwriting position can also be understood as a position where the user wants to write the overwriting content in the target file, and the overwriting position may be a certain position in the target file, or a certain range.

Step S104, according to the above-mentioned overwriting instruction, write the overwriting content to the overwriting position in the target file.

According to the file representation of the target file contained in the overwrite instruction and the storage location identifier of the overwritten content, the target file and the overwritten content can be determined. For example, when the target file and the overwritten content are stored in the distributed file system, according to The file identifier of the target file and the storage location identifier of the overwritten content are determined from the distributed file system. When overwriting the target file, first query the overwriting position in the target file, and then write the overwriting content at the inquired overwriting position.

In specific implementation, after the overwrite operation indicated by the overwrite instruction is completed, the overwrite instruction and the overwrite content at the storage location identifier in the overwrite instruction can be deleted, thereby completing the overwrite of the target file.

In a file overwriting method provided by an embodiment of the present invention, an overwriting instruction is first obtained; the overwriting instruction at least includes a file identifier of a target file to be overwritten, a storage location identifier of the overwriting content, and an overwriting location; and then according to The overwrite instruction writes the overwrite content to the overwrite position in the target file. This method is based on the data contained in the overwrite instruction. In the storage location of the target file that needs to be overwritten, the overwrite content is written into the target file, and there is no need to read the target file from the storage location and then overwrite. , thereby reducing the amount of data read and written, and improving the overwrite performance.

The embodiment of the present invention also provides another method for overwriting a file, which is implemented on the basis of the method in the above-mentioned embodiment; the method focuses on writing the overwriting content to the overwriting position in the target file according to the overwriting instruction. The specific process (implemented through the following steps S204-S206); as shown in Figure 2, the method includes the following steps:

Step S202, obtaining an overwriting instruction; the overwriting instruction at least includes: the file identifier of the target file to be overwritten, the storage location identifier of the overwriting content, and the overwriting position; wherein, the overwriting position includes: the overwriting start address and overwrite length.

The above-mentioned overwriting start address may be the address in the target file input by the user. Since a file in a distributed file system is usually divided horizontally into multiple fixed-length data blocks for storage, the overwriting start address may be a certain position on a certain data block corresponding to the target file. The above-mentioned overwriting length may be a length value input by the user, which is the same as the length of the overwriting content written by the user, or a length value calculated according to the length of the overwriting content input by the user. In the specific implementation, when the user uploads the overwritten content, the system will save the overwritten content in the specified location (equivalent to the above-mentioned storage location) in the distributed file system, so that the target file can be subsequently updated in the distributed file system. Used when overwriting.

Step S204: Determine the target file and the overwritten content according to the file identifier of the target file and the storage location identifier of the overwritten content.

In the specific implementation, since the above-mentioned overwriting content has been pre-saved in the storage location of the distributed file system, the file identifier of the target file in the overwriting instruction and the storage location identifier of the overwriting content can be stored in the distributed file system from the distributed file system. Determine the target file and overwrite the content.

Step S206, starting from the start address of overwriting in the target file, replace the content of the overwriting length in the target file with the overwriting content.

According to the overwrite start address contained in the overwrite instruction, the position corresponding to the overwrite start address is determined from the target file, and the overwrite content is written into the target file from this position, and the overwrite content is in the target file. The write length is the same as the overwrite length indicated in the overwrite instruction, so that the target file can be overwritten in the distributed file system according to user needs, avoiding the need to read the target file and overwrite locally. read and write data amplification problems.

Step S208, delete the above-mentioned overwriting instruction and the overwriting content in the file corresponding to the storage location identifier, so as to complete the overwriting to the target file.

When the content of the overwrite length in the target file is replaced with the overwrite content, the overwrite instruction executed this time is deleted, and the overwrite content in the file corresponding to the storage location identifier is deleted, so as to complete the overwrite instruction indicated by the current overwrite instruction, Overwrite to the target file.

The above-mentioned file overwriting method, first obtains an overwriting instruction, and then determines the target file and overwriting content according to the file identifier of the target file indicated in the overwriting instruction and the storage location identifier of the overwriting content; then from the overwriting in the target file Starting from the writing start address, replace the content of the overwrite length in the target file with the overwrite content; then delete the above overwrite instruction and the overwrite content in the file corresponding to the storage location identifier to complete the overwrite of the target file. In this method, according to the overwrite instruction, the overwrite content is overwritten into the target file at the storage location of the target file that needs to be overwritten. It is not necessary to read out all the target files, merge the local and overwrite content, and then write back the target file. This greatly improves the overwrite performance and the overwrite efficiency.

The embodiment of the present invention also provides another method for overwriting a file, which is implemented on the basis of the method in the above-mentioned embodiment; the method focuses on describing that the overwriting instruction is stored in a specified database, and the target file that needs to be overwritten is stored in a preset In the set distributed file system, the specific process of obtaining the overwrite instruction (implemented by the following steps S310-S312); as shown in FIG. 3, the method includes the following steps:

Step S302, if an overwrite request sent by the user is received, extract the overwrite content, the overwrite location and the file identifier of the target file to be overwritten from the overwrite request.

In the specific implementation, if the user wants to overwrite a certain file saved in the distributed file system, the user can send an overwrite request through the terminal device, and the overwrite request usually carries the overwrite content input by the user, the overwrite The write location and the file identifier (or file name) of the target file to be overwritten.

Step S304: Write the above-mentioned overwriting content into the distributed file system to obtain a storage location identifier of the overwriting content.

When the overwritten content is extracted, the overwritten content is written into the distributed file system in the form of a temporary file, and the storage location identifier of the overwritten content is obtained, and the storage location identifier is also the storage location identifier in the distributed file system. The file ID of the temporary file for the content, which can be a file name.

In some embodiments, the overwrite version number of the target file is stored in the above-mentioned distributed file system; after the overwrite content is written into the distributed file system, and the storage location identifier of the overwrite content is obtained, the distributed file system will return Save the overwrite version of the target file; then the system receives the overwrite version number of the target file returned by the distributed file system, and writes the overwrite version number into the overwrite instruction.

Step S306, splicing the file identifier of the target file, the storage location identifier of the overwriting content, and the overwriting location to obtain an overwriting instruction of the target file.

The file identifier of the target file, the storage location identifier of the overwrite content, and the overwrite location are spliced together to generate an overwrite instruction of the target file, and the overwrite instruction may also be called an overwrite record. In some embodiments, if the overwrite version number of the target file returned by the distributed file system is received, the file identifier of the target file, the storage location identifier of the overwrite content, the overwrite location and the overwrite version of the target file can be stored Numbers are spliced to generate an overwrite instruction.

Step S308, save the above-mentioned overwriting instruction into a designated database.

Each overwrite request sent by the user can correspond to an overwrite instruction. During the specific implementation, multiple overwrite requests sent by multiple users may be received, that is, multiple overwrite instructions are obtained. In order to process the overwrite instructions in an orderly manner, the overwrite instructions can be saved to the In the specified database, the preset rule may be according to the generation sequence of the overwrite instructions, according to the reception sequence of the overwrite requests received, and the like.

Step S310, monitor in real time whether there is an overwrite instruction in the specified database.

Through the preset service, the data in the specified database can be continuously scanned to achieve the purpose of monitoring the data in the specified database in real time, so that when the specified database contains overwrite instructions, the overwrite instructions in the specified database can be processed one by one. .

Step S312; if there is, obtain the above-mentioned overwriting instruction.

Step S314, according to the overwriting instruction, write the overwriting content to the overwriting position in the target file.

If there is an overwrite instruction in the specified database, the overwrite instruction will be read one by one, and step S314 is executed for each overwrite instruction, that is, the following processing is performed for each overwrite instruction: according to the overwrite instruction included in the overwrite instruction The storage location identifier of the write content, read the overwrite content from the distributed file system, call the preset interface of the distributed file system, overwrite the overwrite content to the overwrite location of the target file, and delete the overwrite The instruction and the storage location identify the overwritten content at the corresponding storage location (it can also be understood as deleting the temporary file storing the overwritten content).

In specific implementation, if the overwrite instruction contains the overwrite version number of the target file, after the overwrite content is written to the overwrite position in the target file according to the overwrite instruction, the overwrite in the distributed file system will be overwritten. The write version number is updated to the sum of the overwrite version number and one in the overwrite instruction. It can also be understood that after the overwriting content is written to the target file, the overwriting version number of the target file saved in the distributed target file is incremented by one, thereby ensuring that any overwriting to the same file can be written with a unique and strict value. It is identified by the incremental overwriting version number, and the number of overwriting and writing of the target file can be determined according to the overwriting version number, which is convenient for users to use and query later.

During specific implementation, since the files in the distributed file system are stored in multiple copies (for example, three copies), the above-mentioned target file includes multiple copy files, that is, the multiple copies of the target file stored in the distributed file system are A copy file; when overwriting the target file, it is necessary to write the overwriting content to the overwriting position in the current copy file according to the overwriting instruction for each copy file of the target file; it can also be understood as the overwriting The write content is overwritten to all replica files corresponding to the target file, thereby ensuring data consistency between replicas.

In order to ensure that each copy file of the target file is overwritten, in the specific implementation, it is necessary to judge whether the overwrite content is successfully written to the overwrite position in the current copy file for each copy file of the target file; Write, automatically repair the current copy file, and rewrite the overwritten content to the current copy file until the current copy file is successfully overwritten.

For example, a distributed file system contains three copy files of the target file. When overwriting the target file, concurrently overwriting the three copy files is performed, so that all copy files are successfully overwritten. If a copy file is damaged due to a disk or machine failure, causing the copy file to fail to be overwritten, the system will monitor this situation, automatically remove the disk or machine from the cluster, and automatically restore the file based on the remaining two copy files. The third copy file, and then continue to overwrite the overwritten content to the recovered copy file, until all three copy files are overwritten successfully.

In order to facilitate the understanding of the embodiments of the present invention, FIG. 4 shows a schematic diagram of file overwriting; the storage gateway in FIG. 4 is used to receive overwriting requests sent by users, and the storage gateway is based on a distributed file system. It can exist in the form of HTTP (Hyper Text Transfer Protocol) interface, and can provide file storage services for multiple users, as well as multi-user data isolation, permission verification and other functions; the storage gateway receives After the overwrite request sent by the user, extract the overwrite content in the overwrite request, the file identifier and overwrite location of the target file to be overwritten, and write the overwrite content as a temporary file into the distributed file system , after the distributed file system system receives the temporary file, it will return the overwrite version number to the storage gateway, and then the storage gateway can record the file identifier of the target file, the overwrite location, the storage location identifier of the overwrite content, and the overwrite version. Numbers are spliced to obtain an overwrite instruction, and the overwrite instruction is saved in the specified database.

The instruction reading service in FIG. 4 can continuously scan the overwrite instructions in the specified database, and read the overwrite instructions in the specified database one by one, and perform the following operations for each overwrite instruction: read the temporary instruction indicated by the overwrite instruction. Overwrite the content in the file, call the preset interface of the distributed file system, and write the overwrite content to multiple copies of the target file. If the overwrite of a copy file fails, the overwrite will be retried all the time. Until all copy files are successfully overwritten in the distributed file system, then delete the temporary file and this overwrite instruction.

In the specific implementation, users will read files from the distributed file system according to their own needs, and the reading operation of files can be implemented through the following steps 10-13:

Step 10: Receive a read request of the target file sent by the user. A user can send a read request to any file in the distributed file system through a terminal device.

Step 11, determine whether there is an overwrite instruction of the target file in the designated database; if it exists, go to step 12; if not, go to step 13.

Step 12, according to the overwriting instruction of the target file, read the overwriting content and the target file corresponding to the overwriting instruction from the distributed file system, merge the overwriting content and the target file, and return the merged target file to the user .

Step 13: Read the target file from the distributed file system, and return the read target file to the user.

The above method of reading the target file can ensure that the user can read the target file merged with the overwritten content, thereby ensuring that the user can read the latest file and avoiding data loss.

In the above-mentioned file overwriting method, if an overwriting request sent by a user is received, the overwriting content, the overwriting location and the file identifier of the target file to be overwritten are extracted from the overwriting request; and then the overwriting content is written into a distributed In the file system, the storage location identifier of the overwritten content is obtained; then the file identifier of the target file, the storage location identifier of the overwritten content and the overwritten location are spliced to obtain the overwritten instruction of the target file, and the overwritten instruction is saved to the specified location. In the database; real-time monitoring and acquisition of the overwrite instruction in the specified database, according to the overwrite instruction, the overwrite content is written to the overwrite position in the target file. Compared with the method of reading the original file, merging the overwritten content locally, uploading the entire file and deleting the original file, the present invention does not have the problem of reading and writing amplification, reduces the amount of data read and written, and further improves the file size. Overwrite performance.

Corresponding to the above method embodiments, an embodiment of the present invention provides a file overwriting device, as shown in FIG. 5 , the device includes:

The instruction acquisition module 50 is configured to acquire an overwrite instruction; wherein, the overwrite instruction at least includes: a file identifier of a target file to be overwritten, a storage location identifier of the overwritten content, and an overwritten location.

The overwriting module 51 is configured to write the overwriting content to the overwriting position in the target file according to the overwriting instruction.

The above-mentioned file overwriting device, first obtains an overwriting instruction; the overwriting instruction includes at least the file identifier of the target file that needs to be overwritten, the storage location identifier of the overwriting content and the overwriting position; then according to the overwriting instruction, the overwriting instruction Writes are written to the overwrite location in the target file. This method is based on the data contained in the overwrite instruction. In the storage location of the target file that needs to be overwritten, the overwrite content is written into the target file, and there is no need to read the target file from the storage location and then overwrite. , thereby reducing the amount of data read and written, and improving the overwrite performance.

Specifically, the above-mentioned overwriting position includes: an overwriting start address and an overwriting length; wherein, the overwriting length is the same as the length of the overwriting content; the overwriting module 51 is used for: according to the file identification of the target file and the overwriting The storage location identifier of the content determines the target file and the overwriting content; starting from the overwriting start address in the target file, replace the overwriting length content in the target file with the overwriting content.

Further, the above-mentioned overwriting instruction is stored in a designated database; the above-mentioned instruction acquisition module 50 is used for: judging whether there is an overwriting instruction in the designated database; if there is, acquiring the overwriting instruction.

Further, the above-mentioned target file that needs to be overwritten is stored in a preset distributed file system; the above-mentioned device also includes an overwrite instruction storage module, used for: if an overwrite request sent by a user is received, from the overwrite request Extract the overwrite content, overwrite location and the file identifier of the target file to be overwritten; write the overwrite content into the distributed file system to obtain the storage location identifier of the overwrite content; splicing the file identifier and overwrite content of the target file The storage location identifier and overwrite location of the target file are obtained, and the overwrite instruction of the target file is obtained; the overwrite instruction is saved to the specified database.

Further, the above-mentioned apparatus further includes an information deletion module, which is used for: deleting the overwriting instruction and overwriting content in the file corresponding to the storage location identifier.

When specifically implemented, the above-mentioned device also includes a file reading module, which is used for: receiving a reading request of a target file sent by a user; judging whether there is an overwriting instruction of the target file in the specified database; if there is, according to the overwriting instruction of the target file instruction, read the overwrite content and target file corresponding to the overwrite instruction from the distributed file system, merge the overwrite content with the target file, and return the merged target file to the user; if it does not exist, from the distributed file The system reads the target file and returns the read target file to the user.

Further, the overwriting version number of the target file is stored in the above-mentioned distributed file system; the above-mentioned overwriting instruction preservation module is also used for: writing the overwriting content into the distributed file system, and obtaining the storage location identifier of the overwriting content After that, receive the overwrite version number of the target file returned by the distributed file system; write the overwrite version number into the overwrite instruction.

Specifically, the above apparatus further includes a version number update module, configured to: update the overwrite version number in the distributed file system to the sum of the overwrite version number and one in the overwrite instruction.

When specifically implemented, the above-mentioned target file includes a plurality of duplicate files; the above-mentioned overwriting module 51 is used for: for each duplicate file of the target file, according to the overwriting instruction, the overwriting content is written into the overwriting in the current duplicate file. position.

Further, the above-mentioned device also includes an overwriting monitoring module, which is used for: for each copy file of the target file, determine whether the overwriting content is successfully written in the overwriting position in the current copy file; if it is not successfully written, it is automatically repaired The current copy file, and rewrite the overwritten content to the current copy file until the current copy file is successfully overwritten.

The implementation principle and the technical effect of the file overwriting device provided by the embodiments of the present invention are the same as those of the foregoing method embodiments. For brief description, for the parts not mentioned in the device embodiments, reference may be made to the corresponding content in the foregoing method embodiments. .

An embodiment of the present invention further provides an electronic device, as shown in FIG. 6 , the electronic device includes a processor 101 and a memory 100, where the memory 100 stores machine-executable instructions that can be executed by the processor 101, and the processor 101 Machine-executable instructions are executed to implement the file overwriting method described above.

Further, the electronic device shown in FIG. 6 further includes a bus 102 and a communication interface 103 , and the processor 101 , the communication interface 103 and the memory 100 are connected through the bus 102 .

The memory 100 may include a high-speed random access memory (RAM, Random Access Memory), and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory. The communication connection between the network element of the system and at least one other network element is implemented through at least one communication interface 103 (which may be wired or wireless), which may use the Internet, a wide area network, a local network, a metropolitan area network, and the like. The bus 102 may be an ISA bus, a PCI bus, an EISA bus, or the like. The bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one bidirectional arrow is shown in FIG. 6, but it does not mean that there is only one bus or one type of bus.

The processor 101 may be an integrated circuit chip with signal processing capability. In the implementation process, each step of the above-mentioned method may be completed by an integrated logic circuit of hardware in the processor 101 or an instruction in the form of software. The above-mentioned processor 101 may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU for short), a network processor (NetworkProcessor, NP for short), etc. Circuit (Application Specific Integrated Circuit, ASIC for short), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA for short) or other programmable logic devices, discrete gate or transistor logic devices, and discrete hardware components. Various methods, steps, and logical block diagrams disclosed in the embodiments of the present invention can be implemented or executed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in conjunction with the embodiments of the present invention may be directly embodied as executed by a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software modules may be located in random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers and other storage media mature in the art. The storage medium is located in the memory 100, and the processor 101 reads the information in the memory 100, and completes the steps of the methods in the foregoing embodiments in combination with its hardware.

Embodiments of the present invention further provide a machine-readable storage medium, where the machine-readable storage medium stores machine-executable instructions, and when the machine-executable instructions are invoked and executed by a processor, the machine-executable instructions cause the processor to For the implementation of the above-mentioned file overwriting method, the specific implementation can be found in the method embodiment, which will not be repeated here.

The file overwriting method, apparatus, and computer program product of an electronic device provided by the embodiments of the present invention include a computer-readable storage medium storing program codes, and the instructions included in the program codes can be used to execute the methods described in the foregoing method embodiments. The specific implementation can refer to the method embodiment, which is not repeated here.

The functions, if implemented in the form of software functional units and sold or used as independent products, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention can be embodied in the form of a software product in essence, or the part that contributes to the prior art or the part of the technical solution. The computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, an electronic device, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, Read-Only Memory (ROM, Read-Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes .

Finally, it should be noted that the above-mentioned embodiments are only specific implementations of the present invention, and are used to illustrate the technical solutions of the present invention, but not to limit them. The protection scope of the present invention is not limited thereto, although referring to the foregoing The embodiment has been described in detail the present invention, those of ordinary skill in the art should understand: any person skilled in the art who is familiar with the technical field within the technical scope disclosed by the present invention can still modify the technical solutions described in the foregoing embodiments. Or can easily think of changes, or equivalently replace some of the technical features; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be covered in the present invention. within the scope of protection. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims (12)

1. a file overwriting method, characterized in that the method comprises: Obtain an overwrite instruction; wherein, the overwrite instruction includes at least: a file identifier of a target file that needs to be overwritten, a storage location identifier of the overwritten content, and an overwritten location; According to the overwriting instruction, the overwriting content is written to the overwriting position in the target file. 2. The method according to claim 1, wherein the overwriting position comprises: an overwriting start address and an overwriting length; wherein, the overwriting length is the same as the length of the overwriting content; The step of writing the overwriting content to the overwriting position in the target file according to the overwriting instruction includes: Determine the target file and the overwritten content according to the file identifier of the target file and the storage location identifier of the overwritten content; Starting from the overwriting start address in the target file, the content of the overwriting length in the target file is replaced with the overwriting content. 3. The method according to claim 1, wherein the overwriting instruction is stored in a designated database; the step of obtaining the overwriting instruction comprises: Judging whether the overwrite instruction exists in the specified database; If it exists, get the overwrite instruction. 4. The method according to claim 3, wherein the target file that needs to be overwritten is stored in a preset distributed file system; the overwritten instruction in the designated database is in the following manner Obtain: If an overwrite request sent by the user is received, extract the overwrite content, the overwrite location and the file identifier of the target file to be overwritten from the overwrite request; Writing the overwriting content into the distributed file system to obtain a storage location identifier of the overwriting content; Splicing the file identifier of the target file, the storage location identifier of the overwriting content and the overwriting position, to obtain the overwriting instruction of the target file; The overwrite instruction is stored in the designated database. 5. The method according to claim 1, wherein after the step of writing the overwriting content to the overwriting position in the target file according to the overwriting instruction, the overwriting Methods also include: The overwriting instruction and the overwriting content in the file corresponding to the storage location identifier are deleted. 6. The method according to claim 4, wherein the method further comprises: Receive the read request of the target file sent by the user; Judging whether there is an overwrite instruction of the target file in the specified database; If there is, read the overwrite content corresponding to the overwrite instruction and the target file from the distributed file system according to the overwrite instruction of the target file, and compare the overwrite content with the target file Merge, and return the merged target file to the user; If it does not exist, read the target file from the distributed file system, and return the read target file to the user. 7. The method according to claim 4, wherein the overwrite version number of the target file is stored in the distributed file system; After the step of writing the overwritten content into the distributed file system to obtain the storage location identifier of the overwritten content, the method further includes: receiving the overwrite version number of the target file returned by the distributed file system; Writing the overwriting version number into the overwriting instruction; After the step of writing the overwriting content to the overwriting position in the target file according to the overwriting instruction, the method further includes: The overwrite version number in the distributed file system is updated to the sum of the overwrite version number and one in the overwrite instruction. 8. The method according to claim 1, wherein the target file comprises a plurality of duplicate files; According to the overwriting instruction, the step of writing the overwriting content to the overwriting position in the target file includes: For each copy file of the target file, according to the overwriting instruction, write the overwriting content to the overwriting position in the current copy file. 9. The method according to claim 8, wherein the method further comprises: For each copy file of the target file, determine whether the overwrite content is successfully written to the overwrite position in the current copy file; If it is not successfully written, the current copy file is automatically repaired, and the overwritten content is rewritten into the current copy file until the current copy file is successfully overwritten. 10. A file overwriting device, wherein the device comprises: An instruction acquisition module, used for acquiring an overwriting instruction; wherein, the overwriting instruction at least includes: a file identifier of a target file that needs to be overwritten, a storage location identifier of the overwriting content, and an overwriting location; An overwriting module, configured to write the overwriting content to the overwriting position in the target file according to the overwriting instruction. 11. An electronic device, characterized in that the electronic device comprises a processor and a memory, the memory stores machine-executable instructions that can be executed by the processor, and the processor executes the machine-executable instructions In order to realize the file overwriting method described in any one of claims 1 to 9. 12. A machine-readable storage medium, characterized in that the machine-readable storage medium stores machine-executable instructions that, when invoked and executed by a processor, cause the machine-executable instructions to The processor implements the file overwriting method according to any one of claims 1 to 9.

Images