CN117076200B - A remote sensing data recovery method, device and storage medium based on metadata - Google Patents
A remote sensing data recovery method, device and storage medium based on metadata Download PDFInfo
- Publication number
- CN117076200B CN117076200B CN202311045885.2A CN202311045885A CN117076200B CN 117076200 B CN117076200 B CN 117076200B CN 202311045885 A CN202311045885 A CN 202311045885A CN 117076200 B CN117076200 B CN 117076200B
- Authority
- CN
- China
- Prior art keywords
- data
- target
- remote sensing
- sensing data
- frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1415—Saving, restoring, recovering or retrying at system level
- G06F11/1435—Saving, restoring, recovering or retrying at system level using file system or storage system metadata
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Library & Information Science (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a remote sensing data recovery method, equipment and storage medium based on metadata, which comprises the following steps: the method comprises the steps of obtaining a target remote sensing data list, obtaining a first intermediate file list according to the target remote sensing data list, obtaining a key filing information list, and recovering all target remote sensing data by reading one piece of information when a request for recovering the target remote sensing data is received, so that the working efficiency is improved.
Description
Technical Field
The present invention relates to the field of data processing, and in particular, to a remote sensing data recovery method, apparatus and storage medium based on metadata.
Background
With the development of information technology, the amount of information stored in a computer is continuously increased, and data backup and disaster recovery become hot topics. The data is very valuable, and to ensure the continuous operation and success of the information system, the information based on the computer is protected, and human errors, hard disk damage, computer viruses, natural disasters and the like can cause the loss of the data, so that no appreciable loss is caused. The system data loss can cause the loss of system files, transaction data, user data, technical files and financial accounts, and the business is difficult to normally process, so that important data needs to be backed up at any time in actual work.
In the field of mass data storage, according to the importance of data, entity data files and database information are required to be backed up simultaneously, so that rapid data reconstruction under the condition of disaster is prevented, and the processing requirement of a production system is met.
In the prior art, database backup software is generally adopted to carry out full-quantity backup or incremental backup on database information, entity data files are backed up through data archiving software, two different software are required to be adopted for backup, and steps are complicated when data are restored, so that the working efficiency is low.
Disclosure of Invention
Aiming at the technical problems, the invention adopts the following technical scheme:
a remote sensing data recovery method based on metadata comprises the following steps:
s1, acquiring a target remote sensing data list H= { H 1 ，H 2 ，……，H x ，……，H p }，H x The x-th target remote sensing data is referred to, x= … … p, p is the total number of the target remote sensing data;
s2, according to H, obtaining a first intermediate file list H0= { H0 corresponding to H 1 ，H0 2 ，……，H0 x ，……，H0 p }，H0 x Refers to H x A corresponding first intermediate file;
s21, obtaining H x Corresponding target archive information list C x ＝{C x 1 ，C x 2 ，……，C x i ，……C x n }， Refers to H x The starting byte position in the metadata corresponding to the ith target frame data,/for the metadata>Refers to H x Metadata mid-frame length corresponding to the ith target frame data,/and the like>Refers to H x Filing an identification in metadata corresponding to the ith target frame data;
wherein the method comprises the steps ofWhere a is the frame header length and b is H x A corresponding start frame position;
s22, will (C) 1 ，C 2 ……C x ) Write into key file and regard key file as H0 x It can be understood that: the key file is a file for storing metadata corresponding to target remote sensing data;
s3, acquiring a key archive information list G= { G corresponding to H according to H and H0 1 ，G 2 ，……，G x ，……，G p },G x ＝{H x ，H0 x ，G0 x }，G0 x Is H x Identification of the corresponding target tape;
s4, G x Sequentially writing into the storage area of the target tape to generate U= { H 1 ，H0 1 ，G0 1 ，……，H x ，H0 x ，G0 x ，……，H p ，H0 p ，G0 p }；
S5, when a request for recovering target remote sensing data is received, H0 in U is recovered p And analyzing the corresponding SQL sentences to restore the target remote sensing data.
The invention has at least the following beneficial effects:
H0 x including all the first intermediate files in the first x files, when the target remote sensing data needs to be recovered later, only H0 in U is needed p And reading the metadata to obtain the initial byte position, the frame length and the archiving identification of the corresponding metadata of all the target remote sensing data in the H, and recovering the metadata according to the information, so that the workload of recovering the data is reduced, and the working efficiency is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flowchart of a remote sensing data recovery method based on metadata according to an embodiment of the present invention;
fig. 2 is another flowchart provided in an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to fall within the scope of the invention.
The embodiment provides a remote sensing data recovery method based on metadata, which comprises the following steps, as shown in fig. 1:
and S100, when receiving an archiving instruction of the target remote sensing data, archiving the target remote sensing data in the target tape.
Specifically, the target remote sensing data refers to strip data stored in an online storage medium; it can be understood that: the strip data are data acquired by remote sensing satellites during remote sensing.
Specifically, the archiving instruction refers to an instruction for archiving target telemetry data from an online storage medium to a magnetic tape.
Specifically, the step S100 further includes the following steps:
s101, acquiring a target archive information list A= { A corresponding to the target remote sensing data 1 ，A 2 ，……，A i ，……A n }，Ai＝{A i 1 ，A i 2 ，A i 3 }，A i 1 Refers to the initial byte position A in the metadata corresponding to the ith target frame data in the target remote sensing data i 2 Refers to the frame length A in the metadata corresponding to the ith target frame data in the target remote sensing data i 3 Refers to the ith in the target remote sensing dataAnd archiving the identification in the metadata corresponding to the target frame data, wherein i= … … n, n is the total frame number of the target frame data in the target remote sensing data.
Further, A i 1 Meets the following conditions:
A i 1 ＝a+(b i -1)*A i 2 wherein a refers to the frame header length, b i The position of the initial frame of the ith target frame data in the target remote sensing data in the strip data is referred to.
Specifically, the A i 2 Are all equal.
When the target remote sensing data is archived from the online storage medium to the magnetic tape, the target archiving information list A, A corresponding to the target remote sensing data is obtained simultaneously i The starting byte position of the metadata corresponding to the ith target frame of the target remote sensing data, the frame length of the metadata and the corresponding archiving identification. When the target remote sensing data in the magnetic tape is required to be recovered, the starting byte position and the frame length of the metadata corresponding to each target frame data can be obtained by reading the target filing information list, so that the metadata corresponding to the target frame data is convenient to recover.
Furthermore, the type of the archiving identifier is a hash value, and any method for acquiring the data hash value in the prior art is known by a person skilled in the art, and falls into the protection scope of the present invention, and is not described herein again; the method for obtaining the data hash value can adopt an MD5 method.
S102, A is i The first intermediate file is stored as follows: the first intermediate file refers to a file for storing metadata corresponding to the target frame data.
Further, the format of the first intermediate file is xml format.
S103, when A i When the corresponding target frame data is used as the data to be frame, an intermediate archive information list A0= { A corresponding to the data to be frame is obtained from A 1 ，A 2 ，……，A r ，……，A i-1 }，A r Refers to the r-th intermediate archive information, which refers toAnd archiving information corresponding to the frame data.
S104, when A r 3 ＝A i 3 When A is r Corresponding pointer information is archived in the target tape.
S105, when A r 3 ≠A i 3 At the time, A i The corresponding first intermediate file is archived in the target tape.
The hash value can be used for converting the data with longer length into the character string with shorter length, fixed and not easy to repeat through the algorithm, and when A is used for i When the first intermediate file is stored in the first intermediate file, firstly judging A i Whether or not the archive identification of metadata corresponding to the previous target frame is identical to the archive identification of metadata corresponding to the previous target frame. If the archiving identification is the same as the archiving identification of any metadata, only the pointer information corresponding to the metadata is stored in the target tape, and all information is not required to be stored in the target tape, so that the occupation of the space of the target tape is reduced. When the metadata corresponding to the target frame data needs to be recovered, the target frame data can be found out from the over-read pointer information i Identical A r Will not be to A i Has an influence on the recovery of (a).
S200, when receiving an extraction instruction of target remote sensing data, extracting target data from the target tape.
Specifically, the extraction instruction refers to an instruction that will extract the telemetry data required by the user from the magnetic tape.
Specifically, the step S200 further includes the following steps:
s201, obtaining the data ID to be extracted and extraction information B= { B corresponding to the data ID to be extracted 1 ，B 2 ，B 3 }, wherein B is 1 Refers to the position of the initial frame corresponding to the data ID to be extracted, B 2 Refers to the position of the end frame corresponding to the data ID to be extracted, B 3 Refers to the frame length corresponding to the data ID to be extracted.
Further, the data ID to be extracted refers to a unique identifier of the data to be extracted, where the data to be extracted refers to remote sensing data to be extracted by a user, for example, the data ID to be extracted is a name of the data to be extracted.
S202, when the storage state of the target remote sensing data is offline storage, acquiring the storage capacity D of each storage block in the target tape 0 。
S203 according to D 0 Obtaining intermediate extraction information D= { D corresponding to the data ID to be extracted 1 ，D 2 ，D 3 }，D 1 Refers to the initial storage block position corresponding to the data ID to be extracted, D 2 Refers to the offset of the storage block corresponding to the data ID to be extracted, D 3 Refers to the extracted data length corresponding to the data ID to be extracted.
Further, D 1 Meets the following conditions:
c is B 1 At the storage block location in the target tape.
Further, D2 meets the following conditions:
mod((((B 1 -1)*B 3 +a0+1)+c*D 0 +D 0 )，D 0 ) Mod () is a remainder function.
Further, D 3 Meets the following conditions:
D 3 ＝(B 2 -B 1 +1)*B 3 。
s204, extracting the coincidence D from the target tape 1 、D 2 And D 3 As target data.
In the above, the magnetic tape is a storage medium in which storage blocks are sequentially stored and read, and thus the size of the storage blocks needs to be taken into consideration when extracting target data from the target magnetic tape. The storage block size of the target tape in this embodiment is D 0 Refers to the total number of bytes capable of being stored in one storage block as D 0 . When the target tape is required to be cut, firstly, calculating the position D of a storage block of a start frame of data corresponding to the data ID to be extracted in the target tape 1 Then calculating the position of the initial frame of the data corresponding to the data ID to be extracted in the initial storage block, and thenCalculating to obtain the data length D of the data corresponding to the data ID to be extracted 3 . Finally according to D 1 、D 2 、D 3 The data on the target magnetic tape is extracted to obtain the target data, so that the accurate extraction of the target data is realized, the target data is not required to be extracted after the data on the target magnetic tape are completely recovered, the working steps are reduced, and the working efficiency is improved.
S205, when the storage state of the target remote sensing data is online storage, according to B 1 And B 3 Determining a starting byte position B corresponding to the data ID to be extracted 0 Data length B corresponding to data ID to be extracted 4 。
Further, B 0 Meets the following conditions:
B 0 ＝a0+1+(B 1 -1)*B 3 wherein a0 refers to a frame header length corresponding to the data ID to be extracted.
Further, B 4 Meets the following conditions:
B 4 ＝(B 2 -B 1 +1)*B 3 。
s206, extracting the coincidence B0 and B from the target tape 4 As target data.
When the storage state of the target remote sensing data is online storage, the method comprises the following steps of 0 Cut B at byte position of (2) 4 The data of the length is taken as target data.
Specifically, any method for determining the storage state of remote sensing data in the prior art is known to those skilled in the art, which is not described herein in detail, and for example, the storage state is determined by using the remote sensing data extension attribute.
In a specific embodiment, the step S200 further includes the following steps:
and S300, storing the target data in a preset storage area, wherein the storage mode of the target data is one of a distributed storage mode, an object storage mode or a local storage mode.
S400, when theWhen the target data is stored in a preset storage area, the first metadata (B 0 、B 1 、B 2 、B 3 And B 4 ) Or second metadata (D of the target data 0 ，D 1 ，D 2 ，D 3 ) Stored in the second intermediate file, it can be understood that: the second intermediate file refers to a file for storing metadata corresponding to the target data.
Specifically, the format of the second intermediate file is xml format.
S500, storing the second intermediate file in the preset storage area.
And when the target data needs to be recovered later, the second intermediate file is read to obtain the first metadata or the second metadata of the target data, so that the target data can be recovered conveniently.
In another specific embodiment, the computer program, when executed by a processor, further performs the following steps, as shown in fig. 2:
s1, acquiring a target remote sensing data list H= { H 1 ，H 2 ，……，H x ，……，H p }，H x The x-th target remote sensing data is referred to, and x= … … p, p is the total number of the target remote sensing data.
S2, according to H, obtaining a first intermediate file list H0= { H0 corresponding to H 1 ，H0 2 ，……，H0 x ，……，H0 p }，H0 x Refers to H x A corresponding first intermediate file.
Specifically, the format of the first intermediate file is xml format.
Specifically, the step S2 further includes the following steps of obtaining H0 x ：
S21, obtaining H x Corresponding target archive information list C x ＝{C x 1 ，C x 2 ，……，C x i ，……C x n }， Refers to H x The starting byte position in the metadata corresponding to the ith target frame data,/for the metadata>Refers to H x Metadata mid-frame length corresponding to the ith target frame data,/and the like>Refers to H x The metadata corresponding to the ith target frame data is filed with an identification.
Further, the method comprises the steps of,meets the following conditions:
where a is the frame header length and b is H x Corresponding start frame position.
When the target remote sensing data list H is obtained, the first intermediate file list H0 is obtained at the same time, according to H x Obtaining C x Obtaining H x The initial byte position, the frame length and the archiving identification of the metadata corresponding to the ith target frame data are convenient for recovering H through H0 when the target remote sensing data are recovered later.
Furthermore, the type of the archiving identifier is a hash value, and any method for acquiring the data hash value in the prior art is known by a person skilled in the art, and falls into the protection scope of the present invention, and is not described herein again; the method for obtaining the data hash value can adopt an MD5 method.
S22, will (C) 1 ，C 2 ……C x ) Write into key file and regard key file as H0 x It can be understood that: the key file is a file for storing metadata corresponding to the target remote sensing data.
Further, the format of the first intermediate file is xml format.
Further, C 1 To C x SQL statements are adopted in writing the key file.
S3, acquiring a key archive information list G= { G corresponding to H according to H and H0 1 ，G 2 ，……，G x ，……，G p },G x ＝{H x ，H0 x ，G0 x }，G0 x Is H x Identification of the corresponding target tape.
S4, G x Sequentially writing into the storage area of the target tape to generate U= { H 1 ，H0 1 ，G0 1 ，……，H x ，H0 x ，G0 x ，……，H p ，H0 p ，G0 p }。
S5, when a request for recovering target remote sensing data is received, H0 in U is recovered p Analyzing the corresponding SQL sentences to recover target remote sensing data; those skilled in the art will know that any method for parsing SQL statement belongs to the protection scope of the present invention, and will not be described in detail herein.
Above, H0 x Including all the first intermediate files in the first x files, when the target remote sensing data needs to be recovered later, only H0 in U is needed p And reading the metadata to obtain the initial byte position, the frame length and the archiving identification of the corresponding metadata of all the target remote sensing data in the H, and recovering the metadata according to the information, so that the workload of recovering the data is reduced, and the working efficiency is improved.
Embodiments of the present invention also provide a non-transitory computer readable storage medium that may be disposed in an electronic device to store at least one instruction or at least one program for implementing one of the methods embodiments, the at least one instruction or the at least one program being loaded and executed by the processor to implement the methods provided by the embodiments described above.
Embodiments of the present invention also provide an electronic device comprising a processor and the aforementioned non-transitory computer-readable storage medium.
While certain specific embodiments of the invention have been described in detail by way of example, it will be appreciated by those skilled in the art that the above examples are for illustration only and are not intended to limit the scope of the invention. Those skilled in the art will also appreciate that many modifications may be made to the embodiments without departing from the scope and spirit of the invention. The scope of the invention is defined by the appended claims.
Claims (9)
1. A remote sensing data recovery method based on metadata, the method comprising the steps of:
s1, acquiring a target remote sensing data list H= { H 1 ，H 2 ，……，H x ，……，H p }，H x The x-th target remote sensing data is referred to, x= … … p, p is the total number of the target remote sensing data;
s2, according to H, obtaining a first intermediate file list H0= { H0 corresponding to H 1 ，H0 2 ，……，H0 x ，……，H0 p }，H0 x Refers to H x A corresponding first intermediate file;
s21, obtaining H x Corresponding target archive information list C x ＝{C x 1 ，C x 2 ，……，C x i ，……C x n }，C x i ＝{C x i 1 ，C x i 2 ，C x i 3 }，C x i 1 Refers to H x The initial byte position, C, in the metadata corresponding to the ith target frame data x i 2 Refers to H x The frame length C in the metadata corresponding to the ith target frame data x i 3 Refers to H x The ith order of (3)Archiving the identification in metadata corresponding to the target frame data, wherein i= … … n, n is the total frame number of the target frame data in the target remote sensing data;
wherein C is x i 1 ＝a+1+(b x -1)*C x i 2 The method comprises the steps of carrying out a first treatment on the surface of the Where a is the frame header length, b x Refers to H x A corresponding start frame position;
s22, will (C) 1 ，C 2 ……C x ) Write into key file and regard key file as H0 x The key file is a file for storing metadata corresponding to target remote sensing data;
s3, acquiring a key archive information list G= { G corresponding to H according to H and H0 1 ，G 2 ，……，G x ，……，G p },G x ＝{H x ，H0 x ，G0 x }，G0 x Is H x Identification of the corresponding target tape;
s4, G x Sequentially writing into the storage area of the target tape to generate U= { H 1 ，H0 1 ，G0 1 ，……，H x ，H0 x ，G0 x ，……，H p ，H0 p ，G0 p }；
S5, when a request for recovering target remote sensing data is received, H0 in U is recovered p And analyzing the corresponding sentences to recover the target remote sensing data.
2. The method according to claim 1, characterized in that the method further comprises, before S1:
s100, when an archiving instruction of target remote sensing data is received, archiving the target remote sensing data in a target tape;
s200, when receiving an extraction instruction of target remote sensing data, extracting the target remote sensing data from the target tape;
the step S200 further comprises the following steps:
s201, obtaining the data ID to be extracted and extraction information B= { B corresponding to the data ID to be extracted 1 ，B 2 ，B 3 }, wherein，B 1 Refers to the position of the initial frame corresponding to the data ID to be extracted, B 2 Refers to the position of the end frame corresponding to the data ID to be extracted, B 3 Refers to the frame length corresponding to the data ID to be extracted;
s202, when the storage state of the target remote sensing data is offline storage, acquiring the storage capacity D of each storage block in the target tape 0 ；
S203 according to D 0 Obtaining intermediate extraction information D= { D corresponding to the data ID to be extracted 1 ，D 2 ，D 3 }，D 1 Refers to the initial storage block position corresponding to the data ID to be extracted, D 2 Refers to the offset of the storage block corresponding to the data ID to be extracted, D 3 Refers to the length of the extracted data corresponding to the ID of the data to be extracted;
wherein D is 1 Meets the following conditions:
wherein a0 is the frame header length corresponding to the data ID to be extracted, and c is B 1 Storage block locations in the target tape;
further, D2 meets the following conditions:
mod((((B 1 -1)*B 3 +a0+1)+c*D 0 +D 0 )，D 0 ) Mod () is a remainder function;
further, D 3 Meets the following conditions:
D 3 ＝(B 2 -B 1 +1)*B 3 ；
s204, extracting the coincidence D from the target tape 1 、D 2 And D 3 As target remote sensing data.
3. The method according to claim 2, characterized in that the method further comprises the steps of:
s205, when the storage state of the target remote sensing data is online storage, according to B 1 And B 3 Determining the initial byte corresponding to the data ID to be extractedPosition B 0 Data length B corresponding to data ID to be extracted 4 ；
Further, B 0 Meets the following conditions:
B 0 ＝a0+1+(B 1 -1)*B 3 ；
further, B 4 Meets the following conditions:
B 4 ＝(B 2 -B 1 +1)*B 3 ；
s206, extracting the coincidence B0 and B from the target tape 4 As target remote sensing data.
4. A method according to claim 3, characterized in that the method further comprises the step of:
and S300, storing the target remote sensing data in a preset storage area, wherein the storage mode of the target remote sensing data is one of a distributed storage mode, an object storage mode or a local storage mode.
5. The method according to claim 4, further comprising the step of:
s400, when the target remote sensing data is stored in a preset storage area, the first metadata (B 0 ，B 1 ，B 2 ，B 3 ，B 4 ) Or second metadata (D) 0 ，D 1 ，D 2 ，D 3 ) The method comprises the steps of storing the metadata in a second intermediate file, wherein the second intermediate file is used for storing metadata corresponding to target remote sensing data;
s500, storing the second intermediate file in the preset storage area.
6. The method of claim 1, wherein the format of the first intermediate file is xml format.
7. The method according to claim 2, wherein the step S100 further comprises the steps of:
s101, acquiring a target archive information list A= { A corresponding to the target remote sensing data 1 ，A 2 ，……，A i ，……A n }，A i ＝{A i 1 ，A i 2 ，A i 3 }，A i 1 Refers to the initial byte position A in the metadata corresponding to the ith target frame data in the target remote sensing data i 2 Refers to the frame length A in the metadata corresponding to the ith target frame data in the target remote sensing data i 3 The method is that a metadata corresponding to the ith target frame data in the target remote sensing data is archived with an identification;
further, A i 1 Meets the following conditions:
A i 1 ＝a+(b i -1)*A i 2 wherein a refers to the frame header length, b i The position of the initial frame of the ith target frame data in the target remote sensing data in the strip data is referred to;
s102, A is i Storing the metadata into a first intermediate file, wherein the first intermediate file is used for storing metadata corresponding to target frame data;
s103, when A i When the corresponding target frame data is used as the data to be frame, an intermediate archive information list A0= { A corresponding to the data to be frame is obtained from A 1 ，A 2 ，……，A r ，……，A i-1 }，A r The data storage method comprises the steps of referring to the r-th intermediate archive information, wherein the intermediate archive information refers to archive information corresponding to frame data to be stored;
s104, when A r 3 ＝A i 3 When A is r Corresponding pointer information is archived in the target tape;
s105, when A r 3 ≠A i 3 At the time, A i The corresponding first intermediate file is archived in the target tape.
8. A non-transitory computer readable storage medium having stored therein at least one instruction or at least one program loaded and executed by a processor to implement the method of any one of claims 1-7.
9. An electronic device comprising a processor and the non-transitory computer readable storage medium of claim 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311045885.2A CN117076200B (en) | 2023-08-18 | 2023-08-18 | A remote sensing data recovery method, device and storage medium based on metadata |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311045885.2A CN117076200B (en) | 2023-08-18 | 2023-08-18 | A remote sensing data recovery method, device and storage medium based on metadata |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117076200A CN117076200A (en) | 2023-11-17 |
| CN117076200B true CN117076200B (en) | 2024-04-12 |
Family
ID=88703702
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311045885.2A Active CN117076200B (en) | 2023-08-18 | 2023-08-18 | A remote sensing data recovery method, device and storage medium based on metadata |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117076200B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117093541B (en) * | 2023-08-18 | 2024-02-23 | 北京天华星航科技有限公司 | A data extraction and archiving system for remote sensing data |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2004003912A1 (en) * | 2002-06-28 | 2004-01-08 | Koninklijke Philips Electronics N.V. | Method and arrangement for the generation of an identification data block |
| CN106133717A (en) * | 2014-06-25 | 2016-11-16 | 深圳市大疆创新科技有限公司 | Multimedia file restorative procedure and equipment |
| CN107046647A (en) * | 2017-05-14 | 2017-08-15 | 华中科技大学 | A kind of control method of multispectral remote sensing image real-time decompression device |
| CN113761012A (en) * | 2020-06-05 | 2021-12-07 | 义乌市时空人工智能有限公司 | Analysis visualization method of remote sensing data, server and storage medium |
| CN114244833A (en) * | 2022-02-24 | 2022-03-25 | 中国科学院空天信息创新研究院 | A method for real-time transmission of remote sensing satellite raw data using FTP protocol |
| CN114860558A (en) * | 2022-04-21 | 2022-08-05 | 中国资源卫星应用中心 | A method to facilitate remote sensing satellite data archiving and recovery performance testing |
| CN115525602A (en) * | 2021-06-25 | 2022-12-27 | 华为技术有限公司 | Data processing method and related device |
| CN115630028A (en) * | 2022-12-12 | 2023-01-20 | 中国科学院空天信息创新研究院 | Remote sensing image filing management method, device, equipment and storage medium |
| CN115964224A (en) * | 2022-12-29 | 2023-04-14 | 北京易华录信息技术股份有限公司 | Index metadata backup method and device and electronic equipment |
| CN116452461A (en) * | 2023-05-08 | 2023-07-18 | 中国长江三峡集团有限公司 | A remote sensing data processing method, device, electronic equipment and storage medium |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8055745B2 (en) * | 2004-06-01 | 2011-11-08 | Inmage Systems, Inc. | Methods and apparatus for accessing data from a primary data storage system for secondary storage |
| US11232330B2 (en) * | 2018-02-13 | 2022-01-25 | Slingshot Aerospace, Inc. | Adaptive neural network selection to extract particular results |
-
2023
- 2023-08-18 CN CN202311045885.2A patent/CN117076200B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2004003912A1 (en) * | 2002-06-28 | 2004-01-08 | Koninklijke Philips Electronics N.V. | Method and arrangement for the generation of an identification data block |
| CN106133717A (en) * | 2014-06-25 | 2016-11-16 | 深圳市大疆创新科技有限公司 | Multimedia file restorative procedure and equipment |
| CN107046647A (en) * | 2017-05-14 | 2017-08-15 | 华中科技大学 | A kind of control method of multispectral remote sensing image real-time decompression device |
| CN113761012A (en) * | 2020-06-05 | 2021-12-07 | 义乌市时空人工智能有限公司 | Analysis visualization method of remote sensing data, server and storage medium |
| CN115525602A (en) * | 2021-06-25 | 2022-12-27 | 华为技术有限公司 | Data processing method and related device |
| CN114244833A (en) * | 2022-02-24 | 2022-03-25 | 中国科学院空天信息创新研究院 | A method for real-time transmission of remote sensing satellite raw data using FTP protocol |
| CN114860558A (en) * | 2022-04-21 | 2022-08-05 | 中国资源卫星应用中心 | A method to facilitate remote sensing satellite data archiving and recovery performance testing |
| CN115630028A (en) * | 2022-12-12 | 2023-01-20 | 中国科学院空天信息创新研究院 | Remote sensing image filing management method, device, equipment and storage medium |
| CN115964224A (en) * | 2022-12-29 | 2023-04-14 | 北京易华录信息技术股份有限公司 | Index metadata backup method and device and electronic equipment |
| CN116452461A (en) * | 2023-05-08 | 2023-07-18 | 中国长江三峡集团有限公司 | A remote sensing data processing method, device, electronic equipment and storage medium |
Non-Patent Citations (4)
| Title |
|---|
| KingCloud:智能对象归档系统;缪嘉嘉;付印金;毛捍东;;计算机科学(第S2期);全文 * |
| Xinni Liu.et.al..A review of Convolutional Neural Networks in Remote Sensing Image.《ICSCA '19》.2019,263-267. * |
| 基于CCSDS建议的遥感图像传输系统性能研究;刘庆利;潘成胜;田野;窦雪荔;;计算机应用(第10期);全文 * |
| 遥感数据异地归档方法研究与实现;李斌斌;冯钟葵;唐梦辉;;遥感信息(第02期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117076200A (en) | 2023-11-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105009067B (en) | Manage operations on storage data units | |
| US7366859B2 (en) | Fast incremental backup method and system | |
| CN105027071B (en) | Manage the operation to data storage unit | |
| US7831789B1 (en) | Method and system for fast incremental backup using comparison of descriptors | |
| US9904601B2 (en) | Synchronization of storage using comparisons of fingerprints of blocks | |
| CN111241062B (en) | Method and device for migrating database backup metadata | |
| US20130006941A1 (en) | Device and method for generating copy of database | |
| JP6632380B2 (en) | Managing operations on stored data units | |
| CN109753382B (en) | Recovery method and system for database deleted records | |
| CN107506260A (en) | A kind of dynamic division database incremental backup method | |
| KR101484882B1 (en) | Forensic data recovery method and system | |
| CN103838645B (en) | Remote difference synthesis backup method based on Hash | |
| CN117076200B (en) | A remote sensing data recovery method, device and storage medium based on metadata | |
| US10380141B1 (en) | Fast incremental backup method and system | |
| WO2017067397A1 (en) | Data recovery method and device | |
| CN114817263B (en) | Data processing method, device, electronic device and storage medium | |
| CN109388617B (en) | Method and device for judging reliability of file timestamp | |
| CN113971002A (en) | Block chain based data storage method, device, equipment and readable storage medium | |
| CN117093541B (en) | A data extraction and archiving system for remote sensing data | |
| CN113761059A (en) | Data processing method and device | |
| CN111221801A (en) | A database migration method, system and related device | |
| CN113742097B (en) | A data differential identification coding synchronization method, device, equipment and medium | |
| CN116795296A (en) | A data storage method, storage device and computer-readable storage medium | |
| CN116185711A (en) | Data backup and recovery method and device | |
| CN109491861B (en) | A database repair method, device and storage medium for abnormal overflow page |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A metadata based remote sensing data recovery method, device, and storage medium Granted publication date: 20240412 Pledgee: Pudong Development Bank of Shanghai Limited by Share Ltd. Beijing branch Pledgor: BEIJING TIANHUA XINGHANG TECHNOLOGY Co.,Ltd. Registration number: Y2024110000246 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PC01 | Cancellation of the registration of the contract for pledge of patent right |
Granted publication date: 20240412 Pledgee: Pudong Development Bank of Shanghai Limited by Share Ltd. Beijing branch Pledgor: BEIJING TIANHUA XINGHANG TECHNOLOGY Co.,Ltd. Registration number: Y2024110000246 |
|
| PC01 | Cancellation of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A metadata based remote sensing data recovery method, device, and storage medium Granted publication date: 20240412 Pledgee: Pudong Development Bank of Shanghai Limited by Share Ltd. Beijing branch Pledgor: BEIJING TIANHUA XINGHANG TECHNOLOGY Co.,Ltd. Registration number: Y2026990000021 |