JP2016015669A - Moving image restoration device, moving image restoration method, and program for moving image restoration device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a moving image restoration device 10 etc. which needs no record of a file other than a moving image file such as a restoration file.SOLUTION: A moving image file of a moving image is acquired and frame information relating to the frame part of the moving image file is extracted from a header part of the acquired moving image file (S13). Each frame of the frame part is retrieved and the frame information is calculated (S14 to S17). The extracted frame information is compared with the calculated frame information (S18). When the extracted frame information is different from the calculated frame information, the frame information of the header part is replaced with the calculated frame information (S30) and a moving image file is restored (S31).

Description

  The present invention relates to a moving image restoration device, a moving image restoration method, and a program for a moving image restoration device for restoring a moving image.

  In some cases, the writing of moving image data picked up by the monitoring camera is defective and needs to be repaired. For example, in Patent Document 1, file information of a series of data to be recorded is updated as restoration file information for a digital camera, the restoration file information updated together with the data file is recorded on a recording medium, and the drive power is turned off. When the writing process is interrupted due to opening, opening, impact, etc., the updated repair file information is retrieved and read, and the file information of the file whose recording was interrupted is restored based on the read repair file information. A data recording / reproducing apparatus is disclosed.

JP 2003-169293 A

  However, in the technique of Patent Document 1, since it is stored as a restoration file separately from the moving image data, the capacity of the recording medium is consumed, and there is a restriction in copying and moving data using a personal computer or the like. In addition, it is necessary to cope with the case where the restoration file itself is not normally stored, and the processing becomes complicated.

  Therefore, the present invention has been made in view of the above-described problems, and one example of the problem is to provide a moving image restoration device that does not require recording of a file other than a moving image file such as a restoration file. Objective.

  In order to solve the above-mentioned problem, the invention according to claim 1 is characterized in that a moving image file acquisition unit that acquires a moving image file of moving images and frame information relating to a frame portion of the moving image file from the header portion of the acquired moving image file. Frame information extracting means for extracting the frame information, frame information calculating means for searching for each frame in the frame portion to calculate the frame information, and comparing means for comparing the extracted frame information with the calculated frame information And, when the extracted frame information and the calculated frame information are different, rewrites the frame information of the header part to the calculated frame information, and includes a moving image file repairing unit that repairs the moving image file. And

  Further, the invention according to claim 2 is the moving image restoration apparatus according to claim 1, wherein the frame information calculation unit searches each frame of the frame portion to calculate other frame information, and The file restoration means generates a tail portion of the moving image file from the other frame information.

  In the moving image restoration device according to claim 2, the frame information is the number of frames of the moving image file, and the other frame information is a data size of each frame. It is characterized by that.

  According to a fourth aspect of the present invention, there is provided the moving image restoration apparatus according to any one of the first to third aspects, wherein the file name of the moving image file indicates the order stored in the storage means. The moving image file acquisition unit acquires the moving image file stored last in the storage unit based on the file name.

  According to the fifth aspect of the present invention, the moving image file acquiring unit acquires the moving image file of the moving image, and the frame information extracting unit extracts the moving image file from the header portion of the acquired moving image file. A frame information extracting step for extracting frame information relating to the frame portion; a frame information calculating means for searching each frame of the frame portion to calculate the frame information; and a comparing means for extracting the frame information. The comparison step for comparing the frame information with the calculated frame information, and the moving image file restoration means, when the extracted frame information and the calculated frame information are different, the frame information of the header portion is the calculated frame Video file repair step to repair video files by rewriting information And having a flop, a.

  According to a sixth aspect of the present invention, there is provided a video file acquisition means for acquiring a video file of a video, and frame information for extracting frame information relating to a frame portion of the video file from a header portion of the acquired video file. Extraction means, frame information calculation means for searching for each frame in the frame portion to calculate the frame information, comparison means for comparing the extracted frame information with the calculated frame information, and the extracted frame When the information and the calculated frame information are different, the frame information in the header portion is rewritten with the calculated frame information to function as a moving image file repair unit that repairs a moving image file.

  According to the present invention, a moving image file can be repaired even if a file other than a moving image file such as a repair file is not recorded.

It is a schematic diagram which shows the example of a schematic structure of the moving image restoration apparatus which concerns on embodiment of this invention. It is a schematic diagram which shows the structural example of a moving image file. It is a flowchart which shows the operation example of the moving image restoration apparatus of FIG. It is a schematic diagram which shows an example of the storage area of a moving image file. FIG. 4 is a flowchart illustrating an example of a file check subroutine of FIG. 3. FIG. It is a schematic diagram which shows an example of the damaged moving image file. It is a schematic diagram which shows an example of the damaged moving image file. It is a schematic diagram which shows an example of the damaged moving image file. 4 is a flowchart illustrating an example of a file repair subroutine of FIG. 3. It is a schematic diagram which shows an example of the restored moving image file.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The embodiment described below is an embodiment when the present invention is applied to a moving image restoration apparatus.

[1. Overview of video restoration device configuration and functions]
(1.1 Overview of configuration and functions of video restoration device)

  First, the configuration and outline function of a moving image restoration apparatus according to an embodiment of the present invention will be described with reference to FIG.

  FIG. 1 is a schematic diagram illustrating a schematic configuration example of a moving image restoration apparatus according to an embodiment of the present invention.

  As illustrated in FIG. 1, the moving image restoration apparatus 10 includes an input unit 11 that continuously receives input of moving image data from a camera 3 that captures moving images, and a plurality of frames of moving image data in a moving image file of a predetermined format. It has the system control part 12 which converts, and the memory | storage part 13 which memorize | stores a moving image file. The input unit 11, the system control unit 12, and the storage unit 13 are connected via a system bus 15. Note that the moving image restoration apparatus 10 may include a communication unit (not shown) that can be connected to a network. Moreover, AVI (Audio Video Interleave) etc. are mentioned as an example of the format of a moving image file.

  The camera 3 includes an image sensor (an example of an imaging unit) such as a complementary metal oxide semiconductor (CMOS) or a charge coupled device (CCD), and a lens. The camera 3 is, for example, an in-vehicle camera or a surveillance camera.

  The input unit 11 has an interface function with the camera 3. Note that the input unit 11 may have an interface connected to the TV in order to record the TV (for example, to simultaneously record a multi-channel broadcast).

  The system control unit 12 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. Then, the system control unit 12 converts the frame of the moving image data into a moving image file including a frame portion, a header portion, and an index portion. The system control unit 12 generates a file name of the moving image file.

  The storage unit 13 includes a recording medium 13a such as a memory card, a hard disk drive, or a silicon disk drive, for example. The storage unit 13 has a slot for mounting a memory card (an example of a recording medium). The storage unit 13 stores captured moving image data, an operating system, various programs, and the like. Note that the various programs may be acquired from another server device or the like via a network, or may be recorded on the recording medium 13a and read via a drive device.

(1.2 Example of video file structure)
Next, a configuration example of a moving image file will be described with reference to FIG.
FIG. 2 is a schematic diagram illustrating a configuration example of a moving image file.

  As shown in FIG. 2, the moving image file has a header portion at the beginning of the moving image file, a frame portion next to the header portion, and an index portion at the end of the moving image file (an example of the end portion).

  The header section (HEADER) has a 4-character identifier of “RIFF” (Resource Interchange File Format) for recognizing the format of the moving image file, and a plurality of blocks such as a LIST chunk. In the header portion, header information (an example of frame information) such as information on the total number of frames of the moving image file and information on the data size of the moving image file is described.

  The frame part (frame) is composed of a plurality of frames. Each frame is still image data of a compressed image in JPEG (Joint Photographic Experts Group) format or the like. Each frame has an SOI marker (Start of Image) at the beginning and an EOI marker (End of Image) at the end. For example, hexadecimal “FFD8” is assigned to the SOI marker. For example, hexadecimal “FFD9” is assigned to the EOI marker.

  In the index part (INDEX), information indicating an offset indicating a relative address of each frame and a data size of each frame is described.

  Here, in the case of the JPEG compression method, since the size after compression is different for each frame, the file size of the moving image file, the offset of the header part and the index part, and the size are variable. Therefore, the data size, the number of frames, and the index (offset and size of each frame) are unknown until the recording is stopped. When the recording is stopped, these are calculated, the header information in the header part is updated, and the index part is added. Recording of the video file is complete. More specifically, the data size is described in mobiListSize of the AVILISTMOVI tag in the header part, and the calculated number of frames is overwritten in dwTotalFrames of the AVIMAINHEADER tag. Information composed of the offset and size of each frame is added to the end of the moving image file as an index.

  The file name and directory structure are formed by time or recording order numbers. For example, a directory is created by date, a subdirectory is created by time, and a file name (an example of a file name indicating the order stored in the storage means) is created in minutes and seconds. Moreover, the file name numbered in order of recording (an example of a file name indicating the order stored in the storage means) may be used.

[2. Operation of video restoration device 10]
Next, the operation of the moving image restoration apparatus 10 according to one embodiment of the present invention will be described with reference to FIG.
FIG. 3 is a flowchart illustrating an operation example of the moving image restoration apparatus.

(2.1 Operation of video restoration device)
As shown in FIG. 3, the moving image restoration apparatus 10 determines whether or not the recording medium 13a has been inserted (step S1). Specifically, the system control unit 12 of the moving image restoration apparatus 10 determines whether or not a memory card has been inserted into the slot of the storage unit 13 when the power is turned on.

  When the recording medium is inserted (step S1; YES), the moving image restoration apparatus 10 loads the data of the recording medium (step S2). Specifically, the system control unit 12 accesses the memory card in the storage unit 13 and reads the recorded data. More specifically, directory information and FAT information related to the moving image file recorded on the memory card are read, and loading is performed to prepare for recording.

  As described above, the moving image restoration apparatus 10 functions as an example of a moving image file acquisition unit that acquires a moving image file.

  If no recording medium is inserted (step S1; NO), the process returns to step S1 and enters a standby state until it is inserted. For example, when the memory card is not inserted after the power is turned on, insertion of the memory card is confirmed at intervals of 1 second, and loading is performed when the memory card is inserted.

  Next, the moving image restoration apparatus 10 determines whether or not the overwrite mode is set (step S3). Specifically, the system control unit 12 determines whether or not the method for writing the moving image file to the memory card is a mode for overwriting the memory card.

  When the overwrite mode is set (step S3; YES), the moving image restoration apparatus 10 determines whether or not there is a free space in the recording medium (step S4). Specifically, the system control unit 12 calculates the file usage amount from the recording mode set at the time of loading, and checks the free space of the memory card inserted in the storage unit 13.

  When there is no free space on the recording medium (step S4; NO), the moving image restoration apparatus 10 searches for and deletes the oldest file (step S6). Specifically, if there is no free space, the system control unit 12 searches for and deletes the oldest file from the memory card inserted in the storage unit 13. Then, the moving image restoration apparatus 10 returns to step S4 and further checks the free space.

  If it is not the overwrite mode (step S3; NO), the moving image restoration apparatus 10 determines whether or not there is a free space in the recording medium (step S6).

  If there is no free space on the recording medium (step S6; NO), the process ends and recording starts.

  When the recording medium has free space (step S4; YES or step S6; YES), the moving image restoration apparatus 10 searches for a moving image file (step S7). Specifically, the system control unit 12 searches for the file name and obtains the newest moving image file, that is, the last recorded moving image file. For example, as illustrated in FIG. 4, the moving image restoration apparatus 10 searches for and obtains a moving image file of “file 4”.

  As described above, the moving image restoration apparatus 10 functions as an example of a moving image file acquisition unit that acquires a moving image file. The moving image restoration apparatus 10 functions as an example of a moving image file acquisition unit that acquires a moving image file stored last in the storage unit based on the file name.

  Next, the moving image restoration apparatus 10 checks the last recorded moving image file (step S8). Specifically, the system control unit 12 checks the last recorded moving image file from the top of the file according to a file check subroutine.

  As described above, the moving image restoration apparatus 10 functions as an example of a moving image file acquisition unit that acquires a moving image file.

  Next, the moving image restoration apparatus 10 determines whether or not the moving image file is normal (step S9). For example, the system control unit 12 determines whether or not the moving image file is normal based on the check result (flag or the like) of the moving image file recorded last.

  If the moving image file is not normal (step S9; NO), the moving image repairing apparatus 10 repairs the file (step S10). Specifically, the system control unit 12 repairs the moving image file so that the damaged moving image file can be normally reproduced according to the file repair subroutine.

  If the video file is normal (step S9; YES), the process ends and recording starts.

(2.2 File check subroutine)
Next, a file check subroutine will be described with reference to FIGS.
FIG. 5 is a flowchart illustrating an example of a file check subroutine. FIG. 6 is a schematic diagram illustrating an example of a damaged moving image file. FIG. 7 is a schematic diagram illustrating an example of a damaged moving image file. FIG. 8 is a schematic diagram illustrating an example of a damaged moving image file.

  As shown in FIG. 5, the moving image restoration apparatus 10 determines whether or not the header portion is normal (step S11). Specifically, the system control unit 12 determines whether the header portion of the target moving image file is configured as shown in FIG. For example, the system control unit 12 reads from the head of the header part of the moving image file and determines whether or not the last parameter “moviListSize” of the header part exists. If the power is turned off or the memory card is removed during the generation of the header part, the generation of the header part is not completed and the header part becomes halfway.

  As described above, the moving image restoration apparatus 10 functions as an example of a moving image file acquisition unit that acquires a moving image file.

  Here, as a cause of the damage of the moving image file, there is a case where the power is turned off or the memory card is removed during recording. Further, there are the following three examples of damage patterns of moving image files. As shown in FIG. 6, when the header portion of the moving image file is damaged, as shown in FIG. 7, when the frame portion is damaged (for example, the n + 1th frame is damaged), as shown in FIG. In this case, the index part after the frame is damaged. If the frame is damaged, there is an SOI marker, but there is no EOI marker, and the video file does not have an index part. As described above, since the process at the time of stopping is not normally performed, the moving image file does not have the data size, the number of frames, and the index.

  When the header portion is not normal (step S11; NO), the moving image restoration apparatus 10 sets an abnormal end flag (step S12) and ends the subroutine.

  When the header part is normal (step S11; YES), the moving image restoration apparatus 10 acquires the total number of frames (step S13). Specifically, the system control unit 12 acquires the total number of frames (an example of frame information) of the moving image file from the header part.

  As described above, the moving image restoration apparatus 10 functions as an example of a frame information extraction unit that extracts frame information related to the frame portion of the moving image file from the header portion of the acquired moving image file.

  Next, the moving image restoration apparatus 10 sets a search pointer in the frame portion (step S14). Specifically, in order to search for the top (SOI) of each frame from the top of the moving image file, the system control unit 12 sets a search pointer in the frame portion.

  Next, the moving image restoration apparatus 10 searches for an SOI marker and an EOI marker (step S15). Specifically, the system control unit 12 first searches for the SOI marker while reading from the beginning of the frame portion of the moving image file to obtain the beginning of the frame. Then, the system control unit 12 searches for an EOI marker. While searching, measure the frame size.

  As described above, the moving image restoration apparatus 10 functions as an example of a moving image file acquisition unit that acquires a moving image file.

  Next, the moving image restoration apparatus 10 determines whether or not a marker exists (step S16). Specifically, the system control unit 12 advances the pointer of the memory area of the memory card in the storage unit 13 and determines whether there is an SOI marker or an EOI marker.

  When the marker exists (step S16; YES), the moving image restoration apparatus 10 counts the number of frames and adds an entry to the index (step S17). Specifically, when there is a EOI marker corresponding to the SOI marker, the system control unit 12 increases the count of the number of frames (an example of frame information) by one, and at the same time, the size of the frame (another frame) An example of information) is obtained. Then, the system control unit 12 writes the number of frames, the frame number, the frame size for each frame number, and the like in the memory area for generating the index unit, and sequentially builds the index unit. Note that a memory area for generating the index part is formed in the storage part 13.

  As described above, the moving image restoration apparatus 10 functions as an example of a frame information extraction unit that extracts frame information related to the frame portion of the moving image file from the header portion of the acquired moving image file. In addition, the moving image restoration apparatus 10 functions as an example of a frame information calculation unit that searches for each frame of the frame portion and calculates the frame information. The moving image restoration apparatus 10 functions as an example of a frame information calculation unit that searches each frame of the frame portion and calculates other frame information.

  After adding the entry to the index, the moving image restoration apparatus 10 returns to step S15.

  When the pointer advances and there are no frames and no marker exists (step S16; NO), the moving image restoration apparatus 10 determines whether or not the number of frames is equal (step S18). Specifically, the system control unit 12 determines whether or not the total number of frames (an example of frame information) described in the header part matches the counted number of frames (an example of other frame information). To do. If they do not match, the frame is damaged.

  As described above, the moving image restoration apparatus 10 functions as an example of a comparison unit that compares the extracted frame information with the calculated frame information.

  When the number of frames is not equal (step S18; NO), the moving image restoration apparatus 10 sets a restoration flag (step S19). Specifically, since the system control unit 12 needs to repair the file, it sets a repair flag and ends the subroutine.

  When the number of frames is equal (step S18; YES), the moving image restoration apparatus 10 sets a normal end flag (step S20). Specifically, since the file is not damaged, the system control unit 12 sets a normal end flag and ends the subroutine.

  In addition, as the case where the index part is damaged, when the number of counted frames is not equal to the number of the last frame of the index part, or the total number of frames of the header part is equal to the number of the last frame of the index part. Examples include a case where they are not equal, or a case where there is a final frame offset but there is no final number of frame data. The moving image restoration apparatus 10 determines whether or not the index portion is damaged depending on whether or not these cases are applicable.

(2.3 File restoration subroutine)
Next, the file repair subroutine will be described with reference to FIGS. 9 and 10.
FIG. 9 is a flowchart illustrating an example of a file repair subroutine. FIG. 10 is a schematic diagram illustrating an example of a restored moving image file.

  As shown in FIG. 9, the moving image restoration apparatus 10 sets the number of searched frames in the header part (step S30). Specifically, the system control unit 12 sets the counted number of frames in the tag of the total number of frames in the header part. The number of frames counted is overwritten in dwTotalFrames of the AVIMAINHEADER tag.

  As described above, when the extracted frame information and the calculated frame information are different from each other, the moving image restoration apparatus 10 rewrites the frame information in the header portion with the calculated frame information and restores the moving image file. It functions as an example of means.

  Next, the moving image restoration apparatus 10 adds an index part (step S31). Specifically, based on the index part generated in the storage part 13, the system control part 12, as shown in FIG. 10, after the last frame (nth frame) of the frame part, the index part (tail part) Is added), the moving image file is repaired, and the subroutine is terminated. For example, if the (n + 1) th frame is damaged, an index part is added after the nth frame, and the moving image file is completed. As shown in FIG. 8, when the index part immediately after the nth frame is damaged, the generated index part is added immediately after the nth frame.

  As described above, when the extracted frame information and the calculated frame information are different from each other, the moving image restoration apparatus 10 rewrites the frame information in the header portion with the calculated frame information and restores the moving image file. It functions as an example of means. In addition, the moving image restoration apparatus 10 functions as an example of a moving image file restoration unit that generates a tail portion of the moving image file from the other frame information.

  As described above, according to the present embodiment, a moving image file of a moving image is acquired, frame information related to the frame portion of the moving image file is extracted from the header portion of the acquired moving image file, each frame in the frame portion is searched, Information is calculated, the extracted frame information is compared with the calculated frame information, and if the extracted frame information is different from the calculated frame information, the frame information in the header part is rewritten to the calculated frame information, and the video file By repairing the video file, the video file can be repaired even if a file other than the video file such as a repair file is not recorded.

  Since files other than video files, such as restoration files, are not recorded, the recording medium consumes only the minimum necessary capacity. In a personal computer or the like, file operations such as copying and moving can be completed with only a moving image file. Eliminates the need to prepare a personal computer and move the memory card from the small memory card video recorder to the personal computer.

  Moreover, hardware such as a backup power source and an electric double layer capacitor used for protecting the moving image file when the power is cut off is not required.

  Furthermore, since the moving image file is restored in the apparatus, it is not necessary to develop and install a personal computer or software for the personal computer. Moreover, since it is automatically performed when the memory card is loaded, it does not take time and effort.

  When searching for each frame in the frame part, calculating other frame information, and generating the end part of the movie file from the other frame information, search for each frame in the remaining frame part without damage. Since the end of the movie file is generated, the file can be repaired without using a file other than the movie file.

  Further, when the frame information is the number of frames of the moving image file and the other frame information is the data size of each frame, it can be easily restored from the number of frames and the data size of the remaining frames without being damaged.

  When the file name of the moving image file is a file name indicating the order stored in the storage means (recording medium 13a), and the moving image file stored last in the storage means is acquired based on the file name, It can operate in a short time because it only searches and checks the recorded file. In addition, the destruction of the file due to the power-off or removal of the recording medium corresponds to the moving image file being recorded, that is, the last recorded moving image file. Therefore, only the moving image file is searched, and the processing becomes efficient.

  Furthermore, the present invention is not limited to the above embodiments. Each of the embodiments described above is an exemplification, and any configuration that has substantially the same configuration as the technical idea described in the claims of the present invention and has the same operational effects can be used. It is included in the technical scope of the present invention.

10: moving image restoration device 12: system control unit 13: storage unit 13a: recording medium (storage unit)

Claims (6)

A video file acquisition means for acquiring a video file of a video;
Frame information extraction means for extracting frame information relating to the frame portion of the moving image file from the header portion of the acquired moving image file;
Frame information calculation means for searching for each frame of the frame portion and calculating the frame information;
A comparing means for comparing the extracted frame information with the calculated frame information;
When the extracted frame information and the calculated frame information are different, the frame information in the header part is rewritten to the calculated frame information, and a moving image file repairing unit that repairs a moving image file;
A video restoration apparatus comprising: The moving image restoration apparatus according to claim 1,
The frame information calculation means searches each frame of the frame portion to calculate other frame information,
The moving image restoration apparatus, wherein the moving image file repairing unit generates a tail portion of the moving image file from the other frame information. The moving image restoration apparatus according to claim 2,
The moving image restoration apparatus, wherein the frame information is the number of frames of the moving image file, and the other frame information is a data size of each frame. In the moving image restoration device according to any one of claims 1 to 3,
The file name of the video file is a file name indicating the order stored in the storage means,
The moving image restoration apparatus, wherein the moving image file acquisition unit acquires a moving image file stored last in the storage unit based on the file name. A video file acquisition step in which the video file acquisition means acquires a video file of the video;
A frame information extraction step for extracting frame information relating to the frame portion of the moving image file from the header portion of the acquired moving image file;
Frame information calculation means for searching for each frame of the frame portion and calculating the frame information;
A comparison step in which a comparing means compares the extracted frame information with the calculated frame information;
If the extracted frame information and the calculated frame information are different from each other, the moving image file repairing unit rewrites the frame information in the header part with the calculated frame information, and repairs the moving image file.
A moving image restoration method characterized by comprising: Computer
Video file acquisition means for acquiring video files of videos,
Frame information extracting means for extracting frame information relating to the frame portion of the moving image file from the header portion of the acquired moving image file;
Frame information calculation means for searching for each frame of the frame portion and calculating the frame information;
A comparison means for comparing the extracted frame information with the calculated frame information; and
When the extracted frame information and the calculated frame information are different, the frame information in the header portion is rewritten with the calculated frame information to function as a moving image file repairing unit that repairs a moving image file. Program for repair device.

Images