JPH08205076A - Moving image editing apparatus and moving image editing method - Google Patents

Abstract

(57) [Summary] [Purpose] To perform moving image editing while minimizing the deterioration of moving images encoded by interframe coding. A moving image data encoded by an encoding method including an interframe code and stored in a storage medium is decoded, the decoded moving image data is displayed, and the moving image data displayed on the display means is displayed. When the editing instruction is given, the minimum number of frame images is intraframe-encoded in order to decode the moving image data instructed by the instructing means among the moving image data stored in the recording medium.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a moving image editing apparatus and a moving image editing method.

[0002]

2. Description of the Related Art Recently, an encoding method for encoding a digital moving image at a high compression rate by utilizing inter-frame correlation has been internationally standardized. The representative one is MPEG.
MPEG makes maximum use of inter-frame correlation, refers to frames before and after the frame to be encoded, performs motion compensation, and then performs inter-frame differential encoding. FIG. 5 shows an example of MPEG encoding. I is the encoding frame type of MPEG.
Frames, P frames, and B frames are coded as shown. The I frame is an independent frame by intra-frame coding, and one frame is inserted into 15 frames.
The P frame is an interframe code that performs motion compensation by referring to the preceding P frame or I frame in the forward motion prediction frame. The B frame is an inter-frame prediction code for motion compensation by predicting from both directions of the P frame and the I frame before and after the B frame. The unit of motion compensation is performed in block units called macroblocks (MB) as shown in FIG. MB is Y1 after digitizing a moving image into a sample ratio of 4: 1: 1 of Y (luminance) Cb and Cr (color difference) components.
The unit is a block of 6 × 16 pixels, Cb8 × 8 pixels, and Cr8 × 8 pixels.

[0003]

Motion compensation is performed in B frames and P frames, but since a block having a strong correlation must be searched (vector search) in macroblock units, the processing of the coding unit performs decoding. There is a drawback that it is more complicated than a part. In particular, it is difficult to perform the encoding in real time when the encoding is executed only by software. Therefore, the actual situation is that only decryption is performed by software. Moreover, when the encoding unit is implemented by hardware, there is a drawback that the circuit scale becomes enormous.

Further, as described above, the coding utilizing the inter-frame phase has a problem in performing the editing process. In the encoding using the inter-frame difference, for example, if the moving image is divided into two sequences at the position shown in FIG. 5, the last frame cannot be decoded in the previous sequence, and the next I frame is decoded in the later sequence. There was a flaw that I could not do.

In order to solve the above-mentioned problem, there is a moving image processing apparatus which uses only the intraframe coding method without using the interframe coding. For example, there is a motion JPEG in which a JPEG method for encoding a color still image is independently applied to each frame of a moving image. Motion JPEG
In the case of, MPEG is also used because the encoding is intraframe encoding.
It is not so complicated and frame editing can be done freely, but since it does not use interframe correlation, it has the drawback of being considerably worse in compression efficiency than interframe coding.

It is an object of the present invention to provide a moving picture editing apparatus and a moving picture editing method that solve the above-mentioned drawbacks.

Another object of the present invention is to provide a moving image editing apparatus and a moving image editing method in which the amount of image data to be decoded is suppressed as much as possible when performing editing processing on a predetermined frame.

It is a further object of the present invention to provide a moving image editing apparatus and a moving image editing method capable of high-speed encoding of input moving image data and capable of performing highly compressed image compression after editing. .

Another object of the present invention is to provide a moving image editing apparatus and a moving image editing method which are simple and capable of quick moving image editing.

A further object of the present invention is to provide a moving image editing apparatus and a moving image editing method capable of editing an inter-frame coded moving image with a minimum deterioration in image quality.

[0011]

In order to solve the above-mentioned problems, a first invention is a first coding means for coding input moving image data by a speed-oriented coding method.
Storage means for storing the moving image data encoded by the encoding means, editing means for editing the encoded moving image data, and an encoding method emphasizing a compression rate more than the first encoding means. A second encoding means for encoding the edited moving image data.

Further, a second aspect of the present invention is a frame encoding means for decoding moving image data encoded by an encoding method including interframe encoding, and moving image data decoded in parallel with the decoding by the decoding means. It is characterized in that it has an encoding means for encoding by inner encoding and an editing means for editing the encoded moving image data in frame units.

Further, a third aspect of the invention is a decoding means for decoding moving image data encoded by an encoding method including an interframe code and stored in a storage medium, a display means for displaying the decoded moving image data, Instructing means for giving an editing instruction to the moving image data displayed on the display means, the minimum number of frame images for decoding the moving image data instructed by the instructing means out of the moving image data stored in the recording medium. It is characterized in that it has an encoding means for an intra-frame code.

[0014]

【Example】

<First Embodiment> FIG. 1 is a block diagram of the first embodiment. 1 is a video camera for inputting a moving image, 2 is a capture board unit for generating each frame of the moving image, 3 is a JPEG Eudic unit for performing intra-frame encoding and decoding (the program is processed by the CPU 9), 4 is A disk for storing a moving image, 5 is a video RAM unit for outputting a decoded moving image to the display 7, and 6 is an M for encoding / decoding an inter-frame encoded moving image.
A PEG editing unit (a program is processed by the CPU 9), and 9 is a CPU for controlling this apparatus. The moving image to be processed is input from the video camera 1 and digitized by the video capture board unit. Reference numeral 19 is an operation unit including a mouse pointer described later. In this embodiment, 360 pixels × 240 lines are set as one frame, and 3 frames are displayed per second.
A digital moving image of 0 frame is generated. The pixel signal uses the YCbCr signal 4: 1: 1 sampling performed by MPEG etc. The YCbCr signal generated by the capture board unit 2 is sent to the JP via the computer bus 8.
The encoding that is encoded in real time in the EG codec unit 3 is performed within the frame. The encoding is performed by the JPEG method by regarding each frame as a still image in frame units.

Since the JPEG encoding method is well known, its explanation is omitted. The encoded moving image of 30 frames per second is stored in the disk 4 via the computer bus 8 in real time. Further, in parallel with the encoding, the digital moving image generated by the capture board unit 2 is sent to the video RAM unit 5 and a signal RG for displaying the moving image.
After being converted into a B signal, it is displayed in real time on the display 7. By the above process, the moving image input from the video camera 1 is displayed on the display 7 in real time, and the coded data is encoded by the JPEG codec unit 3 and stored in the disk 4. The input of the moving image disk 4 is continued until the end of one moving image scene (hereinafter referred to as a sequence). One sequence that has been input is displayed on the display 7 as necessary.
To be played. The regeneration process is carried out as follows. The code of one sequence is sequentially read out in frame units and is sent via the computer bus 8 to the JPEG CODEC unit 3 which can be coded at a higher speed than MPEG and is decoded. The decoded frame is 360 pixels x 240
The YCbCr signal of the line is sequentially transferred to the video RAM unit 5 frame by frame, and is displayed on the display unit 7 in the same manner as the above-mentioned real-time moving image input display (hereinafter referred to as normal reproduction).

Normally, when one moving picture sequence is input, unnecessary portions are often included before, after, or in the middle of the sequence. Therefore, in the embodiment, the editing process is performed by utilizing the fact that the intra-frame code is independent of each frame. FIG. 2 shows an example of editing.
Reference numeral 7 is a display in which an editing window 10 is displayed. In this window, each frame of the decoded moving image sequence is displayed in a reduced size. For the reduction, the normal method of simply thinning out is used, and the resolution is set so that the contents can be understood so that several frames can be displayed simultaneously. Reference numeral 15 is a frame which is a point of interest during editing. 14, 13, and 12 are the previous frame, the previous frame, the previous frame, and the previous frame, respectively.
Reference numerals 6, 17, and 18 are frames after one, after two, and after three.

In the case of normal reproduction, the 360 × 240 pixel size is displayed in another window (not shown), but in the case of edit reproduction, a plurality of frames before and after are displayed in this manner.
Pixels reduced to about / 4 × 1/4 are reproduced. In editing / playback, the frame 15 is displayed as a playback point with the preceding and following frames flowing as arrows. The display shows normal speed, slow speed frame advance, etc., if necessary. An editing toolbar 11 is for cutting unnecessary frames and selecting only necessary frames.
In the case of FIG. 2, the frames 13 to 17 are selected (hatched bar) by the mouse pointer.
In this case, the parts before frame 12 and the parts after frame 18 are unnecessary parts. The frames other than the necessary part selected in this way are deleted and edited from the disc 4. The code data stored in the disk 4 is an intra-frame code and can be easily edited. In this embodiment, the CPU
9, the frame editing process is performed by software. The edited code data can be confirmed by performing normal reproduction as described above.

The above-mentioned editing process is performed based on the intra-frame code data which is easy to edit. After the editing is completed, it is converted into an interframe code having a higher compression efficiency than the intraframe coding, and the moving image is efficiently stored in the disk 4 again. The edited intra-frame code 1 sequence stored in the disk 4 is read out for each frame and decoded by the JPEG CODEC unit 3 in the same manner as during normal reproduction.
However, since recoding to the interframe code does not need real-time property, the JPEG codec unit 3 may perform decoding according to the speed of the interframe code. In this embodiment, the MPEG system is used to re-encode the decoded moving image into the inter-frame encoded frame image. In addition, since the re-coding is done by software by the CPU 9, CP
It will be held using the time when U was open. The MPEG encoding is interframe / intraframe encoding into three frame types of I frame, P frame and B frame as shown in FIG. The frames that have been encoded are re-stored in the disk 4 sequentially, and the sequence is completed until the re-encoding ends. After the end, the sequence of the unnecessary intra-frame code is erased, so that the sequence is converted into a sequence with improved compression efficiency, and the disk 4 is used efficiently.

The moving picture sequence thus re-encoded into the inter-frame code can be sequentially decoded by the MPEG decoder 6 if necessary, and can also be normally reproduced on the display 7 via the video RAM section 5.

As described above, by inputting a moving image in real time by intraframe coding, M
The circuit scale is smaller and easier than the case of using the interframe coding by PEG, and the moving image can be easily edited by using the intraframe code. In addition, by converting the post-editing code into an interframe code with high compression efficiency, moving image processing with simple inputting and editing of a moving image and high compression efficiency is realized.

<Second Embodiment> FIG. 3 is a diagram showing a second embodiment. In this embodiment, the moving image is already digitally encoded and stored in an optical recording medium such as a CD-ROM (the recording medium is not limited to the optical recording medium and may be a magnetic storage medium such as an FD). Is. FIG. 20 shows a CD
It is a ROM player and is connected to the computer bus 8 by a SCSI bus. Also, in the figure, the same numbers as in FIG. 1 mean the same configurations. The CDROM player 20 is a moving image reading device for displaying the moving image data normally stored in the CD-ROM on the display 7. CDR
The code is read from the OM player 20 at a constant bit rate. Usually, this kind of storage moving image is often inter-frame coded in consideration of compression efficiency. In the present embodiment, a moving image encoded by the MPEG system is recorded on a CD-
The case of reading from the ROM will be described. One sequence code read from the CDROM player 20 is decoded in real time by the MPEG decoder 6 via the computer bus 8. Frame images (3
(60 × 240Y, Cb, Cr) is sequentially converted into a JPEG code which is an intraframe code by the JPEG codec 3 via the computer bus 8 again frame by frame. At the same time, the frame image decoded by the MPEG decoder 6 is normally reproduced on the display 7 via the video RAM unit 5. Sequences encoded by the JPEG CODEC 3 are sequentially stored on the disc 4 and stored for a sequence having a required length. After the storage is completed, frame editing can be performed as necessary as described in the first embodiment. It is also possible to re-encode the inter-frame code to improve the compression efficiency.

By thus re-encoding the intra-frame code while decoding the inter-frame coded moving image, editing in frame units can be performed quickly and easily.

<Third Embodiment> In the second embodiment,
Although the MPEG code is decoded for all sequences and converted into the intraframe code, it is also possible to convert only the nearby frames to be edited into the intraframe code as follows. In FIG. 3, a recording medium capable of optical recording, magnetic recording, etc. (in this embodiment, C
The MPEG code (interframe code) stored in the D-ROM) is decoded by the MPEG decoder 6 and only the display is displayed. At this time, re-encoding is not performed by the JPEG codec. The display is edited and reproduced as described in FIG. As described above, the necessary part is designated on the editing toolbar 11. However, if the edited portion is inter-frame coded, frame editing cannot be performed easily. Therefore, partial intraframe code conversion as shown in FIG. 4 is performed. As the inter-frame code, I-frames, P-frames, and B-frames are coded between I-frames (15 frames) by MPEG coding as described in FIG.

As an example, when cutting a portion between the second frame and the third frame in FIG. 4 between the B frames, the last B frame of the sequence before the cutting portion cannot be reproduced, and the next frame in the subsequent sequence cannot be reproduced. It becomes a state (broken link) in which I frames cannot be reproduced.
Therefore, in the present embodiment, from the P frame including the cut portion to P
By editing four frames up to the frame (between I and P in the case of I frame) and re-coding to I frame, frame editing at any position becomes possible. CDROM in Figure 3
The MPEG decoder 6 decodes 4 frames including the portion to be cut of the sequence read from the CPU 20, and the CPU 9
Can be partially re-encoded as an intra frame by arithmetic processing, that is, software. Further, instead of re-encoding the intra frame by software, it is possible to perform intra-frame encoding by the JPEG codec 3. In the case of editing, not all the encoded frames are decoded as in the present embodiment, but the minimum number of frame images including the frame image for which editing is instructed and the frames other than the edited frame can be reproduced later. By partially re-encoding only the intra-frame code to the intra-frame code, it is not necessary to re-encode the inter-frame code to improve the compression rate after editing, and the image quality deterioration can be minimized before and after the editing.

[0025]

As described above, according to the present invention, the first
According to the invention, the input moving image data can be encoded at a high speed with a relatively small circuit scale and easily, arbitrary frame editing is possible, and moving image processing with high compression efficiency of the edited moving image data is possible. Become.

According to the second aspect of the present invention, it is possible to perform moving image editing capable of quickly editing inter-frame encoded moving image data.

According to the third aspect of the present invention, the frame image to be decoded is minimized in the moving image data which is inter-frame coded, so that it is possible to carry out the editing process while minimizing the deterioration of image quality.

[Brief description of drawings]

FIG. 1 is a diagram showing a first embodiment.

FIG. 2 is an example of a display screen for editing.

FIG. 3 is a diagram showing a second embodiment.

FIG. 4 is a diagram showing an example in which intra-frame coding is partially performed in one sequence.

FIG. 5 is a diagram showing a state of a sequence when interframe coding is performed.

FIG. 6 is a diagram showing a macro block.

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁶ Identification code Internal reference number FI Technical indication H04N 7/137 Z

Claims (25)

[Claims] 1. A first encoding unit that encodes input moving image data by an encoding method that emphasizes speed, and a storage unit that stores the moving image data encoded by the first encoding unit. Editing means for editing the encoded moving image data, second encoding means for encoding the edited moving image data by an encoding method that emphasizes a compression rate more than the first encoding means, A moving image editing apparatus comprising: 2. The image editing apparatus according to claim 1, wherein the first encoding and the second encoding are performed based on an encoding conversion program. 3. The moving image editing apparatus according to claim 1, wherein the second coding means is coding including interframe coding. 4. The moving image editing apparatus according to claim 1, wherein the first encoding means is intra-frame encoding. 5. The moving image editing apparatus according to claim 1, wherein the editing is editing in units of frame images forming the moving image data. 6. The moving image editing apparatus according to claim 1, wherein the first encoding means performs an encoding process on the input of the moving image data in real time. 7. A display means for displaying the moving image data and an instruction means for giving an editing instruction to the editing means, wherein the editing means responds to an instruction from the instruction means on the display means. The moving image editing apparatus according to claim 1, wherein editing is performed. 8. The moving image editing apparatus according to claim 7, wherein the display unit displays the moving image data as a plurality of frame images in a multi-image display. 9. The moving image editing apparatus according to claim 8, wherein the multi-image is an image obtained by reducing a frame image included in the moving image data. 10. The moving image editing apparatus according to claim 7, wherein said editing means editing the encoded moving image data stored in said storage means in response to an instruction from said instruction means. 11. A width encoding means for decoding moving image data encoded by an encoding method including interframe encoding, and intraframe encoding of moving image data decoded in parallel with the decoding by the decoding means. A moving image editing apparatus, comprising: an encoding unit that encodes the encoded moving image data; and an editing unit that edits the encoded moving image data in frame units. 12. The image editing apparatus according to claim 11, wherein the encoding and decoding are performed based on a conversion program. 13. The apparatus according to claim 1, further comprising display means for displaying the decoded moving image data.
The moving image editing apparatus according to item 1. 14. The moving image editing apparatus according to claim 11, further comprising storage means for storing the edited moving image data. 15. The moving image editing apparatus according to claim 11, further comprising storage means for storing moving image data encoded by an encoding method including the interframe encoding. 16. Decoding means for decoding moving image data encoded by an encoding method including an interframe code and stored in a storage medium, display means for displaying the decoded moving image data, and display on the display means. Instructing means for giving an editing instruction to the specified moving image data; intraframe coding of the minimum number of frame images for decoding the moving image data instructed by the instructing means among the moving image data stored in the recording medium. A moving image editing apparatus, comprising: 17. The image editing apparatus according to claim 16, wherein the encoding and decoding are performed based on a conversion program. 18. The image editing apparatus according to claim 16, wherein the editing process is a cutting process of the moving image data. 19. The image editing apparatus according to claim 16, wherein the encoding including the interframe code is MPEG. 20. The moving image editing apparatus according to claim 16, wherein the display unit displays the moving image data in a multi-image display with a plurality of frame images. 21. The moving image editing apparatus according to claim 20, wherein the multi-image is an image obtained by reducing a frame image included in the moving image data. 22. The minimum number of frame images is an image having a number of frames including the frame image designated by the designating unit and capable of decoding the moving image data without a broken link. The moving image processing apparatus described. 23. The input moving image data is encoded by a speed-oriented encoding method, the moving image data encoded by the encoding means is stored, and the encoded moving image data is stored. A moving image editing method, comprising: editing and encoding the edited moving image data by an encoding method that emphasizes a compression rate rather than the encoding. 24. Decoding the moving image data encoded by an encoding method including inter-frame encoding, encoding the moving image data decoded in parallel with the decoding by intra-frame encoding, A moving picture editing method, characterized in that the modified moving picture data is edited frame by frame. 25. A moving image displayed on the display means for decoding moving image data encoded by an encoding method including an interframe code and stored in a storage medium, and displaying the decoded moving image data. An editing instruction is given to the data, and a minimum number of frame images are intraframe-encoded to decode the moving image data instructed by the instructing means among the moving image data stored in the recording medium. Video editing method.