JPH11177987A - Video information processing apparatus and method - Google Patents

Abstract

(57) [Summary] [PROBLEMS] When processing interlaced frames, dropped frames occur, and the "flickering" and "fluctuations" that occur when the immediately preceding or succeeding frame or field is copied to compensate for the dropped frames. To solve such problems. SOLUTION: By temporarily converting an interlaced frame into a progressive frame and processing the progressive frame as an interlaced frame, half of the time component of the interlaced frame is discarded, and "flickering" in a dropped frame portion is prevented. Also, by converting the frame only when a dropped frame occurs instead of always converting it to a progressive frame, the loss of the time component can be minimized, and the same problem can be solved by saving computer resources.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video information processing apparatus for coding video information.

[0002]

2. Description of the Related Art With the development of digital technology in recent years, video information such as a video image, which can be handled only in an analog form in the past, can be handled in a digital form. In addition, with the high performance of personal computers,
It has become possible to process digitized video information with a personal computer.

FIG. 11 shows a data structure when an analog video signal such as NTSC is converted into digital data by an image capturing device (hereinafter, a capture card) for a personal computer which is generally sold. In the NTSC signal, an image is composed of an even field and an odd field. The even field and the odd field are spatially shifted by one line, and are temporally shifted by 6 lines.
There is a 1/0 second shift. In an ordinary capture card, an even field and an odd field of such an NTSC signal are converted into one frame, such as 1101, in which the odd field and the even field are combined line by line, every one thirtieth of a second. At a time interval, capture in the computer. As described above, when two fields that are originally shifted in time and space are handled as one frame, the frame is called an interlaced frame. That is, in the currently popular capture card, the NTSC signal is digitized as an interlaced frame and taken into the computer.

A conventional example of a video information processing apparatus that encodes an interlaced frame captured in a computer using the above-described capture card and outputs the encoded video information as encoded video information will be described with reference to the drawings. Figure
FIG. 12 is a diagram illustrating a configuration of a video information processing apparatus according to a conventional technique. Reference numeral 1201 denotes an interlaced video output unit which outputs an interlaced frame, and is generally realized by a capture card or the like, which inputs an NTSC signal,
It is output as an interlaced frame after digitization. Reference numeral 1202 denotes a video encoding unit that encodes an interlaced frame input from the interlaced video input unit (1201) to generate encoded video information. In this example, it is assumed that an interlaced frame is coded as it is as an interlaced frame. For example, according to the coding standard of MPEG2 (Moving Picture Expert Group), a code indicating that the coded video information is an interlaced frame is prepared. I assume. However, the related art can be explained even if other coding means such as dividing an interlaced frame into fields and coding the data for each field is applied. This will be described later. FIG. 13 is a diagram for explaining the operation of the video information processing apparatus according to the related art.

[0005] A video information processing apparatus according to the prior art configured as described above will be described with reference to FIGS. First, the NTSC signal is input to the interlaced video output means (1201), and the interlaced video output means (1201) digitizes this and outputs it as an interlaced frame. The video encoding means (1202) encodes the interlaced frame and outputs the encoded interlaced frame as an encoded interlaced frame. Repeat this.

The manner in which the encoded interlaced frame output as described above is decoded will be described.
FIG. The encoded interlaced frame is restored to an interlaced frame by the video decoding unit. The NTSC output means divides the interlaced frame into an even field and an odd field, and outputs an analog signal.

[0007]

The video information processing apparatus according to the prior art encodes an interlaced frame as it is, as described in the above example. In such a method, the interlaced video output means ensures
The condition is to output all frames. if,
In the case where the interlaced video output means drops frames and has to encode them, the conventional technique has an essential problem.

FIG. 15 is a diagram for explaining the above problem. In FIG. 15, it is assumed that an NTSC signal composed of six fields has been input to the interlaced video output means. 1 to 6 to show the temporal arrangement of the six fields
No. was shown. 1 is the oldest image and 6 is the newest image. As described above, the six fields (1 to 6) were input to the interlaced video output unit, but due to the high encoding load and the lack of a buffer for digitized interlaced video, One frame dropped, the center two of the six fields (3,4)
Does not result in an interlaced frame. In other words, only three interlaced frames were originally output, whereas only two were output. Therefore, the video encoding means outputs a code "same as the previous frame" for the frame in which the frame was dropped (b in FIG. 15),
It was encoded video information.

FIG. 16 illustrates the manner in which the video information encoded as described above is decoded. The video information encoded above is decoded into an interlaced frame by the video decoding means. However, since the b of the encoded video is a code of “the same as the previous frame”, the first interlaced frame is used. The frame is copied and used as a second interlaced frame. The NTSC output means divides the interlaced frame thus decoded into an even field and an odd field, and outputs an analog signal. At this time, the first interlaced frame has a time-varying field of "1, 2", and the second frame uses the first frame copied and used. The frame also has a time-varying field such as “1, 2”. this
When output as an NTSC signal, first, a field "1,2" is output, and then a field "1" is output again. This is instantaneous, but it means "return to the past", and when outputting a moving image, the moving image "1, 2" returns with "1", causing the problem that the image "flickers" Resulting in.

In order to avoid the problem shown in FIG. 16, b in FIG. 15 is designated by a sign "both even and odd fields are the same as the previous even field". That is, FIG.
The problem indicated by is caused by the fact that a frame having two fields that are temporally different is originally copied and used as it is, so that the problem can be avoided by copying and using a single field. Should be.

FIG. 17 illustrates how the video information encoded as described above is decoded. The video information encoded above is decoded into an interlaced frame by the video decoding means, but b of the encoded video is a code that "even and odd fields are the same as the previous even field". Only the even fields of the first interlaced frame are copied and used as the second interlaced frame. The interlaced frame thus decoded is output by the NTSC output means.
It is divided into an even field and an odd field and output as an analog signal. At this time, since the second frame uses the even field of the first frame by copying twice, the second frame is the same as “2,2”, which does not change with time. Will have fields.
When this is output as an NTSC signal, temporally, "1,2,
2,2,5,6 ", and there is no" return to the past ", so that the problem of" flicker "as shown in FIG. 16 can be avoided. However, spatially, an image in an even-numbered field is originally displayed on an odd-numbered field, that is, on one line (X in FIG. 17).
The problem occurs. This is a problem that is particularly noticeable when outputting a still image.

In the above-described example of the prior art, the video encoding means encodes the interlaced frame as it is as the interlaced frame. However, other than that, for example, the interlaced frame is encoded in the field. It goes without saying that the same problem as described above occurs even if an encoding means for performing division and encoding for each field is applied. Also, in this example, a sign "same as previous frame" or "same as previous field" is used for a dropped frame, but the code is not used and the previous frame or field is used. Even if the dropped frame is encoded using the same video as it is, the same problem naturally occurs. Also, instead of the sign "Same as previous frame",
Even if the code "same as the next frame" is used, the same problem still occurs. In other words, if the field used to compensate for the dropped frame is different from the field of the dropped frame and the even and odd numbers, a spatial problem will occur, and if you try to match the even and odd numbers,
Time issues arise. The present invention has been made in view of the above-described problems of the conventional video information processing apparatus, and has been developed to avoid the problem of "flickering" and "sway" even if a frame drop occurs due to system load fluctuation. The purpose is to make it possible to supplement the parts.

[0013]

According to a first aspect of the present invention, there is provided a video information processing apparatus, comprising: One frame is progressively converted to a progressive frame, the progressive frame is processed as an interlaced frame, and a frame immediately before or immediately after a frame drop is copied and supplemented in a frame drop section.

In the video information processing apparatus according to the second aspect, only when a frame is dropped, the interlaced frame immediately before or immediately after the dropped frame is temporarily replaced with one of the fields constituting the frame. By performing progressive conversion to a progressive frame, the progressive frame is processed as an interlaced frame,
The frame drop section is characterized in that the frame immediately before or immediately after the frame drop is copied and supplemented.

In the video information processing apparatus according to the third and fifth aspects, only when there is a dropped frame, the field immediately before or immediately after the dropped frame is progressively converted into a progressive frame, and the dropped frame is processed. Is characterized in that this progressive frame is supplemented by processing as an interlaced frame.

Also, in the video information processing method according to claim 6 and claim 9, all the interlaced frames are
Once, one of the fields that make up the frame is progressively converted to a progressive frame, the progressive frame is processed as an interlaced frame, and the frame immediately before or immediately after the frame drop is copied to the frame drop section. It is characterized by supplementing.

According to the video information processing method of the present invention, the interlaced frame immediately before or immediately after the frame drop is replaced with one of the fields constituting the frame only when the frame drop occurs. By performing progressive conversion to a progressive frame, the progressive frame is processed as an interlaced frame,
The frame drop section is characterized in that the frame immediately before or immediately after the frame drop is copied and supplemented.

In the video information processing method according to the eighth and tenth aspects, only when a frame is dropped, a field immediately before or immediately after the dropped frame is progressively converted into a progressive frame, and the dropped frame is processed. Is characterized in that this progressive frame is supplemented by processing as an interlaced frame.

[0019]

DESCRIPTION OF THE PREFERRED EMBODIMENTS (Embodiment 1) A video information processing apparatus according to Embodiment 1 of the present invention temporarily converts all the fields of an interlaced frame into progressive frames, and encodes them as interlaced frames. Is what you do.

FIG. 1 is a block diagram of a video information processing apparatus according to the first embodiment of the present invention, and FIG. 2 is a diagram for explaining the operation of the video information processing apparatus. In the figure, 101 is an interlaced video output means, which outputs an interlaced frame, and is generally realized by a capture card or the like,
An NTSC signal is input, digitized, and then output as an interlaced frame. Reference numeral 102 denotes a video encoding unit that encodes the progressive frame converted by the progressive conversion unit (104) as an interlaced frame. Also, the frame drop detection means
When (103) detects the dropped frame of the progressive frame output by the progressive conversion means, the frame is dropped to the same position as the interlaced frame immediately before the dropped frame.
Is output. Reference numeral 103 denotes a dropped frame detecting unit which detects dropped frames of a progressive frame output from the progressive conversion unit (104). 104 is a progressive conversion means, one of the fields constituting the interlace frame output by the interlace video output means (101), one field,
This is converted into a progressive frame. Here, how the fields are converted into progressive frames is shown in FIG. In FIG. 3, a line that is a gap in field 2 is interpolated to convert the line into a progressive frame. The pixel a in the field 2 is created by averaging the pixels constituting the adjacent upper and lower lines. This is called intra-field interpolation. Also, pixel b in field 2 is
Is created by copying the pixel at the corresponding position. This is called inter-field interpolation. If the inter-field interpolation is performed, the resolution of the progressive frame is strictly doubled. However, if the inter-field interpolation is performed in a moving part, the image is doubled and an unsightly image is obtained. In the case of intra-field interpolation, the resolution is reduced, but it can be applied even to a moving part. As described above, many studies have been made on a technique of line-interpolating a field into a progressive frame. The progressive conversion means (104) of the present example converts an even field among the fields constituting the interlaced frame into a progressive frame by using any method. As can be seen from the above example, the converted progressive frame has twice the vertical resolution but temporally has only the time component at the time of the even field.

The operation of the video information processing apparatus according to the first embodiment configured as described above will be described with reference to FIGS. First, the NTSC signal is used to output interlaced video.
(101), the interlaced video output means (101)
This is digitized and output as an interlaced frame. Here, the fields are input in the order of "1,2,3,4,5,6,7,8".
"1,2" interlaced frames that should be output
Only three cards with time elements of "3,4" and "7,8" were output. The progressive conversion means (104) converts this interlaced frame into a progressive frame only for even fields. Since only the even fields are progressive frames, the vertical resolution is doubled,
The time elements are "2", "4", and "8", and three progressive frames are output. The video encoding means (102) encodes the progressive frame as an interlaced frame, and obtains "a", "b", and "d".
The dropped frame detecting means (103) detects the occurrence of dropped frames by reading the time stamp given to the progressive frame. Frame drop detection means (1
03), the video encoding means (102)
The code "c" is output, which is the same as.

The manner in which the encoded interlaced frame output as described above is decoded will be described.
FIG. The encoded interlaced frame is restored to an interlaced frame by the video decoding unit. The NTSC output means divides the interlaced frame into an even field and an odd field, and outputs an analog signal. At this time, “c” is the same sign as “b”, and “a”, “b”, and “d” are the images once converted to progressive frames as interlaced frames. Because it is coded, the vertical resolution is twice that of the field, but the temporal elements are only "2", "4", and "8".
Therefore, the temporal element of the reproduced video is "2,2,4,
4,4,4,8,8 ". In other words, the problem of "flickering" due to "time back", which was a problem with the conventional technology, can be solved.Furthermore, since the vertical resolution is interpolated by converting to a progressive frame, it is originally displayed in an even field. The problem of "fluctuation" caused by displaying an image to be displayed in an odd field can also be solved.

In this embodiment, the even field is progressively transformed. However, the odd field can be progressively transformed. In this example, the frame drop detecting means detects the frame drop by reading the time stamp given to the progressive frame. However, the frame drop detecting information is output from the progressive converting means or the interlaced video output means. Can also be achieved. In this example, the video encoding means encodes progressive frames as interlaced frames.
For example, the present invention can be applied even if an encoding unit that divides a progressive frame for each line into fields and encodes each field is applied. Also, in this example, the code "same as the previous frame" is used for the portion where the frame was dropped, but the portion where the frame was dropped using the same video as the previous frame without using the code is used. Can be naturally solved by encoding. In addition, the problem can be solved even if the code “same as the next frame” is used instead of the code “same as the previous frame”.

Further, in the present embodiment, the encoding of the image is performed as the processing of the output interlaced frame, but the present invention is not limited to such processing. It goes without saying that the present invention as described in the present embodiment can be implemented not only in the encoding processing but also in general image processing. In this case, instead of using the same sign as “immediately before or immediately after” in the frame dropping portion, if the frame immediately before or immediately after is copied, and a frame dropping countermeasure, etc. Good.

(Embodiment 2) In the video information processing apparatus according to Embodiment 2 of the present invention, when a frame is dropped, only the interlaced frame immediately before or immediately after the dropped frame is displayed.
The field is temporarily converted into a progressive frame, which is encoded as an interlaced frame, and a code indicating that the frame is the same as the image converted into the progressive frame is output in the dropped frame portion.

FIG. 5 is a block diagram of a video information processing apparatus according to a second embodiment of the present invention, and FIG. 6 is a diagram for explaining the operation of the video information processing apparatus. In the figure, reference numeral 501 denotes a video encoding unit which encodes an interlaced frame output by the interlaced video output unit (101), and a dropped frame detecting unit (502) detects dropped frames of the interlaced frame. Is detected, the interlaced frame immediately before the frame drop is not coded, and the progressive frame output by the progressive conversion means (503) is replaced with
The frame is encoded as an interlaced frame, and a code "same as the immediately preceding interlaced frame" is output for the dropped frame portion. Reference numeral 502 denotes a dropped frame detecting unit which detects dropped frames in an interlaced frame output by the interlaced video output unit (101). 503 is a progressive conversion means, when the dropped frame detecting means (502) detects dropped frames, among the fields constituting the interlaced frame immediately before the dropped frame portion, converts even fields into progressive frames and outputs Is what you do. The method of converting a field into a progressive frame is the same as the method described in the first embodiment. Other components are the same as those in the first embodiment, and a description thereof will not be repeated.

The operation of the video information processing apparatus according to the second embodiment configured as described above will be described with reference to FIGS. First, the NTSC signal is used to output interlaced video.
(101), the interlaced video output means (101)
This is digitized and output as an interlaced frame. Here, the fields are input in the order of "1,2,3,4,5,6,7,8".
"1,2" interlaced frames that should be output
Only three cards with time elements of "3,4" and "7,8" were output. This frame drop is detected by frame drop detection means (5
02) is detected by reading the time stamp given to the interlaced frame, and progressive conversion means
A conversion instruction is issued to (503). The progressive conversion means (503) receives the conversion instruction, and only the even-numbered fields of the interlaced frame immediately before the frame drop portion are output.
Use progressive frames. Since only the even fields are progressive frames, the vertical resolution is doubled, but the time element is "4". One progressive frame is output. On the other hand, the video encoding means (501) receives the instruction of dropped frames from the dropped frame detection means (502), does not encode the interlaced frames (3, 4) immediately before the dropped frame portion, and The progressive frame output from the conversion means (503) is encoded as an interlaced frame ("b" in the figure). For the dropped frame portion, a code (“c” in the figure) “Same as previous interlaced frame” is output. Further, the subsequent interlaced frames (7, 8) are encoded as interlaced frames as usual ("d" in the figure).

The manner in which the encoded interlaced frame output as described above is decoded will be described.
FIG. The encoded interlaced frame is restored to an interlaced frame by the video decoding unit. The NTSC output means divides the interlaced frame into an even field and an odd field, and outputs an analog signal. At this time, “c” has the same sign as “b”, and “b” is
Since the image once converted to a progressive frame is encoded as an interlaced frame, the vertical resolution is twice the field, but the temporal element is only "4". Therefore, the temporal element of the reproduced video is “1,2,4,4,4,4,7,8”. That is,
The problem of "flickering" that was a problem with the conventional technology can be solved.In addition, since the vertical resolution is interpolated by converting to a progressive frame, an image that should be originally displayed in an even field is displayed in an odd field. This can solve the problem of "sway". Further, Embodiment 1
In, since the even field of all frames was progressively converted, the temporal element of all frames was halved, and even if frame dropping did not occur, the image that should originally rotate once in 1/60 second, Once every 1/30 second, there was a problem that the motion was nervous, but in the present embodiment, only when a frame drop occurs, progressive conversion is performed, so unless a frame drop occurs, 1/60 second smooth playback can be realized. Furthermore, by performing progressive conversion only when dropped frames occur,
There is also an advantage that computer resources can be saved as compared with the case where progressive conversion is performed for each frame.

In this embodiment, the even field is progressively converted. However, the odd field can be progressively converted. In this example, the video encoding means encodes a progressive frame as an interlaced frame, but other than that, for example, the progressive frame is divided into lines to form fields, and The present invention can be applied even if an encoding unit that encodes the data is applied. Also, in this example, the code "same as the previous frame" is used for the portion where the frame was dropped, but the portion where the frame was dropped using the same video as the previous frame without using the code is used. Can be naturally solved by encoding. Also, instead of progressively converting the interlaced frame immediately before the dropped frame, the interlaced frame immediately after the dropped frame is progressively converted, and the dropped frame does not have the same sign as the previous frame. , "The same as the next frame" can also solve the problem.

(Embodiment 3) In the video information processing apparatus according to Embodiment 3 of the present invention, when a dropped frame occurs, the video information processing apparatus is temporally close to the dropped frame portion of the interlaced frame immediately before or immediately after the dropped frame. The field is once converted into a progressive frame, which is coded as an interlaced frame and used as a code for a dropped frame portion.

FIG. 8 is a block diagram of a video information processing apparatus according to the second embodiment of the present invention, and FIG. 9 is a diagram for explaining the operation of the apparatus. In the figure, reference numeral 801 denotes a video encoding means for encoding an interlaced frame output from the interlaced video output means (101), and a dropped frame detecting unit (502) detects dropped frames of the interlaced frame. Is detected, the dummy code output by the dummy code output means (802) is used as the code of the dropped frame portion. Reference numeral 802 denotes a dummy code output unit. When the dropped frame detection unit (502) detects dropped frames in the interlaced frame, the dropped frame detecting unit (502) outputs time information to the dropped frame unit in the field constituting the interlaced frame immediately before the dropped frame unit. A field that is close to the target, that is, an even field in this case, is converted into a progressive frame, and the image is encoded and output. Embodiment 1 describes a method of converting a field into a progressive frame.
This is the same as the method described above. The other components are the same as those in the second embodiment, and a description thereof will not be repeated.

The operation of the video information processing apparatus according to the third embodiment configured as described above will be described with reference to FIGS. First, the NTSC signal is used to output interlaced video.
(101), the interlaced video output means (101)
This is digitized and output as an interlaced frame. Here, the fields are input in the order of "1,2,3,4,5,6,7,8".
"1,2" interlaced frames that should be output
Only three cards with time elements of "3,4" and "7,8" were output. This frame drop is detected by frame drop detection means (5
02) detects by reading the time stamp given to the interlaced frame, and outputs the dummy code output means (8
In response to 02), a dummy code output instruction is issued. In response to the above instruction, the dummy code output means (802) converts the even field of the interlace frame immediately before the dropped frame into a progressive frame. Since only the even-numbered fields are progressive frames, the vertical resolution is doubled, but the time element is "4". This progressive frame is encoded and output as an interlaced frame. On the other hand, the video encoding unit (801) receives the frame drop instruction from the frame drop detection unit (502), and outputs the dummy code output by the dummy code output unit (802) to the frame drop portion (FIG. "C" inside). Further, the subsequent interlaced frames (7, 8) are encoded as interlaced frames as usual ("d" in the figure).

The manner in which the encoded interlaced frame output as described above is decoded will be described.
FIG. The encoded interlaced frame is restored to an interlaced frame by the video decoding unit. The NTSC output means divides the interlaced frame into an even field and an odd field, and outputs an analog signal. At this time, since "c" is an image once converted to a progressive frame and encoded as an interlaced frame, the vertical resolution is twice the field, but the temporal element is only "4". . Therefore, the temporal element of the reproduced video is “1,2,3,4,4,4,7,8”. In other words, the problem of "flicker" that was a problem with the conventional technology can be solved, and the vertical resolution is interpolated by converting it to a progressive frame. The problem of "sway" due to the display can also be solved. Furthermore, in the second embodiment, since the field immediately before the frame drop was converted into a progressive frame, there was a problem that many time components were lost together with the frame drop portion.
In the present embodiment, since the time component is lost only in the dropped frame portion, smooth reproduction can be realized.

In the present embodiment, the dummy code output means and the video coding means use progressive frames,
Although the encoding is performed as the interlaced frame, the present invention is not limited to the case where the encoding means for dividing the progressive frame into lines and dividing the lines into fields and encoding the fields is applied. Is applicable. Also, in this example, for the part where the frame was dropped, first, the field immediately before the dropped frame was converted to a progressive frame, and a code obtained by encoding the image as an interlaced frame was used. If the processing system that performs the processing is provided with a code `` same as the result of the progressive conversion of the previous field (or the same as the result of line interpolation of the previous field) '', such a code may be used as it is. . Also, the problem can be solved by performing, instead of performing the progressive conversion on the field immediately before the dropped frame portion, the progressive conversion of the field immediately after the dropped frame portion, encoding the encoded data, and using the encoded frame for the dropped frame portion. In that case, the field to be converted is an odd field.

Further, in the present embodiment, an image is coded as a process of an output interlaced frame, but the present invention is not limited to such a process. It goes without saying that the present invention as described in the present embodiment can be implemented not only in the encoding processing but also in general image processing. In that case, instead of the dummy code output means, the field immediately before or immediately after is subjected to progressive conversion, and the image is compensated for dropping frames.
What is necessary is just to prepare a frame dropping coping means.

Further, the method of the present invention described above is
If it is realized as a program product and stored and distributed on a floppy disk or other storage medium,
It is needless to say that the present invention is effective even when distributed through a medium such as a computer network.

[0037]

As described above, the video information processing apparatus according to the first aspect of the present invention comprises: an interlaced video output means for outputting an interlaced frame composed of n fields; Progressive conversion means for converting one field into a progressive frame by n-line interpolation of one field, and frame drop detection means for detecting the frame drop of the progressive frame,
Encoding means for encoding the progressive frame as an interlaced frame composed of n fields, and outputting a video code. Video encoding means for outputting a code that is the same image as the above-mentioned progressive frame immediately before or immediately after the portion and using it as a video code. It is possible to solve a problem such as "flicker" or "jitter" which occurs when a frame drop occurs and a frame or a field immediately before or after the frame drop is copied to compensate for the dropped frame.

According to a second aspect of the present invention, there is provided a video information processing apparatus comprising:
Interlaced video output means for outputting an interlaced frame composed of one field, dropped frame detecting means for detecting dropped frames of the interlaced frame,
When the dropped frame detection means detects a dropped frame, the interlaced frame immediately before or immediately after the dropped frame is
Progressive conversion means for converting one of the n fields constituting the interlaced frame into a progressive frame by n-line interpolation, and encoding the interlaced frame and outputting a video code Means, when the dropped frame detecting means detects dropped frames, the progressive frame corresponding to the interlaced frame is encoded as an interlaced frame composed of n fields, and By providing a video encoding means for outputting a code that is the same image as the progressive frame and outputting a video code, the portion without dropped frames keeps a smooth movement of 1/60 fps. In addition, after saving computer resources for progressive conversion, The effect can be achieved.

According to a third aspect of the present invention, there is provided a video information processing apparatus comprising:
Interlaced video output means for outputting an interlaced frame composed of one field, dropped frame detecting means for detecting dropped frames of the interlaced frame,
When the dropped frame detection means detects a dropped frame, of the n fields constituting the interlaced frame immediately before or immediately after the dropped frame, one field that is temporally closer to the dropped frame is n-fold line interpolation. A dummy code output unit that outputs a dummy frame code indicating an image converted to a progressive frame, and an encoding unit that encodes the interlaced video and outputs a video code. When a dropped frame is detected, video coding means for outputting the dummy code as a video code as a code to be output to the dropped frame portion is provided, so that a lack of a temporal component is eliminated. The effect described in claim 1 can be realized by limiting only to the dropped frame portion.

According to a fourth aspect of the present invention, in the video information processing apparatus,
Interlaced video output means for outputting an interlaced frame composed of a number of fields, progressive conversion means for converting one of the n fields into a progressive frame by n-line interpolation, and When the dropped frame is detected by the dropped frame detecting means for detecting the dropped frame of the progressive frame, and the dropped frame is detected by the dropped frame detecting means, the progressive frame immediately before or immediately after the dropped frame portion is copied and supplemented as an image of the dropped frame portion. Processing the interlaced frame by providing an image processing unit that performs image processing by using the frame output by the dropping unit and the frame output by the progressive conversion unit and the frame dropping unit as an interlaced frame. Frame drop occurs when performing the There can be solved the problem of "flicker" or "swing" occurs when a supplement to copy the frame or field immediately after.

According to a fifth aspect of the present invention, in the video information processing apparatus,
Interlaced video output means for outputting an interlaced frame composed of one field, dropped frame detecting means for detecting dropped frames of the interlaced frame,
When the dropped frame detection means detects a dropped frame, of the n fields constituting the interlaced frame immediately before or immediately after the dropped frame, one field that is temporally closer to the dropped frame is n-fold line interpolation. By converting the frame output to a progressive frame, the frame dropped by the frame dropping section, and the frame output by the interlaced video output means and the frame dropped dropping means,
By providing an image processing means for performing image processing as an interlaced frame, the lack of a temporal component is limited to only the dropped frame portion, and the effect described in claim 4 can be realized.

According to a sixth aspect of the present invention, in the video information processing method,
An interlaced video output step of outputting an interlaced frame composed of a number of fields, a progressive conversion step of converting one of the n fields into a progressive frame by n-line interpolation, A frame drop detecting step of detecting a frame drop of the progressive frame; andcoding the progressive frame as an interlaced frame composed of n fields, and outputting a video code. A frame coding step of outputting a code indicating that the frame is the same as the progressive frame immediately before or immediately after the frame dropping portion and detecting the frame dropping portion as a video code. By doing, the interlaced frame It is possible to solve a problem such as "flickering" or "fluctuation" that occurs when a frame drop occurs during encoding and the frame drop is corrected by copying the immediately preceding or succeeding frame or field.

The video information processing method according to claim 7,
An interlaced video output step of outputting an interlaced frame composed of one field, a dropped frame detecting step of detecting dropped frames of the interlaced frame, and a dropped frame when the dropped frame detection step detects dropped frames. A progressive conversion step of converting the interlaced frame immediately before or immediately after to a progressive frame by n-line interpolation of one of the n fields constituting the interlaced frame; and Is a coding step of outputting a video code, and when the dropped frame detection step detects dropped frames, the progressive frame corresponding to the interlaced frame is replaced with an interlaced frame composed of n fields. As a mark And a frame encoding step for outputting a code indicating that the image is the same as the progressive frame in the frame dropping portion, and providing a video coding step as a video code. 1/60
The effect described in claim 6 can be realized while keeping the smooth motion of fps and saving computer resources for progressive conversion.

The video information processing method according to claim 8 is characterized in that
An interlaced video output step of outputting an interlaced frame composed of one field, a dropped frame detecting step of detecting dropped frames of the interlaced frame, and a dropped frame when the dropped frame detection step detects dropped frames. For a dummy frame showing an image converted into a progressive frame by n-line interpolation of one field that is close to the frame drop-out part of the n fields constituting the interlaced frame immediately before or immediately after A dummy code output step of outputting a code, and an encoding step of encoding the interlaced video and outputting a video code, wherein when the dropped frame detection step detects dropped frames, the code is output to a dropped frame portion. Video encoding by outputting the dummy code By characterized in that a step, kept missing temporal component only dropping frames moieties can achieve the effect described in claim 6.

According to a ninth aspect of the present invention, in the video information processing method,
An interlaced video output step of outputting an interlaced frame composed of a number of fields, a progressive conversion step of converting one of the n fields into a progressive frame by n-line interpolation, When the dropped frame is detected by the dropped frame detecting step for detecting the dropped frame of the progressive frame, and the dropped frame is detected by the dropped frame detection step, a frame for copying and complementing the progressive frame immediately before or immediately after the dropped frame portion as an image of the dropped frame portion. Processing an interlaced frame by providing, as an interlaced frame, an image processing step of performing image processing using the frame output by the dropping step and the progressive conversion step and the dropped frame step. When you drop There occurs, it is possible to solve the problem of "flicker" or "swing" occurs when a supplement to copy immediately before or frame or field immediately after the dropped frames.

A video information processing method according to claim 10 is
When an interlaced video output step of outputting an interlaced frame composed of n fields, a dropped frame detecting step of detecting dropped frames of the interlaced frame, and a dropped frame detection step detect dropped frames, Of the n fields constituting the interlaced frame immediately before or immediately after the drop, one field that is temporally close to the dropped frame is converted to a progressive frame by n-fold line interpolation, and the A frame dropping compensation step for supplementing an image with the image, and an image processing step of performing image processing using the frames output by the interlaced video output step and the frame dropping suppression step as interlaced frames. By doing so, the lack of the temporal component is limited to only the frame drop portion, The effects described can be achieved.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a video information processing apparatus according to a first embodiment of the present invention;

FIG. 2 is a view for explaining the operation of the video information processing apparatus according to the first embodiment of the present invention;

FIG. 3 is a diagram illustrating progressive conversion.

FIG. 4 is a view for explaining the operation when decoding the video coded information coded by the video information processing apparatus according to the first embodiment of the present invention;

FIG. 5 is a configuration diagram of a video information processing apparatus according to a second embodiment of the present invention.

FIG. 6 is a view for explaining the operation of the video information processing apparatus according to the second embodiment of the present invention;

FIG. 7 is a view for explaining the operation when decoding video encoded information encoded by the video information processing apparatus according to the second embodiment of the present invention;

FIG. 8 is a configuration diagram of a video information processing apparatus according to a third embodiment of the present invention.

FIG. 9 is a view for explaining the operation of the video information processing apparatus according to the third embodiment of the present invention;

FIG. 10 is a view for explaining an operation when decoding video encoded information encoded by the video information processing apparatus according to the third embodiment of the present invention;

FIG. 11 illustrates an interlaced frame.

FIG. 12 is a configuration diagram of a video information processing apparatus according to a conventional technique.

FIG. 13 is a diagram for explaining the operation of a video information processing apparatus according to the related art.

FIG. 14 is a diagram illustrating an operation when decoding video encoded information encoded by a video information processing apparatus according to a conventional technique.

FIG. 15 is a diagram for explaining an operation when a dropped frame occurs in a video information processing apparatus according to the related art.

FIG. 16 is a first diagram illustrating a problem when decoding video encoded information encoded by a video information processing apparatus according to the related art.

FIG. 17 is a second diagram illustrating a problem when decoding video encoded information encoded by the video information processing apparatus according to the related art.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 101 Interlace video output means 102 Video encoding means 103 Dropped frame detection means 104 Progressive conversion means

Claims (10)

[Claims] 1. An interlaced video output means for outputting an interlaced frame composed of n fields,
Progressive conversion means for converting one field out of the n fields into a progressive frame by n-fold line interpolation, frame drop detection means for detecting a frame drop in the progressive frame, and the progressive frame as n This is encoding means for encoding as an interlaced frame composed of one field and outputting a video code, and when the dropped frame detection means detects a dropped frame, the dropped frame portion is immediately before or immediately after the dropped frame portion. A video information processing apparatus comprising: a video encoding unit that outputs a code that is the same image as the progressive frame and uses the code as a video code. 2. An interlaced video output means for outputting an interlaced frame composed of n fields,
When the dropped frame is detected by the dropped frame detecting means for detecting dropped frames of the interlaced frame, the interlaced frame immediately before or immediately after the dropped frame constitutes the interlaced frame.
Progressive conversion means for converting one of the fields into a progressive frame by n-line interpolation of one field, and encoding the interlaced frame output by the interlaced video output means and outputting a video code Means, when the dropped frame detection means detects a dropped frame, encodes the progressive frame corresponding to the interlaced frame immediately before or immediately after the dropped frame as an interlaced frame composed of n fields, And a video encoding unit that outputs a code indicating that the image is the same as the progressive frame in the dropped frame portion and uses the code as a video code. 3. An interlaced video output means for outputting an interlaced frame composed of n fields,
The frame drop detecting means for detecting the frame drop in the interlace frame, and when the frame drop detecting means detects the frame drop, the time drop among the n fields constituting the interlace frame immediately before or immediately after the frame drop is selected. A dummy code output means for outputting a dummy frame code indicating an image converted into a progressive frame by n-line interpolation of one field close to a frame drop portion, and the interlaced video output means output An encoding means for encoding an interlaced frame and outputting a video code. When the dropped frame is detected by the dropped frame detecting means, the dummy frame code is output as a code to be output to the dropped frame portion, thereby outputting a video. A video information processing apparatus comprising: video coding means for coding. 4. An interlaced video output means for outputting an interlaced frame composed of n fields,
Progressive conversion means for converting one of the n fields into a progressive frame by n-line interpolation of one field, frame drop detection means for detecting frame drop in the progressive frame, and frame drop detection means When detecting a dropped frame, as a frame dropped portion image, a frame dropped handling means for copying and supplementing the progressive frame immediately before or immediately after the dropped frame portion,
An image information processing apparatus, comprising: an image processing unit that performs image processing by using a frame output by the progressive conversion unit and the dropped frame counter unit as an interlaced frame. 5. An interlaced video output means for outputting an interlaced frame composed of n fields,
The frame drop detecting means for detecting the frame drop in the interlace frame, and when the frame drop detecting means detects the frame drop, the time drop among the n fields constituting the interlace frame immediately before or immediately after the frame drop is selected. One field close to the frame drop portion is converted into a progressive frame by n-fold line interpolation, and the image of the frame drop portion is supplemented with the image. A video information processing apparatus comprising: an image processing unit that performs image processing by using a frame output by the coping unit as an interlaced frame. 6. An interlaced video output step of outputting an interlaced frame composed of n fields, and converting one of the n fields into a progressive frame by n-fold line interpolation. Progressive conversion step, dropped frame detection step of detecting the dropped frame of the progressive frame, and encoding the progressive frame as an interlaced frame composed of n fields,
A coding step of outputting a video code, and when the dropped frame detection step detects dropped frames, outputs a code indicating that the dropped frame portion is the same image as the progressive frame immediately before or immediately after the dropped frame portion. And a video encoding step for performing video encoding. 7. An interlaced video output step of outputting an interlaced frame composed of n fields, a dropped frame detecting step of detecting dropped frames of the interlaced frame, and a dropped frame detecting step. Is detected, the interlaced frame immediately before or immediately after the frame drop is replaced with one of the n fields constituting the interlaced frame by n
A progressive conversion step of converting to a progressive frame by performing double line interpolation; and an encoding step of encoding the interlaced frame output by the interlaced video output step and outputting a video code. When the drop is detected, the progressive frame corresponding to the interlace frame immediately before or immediately after the drop is encoded as an interlace frame composed of n fields, and the dropped frame portion is the same as the progressive frame. A video encoding step of outputting a code that is assumed to be an image of the image to be a video code. 8. An interlaced video output step of outputting an interlaced frame composed of n fields, a dropped frame detecting step of detecting dropped frames of the interlaced frame, and a dropped frame detecting step. Is detected, one of the n fields constituting the interlaced frame immediately before or immediately after the dropped frame is temporally closer to the dropped frame portion by n.
A dummy code output step of outputting a dummy frame code indicating an image converted into a progressive frame by performing double line interpolation, and an encoding step of encoding the interlaced video and outputting a video code. A video encoding step of outputting a dummy frame code as a code to be output to a dropped frame portion when the detection step detects a dropped frame, thereby forming a video code. 9. An interlaced video output step of outputting an interlaced frame composed of n fields, and converting one of the n fields into a progressive frame by n-fold line interpolation. A progressive conversion step, a dropped frame detecting step for detecting a dropped frame of the progressive frame, and a dropped frame detecting step for detecting a dropped frame.When the dropped frame is detected, the progressive frame immediately before or immediately after the dropped frame portion is displayed as a dropped frame image. Video information characterized by comprising a frame dropping countermeasure step of copying and compensating for a frame, and an image processing step of performing image processing using the frames output by the progressive conversion step and the frame dropping step as an interlaced frame. Processing method. 10. An interlaced video output step of outputting an interlaced frame composed of n fields, a dropped frame detecting step of detecting dropped frames of the interlaced frame, and a dropped frame detecting step. Is detected, one of the n fields constituting the interlaced frame immediately before or immediately after the dropped frame is temporally closer to the dropped frame portion.
Convert the frame into a progressive frame by interpolating the n times line, and replace the frame output by the frame dropping step of supplementing the image of the frame dropping part with the image, and the interlaced video output step and the frame dropping step by the interlaced frame. An image processing step of performing image processing.