JPH05204571A - Data display - Google Patents

Abstract

(57) [Abstract] [Object] The present invention relates to a data display device for displaying a moving image, which is used when editing a moving image, and is capable of visually expressing a temporal change of a frame image pattern of the moving image. It is an object of the present invention to easily determine the reproduction and editing points of a moving image, and to easily perform partial reproduction and partial editing of a moving image. [Structure] A feature extraction unit 13 extracts a frame image from a data storage unit 11 in which moving image data is stored at regular intervals and calculates a degree of similarity to calculate a time change value of an image pattern. Further, the time attribute of the moving image data is stored in the attribute storage unit 12, and the information figure generation unit 1
4 generates a time axis figure having a length proportional to the reproduction time from the time attribute. The display control unit 15 displays the time change value of the image pattern calculated by the feature extraction unit 13 on the time axis graphic in color or waveform.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a data display device for digitally displaying a moving image, which is used when editing a moving image.

[0002]

2. Description of the Related Art In recent years, in order to edit a moving image, a data display device for digitally displaying the moving image has been developed. Along with this, various applications for displaying and editing moving images have been developed.

FIG. 4 is a block diagram showing a structure of a data display device for displaying moving image data, which is used when a conventional moving image is edited. In FIG. 4, 21 is a data storage unit that stores moving image data, 22 is an attribute storage unit that stores time attributes of moving image data, and 23 is a time axis figure having a length proportional to the reproduction time of moving image data. An information graphic generation unit 24 is a display unit for displaying a time axis graphic.

The operation of the conventional data display device constructed as above will be described below. First, the attribute storage unit 22 stores time attributes such as reproduction time, output timing, and frame number of the moving image data stored in the data storage unit 21. The information figure generation unit 23 reads the reproduction time of the moving image data from the attribute storage unit 22,
A time axis figure having a length proportional to the reproduction time is generated.

FIG. 5 shows an example of an editing screen using a data display device for displaying moving image data, which is used when performing conventional data editing. In FIG. 5, 31 is a moving image reproduction screen, 32 is a command menu for displaying editing commands, 3
Reference numerals 3, 34, and 35 are time axis figures each having a length proportional to the reproduction time of the moving image data. Hereinafter, this figure is called a time bar. The points on the time bar correspond one-to-one to the reproduced image of the moving image with the reproduction time as a unit. For example, when an arbitrary point on the time bar is designated as a point to be reproduced, the image corresponding to the point is reproduced on the moving image reproduction screen 31. By thus designating a point on the time bar, it is possible to select a point at which a moving image is reproduced and edited at a time corresponding to the designated point.

[0006]

However, with the above-mentioned configuration, it is possible to easily grasp the reproduction time of the moving image data, and it is possible to easily reproduce and edit the moving image at any place. Since the contents of is not given to the user on the time bar, during the editing process,
The user cannot easily find a desired reproduction and edit point, and it is very difficult to edit the moving image data.

In view of the above point, the present invention visually expresses a time change value of a moving image pattern on a time bar with a color and a waveform so that a reproduced image of a moving image at an arbitrary point on the time bar can be displayed. An object of the present invention is to provide a data display device capable of estimating temporal changes, easily determining reproduction and editing points in the editing process, and easily performing reproduction and editing.

[0008]

To achieve the above object, a data display device of the present invention comprises a data storage unit for storing a plurality of moving image data in which a plurality of frame image data are arranged in time series, and the data. An attribute storage unit that stores time attributes of a plurality of moving image data stored in the storage unit, frame images are extracted from the moving image data stored in the data storage unit at regular intervals, and between adjacent frame images, One after another,
A feature extraction unit that calculates a temporal change value of an image pattern by calculating the similarity, and a reproduction time of the moving image data is read from the time attribute stored in the attribute storage unit, and the read reproduction time is set to the read reproduction time. An information figure generating unit that generates a time axis figure having a proportional length, an information figure displaying operation that displays the time axis figure generated by the information figure generating section, and an image pattern calculated by the feature extracting section. The display control unit is configured to perform an image information display operation in which the time change value is expressed in the time axis figure by a color or a waveform.

[0009]

According to the present invention, with the above-described structure, the feature extraction unit extracts frame images from the stored moving image data at regular intervals and successively calculates the degree of similarity between adjacent frames. Calculate the time change value, and
By displaying the time change value of the image pattern calculated by the feature extraction unit on the time axis figure having a length proportional to the reproduction time of the moving image data by the display control unit by color and waveform,
It is possible to visually express the temporal change of the reproduced image of the moving image. As a result, the temporal change of the reproduced image of the moving image can be estimated, the user can easily determine the reproducing and editing points in the editing process, and the moving image data can be easily edited.

[0010]

1 is a block diagram showing the configuration of a data display device according to an embodiment of the present invention. In FIG. 1, 11 is a data storage unit for storing a plurality of moving image data in which a plurality of frame image data are arranged in time series, and 12
Is an attribute storage unit that stores time attributes of a plurality of moving image data stored in the data storage unit 11, and 13 is the data storage unit 1.
A feature extraction unit that extracts frame images at regular intervals from the moving image data stored in No. 1 and calculates the temporal change value of the image pattern by sequentially calculating the similarity between adjacent frame images. Is an information figure generation unit for reading the reproduction time of the moving image data from the time attribute stored in the attribute storage unit 12 and generating a time axis figure having a length proportional to the read reproduction time. Reference numeral 15 is an information figure An information graphic display operation for displaying the time axis graphic generated by the generation unit 14 and an image information display operation for expressing the time change value of the image pattern calculated by the feature extraction unit 13 in the time axis graphic by a color or a waveform. This is a display control unit.

The operation of this embodiment of the data editing apparatus configured as described above will be described below with reference to FIGS. 1, 2 and 3. For example, the data storage unit 11 stores full-color moving image data of 640 × 400 pixels with a reproduction time of 60 seconds and 30 frames / second. The information figure generation unit 14 reads the information of the reproduction time of 60 seconds from the attribute storage unit 12 that stores the time attribute of the moving image data stored in the data storage unit 11, and the length of 600 pixels proportional to the reproduction time. (Here, it is represented by 10 pixels / second.)
Generates a time bar that is a time-axis figure with. The feature extraction unit 13 extracts a frame image for every 30 frames from the first frame of the moving image data from the data storage unit 11,
The RGB value of 640 × 400 pixels is converted into a brightness value to calculate the brightness value of the frame image.

For example, the R, G, and B components of the RGB value of the pixel at the point t of the extracted frame image are Rt, Gt, and
At the time of Bt, the brightness value of the pixel at the point t can be obtained by the brightness value Yt = 0.2990xRt + 0.5870xGt + 0.1140xBt. This is calculated for all points, normalized and averaged to obtain the brightness value of the frame image. Then, the difference in the brightness value between the adjacent frame images is normalized and then quantized to correspond to the grayscale pattern of black and white or a specific color as shown in FIG. Further, in addition to the grayscale pattern of black and white or a specific color, a pattern of a specific plurality of colors, for example, the degree of grayscale may be divided into 7 categories, and 7 colors from red to purple may be sequentially assigned to correspond. In addition, HDTV size (19
When the number of pixels in one frame is large, such as 20 × 1125 pixels), the luminance value of the frame image may be calculated by thinning out the image.

As described above, in this embodiment, the display controller 15
Represents the temporal change of the difference in the luminance value of the frame image calculated by the feature extraction unit 13 with a color on the time bar as shown in FIG. Can be expressed in Note that, in the present embodiment, the change in the temporal brightness value difference of the frame image is represented by color, but the present invention is not limited to this, and it may be represented by a waveform other than color as shown in FIG.

As described above, according to the present embodiment, the temporal change of the difference in the luminance value of the frame image is added to the time bar in the form of a color or a waveform so that the temporal change of the playback screen of the moving image can be suppressed. It can be visually shown, and it can be used to infer the temporal change of the reproduced image of the moving image, so that the user can reproduce, copy, cut,
When performing editing processing such as pasting, it is possible to easily determine the reproduction and editing points, and it is possible to easily edit the moving image data. Although the luminance value of the frame image is calculated in the present embodiment, the present invention is not limited to this, and similar effects can be obtained even with saturation and lightness, for example.

[0015]

As described above, by using the present invention, it is possible to easily grasp the reproduction time of moving image data, and it is possible to easily reproduce and edit a moving image at an arbitrary position, and at the same time, the moving image can be reproduced. It is possible to easily grasp the temporal change of the reproduced image of the data and easily determine the reproducing and editing points in the process of editing. Therefore, the editing work can be easily performed, and the practical effect is extremely large.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of a data display device according to an embodiment of the present invention.

FIG. 2 is a diagram of a time bar displayed on an editing screen using the data display device according to the present embodiment.

FIG. 3 is a diagram of another time bar displayed on the editing screen using the same data display device.

FIG. 4 is a block diagram showing a configuration of a conventional data display device.

FIG. 5 is a screen diagram of an editing screen using a conventional data display device.

[Explanation of symbols]

 11 data storage unit 12 attribute storage unit 13 feature extraction unit 14 information graphic generation unit 15 display control unit

Claims (2)

[Claims] 1. A data storage unit for storing a plurality of moving image data in which a plurality of frame image data are arranged in time series,
An attribute storage unit that stores time attributes of a plurality of moving image data stored in the data storage unit, and frame images are extracted from the moving image data stored in the data storage unit at regular intervals, Then, the reproduction time of the moving image data is read out from the feature extraction unit that calculates the temporal change value of the image pattern by sequentially calculating the similarity, and the reproduction time of the moving image data from the time attribute stored in the attribute storage unit. And an information figure generating section for generating a time axis figure having a length proportional to the reproduction time, an information figure displaying operation for displaying the time axis figure generated by the information figure generating section, and a calculation by the feature extracting section A data display device, comprising: a display control unit that performs an image information display operation of expressing the time change value of the generated image pattern in color on the time axis figure. 2. A data storage unit for storing a plurality of moving image data in which a plurality of frame image data are arranged in time series,
An attribute storage unit that stores time attributes of a plurality of moving image data stored in the data storage unit, and frame images are extracted from the moving image data stored in the data storage unit at regular intervals, Then, the reproduction time of the moving image data is read out from the feature extraction unit that calculates the temporal change value of the image pattern by sequentially calculating the similarity, and the reproduction time of the moving image data from the time attribute stored in the attribute storage unit. And an information figure generating section for generating a time axis figure having a length proportional to the reproduction time, an information figure displaying operation for displaying the time axis figure generated by the information figure generating section, and a calculation by the feature extracting section A data display device, comprising: a display control unit that performs an image information display operation of expressing a time change value of the generated image pattern in a waveform on the time axis figure.