JP2013005376A - Image processing program, image processing apparatus, and image processing method - Google Patents

Abstract

An object of the present invention is to improve the efficiency of adjustment work of parameters necessary for 2D3D conversion.
An adjustment screen for adjusting a three-dimensional parameter is displayed on a first display, and a three-dimensional parameter stored in a three-dimensional parameter storage unit in response to a user input for adjusting the three-dimensional parameter. Update parameters, generate 3D video based on 2D video stored in 2D video storage and 3D parameters stored in 3D parameter storage, using adjustment screen In a state where the three-dimensional parameter can be adjusted, the generated three-dimensional image is displayed on a second display corresponding to the three-dimensional display, which is different from the first display.
[Selection] Figure 1

Description

  The present invention relates to an image processing program, an image processing apparatus, and an image processing method.

  In recent years, an environment for viewing three-dimensional (3D) images in movies and television has been improved, and interest in 3D images has increased. However, in order to create a 3D video, for example, special equipment such as a camera for shooting the 3D video is required, which increases the cost of creating the video. Therefore, the current situation is that the content of 3D video has not been expanded.

  Therefore, attention has been paid to a technique for converting a two-dimensional (2D) video that has already been created into a 3D video, that is, a 2D3D conversion technology. By using such 2D3D conversion technology, it is possible to enjoy many existing contents as 3D video. For example, Patent Document 1 discloses a technique for adjusting parameters necessary for 2D3D conversion.

JP 2006-80982 A

  As described above, it is possible to adjust the parameters of the 2D3D conversion by using the technique disclosed in Patent Document 1. However, in the method disclosed in Patent Document 1, while a parameter for a certain frame image can be adjusted, a 3D image corresponding to the frame image can be confirmed, but a 3D generated from the original 2D video image can be confirmed. The video cannot be confirmed.

  Generally, it is difficult to determine whether a 3D display effect in 3D video is appropriate only by displaying a 3D image for each frame. Therefore, in order to confirm how the parameter adjustment result is reflected in the 3D video, after the parameter adjustment work is once completed, a rendering process for outputting the final 3D video is executed. There is a need. Then, by displaying the 3D video output by rendering on a display corresponding to 3D display, it is confirmed whether or not the 3D display is appropriately performed.

  As described above, in 2D3D conversion, it is necessary to repeat parameter adjustment and rendering for each frame, which requires much labor for adjustment work.

  Accordingly, an object of the present invention is to increase the efficiency of parameter adjustment work necessary for 2D3D conversion.

  An image processing program according to an aspect of the present invention includes a 2D video storage unit that stores 2D video, and a 3D parameter storage that stores 3D parameters necessary for converting the 2D video into 3D video. On the first display, and an adjustment screen for adjusting the three-dimensional parameter is displayed on the first display and stored in the three-dimensional parameter storage unit in response to a user input for adjusting the three-dimensional parameter. Based on the 3D parameter adjustment function for updating the 3D parameter, the 2D image stored in the 2D image storage unit, and the 3D parameter stored in the 3D parameter storage unit. In a state where the 3D image generation function for generating the image and the 3D parameter can be adjusted using the adjustment screen, three different from the first display, A second display corresponding to the original display, and a three-dimensional image display function for displaying the generated three-dimensional image is intended for realizing.

  In the present invention, the “part” does not simply mean a physical means, but includes a case where the function of the “part” is realized by software. Also, even if the functions of one “unit” or device are realized by two or more physical means or devices, the functions of two or more “units” or devices are realized by one physical means or device. May be.

  ADVANTAGE OF THE INVENTION According to this invention, the efficiency of the adjustment work of the parameter required for 2D3D conversion can be improved.

1 is a diagram illustrating a configuration of an image processing system according to an embodiment of the present invention. It is a figure which shows the image of the process which extracts the outline of each object from 2D video. It is a figure which shows the image of the process which synthesize | combines layer data and produces | generates a depth image. It is a figure which shows the image of the process which gives a gradation to a depth value. It is a figure which shows an example of the screen during 3D parameter adjustment. It is a figure which shows an example of the edge in a depth image. It is a figure which shows an example of the pixel pattern in the 3D display 14 for confirmation. It is a figure which shows the image of the process which produces | generates 3D video. It is a figure which shows an example of the largest parallax amount in the case of the multi viewpoint of 3 viewpoints or more. It is a flowchart which shows an example of the flow of the whole 2D3D conversion process.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing a configuration of an image processing system according to an embodiment of the present invention. The image processing system is a system for converting a two-dimensional (2D) image into a three-dimensional (3D) image, and includes an image processing device 10, a work two-dimensional display 12, and a confirmation 3D display 14. ing. The image processing apparatus 10 is an information processing apparatus for performing 2D3D conversion processing, and is realized using a personal computer, a server, or the like. The image processing apparatus 10 may be configured using a plurality of information processing apparatuses. The work 2D display 12 is for displaying various kinds of information necessary for performing work for 2D3D conversion in the image processing apparatus 10, and is a display device capable of 2D display. The confirmation 3D display 14 is for displaying a 3D video generated by the image processing apparatus 10 and is a display device capable of 3D display. Note that the confirmation 3D display 14 only needs to support 3D display, and the 3D display method is arbitrary. For example, glasses using 3D viewing such as a polarizing filter method or a liquid crystal shutter method may be used, or 3D viewing with the naked eye such as a parallax barrier method or a lenticular method may be used. .

  As shown in FIG. 1, the image processing apparatus 10 includes a 2D video storage unit 20, a mask creation unit 22, a layer data creation unit 24, a layer data storage unit 26, a depth video generation unit 28, a 3D parameter storage unit 30, and a 3D parameter. The adjustment unit 32 includes a depth video display unit 34, a 3D video generation unit 36, a 3D video storage unit 38, a 3D video display unit 40, and a 3D video output unit 42. Each unit constituting the image processing apparatus 10 can be realized, for example, by using a storage area such as a memory or a storage device or by executing a program stored in the storage area.

  The 2D video storage unit 20 stores 2D video as a conversion source to 3D video. The 2D video is composed of a plurality of continuous 2D images. The 2D video may be in any format, but here it is assumed that one 2D image is generated for each frame of the 2D video and stored in the 2D video storage unit 20. If a compressed 2D video such as an MPEG format is used, a 2D image for each frame can be generated by decoding the compressed 2D video. In the present embodiment, an image of one frame in 2D video may be simply referred to as a frame image.

  The mask creation unit 22 is for extracting the outline of each object to be 3D displayed from the 2D video. FIG. 2 shows an image diagram of processing for extracting the outline of each object from the 2D video. FIG. 2 shows three objects of a triangle 80 and squares 82 and 84 in the 2D video. For example, the mask creation unit 22 displays one frame image of 2D video on the work 2D display 12 and accepts user input for designating the range of each object. When the range of the object is designated, the mask generation unit 22 performs the object tracking process on the frame image of the subsequent frame of the 2D video, and cuts the outline of the object in each frame image. Note that the mask creating unit 22 may automatically cut out the outline of the object by analyzing the frame image regardless of the user input. In addition, the mask creation unit 22 can display the object tracking result on the work 2D display 12 and can correct a portion in which the tracking is not correctly performed according to a user input.

  The layer data creation unit 24 creates layer data for each object to be 3D displayed based on the processing result of the mask creation unit 22 and stores the layer data in the layer data storage unit 26. The layer data creation unit 24 can also display layer data of a certain object on the work 2D display 12 and accept user input for designating the inclination and unevenness of the object.

  The depth video generation unit 28 generates a depth video by synthesizing the layer data of a plurality of objects created by the layer data creation unit 24 for each frame, and stores the depth video in the depth video storage unit 50 in the 3D parameter storage unit 24. To do. In FIG. 3, a depth image obtained by combining layer data of a certain frame is displayed. The depth image indicates the depth for each pixel in the image, and is called a depth map. The depth image is the same size as the 2D video frame image, and the pixel value of each pixel is a depth value representing the depth. In the present embodiment, the depth image is a grayscale image in which the value of each pixel is represented by 256 levels of grayscale values. As shown in FIG. 3, the depth value 0 represents the innermost depth, and the depth value 255 represents the nearest depth.

  The depth video generation unit 28 can initially set the depth value of each layer for each depth image. Further, the depth video generation unit 28 can change the depth value in the object in accordance with the inclination or unevenness of the object. For example, as shown in FIG. 4, the depth video generation unit 28 can add gradation to the depth value according to the inclination of the object. Note that the initial setting of the depth value can be performed individually for the depth image of each frame. For example, by setting the depth value for the depth image of several frames, other frames can be set. It is also possible to calculate the depth value of the depth image by interpolation. As described above, the depth video generation unit 28 can generate a depth video corresponding to a 2D video by generating a depth image corresponding to each frame of the 2D video.

  The 3D parameter adjustment unit 32 has a function for adjusting 3D parameters necessary for converting 2D video to 3D video. The above-described depth image is also one of 3D parameters. The 3D parameters include a parallax amount, a convergence position, and a 3D mode in addition to the depth image. As shown in FIG. 1, these 3D parameters are stored in the depth video storage unit 50, the parallax amount storage unit 52, the convergence position storage unit 54, and the 3D mode storage unit 56 in the 3D parameter storage unit 30. The 3D parameter adjustment unit 32 can display an adjustment screen for adjusting these 3D parameters on the work 2D display 12 and update the 3D parameters in accordance with a user input on the screen.

  FIG. 5 shows an example of the adjustment screen. As shown in FIG. 5, the adjustment screen 100 includes a display area 110 for displaying the depth image, a button for controlling the reproduction of the depth image, a button for adjusting the 3D parameter, and the 3D image. A button for instructing rendering is provided.

  The play / pause button 120 is for instructing to play or pause the depth video. In response to the operation input of the playback / pause button 120, the depth video display unit 34 plays back or pauses the depth video stored in the depth video storage unit 50. Further, the depth video display unit 34 can display the depth image of the frame designated by the frame designation button 122, and can return or advance the frame according to the operation input of the return button 124 or the feed button 126. is there.

  The depth value button 130 is used when adjusting the depth value of the depth image displayed in the display area 110. For example, the user can select a layer (object) to be adjusted in the display area 110 and input a depth value for the selected layer. The 3D parameter adjustment unit 32 updates the depth value in the target depth image stored in the depth video storage unit 50 based on the depth value thus input. Note that the 3D parameter adjustment unit 32 can update the depth value in consideration of the inclination and unevenness set in the object.

  The depth value range button 132 is used when inputting the depth value range of each layer. For example, the user can select a layer to be adjusted in the display area 110 and input a range of depth values for the selected layer. The 3D parameter adjustment unit 32 can adjust the depth value of the layer within the range specified here. The 3D parameter adjustment unit 32 automatically updates the depth values of the depth images of other frames, for example, by the same method as that at the time of initial setting as the depth value of the depth image of a certain frame is adjusted. be able to. At this time, the 3D parameter adjustment unit 32 can update the depth value so as to be within a range designated by the user.

  The parallax amount button 134 is used when adjusting the maximum parallax amount indicating the maximum parallax between adjacent viewpoints. The maximum amount of parallax is a parameter for adjusting the stereoscopic effect in 3D images. The larger the maximum amount of parallax, the stronger the stereoscopic effect. On the other hand, if the maximum amount of parallax is increased too much, the stereoscopic effect will break down or Disturbance may occur. The 3D parameter adjustment unit 32 stores the maximum parallax amount input in this way in the parallax amount storage unit 52. In the present embodiment, the input maximum parallax amount is applied to all frames of the depth video, but the maximum parallax amount may be adjustable for each frame or each section. When the maximum parallax amount is adjusted for each frame or section, the parallax amount storage unit 52 may store information for identifying the frame or section and the maximum parallax amount in association with each other.

  The convergence position button 136 is used when adjusting the convergence position in the 3D video. The convergence position designates a depth value located on the screen surface when displaying 3D video. For example, as shown in FIG. 3, when the depth value is defined from 0 to 255 from the back to the front, if the convergence position is 0, the depth value 0 (infinity) is located on the screen surface. It will be. In this case, all the images are projected from the screen surface. The 3D parameter adjustment unit 32 stores the congestion position input in this way in the congestion position storage unit 54. In the present embodiment, the input congestion position is applied to all frames of the depth video, but the congestion position may be adjustable for each frame or section. When the congestion position is adjusted for each frame or section, the congestion position storage unit 54 may store information for identifying the frame or section and the congestion position in association with each other.

  The edge correction button 138 is used when correcting an edge in the depth image. An edge is a portion where the amount of change in depth value is large, and is present at a boundary portion of a layer, for example, as shown in FIG. The 3D parameter adjustment unit 32 can detect an edge in the depth image displayed in the display area 110 and update the depth value so that the change in the depth value around the detected edge becomes gradual. Here, the edge can be detected by, for example, determining whether or not the amount of change in the depth value between adjacent pixels is equal to or higher than a predetermined level. The 3D parameter adjustment unit 32 can also correct an edge within a range designated by the user in the display area 110. In addition, the 3D parameter adjustment unit 32 can correct not only the depth image displayed in the display area 110 but also the edges included in the depth images of other frames.

  The 3D mode selection button 140 is used when a 3D mode indicating a mode for generating or displaying a 3D video is selected. For example, as the 3D mode, parallel, cross, anaglyph, interlace, multi-viewpoint, etc. can be selected. Here, the multi-viewpoint has three or more viewpoints, and the number of viewpoints can be input. The 3D parameter adjustment unit 32 stores the 3D mode input in this way in the 3D mode storage unit 56. In the 3D mode storage unit 56, display information indicating specifications related to 3D display on the confirmation 3D display 14 may be stored in advance as part of the 3D mode. Such display information includes, for example, information indicating a pixel arrangement pattern in the confirmation 3D display 14. FIG. 7 shows an example of a pixel pattern in the case where the confirmation 3D display 14 is compatible with display of 8 viewpoints of 3D video. In the example of FIG. 7, the display surface of the confirmation 3D display 14 is grouped into 8 horizontal pixels × 6 vertical pixels, and the same pixel pattern is defined for each group. Note that the 3D parameter adjustment unit 32 may acquire display information indicating such a pixel pattern and the like from the confirmation 3D display 14 and store the display information in the 3D mode storage unit 56.

  Returning to FIG. 1, the 3D video generation unit 36 generates a 3D video based on the 2D video stored in the 2D video storage unit 20 and the 3D parameters stored in the 3D parameter storage unit 30. Store in the storage unit 38. FIG. 8 shows an image of 3D video generation processing. As illustrated in FIG. 8, the 3D video generation unit 36 generates a frame image with the number of viewpoints corresponding to the 3D mode from each frame image of the 2D video in consideration of the 3D parameters. For example, if the number of viewpoints is 8, eight corresponding 3D images are generated from one frame of 2D images.

  An example of processing for generating a 3D video frame image from a 2D video frame image will be described. In this embodiment, as described above, the depth image is a gray scale image of 256 levels having the same width and height as the conversion source 2D image and the same R, G, and B values. The 3D video generation unit 36 acquires the luminance value of each pixel of the depth image, that is, the depth value, and generates a 3D image by moving the corresponding pixel of the conversion source 2D image in the horizontal direction according to the depth value. If the pixel movement amount is shift, the maximum parallax amount is shift_max, and the depth value is p, for example, in the case of two viewpoints, the movement amount shift can be obtained by the following equation (1).

shift = (shift_max × p) / 255 (1)
Here, in the case of two viewpoints, the moving direction of the pixel is the left direction for the 3D image for the right eye and the right direction for the 3D image for the left eye. In addition, if the target pixel of the conversion source 2D image is simply moved in the horizontal direction, if there is a change in the depth value of the pixel adjacent to the target pixel, a gap is generated between the pixels in the generated 3D image. . Therefore, the 3D video generation unit 36 can generate a 3D image so that no gap is generated between pixels, for example, by filling the amount of movement with the target pixel of the conversion source 2D image. The 3D video generation unit 36 can perform the above-described processing for each depth value, for example, the order of the depth value 0 to the depth value 255.

  Furthermore, the 3D video generation unit 36 can generate a 3D image in consideration of the convergence position. Since the convergence position indicates a depth value to be positioned on the screen plane, if the depth image is a 256-level gray scale image, the value of the convergence position is also in the range of 0-255. Here, when the convergence position is s_pos, the movement amount can be obtained by the following equation (2).

shift = (shift_max) × (ps−pos) / 255 (2)
Thereby, the movement width of the pixel having the same depth value as the convergence position on the depth image becomes zero. In addition, the moving direction of the pixels having other depth values on the depth image is opposite to the convergence position as a boundary. As a result, in the generated 3D image, a portion where the depth value is larger than the convergence position pops out, and a portion where the depth value is smaller than the convergence position is recessed.

  Although the case of two viewpoints has been described as a simple example, the 3D video generation unit 36 can generate a multi-viewpoint 3D image by changing the maximum amount of parallax for each viewpoint and applying it to the above equation. If the amount of parallax per viewpoint is shift0 and the number of viewpoints is vn, the maximum amount of parallax when generating a multi-viewpoint 3D image is in the range of 0 to (shift0 × (vn−1)) / 2. If the conversion source 2D image is arranged at the center position in order to suppress degradation of image quality due to 3D conversion, the maximum amount of parallax when generating a multi-viewpoint 3D image is − ((shift0 × (vn−1)). )) / 2) to (shift0 × (vn−1)) / 2. The 3D video generation unit 36 can use a position obtained by equally dividing the range as the maximum parallax amount of each viewpoint. FIG. 9A shows an example of the maximum parallax amount of each viewpoint when the number of viewpoints is an odd number (for example, five viewpoints V1 to V5). FIG. 9B shows an example of the maximum parallax amount of each viewpoint when the number of viewpoints is an even number (for example, six viewpoints V1 to V6).

  Returning to FIG. 1, the 3D video display unit 40 can refer to the 3D video generated by the 3D video generation unit 36 and stored in the 3D video storage unit 38 and display the 3D video on the confirmation 3D display 14. When the 3D parameter is adjusted by the 3D parameter adjustment unit 32, the 3D image display unit 40 displays the 3D image generated based on the 3D parameter at that time on the confirmation 3D display 14 in real time. be able to. That is, as shown in FIG. 5, when the 3D parameter is adjusted on the work 2D display 12, the 3D video reflecting the adjusted 3D parameter value can be displayed on the confirmation 3D display 14. In addition, the 3D video display unit 40 can display the 3D video on the confirmation 3D display 14 in synchronization with the depth video displayed in the display area 110 of the work 2D display 12. That is, it is possible to display a depth image and a 3D image corresponding to the same frame of the 2D image. The correspondence between frames between the 2D image, the depth image, and the 3D image can be performed by any method, for example, including the same character string as a part of the file name in the corresponding frame. The depth video and the 3D video can be synchronized with any depth, for example, by the depth video display unit 34 notifying the 3D video display unit 40 of information indicating the frame of the depth image being displayed on the work 2D display 12. This can be done by a technique.

  Returning to FIG. 1, the 3D video output unit 42 renders and outputs the 3D video after the adjustment of the 3D parameters is completed. For example, when the rendering button 142 is pressed on the adjustment screen 100 shown in FIG. 5, the 3D video output unit 42 reads out the 3D video from the 3D video storage unit 38 and outputs the final 3D video as a storage medium or an external device. Output to the information processing device.

  FIG. 10 is a flowchart illustrating an example of the flow of the entire 2D3D conversion process. First, the mask creation unit 22 reads the 2D video stored in the 2D video storage unit 20 (S1001), and creates a mask for each object by, for example, user input (S1002). When the mask is created, the layer data creation unit 24 creates layer data corresponding to each object and stores it in the layer data storage unit 26 (S1003). The depth video generation unit 28 combines the layer data (S1004), generates a depth video in which the depth value is set, and stores it in the depth video storage unit 50 (S1005).

  Thereafter, the 3D parameter adjustment unit 32 displays the adjustment screen 100 on the work 2D display 12, and based on the input from the user, parallax adjustment (S1006), convergence position adjustment (S1007), and edge correction (S1008) 3D parameter adjustment processing such as is performed, and the depth video stored in the depth video storage unit 50 is updated. When the 3D parameters are adjusted as described above, the 3D video generation unit 36 generates a 3D video based on the 3D parameters at that time, and stores the 3D video in the 3D video storage unit 38 (S1009).

  The 3D video stored in the 3D video storage unit 38 is referred to in real time by the 3D video display unit 40 and displayed on the confirmation 3D display 14 in synchronization with the depth video displayed on the work 2D display 12. (S1010). The user checks the 3D image by checking the adjustment result of the 3D parameter on the confirmation 3D display 14 in real time. When the check result is NG (S1011: NG), the 3D parameter adjustment operation is repeatedly executed. If the check result is OK (S1011: OK), the 3D video output unit 42 renders the 3D video stored in the 3D video storage unit 38 and outputs the final 3D video (S1012). The determination that the check result is OK can be made, for example, when the rendering button 142 is pressed on the adjustment screen 100.

  The present embodiment has been described above. According to this embodiment, the 3D parameter adjustment operation is performed on the work 2D display 12 using the adjustment screen 100, and the 3D video reflecting the adjustment result of the 3D parameter is confirmed on the confirmation 3D display 14 in real time. It is possible. Therefore, when adjusting the 3D parameters, the adjustment operation is temporarily finished, and then rendering is performed to check the 3D video, and the 3D parameters are adjusted again based on the confirmation result. It becomes unnecessary. As a result, it is possible to increase the efficiency of adjustment work of 3D parameters necessary for 2D3D conversion.

  In the present embodiment, since the depth image is displayed on the adjustment screen 100, it is easy to grasp how the 3D image is displayed based on the current depth value. Furthermore, in this embodiment, since the depth video and the 3D video are displayed in a synchronized state, the relationship between the current depth value and the 3D video can be more easily grasped.

  In the present embodiment, since the depth image can be temporarily stopped on the adjustment screen 100, it is easy to check the depth image. Since the 3D parameter for the depth image displayed by the temporary stop can be adjusted, it is easy to perform the 3D parameter adjustment operation.

  Further, in the present embodiment, when an edge exists in the depth image, it is possible to perform edge correction so that a difference in depth value between adjacent pixels becomes small. Thereby, it is possible to make the appearance of the 3D video more natural.

  In the present embodiment, since the 3D parameter can be adjusted for each layer, the adjustment work of the 3D parameter becomes easy, and the work efficiency can be improved.

  Further, in the present embodiment, it is possible to generate a multi-view 3D video of three or more viewpoints based on the 2D video and the 3D parameters. Accordingly, a more natural 3D video can be generated based on the 2D video.

  In the present embodiment, it is possible to acquire display information indicating specifications related to 3D display from the confirmation 3D display 14 and generate a 3D video using the display information. Therefore, an appropriate 3D video image corresponding to the 3D display is generated, and the 3D parameter can be adjusted while confirming the display result on the 3D display.

  Note that this embodiment is intended to facilitate understanding of the present invention and is not intended to limit the present invention. The present invention can be changed / improved without departing from the spirit thereof, and the present invention includes equivalents thereof.

DESCRIPTION OF SYMBOLS 10 Image processing apparatus 12 2D display for work 14 3D display for confirmation 20 2D image | video storage part 22 Mask preparation part 24 Layer data preparation part 26 Layer data storage part 28 Depth image generation part 30 3D parameter storage part 32 3D parameter adjustment part 34 Depth Video display unit 36 3D video generation unit 38 3D video storage unit 40 3D video display unit 42 3D video output unit

Claims (13)

A computer having a 2D video storage unit for storing 2D video and a 3D parameter storage unit for storing 3D parameters necessary for converting the 2D video into a 3D video,
An adjustment screen for adjusting the three-dimensional parameter is displayed on a first display, and the three-dimensional parameter stored in the three-dimensional parameter storage unit in response to a user input for adjusting the three-dimensional parameter 3D parameter adjustment function to update parameters,
A 3D video generation function for generating a 3D video based on the 2D video stored in the 2D video storage unit and the 3D parameter stored in the 3D parameter storage unit;
In a state where the three-dimensional parameter can be adjusted using the adjustment screen, the generated three-dimensional video is displayed on a second display corresponding to the three-dimensional display, which is different from the first display. 3D video display function,
An image processing program for realizing An image processing program according to claim 1,
The three-dimensional parameter includes a depth image representing a depth value in the two-dimensional image,
In the three-dimensional parameter adjustment function, the depth image can be displayed on the adjustment screen.
Image processing program. An image processing program according to claim 2,
The depth image and the 3D image are displayed on the first and second displays in a synchronized state.
Image processing program. An image processing program according to claim 2 or 3,
The depth video displayed on the first display can be paused in a state where an arbitrary depth image included in the depth video is displayed.
Image processing program. An image processing program according to claim 4,
In the three-dimensional parameter adjustment function, the three-dimensional parameter for the arbitrary depth image can be adjusted.
Image processing program. A program according to any one of claims 2 to 5,
In the three-dimensional parameter adjustment function, when a difference in depth value between adjacent pixels in a depth image included in the depth image is equal to or greater than a predetermined value, the adjacent pixels are reduced so that the difference in depth value is reduced. The depth value can be adjusted,
Image processing program. The program according to any one of claims 1 to 6,
The computer further includes a layer data storage unit that stores layer data representing a layer in the 2D video,
The three-dimensional parameter adjustment function is capable of adjusting the three-dimensional parameter for the layer specified on the adjustment screen based on the layer data stored in the layer data storage unit.
Image processing program. A program according to any one of claims 1 to 7,
The 3D parameter includes an amount of parallax when generating the 3D video.
Image processing program. A program according to any one of claims 1 to 8,
The 3D parameter includes a convergence position when generating the 3D video,
Image processing program. A program according to any one of claims 1 to 9,
The 3D video generation function can generate the 3D video having three or more viewpoints based on the 2D video and the 3D parameters.
Image processing program. It is a program as described in any one of Claims 1-10,
In the 3D video generation function, display information indicating specifications related to 3D display on the second display is acquired from the second display, the 2D video, the 3D parameter, and the display information are acquired. The three-dimensional video can be generated based on
Image processing program. A 2D video storage unit for storing 2D video;
A 3D parameter storage unit for storing 3D parameters required to convert the 2D image into a 3D image;
An adjustment screen for adjusting the three-dimensional parameter is displayed on a first display, and the three-dimensional parameter stored in the three-dimensional parameter storage unit in response to a user input for adjusting the three-dimensional parameter A three-dimensional parameter adjustment unit for updating parameters;
A 3D video generation unit that generates a 3D video based on the 2D video stored in the 2D video storage unit and the 3D parameters stored in the 3D parameter storage unit;
In a state where the three-dimensional parameter can be adjusted using the adjustment screen, the generated three-dimensional video is displayed on a second display corresponding to the three-dimensional display, which is different from the first display. A 3D video display,
An image processing apparatus comprising: A computer having a 2D video storage unit for storing a 2D video and a 3D parameter storage unit for storing a 3D parameter required to convert the 2D video into a 3D video,
An adjustment screen for adjusting the three-dimensional parameter is displayed on a first display, and the three-dimensional parameter stored in the three-dimensional parameter storage unit in response to a user input for adjusting the three-dimensional parameter Update the parameters,
Generating a 3D image based on the 2D image stored in the 2D image storage unit and the 3D parameter stored in the 3D parameter storage unit;
In a state where the three-dimensional parameter can be adjusted using the adjustment screen, the generated three-dimensional video is displayed on a second display corresponding to the three-dimensional display, which is different from the first display. ,
Image processing method.