KR102167836B1 - Method and system for omnidirectional environmental projection with Single Projector and Single Spherical Mirror - Google Patents

Abstract

The present invention relates to an omni-directional projection method and system based on a single projector and a spherical mirror that enables calibration using only a simple user input without accurate alignment of the projector and mirror in a general internal environment,
The method includes determining the relationship between the geometric coordinates of the projection space and the pixel coordinates of the projector image, and the relationship between the geometric coordinates of the projection space and the pixel coordinates of the input image based on environmental geometric information specified by the user, and then the projector image and the input. An omnidirectional calibration step of defining a pixel coordinate relationship between images to generate calibration information; And producing a projection image that is projected omnidirectionally onto the projection space by transforming the input image based on the calibration information.

Description

Method and system for omnidirectional environmental projection with Single Projector and Single Spherical Mirror

The present invention relates to an omni-directional projection method and system, and in particular, a single projector and a spherical mirror-based omni-directional projection method to make a panoramic display system easier and more convenient in an arbitrary space using only a single projector and a single spherical reflector, and It's about the system.

For decades, researchers in the computer graphics and virtual reality communities have been trying to provide a more realistic experience to the audience. Among them, the immersive environment system has been studied by projecting an image directly onto the environment to create a display space, and its beginning was Communications of the ACM (vol. 35, no. 6, pp. 64-72). , 1992) is a CAVE (audio visual experience automatic virtual environment) technology. And this immersive virtual environment system has been developed while being optimized for the human visual environment.

The multi-projection technique is a method for creating an immersive virtual space, and is a method of filling a wide viewing angle using multiple projectors. This has the advantage of allowing an image or video to be displayed in various environments, but has some problems that occur when using multiple projectors and servers for managing them.

First, it requires additional space to install the projector and server. Second, the equipment is expensive and expensive to install. Third, it requires a power system to maintain multiple equipment, a maintenance system such as temperature management and frequent lamp replacement. Because of these problems, it is not easy and time consuming to build a multiple projection system.

On the other hand, the mirror projection technology is a simple form in which an additional mirror is attached to the existing projector. In general, a spherical type mirror has been widely used to acquire omnidirectional image data (see “A practical spherical mirror omnidirectional camera” disclosed in Robotic and Sensor Environments, 2005. International Workshop on. IEEE (2005, pp. 8-13)). ). In the same principle, a spherical mirror can serve to diffuse the projector's light in the projection system.

Therefore, if a single projector uses a spherical mirror, it becomes a form that can cover a wide field of view (FOV). However, since spherical mirrors cause a problem of causing image deformation of radial distortion, conventional studies have performed calibration in the form of accurately aligning the projector and the mirror and calculating the reflection curvature. However, it is difficult to accurately align the centerline of the mirror and the projector in a general environment.

C. Cruz-Neira, D. J. Sandin, T. A. DeFanti, R. V. Kenyon, and J. C. Hart, "The cave: audio visual experience automatic virtual environment," Communications of the ACM, vol. 35, no. 6, pp. 64-72, 1992. A. Ohte, O. Tsuzuki, and K. Mori, "A practical spherical mirror omnidirectional camera," in Robotic Sensors: Robotic and Sensor Environments, 2005. International Workshop on. IEEE, 2005, pp. 8-13.

Accordingly, as to solve the above problems, the present invention is a single projector and spherical mirror-based omnidirectional projection method that enables calibration using only a simple user input without accurate alignment of the projector and mirror in a general internal environment, and We want to provide a system.

The object of the present invention is not limited to the object mentioned above, and other objects not mentioned will be clearly understood by those of ordinary skill in the art from the following description.

As a means for solving the above problem, according to an embodiment of the present invention, the relationship between the geometric coordinates of the projection space and the pixel coordinates of the projector image and the geometric coordinates and input of the projection space based on the environmental geometric information specified by the user An omnidirectional calibration step of generating calibration information by determining a relationship between image pixel coordinates and defining a pixel coordinate relationship between the projector image and the input image; And a projection image production step of producing a projection image that is omnidirectionally projected onto the projection space by modifying the input image based on the calibration information.

The omnidirectional calibration step may include determining a relationship between the geometric coordinates of the projection space and the pixel coordinates of the projector image by designating the environmental geometric information to pixel coordinates of the projector image; Determining a relationship between the geometric coordinates of the projection space and the pixel coordinates of the input image by adjusting the area ratio of the input image through the environmental geometric information; And generating calibration information by grasping and defining a relationship between the pixel coordinates of the projector image and the pixel coordinates of the input image through the geometric coordinates of the projection space.

The environmental geometric information is adjustable through positions of eight corner point designators and 12 corner line designators of a rectangular parallelepiped corresponding to a projection environment.

"의 식에 따라 샘플링된 가이드점(

)들을 계산한 후, 상기 샘플링된 가이드점(

)들을 통해 상기 투사공간의 기하좌표와 상기 프로젝터이미지의 픽셀 좌표 사이의 관계를 구체화하는 것을 특징으로 하며, 상기 c_i는 상기 직육면체의 모서리점 지정자, 상기 b_k는 상기 직육면체의 모서리선 지정자, 상기 g_k는 서로 다른 두 개의 모서리점 지정자와 상기 서로 다른 두 개의 모서리점 지정자를 연결하는 모서리선 지정자로 구성된 제1 가이드 곡선, 상기 t는 샘플링 단계인 것을 특징으로 한다. The step of determining the relationship between the geometric coordinates of the projection space and the pixel coordinates of the projector image is "

Guide points sampled according to the equation (

) After calculating, the sampled guide point (

) To specify the relationship between the geometric coordinates of the projection space and the pixel coordinates of the projector image, wherein c _i is a corner point designator of the rectangular parallelepiped, and b _k is an edge designator of the rectangular parallelepiped, the g _k is a first guide curve composed of two different corner point designators and an edge designator connecting the two different corner point designators, and t is a sampling step.

)들을 계산한 후, 상기 샘플링된 가이드점(

)들을 통해 투사공간의 기하좌표와 프로젝터이미지의 픽셀 좌표 사이의 관계를 구체화하는 것을 특징으로 하며, 상기 d_i는 상기 직육면체의 모서리점 지정자, 상기 v_k는 상기 직육면체의 모서리선 지정자, 상기 q_k는 서로 다른 두 개의 모서리점 지정자와 상기 서로 다른 두 개의 모서리점 지정자를 연결하는 모서리선 지정자로 구성된 제2 가이드 곡선, 상기 t는 샘플링 단계인 것을 특징으로 한다. The determining of the relationship between the geometric coordinates of the projection space and the pixel coordinates of the input image includes a guide point sampled according to the Bezier cursor equation (

) After calculating, the sampled guide point (

) To specify the relationship between the geometric coordinates of the projection space and the pixel coordinates of the projector image, wherein d _i is a corner point designator of the rectangular parallelepiped, v _k is an edge designator of the rectangular parallelepiped, and q _k Is a second guide curve composed of two different corner point designators and an edge designator connecting the two different corner point designators, and t is a sampling step.

The step of producing the projection image may include creating a displacement map based on the first and second guide curves, and then spreading the displacement map over the entire projection area; And obtaining the projection image by transforming the input image based on the diffused displacement map.

In addition, in the step of producing the projection image, the panoramic image is transformed through rear warping.

In addition, the step of producing the projection image may further include performing a focus adjustment operation using a sharpening effect based on the calibration information.

As a means for solving the above problem, according to another embodiment of the present invention, a single spherical mirror installed on the ceiling of the projection space; A single projector installed on the floor of the projection space and projecting an image toward the single spherical mirror; And the relationship between the geometric coordinates of the projection space and the pixel coordinates of the projector image and the relationship between the geometric coordinates of the projection space and the pixel coordinates of the input image based on the environmental geometric information specified by the user, and then between the projector image and the input image. Omnidirectional including a processor that defines a pixel coordinate relationship to generate calibration information, generates a projection image to be projected omnidirectionally onto the projection space by transforming the input image based on the calibration information, and provides it to the single projector Provides a projection system.

The present invention proposes an omni-directional environmental mirror projection system using a single projector and a single spherical reflector to make a panoramic display system easier and more convenient in an arbitrary projection space. In other words, for a quicker and easier calibration process, an intuitive and optimized calibration system was provided to the user to increase the efficiency of the system installation process. In addition, a method of warping and correcting the image based on the calibration information to create an image optimized for the projection environment is suggested.

Accordingly, it can be seen that according to the present invention, it is possible to more easily and quickly construct an omnidirectional environment projection system. In addition, by proposing an image production method optimized for the projection environment, it is possible to produce an image without loss of resolution.

1 is a view showing the object of the present invention to build an omni-directional projection environment using panoramic content according to an embodiment of the present invention.
2 is a view for explaining an omni-directional projection system based on a single projector and a spherical mirror according to an embodiment of the present invention.
3 is a diagram for explaining an omni-directional projection method based on a single projector and a spherical mirror according to an embodiment of the present invention.
4 is a diagram for explaining in more detail an omnidirectional calibration step according to an embodiment of the present invention.
5 is a view for explaining in more detail a step of specifying environmental geometric information in an omnidirectional calibration step according to an embodiment of the present invention.
6 is a diagram for explaining in more detail an image registration step in an omnidirectional calibration step according to an embodiment of the present invention.
7 is a view for explaining in more detail a projection image production step according to an embodiment of the present invention.
8 is a view for explaining in more detail a displacement map diffusion step according to an embodiment of the present invention.
9 is a view for explaining a focus adjustment image warping process according to an embodiment of the present invention.
10 is a diagram showing an example of a defocus phenomenon according to an embodiment of the present invention.
11 is a diagram showing a focus adjustment result according to an embodiment of the present invention.
12 is a diagram for explaining installation efficiency according to an omni-directional projection method based on a single projector and a spherical mirror according to an embodiment of the present invention.

Objects and effects of the present invention, and technical configurations for achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. In describing the present invention, when it is determined that a detailed description of a known function or configuration may unnecessarily obscure the subject matter of the present invention, a detailed description thereof will be omitted.

In addition, terms to be described later are terms defined in consideration of functions in the present invention, which may vary depending on the intention or custom of users or operators.

However, the present invention is not limited to the embodiments disclosed below, and may be implemented in various different forms. These embodiments are provided only to make the disclosure of the present invention complete, and to fully inform the scope of the invention to those skilled in the art to which the present invention pertains, and the present invention is defined by the scope of the claims. It just becomes. Therefore, the definition should be made based on the contents throughout this specification.

Prior to describing the present invention, an omni-directional environmental mirror projection system installation and operation process will be described below to aid in understanding the present invention.

1 is a view showing the object of the present invention to build an omni-directional projection environment using panoramic content according to an embodiment of the present invention.

As shown in (a) of FIG. 1, the input in the present invention covers the omnidirectional space from 0° to 360° horizontally using Cylindrical Projection, and from -90° to 90° vertically. This is a standard input image in the form of projecting up to °.

As a result of this, as shown in (b) of FIG. 1, an image is projected on the surfaces of the omnidirectional environment.

In the present invention, the shape of the environmental space was determined as a rectangular parallelepiped. These selections are to select the most common types and increase the versatility of the system to which the present invention is applied. In conclusion, the present invention enables omnidirectional projection of a standard panoramic image onto an interior space in the form of a rectangular parallelepiped.

2 is a view for explaining an omni-directional projection system based on a single projector and a spherical mirror according to an embodiment of the present invention.

As shown in Fig. 2, the omnidirectional projection system of the present invention is a single projector 20 projecting an image with a single spherical mirror 10 installed on the ceiling of the projection space and a single spherical mirror 10 installed on the floor of the projection space. ), and the relationship between the geometric coordinates of the projection space and the pixel coordinates of the projector image (E⇔P) and the relationship between the geometric coordinates of the projection space and the pixel coordinates of the input image (E⇔I) based on the environmental geometric information specified by the user. After identification, the relationship between the pixel coordinates of the projector image and the pixel coordinates of the input image (I⇔E⇔P) is defined to generate calibration information, and then the input image is transformed based on the calibration information to be projected omnidirectionally into the projection space. It may include a processor 30 and the like to be manufactured and provided to a single projector 20.

The arrangement position of the single spherical mirror 10 and the single projector 20 in the projection space can be varied in various ways, but it is best to have a shape that fills the floor and side walls similar to the arrangement according to the CAVE technology described above. It would be desirable.

Accordingly, in the present invention, after placing the single spherical mirror 10 on the ceiling of the projection space and the single projector 20 facing each other on the floor of the projection space, the single projector 20 faces the single spherical mirror 10. Is projected so that the image is projected in a 270° omnidirectional space excluding the ceiling.

However, previous studies on mirror projection allow calibration to proceed in a form in which the axes of the projector and the mirror are accurately aligned, but in the present invention, this problem is solved together in the calibration process without having to separately perform an alignment process between hardware devices. do.

3 is a diagram for explaining an omni-directional projection method based on a single projector and a spherical mirror according to an embodiment of the present invention.

Referring to FIG. 3, the omnidirectional projection method of the present invention may largely include an omnidirectional calibration step (S10) and a projection image production step (S20).

A general environmental projection system requires a calibration process to specify the projection environment information and an image transformation process corresponding thereto, and the present invention also performs an omnidirectional calibration step (S10) and a projection image production step (S20) similar to the general environmental projection system. To be included.

First, in step S10, after finding the relationship between the pixel coordinates of the input image, the geometric coordinates of the projection space, and the pixel coordinates of the projector, based on this, calibration information defining the pixel coordinate relationship between the input image and the projector is generated. This is the process of environment geometry assignment to find the relationship between the pixel coordinates of the projector image and the geometric coordinates of the projection space, and Image registration to find the relationship between the pixel coordinates of the input image and the geometric coordinates of the projection space. It consists of a process, and a calibration information process of generating calibration information by identifying and defining the relationship between the pixel coordinates of the projector image and the pixel coordinates of the input image through the geometric coordinates of the projection space.

Then, in step S20, an image optimized for the projection environment is produced based on the previous calibration information from the input panoramic image. This is a displacement map diffusion process that spreads the input calibration information to the entire image pixel coordinates, an image warping process according to this displacement map, and a defocusing effect caused by an imbalance in focal length. It consists of a focus correction process to solve the problem.

4 is a diagram for explaining in more detail an omnidirectional calibration step according to an embodiment of the present invention.

Referring to FIG. 4, the omnidirectional calibration step of the present invention receives geometric information on a projection environment from a user and designates the relationship between the geometric coordinates (E) of the projection space and the pixel coordinates (P) of the projector image. The information designation step (S11) and the image registration step (S12) of specifying the relationship between the projection environment and the input image, that is, the relationship between the geometric coordinates (E) of the projection space and the pixel coordinates (I) of the input image, and projection The calibration information generation step (S13) of generating calibration information by grasping and defining the relationship between the pixel coordinates (P) of the projector image and the pixel coordinates (I) of the input image through the geometric coordinates of space (E) as a medium. Can include.

As described above, in the present invention, the relationship between the pixel coordinates of the input image and the projection coordinates of the projector is grasped through the environmental geometric information designation step (S11) and the image registration step (S12), and based on this, the image projection optimized for the projection environment is performed. Make it happen (I⇔E⇔P).

In other words, according to the present invention, the relationship between the pixel coordinate I of the input image and the pixel coordinate P of the projector image is specified through the omnidirectional calibration step. In addition, considering that the environment projection system visualizes content through the environment, it is necessary to additionally specify the geometric coordinate (E) of the projection space between the two pixel coordinates (I, P). And finally, the relationship between I and P is concreted through the geometric coordinates (E) of the projection space. In addition, guide lines expressed in color at each pixel coordinate I and P are provided to the user to provide an environment in which the concrete process can be performed.

Hereinafter, referring to FIGS. 5 and 6, the environmental geometric information designation step S11 and the image registration step S12 will be described in more detail.

In the environmental geometric information designation step S11, the environmental geometric information is designated in the pixel coordinates of the projector image.

First, the projector image pixel coordinate (P) is divided into a projection area and a non-projection area due to a mismatch between the spherical mirror and the projector image pixel coordinates. Fig. 5(a) shows this discrepancy and the shape of the projection area.

Second, the projection area is divided into individual faces of the environment space. Fig. 5(b) shows the division of the projection area. However, it is not easy to accurately designate the process of classifying and designating the surface of each projection area due to image deformation caused by the spherical mirror.

Accordingly, in the present invention, designators as shown in FIG. 5C are provided to the user to assist in the process of designating environmental geometric information. For example, in the present invention, considering that a standard panoramic image is projected omnidirectionally into an interior space in the form of a rectangular parallelepiped consisting of 8 points and 12 corners, 8 corner point designators (c _i ) in red and green It is possible to provide 12 edge designators (b _k ). The user can adjust the guide curves g _k for inputting environmental geometric information through the positions of the designators. This guide curve can be expressed as a colored curve in Fig. 5(d).

)들이 계산된다.In this process, the present invention used a quadratic Bezier curve to make a guide curve from the designators. This is because the radial image deformation generated from the spherical mirror is in the form of a quadratic curve. The second order Bezier guide curve is composed of a corner point designator, which is a starting point and an end point, and one corner line designator, respectively, and sampled guide points (g _k ) of the guide curves (g _k ) through Equation 1 below (

) Are calculated.

[Equation 1]

)들을 통해 구체화하였다In conclusion, in the present invention, the relationship between the pixel coordinate (P) of the projector image and the geometric coordinate (E) of the projection space is determined by the sampled guide point of the guide curve (g _k ).

) Through

[Equation 2]

In the image registration step S12, the relationship between the pixel coordinates P of the input image and the geometric coordinates E of the projection space is specified.

)을 조정한다. 각각의 투사환경의 크기와 비율이 가변적이기 때문에 이에 따라 사용자는 d_i와 v_k를 조정하여 입력 이미지 영역의 비율을 조절해줘야 할 필요가 있다.As shown in FIG. 6, the input panoramic pixel coordinates (P) also use the same number of 8 corner point designators (d _i ) and 12 corner line designators (v _k ). Guide points sampled according to the quadratic Bezier curve equation of Equation 3 (or the nth Bezier curve equation of Equation 4) using these designators (

) To adjust. Since the size and ratio of each projection environment are variable, the user needs to adjust the ratio of the input image area by adjusting d _i and v _k accordingly.

[Equation 3]

[Equation 4]

"와 같이 6개의 조절점들(P0~P5)로 계산되는 5차 베지어 곡선을 나타낸다. 그리고 이를 조절점의 최소화를 위한 2차 베지어 곡선의 형태로 표현하면, 상기 수학식 3과 같이 표현되게 된다. 즉, 본 발명은 작업 환경, 작업 부하등을 고려하여 베지어 곡선의 차수를 능동가변하면서 상기의 가이드 점 샘플링 동작을 수행하도록 한다. Equation 4 is an equation defining a general nth order Bezier curve, where n+1 represents the number of control points of the Bezier curve. For example, if n=5, "

It represents a 5th order Bezier curve calculated from six control points (P0 to P5) as shown in ". And if this is expressed in the form of a quadratic Bezier curve for minimizing control points, it is expressed as in Equation 3 above. That is, the present invention performs the above-described guide point sampling operation while actively varying the order of the Bezier curve in consideration of a work environment, a work load, and the like.

In addition, the sampling method of the guide point designates a point by changing the value of t from 0 to 1 according to the Bezier curve equation. Therefore, if the size of the change amount is small, the points can be obtained more densely. Here, the value of the change amount for sampling of the guide point is designated up to twice the distance between the start and end points of the Bezier curve in consideration of the resolution of the output image, so that the maximum curvature can be secured within the resolution.

)들의 샘플링된 가이드점(

)들에 따라 관계를 구체화하도록 한다. In conclusion, as in Equation 5, the present invention relates the relationship between the input image pixel coordinate (I) and the geometric coordinate (E) of the projection space to the guide curve (

) Of sampled guide points (

) To specify the relationship.

[Equation 5]

7 is a view for explaining in more detail a projection image production step according to an embodiment of the present invention.

Referring to FIG. 7, in the projected image production step of the present invention, the displacement map diffusion step (S21) of gently spreading the displacement map over the entire projection area, and an optimized image through image warping based on the diffused displacement map It may include an image warping step (S22), and a focus adjustment step (S23) of performing a focus adjustment operation to improve projection quality.

,

)의 대응관계 또한 구체화된다. 따라서 프로젝터 이미지픽셀좌표 P의 가이드 곡선((g_k)들의 모든 샘플링된 점

들 중 각각의 픽셀 x들에 대하여 변위점 v(x)을 구체화 할 수 있다.In the displacement map diffusion step of step S21, as shown in Fig. 8A, an initial displacement map is produced through guide curves g _k and q _k of each coordinate system. Guide points that are sampled and calculated in step t in advance according to the correspondence of guide curves (

,

The correspondence of) is also specified. Therefore, all sampled points of the guide curve ((g _k ) of the projector image pixel coordinate P

The displacement point v(x) can be specified for each of the pixels x.

) 위에만 희박하게 지정되므로, 도8의 (c)에서와 같이전체 변위맵 Ω에 걸쳐서 부드럽게 확산시켜주는 과정이 필요하다. 이에 부분적으로 존재한 정보를 디리클레(Dirichlet) 경계 조건으로, 본 발명에서는 x, y각각의 좌표계에 대해서 라플라시안(Laplace)을 이용하여 상기 문제를 해결하도록 한다. However, as shown in (b) of FIG. 8, the displacement point v(x) is the guide curves (

), so it is sparsely designated over the entire displacement map Ω, as shown in Fig. 8(c). Accordingly, the partially existing information is used as a Dirichlet boundary condition, and in the present invention, the above problem is solved by using Laplace for each of the x and y coordinate systems.

[Equation 6]

In the image warping step of step S22, the input image as shown in (c) of FIG. 9 is transformed to create a projection image as shown in (d) of FIG. 9 in accordance with the omni-directional environmental projection system.

9 shows the result of the image warping process. In the present invention, image transformation is performed through backward warping based on the dense displacement map Ω calculated in units of pixels. The projected image produced in this way has a shape similar to the'Little Planet' (refer to Fig. 9(b)), which is the result of stereographic projection (refer to Fig. 9(a)) among the types of input images. This is because the projection direction has a direction similar to that of the polar coordinate system. However, the shape of the Little Planet can only maintain a uniform projection direction, so that the separation and ratio of the projection area cannot be considered, whereas the method of the present invention enables omnidirectional environmental projection by producing an optimized image tailored to the environmental geometric information.

However, as shown in (a) of FIG. 10, according to the omnidirectional environmental mirror projection system of the present invention, a defocus phenomenon may occur spatially (in the direction of the red line). This is because the projection distance of light for each pixel of the projector is not constant.

Accordingly, the present invention further includes a focus adjustment step of step S23, through which a sharpening effect is applied based on the calibration data to perform focus adjustment. The focus adjustment method using this sharpening effect is a general method used to solve the defocus phenomenon of the projector. However, in the present invention, when adjusting the focus, it is assumed that the user maintains the focus of the projector in the middle of the side wall (corresponding to the blue dot in Fig. 10(a)). Create a picture adjustment map and proceed with focus adjustment.

FIG. 11 is a view showing a focus adjustment result according to an embodiment of the present invention. Compared to the image before focus adjustment of FIG. 11 (a), the image after focus adjustment of FIG. 11 (b) has a sharper focus. Can be seen.

12 is a diagram for explaining installation efficiency according to an omni-directional projection method based on a single projector and a spherical mirror according to an embodiment of the present invention.

The omnidirectional projection results and user evaluation results using the system proposed in the present invention are shown. All experiments were conducted in the same omnidirectional mirror projection system space, cube room, which is a rectangular space with a length of about 2.5m in width, length, and height, and its size is CAVE technology, the first immersive virtual environment system. It was decided by reference.

The experimental group was divided into beginner users using the system of the present invention and synthesis experts who are familiar with existing tools. The beginner user experiment group consisted of general graduate students, and consisted of users who had not previously used the system of the present invention. After learning how to use the system simply through the manual, they installed the omni-directional projection system using the system. After initializing all the settings of the system of the present invention, the time of installing the system from the beginning was measured.

As a result, the average installation time of the experimental groups of novice users using the method of the present invention took an average of 10.893 minutes for the calibration process and 5.203 minutes for the projected image calculation, a total of 16.096 minutes.

On the contrary, the synthesis expert experiment group was conducted using The Foundary's Nuke program, which is the most widely used synthesis tool by experts with about 5 years of synthesis expertise in the visual effects industry.

The expert also measured the time starting in the same situation where all syschem settings were initialized. After five trials, the average result shows that the total installation time takes about 1 hour and 20 minutes.

From the above results, it can be seen that the method of the present invention reduces the installation time more efficiently than the method using the existing tools, and it can be seen that novice users without specialized knowledge can easily and quickly construct an omnidirectional environmental projection system. have.

[Table 1]

The above description is merely illustrative of the technical idea of the present invention, and those of ordinary skill in the art to which the present invention pertains will be able to make various modifications and variations without departing from the essential characteristics of the present invention. Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but to explain the technical idea, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be interpreted as being included in the scope of the present invention.

Further, the omnidirectional projection method and system based on a single projector and a spherical mirror according to the present invention can be implemented as computer-readable codes on a computer-readable recording medium. The computer-readable recording medium includes all types of recording devices that store data that can be read by a computer system. Examples of recording media include ROM, RAM, CD ROM, magnetic tapes, floppy disks, optical data storage devices, hard disks, and flash drives, and also implemented in the form of a carrier wave (for example, transmission through the Internet). Include. In addition, the computer-readable recording medium can be distributed over a computer system connected through a network to store and execute computer-readable codes in a distributed manner.

Claims (10)

Obtaining a first guide point for designating a relationship between the geometric coordinates of the projection space and the pixel coordinates of the projector image based on the environmental geometric information specified by the user;
Obtaining a second guide point for designating a relationship between the geometric coordinates of the projection space and the pixel coordinates of the input image based on the environmental geometric information; And
Producing a projection image that is omnidirectionally projected onto the projection space by transforming the input image based on calibration information including the first guide point and the second guide point
Including,
The step of obtaining the first guide point
Based on a Bezier curve having a designator on pixel coordinates of the projector image corresponding to an edge of the projection space and a designator on pixel coordinates of the projector image corresponding to both end points of the edge line as control points, Generating a first guide curve; And
Sampling the first guide point from the first guide curve
Including,
The step of obtaining the second guide point
A second guide curve based on a Bezier curve having a designator on a pixel coordinate of the input image corresponding to an edge of the projection space and a designator on a pixel coordinate of the input image corresponding to both end points of the edge line as control points Generating; And
Sampling the second guide point from the second guide curve
Including
Single projector and spherical mirror based omni-directional projection method.
delete The method of claim 1, wherein the environmental geometric information
Based on the geometric information of the projection space, adjustable through the positions of a designator corresponding to the edge of the projection space and a designator corresponding to the end point of the edge line
Single projector and spherical mirror based omni-directional projection method.
The method of claim 1, wherein obtaining the first guide point
"

"The first guide point sampled according to the equation (

) After calculating, the sampled first guide point (

) Specifying the relationship between the geometric coordinates of the projection space and the pixel coordinates of the projector image
Including,
The c _i is a corner point designator corresponding to the end point of the corner line, the b _k is an corner line designator corresponding to the corner line, and g _k is two different corner point designators and the two different corner point designators. A first guide curve consisting of connecting edge designators, wherein t is a sampling step.
Single projector and spherical mirror based omni-directional projection method.
The method of claim 1,
The step of obtaining the second guide point
“

The second guide point sampled according to the equation (

) After calculating, the sampled second guide point (

) Specifying the relationship between the geometric coordinates of the projection space and the pixel coordinates of the input image,
The d _i is a corner point designator corresponding to the end point of the edge line, the v _k is an edge line designator corresponding to the corner line, and q _k is two different corner point designators and the two different corner point designators. A second guide curve consisting of connecting edge designators, wherein t is a sampling step.
Single projector and spherical mirror based omni-directional projection method.
The method of claim 1,
The step of producing the projection image
Creating a displacement map based on the first and second guide curves and then spreading the displacement map over the entire projection area; And
Obtaining the projection image by transforming the input image based on the diffused displacement map
Including
Single projector and spherical mirror based omni-directional projection method.
The method of claim 6,
The step of obtaining the projection image by transforming the input image
Transforming the input image through rear warping
Including
Single projector and spherical mirror based omni-directional projection method.
The method of claim 1,
The step of producing the projection image
Performing a focus adjustment operation using a sharpening effect based on the calibration information
Further comprising
Single projector and spherical mirror based omni-directional projection method.
A computer-readable recording medium in which a program for executing an omni-directional projection method based on a single projector and a spherical mirror according to any one of claims 1 and 3 to 8 is recorded. A single spherical mirror installed on the ceiling of the projection space;
A single projector installed on the floor of the projection space and projecting an image toward the single spherical mirror; And
Acquires a first guide point that specifies the relationship between the geometric coordinates of the projection space and the pixel coordinates of the projector image based on the environmental geometric information specified by the user, and based on the environmental geometric information, the geometric coordinates of the projection space and the input image A projected image that is projected omnidirectionally into the projection space by obtaining a second guide point specifying a relationship between pixel coordinates, transforming the input image based on calibration information including the first guide point and the second guide point And a processor provided to the single projector after manufacturing,
The first guide point is a Bezier curve in which a designator on pixel coordinates of the projector image corresponding to an edge of the projection space and a designator on pixel coordinates of the projector image corresponding to both end points of the edge line are used as control points. curve) generated by sampling the first guide curve,
The second guide point is based on a Bezier curve using a designator on the pixel coordinates of the input image corresponding to an edge of the projection space and a designator on the pixel coordinates of the input image corresponding to both end points of the edge line as control points. Calculated by sampling the generated second guide curve
Omnidirectional projection system.

Images