TWI865069B - Matrix imaging apparatus - Google Patents

Abstract

A matrix imaging apparatus includes a base and an imaging module. The base is for placing an object and includes a plurality of gradient color rings. The imaging module includes a plurality of cameras arranged in a matrix. The imaging module can simultaneously capture a plurality of two-dimensional images containing a portion of the object and a portion of the gradient color rings through the cameras, and combine the plurality of two-dimensional images into a three-dimensional image corresponding to the geometry and color of the object based on the color of the gradient color rings, the location at which the object is taken, and the color of the object.

Description

Matrix imaging equipment

The present invention relates to an imaging device, and in particular to a matrix imaging device that can capture multiple two-dimensional images and synthesize them into a three-dimensional image.

Three-dimensional modeling technology has received considerable attention in modern times. Generally, three-dimensional modeling refers to the use of images captured by cameras as the basis, through the reconstruction algorithm, to calculate and restore the three-dimensional spatial information of real scenes or objects. This technology has been widely used in industries such as autonomous driving, 3D printing, intelligent robot vision, medical treatment, virtual reality, e-commerce, game entertainment, and automated manufacturing.

One way to achieve the above three-dimensional modeling is to use special equipment, such as using an imaging device that can calculate depth information to directly generate a three-dimensional image. However, this method relies on complex hardware equipment and professional operations, and the equipment cost is high and is not conducive to popularization. Another way is to use algorithms such as MVS (Multi View Stereo) to align and stitch multiple captured two-dimensional images to synthesize a three-dimensional image. However, this type of algorithm consumes too much resources and is not conducive to using general equipment with limited resources for calculation. Furthermore, the selection of matching positioning parameters between multiple images is still too complicated. There are also other ways to perform three-dimensional modeling through photography, but how to stitch the three-dimensional images still relies on a lot of manual operation or complex calculations, and the cost is still high.

Based on this, it is still necessary to develop a system with simple and efficient calculations that can be used to construct an accurate three-dimensional modeling system using common equipment.

The present invention provides a matrix imaging device, which uses an imaging module with a camera arranged in a matrix, and can align and splice the captured two-dimensional image of the object to be tested to synthesize a three-dimensional image of the object to be tested. Through a special imaging method, the accuracy and efficiency of the synthesized three-dimensional image are improved, and the real three-dimensional geometric shape and color of the object to be tested can be highly restored.

In one embodiment, the present invention provides a matrix imaging device, which includes a base and an imaging module. The base is used to place an object to be tested, which includes a plurality of gradient color rings. The imaging module is arranged around the base, and includes a plurality of cameras arranged in a matrix. The imaging module can simultaneously capture a plurality of two-dimensional images including a partial area of the object to be tested and a partial area of the gradient color rings through the cameras, and combine the plurality of two-dimensional images into a three-dimensional image corresponding to the geometry and color of the object to be tested according to the colors of the gradient color rings, the imaging position of the object to be tested, and the color of the object to be tested. During operation, the object to be tested remains stationary and the imaging module moves around the object to be tested; or the imaging module remains stationary and the base drives the object to be tested to rotate, so that the imaging module captures multiple two-dimensional images corresponding to the partial area of the object to be tested and the partial area of the gradient color rings.

In one embodiment, the cameras of the imaging module can be installed in a camera, a mobile phone, a laptop or a tablet computer.

In one embodiment, each gradient color ring may include multiple gradient color blocks.

In one embodiment, each gradient color block may include red and its gradient color series, blue and its gradient color series, green and its gradient color series, or a gradient color series composed of any of the aforementioned colors.

In one embodiment, the gradient color block may include cyan and its gradient color system, magenta and its gradient color system, yellow and its gradient color system, or a gradient color system composed of any of the aforementioned colors.

In one embodiment, multiple cameras may be arranged in a one-dimensional linear array, a two-dimensional linear array, or a three-dimensional linear array.

In one embodiment, multiple cameras may be arranged in a one-dimensional annular array, a two-dimensional annular array, or a three-dimensional annular array.

100: Matrix imaging equipment

110: Base

111: Gradient color ring

111a, 111b, 111c: gradient color blocks

120: Imaging module

121: Camera

O: Object to be tested

FIG. 1 is a schematic diagram showing the structure of a matrix imaging device according to an embodiment of the present invention; FIG. 2 is a schematic diagram showing another structure of the matrix imaging device of FIG. 1; FIG. 3 is a schematic diagram showing a gradient color block of a gradient color ring in the matrix imaging device of FIG. 1; FIG. 4 is a schematic diagram showing an operation mode of the matrix imaging device of FIG. 1; FIG. 5 is a schematic diagram showing another operation mode of the matrix imaging device of FIG. 1.

The following will describe multiple embodiments of the present invention with reference to the drawings. For the sake of clarity, many practical details will be described together in the following description. However, it should be understood that these practical details should not be used to limit the present invention. In other words, in some embodiments of the present invention, these practical details are not necessary. In addition, in order to simplify the drawings and focus on the main technical features of the case, some commonly used, non-essential structures and components will be shown or omitted in the drawings in a simple schematic manner.

Please refer to Figure 1, Figure 2 and Figure 3. Figure 1 is a schematic diagram showing the structure of a matrix imaging device 100 according to an embodiment of the present invention. Figure 2 is a schematic diagram showing another structure of the matrix imaging device 100 of Figure 1. Figure 3 is a schematic diagram showing the gradient color blocks 111a, 111b, and 111c of the gradient color ring 111 in the matrix imaging device 100 of Figure 1.

The present invention provides a matrix imaging device 100, which includes a base 110 and an imaging module 120. The base 110 is used to place an object to be tested O, which includes a plurality of gradient color rings 111. The imaging module 120 is arranged around the base 110, and includes a plurality of cameras 121 arranged in a matrix. The imaging module 120 can simultaneously capture a plurality of two-dimensional images including a partial area of the object to be tested O and a partial area of the gradient color rings 111 through the cameras 121, and combine the plurality of two-dimensional images into a three-dimensional image corresponding to the geometry and color of the object to be tested O according to the colors of the gradient color rings 111, the imaging position of the object to be tested O, and the color of the object to be tested O.

Each camera 121 can be mounted on a camera, a mobile phone, a laptop, a tablet computer or other devices that can be equipped with a camera 121. When the imaging module 120 captures multiple two-dimensional images of different regions of the object to be tested O through multiple cameras 121, it also captures multiple two-dimensional images of different regions of the gradient color ring 111 of the base 110. In other words, a single two-dimensional image captured by each camera 121 includes a partial regional image of the object to be tested O and a partial regional image of the gradient color ring 111 of the base 110.

The multiple cameras 121 in the imaging module 120 can have a variety of arrangements. In Figure 1, the multiple cameras 121 are coaxially arranged along a straight line to form a linear array. In addition, multiple groups of coaxially arranged cameras 121 are arranged into a two-dimensional linear array. There is no special restriction on the number of cameras 121. A larger number of cameras 121 can capture a larger number of two-dimensional images, which helps to synthesize a three-dimensional image that is closer to the real geometry and color of the object O to be tested. The linear array formed by the arrangement of the cameras 121 can be a one-dimensional linear array, a two-dimensional linear array, or a three-dimensional linear array. In Figure 2, the multiple cameras 121 are arranged in a ring array. In other words, the multiple cameras 121 surround the object O to be tested in a ring shape to capture multiple two-dimensional images that simultaneously include a partial area of the object O to be tested and a partial area of the gradient color ring 111 of the base 110. Similarly, the ring array can also be a one-dimensional ring array, a two-dimensional ring array, or a three-dimensional ring array.

Each gradient color ring 111 of the base 110 may include multiple gradient color blocks 111a, 111b, and 111c. For example, in FIG. 3, the base includes three gradient color rings 111, and each gradient color ring includes three gradient color blocks 111a, 111b, and 111c.

The colors of the gradient blocks 111a, 111b, and 111c may be the same or different. In one embodiment, the gradient block 111a may include red and its gradient colors, the gradient block 111b may include blue and its gradient colors, and the gradient block 111c may include green and its gradient colors. The colors of the gradient blocks 111a, 111b, and 111c may also include a gradient color system composed of any of the aforementioned colors. In another embodiment, the gradient block 111a may include cyan and its gradient colors, the gradient block 111b may include magenta and its gradient colors, and the gradient block 111c may include yellow. The colors of the gradient blocks 111a, 111b, and 111c may also include a gradient color system composed of any of the aforementioned colors.

In the present invention, the gradient color blocks 111a, 111b, 111c use a color system that uses red, green, and blue light, which can also be called the three primary colors of light, because they are basic colors that cannot be decomposed and can be combined into any color. In another color system, yellow, cyan, and magenta can also be called the three primary colors of pigments, which are based on red mixed with green to obtain yellow, green mixed with blue to obtain cyan, and blue mixed with red to obtain magenta. By mixing the three primary colors of light or the three primary colors of pigments in different proportions and intensities, complex and realistic colors can be obtained. However, the above color system is only an example. Depending on different purposes, more types of gradient color blocks 111a, 111b, 111c can be used. The number of gradient color blocks can be three or more, and the color system does not necessarily have to use three colors as mentioned above. The number of colors can be three or more without special restrictions.

Generally, when a 3D image model of an object to be tested is constructed by synthesizing multiple 2D images, the most critical issue is whether the real 3D geometric shape and color of the object to be tested O can be completely restored. In the present invention, a gradient color ring 111 is disposed on the base 110 . When capturing the two-dimensional image of the object to be tested O, the two-dimensional images of the different gradient color blocks 111a, 111b, and 111c of the gradient color ring 111 are captured in a single two-dimensional image, and the image capture position of the object to be tested O and the color of the object to be tested O are also captured at the same time, and image recognition analysis and image synthesis calculation are performed based on the colors of the gradient color blocks 111a, 111b, and 111c of the gradient color ring 111, the image capture position of the object to be tested O, and the color of the object to be tested O. In this way, the accuracy of the two-dimensional images of the various parts of the object to be tested O when splicing and synthesizing is increased. At the same time, the gradient transition colors of the gradient color blocks 111a, 111b, and 111c are used as the reference colors for image synthesis calculation, which reduces unnecessary color consumption, increases image synthesis efficiency, and improves the realism of three-dimensional image modeling.

Please refer to Figures 4 and 5. Figure 4 is a schematic diagram showing one operation mode of the matrix imaging device 100 in Figure 1. Figure 5 is a schematic diagram showing another operation mode of the matrix imaging device 100 in Figure 1.

When operating the matrix imaging device 100 to capture images, there are multiple operating modes. In FIG. 4, the imaging module 120 is stationary, and the base 110 drives the object to be tested O to rotate, so as to capture two-dimensional images of a partial area of the object to be tested O and a partial area of the gradient color blocks 111a, 111b, and 111c of the gradient color ring 111 at multiple different angles. In FIG. 5, the object to be tested O is stationary, and the imaging module 120 moves around the object to be tested O. As mentioned above, the multiple cameras 121 of the imaging module 120 can be arranged in a linear array or a circular array. Thus, it is not necessary to set up a large number of cameras 121. A relatively small number of cameras 121 can be used to capture multiple two-dimensional images of each partial area of the object to be tested O and each partial area of the gradient color blocks 111a, 111b, and 111c of the gradient color ring 111, which can reduce the use of cameras 121 and improve the shooting efficiency. When the object to be tested O or the imaging module 120 is rotated, it can be rotated 360 degrees at intervals of a certain angle. When more two-dimensional images are captured, more detailed three-dimensional images can be synthesized.

In the embodiments of Figures 4 and 5, each camera 121 can be at different angles relative to the object to be tested O to capture images of different parts of the object to be tested O. In other words, the imaging angle of each camera 121 relative to the object to be tested O is adjusted to simultaneously capture two-dimensional images of various parts of the object to be tested O and parts of the gradient color blocks 111a, 111b, and 111c of the gradient color ring 111 at various different angles.

To process the multiple two-dimensional images captured by the imaging module 120, the multiple two-dimensional images are first converted into an image signal and transmitted to an image processing module (not shown) for image processing. The image processing module carries relevant software programs and performs image recognition and alignment analysis on multiple two-dimensional images of different parts of the object O captured by different cameras 121 according to the colors of the gradient blocks 111a, 111b, 111c of the gradient color ring 111 and the shooting position of the object O to be tested, and combines the multiple two-dimensional images into a three-dimensional image corresponding to the complete real geometric shape and color of the object O to be tested.

The image processing module can be set in the imaging module 120 or in a cloud device connected to the imaging module 120. For example, if the camera 121 of the imaging module 120 is installed in a mobile phone, a laptop or a tablet computer, it itself has a microprocessor and software with computing functions. If the camera 121 is installed in a camera or a video recorder, the two-dimensional image captured by it can be converted into an image signal by wireless or wired connection, and transmitted to the cloud device for image recognition and computing analysis.

Therefore, the matrix imaging device 100 disclosed in the present invention can use a common camera device as the imaging module 120, and the gradient color ring 111 provided on the base 110 can be used as a reference for two-dimensional image synthesis, which can not only reduce the equipment cost, but also help to improve the accuracy and efficiency of two-dimensional image synthesis, thereby obtaining a three-dimensional synthetic image with high restoration degree.

Although the present invention has been disclosed in the form of implementation as above, it is not intended to limit the present invention. Anyone familiar with this art can make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention shall be subject to the scope of the patent application attached hereto.

100: Matrix imaging equipment

110: Base

111: Gradient color ring

120: Imaging module

121: Camera

O: Object to be tested

Claims (4)

A matrix imaging device comprises: a base for placing an object to be tested, wherein the base comprises a plurality of gradient color rings; and an imaging module, which is arranged around the base and comprises a plurality of cameras arranged in a matrix. The imaging module simultaneously captures a plurality of two-dimensional images including a partial area of the object to be tested and a partial area of the gradient color rings through the cameras, and determines the image quality of the object to be tested according to the colors of the gradient color rings and the color of the object to be tested. The imaging position and the color of the object to be tested are combined into a three-dimensional image corresponding to the geometric shape and color of the object to be tested; wherein, during operation, the object to be tested is stationary and the imaging module moves around the object to be tested; or the imaging module is stationary and the base drives the object to be tested to rotate, so that the imaging module captures the multiple two-dimensional images corresponding to the partial area of the object to be tested and the partial area of the gradient color rings; wherein , each of the gradient color rings includes a plurality of gradient color blocks, and the color of each of the gradient color blocks includes red, blue, green, or one or more gradient color systems composed of any of the aforementioned colors alone or two or more combinations thereof; or the color of each of the gradient color blocks includes cyan, magenta, yellow, or one or more gradient color systems composed of any of the aforementioned colors alone or two or more combinations thereof; wherein when capturing the two-dimensional image of the object to be detected, the image containing the gradient color blocks is synchronously captured. The image position of the object to be tested, the color of the object to be tested, and the two-dimensional images of each of the different gradient color blocks of the gradient color ring are captured in a single two-dimensional image, and image recognition analysis and image synthesis calculation are performed based on the colors of each of the gradient color blocks of the gradient color rings, the image position of the object to be tested, and the color of the object to be tested, and the gradient colors of each of the gradient color blocks are used as reference colors for image synthesis calculation. A matrix imaging device as described in claim 1, wherein the cameras of the imaging module can be mounted on a camera, a mobile phone, a laptop or a tablet computer. A matrix imaging device as described in claim 1, wherein the multiple cameras are arranged in a one-dimensional linear array, a two-dimensional linear array, or a three-dimensional linear array. A matrix imaging device as described in claim 1, wherein the multiple cameras are arranged in a one-dimensional annular array, a two-dimensional annular array, or a three-dimensional annular array.

Images