[go: up one dir, main page]

CN105066906A - Fast high dynamic range three-dimensional measurement method - Google Patents

Fast high dynamic range three-dimensional measurement method Download PDF

Info

Publication number
CN105066906A
CN105066906A CN201510444695.7A CN201510444695A CN105066906A CN 105066906 A CN105066906 A CN 105066906A CN 201510444695 A CN201510444695 A CN 201510444695A CN 105066906 A CN105066906 A CN 105066906A
Authority
CN
China
Prior art keywords
phase
frequency
cos
dynamic range
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510444695.7A
Other languages
Chinese (zh)
Other versions
CN105066906B (en
Inventor
陈钱
冯世杰
顾国华
左超
张玉珍
陶天阳
张良
孙佳嵩
胡岩
张佳琳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing University of Science and Technology
Original Assignee
Nanjing University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing University of Science and Technology filed Critical Nanjing University of Science and Technology
Priority to CN201510444695.7A priority Critical patent/CN105066906B/en
Publication of CN105066906A publication Critical patent/CN105066906A/en
Application granted granted Critical
Publication of CN105066906B publication Critical patent/CN105066906B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Length Measuring Devices By Optical Means (AREA)

Abstract

本发明提出一种快速高动态范围三维测量方法,使用计算机生成四幅光栅条纹;分别在投影仪光轴和摄像机光轴上放置一块偏振镜,转动任意一块偏振镜,将投影仪光轴和摄像机光轴之间的夹角调节为90度;使用投影仪将生成的四幅光栅条纹投射至被测物,使用摄像机同步拍摄被测物反射生成的四幅条纹图像;对四幅条纹图像进行分析,获得高频包裹相位和低频相位;对高频包裹相位去包裹,获得高频去包裹后相位,根据去包裹后相位重建被测物体三维场景。本发明可以对动态场景实现高动态范围的三维测量。

The invention proposes a fast high dynamic range three-dimensional measurement method, which uses a computer to generate four grating stripes; respectively places a polarizer on the optical axis of the projector and the optical axis of the camera, rotates any polarizer, and aligns the optical axis of the projector with the optical axis of the camera The angle between the axes is adjusted to 90 degrees; use a projector to project the generated four grating fringes to the measured object, and use a camera to simultaneously capture the four fringe images generated by the reflection of the measured object; analyze the four fringe images to obtain high-frequency Wrap phase and low-frequency phase; Unwrap the high-frequency wrapped phase to obtain the high-frequency unwrapped phase, and reconstruct the three-dimensional scene of the measured object according to the unwrapped phase. The invention can realize three-dimensional measurement with high dynamic range for dynamic scenes.

Description

一种快速高动态范围三维测量方法A Fast High Dynamic Range 3D Measurement Method

技术领域technical field

本发明属于光学测量技术领域,具体涉及一种快速高动态范围三维测量方法。The invention belongs to the technical field of optical measurement, and in particular relates to a fast three-dimensional measurement method with high dynamic range.

背景技术Background technique

光学三维测量方法以非接触、高精度、易于实施等优点已日益成为人们获取三维轮廓数据的一种重要手段。根据照明方法的不同,通常将光学三维测量分成主动式和被动式的三维测量。被动式三维测量通过两个或者多个相机从不同角度对被测物进行拍摄,从获取的二维图像中恢复被测表面三维信息。该类方法优点在于测量系统简单以及数据采集方便,所以其在机器视觉中有着广泛的应用。双目视觉法是该类方法的一种代表性方法,其根据仿生物原理构造类似于人眼的功能,从不同视角的二维图像中确定距离。其在航空测量领域,利用飞行器装载大视场高分辨率相机沿飞行方向拍摄图像序列,从而获取地形地貌。尽管被动式方法可有效获取被测物表面三维信息,但是其主要有两个缺点:运算量十分巨大,通常需要高速处理器来实现测量;对物体表面纹理过分依赖,使得该方法不适合测量光滑或者特征点较少的表面。The optical three-dimensional measurement method has become an important means for people to obtain three-dimensional profile data due to its advantages of non-contact, high precision and easy implementation. According to different lighting methods, optical three-dimensional measurement is usually divided into active and passive three-dimensional measurement. Passive 3D measurement uses two or more cameras to shoot the measured object from different angles, and recovers the 3D information of the measured surface from the acquired 2D images. The advantage of this type of method is that the measurement system is simple and the data collection is convenient, so it has a wide range of applications in machine vision. The binocular vision method is a representative method of this kind of method. It constructs a function similar to the human eye according to the principle of bionics, and determines the distance from two-dimensional images of different viewing angles. In the field of aeronautical surveying, the aircraft is equipped with a large-field-of-view high-resolution camera to capture image sequences along the flight direction to obtain terrain and landforms. Although the passive method can effectively obtain the three-dimensional information of the surface of the measured object, it has two main disadvantages: the amount of calculation is very large, and a high-speed processor is usually required to realize the measurement; the excessive dependence on the surface texture of the object makes this method not suitable for measuring smooth or Surfaces with fewer feature points.

主动式三维测量是采用结构光照明的方法对被测物主动地投射光信号,然后根据拍摄得到的调制光场中解调出被测物的三维信息。这类方法由于利用调制光主动对被测面进行调制,所以其解决了对物体自身表面纹理依赖的问题,且避免了相关算法的使用,从而降低了数据运算量。常用的主动式方法包括条纹投影法、飞行时间法、调制度轮廓法等。其中条纹投影法是目前使用最为普遍的一种测量方法。该方法通过向被测物投射光栅条纹,摄像机从另一角度拍摄经被测物调制的光栅条纹,经过条纹解码,解调出被测表面三维轮廓。随着数字投影设备的不断发展,该技术被逐渐用于动态场景三维场景测量。随着条纹高速地投射至被测表面以及摄像机同步采集二维光栅图案,最终通过高速数据处理,可实现针对运动形变物体的高速三维测量。Active three-dimensional measurement is to use the method of structured light illumination to actively project light signals to the measured object, and then demodulate the three-dimensional information of the measured object from the modulated light field obtained by shooting. Since this type of method uses modulated light to actively modulate the measured surface, it solves the problem of dependence on the surface texture of the object itself, and avoids the use of related algorithms, thereby reducing the amount of data calculation. Commonly used active methods include fringe projection method, time-of-flight method, modulation degree contour method and so on. Among them, the fringe projection method is the most commonly used measurement method at present. In this method, the grating fringes are projected to the measured object, and the camera shoots the grating fringes modulated by the measured object from another angle, and after the fringe decoding, the three-dimensional profile of the measured surface is demodulated. With the continuous development of digital projection equipment, this technology is gradually used in dynamic scene 3D scene measurement. With the high-speed projection of the stripes to the measured surface and the synchronous acquisition of the two-dimensional grating pattern by the camera, and finally through high-speed data processing, high-speed three-dimensional measurement of moving and deformable objects can be realized.

高速三维测量对于在线检测、生物医疗、形变分析等领域都有着十分重要意义。但是在实际测量过程中,研究人员仍然面临了很多急需解决的问题。其中一个最常遇到的问题就是如何实现高动态范围的高速测量。因为目前待测物体表面由于反射率高,很容易形成局部高光。特别是合金金属工件,其表面的高光尤为明显。表面的高光由于会导致摄像机像素饱和,所以使得摄像机无法获取高光处的有用光信号,最终难以恢复该区域的三维轮廓。同时,传统的多曝光技术尽管可以实现高动态范围的三维测量,但由于需要多次曝光,所以只适合用静态场景的测量。High-speed 3D measurement is of great significance to the fields of online inspection, biomedicine, deformation analysis and so on. However, in the actual measurement process, researchers still face many problems that need to be solved urgently. One of the most frequently encountered problems is how to achieve high-speed measurements with high dynamic range. Because the surface of the object to be measured is currently highly reflective, it is easy to form local highlights. Especially for alloy metal workpieces, the highlights on the surface are particularly obvious. The high light on the surface will cause the pixel saturation of the camera, so the camera cannot obtain the useful light signal at the high light, and finally it is difficult to restore the three-dimensional outline of the area. At the same time, although the traditional multi-exposure technology can achieve three-dimensional measurement with high dynamic range, it is only suitable for the measurement of static scenes because it requires multiple exposures.

发明内容Contents of the invention

本发明的目的在于提供一种快速高动态范围三维测量方法,可以对动态场景实现高动态范围的三维测量。The purpose of the present invention is to provide a fast three-dimensional measurement method with high dynamic range, which can realize three-dimensional measurement with high dynamic range for dynamic scenes.

为了解决上述技术问题,本发明提供一种快速高动态范围三维测量方法,使用计算机生成四幅光栅条纹;分别在投影仪光轴和摄像机光轴上放置一块偏振镜,转动任意一块偏振镜,将投影仪光轴和摄像机光轴之间的夹角调节为90度;使用投影仪将生成的四幅光栅条纹投射至被测物,使用摄像机同步拍摄被被测物反射生成的四幅条纹图像;对四幅条纹图像进行分析,获得高频包裹相位和低频相位;对高频包裹相位去包裹,获得高频去包裹后相位,根据去包裹后相位重建被测物体三维场景。In order to solve the above-mentioned technical problems, the present invention provides a fast three-dimensional measurement method with high dynamic range, using a computer to generate four grating stripes; respectively placing a polarizer on the optical axis of the projector and the optical axis of the camera, rotating any polarizer, and projecting The angle between the optical axis of the instrument and the optical axis of the camera is adjusted to 90 degrees; use the projector to project the generated four grating stripes to the object under test, and use the camera to simultaneously capture the four fringe images generated by the reflection of the object under test; for the four fringes The image is analyzed to obtain the high-frequency wrapped phase and the low-frequency phase; the high-frequency wrapped phase is unwrapped to obtain the high-frequency unwrapped phase, and the three-dimensional scene of the measured object is reconstructed according to the unwrapped phase.

进一步,计算机生成的四幅光栅条纹Ip 1~Ip 4的光学表达式如下所示,Further, the optical expressions of the four grating stripes I p 1 ~ I p 4 generated by computer are as follows,

Ip 1(xp,yp)=Ap(xp,yp)+Bp(xp,yp)cos(2πfxp)I p 1 (x p ,y p )=A p (x p ,y p )+B p (x p ,y p )cos(2πfx p )

Ip 2(xp,yp)=Ap(xp,yp)+Bp(xp,yp)cos(2πxp)I p 2 (x p ,y p )=A p (x p ,y p )+B p (x p ,y p )cos(2πx p )

Ip 3(xp,yp)=Ap(xp,yp)+Bp(xp,yp)cos(2πxp+2π/3)I p 3 (x p ,y p )=A p (x p ,y p )+B p (x p ,y p )cos(2πx p +2π/3)

Ip 4(xp,yp)=Ap(xp,yp)+Bp(xp,yp)cos(2πxp+4π/3)I p 4 (x p ,y p )=A p (x p ,y p )+B p (x p ,y p )cos(2πx p +4π/3)

其中,(xp,yp)为投影仪像素坐标,Ap为直流分量,Bp为调制度,Ap=Bp=127.5,图像像素深度为8比特,f为第一幅正弦光栅条纹的频率。Among them, (x p , y p ) is the pixel coordinates of the projector, A p is the DC component, B p is the modulation degree, A p =B p =127.5, the image pixel depth is 8 bits, f is the first sinusoidal grating fringe Frequency of.

进一步,摄像机同步拍摄的四幅条纹图像Ic 1~Ic 4的强度分布表达式如下所示,Further, the expression of the intensity distribution of the four fringe images I c 1 to I c 4 captured synchronously by the camera is as follows,

Ic 1(xc,yc)=Ac(xc,yc)+Bc(xc,yc)cos(φh)I c 1 (x c ,y c )=A c (x c ,y c )+B c (x c ,y c )cos(φ h )

Ic 2(xc,yc)=Ac(xc,yc)+Bc(xc,yc)cos(φl)I c 2 (x c ,y c )=A c (x c ,y c )+B c (x c ,y c )cos(φ l )

Ic 3(xc,yc)=Ac(xc,yc)+Bc(xc,yc)cos(φl+2π/3)I c 3 (x c ,y c )=A c (x c ,y c )+B c (x c ,y c )cos(φ l +2π/3)

Ic 4(xc,yc)=Ac(xc,yc)+Bc(xc,yc)cos(φl+4π/3)I c 4 (x c ,y c )=A c (x c ,y c )+B c (x c ,y c )cos(φ l +4π/3)

其中,(xc,yc)为摄像机像素坐标,Ac为背景光强,Bc为相位调制度,φh为拍摄的第一幅条纹图像中包含的高频相位,φl为拍摄的第二幅至第四幅条纹图像中包含的低频相位。Among them, (x c , y c ) is the pixel coordinates of the camera, A c is the background light intensity, B c is the degree of phase modulation, and φ h is the first fringe image taken The high-frequency phase contained in , φ l is the second to fourth fringe images taken The low-frequency phase contained in .

进一步,对第一幅条纹图像Ic 1进行二维傅里叶变换,在获得的频谱中使用汉宁窗对正一级频谱进行滤波,然后进行二维逆傅里叶变换,获得高频包裹相位φhFurther, perform two-dimensional Fourier transform on the first fringe image I c 1 , use Hanning window to filter the positive first-order spectrum in the obtained spectrum, and then perform two-dimensional inverse Fourier transform to obtain the high-frequency package Phase φ h .

进一步,对第二幅至第四幅条纹图像Ic 2、Ic 3和Ic 4使用三步相移法分析,获得低频相位φl,计算公式如下所示,Further, use the three-step phase shift method to analyze the second to fourth fringe images I c 2 , I c 3 and I c 4 to obtain the low-frequency phase φ l , the calculation formula is as follows,

φφ ll (( xx cc ,, ythe y cc )) == tanthe tan -- 11 33 (( II 11 cc (( xx cc ,, ythe y cc )) -- II 33 cc (( xx cc ,, ythe y cc )) )) 22 II 22 cc (( xx cc ,, ythe y cc )) -- II 11 cc (( xx cc ,, ythe y cc )) -- II 33 cc (( xx cc ,, ythe y cc )) ..

进一步,获取去包裹后相位Φ的具体方法如下式所示:Further, the specific method of obtaining the phase Φ after unwrapping is shown in the following formula:

ΦΦ (( xx cc ,, ythe y cc )) == φφ hh (( xx cc ,, ythe y cc )) ++ 22 ππ ×× RR oo uu nno dd [[ fφfφ ll (( xx cc ,, ythe y cc )) -- φφ hh (( xx cc ,, ythe y cc )) 22 ππ ]]

其中,Round为求取最近整数。Among them, Round is to find the nearest integer.

本发明与现有技术相比,其显著优点在于,本发明使用偏振镜很好地解决了现有技术存在的高光问题,使得在单次曝光的情况下就可实现高动态范围的三维测量。此外,根据传统方法,比如双频三步相移法,动态场景测量通常需要六幅条纹,而本发明方法只需要使用四幅光栅条纹,所以本发明非常适合快速运动形变物体的测量。Compared with the prior art, the present invention has the remarkable advantage that the present invention uses a polarizer to well solve the highlight problem existing in the prior art, so that three-dimensional measurement with a high dynamic range can be realized under the condition of a single exposure. In addition, according to traditional methods, such as the dual-frequency three-step phase-shift method, dynamic scene measurement usually requires six fringes, while the method of the present invention only needs to use four grating fringes, so the present invention is very suitable for the measurement of fast-moving deformed objects.

下面结合附图对本发明作进一步详细描述。The present invention will be described in further detail below in conjunction with the accompanying drawings.

附图说明Description of drawings

图1为本发明快速高动态范围三维测量方法流程示意图。Fig. 1 is a schematic flow chart of the rapid high dynamic range three-dimensional measurement method of the present invention.

图2为本发明实施例中使用的测量对象及其场景图像,测量对象为图像中的具有局部高光的白色水杯。Fig. 2 is a measurement object and its scene image used in the embodiment of the present invention, the measurement object is a white water cup with local highlights in the image.

图3为本发明实施例中对图2所示测量对象拍摄的四幅条纹图像,其中,(a)为拍摄的第一幅条纹图像(b)为拍摄的第二幅条纹图像(c)为拍摄的第三幅条纹图像(d)为拍摄的第四幅条纹图像 Fig. 3 is four fringe images taken to the measurement object shown in Fig. 2 in the embodiment of the present invention, wherein, (a) is the first fringe image taken (b) is the second fringe image taken (c) is the third fringe image taken (d) is the fourth fringe image taken

图4为本发明实施例中求解的相位示意图,其中(a)为高频相位φh,(b)为低频相位φlFig. 4 is a schematic diagram of phases solved in an embodiment of the present invention, where (a) is the high-frequency phase φ h , and (b) is the low-frequency phase φ l .

图5为本发明实施例获得的三维重建图像对比,其中(a)为使用传统方法重建获得的三维图像,(b)为使用本发明方法重建获得的三维图像。Fig. 5 is a comparison of 3D reconstructed images obtained in the embodiment of the present invention, wherein (a) is a 3D image reconstructed using a traditional method, and (b) is a 3D image reconstructed using a method of the present invention.

具体实施方式Detailed ways

容易理解,依据本发明的技术方案,在不变更本发明的实质精神的情况下,本领域的一般技术人员可以想象出本发明快速高动态范围三维测量方法的多种实施方式。因此,以下具体实施方式和附图仅是对本发明的技术方案的示例性说明,而不应当视为本发明的全部或者视为对本发明技术方案的限制或限定。It is easy to understand that, according to the technical solution of the present invention, those skilled in the art can imagine various implementations of the rapid high dynamic range three-dimensional measurement method of the present invention without changing the essence of the present invention. Therefore, the following specific embodiments and drawings are only exemplary descriptions of the technical solution of the present invention, and should not be regarded as the entirety of the present invention or as a limitation or limitation on the technical solution of the present invention.

结合图1,本发明所述快速高动态范围三维测量方法,步骤如下:In conjunction with Fig. 1, the fast high dynamic range three-dimensional measurement method of the present invention, the steps are as follows:

步骤一,使用计算机生成所需的四幅光栅条纹。以竖直条纹生成为例,四幅光栅条纹Ip 1~Ip 4,四幅光栅条纹Ip 1~Ip 4按以下方式生成:Step 1, using a computer to generate four required grating stripes. Taking the generation of vertical stripes as an example, four grating stripes I p 1 to I p 4 and four grating stripes I p 1 to I p 4 are generated as follows:

Ip 1(xp,yp)=Ap(xp,yp)+Bp(xp,yp)cos(2πfxp)I p 1 (x p ,y p )=A p (x p ,y p )+B p (x p ,y p )cos(2πfx p )

Ip 2(xp,yp)=Ap(xp,yp)+Bp(xp,yp)cos(2πxp)I p 2 (x p ,y p )=A p (x p ,y p )+B p (x p ,y p )cos(2πx p )

Ip 3(xp,yp)=Ap(xp,yp)+Bp(xp,yp)cos(2πxp+2π/3)I p 3 (x p ,y p )=A p (x p ,y p )+B p (x p ,y p )cos(2πx p +2π/3)

Ip 4(xp,yp)=Ap(xp,yp)+Bp(xp,yp)cos(2πxp+4π/3)I p 4 (x p ,y p )=A p (x p ,y p )+B p (x p ,y p )cos(2πx p +4π/3)

其中,(xp,yp)为投影仪像素坐标,Ap为直流分量,Bp为调制度,Ap=Bp=127.5,图像像素深度为8比特,f为第一幅正弦光栅条纹的频率。Among them, (x p , y p ) is the pixel coordinates of the projector, A p is the DC component, B p is the modulation degree, A p =B p =127.5, the image pixel depth is 8 bits, f is the first sinusoidal grating fringe Frequency of.

步骤二,放置偏振镜。分别在投影仪光轴和摄像机光轴上放置一块偏振镜,转动其中任意一块偏振镜,将投影仪光轴和摄像机光轴的透光轴之间的夹角调节为90度。Step two, place the polarizer. Place a polarizer on the optical axis of the projector and the optical axis of the camera, and rotate any one of the polarizers to adjust the angle between the optical axis of the projector and the light transmission axis of the optical axis of the camera to 90 degrees.

步骤三,采集光栅条纹以及相位求解。Step 3, collecting the grating fringes and solving the phase.

首先,使用投影仪将生成的四幅光栅条纹投射至被测物,摄像机同步采集被被测物反射生成的四幅条纹图像,摄像机同步拍摄的四幅条纹图像Ic 1(xc,yc)~Ic 4(xc,yc)可被表示为:First, the projector is used to project the generated four grating fringes to the measured object, and the camera synchronously collects the four fringe images generated by the reflection of the measured object, and the four fringe images I c 1 (x c ,y c )~I c 4 (x c ,y c ) can be expressed as:

Ic 1(xc,yc)=Ac(xc,yc)+Bc(xc,yc)cos(φh)I c 1 (x c ,y c )=A c (x c ,y c )+B c (x c ,y c )cos(φ h )

Ic 2(xc,yc)=Ac(xc,yc)+Bc(xc,yc)cos(φl)I c 2 (x c ,y c )=A c (x c ,y c )+B c (x c ,y c )cos(φ l )

Ic 3(xc,yc)=Ac(xc,yc)+Bc(xc,yc)cos(φl+2π/3)I c 3 (x c ,y c )=A c (x c ,y c )+B c (x c ,y c )cos(φ l +2π/3)

Ic 4(xc,yc)=Ac(xc,yc)+Bc(xc,yc)cos(φl+4π/3)I c 4 (x c ,y c )=A c (x c ,y c )+B c (x c ,y c )cos(φ l +4π/3)

其中,(xc,yc)为摄像机像素坐标,Ac为背景光强,Bc为相位调制度,φh为拍摄的第一幅条纹图像中包含的高频相位,φl为拍摄的第二幅至第四幅条纹图像中包含的低频相位。Among them, (x c , y c ) is the pixel coordinates of the camera, A c is the background light intensity, B c is the degree of phase modulation, and φ h is the first fringe image taken The high-frequency phase contained in , φ l is the second to fourth fringe images taken The low-frequency phase contained in .

其次,对第一幅条纹图像使用傅里叶轮廓术进行分析,获得高频包裹相位φh。使用二维傅里叶变换,在得到的频谱中,使用大小为M×N的汉宁窗对正一级频谱进行滤波,最后进行二维逆傅里叶变换,得到高频包裹相位φhSecond, for the first fringe image Analysis was performed using Fourier profilometry to obtain the high-frequency wrapping phase φ h . Using two-dimensional Fourier transform, in the obtained spectrum, use a Hanning window with a size of M×N to filter the positive first-order spectrum, and finally perform two-dimensional inverse Fourier transform to obtain the high-frequency wrapping phase φ h .

最后,对第二幅至第四幅条纹图像使用三步相移法分析,获得低频相位φl。低频相位φl具体由以下公式获得:Finally, for the second to fourth fringe images Using the three-step phase-shift method analysis, the low-frequency phase φ l is obtained. The low-frequency phase φ l is specifically obtained by the following formula:

φφ ll (( xx cc ,, ythe y cc )) == tanthe tan -- 11 33 (( II 11 cc (( xx cc ,, ythe y cc )) -- II 33 cc (( xx cc ,, ythe y cc )) )) 22 II 22 cc (( xx cc ,, ythe y cc )) -- II 11 cc (( xx cc ,, ythe y cc )) -- II 33 cc (( xx cc ,, ythe y cc ))

步骤四,被测场景三维重建。对高频包裹相位φh去包裹,获得高频去包裹后相位Φ,根据去包裹后相位Φ重建被测三维场景。获取去包裹后相位Φ的具体方法如下式所示:Step 4, three-dimensional reconstruction of the scene under test. Unwrap the high-frequency wrapped phase φ h to obtain the high-frequency unwrapped phase Φ, and reconstruct the measured 3D scene according to the unwrapped phase Φ. The specific method to obtain the phase Φ after unwrapping is as follows:

ΦΦ (( xx cc ,, ythe y cc )) == φφ hh (( xx cc ,, ythe y cc )) ++ 22 ππ ×× RR oo uu nno dd [[ fφfφ ll (( xx cc ,, ythe y cc )) -- φφ hh (( xx cc ,, ythe y cc )) 22 ππ ]]

其中,Round为求取最近整数。在求得去包裹后相位Φ后,根据去包裹后相位Φ重建被测三维场景可以参考文献“Automaticidentificationandremovalofoutliersforhigh-speedfringeprojectionprofilometry”(OptEng2013;52013605-013605)所述的相位深度转换方法。Among them, Round is to find the nearest integer. After obtaining the phase Φ after dewrapping, the reconstruction of the measured 3D scene according to the phase Φ after dewrapping can refer to the phase depth conversion method described in the document "Automatic identification and removal of outliers for high-speed fringe projection profilometry" (OptEng2013; 52013605-013605).

实施例Example

本实施例中,被测对象如图2所示为一个表面有高光反射的水杯。使用本发明所述步骤一生成的四幅光栅条纹投射进行测量,当不加入偏振镜时三维测量结果如图5(a)所示,可明显看出高光区域的表面出现了凹坑,说明高光的存在影响该部分表面的测量。当按照本发明方法按步骤二在投影仪光轴和摄像机光轴上加入偏振镜后,采集的四幅条纹图像依次如图3中(a)至(d)所示,从图3中不难发现,原有的高光已经被削弱。随后,利用步骤三中傅里叶轮廓术对图3中(a)所示的条纹图像进行分析,得到高频包裹相位φh,高频包裹相位φh如图4(a)所示。然后使用步骤三中三步相移法对图4中(b)至(d)所示的三幅条纹图像进行处理,得到低频相位φl,低频相位φl如图4(b)所示。最后,采用步骤四中三维重建的方法得到被测水杯的三维轮廓,三维轮廓如图5(b)所示,其中mm表示毫米,Pixel表示像素。可以看出,利用本发明所述方法,在存在高光的物体表面也能被正确地测量重建三维图像。In this embodiment, as shown in FIG. 2 , the measured object is a water cup with high light reflection on the surface. The projection of four grating fringes generated in step 1 of the present invention is used for measurement. When the polarizer is not added, the three-dimensional measurement result is shown in Figure 5 (a). It can be clearly seen that pits appear on the surface of the highlight area, indicating that the highlight is There are measurements that affect the surface of that part. After adding a polarizer on the optical axis of the projector and the optical axis of the camera according to the method of the present invention in step 2, the four fringe images collected are successively shown in (a) to (d) in Figure 3, and it is not difficult to find from Figure 3 , the original highlight has been weakened. Subsequently, the fringe image shown in Figure 3(a) was analyzed by Fourier profilometry in step 3, and the high-frequency wrapping phase φh was obtained, which is shown in Figure 4(a). Then use the three-step phase shift method in step 3 to process the three fringe images shown in (b) to (d) in Figure 4 to obtain the low-frequency phase φ l , which is shown in Figure 4(b). Finally, use the three-dimensional reconstruction method in step four to obtain the three-dimensional outline of the water cup under test, as shown in Figure 5(b), where mm represents millimeters, and Pixel represents pixels. It can be seen that by using the method of the present invention, the three-dimensional image can also be correctly measured and reconstructed on the object surface with high light.

Claims (6)

1.一种快速高动态范围三维测量方法,其特征在于,1. A fast high dynamic range three-dimensional measurement method, characterized in that, 使用计算机生成四幅光栅条纹;Use computer to generate four raster stripes; 分别在投影仪光轴和摄像机光轴上放置一块偏振镜,转动任意一块偏振镜,将投影仪光轴和摄像机光轴之间的夹角调节为90度;Place a polarizer on the optical axis of the projector and the optical axis of the camera respectively, rotate any polarizer, and adjust the angle between the optical axis of the projector and the optical axis of the camera to 90 degrees; 使用投影仪将生成的四幅光栅条纹投射至被测物,使用摄像机同步拍摄被被测物反射生成的四幅条纹图像;对四幅条纹图像进行分析,获得高频包裹相位和低频相位;Use the projector to project the generated four grating fringes to the measured object, and use the camera to simultaneously capture the four fringe images generated by the reflection of the measured object; analyze the four fringe images to obtain the high-frequency wrapped phase and low-frequency phase; 对高频包裹相位去包裹,获得高频去包裹后相位,根据去包裹后相位重建被测物体三维场景。Unwrap the high-frequency wrapped phase, obtain the high-frequency unwrapped phase, and reconstruct the three-dimensional scene of the measured object according to the unwrapped phase. 2.如权利要求1所述快速高动态范围三维测量方法,其特征在于,计算机生成的四幅光栅条纹Ip 1~Ip 4的光学表达式如下所示,2. The fast high dynamic range three-dimensional measurement method according to claim 1, wherein the optical expressions of the four grating stripes I p 1 to I p 4 generated by the computer are as follows, Ip 1(xp,yp)=Ap(xp,yp)+Bp(xp,yp)cos(2πfxp)I p 1 (x p ,y p )=A p (x p ,y p )+B p (x p ,y p )cos(2πfx p ) Ip 2(xp,yp)=Ap(xp,yp)+Bp(xp,yp)cos(2πxp)I p 2 (x p ,y p )=A p (x p ,y p )+B p (x p ,y p )cos(2πx p ) Ip 3(xp,yp)=Ap(xp,yp)+Bp(xp,yp)cos(2πxp+2π/3)I p 3 (x p ,y p )=A p (x p ,y p )+B p (x p ,y p )cos(2πx p +2π/3) Ip 4(xp,yp)=Ap(xp,yp)+Bp(xp,yp)cos(2πxp+4π/3)I p 4 (x p ,y p )=A p (x p ,y p )+B p (x p ,y p )cos(2πx p +4π/3) 其中,(xp,yp)为投影仪像素坐标,Ap为直流分量,Bp为调制度,Ap=Bp=127.5,图像像素深度为8比特,f为第一幅正弦光栅条纹的频率。Among them, (x p , y p ) is the pixel coordinates of the projector, A p is the DC component, B p is the modulation degree, A p =B p =127.5, the image pixel depth is 8 bits, f is the first sinusoidal grating fringe Frequency of. 3.如权利要求2所述快速高动态范围三维测量方法,其特征在于,摄像机同步拍摄的四幅条纹图像Ic 1~Ic 4的强度分布表达式如下所示,3. The fast high dynamic range three-dimensional measurement method according to claim 2, wherein the intensity distribution expressions of the four fringe images I c 1 to I c 4 captured synchronously by the camera are as follows, Ic 1(xc,yc)=Ac(xc,yc)+Bc(xc,yc)cos(φh)I c 1 (x c ,y c )=A c (x c ,y c )+B c (x c ,y c )cos(φ h ) Ic 2(xc,yc)=Ac(xc,yc)+Bc(xc,yc)cos(φl)I c 2 (x c ,y c )=A c (x c ,y c )+B c (x c ,y c )cos(φ l ) Ic 3(xc,yc)=Ac(xc,yc)+Bc(xc,yc)cos(φl+2π/3)I c 3 (x c ,y c )=A c (x c ,y c )+B c (x c ,y c )cos(φ l +2π/3) Ic 4(xc,yc)=Ac(xc,yc)+Bc(xc,yc)cos(φl+4π/3)I c 4 (x c ,y c )=A c (x c ,y c )+B c (x c ,y c )cos(φ l +4π/3) 其中,(xc,yc)为摄像机像素坐标,Ac为背景光强,Bc为相位调制度,φh为拍摄的第一幅条纹图像中包含的高频相位,φl为拍摄的第二幅至第四幅条纹图像中包含的低频相位。Among them, (x c , y c ) is the pixel coordinates of the camera, A c is the background light intensity, B c is the degree of phase modulation, and φ h is the first fringe image taken The high-frequency phase contained in , φ l is the second to fourth fringe images taken The low-frequency phase contained in . 4.如权利要求3所述快速高动态范围三维测量方法,其特征在于,对第一幅条纹图像Ic 1进行二维傅里叶变换,在获得的频谱中使用汉宁窗对正一级频谱进行滤波,然后进行二维逆傅里叶变换,获得高频包裹相位φh4. fast high dynamic range three-dimensional measurement method as claimed in claim 3, is characterized in that, carry out two-dimensional Fourier transform to the first fringe image I c 1 , use Hanning window in the frequency spectrum that obtains to correct one level The spectrum is filtered and then subjected to two-dimensional inverse Fourier transform to obtain the high-frequency wrapped phase φ h . 5.如权利要求4所述快速高动态范围三维测量方法,其特征在于,对第二幅至第四幅条纹图像Ic 2、Ic 3和Ic 4使用三步相移法分析,获得低频相位φl,计算公式如下所示,5. fast high dynamic range three-dimensional measurement method as claimed in claim 4, is characterized in that, use three-step phase-shift method analysis to the second to the fourth fringe images I c 2 , I c 3 and I c 4 , obtain Low-frequency phase φ l , the calculation formula is as follows, φφ ll (( xx cc ,, ythe y cc )) == tanthe tan -- 11 33 (( II 11 cc (( xx cc ,, ythe y cc )) -- II 33 cc (( xx cc ,, ythe y cc )) )) 22 II 22 cc (( xx cc ,, ythe y cc )) -- II 11 cc (( xx cc ,, ythe y cc )) -- II 33 cc (( xx cc ,, ythe y cc )) .. 6.如权利要求5所述快速高动态范围三维测量方法,其特征在于,获取去包裹后相位Φ的具体方法如下式所示:6. fast high dynamic range three-dimensional measurement method as claimed in claim 5, is characterized in that, the specific method of obtaining the phase Φ after dewrapping is shown in the following formula: ΦΦ (( xx cc ,, ythe y cc )) == φφ hh (( xx cc ,, ythe y cc )) ++ 22 ππ ×× RR oo uu nno dd [[ fφfφ ll (( xx cc ,, ythe y cc )) -- φφ hh (( xx cc ,, ythe y cc )) 22 ππ ]] 其中,Round为求取最近整数。Among them, Round is to find the nearest integer.
CN201510444695.7A 2015-07-24 2015-07-24 A kind of quick high dynamic range method for three-dimensional measurement Expired - Fee Related CN105066906B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510444695.7A CN105066906B (en) 2015-07-24 2015-07-24 A kind of quick high dynamic range method for three-dimensional measurement

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510444695.7A CN105066906B (en) 2015-07-24 2015-07-24 A kind of quick high dynamic range method for three-dimensional measurement

Publications (2)

Publication Number Publication Date
CN105066906A true CN105066906A (en) 2015-11-18
CN105066906B CN105066906B (en) 2018-06-12

Family

ID=54496334

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510444695.7A Expired - Fee Related CN105066906B (en) 2015-07-24 2015-07-24 A kind of quick high dynamic range method for three-dimensional measurement

Country Status (1)

Country Link
CN (1) CN105066906B (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106651962A (en) * 2016-12-13 2017-05-10 天津大学 Adaptive light compensation method based on projector-camera system
CN106931910A (en) * 2017-03-24 2017-07-07 南京理工大学 A kind of efficient acquiring three-dimensional images method based on multi-modal composite coding and epipolar-line constraint
CN108195313A (en) * 2017-12-29 2018-06-22 南京理工大学 A kind of high dynamic range method for three-dimensional measurement based on Intensity response function
CN109579741A (en) * 2018-11-01 2019-04-05 南京理工大学 A kind of Full-automatic multimould state three-dimensional colour measurement method based on multi-angle of view
CN110234954A (en) * 2017-03-08 2019-09-13 欧姆龙株式会社 It is mutually reflected detection device, is mutually reflected detection method and program
CN110672038A (en) * 2019-09-03 2020-01-10 安徽农业大学 Rapid three-dimensional measurement method based on dual-frequency phase shift fringe projection
CN111707216A (en) * 2020-06-30 2020-09-25 西安工业大学 A Surface Shape Detection Method Based on Random Two-step Phase Shift
CN112697259A (en) * 2020-12-31 2021-04-23 福州大学 Beam structure modal shape measuring device and method based on combined stripes
CN113029040A (en) * 2021-02-26 2021-06-25 中国科学院深圳先进技术研究院 Polarization phase deflection measurement method and device
CN115325960A (en) * 2021-05-10 2022-11-11 广州视源电子科技股份有限公司 Multi-frequency phase shift measurement method, device, storage medium and equipment
CN116592794A (en) * 2023-07-17 2023-08-15 南京理工大学 A Fast 3D Reconstruction Method Based on Polarized Structured Light

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6639685B1 (en) * 2000-02-25 2003-10-28 General Motors Corporation Image processing method using phase-shifted fringe patterns and curve fitting
CN1963381A (en) * 2005-10-24 2007-05-16 通用电气公司 Method and apparatus for inspecting an object
CN102155924A (en) * 2010-12-17 2011-08-17 南京航空航天大学 Four-step phase shifting method based on absolute phase recovery
CN103791856A (en) * 2014-01-21 2014-05-14 南京理工大学 Phase solving and unwrapping method based on four-width optical grating stripe image

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6639685B1 (en) * 2000-02-25 2003-10-28 General Motors Corporation Image processing method using phase-shifted fringe patterns and curve fitting
CN1963381A (en) * 2005-10-24 2007-05-16 通用电气公司 Method and apparatus for inspecting an object
CN102155924A (en) * 2010-12-17 2011-08-17 南京航空航天大学 Four-step phase shifting method based on absolute phase recovery
CN103791856A (en) * 2014-01-21 2014-05-14 南京理工大学 Phase solving and unwrapping method based on four-width optical grating stripe image

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
申国辰: "基于数字相移条纹投影的实时三维测量技术研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106651962A (en) * 2016-12-13 2017-05-10 天津大学 Adaptive light compensation method based on projector-camera system
US11441896B2 (en) 2017-03-08 2022-09-13 Omron Corporation Inter-reflection detection apparatus and inter-reflection detection method
CN110234954A (en) * 2017-03-08 2019-09-13 欧姆龙株式会社 It is mutually reflected detection device, is mutually reflected detection method and program
CN106931910A (en) * 2017-03-24 2017-07-07 南京理工大学 A kind of efficient acquiring three-dimensional images method based on multi-modal composite coding and epipolar-line constraint
CN106931910B (en) * 2017-03-24 2019-03-05 南京理工大学 A kind of efficient acquiring three-dimensional images method based on multi-modal composite coding and epipolar-line constraint
US10911672B2 (en) 2017-03-24 2021-02-02 Nanjing University Of Science And Technology Highly efficient three-dimensional image acquisition method based on multi-mode composite encoding and epipolar constraint
CN108195313A (en) * 2017-12-29 2018-06-22 南京理工大学 A kind of high dynamic range method for three-dimensional measurement based on Intensity response function
CN109579741A (en) * 2018-11-01 2019-04-05 南京理工大学 A kind of Full-automatic multimould state three-dimensional colour measurement method based on multi-angle of view
CN109579741B (en) * 2018-11-01 2020-06-26 南京理工大学 Full-automatic multi-mode three-dimensional color measurement method based on multiple visual angles
CN110672038A (en) * 2019-09-03 2020-01-10 安徽农业大学 Rapid three-dimensional measurement method based on dual-frequency phase shift fringe projection
CN111707216A (en) * 2020-06-30 2020-09-25 西安工业大学 A Surface Shape Detection Method Based on Random Two-step Phase Shift
CN111707216B (en) * 2020-06-30 2021-07-02 西安工业大学 A Surface Shape Detection Method Based on Random Two-step Phase Shift
CN112697259B (en) * 2020-12-31 2022-04-08 福州大学 Beam structure modal shape measuring device and method based on combined stripes
CN112697259A (en) * 2020-12-31 2021-04-23 福州大学 Beam structure modal shape measuring device and method based on combined stripes
CN113029040A (en) * 2021-02-26 2021-06-25 中国科学院深圳先进技术研究院 Polarization phase deflection measurement method and device
CN115325960A (en) * 2021-05-10 2022-11-11 广州视源电子科技股份有限公司 Multi-frequency phase shift measurement method, device, storage medium and equipment
CN115325960B (en) * 2021-05-10 2025-02-18 广州视源电子科技股份有限公司 Multi-frequency phase shift measurement method, device, storage medium and equipment
CN116592794A (en) * 2023-07-17 2023-08-15 南京理工大学 A Fast 3D Reconstruction Method Based on Polarized Structured Light
CN116592794B (en) * 2023-07-17 2023-11-24 南京理工大学 Rapid three-dimensional reconstruction method based on polarized structured light

Also Published As

Publication number Publication date
CN105066906B (en) 2018-06-12

Similar Documents

Publication Publication Date Title
CN105066906B (en) A kind of quick high dynamic range method for three-dimensional measurement
CN109253708B (en) A deep learning-based fringe projection temporal phase unwrapping method
Liu et al. Real-time 3D surface-shape measurement using background-modulated modified Fourier transform profilometry with geometry-constraint
CN106931910B (en) A kind of efficient acquiring three-dimensional images method based on multi-modal composite coding and epipolar-line constraint
CN102322822B (en) Three-dimensional measurement method for triple-frequency color fringe projection
US9322643B2 (en) Apparatus and method for 3D surface measurement
CN101608908B (en) Combined three-dimensional digital imaging method of digital speckle projection and phase measuring profilometry
CN113358063B (en) Surface structured light three-dimensional measurement method and system based on phase weighted fusion
EP3012576B1 (en) Method for measuring a contour of an object
CN109579741B (en) Full-automatic multi-mode three-dimensional color measurement method based on multiple visual angles
CN105066907B (en) A carrier frequency and phase removal method for Fourier profilometry
CN106204732B (en) The three-dimensional rebuilding method and system of dynamic exposure
Budianto et al. Marker encoded fringe projection profilometry for efficient 3D model acquisition
CN102519393A (en) Method for realizing rapid modulation degree profilometry by use of two orthogonal sinusoidal gratings
CN107990846B (en) Active and passive combination depth information acquisition method based on single-frame structured light
CN111473745A (en) Light-emitting surface microscopic three-dimensional measurement method based on multi-frequency phase shift scheme
Suresh et al. PMENet: phase map enhancement for Fourier transform profilometry using deep learning
CN111947600A (en) Robust Stereo Phase Unwrapping Method Based on Phase Order Cost Filtering
Su Phase unwrapping techniques for 3D shape measurement
CN104680534A (en) Object depth information acquisition method on basis of single-frame compound template
CN112562007B (en) Three-mesh constraint-based wrapping phase non-unfolding fast stereo matching method
Mohammadi et al. Single-frame digital phase-shifting 3D shape measurement using pixel-wise moiré-wavelength refinement
Yao et al. Mirror-assisted 360° panoramic 3D measurement system based on rotary laser profilometer
CN113709442B (en) Single-pixel imaging method based on projection reconstruction
Guo et al. Absolute phase technique for the Fourier transform method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180612

Termination date: 20210724

CF01 Termination of patent right due to non-payment of annual fee