[go: up one dir, main page]

CN107976157A - A kind of wireless hand-held three-dimensional scanning device in acquisition object surface three-dimensional morphology - Google Patents

A kind of wireless hand-held three-dimensional scanning device in acquisition object surface three-dimensional morphology Download PDF

Info

Publication number
CN107976157A
CN107976157A CN201711431320.2A CN201711431320A CN107976157A CN 107976157 A CN107976157 A CN 107976157A CN 201711431320 A CN201711431320 A CN 201711431320A CN 107976157 A CN107976157 A CN 107976157A
Authority
CN
China
Prior art keywords
held
scanning device
dimensional scanning
wireless hand
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711431320.2A
Other languages
Chinese (zh)
Inventor
王玮
李洲强
杜华
李仁举
叶成蔚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Far East Three Dimensional (tianjin) Technology Co Ltd
Original Assignee
Far East Three Dimensional (tianjin) Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Far East Three Dimensional (tianjin) Technology Co Ltd filed Critical Far East Three Dimensional (tianjin) Technology Co Ltd
Priority to CN201711431320.2A priority Critical patent/CN107976157A/en
Publication of CN107976157A publication Critical patent/CN107976157A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/24Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G01B11/25Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
    • G01B11/2513Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object with several lines being projected in more than one direction, e.g. grids, patterns

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

本发明提供一种用于获取物体表面三维形貌的无线手持式三维扫描设备,包括一组用于分析图像数据和控制前端设备状态的移动处理平台,该处理平台分别与图案投射装置,图像传感设备,数据发送模块,移动电源模块连接,实现图像数据到目标检测结果压缩数据的检测输出,实现设备状态探测,实现与上位机的数据和命令交流。本设备具有更高的扫描分辨率和扫描速度,使用处理后的数据,配合数据压缩,突破原有限制,可以实现更高分辨率,更高速度的扫描。

The present invention provides a wireless hand-held three-dimensional scanning device for acquiring the three-dimensional shape of the surface of an object, which includes a set of mobile processing platforms for analyzing image data and controlling the status of front-end equipment. Sensing equipment, data sending module, and mobile power module are connected to realize the detection output from image data to target detection result compressed data, realize equipment status detection, and realize data and command communication with the host computer. This device has higher scanning resolution and scanning speed, uses the processed data, cooperates with data compression, breaks through the original limitation, and can achieve higher resolution and higher speed scanning.

Description

一种于获取物体表面三维形貌的无线手持式三维扫描设备A wireless handheld 3D scanning device for acquiring the 3D topography of the object surface

技术领域technical field

本发明属于物体表面几何形状的三维扫描领域,尤其是一种具有数据前端处理功能的无线手持三维扫描设备。The invention belongs to the field of three-dimensional scanning of object surface geometry, in particular to a wireless handheld three-dimensional scanning device with data front-end processing function.

背景技术Background technique

物体表面的何形状的三维扫描和数字化技术现在被普遍地应用于很多工业和服务中,它的应用领域是非常广泛的。这些应用领域的一些例子如下:工业生产系统中的外形一致性检查和测量;工业造型设计中的设计模型和样件的数字化;具有复杂几何形状的零部件的逆向工程;多媒体和游戏应用中的交互式虚拟现实技术;文物,艺术品等高价值物品的非接触三维数字化。The three-dimensional scanning and digitization technology of the shape of the object surface is now widely used in many industries and services, and its application fields are very extensive. Some examples of these application areas are as follows: shape conformity inspection and measurement in industrial production systems; digitization of design models and prototypes in industrial design; reverse engineering of parts with complex geometries; Interactive virtual reality technology; non-contact 3D digitization of high-value items such as cultural relics and artworks.

测距传感器可以测量传感器和物体表面上一组点之间的距离,从而获得目标表面上各点在传感器坐标系上的三维坐标。但此时获得的三维坐标集合仅仅是表面可见部分的距离测量。为了完整的获得整个物体的数字化形状,传感器必须移动视角以覆盖整个物体表面。根据各个视角在全球公用坐标系统上的方位以及对应视角传感器坐标系上的局部三维坐标,旋转平移组合全部的局部坐标集合,即可以获得整个目标物的完整数字化外部形状。The ranging sensor can measure the distance between the sensor and a group of points on the object surface, so as to obtain the three-dimensional coordinates of each point on the target surface in the sensor coordinate system. But the set of three-dimensional coordinates obtained at this time is only the distance measurement of the visible part of the surface. In order to fully obtain the digitized shape of the entire object, the sensor must move the viewing angle to cover the entire object surface. According to the orientation of each viewing angle on the global common coordinate system and the local three-dimensional coordinates on the corresponding viewing angle sensor coordinate system, the complete digital external shape of the entire target can be obtained by combining all the local coordinate sets with rotation and translation.

关于测距传感器发展了很多不同的理论,其中,干涉度量法(interferometry),飞行时间(TOF)和多视角摄影测量法的原理是公知的理论,根据精度要求、传感器和物体之间的距离以及景深要求,每一种理论都有其适用的范围。Many different theories have been developed for ranging sensors, among which the principles of interferometry, time-of-flight (TOF) and multi-view photogrammetry are well-known theories, depending on the accuracy requirements, the distance between the sensor and the object and Depth of field requirements, each theory has its scope of application.

我们特别关注基于多视角摄影测量原理的测距传感器,此类传感器通常适用于近距离测量,尤其是分米~米长度级别的距离测量。此类方法模拟生物的立体双目视觉,人们必须从两个不同视角收集同一目标的两个观测值,这两个视角相对位置固定。综合视角顶点的连线和两个光线方向,可以获知被观测点的相对位置,即使用三角形中的一条边长和两个角求解三角形顶点。进一步的,如果用在己知方向上发射一组光线的光线投影器来替代光线检测器,那么使用投影器的方向线替代双目方案的其中一个视角,也可以检测光线求解三角形。We are particularly interested in ranging sensors based on the principle of multi-view photogrammetry, which are generally suitable for close-range measurements, especially at the decimeter to meter length level. This type of method simulates the stereoscopic binocular vision of organisms. People must collect two observations of the same target from two different perspectives, and the relative positions of the two perspectives are fixed. The relative position of the observed point can be obtained by combining the connection line of the vertices of the viewpoint and the directions of the two rays, that is, using one side length and two angles in the triangle to solve the triangle vertices. Furthermore, if the light detector is replaced by a light projector that emits a set of rays in a known direction, then using the direction line of the projector instead of one of the viewing angles of the binocular solution, the light rays can also be detected to solve the triangle.

光线投影器的使用替代了图像目标物的复杂检测,同时可以提供密集的表面点测量集。典型的光源有投射点光线、光照平面或其他简单几何图案排布的激光光源。CCD和CMOS数码相机是最常用的光线检测器。The use of ray projectors replaces complex inspection of image objects while providing a dense set of surface point measurements. Typical light sources are laser light sources that project point rays, light planes, or other simple geometric patterns. CCD and CMOS digital cameras are the most commonly used light detectors.

扫描一个物体的就是要收集物体表面上点的信息,并将其构造成曲线(轮廓)或深度图像的形式。为了扫描物体的整个表面,需要移动传感器实现全方位覆盖。一般来说,传感器通常至少包含一个光线检测器和一个投影器,且光线检测器和投影器是刚性集成的。通过利用机械系统带动或手持围绕物体转动扫描,非常适合快速扫描物体或物体必须在现场扫描的情况。Scanning an object is to collect information about points on the object's surface and construct it in the form of curves (contours) or depth images. In order to scan the entire surface of an object, a mobile sensor is required to achieve full coverage. In general, a sensor usually contains at least one light detector and a projector, and the light detector and projector are rigidly integrated. By using the mechanical system to drive or hand-held to rotate and scan around the object, it is very suitable for scanning objects quickly or when the object must be scanned on site.

以上步骤获得了物体在设备坐标系下的扫描数据,扫描整体轮廓需要将数据转换到相对于物体来说是固定的全球公用坐标系统,这需要连续评估仪器的位置和方向。一类方法是通过使用与测距传感器相耦合的定位装置来完成,但存在增加仪器的复杂度和成本以及可能限制集成数据质量的问题。另一种替代方案是使用在刚性物体上收集到的测量结果来计算仪器和物体之间相对位置和方向,但是这种系统完全依赖于物体的几何形状并且对所保持姿势的准确评估较为困难。The above steps obtain the scanning data of the object in the device coordinate system. Scanning the overall profile needs to convert the data to a global common coordinate system that is fixed relative to the object, which requires continuous evaluation of the position and orientation of the instrument. One class of methods is accomplished by using a positioning device coupled with a ranging sensor, but there are problems of increasing the complexity and cost of the instrument and possibly limiting the quality of the integrated data. Another alternative is to use measurements collected on a rigid object to calculate the relative position and orientation between the instrument and the object, but such systems are completely dependent on the geometry of the object and accurate assessment of the held posture is difficult.

为了改进上述的方法,可以使用从场景中的提取的固定点及特征,通过多视角特征匹配,就可以使用照相测量法理论。但这种场景中的自然点存在密度或质量是不充分的问题,进一步的,使用人工设置的固定目标,可以较好的解决特征点不足或难以精确检测的问题。使用这种类型的系统,一般首先测量和建立特征目标的框架,使用扫描图像中的目标信息,实现当前位置检测数据和整体目标数据的拼合。In order to improve the above method, the fixed points and features extracted from the scene can be used, and the photogrammetry theory can be used through multi-view feature matching. However, the density or quality of natural points in this scene is insufficient. Further, using artificially set fixed targets can better solve the problem of insufficient feature points or difficult to accurately detect. Using this type of system, generally first measure and establish the frame of the characteristic target, and use the target information in the scanned image to realize the stitching of the current position detection data and the overall target data.

通过利用机械系统带动或手持围绕物体转动扫描,非常适合快速扫描物体或物体必须在现场扫描的情况。现有的手持设备受到电源和数据线长度的限制,扫描大型或表面结构较复杂的目标时,操作受限或非常不便,为了改进上述的方法,可以使用无线传输和电池供电的模式,同时为了解决附加高数据传输量的问题,采用前端处理+无线的方式可以获得更好的使用体验。By using the mechanical system to drive or hand-held to rotate and scan around the object, it is very suitable for scanning objects quickly or when the object must be scanned on site. Existing handheld devices are limited by the length of power supply and data lines. When scanning large-scale or complex surface structures, the operation is limited or very inconvenient. In order to improve the above methods, wireless transmission and battery-powered modes can be used. At the same time, for To solve the problem of additional high data transmission volume, a better user experience can be obtained by using front-end processing + wireless.

然而,前端图像处理需要的大量计算和无线设备功耗,如何提高设备的续航能力;高帧速原始图像的数据量大于有效带宽的条件下,如何稳定传输大量的检测数据;前端处理和无线传输带来的设备重量变化和便携性的冲突如何协调,是本发明要解决的技术问题。However, front-end image processing requires a large amount of calculation and wireless device power consumption, how to improve the endurance of the device; under the condition that the data volume of high frame rate original image is greater than the effective bandwidth, how to stably transmit a large amount of detection data; front-end processing and wireless transmission The technical problem to be solved by the present invention is how to coordinate the conflict between the resulting change in equipment weight and portability.

发明内容Contents of the invention

本发明的目的在于克服现有技术的不足之处,提供一种在世界坐标系内获得物体表面空间坐标点的便携式手持3D激光测量设备。The object of the present invention is to overcome the shortcomings of the prior art, and provide a portable handheld 3D laser measuring device for obtaining spatial coordinate points on the surface of an object in a world coordinate system.

本发明解决技术问题所采用的技术方案是:The technical scheme that the present invention solves technical problem adopts is:

一种具有数据前端处理功能的无线手持三维扫描设备,图案投射装置,图像传感设备,无线通信模块,移动电源模块,还包括一组用于分析图像数据和控制前端设备状态的移动处理平台,实现图像数据到目标检测结果压缩数据的输出,实现设备状态探测,实现与上位机的数据和命令交流。A wireless handheld three-dimensional scanning device with data front-end processing function, pattern projection device, image sensing device, wireless communication module, mobile power supply module, and a set of mobile processing platforms for analyzing image data and controlling the status of front-end equipment, Realize the output of compressed data from image data to target detection results, realize equipment status detection, and realize data and command communication with the host computer.

图案投射装置,图像传感设备,无线通信模块,移动电源模块,温度传感器均连接在处理单元的接口上。图案投射装置,图像传感设备,无线通信模块,移动电源模块和核心的移动处理单元可以集成到一个结构件内部,也可以将移动处理单元外挂到现有的仅包含图案投射装置,图像传感设备和驱动电路的有线手持设备上。本设备还包括音频信息反馈设备,告警设备的异常状态;移动电源模块采用双模供电模块,可使用外接电源和电池两种供电模式。图案投射装置是由若干激光器和LED按一定投射角度组合,具有独立或统一点亮时序的设备。The pattern projecting device, the image sensing device, the wireless communication module, the mobile power supply module, and the temperature sensor are all connected to the interface of the processing unit. The pattern projection device, image sensing equipment, wireless communication module, mobile power supply module and core mobile processing unit can be integrated into a structural part, or the mobile processing unit can be plugged into the existing pattern projection device, image sensing device, etc. devices and drive circuits on wired handheld devices. The device also includes an audio information feedback device, and an abnormal state of the alarm device; the mobile power module adopts a dual-mode power supply module, and can use two power supply modes of external power supply and battery. The pattern projection device is a device that combines several lasers and LEDs according to a certain projection angle, and has independent or unified lighting timing.

所述移动处理平台包括至少一个移动处理单元,移动处理单元包括至少一个前端计算器,所述前端计算器用于进行前端数据运算;所述的前端计算器从图像中提取扫描目标物表面标记点和表面点的2D特征数据,根据2D特征数据集进行三维重建得到三维特征数据集。The mobile processing platform includes at least one mobile processing unit, the mobile processing unit includes at least one front-end calculator, and the front-end calculator is used to perform front-end data calculation; the front-end calculator extracts the surface marker points and The 2D feature data of the surface points are reconstructed according to the 2D feature data set to obtain the 3D feature data set.

其中,移动处理单元使用CPU+GPU的构成方案,其中高速图像处理模块使用GPU实现;也可以使用DSP、FPGA、ARM实现。上述移动处理单元及其支撑电路构成的移动处理平台,替代了现有的传输图像的手持前端中包含的相机控制电路,由于上述核心方案的高集成度,即使额外包含了电池和散热装置,优化设计了结构的前端设备重量也仅仅是略高于现有的手持前端,由于扫描中无需使用电源和网线,或二者集成的连接线,使用的便利性大大提高。Among them, the mobile processing unit uses a composition scheme of CPU+GPU, and the high-speed image processing module is realized by using GPU; it can also be realized by using DSP, FPGA, and ARM. The mobile processing platform composed of the above-mentioned mobile processing unit and its supporting circuit replaces the camera control circuit contained in the existing hand-held front-end for image transmission. The weight of the front-end device with the designed structure is only slightly higher than that of the existing handheld front-end. Since the scanning does not need to use power supply and network cable, or the connecting line integrated between the two, the convenience of use is greatly improved.

移动处理单元包括前端图像处理器,该模块以高帧速接收相机图像,该模块可以从图像中提取至少4个扫描目标物表面标记物的几何参数和光学参数,也可以从图像中提取图案投射装置在扫描目标物表面上漫反射得到的图样的坐标位置和光学参数;本方案的表面标记物为圆形,对应几何参数为椭圆的5个几何参数;光学参数为目标范围内点的分段亮度分布统计值。上述两种检测功能可同时运行,也可单独运行。本模块使用计算平衡技术,把计算中可以同时进行的部分,分配到构成所述移动处理单元的不同电子芯片中,可以充分利用前端有限的资源,降低硬件要求。The mobile processing unit includes a front-end image processor, this module receives the camera image at a high frame rate, this module can extract the geometric parameters and optical parameters of at least 4 scanning target surface markers from the image, and can also extract the pattern projection from the image The coordinate position and optical parameters of the pattern obtained by the diffuse reflection of the device on the surface of the scanning target; the surface marker of this scheme is a circle, and the corresponding geometric parameters are 5 geometric parameters of the ellipse; the optical parameters are the segmentation of points within the target range Brightness distribution statistics. The above two detection functions can be operated simultaneously or independently. This module uses calculation balance technology to distribute the part of the calculation that can be performed simultaneously to different electronic chips that constitute the mobile processing unit, which can make full use of the limited front-end resources and reduce hardware requirements.

移动处理单元包括实时设备参数调控模块,使用高速图像处理模块两个分支计算的光学参数的统计值,计算修改图案投射装置和图像传感设备的运行参数;通过与移动处理平台,根据参数控制上述设备完成接收图像的实时控制。由于上述设备直接与移动处理单元连接,信号的速率和完整度均高于现有的上位机发送控制的连接方式,控制的实时性更好。The mobile processing unit includes a real-time equipment parameter control module, which uses the statistical values of the optical parameters calculated by the two branches of the high-speed image processing module to calculate and modify the operating parameters of the pattern projection device and image sensing equipment; The device completes the real-time control of the received image. Since the above-mentioned devices are directly connected with the mobile processing unit, the rate and integrity of the signal are higher than that of the existing upper computer transmission control connection mode, and the real-time performance of the control is better.

移动处理单元包括数据压缩和发送模块,上述检测数据使用结构化的数据存储,压缩模块将数据通过压缩算法合并成信息相同但数据量较少的数据包;然后将上述数据包向上位机发送,压缩数据可在上位机还原为原始结构化数据。由于使用前端图像处理器,上述发送数据的数据量低于原始图像数据量的10%,在无线传输速率一定的条件下,单位时间可以传输更多帧更大分辨率图像的检测数据,有效支撑整体系统的更高速扫描。上述数据压缩模块还包含数据校验,能有效检测并处理传输导致的局部数据异常,对比难以纠错的原始图像数据,有效降低传输错误带来的突发扫描精度异常。The mobile processing unit includes a data compression and sending module. The above-mentioned detection data uses structured data storage. The compression module combines the data into a data packet with the same information but a small amount of data through a compression algorithm; then sends the above-mentioned data packet to the host computer. Compressed data can be restored to original structured data on the host computer. Due to the use of the front-end image processor, the data volume of the above-mentioned sent data is less than 10% of the original image data volume. Under the condition of a certain wireless transmission rate, more frames of detection data with larger resolution images can be transmitted per unit time, effectively supporting Higher speed scanning of the overall system. The above-mentioned data compression module also includes data verification, which can effectively detect and deal with local data anomalies caused by transmission, compare the original image data that is difficult to correct, and effectively reduce sudden abnormal scanning accuracy caused by transmission errors.

移动处理单元包括状态接收和发送模块,移动处理平台与外围设备的接口,获取设备参数,电源模块参数,设备温度信息,设备按键动作等信息构成设备状态数据包,然后将上述数据发送至上位机和前端便携显示屏;同时,上述信息的部分信息还可以使用设备端包含的警示灯和声音模块完成异常告警。The mobile processing unit includes a status receiving and sending module, the interface between the mobile processing platform and peripheral devices, obtains device parameters, power module parameters, device temperature information, device button actions and other information to form a device status data packet, and then sends the above data to the host computer and front-end portable display screen; at the same time, part of the above information can also use the warning lights and sound modules included in the device to complete abnormal alarms.

移动处理单元包括设备连接控制模块,模块通过获取上位机提供的包含连接信息的二维码,识别设备对应的上位机目标并设置实现设备和上位机的无线或有线连接。The mobile processing unit includes a device connection control module. The module identifies the target of the upper computer corresponding to the device by obtaining the two-dimensional code provided by the upper computer and includes the connection information, and sets to realize the wireless or wired connection between the device and the upper computer.

最后,移动处理单元还包括功能调度和核心控制模块,该模块实现上述全部模块的调度和移动处理单元硬件状态的控制,可将移动处理单元设置为全性能,普通和低功耗等多种工作模式;根据前端图像处理器的状态切换模式,有效延长了前端设备的续航时间。Finally, the mobile processing unit also includes a function scheduling and core control module, which realizes the scheduling of all the above modules and the control of the hardware status of the mobile processing unit, and can set the mobile processing unit to work in full performance, normal and low power consumption, etc. mode; switch modes according to the state of the front-end image processor, effectively prolonging the battery life of the front-end device.

本设备包含连接在移动处理单元上的无线通信模块,使用WiFi芯片和内置天线实现;同时使用无线和有线两种可切换模式,传输所述压缩数据;所述无线模式使用WiFi收发命令和数据,所述有线模式使用USB3.0和千兆网线收发命令和数据;所述切换方法使用人工和自动检测前端连接条件两种模式,不存在有线连接时自动启用无线连接,也可以在不适合无线的环境中改为有线连接。This device includes a wireless communication module connected to the mobile processing unit, which is realized by using a WiFi chip and a built-in antenna; it uses two switchable modes of wireless and wired at the same time to transmit the compressed data; the wireless mode uses WiFi to send and receive commands and data, The wired mode uses USB3.0 and Gigabit network cables to send and receive commands and data; the switching method uses two modes of manual and automatic detection of front-end connection conditions, and wireless connections are automatically enabled when there is no wired connection, and it can also be used in situations that are not suitable for wireless The environment is changed to a wired connection.

此外,设备的实现形式不仅限于上述的一体化前端,也可以使用分体式设计进一步减轻扫描负重。方案为,移动处理单元,无线通信模块和移动电源模块共同组成外置的处理盒;图像传感器,图案投射装置和其他传感器构成最小化的前端;处理盒挂在使用者衣物表面或衣袋中,通过短距离的柔性电缆与的最小化前端相连;最小化前端重量极大减小,长时间扫描更不容易疲劳。此外,仅移动电源模块外置的方案也是可以的。In addition, the implementation form of the device is not limited to the above-mentioned integrated front end, and a split design can also be used to further reduce the scanning load. The solution is that the mobile processing unit, the wireless communication module and the mobile power supply module together form an external processing box; the image sensor, pattern projection device and other sensors form a minimized front end; the processing box is hung on the surface of the user's clothing or in the pocket, The short-distance flexible cable is connected to the minimal front end; the weight of the minimal front end is greatly reduced, and it is less likely to be fatigued for long-term scanning. In addition, a solution in which only the mobile power module is external is also possible.

除了传统的上位机显示外,本设备存在连接在所述前端设备上的便携显示屏,所述显示屏用于显示设备状态信息和扫描模型图像;所述扫描模型图像由上位机生成,使用无线的HDMI传输;所述信息包含所述图案投射装置的配置参数;包含所述移动电源模块的状态信息。传统的有线手持扫描大物体是需要上位机设备两端不停的来回观察上位机屏幕上的扫描结果和前端对着的扫描位置,受限于连接线长度和操作人员的视力,扫描件较大时可能还需要不断搬移上位机,极为不便,本方案的随身显示设计,极大的提高了操作的便利性和扫描效率。In addition to the traditional upper computer display, this device has a portable display connected to the front-end device, and the display is used to display device status information and scan model images; the scan model images are generated by the upper computer, using wireless HDMI transmission; the information includes configuration parameters of the pattern projection device; includes status information of the mobile power module. The traditional wired handheld scanning of large objects requires both ends of the host computer to continuously observe the scan results on the screen of the host computer and the scanning position facing the front end. Due to the limitation of the length of the connecting line and the vision of the operator, the scanned image is relatively large. It may be necessary to constantly move the host computer, which is extremely inconvenient. The portable display design of this solution greatly improves the convenience of operation and scanning efficiency.

本设备与上位机连接构成完整的测量系统,上位机包括后端立体重构设备,立体拼接设备,模型生成设备和模型展示设备等。The device is connected with the upper computer to form a complete measurement system. The upper computer includes back-end three-dimensional reconstruction equipment, three-dimensional splicing equipment, model generation equipment and model display equipment, etc.

图案投射装置包含激光器和LED光源,使用固定在前端设备上的激光投影器将图案投影在所述表面上;使用由至少3个LED光源正多边形排布构成,几何中心与一个传感器镜头组的光学中心接近且发射方向和传感器镜头组的光轴方向近似平行的光源照射所述标记物;所述标记物为不同反光率材质构建的对称双层几何图案,所述几何图案为圆形但不仅限于圆形,所述标记固定在所述物体的表面上且可在扫描过程中补充添加。The pattern projection device includes a laser and an LED light source, and a laser projector fixed on the front-end equipment is used to project the pattern on the surface; an optical system composed of at least 3 LED light sources arranged in a regular polygon, the geometric center and a sensor lens group is used The marker is irradiated by a light source whose center is close and whose emission direction is approximately parallel to the optical axis direction of the sensor lens group; the marker is a symmetrical double-layer geometric pattern constructed of materials with different reflectivity, and the geometric pattern is circular but not limited to Circular, the marker is fixed on the surface of the object and can be supplemented during scanning.

所述图案投射装置包含使用特定波长的光过滤装置的镜头,所述过滤装置透过的光为两种频率,分别与所述激光投射器和LED投射装置各自的光频率对应;The pattern projection device includes a lens using a light filter device of a specific wavelength, and the light transmitted by the filter device has two frequencies, corresponding to the respective optical frequencies of the laser projector and the LED projection device;

所述图像传感设备包含同步触发控制模块,用于在一个图像采集周期的开始触发所述激光投射器和LED投射装置;The image sensing device includes a synchronous trigger control module for triggering the laser projector and the LED projection device at the beginning of an image acquisition cycle;

移动处理单元读取所述图像传感设备采集的图像,计算所述表面上标记物和表面上漫反射的图样的位置数据和光学参数,并将其压缩传输;所述数据在上位机接收并完全还原为所述位置数据和光学参数;The mobile processing unit reads the image collected by the image sensing device, calculates the position data and optical parameters of the marker on the surface and the diffusely reflected pattern on the surface, and compresses and transmits it; the data is received by the host computer and Full reduction to said position data and optical parameters;

移动处理单元读取所述表面上标记物和漫反射得到的图样的光学参数,计算并控制所图案投射装置的参数,实现最佳的检测效果。The mobile processing unit reads the optical parameters of the marker on the surface and the pattern obtained by diffuse reflection, calculates and controls the parameters of the pattern projection device, and achieves the best detection effect.

本发明的优点和有益效果:Advantages and beneficial effects of the present invention:

1、本设备具有更高扫描速度,现有手持扫描设备仅实现图像接收传输的方案,改为无线时,受限于带宽,扫描速度较差,本方案使用处理后的数据,配合数据压缩,突破原有限制,可以实现更高速度的扫描。1. This device has a higher scanning speed. The existing handheld scanning device only realizes the image receiving and transmission scheme. When it is changed to wireless, it is limited by the bandwidth and the scanning speed is poor. This scheme uses the processed data and cooperates with data compression. By breaking through the original limitation, higher speed scanning can be realized.

2、本设备具有更高的扫描精度,具有前端处理能力的设备支持更高的扫描分辨率,较少的带宽占用支持前端设备采用更高分辨率的相机,提供更高的扫描精度。2. This device has higher scanning accuracy. Devices with front-end processing capabilities support higher scanning resolution, and less bandwidth occupation supports front-end devices to use higher-resolution cameras to provide higher scanning accuracy.

3、本设备具有更高的整体扫描系统速度,前端计算和现有的传输原始图像的模式相比,减少了上位机端的计算量,有助于整体达到更高的扫描速度。3. This device has a higher overall scanning system speed. Compared with the existing mode of transmitting original images, the front-end calculation reduces the amount of calculation on the upper computer side, which helps to achieve a higher overall scanning speed.

4、本设备采用无线连接,电池供电,不受数据线和电源线的长度限制,10米以内稳定连接,扫描更加便利,特别是扫描大物体时;移动处理单元包含二维码扫描模式,可简易实现设备到上位机的连接。4. This device adopts wireless connection, battery power supply, not limited by the length of the data line and power line, stable connection within 10 meters, and scanning is more convenient, especially when scanning large objects; the mobile processing unit includes a QR code scanning mode, which can It is easy to realize the connection between the device and the host computer.

5、本设备具有显示屏,当扫描位置远离上位机而无法看清显示屏幕时,提供随身的扫描过程显示,便于使用者随时调整;设备状态和告警信息可以直观的显示到屏幕上,远优于现有有线扫描常用的上位机端和设备发声提示,极大的提高了操作的便利性和扫描效率。5. This device has a display screen. When the scanning position is far away from the host computer and the display screen cannot be seen clearly, it provides a portable scanning process display, which is convenient for users to adjust at any time; the device status and alarm information can be intuitively displayed on the screen, far superior The host computer terminal and equipment that are commonly used in existing wired scans give voice prompts, which greatly improves the convenience of operation and scanning efficiency.

附图说明Description of drawings

图1为本设备的电路框图;Figure 1 is a circuit block diagram of the device;

图2为本设备的立体结构图;Figure 2 is a three-dimensional structure diagram of the device;

图3为参考目标附着在其上并且图形投射到其上的表面部分的图示;Figure 3 is an illustration of a portion of a surface to which a reference target is attached and onto which a graphic is projected;

图4为本设备的处理流程模块图示;Fig. 4 is the schematic diagram of the processing flow module of this equipment;

图5为本设备分体式设计的结构示意图。Figure 5 is a schematic structural diagram of the split design of the device.

具体实施方式Detailed ways

本发明可以通过以下所述实例来实践,在以下描述中,参考附图是为了说明实例。本发明可以通过所述实例来实践,也可以在不脱离所揭示的本发明的范围的情况下通过实施其它实施例来实现。The invention can be practiced by the examples described below, and in the following description, reference is made to the accompanying drawings for the purpose of illustrating the examples. The invention may be practiced by the examples described and by implementing other embodiments without departing from the scope of the invention as disclosed.

一种具有数据前端处理功能的无线手持三维扫描设备,如图1所示,包括移动处理平台,及分别与移动处理平台连接的图案投射装置(激光投射装置、LED投射装置)、图像传感器、电池模块、随身显示屏、距离报警装置、按键、设备状态传感器。移动处理平台包括智能设备控制模块、图像和数据处理器及数据发送模块。智能设备控制模块分别与图像和数据处理器、数据发送模块连接,图像和数据处理器与数据发送模块连接。A wireless handheld three-dimensional scanning device with data front-end processing function, as shown in Figure 1, includes a mobile processing platform, and a pattern projection device (laser projection device, LED projection device) respectively connected to the mobile processing platform, an image sensor, a battery Modules, portable display screens, distance alarm devices, buttons, and equipment status sensors. The mobile processing platform includes a smart device control module, an image and data processor and a data sending module. The smart device control module is respectively connected with the image and data processor and the data sending module, and the image and data processor is connected with the data sending module.

移动处理平台实现图像数据到目标检测结果压缩数据的输出,实现设备状态探测,实现与上位机端后处理部分的数据和命令交流。The mobile processing platform realizes the output of compressed data from image data to target detection results, realizes equipment status detection, and realizes data and command communication with the post-processing part of the host computer.

图2为本设备的立体结构图,包括壳体、激光投射装置3、图像传感器1及LED投射装置2,所述壳体由底座4及手持部6两部分构成,在底座的顶面竖向固装一条形的手持部,在手持部的正面上下间隔对称固装两图像传感器,在每一图像传感器上均固装一环形的LED投射装置,在两图像传感器之间的壳体上固装激光投射装置,在手持部侧面安装的显示屏5,在底座内安装电路板及电池。上述显示屏可以通过活动转轴和卡扣与手持部侧壁连接,以设备侧边和屏幕的连接的活动转轴为转轴,打开另一侧的卡扣向外翻起,可以使屏幕面向使用者;显示屏也可以将显示屏完全拿出,手持观察。Fig. 2 is a three-dimensional structural diagram of the device, including a housing, a laser projection device 3, an image sensor 1 and an LED projection device 2. The housing is composed of a base 4 and a hand-held part 6. A strip-shaped hand-held part is fixed, and two image sensors are fixed symmetrically at intervals up and down on the front of the hand-held part. A ring-shaped LED projection device is fixed on each image sensor, and a ring-shaped LED projection device is fixed on the housing between the two image sensors. Laser projection device, the display screen 5 that is installed on the side of the hand-held part, circuit board and battery are installed in the base. The above-mentioned display screen can be connected to the side wall of the handheld part through a movable shaft and a buckle, and the movable shaft connected to the side of the device and the screen is used as the rotating shaft, and the buckle on the other side is opened and turned outward, so that the screen can face the user; The display screen can also be completely taken out for hand-held observation.

此外,上述结构还存在外挂模式的变形分支,所述的移动处理平台,数据发送模块和移动电源模块共同组成外置的处理盒7,图像传感设备,图案投射装置和对应的传感器构成最小化的前端9,处理盒挂在使用者衣物表面或衣袋中,通过短距离的柔性电缆8与最小化前端相连,如图5所示。In addition, the above-mentioned structure also has a variant branch of the plug-in mode. The mobile processing platform, the data sending module and the mobile power supply module together form the external processing box 7, and the image sensing equipment, the pattern projection device and the corresponding sensors constitute a minimum The front end 9 of the front end, the processing box is hung on the user's clothing surface or in the pocket, and is connected to the front end of the minimization by a short-distance flexible cable 8, as shown in Figure 5.

图3为参考目标附着在其上并且图形投射到其上的表面部分的图示,设备运行前,首先将高反光率的目标附着到场景和被测物上。在此实例中,参考目标是表面具有回归反射特性的目标,其图案在多边形灯组的发光波段下是可见的,材料被低反射率颜色(例如黑色)的环包围,有助于在传感器的图像中准确识别目标。由于采用了具有回归反射特性的材料,物体的表面需要被照亮以允许对参考目标的恰当识别。Figure 3 is an illustration of the part of the surface on which the reference target is attached and the graphics are projected onto. Before the device is operated, the target with high reflectivity is first attached to the scene and the object to be measured. In this example, the reference target is a target with a surface that has retroreflective properties, and whose pattern is visible in the emission band of the polygonal light set, the material is surrounded by a ring of low reflectivity color (such as black), which helps in the sensor's reflection. Accurately identify objects in images. Due to the use of materials with retroreflective properties, the surface of the object needs to be illuminated to allow proper identification of the reference target.

图4为本设备的处理流程模块图示,在此实例中,首先使用上述装置将多边形灯的灯光和激光器的交叉线图案投射被测物表面,相机可以同时同步捕获场景的两个图像,使用计算芯片内封装的二维图像处理技术,在每幅图像中获得所述目标和所述激光图样的2D位置;然后,使用无线通信模块将计算核心压缩的结构化数据发送到后端处理软件上;下一步,利用对极几何约束(epi-polar geometry constraints)来匹配在两幅图像中的所述2D位置;使用所述的两幅图像中的目标对应关系,使用三角立体成像方法获得设备坐标系下的所述目标和所述激光图样的3D位置,其中激光图样的3D位置就是图样投射区域的被测物表面的3D位置信息;最后通过匹配计算图像序列的参考目标的3D位置,构建单次采集图像的目标和激光点3D位置和规定初始位置的转换关系,通过转换关系获得世界坐标系下的激光图样的3D位置集合,重构激光图样的3D位置集合得到被测物表面的3D位置信息。Figure 4 is a schematic diagram of the processing flow module of this device. In this example, first use the above-mentioned device to project the light of the polygonal lamp and the cross-hatch pattern of the laser on the surface of the measured object, and the camera can capture two images of the scene synchronously at the same time. Calculate the two-dimensional image processing technology packaged in the chip to obtain the 2D position of the target and the laser pattern in each image; then, use the wireless communication module to send the structured data compressed by the calculation core to the back-end processing software ; Next step, use epi-polar geometry constraints to match the 2D positions in the two images; using the target correspondence in the two images, use the triangular stereo imaging method to obtain the device coordinates The 3D position of the target and the laser pattern under the system, wherein the 3D position of the laser pattern is the 3D position information of the surface of the measured object in the pattern projection area; finally, by matching and calculating the 3D position of the reference target of the image sequence, a single The conversion relationship between the 3D position of the target and the laser point of the second acquisition image and the specified initial position, through the conversion relationship, the 3D position set of the laser pattern in the world coordinate system is obtained, and the 3D position set of the laser pattern is reconstructed to obtain the 3D position of the surface of the measured object information.

在此实例中,使用由多个LED等距构成,正多边形排布,固定在相机前端附近,中心位于相机光轴上且方向和相机光轴观察方向一致的灯组实现标记目标的补光照亮,LED灯的强度可以经调整以便使图像中目标和背景有足够的亮度差,有助于在传感器的图像中准确识别目标。In this example, a light group consisting of multiple LEDs equidistant, arranged in a regular polygon, fixed near the front of the camera, centered on the optical axis of the camera and in the same direction as the viewing direction of the optical axis of the camera is used to achieve supplementary lighting for the marked target On, the intensity of the LED light can be adjusted so that there is enough brightness difference between the target and the background in the image to help accurately identify the target in the sensor's image.

在此实例中,激光投射装置安装在所述使用3对或更多交叉线图样的红色激光器,同样也可以使用其他类型的投影装置,如白光图形投影仪或蓝色LED图形投影仪;所提取图样投射区域的被测物表面的3D位置信息将根据激光投射装置的类型以及所应用的方法而变化。In this example, the laser projection device is installed on the red laser using 3 or more cross-hatch patterns, but other types of projection devices can also be used, such as a white light graphic projector or a blue LED graphic projector; the extracted The 3D position information of the measured object surface in the pattern projection area will vary depending on the type of laser projection device and the applied method.

在此实例中,使用一对相机,相机镜头前端存在和激光器匹配的滤光结构的光过滤装置;也可以向此装置添加若干个相机,以同样的原理获得更精确的匹配或更高精度的最终坐标。相机曝光过程和上述LED以及激光器发光过程同步,通过相机捕获的图像上可以清楚的获得目标和激光器图样的成像。In this example, a pair of cameras are used, and there is a light filter device with a filter structure matching the laser at the front of the camera lens; it is also possible to add several cameras to this device to obtain more accurate matching or higher precision by using the same principle. final coordinates. The camera exposure process is synchronized with the above-mentioned LED and laser light emitting process, and the imaging of the target and the laser pattern can be clearly obtained on the image captured by the camera.

在此实例中,由于使用圆形的目标标记,在图像中提取反射目标的未失真轮廓可以用椭圆形轮廓来表示。因为相机被校准,未失真轮廓可以使用所属领域中熟知的方法来去除失真,在此实例中,需要从相机参数存储器获得相机的光学特性参数。根据图像中的椭圆形轮廓的方程,可计算所述椭圆形轮廓在3D空间中的定向,可以参考“对3D计算机视觉的介绍性技术(Introductory techniques for 3D computer vision)”的第11章以获得更详细的论述。因为所述圆投射到相机的投射中心,所以所述圆在3D空间中与圆锥相交。在提取轮廓点之后,拟合到局部的3D点集上的模型可以是平面或用于更大精度的二次多项式。在后者的情况中,利用以下模型来应用最小平方法,然后使用常用的椭圆参数计算方法获得其几何参数。In this example, due to the use of circular target markers, extraction of the undistorted contour of the reflective target in the image can be represented by an elliptical contour. Since the camera is calibrated, the undistorted profile can be undistorted using methods well known in the art, in this instance the optical characteristic parameters of the camera need to be obtained from the camera parameter memory. From the equation of an elliptical contour in an image, the orientation of said elliptical contour in 3D space can be calculated, which can be found in Chapter 11 of "Introductory techniques for 3D computer vision" for A more detailed discussion. Because the circle is projected onto the camera's projected center, the circle intersects the cone in 3D space. After extracting the contour points, the model fitted to the local 3D point set can be a plane or a quadratic polynomial for greater precision. In the latter case, the least squares method is applied using the following model, and then its geometric parameters are obtained using a commonly used ellipse parameter calculation method.

z=ax2+bxy+cy2+dx+ey+fz= ax2 +bxy+ cy2 +dx+ey+f

在此实例中,激光图样使用的是3对或更多交叉线图样,通过图像处理计算获得线上各点的2D坐标位置,同样的,因为相机被校准,未失真坐标可以使用所属领域中熟知的方法来去除失真。在此实例中,相机的曝光时间,增益和激光器的光强是可调节的,可以在传感器的图像生成狭窄清晰的线条图样,有助于精确地提取出图样上各点的2D坐标位置。In this example, the laser pattern uses 3 or more pairs of cross-line patterns, and the 2D coordinate positions of each point on the line are obtained through image processing calculations. Similarly, because the camera is calibrated, the undistorted coordinates can be obtained using well-known methods in the art. method to remove distortion. In this example, the exposure time of the camera, the gain and the light intensity of the laser are adjustable, which can generate a narrow and clear line pattern in the image of the sensor, which helps to accurately extract the 2D coordinate position of each point on the pattern.

在此实例中,上述处理步骤在设备端的CPU和GPU上计算实现,获得了单帧采集的两幅图构建的目标点和表面点的坐标位置。上述数据需要传输到上位机端的处理软件中完成后续的3D重构和表面建模,在此实例中,使用无线通信传输上述数据,同时也支持在高电磁干扰的环境中切换到有线网络传输的模式。In this example, the above-mentioned processing steps are calculated and implemented on the CPU and GPU of the device, and the coordinate positions of the target point and the surface point constructed from the two images collected in a single frame are obtained. The above data needs to be transmitted to the processing software on the host computer to complete the subsequent 3D reconstruction and surface modeling. In this example, the above data is transmitted using wireless communication, and it also supports switching to wired network transmission in an environment with high electromagnetic interference. model.

在此实例中,目标的3D位置使用三角法计算,目标的法向使用视线方向关联的方法计算。首先需要从目标尺寸存储器获得两个相机的位置参数,一般以其中一个相机的光学中心为圆点,然后根据对极几何约束构建基础矩阵,通过极线方程搜索标记圆点的匹配关系;最后将一组匹配的标记点位置通过三角法计算出3D位置,即单个参考目标在设备坐标系下的空间位置。In this example, the 3D position of the target is calculated using trigonometry, and the normal to the target is calculated using a gaze direction correlation method. Firstly, the position parameters of the two cameras need to be obtained from the target size memory, and the optical center of one of the cameras is generally used as a dot, and then the basic matrix is constructed according to the epipolar geometric constraints, and the matching relationship of the marked dots is searched through the epipolar line equation; finally, the A set of matched marker positions are triangulated to calculate the 3D position, which is the spatial position of a single reference target in the device coordinate system.

在此实例中,激光图样的3D坐标计算方式和上述目标中心的坐标计算方法基本一致。考虑到单个激光点特征不足导致的匹配依据缺失和误匹配,需要将点按投射图样的几何特征组合,按组合结果计算带有几何特征的点集合的匹配,然后再使用和目标中心的坐标计算方法。在此实例中,投射图样为交叉线,因此使用线段作为匹配的几何特征,同样的,使用不同的投射图样,需要使用不同的特征和组合,原理是一致的。In this example, the 3D coordinate calculation method of the laser pattern is basically the same as the above-mentioned coordinate calculation method of the target center. Considering the lack of matching basis and mismatching caused by insufficient features of a single laser point, it is necessary to combine the geometric features of the projected pattern by point pressing, and calculate the matching of the point set with geometric features according to the combination result, and then use the coordinate calculation with the center of the target method. In this example, the projected pattern is a crossing line, so the line segment is used as the matching geometric feature. Similarly, different projected patterns need to use different features and combinations, and the principle is the same.

在扫描过程中,使用者可能将物体传感器至少其一握在其手中移动来实现表面点的全覆盖,此时每一帧的以上步骤获得的数据都是基于当前帧的设备坐标系的,由于设备的运动,坐标系相对世界坐标系是不断变化的,传感器坐标系中的3D点需要六个刚性变换的自由度的参数传感器的坐标系映射到模型坐标系(世界坐标系)中。During the scanning process, the user may move at least one of the object sensors in his hand to achieve full coverage of the surface points. At this time, the data obtained in the above steps of each frame are based on the device coordinate system of the current frame, because For the movement of the device, the coordinate system is constantly changing relative to the world coordinate system. The 3D point in the sensor coordinate system needs six rigid transformation parameters of the degrees of freedom. The sensor coordinate system is mapped to the model coordinate system (world coordinate system).

在此实例中,使用标记点的匹配实现变换参数的计算。使用在当前帧计算的目标坐标和参数,在积累的目标模型中寻找基于位置三角位置关系的最佳匹配集合,获取积累的目标中与当前参考目标对应的匹配关系,由此计算所述将传感器的坐标系映射到模型坐标的刚性变换;然后将3D表面点使用相同的刚性变换,对应地从传感器的坐标系变换到模型坐标系;最后将新的变换后的参考目标和3D表面点积累到已有的目标框架和表面点集合中。In this example, the calculation of the transformation parameters is achieved using the matching of marked points. Using the target coordinates and parameters calculated in the current frame, find the best matching set based on the position triangle position relationship in the accumulated target model, and obtain the matching relationship corresponding to the current reference target in the accumulated target, thereby calculating the sensor The coordinate system of the model is mapped to the rigid transformation of the model coordinates; then the 3D surface points are transformed from the sensor coordinate system to the model coordinate system correspondingly using the same rigid transformation; finally, the new transformed reference target and 3D surface points are accumulated into In the existing target frame and surface point collection.

同样的,上述刚性变换也可以考虑使用空间位置或加速度感应装置直接获取。Similarly, the aforementioned rigid transformation can also be directly obtained by using a spatial position or acceleration sensing device.

考虑到扫描距离对精度的影响,在此实例中,设备端面向使用者的表面上存在一个距离指示器,通过颜色的变化反映当前设备和扫描物距离的状态。同样的,也可以使用声音提示的方式实现上述功能。Considering the impact of the scanning distance on the accuracy, in this example, there is a distance indicator on the surface of the device facing the user, and the color changes to reflect the current state of the distance between the device and the scanned object. Similarly, the above functions can also be realized by means of voice prompts.

由于表面点存在噪声的影响,难以直接用于显示和测量,在此实例中,上述的3D表面点需要通过重构产生表面模型,最终,经重构表面被传送到用户界面显示器。Due to the influence of noise on the surface points, it is difficult to be directly used for display and measurement. In this example, the above-mentioned 3D surface points need to be reconstructed to generate a surface model, and finally, the reconstructed surface is sent to the user interface display.

为了便于大体积目标的扫描,在此实例中,用户界面显示器分为上位机端连接的主显示器和所述随身显示屏,其中随身显示屏连接在前端设备上,显示扫描结果和设备状态,使用HDMI接口传输数据。在此实例中,所述设备状态包含且不限于温度,电量,电源状态,靠近显示屏边缘叠加显示。所述的状态数据来源于连接设备上的各类温度,电量等传感器。In order to facilitate the scanning of large-volume targets, in this example, the user interface display is divided into the main display connected to the host computer and the portable display, wherein the portable display is connected to the front-end device to display scanning results and device status. The HDMI interface transmits data. In this example, the device status includes but is not limited to temperature, battery power, and power status, which are superimposed and displayed near the edge of the display screen. The state data mentioned above come from various temperature and power sensors on the connected device.

为了便于大体积目标的扫描,在此实例中,使用可更换的充电电池作为前端设备的电源,同样,也可以使用有线连接的适配电源。In order to facilitate the scanning of large-volume targets, in this example, a replaceable rechargeable battery is used as the power source of the front-end device, and similarly, a wired-connected adapter power source can also be used.

尽管以上描述涉及如本发明人目前所考虑的实例实施例,但应理解,本发明在其广义方面包含本文中所描述的元件的等效物和过程的等效方法。上文描述的实施例仅希望为示例性的。因此,本发明的范围希望仅由所附权利要求书限制。While the above description refers to example embodiments as presently contemplated by the inventors, it is to be understood that the invention in its broadest aspects encompasses equivalents of the elements described herein and equivalents of processes. The embodiments described above are intended to be exemplary only. Accordingly, it is intended that the scope of the invention be limited only by the appended claims.

Claims (24)

1. a kind of wireless hand-held three-dimensional scanning device for being used to obtain object surface three-dimensional morphology, including:
Pattern projecting device, for providing projection pattern on the body surface;
Image sensing apparatus, including at least two cameras, camera are used for the 2D that the body surface is obtained from different points of view Image;
Mobile processing platform, arithmetic core is provided for equipment, and the mobile processing platform includes at least one mobile processing unit, Mobile processing unit includes at least one front end calculator, and the front end calculator is used to carry out front end data computing;
Data transmission blocks, the data sending for the mobile processing platform to be obtained subsequently are calculated and connect to host computer Receive host computer order and be sent to the mobile processing platform;
Mobile power module, for powering for the three-dimensional scanning device.
2. wireless hand-held three-dimensional scanning device according to claim 1, it is characterised in that:The front end calculator from Extraction scanning target surface mark point and the 2D characteristics of surface point in image.
3. wireless hand-held three-dimensional scanning device according to claim 2, is further characterized in that:The front end calculator Three-dimensional reconstruction is carried out according to 2D characteristic data sets and obtains three-dimensional feature data set.
4. wireless hand-held three-dimensional scanning device according to claim 1, it is characterised in that:The mobile processing unit bag Real-time device parametric regulation and control module is included, realizes the real-time control for the quality for receiving image.
5. wireless hand-held three-dimensional scanning device according to claim 4, it is characterised in that:Real-time device parametric regulates and controls mould Block uses the statistic of the characteristic and characteristic, adjusts the control parameter of pattern projecting device;Above-mentioned parameter is led to The circuit being connected with mobile processing unit is crossed, controls pattern projecting device.
6. wireless hand-held three-dimensional scanning device according to claim 1, it is characterised in that:The mobile processing unit bag Include data compressing module.
7. wireless hand-held three-dimensional scanning device according to claim 6, it is characterised in that:The compression module is by described in The data that front end calculator obtains are merged into by compression algorithm can be in the structural data that host computer is reduced.
8. wireless hand-held three-dimensional scanning device according to claim 1, it is characterised in that:The mobile processing unit bag Dispatching control module is included, which realizes the whole scheduling of module and the control of mobile processing unit hardware state.
9. wireless hand-held three-dimensional scanning device according to claim 8, it is characterised in that:The dispatching control module according to Mobile processing unit is arranged to the plurality of operating modes of different power consumption according to the working status of modules.
10. wireless hand-held three-dimensional scanning device according to claim 1, it is characterised in that:The mobile processing list Member includes state receiving module, obtains status information of equipment, constitution equipment state data packets, periodically send to host computer.
11. wireless hand-held three-dimensional scanning device according to claim 10, it is characterised in that:The equipment state letter Breath includes equipment adjustment parameter, equipment for power information, battery information, device temperature information, device keys action message.
12. wireless hand-held three-dimensional scanning device according to claim 1, it is characterised in that:The mobile processing list Member includes equipment link control module.
13. wireless hand-held three-dimensional scanning device according to claim 12, it is characterised in that:The equipment connection control The Quick Response Code for including link information that molding block control camera shooting host computer provides, the corresponding host computer target of identification equipment, Then wired connection state is detected, reads the wirelessly or non-wirelessly connection that user setting realizes equipment and host computer.
14. wireless hand-held three-dimensional scanning device according to claim 1, it is characterised in that:The mobile processing unit The processing function is performed for carrier using some electronic chips, the electronic chip is used in CPU, GPU, ARM, FPGA, DSP The mode of at least one or more of combination is formed.
15. wireless hand-held three-dimensional scanning device according to claim 1, it is characterised in that:The data sending mould Block realizes the data exchange with host computer using wirelessly or non-wirelessly mode.
16. wireless hand-held three-dimensional scanning device according to claim 1, it is characterised in that:The data sending mould Block has wireless, wired two kinds of transmission modes concurrently, and the switching of two ways is realized by handover module.
17. wireless hand-held three-dimensional scanning device according to claim 1, it is characterised in that:The equipment further include with The associated portable display screen of equipment, display device status information and scan model image.
18. wireless hand-held three-dimensional scanning device according to claim 1, it is characterised in that:The mobile power module It is Smart Power Module, obtains the electricity of power supply, status data feature, by state receiving module in the host computer and portable Display screen is shown.
19. wireless hand-held three-dimensional scanning device according to claim 1, it is characterised in that:The mobile power module Using two kinds of powering modes of external power supply and battery, according to external power supply and battery status automatic switching apparatus power supply source.
20. wireless hand-held three-dimensional scanning device according to claim 1, it is characterised in that:The equipment further includes sound Frequency information feedback device, the abnormality of alarm equipment.
21. wireless hand-held three-dimensional scanning device according to claim 1, it is characterised in that:The mobile processing is put down Platform, data transmission blocks, mobile power module, image sensing apparatus, pattern projecting device are commonly mounted on a housing, structure Into complete equipment.
22. wireless hand-held three-dimensional scanning device according to claim 1, it is characterised in that:The mobile processing is put down Platform, data transmission blocks and mobile power module collectively constitute external handle box, image sensing apparatus, pattern projecting device and Corresponding sensor forms the front end minimized, and handle box is hung in user's clothing surface or pocket, by short-range soft Property cable with minimize front end be connected.
23. wireless hand-held three-dimensional scanning device according to claim 1, it is characterised in that:The mobile power mould Block is separately formed external power supply, mobile processing platform, data transmission blocks, image sensing apparatus, and pattern projecting device is pacified jointly On a housing, light-weighted equipment is formed.
24. wireless hand-held three-dimensional scanning device according to claim 1, it is characterised in that:This equipment connects with host computer Connect and form complete measuring system, host computer includes back end perspective reconstructing arrangement, 3 D spliced equipment, model generation device and mould Type presentation device.
CN201711431320.2A 2017-12-26 2017-12-26 A kind of wireless hand-held three-dimensional scanning device in acquisition object surface three-dimensional morphology Pending CN107976157A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711431320.2A CN107976157A (en) 2017-12-26 2017-12-26 A kind of wireless hand-held three-dimensional scanning device in acquisition object surface three-dimensional morphology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711431320.2A CN107976157A (en) 2017-12-26 2017-12-26 A kind of wireless hand-held three-dimensional scanning device in acquisition object surface three-dimensional morphology

Publications (1)

Publication Number Publication Date
CN107976157A true CN107976157A (en) 2018-05-01

Family

ID=62007578

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711431320.2A Pending CN107976157A (en) 2017-12-26 2017-12-26 A kind of wireless hand-held three-dimensional scanning device in acquisition object surface three-dimensional morphology

Country Status (1)

Country Link
CN (1) CN107976157A (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109900221A (en) * 2019-04-12 2019-06-18 杭州思看科技有限公司 A kind of handheld three-dimensional scanning system
CN110595388A (en) * 2019-08-28 2019-12-20 南京理工大学 A high dynamic real-time 3D measurement method based on binocular vision
CN110715618A (en) * 2019-09-29 2020-01-21 北京天远三维科技股份有限公司 A kind of dynamic three-dimensional scanning method and equipment
CN112129224A (en) * 2020-10-16 2020-12-25 集美大学 A binocular vision 3D scanning system
CN112890765A (en) * 2020-12-31 2021-06-04 深圳市菲森科技有限公司 Intraoral three-dimensional scanning device and method
CN114152213A (en) * 2021-11-15 2022-03-08 东南大学 Device and method for measuring rod model morphology characteristics by matching with handheld 3D scanner
EP4296614A1 (en) * 2022-06-24 2023-12-27 Faro Technologies, Inc. Line scanner having integrated processing capability
US12483625B2 (en) 2020-12-23 2025-11-25 Faro Technologies, Inc. Handheld scanner that transfers data and power over ethernet

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005003631A (en) * 2003-06-16 2005-01-06 Fuji Xerox Co Ltd Apparatus and method for measuring three-dimensional shape
US7256899B1 (en) * 2006-10-04 2007-08-14 Ivan Faul Wireless methods and systems for three-dimensional non-contact shape sensing
CN101853528A (en) * 2010-05-10 2010-10-06 沈阳雅克科技有限公司 Hand-held three-dimensional surface information extraction method and extractor thereof
US20120327218A1 (en) * 2011-06-21 2012-12-27 Microsoft Corporation Resource conservation based on a region of interest
US20130293684A1 (en) * 2011-04-15 2013-11-07 Faro Technologies, Inc. Three-dimensional coordinate scanner and method of operation
DE102013100177A1 (en) * 2013-01-09 2014-07-10 Joanneum Research Forschungsgesellschaft Mbh Method for creation of three-dimensional model of e.g. three-dimensional body, involves transmitting specific dimensional images to data processing system, and creating model on basis of dimensional images representing data
CN104165600A (en) * 2014-07-03 2014-11-26 杭州鼎热科技有限公司 Wireless hand-held 3D laser scanning system
CN105049664A (en) * 2015-08-12 2015-11-11 杭州思看科技有限公司 Method for light filling control of handheld three-dimensional laser scanner
CN204902788U (en) * 2015-08-12 2015-12-23 杭州思看科技有限公司 Handheld laser three -dimensional scanner with laser projection ware exposure time regulatory function
CN105222724A (en) * 2015-09-10 2016-01-06 北京天远三维科技有限公司 Multi-thread array laser 3 D scanning system and multi-thread array laser 3-D scanning method
CN205785108U (en) * 2016-06-08 2016-12-07 杭州非白三维科技有限公司 A kind of extendible miniature high-speed 3-D scanning module based on mobile platform and FPGA
WO2017061890A1 (en) * 2015-10-08 2017-04-13 3Divi Company Wireless full body motion control sensor
CN107111602A (en) * 2014-08-13 2017-08-29 C 3 有限公司 Log scanning system
CN107202554A (en) * 2017-07-06 2017-09-26 杭州思看科技有限公司 It is provided simultaneously with photogrammetric and 3-D scanning function hand-held large scale three-dimensional measurement beam scanner system
CN208125072U (en) * 2017-12-26 2018-11-20 天远三维(天津)科技有限公司 For obtaining the wireless hand-held three-dimensional scanning device of object surface three-dimensional morphology

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005003631A (en) * 2003-06-16 2005-01-06 Fuji Xerox Co Ltd Apparatus and method for measuring three-dimensional shape
US7256899B1 (en) * 2006-10-04 2007-08-14 Ivan Faul Wireless methods and systems for three-dimensional non-contact shape sensing
CN101853528A (en) * 2010-05-10 2010-10-06 沈阳雅克科技有限公司 Hand-held three-dimensional surface information extraction method and extractor thereof
US20130293684A1 (en) * 2011-04-15 2013-11-07 Faro Technologies, Inc. Three-dimensional coordinate scanner and method of operation
US20120327218A1 (en) * 2011-06-21 2012-12-27 Microsoft Corporation Resource conservation based on a region of interest
DE102013100177A1 (en) * 2013-01-09 2014-07-10 Joanneum Research Forschungsgesellschaft Mbh Method for creation of three-dimensional model of e.g. three-dimensional body, involves transmitting specific dimensional images to data processing system, and creating model on basis of dimensional images representing data
CN104165600A (en) * 2014-07-03 2014-11-26 杭州鼎热科技有限公司 Wireless hand-held 3D laser scanning system
CN107111602A (en) * 2014-08-13 2017-08-29 C 3 有限公司 Log scanning system
CN105049664A (en) * 2015-08-12 2015-11-11 杭州思看科技有限公司 Method for light filling control of handheld three-dimensional laser scanner
CN204902788U (en) * 2015-08-12 2015-12-23 杭州思看科技有限公司 Handheld laser three -dimensional scanner with laser projection ware exposure time regulatory function
CN105222724A (en) * 2015-09-10 2016-01-06 北京天远三维科技有限公司 Multi-thread array laser 3 D scanning system and multi-thread array laser 3-D scanning method
WO2017061890A1 (en) * 2015-10-08 2017-04-13 3Divi Company Wireless full body motion control sensor
CN205785108U (en) * 2016-06-08 2016-12-07 杭州非白三维科技有限公司 A kind of extendible miniature high-speed 3-D scanning module based on mobile platform and FPGA
CN107202554A (en) * 2017-07-06 2017-09-26 杭州思看科技有限公司 It is provided simultaneously with photogrammetric and 3-D scanning function hand-held large scale three-dimensional measurement beam scanner system
CN208125072U (en) * 2017-12-26 2018-11-20 天远三维(天津)科技有限公司 For obtaining the wireless hand-held three-dimensional scanning device of object surface three-dimensional morphology

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109900221A (en) * 2019-04-12 2019-06-18 杭州思看科技有限公司 A kind of handheld three-dimensional scanning system
CN110595388A (en) * 2019-08-28 2019-12-20 南京理工大学 A high dynamic real-time 3D measurement method based on binocular vision
CN110715618A (en) * 2019-09-29 2020-01-21 北京天远三维科技股份有限公司 A kind of dynamic three-dimensional scanning method and equipment
CN112129224A (en) * 2020-10-16 2020-12-25 集美大学 A binocular vision 3D scanning system
US12483625B2 (en) 2020-12-23 2025-11-25 Faro Technologies, Inc. Handheld scanner that transfers data and power over ethernet
CN112890765A (en) * 2020-12-31 2021-06-04 深圳市菲森科技有限公司 Intraoral three-dimensional scanning device and method
CN114152213A (en) * 2021-11-15 2022-03-08 东南大学 Device and method for measuring rod model morphology characteristics by matching with handheld 3D scanner
CN114152213B (en) * 2021-11-15 2023-12-26 东南大学 Device and method for measuring morphology features of rod type model by matching with handheld 3D scanner
EP4296614A1 (en) * 2022-06-24 2023-12-27 Faro Technologies, Inc. Line scanner having integrated processing capability

Similar Documents

Publication Publication Date Title
CN107976157A (en) A kind of wireless hand-held three-dimensional scanning device in acquisition object surface three-dimensional morphology
JP6429772B2 (en) 3D scanning and positioning system
CN108700939B (en) System and method for augmented reality
CN105222724B (en) Multi-thread array laser 3 D scanning system and multi-thread array laser 3-D scanning method
AU2018316381B2 (en) Systems and methods for analyzing cutaneous conditions
US6664531B2 (en) Combined stereovision, color 3D digitizing and motion capture system
CN104165600B (en) A kind of wireless handheld 3D laser scanning system
WO2019007180A1 (en) Handheld large-scale three-dimensional measurement scanner system simultaneously having photography measurement and three-dimensional scanning functions
CN110470238A (en) A kind of hand-held laser 3 d scanner, scan method and device
US20100134598A1 (en) Hand-held self-referenced apparatus for three-dimensional scanning
CN109900221A (en) A kind of handheld three-dimensional scanning system
CN107230224B (en) Three-dimensional virtual garment model production method and device
CN105867611A (en) Space positioning method, device and system in virtual reality system
CN206905709U (en) Hand-held large scale three-dimensional measurement scanner
CN114858086A (en) Three-dimensional scanning system, method and device
CN103340606B (en) Light switches human body three-dimensional scanning system and method for work thereof
CN114207473A (en) Support for at least one scanning device and space detection device with at least one scanning device
CN101109617A (en) A reverse measurement method and device based on axial stereo vision
CN208125072U (en) For obtaining the wireless hand-held three-dimensional scanning device of object surface three-dimensional morphology
CN210719062U (en) Tracking device and scanning system based on wireless synchronization
CN108759712A (en) The aviation luggage three-dimensional detection device of laser projection stereoscopic vision
EP4502531A1 (en) Three-dimensional scanning system, method and apparatus, and mobile computing module
CN118096858A (en) A method for measuring the phase distance between transformer bushings based on augmented reality technology
CN210719061U (en) Scanning device and scanning system based on wireless synchronization
CN115424300A (en) Method and equipment for measuring human body parameters

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180501

RJ01 Rejection of invention patent application after publication