CN111415405A - Three-dimensional high-precision vision measurement method for workpiece with high light-reflecting surface - Google Patents
Three-dimensional high-precision vision measurement method for workpiece with high light-reflecting surface Download PDFInfo
- Publication number
- CN111415405A CN111415405A CN202010182224.4A CN202010182224A CN111415405A CN 111415405 A CN111415405 A CN 111415405A CN 202010182224 A CN202010182224 A CN 202010182224A CN 111415405 A CN111415405 A CN 111415405A
- Authority
- CN
- China
- Prior art keywords
- images
- workpiece
- dimensional high
- precision
- processor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10028—Range image; Depth image; 3D point clouds
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
The invention discloses a three-dimensional high-precision vision measurement method for a high-reflection surface workpiece, which comprises the following steps of (1) setting a structured light projection brightness value interval [ L ]min,Lmax]The number of groups of the projection structured light is N; (2) sequentially projecting N groups, and shooting 2 × M brightness values in each group by using a 3D cameraWherein i is 0,1,2 …, N-1; (3) fusing the N groups of phase shift grating images into 1 group of 2 x M images by an image fusion method; (4) finally, reconstructing the fused 2 x M frame images into an accurate 3D point cloud picture of the object to be detected; wherein M and N are both positive integers. The invention has the advantages of: by means of high-speed structural light brightness sequential switching and high-speed image fusion, the problems of poor 3D point cloud reconstruction quality and low measurement precision caused by high reflection of light on the surface of a workpiece are solved.
Description
Technical Field
The invention relates to the field of 3D, in particular to a three-dimensional high-precision vision measurement method for a workpiece with a high light-reflecting surface.
Background
Three-dimensional measurement techniques have been widely used in (1) surveying and mapping projects, such as topographic survey, highway surveying and mapping, site surveying and mapping, and cultural relic repair; (2) national security, such as anti-terrorism, mobile reconnaissance, forest fire monitoring; (3) entertainment industries such as 3D game development, virtual reality; (4) reverse engineering; (5) product quality management and the like.
With the rapid development of modern manufacturing industry, the measurement and detection of high-speed high-precision 3D topography features of large-scale parts have gradually become a new direction of attention in the field of three-dimensional measurement, such as the three-dimensional measurement of profiles of large objects such as airplanes and engine blades in the field of aerospace, automobiles and ships in the field of transportation, which also puts higher requirements on the three-dimensional topography measurement.
Taking the automobile industry as an example, automobile part and whole automobile part manufacturers gradually improve the product quality control standard to meet the aggravation of industry competition and the severe requirements of the market on the product quality, and the manufacturers can accurately detect and measure the quality (including appearance, spatial form and position geometric dimension and the like) of each product, the existing three-dimensional measurement mainly comprises (1) an off-line measurement system represented by a three-coordinate measuring instrument, in a three-dimensional measurable spatial range, the three-coordinate measuring instrument detects a workpiece point by point according to a measuring head system and returns point data on the surface of the workpiece, and various geometric shapes, dimensions and the like are finally calculated through a software system.
The traditional technology has the following technical problems:
however, the existing 3D vision measurement technology and system based on structured light still have disadvantages, for example, when there is a severe reflected light on the surface of the workpiece to be measured, the detail features will be lost or the precision will be greatly reduced.
Disclosure of Invention
The invention aims to provide a three-dimensional high-precision vision measurement method for a workpiece with a high-reflection surface, a high-speed structural light brightness sequence switching and high-speed image fusion method, and solves the problems of poor 3D point cloud reconstruction quality and low measurement precision caused by high reflection of the surface of the workpiece.
In order to solve the technical problem, the invention provides a three-dimensional high-precision vision measurement method of a high-reflection surface workpiece, which comprises the following steps:
(1) setting the projection brightness value interval of the structured light [ L ]min,Lmax]The number of groups of the projection structured light is N;
(2) sequentially projecting N groups, and shooting 2 × M brightness values in each group by using a 3D cameraWherein i is 0,1,2 …, N-1;
(3) fusing the N groups of phase shift grating images into 1 group of 2 x M images by an image fusion method;
(4) finally, reconstructing the fused 2 x M frame images into an accurate 3D point cloud picture of the object to be detected;
wherein M and N are both positive integers.
In one embodiment, M is 12.
In one embodiment, the left and right cameras inside the 3D camera each take M pictures.
In one embodiment, in step (3), the images taken by the left camera inside the 3D camera are merged into M images, and the images taken by the right camera are merged into M images.
In one embodiment, the image fusion method employs an extreme learning machine.
In one embodiment, the image fusion method adopts a support vector machine or a back propagation method.
In one embodiment, in the step (4), the fused 24 frames of images are reconstructed into an accurate 3D point cloud picture of the object to be detected by a triangulation method.
Based on the same inventive concept, the present application also provides a computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of any of the methods when executing the program.
Based on the same inventive concept, the present application also provides a computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of any of the methods.
Based on the same inventive concept, the present application further provides a processor for executing a program, wherein the program executes to perform any one of the methods.
The invention has the beneficial effects that:
by means of high-speed structural light brightness sequential switching and high-speed image fusion, the problems of poor 3D point cloud reconstruction quality and low measurement precision caused by high reflection of light on the surface of a workpiece are solved.
Drawings
FIG. 1 is a flow chart of a three-dimensional high-precision vision measuring method of a high-reflectivity surface workpiece according to the invention.
Detailed Description
The present invention is further described below in conjunction with the following figures and specific examples so that those skilled in the art may better understand the present invention and practice it, but the examples are not intended to limit the present invention.
Aiming at a workpiece with a high-light-reflection surface, which kind of suitable brightness is difficult to determine to project light bars so as to obtain high-quality workpiece point cloud data, the invention provides a high-speed structural light brightness sequence switching and high-speed image fusion method, which comprises the following specific implementation steps (a specific flow chart is shown in fig. 1):
(1) setting the projection brightness value interval of the structured light [ L ]min,Lmax]The number of groups of the projection structured light is N;
(2) n sets of 24 shots (12 shots from each of the left and right cameras within the 3D camera) are projected sequentially with brightness values ofWherein i is 0,1,2 …, N-1.
(3) N groups of phase-shift grating images are fused into 1 group of 24 images (12 images shot by a left camera and 12 images shot by a right camera inside a 3D camera) by an image fusion method, wherein the fusion method adopts an Extreme learning Machine (E L M) method, and the fusion speed is thousands times of that of the most common methods such as Support Vector Machines (SVMs) and back propagation methods under the condition of equal fusion precision.
(4) And finally, reconstructing the fused 24 frames of images into an accurate 3D point cloud picture of the object to be detected by a triangular transformation method.
The above-mentioned embodiments are merely preferred embodiments for fully illustrating the present invention, and the scope of the present invention is not limited thereto. The equivalent substitution or change made by the technical personnel in the technical field on the basis of the invention is all within the protection scope of the invention. The protection scope of the invention is subject to the claims.
Claims (10)
1. A three-dimensional high-precision vision measurement method for a workpiece with a high-light-reflection surface is characterized by comprising the following steps:
(1) setting the projection brightness value interval of the structured light [ L ]min,Lmax]The number of groups of the projection structured light is N;
(2) sequentially projecting N groups, and shooting 2 × M brightness values in each group by using a 3D cameraWherein i is 0,1,2 …, N-1;
(3) fusing the N groups of phase shift grating images into 1 group of 2 x M images by an image fusion method;
(4) finally, reconstructing the fused 2 x M frame images into an accurate 3D point cloud picture of the object to be detected;
wherein M and N are both positive integers.
2. The method for three-dimensional high-precision visual measurement of highly reflective surface workpieces according to claim 1 wherein M is 12.
3. The method for three-dimensional high-precision vision measurement of a highly reflective surface workpiece according to claim 1, wherein M images are taken by each of left and right cameras inside the 3D camera.
4. The method for three-dimensional high-precision visual measurement of a workpiece with a highly reflective surface according to claim 1, wherein in step (3), the images taken by the left camera and the images taken by the right camera inside the 3D camera are merged into M images.
5. The method for three-dimensional high-precision visual measurement of a highly reflective surface workpiece according to claim 1, wherein the image fusion method employs an extreme learning machine.
6. The method for three-dimensional high-precision visual measurement of a highly reflective surface workpiece according to claim 1, wherein the image fusion method employs a support vector machine or a back propagation method.
7. The method for three-dimensional high-precision visual measurement of highly reflective surface workpieces according to claim 1, wherein in step (4), the fused 24 frames of images are reconstructed into an accurate 3D point cloud image of the object to be detected by a triangulation method.
8. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of any of claims 1 to 7 are implemented when the program is executed by the processor.
9. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.
10. A processor, characterized in that the processor is configured to run a program, wherein the program when running performs the method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010182224.4A CN111415405A (en) | 2020-03-16 | 2020-03-16 | Three-dimensional high-precision vision measurement method for workpiece with high light-reflecting surface |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010182224.4A CN111415405A (en) | 2020-03-16 | 2020-03-16 | Three-dimensional high-precision vision measurement method for workpiece with high light-reflecting surface |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111415405A true CN111415405A (en) | 2020-07-14 |
Family
ID=71492968
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010182224.4A Pending CN111415405A (en) | 2020-03-16 | 2020-03-16 | Three-dimensional high-precision vision measurement method for workpiece with high light-reflecting surface |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111415405A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113091647A (en) * | 2021-04-07 | 2021-07-09 | 韶关学院 | Structured light three-dimensional scanning method for workpiece with high light reflection surface |
| CN114219893A (en) * | 2021-12-15 | 2022-03-22 | 无锡图创智能科技有限公司 | Three-dimensional vision reconstruction method for cambered surface light-reflecting workpiece |
| CN115060198A (en) * | 2022-08-17 | 2022-09-16 | 无锡维度机器视觉产业技术研究院有限公司 | Omnibearing stereoscopic vision detection method for bright surface workpiece and application |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102261896A (en) * | 2011-04-19 | 2011-11-30 | 长春东瑞科技发展有限公司 | Method and system for measuring three-dimensional shape of object based on phase measurement |
| JP2012068176A (en) * | 2010-09-27 | 2012-04-05 | Panasonic Corp | Three-dimensional shape measuring apparatus |
| CN102721375A (en) * | 2012-06-20 | 2012-10-10 | 北京航空航天大学 | Multi-reflection inhibiting method in in-situ measurement of high reflection metal structural component |
| CN102937425A (en) * | 2012-10-18 | 2013-02-20 | 北京航空航天大学 | Measuring system of three-dimensional shape of strong reflecting surface based on high dynamic strip projector |
| CN103827626A (en) * | 2012-01-27 | 2014-05-28 | Ckd株式会社 | Three-dimensional measurement device |
| CN108195313A (en) * | 2017-12-29 | 2018-06-22 | 南京理工大学 | A kind of high dynamic range method for three-dimensional measurement based on Intensity response function |
-
2020
- 2020-03-16 CN CN202010182224.4A patent/CN111415405A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012068176A (en) * | 2010-09-27 | 2012-04-05 | Panasonic Corp | Three-dimensional shape measuring apparatus |
| CN102261896A (en) * | 2011-04-19 | 2011-11-30 | 长春东瑞科技发展有限公司 | Method and system for measuring three-dimensional shape of object based on phase measurement |
| CN103827626A (en) * | 2012-01-27 | 2014-05-28 | Ckd株式会社 | Three-dimensional measurement device |
| CN102721375A (en) * | 2012-06-20 | 2012-10-10 | 北京航空航天大学 | Multi-reflection inhibiting method in in-situ measurement of high reflection metal structural component |
| CN102937425A (en) * | 2012-10-18 | 2013-02-20 | 北京航空航天大学 | Measuring system of three-dimensional shape of strong reflecting surface based on high dynamic strip projector |
| CN108195313A (en) * | 2017-12-29 | 2018-06-22 | 南京理工大学 | A kind of high dynamic range method for three-dimensional measurement based on Intensity response function |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113091647A (en) * | 2021-04-07 | 2021-07-09 | 韶关学院 | Structured light three-dimensional scanning method for workpiece with high light reflection surface |
| CN114219893A (en) * | 2021-12-15 | 2022-03-22 | 无锡图创智能科技有限公司 | Three-dimensional vision reconstruction method for cambered surface light-reflecting workpiece |
| CN115060198A (en) * | 2022-08-17 | 2022-09-16 | 无锡维度机器视觉产业技术研究院有限公司 | Omnibearing stereoscopic vision detection method for bright surface workpiece and application |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107044833B (en) | A kind of ultrafast 3 D measuring method and its system based on improved Fourier transform outline technology | |
| CN103049896B (en) | The geometric data of three-dimensional model and data texturing autoregistration algorithm | |
| CN105006021B (en) | A kind of Color Mapping Approach and device being applicable to quickly put cloud three-dimensional reconstruction | |
| CN109816704A (en) | The 3 D information obtaining method and device of object | |
| CN109596059A (en) | A kind of aircraft skin gap based on parallel lines structure light and scale measurement method | |
| CN111415405A (en) | Three-dimensional high-precision vision measurement method for workpiece with high light-reflecting surface | |
| CN110702025B (en) | A grating type binocular stereo vision three-dimensional measurement system and method | |
| CN110672039A (en) | Object omnibearing three-dimensional measurement method based on plane reflector | |
| CN113888639B (en) | Visual odometer positioning method and system based on event camera and depth camera | |
| CN108036740A (en) | Three-dimensional colour measuring system and method during a kind of high-precision real based on various visual angles | |
| CN109443239A (en) | Structural light measurement method, apparatus, equipment, storage medium and system | |
| CN113450460A (en) | Phase-expansion-free three-dimensional face reconstruction method and system based on face shape space distribution | |
| CN102721375A (en) | Multi-reflection inhibiting method in in-situ measurement of high reflection metal structural component | |
| CN108986120A (en) | A kind of quick and reliable phase unwrapping algorithm | |
| CN102269575B (en) | Mapping-based phase matching method in vision measurement | |
| CN102679937A (en) | Ship steel plate dynamic three-dimension measurement method based on multi-camera vision | |
| CN103559710B (en) | A kind of scaling method for three-dimensional reconstruction system | |
| CN111982026A (en) | Grating projection three-dimensional measuring device and measuring method for high-reflection object curved surface | |
| CN111288929B (en) | Three-dimensional high-precision vision measurement method for workpiece with large curvature surface | |
| Zhang et al. | 3D reconstruction of coal pile based on visual scanning of bridge crane | |
| CN114719780A (en) | 3D measurement method of structured light projection on the surface of reflective objects based on deep learning | |
| Li et al. | Multi-state objects depth acquisition based on binocular structured light | |
| CN115993099B (en) | Method for measuring surface shape of large-caliber optical element based on multi-camera splicing deflection operation | |
| Rao et al. | A calibration method of a large FOV binocular vision system for field measurement | |
| CN118225001A (en) | Frequency-variable fringe encoding and decoding method, device and medium for fast three-dimensional measurement |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200714 |
|
| RJ01 | Rejection of invention patent application after publication |