[go: up one dir, main page]

WO2016039955A1 - Dispositif portable de mesure optique de coordonnées tridimensionnelles - Google Patents

Dispositif portable de mesure optique de coordonnées tridimensionnelles Download PDF

Info

Publication number
WO2016039955A1
WO2016039955A1 PCT/US2015/045843 US2015045843W WO2016039955A1 WO 2016039955 A1 WO2016039955 A1 WO 2016039955A1 US 2015045843 W US2015045843 W US 2015045843W WO 2016039955 A1 WO2016039955 A1 WO 2016039955A1
Authority
WO
WIPO (PCT)
Prior art keywords
arm
hand
carrying structure
held scanner
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2015/045843
Other languages
English (en)
Inventor
Axel Ruhland
Rolf Heidemann
Reinhard Becker
Martin Ossig
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Faro Technologies Inc
Original Assignee
Faro Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from DE102014013678.7A external-priority patent/DE102014013678B3/de
Priority claimed from DE102014013677.9A external-priority patent/DE102014013677B4/de
Priority claimed from DE102014113015.4A external-priority patent/DE102014113015B4/de
Priority claimed from US14/826,859 external-priority patent/US9671221B2/en
Application filed by Faro Technologies Inc filed Critical Faro Technologies Inc
Priority to GB1705409.9A priority Critical patent/GB2545603B/en
Publication of WO2016039955A1 publication Critical patent/WO2016039955A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G01B11/245—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures using a plurality of fixed, simultaneously operating transducers
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
    • G01B11/2545—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object with one projection direction and several detection directions, e.g. stereo
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/002—Measuring arrangements characterised by the use of optical techniques for measuring two or more coordinates
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/189—Recording image signals; Reproducing recorded image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance

Definitions

  • the subject matter disclosed herein relates to a portable scanner, and in particular to a portable scanner having a display.
  • a portable scanner includes a projector that projects light patterns on the surface of an object to be scanned.
  • the position of the projector is determined by means of a projected, encoded pattern.
  • Two (or more) cameras, the relative positions and alignment of which are known or are determined, can record images of the surface with a further, uncoded pattern.
  • the three-dimensional coordinates (of the points of the pattern) can be determined by means of mathematical methods which are known per se, such as epipolar geometry.
  • scanners are known as tracking devices, in which a projector projects an encoded light pattern onto the target to be pursued, preferably the user who is playing, in order to then record this encoded light pattern with a camera and to determine the coordinates of the user.
  • the data are represented on an appropriate display.
  • a system for scanning a scene may include, in its most simplest form, a camera unit with two cameras, and illumination unit and a synchronizing unit.
  • the cameras which may optionally include filters, are used for the stereoscopic registration of a target area.
  • the illumination unit is used for generating a pattern in the target area, such as by means of a diffractive optical element.
  • the synchronizing unit synchronizes the illumination unit and the camera unit.
  • Camera unit and illumination unit can be set up in selectable relative positions.
  • two camera units or two illumination units can be used.
  • a hand-held scanner for producing 3D scans of an object in the environment if provided.
  • the scanner includes a carrying structure having a front side and a reverse side, the carrying structure having a first arm, a second arm and a third arm arranged in a T-shape or a Y-shape.
  • a housing is coupled to the reverse side having a handle, the handle being positioned opposite the carrying structure, the housing and carrying structure defining an interior space.
  • At least one projector is configured to project at least one pattern on the object, the at least one projector being positioned within the interior space and oriented to project the at least one pattern from the front side.
  • At least two cameras are provided spaced apart from each other, the at least two cameras being configured to record images of the object, the at least two cameras being disposed within the interior space and oriented to record images through the front side, the at least two cameras and the at least one projector being spaced apart by a pre-determined distance from each other by the carrying structure.
  • FIG. 1 shows a perspective view of a hand-held scanner and of an object in the environment
  • Fig. 2 shows a view of the front side of the hand-held scanner
  • FIG. 3 shows a view of the reverse side of the hand-held scanner
  • Fig. 4 shows a top view of the hand-held scanner from above
  • Fig. 5 shows a view of the hand-held scanner from the right side
  • Fig. 6 shows a perspective view corresponding to Fig. 1 without housing
  • Fig. 7 shows a representation of the control and evaluation device with display
  • Fig. 8 shows a representation corresponding to Fig. 7, with a smaller scale of the video image
  • FIG. 9 shows a representation of the control and evaluation device with display in accordance with another embodiment.
  • Fig. 10 is a computer generated image of the display of Fig. 7 or Fig. 9.
  • the carrying structure is stable mechanically and thermally, defines the relative distances and the relative alignments of a camera and of a projector.
  • the arrangement on a front side of the 3D measuring device faces on the environment, has the advantage that these distances and alignments are not changed by a change of the shape of a housing.
  • the term "projector” is defined to generally refer to a device for producing a pattern.
  • the generation of the pattern can take place by means of deflecting methods, such as generation by means of diffractive optical elements or micro-lenses (or single lasers), or by shading methods, for example the production by means of shutters, transparencies (as they would be used in a transparency projector) and other masks.
  • deflecting methods have the advantage of less light getting lost and consequently a higher intensity being available.
  • a corresponding number of arms of the carrying structure is provided, which protrude from a common center located at the intersection of the arms.
  • the assemblies which may include a combination of cameras and projectors, are provided in the area of the ends of the assigned arms.
  • the assemblies may be arranged each on the reverse side of the carrying structure. Their respective optics are directed through an assigned aperture in the carrying structure, so that the respective assemblies are operably oriented to face towards the environment from the front side.
  • a housing covers the reverse side and forms the handle part.
  • the carrying structure consists of a carbon-reinforced or a glass-fiber-reinforced matrix of synthetic material or ceramics (or of another material).
  • the material provides for stability and a low weight and can, at the same time, be configured with viewing areas.
  • a concave (spherical) curvature of the front side of the carrying structure does not only have constructive advantages, but it also protects the optical components arranged on the front side when the front surface of the 3D measuring device is placed on a work surface.
  • the projector produces the projected pattern, which may or may not be within the visible wavelength range.
  • the projected pattern has a wavelength in the infrared range.
  • the two cameras are configured to acquire images from light within this wavelength range, while also filtering out scattered light and other interferences in the visible wavelength range.
  • a color or 2D camera can be provided as third camera for additional information, such as color for example.
  • Such camera records images of the environment and of the object being scanned.
  • the point cloud generated from the scanning process (herein referred to as the "3D-scan”) can have color values assigned from the color information contained in the color images.
  • the 3D measuring device During operation the 3D measuring device generates multiple 3D scans of the same scene, from different positions.
  • the 3D scans are registered in a joint coordinate system.
  • For joining two overlapping 3D scans there are advantages in being able to recognizable structures within the 3D scans.
  • such recognizable structures are looked for and displayed continuously or, at least after the recording process. If, in a determined area, density is not at a desired level, further 3D scans of this area can be generated.
  • a subdivision of the display used for representing a video image and the (thereto adjacent parts of the) three-dimensional point cloud helps to recognize, in which areas scan should still be generated.
  • the 3D measuring device is designed as a portable scanner, i.e. it works at high speed and is of a size and weight suitable for carrying and use by a single person. It is, however, also possible to mount the 3D measuring device on a tripod (or on another stand), on a manually movable trolley (or another cart), or on an autonomously moving robot, i.e. that it is not carried by the user - optionally also by using another housing, for example without a carrying handle. It should be appreciated that while embodiments herein describe the 3D measuring device as being hand-held, this is for exemplary purposes and the claimed invention should not be so limited. In other embodiments, the 3D measuring device may also be configured as a compact unit, which are stationary or mobile and, if appropriate, built together with other devices.
  • a 3D measuring device 100 is provided as portable part of a device for optically scanning and measuring an environment of the 3D measuring device 100 with objects O.
  • the side of the device 100 which faces the user shall be referred to as the reverse side, and the side of the device 100 which faces the environment as the front side.
  • This definition extends to the components of the 3D measuring device 100.
  • the 3D measuring device 100 is provided (on its front side) visibly with a carrying structure 102 having three arms 102a, 102b, 102c. These arms give the carrying structure 102 a T-shape or a Y-shape, i.e. a triangular arrangement.
  • the carrying structure 102 is provided with a left arm 102a, a right arm 102b and a lower arm 102c.
  • the angle between the left arm 102a and the right arm 102b is, for example, approximately 150° + 20°, between the left arm 102a and the lower arm 102c approximately 105° + 10°.
  • the lower arm 102c is, in some embodiments, somewhat longer than the two other arms 102a, 102b.
  • the carrying structure 102 preferably is configured from fiber-reinforced synthetic material, such as a carbon-fiber-reinforced synthetic material (CFC).
  • CFC carbon-fiber-reinforced synthetic material
  • the carrying structure 102 is made from carbon-fiber-reinforced ceramics or from glass-fiber-reinforced synthetic material.
  • the material renders the carrying structure 102 mechanically and thermally stable and provides at the same time for a low weight.
  • the thickness of the carrying structure 102 is considerably smaller (for example 5 to 15 mm) than the length of the arms 102a, 102b, 102c (for example 15 to 25 cm).
  • the carrying structure 102 hence has a flat basic shape.
  • the arms 102a, 102b, 102c may include a reinforced back near the center of the arm. It is, however, preferably not configured to be plane, but to be curved. Such curvature of the carrying structure 102 is adapted to the curvature of a sphere having a radius of approximately 1 to 3 m.
  • the front side (facing the object 0) of the carrying structure 102 is thereby configured to be concave, the reverse side to be convex.
  • the curved shape of the carrying structure 102 is advantageous for providing stability.
  • the front side of the carrying structure 102 (and in one embodiment the visible areas of the reverse side) is configured to be a viewing area, i.e. it is not provided with hiders, covers, cladding or other kinds of packaging.
  • the preferred configuration from fiber- reinforced synthetic materials or ceramics is particularly suitable for this purpose.
  • a housing 104 is arranged, which is connected with the carrying structure 102 within the area of the ends of the three arms 102a, 102b, 102c in a floating way, by means of appropriate connecting means, for example by means of rubber rings and screws with a bit of clearance.
  • a floating connection is one that reduces or eliminates the transmission of vibration from the housing 104 to the carrying structure 102.
  • the floating connection is formed by a rubber isolation mount disposed between the housing 104 and the carrying structure.
  • an elastomeric seal such as rubber, is disposed between the outer perimeter of the carrying structure 102 and the housing 104.
  • the carrying structure 102 and the housing 104 are then clamped together using elastomeric bushings.
  • the seal and bushings cooperate to form the floating connection between the carrying structure 102 and the housing 104.
  • the edge of the housing 104 extends into the immediate vicinity of the carrying structure 102, while the housing 104 extends from the center of the 3D measuring device 100 within the area of the lower arm 102c, at a distance to the carrying structure 102, forming a handle part 104g, bends off at the end of the handle part 104g and approaches the end of the lower arm 102c, where it is connected with it in a floating manner.
  • sections of the carrying structure 102 may include a reinforced back 102r.
  • the back 102r protrudes into the interior of the housing 104.
  • the housing 104 acts as a hood to cover the reverse side of the carrying structure 102 and define an interior space.
  • the protective elements 105 may be attached to the housing 104 or to the carrying structure 102.
  • the protective elements 105 are arranged at the ends of and extend outward from the arms 102a, 102b, 102c to protect the 3D measuring device from impacts and from damage resulting thereof.
  • the 3D measuring device 100 can be put down with its front side to the bottom. Due to the concave curvature of the front side, on the 3D measuring device will only contact the the surface at the ends of the arms 102a, 102b, 102c.
  • advantages are gained since the protective elements
  • the protective elements 105 will provide additional clearance with the surface. Furthermore, when the protective elements 105 are made from a soft material for example from rubber, this provides a desirable tactile feel for the user's hand. This soft material can optionally be attached to the housing 104, particularly to the handle part 104g.
  • an control actuator or control knob 106 is arranged on the housing 104, by means of which at least optical scanning and measuring, i.e. the scanning process, can be started and stopped.
  • the control knob 106 is arranged in the center of the housing 104 adjacent one end of the handle. The control knob
  • the control knob 106 may be multi-functional and provide different functions based on a sequence of actions by the user. These actions may time based (e.g. multiple button pushed within a predetermined time), or space based (e.g. the button moved in a predetermined set of directions), or a combination of both.
  • the control knob 106 may be tilted in several directions in (e.g. left, right, up, down).
  • around the control knob 106 there are at least one status lamp 107.
  • the status lamps 107 can preferably show different colors (for example green or red) in order to distinguish several status'.
  • the status lamps 107 may be light emitting diodes (LEDs).
  • a first camera 111 is arranged on the left arm 102a (in the area of its end), and a second camera 112 is arranged on the right arm 102b (in the area of its end).
  • the two cameras 111 and 112 are arranged on the reverse side of the carrying structure 102 and fixed thereto, wherein the carrying structure 102 is provided with apertures through which the respective camera 111, 112 can acquire images through the front side of the carrying structure 102.
  • the two cameras 111, 112 are preferably surrounded by the connecting means for the floating connection of the housing 104 with the carrying structure 102.
  • Each of the cameras 111, 112 have a field of view associated therewith.
  • the alignments of the first camera 111 and of the second camera 112 to each other are adjusted or adjustable in such a way that the fields of view overlap to allow stereoscopic images of the objects O. If the alignments are fixed, there is a desired predetermined overlapping range, depending on the application in which the 3D measuring device 100 is used. Depending on environment situations, also a range of several decimeters or meters may be desired.
  • the alignments of the cameras 111, 112 can be adjusted by the user, for example by pivoting the cameras 111, 112 in opposite directions. In one embodiment, the alignment of the cameras 111, 112 is tracked and therefore known to the 3D measuring device 100.
  • the alignment is initially at random (and unknown), and is then determined, such as be measuring the positions of the camera's for example, and thus known to the 3D measuring device 100.
  • the alignment is set and fixed during manufacturing or calibration of the 3D measurement device 100.
  • the first camera 111 and the second camera 112 are preferably monochrome, i.e. sensitive to a narrow wavelength range, for example by being provided with corresponding filters, which then filter out other wavelength ranges, including scattered light. This narrow wavelength range may also be within the infrared range.
  • the 3D measuring device 100 preferably includes a 2D camera, such as color camera 113 which is preferably aligned symmetrically to the first camera 111 and to the second camera 112, and arranged in the center of the 3D measuring device 100, between the cameras 111, 112.
  • the 2D camera 113 may include an image sensor that is sensitive to light in the visible wavelength range.
  • a light source such as four (powerful) light-emitting diodes (LED) 114 are provided.
  • One radiating element 115 is associated with each of the LEDs 114.
  • the light emitted from the light-emitting diode 114 is deflected in correspondence with the alignment of the 3D measuring device 100, from the corresponding LED 114.
  • Such a radiating element 115 can, for example, be a lens or an appropriately configured end of a light guide.
  • the (in the illustrated embodiment four) radiating elements 115 are arranged equally around the color camera 113.
  • Each LED 114 is connected with the assigned radiating element 115 by means of one light guide each.
  • the LED 114 therefore can be structurally arranged at a control unit 118 of the 3D measuring device 100, such as by being fixed on a board thereof.
  • a sensor such as an inclinometer 119 is provided.
  • the inclinometer 119 is an acceleration sensor (with one or several sensitive axes), which is manufactured in a manner known per se, as MEMS (micro-electro-mechanical system).
  • MEMS micro-electro-mechanical system
  • inclinometer 119 also other embodiments and combinations are possible.
  • the data of the 3D measuring device 100 each have (as one component) a gravitation direction provided by the inclinometer 119.
  • images are recorded by the first camera 111 and by the second camera 112. From these images three-dimensional data can be determined, i.e. 3D- scans of the objects O can be produced, for example by means of photogrammetry.
  • the objects O may have few structures or features and many smooth surfaces. As a result, the generation of 3D-scans from the scattered light of the objects O is difficult.
  • a projector 121 may be used, which is arranged at the lower arm 102c (in the area of its end).
  • the projector 121 is arranged within the interior space on the reverse side of the carrying structure 102 and fixed thereto.
  • the carrying structure 102 is provided with an aperture through which the projector 121 can project a pattern of light through the front side of the carrying structure 102.
  • the projector 121 is surrounded by the connecting means to provide a floating connection between the housing 104 with the carrying structure 102.
  • the projector 121, the first camera 111, and the second camera 112 are arranged in a triangular arrangement with respect to each other and aligned to the environment of the 3D measuring device 100.
  • the projector 121 is aligned in correspondence with the two cameras 111, 112.
  • the relative alignment between the cameras 111, 112 and the projector 121 is preset or can be set by the user.
  • the cameras 111, 112 and the projector 121 form an equilateral triangle and have a common tilt angle.
  • the centers of the field of view will intersect at a common point at a particular distance from the scanner 100. This arrangement allows for a maximum amount of overlap to be obtained.
  • the tilt or angle of the cameras 111, 112 and projector 121 may be adjusted, the distance or range to the intersection of the fields of view may be changed.
  • the concave curvature of the front side creates a gap between the cameras 111, 112, 113 and the projector 121 from the surface, so that the respective lenses are protected from damage.
  • the cameras 111, 112, 113, the projector 121, the control knob 106, the status lamps 107, the light-emitting diodes 114 and the inclinometer 119 are connected with the common control unit 118, which is arranged inside the housing 104.
  • This control unit 118 can be part of a control and evaluation device which is integrated in the housing.
  • control unit 118 is connected with a standardized communication interface at the housing 104, the interface being configured for a wireless connection (for example Bluetooth, WLAN, DECT) as an emitting and receiving unit, or for a cable connection (for example USB, LAN), if appropriate also as a defined interface, such as that described in DE 10 2009 010 465 B3, the contents of which are incorporated by reference herein.
  • the communication interface is connected with an external control and evaluation device 122 (as a further component of the device for optically scanning and measuring an environment of the 3D measuring device 100), by means of said wireless connection or connection by cable.
  • the communication interface is configured for a connection by cable, wherein a cable 125 is plugged into the housing 104, for example at the lower end of the handle part 104g, so that the cable 125 extends in prolongation of the handle part 104g.
  • the control and evaluation device 122 may include one or more processors 122a to carry out the methods for operating and controlling the 3D measuring device 100 and evaluating the measured data.
  • the control and evaluation device 122 may be a portable computer (notebook) or a tablet (or smartphone) such as that shown in FIGS. 7 and 8, or any external or distal computer (e.g. in the web).
  • the control and evaluation device 122 may also be configured in software for controlling the 3D measuring device 100 and for evaluating the measured data.
  • the control and evaluation device 122 may be embodied in separate hardware, or it can be integrated into the 3D measuring device 100.
  • the control and evaluation device 122 may also be a system of distributed components, at least one component integrated into the 3D measuring device 100 and one component externally. Accordingly, the processor(s) 122a for performing said methods may be embedded in the 3D measuring device 100 and/or in an external computer.
  • the projector 121 projects a pattern X, which it produces, for example by means of a diffractive optical element, on the objects to be scanned.
  • the pattern X does not need to be encoded (that is to say single-valued), but it is preferably uncoded, for example periodically, that is to say multivalued.
  • the multi-valuedness is resolved by the use of the two cameras 111, 112, combined with the available, exact knowledge of the shape and direction of the pattern.
  • the uncoded pattern X is preferably a point pattern, comprising a regular arrangement of points in a grid. In the present invention, for example, approximately one hundred times one hundred points are projected at an angle of approximately 50° to a distance of approx. 0.5 m to 5 m.
  • the pattern X can also be a line pattern or a combined pattern of points and lines, each of which is formed by tightly arranged light points.
  • the projector 121 may produce the two patterns offset to each other with respect to time or in another wavelength range or with different intensity.
  • the other pattern may be a pattern which deviates from pattern X, such as an uncoded pattern.
  • the pattern is a point pattern with a regular arrangement of points having another distance (grid length) to each other.
  • the projector 121 produces the pattern X on the objects O only, when the cameras 111 and 112 (and if available 113) record images of the objects O which are provided with the pattern X.
  • the two cameras 111, 112 and the projector 121 are synchronized, i.e. coordinated internally with each other, with regard to both, time and the pattern X used.
  • Each recording process starts by the projector 121 producing the pattern X, similar to a flash in photography, and the cameras 111 and 112 (and, if available 113) following with their records, more particularly their pairs of records (frames), i.e. one image each from each of the two cameras 111, 112.
  • the recording process can comprise one single frame (shot), or a sequence of a plurality of frames (video). Such a shot or such a video is triggered by means of the control knob 106.
  • each frame then constitutes a 3D-scan, i.e. a point cloud in the three-dimensional space, in relative coordinates of the 3D measuring device 100.
  • the data furnished by the 3D measuring device 100 are processed in the control and evaluation device 122, i.e. the 3D scans are generated from the frames.
  • the 3D scans in turn are joined, i.e. registered in a joint coordinate system.
  • the known methods can be used, i.e. natural or artificial targets (i.e.
  • the control and evaluation device 122 is provided with a display 130 (display device), which is integrated or connected externally.
  • One embodiment of the display 130 shown in Fig. 7 illustrates a subdivided image or subdivided screen.
  • the display 130 is divided into a first display part 130a and a second display part 130b.
  • the first display part 130a is a (rectangular) central part of the display 130
  • the second display part 130b is a peripheral area around the first display part 130a.
  • the two display parts may be columns.
  • the first display part 130a is shown as having a rectangular shape, however this is for exemplary purposes and the claimed invention should not be so limited.
  • the first display part 130a may have other shapes, including but not limited to circular, square, trapezoid (Fig. 10), trapezium, parallelogram, oval, triangular, or a polygon having any number of sides. In one embodiment, the shape of the first display part 130a is user defined or selectable.
  • a video live image VL is displayed, such as that captured by 2D camera 113 for example.
  • an image of the latest 3D scan (or a plurality of 3D scans that have been registered) is displayed as at least part of a view of the three-dimensional point cloud 3DP.
  • the size of the first display part 130a may be variable, and the second display part 130b is arranged in the area between the first display part 130a and the border 131 of the display 130.
  • video live image VL changes, such as when the user moves the device 100, the image of the three-dimensional point cloud 3DP changes correspondingly to reflect the change in position and orientation of the device 100.
  • the placement of the image of the three- dimensional point cloud 3DP around the periphery of the video live image VL provides advantages in allowing the user to easily see where additional scanning may be required without taking their eyes off of the display 130.
  • Fig. 9 it can be seen that during a scanning operation some areas, such as areas 140, 142 have a high density of points that allow for a representation of an object at a desired accuracy level.
  • FIG. 10 illustrates a computer generated image of a scanning process
  • the image acquired by the camera 113 is a two-dimensional (2D) image of the scene.
  • a 2D image that is rendered into a three-dimensional view will typically include a pincushion- shaped or barrel-shaped distortion depending on the type of optical lens used in the camera.
  • FOV field of view
  • the image of the three-dimensional point cloud data may appear distorted depending on how the image is processed for the display.
  • the point cloud data 3DP may be viewed as a planar view where the image is obtained in the native coordinate system of the scanner (e.g. a spherical coordinate system) and mapped onto a plane.
  • the images within the first display part 130a appear to be similar to that in the second display part 130b to provide a continuous and seamless image experience for the user.
  • the image of three-dimensional point cloud 3DP is significantly distorted, it may make it difficult for the user to determine which areas could use additional scanning.
  • the planar image of the point cloud data 3DP could be distorted relative to the 2D camera image, one or more processing steps may be performed on the image generated from the point cloud data 3DP.
  • the field of view (FOV) of the second display part 130b is limited so that only the central portion of the planar image is shown. In other words, the image is truncated or cropped to remove the highly distorted portions of the image.
  • the distortion is limited and the planar view of the point cloud data 3DP will appear as desired to the user.
  • the planar view is processed to scale and shift the planar image to provide to match the camera 113 image in the first display part 130a.
  • the three-dimensional point cloud data 3DP is processed to generate a panoramic image.
  • panoramic refers to a display in which angular movement is possible about a point in space (generally the location of the user).
  • a panoramic view does not incur the distortions at the poles as is the case with a planar view.
  • the panoramic view may be a spherical panorama that includes 360 degrees in the azimuth direction and +/- 45 degrees ion the zenith.
  • the spherical panoramic view may be only a portion of a sphere.
  • the point cloud data 3DP may be processed to generate a 3D display.
  • a 3D display refers to a display in which provision is made to enable not only rotation about a fixed point, but also translational movement from point to point in space. This provides advantages in allowing the user to move about the environment and provide a continuous and seamless display between the first display part 130a and the second display part 130b.
  • the video live image VL in the first display part 130a and the image of the three-dimensional point cloud 3DP in the second display part 130b match together seamlessly and continuously (with respect to the displayed contents).
  • a part of the three-dimensional point cloud 3DP is first selected (by the control and evaluation device 122) in such a way, as it is regarded from the perspective of the 2D camera 113 or at least from a position aligned with the 2D camera 113. Then, the selected part of the three-dimensional point cloud 3DP is selected in such a way that it adjoins continuously the video live image VL.
  • the displayed image of the three-dimensional point cloud 3DP becomes a continuation of the video live image VL for the areas beyond the field of view of the 2D camera 113 on the left, on the right, top and bottom relative to the field of view of the 2D camera).
  • the selected portion of the three-dimensional point cloud 3DP may be processed to reduce or eliminate distortions.
  • the representation may correspond to the representation of a fish-eye lens, but preferably it is undistorted. The part of the three-dimensional point cloud 3DP which is located in the area occupied by the first display part 130a, in other words the portion beneath or hidden by the video live image VL, is not displayed.
  • the density of the points in the three-dimensional point cloud 3DP in the area where the first display part 130a is located will not be visible to the user.
  • the video live image VL is displayed using the natural coloring.
  • the coloring of the video live image VL may be changed artificially such as by overlaying for example.
  • the artificial color (and, if appropriate, the intensity) used for representing the artificially colored video live image VL corresponds to the density of the points.
  • a green coloring to the video live image VL may indicate a (sufficiently) high density while a yellow coloring may be used to indicate a medium or low point density (e.g. areas which still the scan data can be improved).
  • the distant-depending precision of the data points could be displayed using this color-coding.
  • flags or marks 133 may be inserted in the first display part 130a to indicate structures (i.e. possible targets) recognized by the control and evaluation device 122.
  • the marks 133 may be a symbol, such as a small "x" or "+” for example.
  • the recognizable structures can be points, corners, edges or textures of objects.
  • the recognizable structures may be found by the latest 3D scan or the video live image VL being subjected to the beginning of the registering process (i.e. to the localization of targets). The use of the latest video live image VL provides advantages in that the registration process does not have to be performed as frequently.
  • the marks 133 have a high density, it is considered to be a successful registration of the 3D scans. If, however, a lower density of the marks 133 is recognized, additional 3D scans may be performed using a relatively slow movement of the 3D measuring device 100. By slowing the movement of the device 100 during the scan, additional or higher density points may be acquired. Correspondingly, the density of the marks 133 may be used as a qualitative measure for the success of the registration. Similarly, the density of the points of the three- dimensional point cloud 3DP may be used to indicate a successful scan. As discussed above, the density of points in the scan may be represented by the artificial coloring of the video live image VL.
  • the movement of the 3D measuring device 100 and processing of the captured frames may also be performed by a tracking function, i.e. the 3D measuring device 100 tracks the relative movement of its environment with the methods used during tracking. If tracking gets lost, for example, if the 3D measuring device 100 has been moved too fast, there is a simple possibility of reassuming tracking.
  • the video live image VL as it is provided by the 2D camera 113 and the last video still image from tracking provided by it may be represented adjacent to each other in a side by side arrangement on the display 130 for the user. The user may then move the 3D measuring device 100 until the two video images coincide.
  • the 3D measuring device 100 may be controlled based on movements of the device 100. These movements or gestures by the user can also be used for controlling the representation of the video image VL or of the three-dimensional point cloud 3DP.
  • the scale of representation of the video image VL and/or of the three-dimensional point cloud 3DP on the display 130 may depend on the speed and/or acceleration of the movement of the 3D measuring device 100.
  • scale is defined as the ratio between the size (either linear dimension or area) of the first display part 130a and the size of the complete display 130, being denoted as a percentage.
  • a small field of view of the 2D camera 113 is assigned to a small scale.
  • this first display part 130a then may be of smaller size than in the standard case, and the second display part 130b (about the periphery of the first display part 130a) shows a bigger part of the three-dimensional point cloud 3DP.
  • a larger field of view is assigned to a large scale.
  • the video live image VL may fill the whole display 130.
  • the scale of the representation may be configured smaller than with low speeds and vice versa. Similarly, this may apply to accelerations of the movement of the 3D measuring device 100. For example, the scale of the displayed image is reduced in the case of positive accelerations, and the scale is increased in the case of negative accelerations.
  • the scale may also depend on a component of the speed and/or acceleration of the movement of the 3D measuring device 100, for example on a component which is arranged perpendicular or parallel to the alignment of the 3D measuring device 100. If the scale is determined based on a component of the movement, parallel to the alignment (i.e. in the direction of the alignment), the scale can also be made dependent on the change of an average distance to objects O from the 3D measuring device 100.
  • the change of the scale due to movement, a standstill of the movement of the 3D measuring device 100 or a threshold speed of movement value not being achieved can be used to record a sequence of still images of the camera 113 with a low dynamic range. These images may be captured at low dynamic range but with different exposure times or illumination intensities within the sequence to generate a high dynamic range image therefrom.
  • the direction of gravity may be defined at the beginning of the registration process by a defined movement of the 3D measuring device 100. This defined movement is carried out by the user by moving the device 100 in a vertical upward and downward movement for example.
  • the direction of gravity may be determined from a set of statistics of all movements during the registration process.
  • a plane may be averaged from the coordinates of the positions taken by the device 100 while recording process along a path of movement through space. It is assumed that the averaged plane is located horizontally in space, meaning that the direction of gravity is perpendicular to it. As a result, the use of inclinometer 119 for determining the direction of gravity may be avoided.
  • the evaluation of the coordinates of the positions may also be used for determining the kind of scene and, if appropriate, to offer different representations or operating possibilities.
  • a path of movement around a center location suggests an image of a single object O (object-centered image).
  • a path of movement that orients the device 100 towards the outside makes reference to an image of rooms.
  • an image of a floor plan top view may be inserted into the display 130.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

L'invention concerne un dispositif permettant d'effectuer un balayage et d'obtenir des coordonnées tridimensionnelles. Le dispositif peut être un dispositif de balayage portatif qui comprend une structure de support comportant un côté avant et un côté arrière, la structure de support comportant un premier bras, un deuxième bras et un troisième bras agencés suivant une configuration en T ou une configuration en Y. Un boîtier est accouplé au côté arrière, une poignée est positionnée en face de la structure de support, le boîtier et la structure de support définissant un espace intérieur. Au moins un projecteur est configuré pour projeter au moins un motif sur un objet, le projecteur étant placé à l'intérieur de l'espace intérieur et orienté de façon à projeter le ou les motifs à partir du côté avant. Au moins deux caméras sont placées de manière espacée l'une vis-à-vis de l'autre, les caméras étant configurées pour enregistrer des images de l'objet. Les caméras et le projecteur sont espacés les uns des autres d'une distance prédéterminée.
PCT/US2015/045843 2014-09-10 2015-08-19 Dispositif portable de mesure optique de coordonnées tridimensionnelles Ceased WO2016039955A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
GB1705409.9A GB2545603B (en) 2014-09-10 2015-08-19 A portable device for optically measuring three-dimensional coordinates

Applications Claiming Priority (14)

Application Number Priority Date Filing Date Title
DE102014013678.7A DE102014013678B3 (de) 2014-09-10 2014-09-10 Verfahren zum optischen Abtasten und Vermessen einer Umgebung mit einem Handscanner und Steuerung durch Gesten
DE102014113015.4 2014-09-10
DE102014013677.9A DE102014013677B4 (de) 2014-09-10 2014-09-10 Verfahren zum optischen Abtasten und Vermessen einer Umgebung mit einem Handscanner und unterteiltem Display
DE102014013677.9 2014-09-10
DE102014013678.7 2014-09-10
DE102014113015.4A DE102014113015B4 (de) 2014-09-10 2014-09-10 Vorrichtung zum optischen Abtasten und Vermessen einer Umgebung, umfassend einen Handscanner mit Tragestruktur
US201562161461P 2015-05-14 2015-05-14
US62/161,461 2015-05-14
US14/712,993 2015-05-15
US14/712,993 US10070116B2 (en) 2014-09-10 2015-05-15 Device and method for optically scanning and measuring an environment
US14/722,219 US9769463B2 (en) 2014-09-10 2015-05-27 Device and method for optically scanning and measuring an environment and a method of control
US14/722,219 2015-05-27
US14/826,859 2015-08-14
US14/826,859 US9671221B2 (en) 2014-09-10 2015-08-14 Portable device for optically measuring three-dimensional coordinates

Publications (1)

Publication Number Publication Date
WO2016039955A1 true WO2016039955A1 (fr) 2016-03-17

Family

ID=55459413

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2015/045843 Ceased WO2016039955A1 (fr) 2014-09-10 2015-08-19 Dispositif portable de mesure optique de coordonnées tridimensionnelles

Country Status (2)

Country Link
GB (1) GB2545603B (fr)
WO (1) WO2016039955A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018096116A1 (fr) 2016-11-28 2018-05-31 Centre National De La Recherche Scientifique (Cnrs) Systeme et procede de numerisation tridimensionnelle d'un objet
WO2018147844A1 (fr) * 2017-02-08 2018-08-16 Hewlett-Packard Development Company, L.P. Scanners d'objets dotés d'ouvertures
US20220236048A1 (en) * 2019-03-15 2022-07-28 Faro Technologies, Inc. Handheld three-dimensional coordinate measuring device operatively coupled to a mobile computing device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010015086A1 (fr) * 2008-08-06 2010-02-11 Creaform Inc. Système pour balayage tridimensionnel adaptatif de caractéristiques de surface
US20100134598A1 (en) * 2005-03-11 2010-06-03 St-Pierre Eric Hand-held self-referenced apparatus for three-dimensional scanning
US20130218024A1 (en) * 2011-10-09 2013-08-22 Clear Guide Medical, Llc Interventional In-Situ Image-Guidance by Fusing Ultrasound and Video
WO2013184340A1 (fr) * 2012-06-07 2013-12-12 Faro Technologies, Inc. Machines de mesure de coordonnées à accessoires amovibles

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102012112321B4 (de) * 2012-12-14 2015-03-05 Faro Technologies, Inc. Vorrichtung zum optischen Abtasten und Vermessen einer Umgebung

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100134598A1 (en) * 2005-03-11 2010-06-03 St-Pierre Eric Hand-held self-referenced apparatus for three-dimensional scanning
WO2010015086A1 (fr) * 2008-08-06 2010-02-11 Creaform Inc. Système pour balayage tridimensionnel adaptatif de caractéristiques de surface
US20130218024A1 (en) * 2011-10-09 2013-08-22 Clear Guide Medical, Llc Interventional In-Situ Image-Guidance by Fusing Ultrasound and Video
WO2013184340A1 (fr) * 2012-06-07 2013-12-12 Faro Technologies, Inc. Machines de mesure de coordonnées à accessoires amovibles

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018096116A1 (fr) 2016-11-28 2018-05-31 Centre National De La Recherche Scientifique (Cnrs) Systeme et procede de numerisation tridimensionnelle d'un objet
FR3059416A1 (fr) * 2016-11-28 2018-06-01 Centre National De La Recherche Scientifique Systeme et procede de numerisation tridimensionnelle d’un objet
WO2018147844A1 (fr) * 2017-02-08 2018-08-16 Hewlett-Packard Development Company, L.P. Scanners d'objets dotés d'ouvertures
CN110192144A (zh) * 2017-02-08 2019-08-30 惠普发展公司，有限责任合伙企业 带开口的物体扫描仪
US10423197B2 (en) 2017-02-08 2019-09-24 Hewlett-Packard Development Company, L.P. Object scanners with openings
EP3545355A4 (fr) * 2017-02-08 2020-05-06 Hewlett-Packard Development Company, L.P. Scanners d'objets dotés d'ouvertures
US20220236048A1 (en) * 2019-03-15 2022-07-28 Faro Technologies, Inc. Handheld three-dimensional coordinate measuring device operatively coupled to a mobile computing device
US11725928B2 (en) * 2019-03-15 2023-08-15 Faro Technologies, Inc. Handheld three-dimensional coordinate measuring device operatively coupled to a mobile computing device

Also Published As

Publication number Publication date
GB2545603A (en) 2017-06-21
GB2545603B (en) 2020-04-15
GB201705409D0 (en) 2017-05-17

Similar Documents

Publication Publication Date Title
US9671221B2 (en) Portable device for optically measuring three-dimensional coordinates
US10499040B2 (en) Device and method for optically scanning and measuring an environment and a method of control
GB2545145B (en) A device and method for optically scanning and measuring an environment
US10088296B2 (en) Method for optically measuring three-dimensional coordinates and calibration of a three-dimensional measuring device
US10401143B2 (en) Method for optically measuring three-dimensional coordinates and controlling a three-dimensional measuring device
US10841562B2 (en) Calibration plate and method for calibrating a 3D measurement device
US9858682B2 (en) Device for optically scanning and measuring an environment
JP4643583B2 (ja) 表示装置及び撮像装置
US9115986B2 (en) Device for optically scanning and measuring an environment
US20180014002A1 (en) Balancing colors in a scanned three-dimensional image
WO2016040229A1 (fr) Procédé de mesure optique de coordonnées tridimensionnelles, et étalonnage d'un dispositif de mesure tridimensionnelle
US11350077B2 (en) Handheld three dimensional scanner with an autoaperture
JP2017528714A (ja) ３次元座標の光学測定のための方法および３次元測定デバイスの制御
US20060119848A1 (en) Methods and apparatus for making images including depth information
CN108779978A (zh) 深度感测系统和方法
WO2016039955A1 (fr) Dispositif portable de mesure optique de coordonnées tridimensionnelles
WO2005090905A1 (fr) Appareil a profilometre optique et procede correspondant
JP2025092400A (ja) 投光装置、投受光装置および測距システム
HK1163824B (en) Panomaric projection device and method implemented by said device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15757098

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 201705409

Country of ref document: GB

Kind code of ref document: A

Free format text: PCT FILING DATE = 20150819

122 Ep: pct application non-entry in european phase

Ref document number: 15757098

Country of ref document: EP

Kind code of ref document: A1