WO2019104650A1 - Capturing device and method for optimizing capturing position - Google Patents
Capturing device and method for optimizing capturing position Download PDFInfo
- Publication number
- WO2019104650A1 WO2019104650A1 PCT/CN2017/113976 CN2017113976W WO2019104650A1 WO 2019104650 A1 WO2019104650 A1 WO 2019104650A1 CN 2017113976 W CN2017113976 W CN 2017113976W WO 2019104650 A1 WO2019104650 A1 WO 2019104650A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- camera
- light source
- image
- control device
- images
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
Definitions
- the present invention relates to the field of vision technology, and in particular, to a camera device and a method for optimizing a shooting position.
- Computer vision is divided into two types: active vision and passive vision.
- active vision the method of actively editing the surface feature information of the object by using structured light is called active vision.
- Active vision can actively control the influence of ambient light on the target object, overcome the uncertainty factors in passive vision, and increase the accuracy of stereoscopic 3D reconstruction. Therefore, active vision has greater application value than passive vision.
- an active vision system consisting of a structured light source and a camera, the specific location of the structured light source and camera has a significant impact on the quality of the image.
- the structural light source and the camera are respectively fixed on the guide rail and cannot be freely moved, and the optimal shooting position of the structural light source and the camera cannot be automatically found according to objects of different sizes and distances. , which in turn affects the quality of the image.
- the technical problem to be solved by the present invention is to provide a shooting device and a method for optimizing the shooting position, which can better avoid the occlusion and obtain an optimal shooting position according to the pre-acquisition of the image.
- the first technical solution adopted by the present invention is to provide a photographing device, which comprises: a structural light source, a camera, a sliding module, a position sensor, a processor; the structural light source and the camera are respectively connected with the sliding module ;
- the position sensor is specifically configured to record and store the position coordinates of the camera and the structural light source, and the camera is specifically configured to collect image collections including a series of images of the target object at a plurality of different locations;
- the processor is specifically configured to obtain a frame image with the highest degree of matching with the image collection from the image collection, and determine the position coordinates of the camera and the structural light source corresponding to the frame image with the highest matching degree as the optimal shooting position.
- the second technical solution adopted by the present invention is to provide a method for finding a shooting position, the method comprising:
- the camera collects a collection of images containing a series of images of the target object at a plurality of different locations, the position sensor records and stores the camera and/or the structured light source during movement of the camera and the structured light source Series position coordinates;
- the frame image with the highest matching degree with the image collection is obtained from the image collection by the processor, and the position coordinates of the camera corresponding to the frame image with the highest matching degree and the structural light source are determined as the optimal shooting position.
- the present invention controls the movement of the camera and/or the structural light source by the sliding module, and the camera collects a collection of images including a series of images of the target object at a plurality of different positions, the processor slave image
- the frame image with the highest matching degree with the image collection is obtained in the collection, and the position coordinates of the camera and the structural light source corresponding to the frame image with the highest matching degree are determined as the optimal shooting position.
- the occlusion can be better avoided, and the optimal shooting position of the structural light source and the camera can be automatically found according to objects of different sizes and distances, thereby improving the display quality of the captured image.
- FIG. 1 is a schematic structural view of a first embodiment of a photographing apparatus provided by the present invention.
- FIG. 2 is a schematic structural view of a second embodiment of a photographing apparatus provided by the present invention.
- FIG. 3 is a schematic structural view of a third embodiment of a photographing apparatus provided by the present invention.
- FIG. 4 is a schematic flow chart of an embodiment of a method for optimizing a shooting position according to the present invention.
- the photographing device comprises a structural light source, a camera, a sliding module, a position sensor and a processor; and the structured light source and the camera are respectively connected with the sliding module. .
- the sliding module includes a sliding electric control device and a guide rail
- the position sensor is a position encoder
- the sliding electric control device is used to control the movement of the camera and/or the structural light source on the guide rail
- the position encoder is used for recording and storing the camera and the structural light source.
- Position coordinates the camera is used to collect a collection of images containing a series of images of the target object at a plurality of different locations, and the processor obtains a frame image containing the most object elements from the image collection, and the position of the camera and the structural light source corresponding to the image The coordinates are determined as the optimal shooting position.
- FIG. 1 is a schematic structural diagram of a first embodiment of a photographing apparatus according to the present invention.
- the photographing apparatus includes: a position encoder 101, a structure light source 102, a slide electric control device 103, and a camera 104. , rail 105, processor (not shown).
- the slide electronic control unit 103 and the guide rail 105 together constitute a slide module.
- the guide rail 105 is a linear guide rail
- the camera 104 is a binocular camera.
- the camera 104 may be a monocular camera or a multi-view camera in other embodiments, and is not limited thereto.
- the structured light source 102 and the camera 104 are respectively connected to the guide rail 105, the camera 104 is electrically connected to the slide electronic control device 103, the slide electronic control device 103 is used to control the movement of the camera 104 on the guide rail 105, and the position encoder 101 is used for recording and storing the camera 104.
- the position coordinates of the structural light source 102, the camera 104 is configured to collect a collection of images including a series of images of the target object at a plurality of different locations, and the processor acquires a frame image including the content element of the target object from the image collection, the image is
- the position coordinates of the corresponding camera 104 and the structured light source 102 are determined as the optimal shooting position.
- the structural light source 102 and the camera 104 are respectively fixed at both ends of the guide rail 105, and the slide electric control device 103 is mounted on the camera 104, and is controlled by the slide electric control device 103.
- the camera 104 moves on the guide rail 105 in a direction toward the structural light source 102.
- the position encoder 101 records and stores the position coordinates of the camera 104 and the structured light source 102, and the camera 104 collects the plurality of different positions.
- the target object is a collection of images of a series of images
- the processor selects a frame image containing the most content elements of the target object from the image collection, and determines the position coordinates of the camera 104 and the structural light source 102 corresponding to the image as the optimal shooting position.
- the specific moving manner of the structural light source 102 and the camera 104 is not limited during the entire moving process.
- the structured light source 102 and the camera 104 are first secured to the same end of the rail 105, and the camera 104 is controlled to move toward the other end of the rail 105 by the slide electronic control device 103.
- the sliding electronic control unit 103 is only mounted on the camera 104.
- the sliding electric control device can be mounted on the structural light source 102 and the camera 104, and the structural light source 102 and the sliding electronic control device are controlled.
- the camera 104 is simultaneously moved on the guide rail 105.
- the optimal shooting position is reacquired by the photographing device or the camera 104 is automatically adjusted by the slide electric control device 103 according to the change of the position coordinate of the target object in the world coordinate system.
- the location on the 105 is automatically adjusted by the slide electric control device 103 according to the change of the position coordinate of the target object in the world coordinate system.
- FIG. 2 is a schematic structural diagram of a second embodiment of a photographing apparatus according to the present invention.
- the photographing apparatus includes: a position encoder 201, a structural light source 202, and a first sliding electric control device 203.
- the first sliding electronic control unit 203, the second sliding electronic control unit 205 and the guide rail 206 together constitute a sliding module.
- the guide rail 206 is a curved guide rail
- the camera 204 is a binocular camera.
- the camera 204 may be a monocular camera or a multi-view camera in other embodiments, which is not limited thereto.
- the structured light source 202 and the camera 204 are respectively connected to the guide rail 206, and the structural light source 202 and the camera 204 are electrically connected to the first sliding electronic control device 203 and the second sliding electronic control device 205, respectively, the first sliding electronic control device 203 and the second sliding electric device.
- the control device 205 controls the structural light source 202 and the camera 204 to move on the guide rail 206
- the position encoder 201 is used to record and store the position coordinates of the camera 204 and the structural light source 202
- the camera 204 is configured to collect the target object at a plurality of different positions.
- the image collection of the series of images is obtained, and the processor acquires a frame image including the content element of the target object from the image collection, and determines the position coordinates of the camera 204 and the structural light source 202 corresponding to the image as the optimal shooting position.
- the structural light source 202 and the camera 204 are respectively fixed at the two ends of the guide rail 206, and then passed through the first sliding electronic control device 203 and the second sliding electronic control device 205 respectively.
- the control structure light source 202 and the camera 204 move toward the middle of the guide rail 206.
- the position encoder 201 records and stores the position coordinates of the camera 204 and the structured light source 202, and the camera 204 collects the target at a plurality of different positions.
- the processor selects a frame image containing the most content elements of the target object from the image collection, and determines the position coordinates of the camera 204 and the structural light source 202 corresponding to the image as the optimal shooting position.
- the specific moving manner of the structural light source 202 and the camera 204 is not limited during the entire moving process.
- the structural light source 202 and the camera 204 are first fixed at the middle of the guide rail 206, and then the structural light source 202 and the camera 204 are respectively controlled by the first sliding electronic control device 203 and the second sliding electronic control device 205.
- the mounting of the sliding electrical control device on both the structured light source 202 and the camera 204 is a specific embodiment. In other embodiments, the sliding electrical control device can be mounted only on the structured light source 202 or the camera 204.
- the optimal shooting position is reacquired by the photographing device or the first sliding electronic control device 203 and the second sliding are changed according to the change of the position coordinate of the target object in the world coordinate system.
- the electronic control unit 205 automatically adjusts the position of the structured light source 202 and camera 204 on the rail 206.
- FIG. 3 is a schematic structural diagram of a third embodiment of a camera device according to the present invention.
- the camera device includes a position encoder 301, a structure light source 302, and a first slide electronic control device 303.
- the first sliding electronic control device 303, the first rail 305, the second sliding electronic control device 306 and the second rail 308 together constitute a sliding module.
- the first rail 305 and the second rail 308 are both linear guide rails, and the two rails form an angle. In other embodiments, the rails may also be curved rails.
- the two cameras are binocular cameras, and the two cameras may be monocular cameras or multi-view cameras in other embodiments, which are not limited.
- the structure light source 302 and the first camera 304 are respectively connected to the first rail 305
- the second camera 307 is connected to the second rail 308, and the first slide electronic control device 303 and the second slide electronic control device 306 are respectively coupled to the first camera 304 and the
- the two cameras 307 are electrically connected, and the two sliding electronic control devices respectively control the movement of the two cameras on the first rail 305 and the second rail 308, and the position encoder 301 is used for recording and storing the position coordinates of the two cameras and the structural light source 302.
- the two cameras are used to collect a collection of images including a series of images of the target object at a plurality of different locations, and the processor obtains a frame image containing the most content elements of the target object from the image collection, and the camera and the structural light source corresponding to the image
- the position coordinates of 302 are determined as the optimal shooting position.
- the structural light source 302 and the first camera 304 are respectively fixed at both ends of the first rail 305, and the second camera 307 is fixed at one end of the second rail 308.
- the first camera 304 and the second camera 307 are respectively controlled to move toward the other end of the first rail 305 and the second rail 308 by the first sliding electronic control device 303 and the second sliding electronic control device 306, during the whole movement,
- the position encoder 301 records and stores the position coordinates of the two cameras and the structural light source 302.
- the two cameras collect image collections including a series of images of the target object at a plurality of different positions, and the processor selects the target from the image collection.
- the frame image having the largest object content element determines the position coordinates of the camera corresponding to the image and the structural light source 302 as the optimal shooting position.
- the specific moving manner of the structural light source 302 and the two cameras is not limited during the entire moving process.
- the structural light source 302 and the first camera 304 are both fixed at the same end of the first rail 305, and the second camera 307 is fixed at one end of the second rail 308, and then passes through the first sliding electric
- the control device 303 and the second sliding electronic control device 306 respectively control the first camera 304 and the second camera 307 to move toward the other end of the first rail 305 and the second rail 308; or first fix the structural light source 302 and the first camera 304 At the middle of the first guide rail 305, and fixing the second camera 307 at one end of the second guide rail 308, the first camera 304 is controlled to move on the first guide rail 305 in a direction away from the structural light source 302 by the slide electric control device. And controlling the second camera 307 to move
- the slide electronic control device mounted on each of the two cameras is a specific embodiment. In other embodiments, the slide electronic control device can be mounted on both the structured light source 302 and the two cameras.
- the optimal shooting position is reacquired by the photographing device or the camera is automatically adjusted on the guide rail by the sliding electric control device according to the change of the position coordinate of the target object in the world coordinate system. position.
- the present invention controls the movement of the camera and/or the structural light source by the sliding module, and the camera collects a collection of images including a series of images of the target object at a plurality of different positions, and the processor obtains the highest matching degree with the image collection from the image collection.
- the frame image determines the position coordinates of the camera and the structural light source corresponding to the frame image with the highest matching degree as the optimal shooting position. In this way, the occlusion can be better avoided, and the optimal shooting position of the structural light source and the camera can be automatically found according to objects of different sizes and distances, thereby improving the display quality of the captured image.
- FIG. 4 is a schematic flowchart diagram of an embodiment of a method for optimizing a shooting position according to the present invention. Hereinafter, specific steps of the method will be described in detail.
- S401 Acquire parameter information of the calibration of the photographing device.
- a geometric model of the camera imaging In the process of acquiring the image information of the target object, in order to determine the relationship between the three-dimensional geometric position of a certain point on the surface of the target and its corresponding point in the image, a geometric model of the camera imaging must be established. These geometric model parameters are the parameters of the camera. The process of obtaining these parameters is called camera calibration.
- the camera in this embodiment is a monocular, binocular or multi-eye camera.
- the calibration of the camera includes calibration of internal parameters and external parameters, and internal parameter information such as principal point coordinates, focal length, radial distortion coefficient, and lateral distortion coefficient, and external parameter information such as a rotation matrix and a translation matrix are obtained by calibration. .
- S402 controlling the movement of the camera and/or the structural light source by the sliding module, the camera collects a collection of images including a series of images of the target object at a plurality of different positions, and the position sensor records and stores the camera and the structural light source during the moving process. A series of position coordinates.
- a sliding electronic control device on the camera and / or structure light source, control the camera through the sliding electronic control device and / Or the structural light source moves on the guide rail.
- the camera collects a collection of images containing a series of images of the target object at a plurality of different positions, and the position encoder records and stores the camera and/or the structural light source moving on the guide rail.
- a series of position coordinates of the camera and the structured light source Specifically, as shown in FIG. 1, the number of cameras and guide rails in FIG. 1 is one.
- a slide electronic control device 103 is mounted on the camera 104, and the structural light source 102 and the camera 104 are respectively fixed at both ends of the guide rail 105.
- the slide electronic control device 103 controls the camera 104 to move on the guide rail 105 in a direction toward the structural light source 102. During the entire movement, the camera 104 collects a collection of images containing a series of images of the target object, and the position encoder 101 records and stores. A series of positional coordinates of camera 104 and structured light source 102.
- the specific moving manner of the structural light source 102 and the camera 104 is not limited during the entire moving process.
- the structured light source 102 and the camera 104 are first secured to the same end of the rail 105, and the camera 104 is controlled to move toward the other end of the rail 105 by the slide electronic control device 103.
- the sliding electronic control unit 103 is only mounted on the camera 104. In other embodiments, the sliding electric control device can be mounted on the structural light source 102 and the camera 104, and the structural light source 102 and the sliding electronic control device are controlled.
- the camera 104 is simultaneously moved on the guide rail 105.
- the number of cameras and rails is two.
- the two guide rails in FIG. 3 are all linear guide rails, and both cameras are binocular cameras, and the two cameras may also be monocular or multi-head cameras, which are not limited.
- a sliding electric control device is mounted on both cameras.
- the structural light source 302 and the first camera 304 are respectively fixed at two ends of the first guide rail 305, and the second camera 307 is fixed at one end of the second guide rail 308, and then The first camera 304 and the second camera 307 are respectively controlled to move toward the other end of the first rail 305 and the second rail 308 by the first slide electronic control device 303 and the second slide electronic control device 306, during the entire movement, two
- the camera collects a collection of images containing a series of images of the target object at a plurality of different locations, and the position encoder 301 records and stores a series of position coordinates of the two cameras and the structured light source 302.
- the specific moving manner of the structural light source 302 and the two cameras is not limited during the entire moving process.
- the structural light source 302 and the first camera 304 are both fixed at the same end of the first rail 305, and the second camera 307 is fixed at one end of the second rail 308, and then passes through the first sliding electric
- the control device 303 and the second sliding electronic control device 306 respectively control the first camera 304 and the second camera 307 to move toward the other end of the first rail 305 and the second rail 308; or first fix the structural light source 302 and the first camera 304 At the middle of the first guide rail 305, and fixing the second camera 307 at one end of the second guide rail 308, the first camera 304 is controlled to move on the first guide rail 305 in a direction away from the structural light source 302 by the slide electric control device.
- the slide electronic control device mounted on each of the two cameras is a specific embodiment. In other embodiments, the slide electronic control device can be mounted on both the structured light source 302 and the two cameras.
- the frame image with the highest matching degree with the image collection is obtained from the image collection by the processor, and the position coordinates of the camera corresponding to the frame image with the highest matching degree and the structural light source are determined as the optimal shooting position.
- an image collection of a series of images of the camera acquisition target object and a series of position coordinates of the camera and the structural light source are obtained, and the processor obtains the frame with the highest matching degree of the image collection from the image collection.
- the image determines the position coordinates of the camera and the structural light source corresponding to the frame image with the highest matching degree as the optimal shooting position.
- the frame image having the highest matching degree with the image collection from the image collection is specifically obtained by acquiring the frame image including the target object content element from the image collection.
- the processor collects the collected images.
- a frame image including the most content elements of the target object is selected, and the position coordinates of the camera 104 and the structural light source 102 corresponding to the selected image are determined as the optimal shooting position.
- the optimal shooting position is reacquired by the photographing device or the camera 104 is automatically adjusted by the slide electric control device 103 according to the change of the position coordinate of the target object in the world coordinate system.
- the location on the 105 is automatically adjusted by the slide electric control device 103 according to the change of the position coordinate of the target object in the world coordinate system.
- the number of cameras and rails is two.
- the two guide rails in FIG. 3 are all linear guide rails, and both cameras are binocular cameras, and the two cameras may also be monocular or multi-head cameras, which are not limited.
- the processor collects the collected images from the image. A frame image including the content element of the target object is selected, and the position coordinates of the camera corresponding to the selected image and the structural light source 302 are determined as the optimal shooting position.
- the optimal shooting position is reacquired by the photographing device or the camera is automatically adjusted on the guide rail by the sliding electric control device according to the change of the position coordinate of the target object in the world coordinate system. position.
- the present invention controls the movement of the camera and/or the structural light source through the sliding module, and the camera collects a collection of images including a series of images of the target object at a plurality of different locations, and the processor acquires the image collection from the image collection.
- the frame image with the highest matching degree determines the position coordinates of the camera and the structural light source corresponding to the frame image with the highest matching degree as the optimal shooting position. In this way, the occlusion can be better avoided, and the optimal shooting position of the structural light source and the camera can be automatically found according to objects of different sizes and distances, thereby improving the display quality of the captured image.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
Description
【技术领域】[Technical Field]
本发明涉及视觉技术领域,特别是涉及一种拍摄装置及拍摄位置寻优的方法。The present invention relates to the field of vision technology, and in particular, to a camera device and a method for optimizing a shooting position.
【背景技术】 【Background technique】
计算机视觉从实现方法来分,主要分为主动视觉和被动视觉两类,其中,通过用到结构光主动编辑物体表面特征信息的方法称为主动视觉。主动视觉能主动控制环境光等对目标对象的影响,克服了被动视觉中存在的不确定性因素,同时增大了立体视觉三维重建的精度。由此,主动视觉相对于被动视觉有着更大的应用价值。在由结构光源和相机组成的主动视觉系统中,结构光源与相机的具体位置对成像的质量有重要影响。Computer vision is divided into two types: active vision and passive vision. Among them, the method of actively editing the surface feature information of the object by using structured light is called active vision. Active vision can actively control the influence of ambient light on the target object, overcome the uncertainty factors in passive vision, and increase the accuracy of stereoscopic 3D reconstruction. Therefore, active vision has greater application value than passive vision. In an active vision system consisting of a structured light source and a camera, the specific location of the structured light source and camera has a significant impact on the quality of the image.
目前而言,对于由结构光源与相机组成的成像系统中,结构光源与相机分别固定在导轨上而不能自由移动,无法实现根据不同大小、远近的物体自动找到结构光源和相机的最优拍摄位置,进而影响了成像的质量。At present, in an imaging system composed of a structured light source and a camera, the structural light source and the camera are respectively fixed on the guide rail and cannot be freely moved, and the optimal shooting position of the structural light source and the camera cannot be automatically found according to objects of different sizes and distances. , which in turn affects the quality of the image.
【发明内容】 [Summary of the Invention]
本发明主要解决的技术问题是提供一种拍摄装置及拍摄位置寻优的方法,能够更好的避开遮挡,并根据图像的预采集获取最优拍摄位置。The technical problem to be solved by the present invention is to provide a shooting device and a method for optimizing the shooting position, which can better avoid the occlusion and obtain an optimal shooting position according to the pre-acquisition of the image.
为解决上述技术问题,本发明采用的第一个技术方案是提供一种拍摄装置,该装置包括:结构光源、相机、滑动模块、位置传感器、处理器;结构光源和相机分别与滑动模块连接连接; In order to solve the above technical problem, the first technical solution adopted by the present invention is to provide a photographing device, which comprises: a structural light source, a camera, a sliding module, a position sensor, a processor; the structural light source and the camera are respectively connected with the sliding module ;
位置传感器具体用于记录并存储相机与结构光源的位置坐标,相机具体用于在多个不同位置采集包含目标对象一系列图像的图像合集;The position sensor is specifically configured to record and store the position coordinates of the camera and the structural light source, and the camera is specifically configured to collect image collections including a series of images of the target object at a plurality of different locations;
处理器具体用于从图像合集中获取与图像合集匹配度最高的帧图像,将匹配度最高的帧图像所对应的相机与结构光源的位置坐标确定为最优拍摄位置。The processor is specifically configured to obtain a frame image with the highest degree of matching with the image collection from the image collection, and determine the position coordinates of the camera and the structural light source corresponding to the frame image with the highest matching degree as the optimal shooting position.
为解决上述技术问题,本发明采用的第二个技术方案是提供一种拍摄位置寻优的方法,该方法包括:In order to solve the above technical problem, the second technical solution adopted by the present invention is to provide a method for finding a shooting position, the method comprising:
获取拍摄装置标定的参数信息;Obtaining parameter information of the calibration of the camera;
通过滑动模块控制相机和/或结构光源移动,相机在多个不同位置采集包含目标对象一系列图像的图像合集,位置传感器记录并存储相机和/或结构光源在移动过程中相机与结构光源的一系列位置坐标;Controlling the movement of the camera and/or the structured light source by the sliding module, the camera collects a collection of images containing a series of images of the target object at a plurality of different locations, the position sensor records and stores the camera and/or the structured light source during movement of the camera and the structured light source Series position coordinates;
通过处理器从图像合集中获取与图像合集匹配度最高的帧图像,将匹配度最高的帧图像所对应的相机与结构光源的位置坐标确定为最优拍摄位置。The frame image with the highest matching degree with the image collection is obtained from the image collection by the processor, and the position coordinates of the camera corresponding to the frame image with the highest matching degree and the structural light source are determined as the optimal shooting position.
本发明的有益效果是:区别于现有技术的情况,本发明通过滑动模块控制相机和/或结构光源移动,相机在多个不同位置采集包含目标对象一系列图像的图像合集,处理器从图像合集中获取与该图像合集匹配度最高的帧图像,将匹配度最高的帧图像所对应的相机与结构光源的位置坐标确定为最优拍摄位置。这样能够更好的避开遮挡,并实现了根据不同大小、远近的物体自动找到结构光源和相机的最优拍摄位置,进而提高了拍摄图像的显示质量。The beneficial effects of the present invention are: different from the prior art, the present invention controls the movement of the camera and/or the structural light source by the sliding module, and the camera collects a collection of images including a series of images of the target object at a plurality of different positions, the processor slave image The frame image with the highest matching degree with the image collection is obtained in the collection, and the position coordinates of the camera and the structural light source corresponding to the frame image with the highest matching degree are determined as the optimal shooting position. In this way, the occlusion can be better avoided, and the optimal shooting position of the structural light source and the camera can be automatically found according to objects of different sizes and distances, thereby improving the display quality of the captured image.
【附图说明】 [Description of the Drawings]
图1是本发明提供的一种拍摄装置第一实施例的结构示意图;1 is a schematic structural view of a first embodiment of a photographing apparatus provided by the present invention;
图2是本发明提供的一种拍摄装置第二实施例的结构示意图;2 is a schematic structural view of a second embodiment of a photographing apparatus provided by the present invention;
图3是本发明提供的一种拍摄装置第三实施例的结构示意图;3 is a schematic structural view of a third embodiment of a photographing apparatus provided by the present invention;
图4是本发明提供的一种拍摄位置寻优的方法一实施例的流程示意图。FIG. 4 is a schematic flow chart of an embodiment of a method for optimizing a shooting position according to the present invention.
【具体实施方式】【Detailed ways】
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,均属于本发明保护的范围。The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
为了根据不同大小、远近的物体自动找到结构光源和相机的最优拍摄位置,本发明提供的拍摄装置包括结构光源、相机、滑动模块、位置传感器、处理器;结构光源和相机分别与滑动模块连接。In order to automatically find the optimal shooting position of the structural light source and the camera according to different sizes and objects, the photographing device provided by the present invention comprises a structural light source, a camera, a sliding module, a position sensor and a processor; and the structured light source and the camera are respectively connected with the sliding module. .
具体地,滑动模块包括滑动电控装置和导轨,位置传感器为位置编码器,滑动电控装置用于控制相机和/或结构光源在导轨上移动,位置编码器用于记录并存储相机与结构光源的位置坐标;相机用于在多个不同位置采集包含目标对象一系列图像的图像合集,处理器从图像合集中获取包含目标对象元素最多的帧图像,将该图像所对应的相机与结构光源的位置坐标确定为最优拍摄位置。Specifically, the sliding module includes a sliding electric control device and a guide rail, the position sensor is a position encoder, the sliding electric control device is used to control the movement of the camera and/or the structural light source on the guide rail, and the position encoder is used for recording and storing the camera and the structural light source. Position coordinates; the camera is used to collect a collection of images containing a series of images of the target object at a plurality of different locations, and the processor obtains a frame image containing the most object elements from the image collection, and the position of the camera and the structural light source corresponding to the image The coordinates are determined as the optimal shooting position.
为了清楚说明上述拍摄装置的工作过程,请参阅图1~图4。In order to clearly explain the working process of the above-mentioned photographing device, please refer to FIG. 1 to FIG. 4.
请参阅图1,图1是本发明提供的拍摄装置第一实施例的结构示意图,如图1所示,该拍摄装置包括:位置编码器101、结构光源102、滑动电控装置103、相机104、导轨105、处理器(图中未示出)。滑动电控装置103和导轨105一起构成滑动模块。其中,导轨105为直线型导轨,相机104为双目相机,相机104在其他实施例中也可为单目相机或多目相机,具体不作限定。结构光源102以及相机104分别与导轨105连接,相机104与滑动电控装置103电连接,滑动电控装置103用于控制相机104在导轨105上移动,位置编码器101用于记录并存储相机104和结构光源102的位置坐标,相机104用于在多个不同位置采集包含目标对象一系列图像的图像合集,处理器从该图像合集中获取包含目标对象内容元素最多的帧图像,将该图像所对应的相机104与结构光源102的位置坐标确定为最优拍摄位置。Please refer to FIG. 1. FIG. 1 is a schematic structural diagram of a first embodiment of a photographing apparatus according to the present invention. As shown in FIG. 1, the photographing apparatus includes: a position encoder 101, a structure light source 102, a slide electric control device 103, and a camera 104. , rail 105, processor (not shown). The slide electronic control unit 103 and the guide rail 105 together constitute a slide module. The guide rail 105 is a linear guide rail, and the camera 104 is a binocular camera. The camera 104 may be a monocular camera or a multi-view camera in other embodiments, and is not limited thereto. The structured light source 102 and the camera 104 are respectively connected to the guide rail 105, the camera 104 is electrically connected to the slide electronic control device 103, the slide electronic control device 103 is used to control the movement of the camera 104 on the guide rail 105, and the position encoder 101 is used for recording and storing the camera 104. And the position coordinates of the structural light source 102, the camera 104 is configured to collect a collection of images including a series of images of the target object at a plurality of different locations, and the processor acquires a frame image including the content element of the target object from the image collection, the image is The position coordinates of the corresponding camera 104 and the structured light source 102 are determined as the optimal shooting position.
在一个具体的实施方式中,为了确定最优拍摄位置,将结构光源102和相机104分别固定在导轨105的两端,将滑动电控装置103安装在相机104上,通过滑动电控装置103控制相机104在导轨105上朝着靠近结构光源102的方向移动,在整个移动过程中,位置编码器101记录并存储了相机104与结构光源102的位置坐标,相机104在多个不同位置采集了包含目标对象一系列图像的图像合集,处理器从该图像合集中选出包含目标对象内容元素最多的帧图像,将该图像所对应的相机104与结构光源102的位置坐标确定为最优拍摄位置。其中,在整个移动过程中,对结构光源102和相机104的具体移动方式不作限定。例如,在其他实施方式中,先将结构光源102和相机104固定在导轨105的同一端,再通过滑动电控装置103控制相机104移向导轨105的另一端。In a specific embodiment, in order to determine an optimal shooting position, the structural light source 102 and the camera 104 are respectively fixed at both ends of the guide rail 105, and the slide electric control device 103 is mounted on the camera 104, and is controlled by the slide electric control device 103. The camera 104 moves on the guide rail 105 in a direction toward the structural light source 102. During the entire movement, the position encoder 101 records and stores the position coordinates of the camera 104 and the structured light source 102, and the camera 104 collects the plurality of different positions. The target object is a collection of images of a series of images, and the processor selects a frame image containing the most content elements of the target object from the image collection, and determines the position coordinates of the camera 104 and the structural light source 102 corresponding to the image as the optimal shooting position. The specific moving manner of the structural light source 102 and the camera 104 is not limited during the entire moving process. For example, in other embodiments, the structured light source 102 and the camera 104 are first secured to the same end of the rail 105, and the camera 104 is controlled to move toward the other end of the rail 105 by the slide electronic control device 103.
只在相机104上安装滑动电控装置103是一具体的实施方式,在其他实施方式中,可以在结构光源102和相机104上均安装滑动电控装置,通过滑动电控装置控制结构光源102和相机104同时在导轨105上移动。The sliding electronic control unit 103 is only mounted on the camera 104. In other embodiments, the sliding electric control device can be mounted on the structural light source 102 and the camera 104, and the structural light source 102 and the sliding electronic control device are controlled. The camera 104 is simultaneously moved on the guide rail 105.
当目标对象在世界坐标系中的位置坐标发生变化时,通过该拍摄装置重新获取最优拍摄位置或者根据目标对象在世界坐标系中位置坐标的变化通过滑动电控装置103自动调节相机104在导轨105上的位置。When the position coordinate of the target object in the world coordinate system changes, the optimal shooting position is reacquired by the photographing device or the camera 104 is automatically adjusted by the slide electric control device 103 according to the change of the position coordinate of the target object in the world coordinate system. The location on the 105.
请参阅图2,图2是本发明提供的拍摄装置第二实施例的结构示意图,如图2所示,该拍摄装置包括:位置编码器201、结构光源202、第一滑动电控装置203、相机204、第二滑动电控装置205、导轨206、处理器(图中未示出)。第一滑动电控装置203、第二滑动电控装置205和导轨206共同构成滑动模块。其中,导轨206为曲线型导轨,相机204为双目相机,相机204在其他实施例中也可为单目相机或多目相机,具体不作限定。结构光源202以及相机204分别与导轨206连接,结构光源202和相机204分别与第一滑动电控装置203和第二滑动电控装置205电连接,第一滑动电控装置203和第二滑动电控装置205分别控制结构光源202和相机204在导轨206上移动,位置编码器201用于记录并存储相机204和结构光源202的位置坐标,相机204用于在多个不同位置采集包含目标对象一系列图像的图像合集,处理器从该图像合集中获取包含目标对象内容元素最多的帧图像,将该图像所对应的相机204与结构光源202的位置坐标确定为最优拍摄位置。Referring to FIG. 2, FIG. 2 is a schematic structural diagram of a second embodiment of a photographing apparatus according to the present invention. As shown in FIG. 2, the photographing apparatus includes: a position encoder 201, a structural light source 202, and a first sliding electric control device 203. The camera 204, the second sliding electronic control unit 205, the guide rail 206, and a processor (not shown). The first sliding electronic control unit 203, the second sliding electronic control unit 205 and the guide rail 206 together constitute a sliding module. The guide rail 206 is a curved guide rail, and the camera 204 is a binocular camera. The camera 204 may be a monocular camera or a multi-view camera in other embodiments, which is not limited thereto. The structured light source 202 and the camera 204 are respectively connected to the guide rail 206, and the structural light source 202 and the camera 204 are electrically connected to the first sliding electronic control device 203 and the second sliding electronic control device 205, respectively, the first sliding electronic control device 203 and the second sliding electric device. The control device 205 controls the structural light source 202 and the camera 204 to move on the guide rail 206, the position encoder 201 is used to record and store the position coordinates of the camera 204 and the structural light source 202, and the camera 204 is configured to collect the target object at a plurality of different positions. The image collection of the series of images is obtained, and the processor acquires a frame image including the content element of the target object from the image collection, and determines the position coordinates of the camera 204 and the structural light source 202 corresponding to the image as the optimal shooting position.
在一个具体的实施方式中,为了确定最优拍摄位置,先将结构光源202和相机204分别固定在导轨206的两端,再通过第一滑动电控装置203和第二滑动电控装置205分别控制结构光源202和相机204朝向导轨206的中间处移动,在整个移动过程中,位置编码器201记录并存储了相机204与结构光源202的位置坐标,相机204在多个不同位置采集了包含目标对象一系列图像的图像合集,处理器从该图像合集中选出包含目标对象内容元素最多的帧图像,将该图像所对应的相机204与结构光源202的位置坐标确定为最优拍摄位置。其中,在整个移动过程中,对结构光源202和相机204的具体移动方式不作限定。例如,在其他实施方式中,先将结构光源202和相机204都固定在导轨206的中间处,再通过第一滑动电控装置203和第二滑动电控装置205分别控制结构光源202和相机204移向导轨206的两端;或者先将结构光源202和相机204均固定在导轨206的一端,再通过滑动电控装置控制结构光源202和相机204移向导轨206的另一端。In a specific embodiment, in order to determine the optimal shooting position, the structural light source 202 and the camera 204 are respectively fixed at the two ends of the guide rail 206, and then passed through the first sliding electronic control device 203 and the second sliding electronic control device 205 respectively. The control structure light source 202 and the camera 204 move toward the middle of the guide rail 206. During the entire movement, the position encoder 201 records and stores the position coordinates of the camera 204 and the structured light source 202, and the camera 204 collects the target at a plurality of different positions. The image collection of a series of images of the object, the processor selects a frame image containing the most content elements of the target object from the image collection, and determines the position coordinates of the camera 204 and the structural light source 202 corresponding to the image as the optimal shooting position. The specific moving manner of the structural light source 202 and the camera 204 is not limited during the entire moving process. For example, in other embodiments, the structural light source 202 and the camera 204 are first fixed at the middle of the guide rail 206, and then the structural light source 202 and the camera 204 are respectively controlled by the first sliding electronic control device 203 and the second sliding electronic control device 205. Moving to both ends of the guide rail 206; or firstly fixing the structural light source 202 and the camera 204 to one end of the guide rail 206, and then controlling the structural light source 202 and the camera 204 to move to the other end of the guide rail 206 by the slide electric control device.
在结构光源202和相机204上均安装滑动电控装置是一具体的实施方式,在其他实施方式中,可以只在结构光源202或相机204上安装滑动电控装置。The mounting of the sliding electrical control device on both the structured light source 202 and the camera 204 is a specific embodiment. In other embodiments, the sliding electrical control device can be mounted only on the structured light source 202 or the camera 204.
当目标对象在世界坐标系中的位置坐标发生变化时,通过该拍摄装置重新获取最优拍摄位置或者根据目标对象在世界坐标系中位置坐标的变化通过第一滑动电控装置203和第二滑动电控装置205自动调节结构光源202和相机204在导轨206上的位置。When the position coordinate of the target object in the world coordinate system changes, the optimal shooting position is reacquired by the photographing device or the first sliding electronic control device 203 and the second sliding are changed according to the change of the position coordinate of the target object in the world coordinate system. The electronic control unit 205 automatically adjusts the position of the structured light source 202 and camera 204 on the rail 206.
请参阅图3,图3是本发明提供的拍摄装置第三实施例的结构示意图,如图3所示,该拍摄装置包括:位置编码器301、结构光源302、第一滑动电控装置303、第一相机304、第一导轨305、第二滑动电控装置306、第二相机307、第二导轨308、处理器(图中未示出)。第一滑动电控装置303、第一导轨305、第二滑动电控装置306和第二导轨308共同构成滑动模块。其中,第一导轨305和第二导轨308均为直线型导轨,两个导轨形成夹角,在其他实施例中也可以为曲线型导轨。两个相机均为双目相机,两个相机在其他实施例中也可为单目相机或多目相机,具体不作限定。结构光源302以及第一相机304分别与第一导轨305连接,第二相机307与第二导轨308连接,第一滑动电控装置303和第二滑动电控装置306分别与第一相机304和第二相机307电连接,两个滑动电控装置分别控制两个相机在第一导轨305和第二导轨308上移动,位置编码器301用于记录并存储两个相机和结构光源302的位置坐标,两个相机用于在多个不同的位置采集包含目标对象一系列图像的图像合集,处理器从该图像合集中获取包含目标对象内容元素最多的帧图像,将该图像所对应的相机与结构光源302的位置坐标确定为最优拍摄位置。Referring to FIG. 3, FIG. 3 is a schematic structural diagram of a third embodiment of a camera device according to the present invention. As shown in FIG. 3, the camera device includes a position encoder 301, a structure light source 302, and a first slide electronic control device 303. The first camera 304, the first rail 305, the second slide electronic control unit 306, the second camera 307, the second rail 308, and a processor (not shown). The first sliding electronic control device 303, the first rail 305, the second sliding electronic control device 306 and the second rail 308 together constitute a sliding module. The first rail 305 and the second rail 308 are both linear guide rails, and the two rails form an angle. In other embodiments, the rails may also be curved rails. The two cameras are binocular cameras, and the two cameras may be monocular cameras or multi-view cameras in other embodiments, which are not limited. The structure light source 302 and the first camera 304 are respectively connected to the first rail 305, the second camera 307 is connected to the second rail 308, and the first slide electronic control device 303 and the second slide electronic control device 306 are respectively coupled to the first camera 304 and the The two cameras 307 are electrically connected, and the two sliding electronic control devices respectively control the movement of the two cameras on the first rail 305 and the second rail 308, and the position encoder 301 is used for recording and storing the position coordinates of the two cameras and the structural light source 302. The two cameras are used to collect a collection of images including a series of images of the target object at a plurality of different locations, and the processor obtains a frame image containing the most content elements of the target object from the image collection, and the camera and the structural light source corresponding to the image The position coordinates of 302 are determined as the optimal shooting position.
在一个具体的实施方式中,为了确定最优拍摄位置,先将结构光源302和第一相机304分别固定在第一导轨305的两端,并将第二相机307固定在第二导轨308的一端,再通过第一滑动电控装置303和第二滑动电控装置306分别控制第一相机304和第二相机307朝向第一导轨305和第二导轨308的另一端移动,在整个移动过程中,位置编码器301记录并存储两个相机与结构光源302的位置坐标,两个相机在多个不同的位置采集了包含目标对象一系列图像的图像合集,处理器从该图像合集中选出包含目标对象内容元素最多的帧图像,将该图像所对应的相机与结构光源302的位置坐标确定为最优拍摄位置。其中,在整个移动过程中,对结构光源302和两个相机的具体移动方式不作限定。例如,在其他实施方式中,先将结构光源302和第一相机304都固定在第一导轨305的同一端,并将第二相机307固定在第二导轨308的一端,再通过第一滑动电控装置303和第二滑动电控装置306分别控制第一相机304和第二相机307朝向第一导轨305和第二导轨308的另一端移动;或者先将结构光源302和第一相机304均固定在第一导轨305的中间处,并将第二相机307固定在第二导轨308的一端,再通过滑动电控装置控制第一相机304在第一导轨305上朝着远离结构光源302的方向移动以及控制第二相机307移向第二导轨308的另一端。In a specific embodiment, in order to determine an optimal shooting position, the structural light source 302 and the first camera 304 are respectively fixed at both ends of the first rail 305, and the second camera 307 is fixed at one end of the second rail 308. The first camera 304 and the second camera 307 are respectively controlled to move toward the other end of the first rail 305 and the second rail 308 by the first sliding electronic control device 303 and the second sliding electronic control device 306, during the whole movement, The position encoder 301 records and stores the position coordinates of the two cameras and the structural light source 302. The two cameras collect image collections including a series of images of the target object at a plurality of different positions, and the processor selects the target from the image collection. The frame image having the largest object content element determines the position coordinates of the camera corresponding to the image and the structural light source 302 as the optimal shooting position. Wherein, the specific moving manner of the structural light source 302 and the two cameras is not limited during the entire moving process. For example, in other embodiments, the structural light source 302 and the first camera 304 are both fixed at the same end of the first rail 305, and the second camera 307 is fixed at one end of the second rail 308, and then passes through the first sliding electric The control device 303 and the second sliding electronic control device 306 respectively control the first camera 304 and the second camera 307 to move toward the other end of the first rail 305 and the second rail 308; or first fix the structural light source 302 and the first camera 304 At the middle of the first guide rail 305, and fixing the second camera 307 at one end of the second guide rail 308, the first camera 304 is controlled to move on the first guide rail 305 in a direction away from the structural light source 302 by the slide electric control device. And controlling the second camera 307 to move to the other end of the second rail 308.
在两个相机上分别安装滑动电控装置是一具体的实施方式,在其他实施方式中,可以在结构光源302和两个相机上均安装滑动电控装置。Mounting the slide electronic control device on each of the two cameras is a specific embodiment. In other embodiments, the slide electronic control device can be mounted on both the structured light source 302 and the two cameras.
当目标对象在世界坐标系中的位置坐标发生变化时,通过该拍摄装置重新获取最优拍摄位置或者根据目标对象在世界坐标系中位置坐标的变化通过滑动电控装置自动调节相机在导轨上的位置。When the position coordinate of the target object in the world coordinate system changes, the optimal shooting position is reacquired by the photographing device or the camera is automatically adjusted on the guide rail by the sliding electric control device according to the change of the position coordinate of the target object in the world coordinate system. position.
由上述可知,本发明通过滑动模块控制相机和/或结构光源移动,相机在多个不同位置采集包含目标对象一系列图像的图像合集,处理器从图像合集中获取与该图像合集匹配度最高的帧图像,将匹配度最高的帧图像所对应的相机与结构光源的位置坐标确定为最优拍摄位置。这样能够更好的避开遮挡,并实现了根据不同大小、远近的物体自动找到结构光源和相机的最优拍摄位置,进而提高了拍摄图像的显示质量。It can be seen from the above that the present invention controls the movement of the camera and/or the structural light source by the sliding module, and the camera collects a collection of images including a series of images of the target object at a plurality of different positions, and the processor obtains the highest matching degree with the image collection from the image collection. The frame image determines the position coordinates of the camera and the structural light source corresponding to the frame image with the highest matching degree as the optimal shooting position. In this way, the occlusion can be better avoided, and the optimal shooting position of the structural light source and the camera can be automatically found according to objects of different sizes and distances, thereby improving the display quality of the captured image.
请参阅图4,图4是本发明提供的一种拍摄位置寻优的方法一实施例的流程示意图。以下,详细说明该方法的具体步骤。Please refer to FIG. 4. FIG. 4 is a schematic flowchart diagram of an embodiment of a method for optimizing a shooting position according to the present invention. Hereinafter, specific steps of the method will be described in detail.
S401:获取拍摄装置标定的参数信息。S401: Acquire parameter information of the calibration of the photographing device.
相机在获取目标物图像信息的过程中,为确定目标物表面某点的三维几何位置与其在图像中对应点之间的相互关系,必须建立相机成像的几何模型,这些几何模型参数就是相机的参数,获取这些参数的过程称为相机的标定。本实施方式中的相机为单目、双目或多目相机。In the process of acquiring the image information of the target object, in order to determine the relationship between the three-dimensional geometric position of a certain point on the surface of the target and its corresponding point in the image, a geometric model of the camera imaging must be established. These geometric model parameters are the parameters of the camera. The process of obtaining these parameters is called camera calibration. The camera in this embodiment is a monocular, binocular or multi-eye camera.
在一具体实施方式中,相机的标定包括内部参数和外部参数的标定,通过标定获取主点坐标、焦距、径向畸变系数、横向畸变系数等内部参数信息以及旋转矩阵、平移矩阵等外部参数信息。In a specific embodiment, the calibration of the camera includes calibration of internal parameters and external parameters, and internal parameter information such as principal point coordinates, focal length, radial distortion coefficient, and lateral distortion coefficient, and external parameter information such as a rotation matrix and a translation matrix are obtained by calibration. .
S402:通过滑动模块控制相机和/或结构光源移动,相机在多个不同位置采集包含目标对象一系列图像的图像合集,位置传感器记录并存储相机和/或结构光源在移动过程中相机与结构光源的一系列位置坐标。S402: controlling the movement of the camera and/or the structural light source by the sliding module, the camera collects a collection of images including a series of images of the target object at a plurality of different positions, and the position sensor records and stores the camera and the structural light source during the moving process. A series of position coordinates.
在相机和/或结构光源上安装滑动电控装置,通过滑动电控装置控制相机和/ 或结构光源在导轨上移动,在整个移动的过程中,相机在多个不同位置采集包含目标对象一系列图像的图像合集,位置编码器记录并存储相机和/或结构光源在导轨上移动过程中相机与结构光源的一系列位置坐标。具体地,如图1所示,图1中相机和导轨的数量均为一个,在相机104上安装有滑动电控装置103,将结构光源102和相机104分别固定在导轨105的两端,通过滑动电控装置103控制相机104在导轨105上朝着靠近结构光源102的方向移动,在整个移动过程中,相机104采集了包含目标对象一系列图像的图像合集,位置编码器101记录并存储了相机104与结构光源102的一系列位置坐标。其中,在整个移动过程中,对结构光源102和相机104的具体移动方式不作限定。例如,在其他实施方式中,先将结构光源102和相机104固定在导轨105的同一端,再通过滑动电控装置103控制相机104移向导轨105的另一端。只在相机104上安装滑动电控装置103是一具体的实施方式,在其他实施方式中,可以在结构光源102和相机104上均安装滑动电控装置,通过滑动电控装置控制结构光源102和相机104同时在导轨105上移动。Install a sliding electronic control device on the camera and / or structure light source, control the camera through the sliding electronic control device and / Or the structural light source moves on the guide rail. During the whole movement, the camera collects a collection of images containing a series of images of the target object at a plurality of different positions, and the position encoder records and stores the camera and/or the structural light source moving on the guide rail. A series of position coordinates of the camera and the structured light source. Specifically, as shown in FIG. 1, the number of cameras and guide rails in FIG. 1 is one. A slide electronic control device 103 is mounted on the camera 104, and the structural light source 102 and the camera 104 are respectively fixed at both ends of the guide rail 105. The slide electronic control device 103 controls the camera 104 to move on the guide rail 105 in a direction toward the structural light source 102. During the entire movement, the camera 104 collects a collection of images containing a series of images of the target object, and the position encoder 101 records and stores. A series of positional coordinates of camera 104 and structured light source 102. The specific moving manner of the structural light source 102 and the camera 104 is not limited during the entire moving process. For example, in other embodiments, the structured light source 102 and the camera 104 are first secured to the same end of the rail 105, and the camera 104 is controlled to move toward the other end of the rail 105 by the slide electronic control device 103. The sliding electronic control unit 103 is only mounted on the camera 104. In other embodiments, the sliding electric control device can be mounted on the structural light source 102 and the camera 104, and the structural light source 102 and the sliding electronic control device are controlled. The camera 104 is simultaneously moved on the guide rail 105.
在其他实施方式中,相机和导轨的数量均为两个。具体地,如图3所示,图3中的两导轨均为直线型导轨,两相机均为双目相机,两相机也可以为单目或多目相机,具体不作限定。在两个相机上均安装有滑动电控装置,先将结构光源302和第一相机304分别固定在第一导轨305的两端,并将第二相机307固定在第二导轨308的一端,再通过第一滑动电控装置303和第二滑动电控装置306分别控制第一相机304和第二相机307朝向第一导轨305和第二导轨308的另一端移动,在整个移动过程中,两个相机在多个不同位置采集了包含目标对象一系列图像的图像合集,位置编码器301记录并存储两个相机与结构光源302的一系列位置坐标。其中,在整个移动过程中,对结构光源302和两个相机的具体移动方式不作限定。例如,在其他实施方式中,先将结构光源302和第一相机304都固定在第一导轨305的同一端,并将第二相机307固定在第二导轨308的一端,再通过第一滑动电控装置303和第二滑动电控装置306分别控制第一相机304和第二相机307朝向第一导轨305和第二导轨308的另一端移动;或者先将结构光源302和第一相机304均固定在第一导轨305的中间处,并将第二相机307固定在第二导轨308的一端,再通过滑动电控装置控制第一相机304在第一导轨305上朝着远离结构光源302的方向移动以及控制第二相机307移向第二导轨308的另一端。在两个相机上分别安装滑动电控装置是一具体的实施方式,在其他实施方式中,可以在结构光源302和两个相机上均安装滑动电控装置。In other embodiments, the number of cameras and rails is two. Specifically, as shown in FIG. 3, the two guide rails in FIG. 3 are all linear guide rails, and both cameras are binocular cameras, and the two cameras may also be monocular or multi-head cameras, which are not limited. A sliding electric control device is mounted on both cameras. The structural light source 302 and the first camera 304 are respectively fixed at two ends of the first guide rail 305, and the second camera 307 is fixed at one end of the second guide rail 308, and then The first camera 304 and the second camera 307 are respectively controlled to move toward the other end of the first rail 305 and the second rail 308 by the first slide electronic control device 303 and the second slide electronic control device 306, during the entire movement, two The camera collects a collection of images containing a series of images of the target object at a plurality of different locations, and the position encoder 301 records and stores a series of position coordinates of the two cameras and the structured light source 302. Wherein, the specific moving manner of the structural light source 302 and the two cameras is not limited during the entire moving process. For example, in other embodiments, the structural light source 302 and the first camera 304 are both fixed at the same end of the first rail 305, and the second camera 307 is fixed at one end of the second rail 308, and then passes through the first sliding electric The control device 303 and the second sliding electronic control device 306 respectively control the first camera 304 and the second camera 307 to move toward the other end of the first rail 305 and the second rail 308; or first fix the structural light source 302 and the first camera 304 At the middle of the first guide rail 305, and fixing the second camera 307 at one end of the second guide rail 308, the first camera 304 is controlled to move on the first guide rail 305 in a direction away from the structural light source 302 by the slide electric control device. And controlling the second camera 307 to move to the other end of the second rail 308. Mounting the slide electronic control device on each of the two cameras is a specific embodiment. In other embodiments, the slide electronic control device can be mounted on both the structured light source 302 and the two cameras.
S403:通过处理器从图像合集中获取与图像合集匹配度最高的帧图像,将匹配度最高的帧图像所对应的相机与结构光源的位置坐标确定为最优拍摄位置。S403: The frame image with the highest matching degree with the image collection is obtained from the image collection by the processor, and the position coordinates of the camera corresponding to the frame image with the highest matching degree and the structural light source are determined as the optimal shooting position.
在S402中得到了整个移动过程中相机采集目标对象的一系列图像的图像合集以及相机与结构光源的一系列位置坐标,再通过处理器从该图像合集中获取与该图像合集匹配度最高的帧图像,将该匹配度最高的帧图像所对应的相机与结构光源的位置坐标确定为最优拍摄位置。其中,从图像合集中获取与该图像合集匹配度最高的帧图像具体为从图像合集中获取包含目标对象内容元素最多的帧图像。具体地,如图1所示,当相机104在多个不同位置采集到整个移动过程中一系列图像的图像合集及位置编码器101采集到一系列位置坐标后,处理器从采集到的图像合集中选出包含目标对象内容元素最多的帧图像,并将该选出的图像所对应的相机104与结构光源102的位置坐标确定为最优拍摄位置。In S402, an image collection of a series of images of the camera acquisition target object and a series of position coordinates of the camera and the structural light source are obtained, and the processor obtains the frame with the highest matching degree of the image collection from the image collection. The image determines the position coordinates of the camera and the structural light source corresponding to the frame image with the highest matching degree as the optimal shooting position. The frame image having the highest matching degree with the image collection from the image collection is specifically obtained by acquiring the frame image including the target object content element from the image collection. Specifically, as shown in FIG. 1, when the camera 104 collects image collection of a series of images during the entire movement process at a plurality of different positions and the position encoder 101 acquires a series of position coordinates, the processor collects the collected images. A frame image including the most content elements of the target object is selected, and the position coordinates of the camera 104 and the structural light source 102 corresponding to the selected image are determined as the optimal shooting position.
当目标对象在世界坐标系中的位置坐标发生变化时,通过该拍摄装置重新获取最优拍摄位置或者根据目标对象在世界坐标系中位置坐标的变化通过滑动电控装置103自动调节相机104在导轨105上的位置。When the position coordinate of the target object in the world coordinate system changes, the optimal shooting position is reacquired by the photographing device or the camera 104 is automatically adjusted by the slide electric control device 103 according to the change of the position coordinate of the target object in the world coordinate system. The location on the 105.
在其他实施方式中,相机和导轨的数量均为两个。具体地,如图3所示,图3中的两导轨均为直线型导轨,两相机均为双目相机,两相机也可以为单目或多目相机,具体不作限定。当两个相机在多个不同位置采集了包含目标对象一系列图像的图像合集以及位置编码器301记录并存储两个相机与结构光源302的一系列位置坐标后,处理器从采集到的图像合集中选出包含目标对象内容元素最多的帧图像,并将该选出的图像所对应的相机与结构光源302的位置坐标确定为最优拍摄位置。In other embodiments, the number of cameras and rails is two. Specifically, as shown in FIG. 3, the two guide rails in FIG. 3 are all linear guide rails, and both cameras are binocular cameras, and the two cameras may also be monocular or multi-head cameras, which are not limited. When the two cameras collect image collections containing a series of images of the target object at a plurality of different locations and the position encoder 301 records and stores a series of position coordinates of the two cameras and the structural light source 302, the processor collects the collected images from the image. A frame image including the content element of the target object is selected, and the position coordinates of the camera corresponding to the selected image and the structural light source 302 are determined as the optimal shooting position.
当目标对象在世界坐标系中的位置坐标发生变化时,通过该拍摄装置重新获取最优拍摄位置或者根据目标对象在世界坐标系中位置坐标的变化通过滑动电控装置自动调节相机在导轨上的位置。When the position coordinate of the target object in the world coordinate system changes, the optimal shooting position is reacquired by the photographing device or the camera is automatically adjusted on the guide rail by the sliding electric control device according to the change of the position coordinate of the target object in the world coordinate system. position.
区别于现有技术的情况,本发明通过滑动模块控制相机和/或结构光源移动,相机在多个不同位置采集包含目标对象一系列图像的图像合集,处理器从图像合集中获取与该图像合集匹配度最高的帧图像,将匹配度最高的帧图像所对应的相机与结构光源的位置坐标确定为最优拍摄位置。这样能够更好的避开遮挡,并实现了根据不同大小、远近的物体自动找到结构光源和相机的最优拍摄位置,进而提高了拍摄图像的显示质量。Different from the prior art, the present invention controls the movement of the camera and/or the structural light source through the sliding module, and the camera collects a collection of images including a series of images of the target object at a plurality of different locations, and the processor acquires the image collection from the image collection. The frame image with the highest matching degree determines the position coordinates of the camera and the structural light source corresponding to the frame image with the highest matching degree as the optimal shooting position. In this way, the occlusion can be better avoided, and the optimal shooting position of the structural light source and the camera can be automatically found according to objects of different sizes and distances, thereby improving the display quality of the captured image.
以上所述仅为本发明的实施方式,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所做的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。The above description is only the embodiment of the present invention, and is not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformation using the specification and the drawings of the present invention may be directly or indirectly applied to other related The technical field is equally included in the scope of patent protection of the present invention.
Claims (16)
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201780036117.7A CN109328456B (en) | 2017-11-30 | 2017-11-30 | Shooting device and shooting position optimizing method |
| PCT/CN2017/113976 WO2019104650A1 (en) | 2017-11-30 | 2017-11-30 | Capturing device and method for optimizing capturing position |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2017/113976 WO2019104650A1 (en) | 2017-11-30 | 2017-11-30 | Capturing device and method for optimizing capturing position |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2019104650A1 true WO2019104650A1 (en) | 2019-06-06 |
Family
ID=65244712
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2017/113976 Ceased WO2019104650A1 (en) | 2017-11-30 | 2017-11-30 | Capturing device and method for optimizing capturing position |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109328456B (en) |
| WO (1) | WO2019104650A1 (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110677568A (en) * | 2019-10-30 | 2020-01-10 | 广东利元亨智能装备股份有限公司 | image acquisition agency |
| CN111541851B (en) * | 2020-05-12 | 2021-08-13 | 南京甄视智能科技有限公司 | Face recognition equipment accurate installation method based on unmanned aerial vehicle hovering survey |
| CN112073608B (en) * | 2020-08-28 | 2021-08-27 | 中航测控(深圳)有限公司 | Intelligent camera based on machine vision technology |
| CN113426117B (en) * | 2021-06-23 | 2024-03-01 | 网易(杭州)网络有限公司 | Shooting parameter acquisition method and device for virtual camera, electronic equipment and storage medium |
| CN114909999A (en) * | 2022-07-18 | 2022-08-16 | 深圳市超准视觉科技有限公司 | Three-dimensional measurement system and method based on structured light |
| CN115841570A (en) * | 2022-11-24 | 2023-03-24 | 成都睿铂科技有限责任公司 | Shooting method, device and system for removing ambient light |
| CN116233585B (en) * | 2022-12-23 | 2025-10-14 | 惠州华阳通用电子有限公司 | A method for acquiring target image |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5003166A (en) * | 1989-11-07 | 1991-03-26 | Massachusetts Institute Of Technology | Multidimensional range mapping with pattern projection and cross correlation |
| CN1170177A (en) * | 1996-06-25 | 1998-01-14 | 松下电工株式会社 | Image processing process |
| CN102609942A (en) * | 2011-01-31 | 2012-07-25 | 微软公司 | Mobile camera localization using depth maps |
| CN103712572A (en) * | 2013-12-18 | 2014-04-09 | 同济大学 | Structural light source-and-camera-combined object contour three-dimensional coordinate measuring device |
| US20160349045A1 (en) * | 2014-12-19 | 2016-12-01 | Andrei Vladimirovich Klimov | A method of measurement of linear dimensions of three-dimensional objects |
| CN205842127U (en) * | 2016-07-19 | 2016-12-28 | 福建师范大学 | A kind of many mesh camera support |
| US20170042622A1 (en) * | 2010-04-28 | 2017-02-16 | Ryerson University | System and methods for intraoperative guidance feedback |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101986350B (en) * | 2010-10-22 | 2012-03-28 | 武汉大学 | 3D modeling method based on monocular structured light |
| CN103413309A (en) * | 2013-08-12 | 2013-11-27 | 西北工业大学 | CCD camera nonlinearity degree calibration method based on structured light three-dimensional measurement system |
| US9507995B2 (en) * | 2014-08-29 | 2016-11-29 | X Development Llc | Combination of stereo and structured-light processing |
| CN105787997B (en) * | 2016-03-27 | 2018-12-25 | 中国海洋大学 | Underwater high-precision three-dimensional reconstructing device and method |
| CN206563985U (en) * | 2016-09-19 | 2017-10-17 | 深圳市微付充科技有限公司 | 3-D imaging system |
-
2017
- 2017-11-30 CN CN201780036117.7A patent/CN109328456B/en active Active
- 2017-11-30 WO PCT/CN2017/113976 patent/WO2019104650A1/en not_active Ceased
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5003166A (en) * | 1989-11-07 | 1991-03-26 | Massachusetts Institute Of Technology | Multidimensional range mapping with pattern projection and cross correlation |
| CN1170177A (en) * | 1996-06-25 | 1998-01-14 | 松下电工株式会社 | Image processing process |
| US20170042622A1 (en) * | 2010-04-28 | 2017-02-16 | Ryerson University | System and methods for intraoperative guidance feedback |
| CN102609942A (en) * | 2011-01-31 | 2012-07-25 | 微软公司 | Mobile camera localization using depth maps |
| CN103712572A (en) * | 2013-12-18 | 2014-04-09 | 同济大学 | Structural light source-and-camera-combined object contour three-dimensional coordinate measuring device |
| US20160349045A1 (en) * | 2014-12-19 | 2016-12-01 | Andrei Vladimirovich Klimov | A method of measurement of linear dimensions of three-dimensional objects |
| CN205842127U (en) * | 2016-07-19 | 2016-12-28 | 福建师范大学 | A kind of many mesh camera support |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109328456B (en) | 2020-10-16 |
| CN109328456A (en) | 2019-02-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2019104650A1 (en) | Capturing device and method for optimizing capturing position | |
| CN108734744B (en) | Long-distance large-view-field binocular calibration method based on total station | |
| JP7185821B2 (en) | Stereocalibration method for movable vision system | |
| WO2018174535A1 (en) | System and method for depth map | |
| CN108510540A (en) | Stereoscopic vision video camera and its height acquisition methods | |
| WO2019014861A1 (en) | Intelligent object tracking | |
| CN105376484A (en) | Image processing method and terminal | |
| CN102785719B (en) | Ship water gauge image shooting method | |
| JP2958458B1 (en) | Multi-view image sensor | |
| CN108805940B (en) | Method for tracking and positioning zoom camera in zooming process | |
| EP2374281A2 (en) | Image data obtaining method and apparatus therefor | |
| CN111833394A (en) | Camera calibration method, measurement method based on binocular measurement device | |
| CN113484239B (en) | Multi-angle appearance detection equipment | |
| CN212483393U (en) | A multi-faceted imaging visual inspection device | |
| CN110849269A (en) | A system and method for measuring geometric dimensions of field corn cob | |
| CN102385692A (en) | Human face deflection image acquiring system and method | |
| WO2016078132A1 (en) | Method and apparatus for alignment and lamination of optical grating and display panel | |
| CN114543667A (en) | A single camera-biprism three-dimensional measurement system and measurement method based on neural network | |
| JP2023528407A (en) | Global shutter synchronized color stereo camera system | |
| CN117154595B (en) | A live working device and target wire identification and positioning method | |
| CN113476014B (en) | System and method for establishing correspondence between dual coordinate systems | |
| CN107749938A (en) | A kind of monocular multi-focus stereo vision apparatus for robot three-dimensional environment sensing | |
| CN114216406A (en) | Novel monocular microscopic three-dimensional measurement device and method | |
| CN109462746B (en) | Image stabilization method and device | |
| CN119090958B (en) | Monocular vision posture estimation method and system based on EPnP algorithm |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17933534 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 17933534 Country of ref document: EP Kind code of ref document: A1 |