[go: up one dir, main page]

CN1419104A - Object space position detector - Google Patents

Object space position detector Download PDF

Info

Publication number
CN1419104A
CN1419104A CN 02158692 CN02158692A CN1419104A CN 1419104 A CN1419104 A CN 1419104A CN 02158692 CN02158692 CN 02158692 CN 02158692 A CN02158692 A CN 02158692A CN 1419104 A CN1419104 A CN 1419104A
Authority
CN
China
Prior art keywords
camera
robot
ultrasonic sensor
detection device
point
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN 02158692
Other languages
Chinese (zh)
Inventor
丁希仑
解玉文
战强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beihang University
Original Assignee
Beihang University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beihang University filed Critical Beihang University
Priority to CN 02158692 priority Critical patent/CN1419104A/en
Publication of CN1419104A publication Critical patent/CN1419104A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Manipulator (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Numerical Control (AREA)

Abstract

本发明公开了一种物体空间位姿检测装置,属于精密自动测量装置,其由装在机器人末端的摄像机和超声传感器、计算机组成,摄像机和超声传感器由数据线与计算机中的图像采集卡和超声信息采集卡相连,机器人由控制总线与计算机相连。本发明的检测装置取代了传统的双目视觉检测,通过单幅图像获取物体上的任意点在图像中的理想坐标,求得该点与摄像机中心连线的方向,然后通过机器人末端的运动,导引超声传感器与未移动前摄像机坐标系的原点重合,而其轴向与求得的连线方向相同,再由超声传感器测出该连线的长度,从而确定该点在摄像机坐标系中的坐标,并可以进一步转换到机器人基坐标系中。通过测量操作物体上的两点的空间坐标,就能够确定物体的空间姿态。本物体位姿检测方法简单易行,计算量小,精度较高。

Figure 02158692

The invention discloses an object space position and posture detection device, belonging to a precision automatic measurement device, which is composed of a camera, an ultrasonic sensor, and a computer installed at the end of a robot. The camera and the ultrasonic sensor are composed of a data line and an image acquisition card and an ultrasonic The information acquisition card is connected, and the robot is connected with the computer by a control bus. The detection device of the present invention replaces the traditional binocular vision detection, obtains the ideal coordinates of any point on the object in the image through a single image, and obtains the direction of the line connecting the point to the center of the camera, and then through the movement of the robot end, The guiding ultrasonic sensor coincides with the origin of the unmoved front camera coordinate system, and its axial direction is the same as the direction of the obtained connection line, and then the length of the connection line is measured by the ultrasonic sensor, so as to determine the position of the point in the camera coordinate system coordinates, and can be further transformed into the robot base coordinate system. By measuring the spatial coordinates of two points on the operating object, the spatial attitude of the object can be determined. The object pose detection method is simple and easy, with small calculation amount and high precision.

Figure 02158692

Description

The object space apparatus for detecting position and posture
Technical field
The present invention relates to a kind of accurate self-operated measuring unit, particularly relate to a kind of object space apparatus for detecting position and posture that carries out the object pose detection by robot, video camera, sonac, computing machine.
Background technology
Along with development of science and technology, robot has obtained application more and more widely, and for example assembling is automatically welded automatically, sprayed paint, the inspection of mechanical component etc.In these were used, the detection of testee pose was the prerequisite that realizes the testee operation.Conventional detection generally all is to utilize binocular vision to realize, but the data volume that this method need be handled is very big, the image matching algorithm in the binocular vision, and also perfect not to the utmost, error is bigger.
Summary of the invention
In order to overcome the deficiency of said method, the present invention proposes a kind of method of new inspected object pose, can only need to gather single sub-picture by video camera and the sonac that is contained in robots arm's end, processing through computing machine just can realize the detection to the testee pose.
A kind of object space apparatus for detecting position and posture of the present invention, form by the video camera that is contained in the robot end and sonac, computing machine, also relating to an object pose detection system is stored in the computing machine, video camera and sonac are installed in the end of robot arm, video camera and sonac are linked to each other with the ultrasound information capture card with image pick-up card in the computing machine by data line, and robot is linked to each other with computing machine by control bus.
Described pick-up unit, its video camera and the sonac fixing position that is arranged in parallel changes differently according to robot construction, be fixed on the end that robot picks up the object parts.
Described pick-up unit detects required information acquisition unit by single camera and single sonac constituent posture.
Described pick-up unit, the pose of object to be detected only need be gathered a sub-picture, by the direction of the point on the Image Acquisition object of camera acquisition and the video camera line of centres, is obtained the length of this line by sonac.
Described pick-up unit, a sub-picture of camera acquisition testee, and passed in the computing machine by video and data line by to treatment of picture, can obtain any 1 P on the object to the projection vector of video camera center O Direction, measure by sonac then Length, thereby can determine the coordinate of a P in camera coordinate system OXYZ, this coordinate can finally be transformed in the basis coordinates system of robot.Image coordinate by point is obtained its ideal coordinates, and corresponding point overlap with the line at video camera center on the point of this ideal coordinates correspondence and the line at video camera center and the object.
Described pick-up unit, sonac can adopt laser sensor.
Described pick-up unit is characterized in that: video camera and sonac also can parallel to the layout and installation at the end of bowl portion of robot.
The position of spatial point generally needs two width of cloth images, determines with the intersection point of two projection lines.The method that the present invention proposes then can add the position that ultrasonic (or laser) range finding can be determined spatial point with piece image.
Compare with binocular vision, the present invention has fundamentally avoided because caused uncertainty of images match and error.After the image coordinate of spatial point was determined, its coordinate in camera coordinate system can just can obtain by simple calculating.Binocular vision then will be carried out images match earlier, and then asks the intersection point of projection line.Obviously the present invention has significantly reduced calculated amount, has improved detection speed.
Description of drawings
Fig. 1 is a structural representation of the present invention.
Fig. 2 is that the direction synoptic diagram of determining projection vector produces.
Fig. 3 is a length synoptic diagram of determining projection vector.
Among the figure: 1. video camera 2. sonacs 3. testees 4. worktable 5. robots 6. computing machines, 7. data lines, 8. control buss, 9. planes of delineation
Embodiment
The present invention is further illustrated below in conjunction with drawings and Examples.
See also shown in Figure 1, object space apparatus for detecting position and posture of the present invention, form by the video camera that is contained in the robot end and sonac, computing machine and the object pose detection system that is stored in the computing machine, single camera and single sonac are installed in the end of robot arm, video camera and sonac are linked to each other with the ultrasound information capture card with image pick-up card in the computing machine by data line, and robot is linked to each other with computing machine by control bus.
In the present invention, testee 3 is placed on the worktable 4, gathers a sub-picture by video camera 1, this image is transferred in the computing machine 6 by video and ultrasound data line 7, and by the operation control software of storage in the computing machine 6 it is handled.For example, set 1 P on testee 3,1 P on the object will measure its coordinate in camera coordinate system OXYZ, needs to determine projection vector
Figure A0215869200051
Direction and length.Consider the distortion that camera lens causes, by the image coordinate P of a P uCan obtain its ideal image coordinate (distortion that the distortion of compensation camera lens causes) P i, because
Figure A0215869200052
Length known (being the camera lens focal distance f) so just can obtain Direction in camera coordinate system,
Figure A0215869200054
Direction be exactly with
Figure A0215869200055
Direction (as shown in Figure 2).By the motion of control robot 5, make the true origin of sonac 2 move to the O point, axis with Overlap, the measured value of sonac 2 is exactly so
Figure A0215869200057
Length.Like this, the coordinate of some P in video camera 1 coordinate system just can obtain, and can finally be converted into the coordinate in 5 basis coordinates system of robot.Can record the project objects center of gravity with this method is the coordinate in space in robot 5 basis coordinates, just the position coordinates of object.Be without loss of generality, can represent the attitude of object with the attitude of the major axis of project objects.The volume coordinate of this two end points can record with said process, just can further calculate the attitude of this axis in basis coordinates system of robot.The position of object and attitude are just decided fully like this.
For example, for the workpiece that is placed on the worktable, establishing its focus point is C, then can record With the angle of each between centers of camera coordinate system be: with the X-axis angle be 68.2694 °, with the Y-axis angle be 60.4186 °, with Z axle clamp angle be 38.1027 °, record Length be 42.2019mm, its coordinate in camera coordinate system is X=5.6250mm so, Y=20.8333mm, Z=33.2089mm, the coordinate of measured workpiece in basis coordinates system of robot is X=27.7815mm, Y=98.6157mm, Z=34.5791mm.The attitude angle of measured workpiece in robot basis coordinates system is: with the X-axis angle be 62.6605 °, with the Y-axis angle be 74.6356 °, with Z axle clamp angle be 32.0197 °.
The method that the present invention proposes can add the position that ultrasonic (or laser) range finding can be determined spatial point with piece image.
Compare with binocular vision, the present invention has fundamentally avoided because caused uncertainty of images match and error.After the image coordinate of spatial point was determined, its coordinate in camera coordinate system can just can obtain by simple calculating.Binocular vision then will be carried out images match earlier, and then asks the intersection point of projection line.Obviously the present invention has significantly reduced calculated amount, has improved detection speed.

Claims (8)

1.一种物体空间位姿检测装置,由机器人、摄像机、超声传感器、计算机组成,其特征在于:还涉及一物体位姿检测系统存储在计算机内,摄像机(1)和超声传感器(2)平行布置安装在机器人手臂的末端,摄像机(1)和超声传感器(2)由数据线与计算机中的图像采集卡和超声信息采集卡相连,机器人(5)由控制总线(8)与计算机(6)相连。1. An object space pose detection device is composed of a robot, a video camera, an ultrasonic sensor, and a computer, and is characterized in that: an object pose detection system is also stored in the computer, and the camera (1) and the ultrasonic sensor (2) are parallel The arrangement is installed on the end of the robot arm, the camera (1) and the ultrasonic sensor (2) are connected with the image acquisition card and the ultrasonic information acquisition card in the computer by the data line, and the robot (5) is connected to the computer (6) by the control bus (8). connected. 2.根据权利要求1所述的检测装置,其特征在于:由单个摄像机(1)和单个超声传感器(2)组成物体位姿检测所需的信息采集单元。2 . The detection device according to claim 1 , characterized in that: a single camera ( 1 ) and a single ultrasonic sensor ( 2 ) constitute an information acquisition unit required for object pose detection. 3 . 3.根据权利要求1所述的检测装置,其特征在于:被检测物体(3)的位姿只需采集一副图像,由摄像机(1)采集的图像获取物体上的点与摄像机(1)中心连线的方向,由超声传感器(2)获取该连线的长度。3. The detection device according to claim 1, characterized in that: the pose of the detected object (3) only needs to collect a pair of images, and the image captured by the camera (1) captures the points on the object and the camera (1) The direction of the central connection line, the length of the connection line is obtained by the ultrasonic sensor (2). 4.根据权利要求1、3所述的检测装置,其特征在于:摄像机(1)采集被测物体(3)的一副图像,并由视频及数据线(7)传到计算机(6)中,通过对图像的处理,可以获得物体上的任意一点P到摄像机(1)中心O的投影矢量 的方向,然后由超声传感器(2)测量 的长度,从而可以确定点P在摄像机坐标系OXYZ中的坐标,该坐标可以最终转换到机器人的基坐标系中。4. The detection device according to claim 1, 3, characterized in that: the camera (1) collects an image of the object (3) to be measured, and transmits it to the computer (6) by the video and data line (7) , by processing the image, the projection vector from any point P on the object to the center O of the camera (1) can be obtained direction, then measured by the ultrasonic sensor (2) The length of , so that the coordinates of point P in the camera coordinate system OXYZ can be determined, and the coordinates can be finally transformed into the base coordinate system of the robot. 5.根据权利要求4所述的检测装置,其特征在于:由点的图像坐标获取其理想坐标,该理想坐标对应的点与摄像机中心的连线与物体上对应点与摄像机中心的连线重合。5. The detection device according to claim 4, characterized in that: its ideal coordinates are obtained by the image coordinates of the point, and the connection line between the point corresponding to the ideal coordinates and the camera center coincides with the connection line between the corresponding point on the object and the camera center . 6.根据权利要求1所述的检测装置,其特征在于:超声传感器(2)可采用激光传感器。6. The detection device according to claim 1, characterized in that: the ultrasonic sensor (2) can be a laser sensor. 7.根据权利要求1所述的检测装置,其特征在于:摄像机(1)和超声传感器(2)平行布置固定的位置根据机器人的结构变化有所不同,固定在机器人拾取物体部件的末端。7. The detection device according to claim 1, characterized in that: the camera (1) and the ultrasonic sensor (2) are arranged in parallel and fixed positions vary according to the structural changes of the robot, and are fixed at the end where the robot picks up object parts. 8.根据权利要求1所述的检测装置,其特征在于:摄像机(1)和超声传感器(2)也可以平行布置安装在机器人碗部的末端。8. The detection device according to claim 1, characterized in that: the camera (1) and the ultrasonic sensor (2) can also be arranged in parallel and installed at the end of the robot bowl.
CN 02158692 2002-12-26 2002-12-26 Object space position detector Pending CN1419104A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 02158692 CN1419104A (en) 2002-12-26 2002-12-26 Object space position detector

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 02158692 CN1419104A (en) 2002-12-26 2002-12-26 Object space position detector

Publications (1)

Publication Number Publication Date
CN1419104A true CN1419104A (en) 2003-05-21

Family

ID=4753152

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 02158692 Pending CN1419104A (en) 2002-12-26 2002-12-26 Object space position detector

Country Status (1)

Country Link
CN (1) CN1419104A (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100375939C (en) * 2003-05-29 2008-03-19 发那科株式会社 Robot system
CN102941569A (en) * 2012-11-01 2013-02-27 李木 Single-rail robot capable of locating and operating target object and control method thereof
CN104298169A (en) * 2014-08-29 2015-01-21 暨南大学韶关研究院 Data converting method of intelligent vision numerical control system
CN105750723A (en) * 2016-04-29 2016-07-13 江苏科技大学 Friction stir welding tool posture and position calibration device and calibration method
CN105750724A (en) * 2016-04-29 2016-07-13 江苏科技大学 Laser calibration device and calibration method for friction stir welding
CN107255463A (en) * 2017-05-26 2017-10-17 珠海格力电器股份有限公司 Positioning measurement device and positioning measurement method
CN108291803A (en) * 2015-09-17 2018-07-17 瓦卢瑞克图沃斯巴西股份公司 The automatic system and method for end for measuring and processing tubular element
CN110036162A (en) * 2016-09-30 2019-07-19 新加坡-Eth研究中心 For object to be placed system and method on the surface

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100375939C (en) * 2003-05-29 2008-03-19 发那科株式会社 Robot system
CN102941569A (en) * 2012-11-01 2013-02-27 李木 Single-rail robot capable of locating and operating target object and control method thereof
CN104298169A (en) * 2014-08-29 2015-01-21 暨南大学韶关研究院 Data converting method of intelligent vision numerical control system
CN108291803A (en) * 2015-09-17 2018-07-17 瓦卢瑞克图沃斯巴西股份公司 The automatic system and method for end for measuring and processing tubular element
CN105750723A (en) * 2016-04-29 2016-07-13 江苏科技大学 Friction stir welding tool posture and position calibration device and calibration method
CN105750724A (en) * 2016-04-29 2016-07-13 江苏科技大学 Laser calibration device and calibration method for friction stir welding
CN110036162A (en) * 2016-09-30 2019-07-19 新加坡-Eth研究中心 For object to be placed system and method on the surface
CN110036162B (en) * 2016-09-30 2021-04-02 新加坡-Eth研究中心 System and method for placing objects on surfaces
CN107255463A (en) * 2017-05-26 2017-10-17 珠海格力电器股份有限公司 Positioning measurement device and positioning measurement method

Similar Documents

Publication Publication Date Title
CN105547153B (en) Plug-in component stitch visual positioning method and device based on binocular vision
CN102782721B (en) System and method for runtime determination of camera calibration error
CN108965690B (en) Image processing system, image processing apparatus, and computer-readable storage medium
CN110842901B (en) Robot hand-eye calibration method and device based on novel three-dimensional calibration block
CN112589232B (en) A welding seam tracking method and device based on independent rectification deep learning
CN110717943A (en) Eye-on-hand manipulator hand-eye calibration method and system for two-dimensional plane
CN112230345A (en) Optical fiber automatic coupling alignment device and method
CN1203290C (en) Contact type object position and gesture measurer
CN113689509A (en) Binocular vision-based disordered grabbing method and system and storage medium
CN115890638B (en) Automated robotic arm system
CN115078961A (en) Desktop-level circuit board detection device and method based on visual feedback mechanical arm
CN1419104A (en) Object space position detector
CN118744434A (en) Automatic plugging and unplugging method of charging gun for mobile charging robot based on active visual positioning technology
CN108788550A (en) Detection device, the control method and device that areola welding bead is detected using detection device
JP6973233B2 (en) Image processing system, image processing device and image processing program
Edwards et al. A review of current research in 3-D machine vision and robot accuracy
JP2020075327A (en) Control system
CN112001945A (en) Multi-robot monitoring method suitable for production line operation
JP7476814B2 (en) Inspection Equipment
CN205482791U (en) Plug -in components component stitch vision positioning device based on binocular vision
WO2022124232A1 (en) Image processing system and image processing method
CN116393982B (en) Screw locking method and device based on machine vision
CN119779640A (en) A device and method for detecting the response time of a curved screen of an automobile
CN2645034Y (en) Object space pose detection apparatus
CN114902281B (en) Image processing system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C57 Notification of unclear or unknown address
DD01 Delivery of document by public notice

Addressee: Zhou Changqi

Document name: Deemed as a notice of withdrawal (Trial)

C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication