[go: up one dir, main page]

CN110807814A - Camera pose calculation method, device, equipment and storage medium - Google Patents

Camera pose calculation method, device, equipment and storage medium Download PDF

Info

Publication number
CN110807814A
CN110807814A CN201911042937.4A CN201911042937A CN110807814A CN 110807814 A CN110807814 A CN 110807814A CN 201911042937 A CN201911042937 A CN 201911042937A CN 110807814 A CN110807814 A CN 110807814A
Authority
CN
China
Prior art keywords
pose
coordinate system
camera
virtual space
preset
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911042937.4A
Other languages
Chinese (zh)
Inventor
吴迪云
许秋子
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Realis Multimedia Technology Co Ltd
Original Assignee
Shenzhen Realis Multimedia Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Realis Multimedia Technology Co Ltd filed Critical Shenzhen Realis Multimedia Technology Co Ltd
Priority to CN202210440436.7A priority Critical patent/CN114820814A/en
Priority to CN201911042937.4A priority patent/CN110807814A/en
Publication of CN110807814A publication Critical patent/CN110807814A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/80Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10048Infrared image

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

The invention discloses a method, a device and equipment for calculating the attitude of a camera and a storage medium, wherein the method comprises the following steps: acquiring N groups of coordinate parameters corresponding to N different positions of a pose calibration plate of an infrared camera in an optical virtual space coordinate system, wherein a preset number of light reflecting pastes are pasted on one surface of the pose calibration plate, one light reflecting paste is pasted on a preset central point of the pose calibration plate, the optical virtual space coordinate system is a preset three-dimensional world coordinate system, each group of coordinate parameters comprises a three-dimensional coordinate of the preset central point in the optical virtual space coordinate system and a two-dimensional coordinate in a preset image coordinate system, and N is a preset value; obtaining pre-stored internal parameters of the infrared camera; and substituting the acquired N groups of coordinate parameters and internal parameters into a preset camera attitude estimation algorithm for calculation to obtain the pose of the infrared camera in the optical virtual space coordinate system. The invention realizes the calculation of the pose of the infrared camera in the virtual space coordinate system.

Description

摄影机位姿计算方法、装置、设备及存储介质Camera pose calculation method, device, equipment and storage medium

技术领域technical field

本发明涉及计算机视觉技术领域,尤其涉及摄影机位姿计算方法、装置、设备及存储介质。The present invention relates to the technical field of computer vision, and in particular, to a camera pose calculation method, device, device and storage medium.

背景技术Background technique

近年来,虚实混合拍摄系统已经广泛应用于影视剧拍摄行业,该系统有三个主要特点:(1)摄影机画面投影在虚拟场景中;(2)真实摄影机和虚拟摄影机在虚拟3D空间中位姿同步;(3)实时运行。虚实混合拍摄运用的是混合现实(mixed reality,MR)技术,混合现实技术是虚拟现实技术的进一步发展,该技术通过在真实场景中引入虚拟3D信息或者在虚拟3D环境中叠加真实环境信息,能够增强用户体验的真实感。In recent years, the virtual-real hybrid shooting system has been widely used in the film and television drama shooting industry. The system has three main features: (1) the camera image is projected in the virtual scene; (2) the real camera and the virtual camera are synchronized in the virtual 3D space. ; (3) real-time operation. Mixed reality (MR) technology is used in mixed reality shooting, which is a further development of virtual reality technology. Enhance the realism of the user experience.

在虚实混合拍摄系统中,为能够同时从真实摄影机和虚拟摄影机视角看到叠加后的可视化三维世界,真实摄影机和虚拟摄影机的位姿必须保持同步,这就需要将真实摄影机的机体坐标系转换到虚拟空间坐标系中,也即需要求得摄影机在虚拟空间坐标系下的位姿。目前,缺乏一种基于红外相机空间定位技术计算红外摄影机在虚拟空间坐标系下的位姿的方法。In the virtual-real hybrid shooting system, in order to be able to see the superimposed visual 3D world from the perspective of the real camera and the virtual camera at the same time, the poses of the real camera and the virtual camera must be synchronized, which requires the transformation of the body coordinate system of the real camera to In the virtual space coordinate system, that is, the pose of the camera in the virtual space coordinate system needs to be obtained. At present, there is a lack of a method for calculating the pose of an infrared camera in a virtual space coordinate system based on an infrared camera spatial positioning technology.

发明内容SUMMARY OF THE INVENTION

本发明的主要目的在于提出一种摄影机位姿计算方法、装置、设备及存储介质,旨在实现计算红外摄影机在虚拟空间坐标系下的位姿。The main purpose of the present invention is to propose a camera pose calculation method, device, equipment and storage medium, aiming at realizing the calculation of the pose of an infrared camera in a virtual space coordinate system.

为实现上述目的,本发明提供一种摄影机位姿计算方法,所述方法包括如下步骤:In order to achieve the above purpose, the present invention provides a camera pose calculation method, the method includes the following steps:

采集红外摄影机的位姿标定板在光学虚拟空间坐标系下的N个不同位置所对应的N组坐标参数,其中,所述位姿标定板的一个表面上粘贴有预设数量的反光贴,其中一个反光贴粘贴在所述位姿标定板的预设中心点上,所述光学虚拟空间坐标系为预设的三维世界的坐标系,每组坐标参数包括所述预设中心点在所述光学虚拟空间坐标系下的三维坐标,以及在预设图像坐标系中的二维坐标,N为预设值;Collect N sets of coordinate parameters corresponding to N different positions of the pose calibration board of the infrared camera in the optical virtual space coordinate system, wherein a preset number of reflective stickers are pasted on one surface of the pose calibration board, wherein A reflective sticker is pasted on the preset center point of the pose calibration plate, the optical virtual space coordinate system is a preset coordinate system of the three-dimensional world, and each set of coordinate parameters includes the preset center point in the optical The three-dimensional coordinates in the virtual space coordinate system and the two-dimensional coordinates in the preset image coordinate system, N is the preset value;

获取预先保存的所述红外摄影机的内参;obtaining the pre-saved internal parameters of the infrared camera;

将采集到的所述N组坐标参数和所述内参代入预设的相机姿态估计算法中进行计算,得到所述红外摄影机在所述光学虚拟空间坐标系下的位姿。Substitute the collected N sets of coordinate parameters and the internal reference into a preset camera pose estimation algorithm for calculation to obtain the pose of the infrared camera in the optical virtual space coordinate system.

可选地,在粘贴有反光贴的所述表面上还设置有一张二维码图像;Optionally, a two-dimensional code image is also provided on the surface pasted with the reflective stickers;

所述采集红外摄影机的位姿标定板在光学虚拟空间坐标系下的N个不同位置所对应的N组坐标参数的步骤之前,还包括:Before the step of collecting the N groups of coordinate parameters corresponding to N different positions of the infrared camera's pose calibration board in the optical virtual space coordinate system, the method further includes:

接收中心点设置指令,根据所述中心点设置指令将所述二维码图像的一个角点设置为所述位姿标定板的中心点。A center point setting instruction is received, and a corner point of the two-dimensional code image is set as the center point of the pose calibration board according to the center point setting instruction.

可选地,所述采集红外摄影机的位姿标定板在光学虚拟空间坐标系下的N个不同位置所对应的N组坐标参数的步骤之前,还包括:Optionally, before the step of collecting N sets of coordinate parameters corresponding to N different positions of the infrared camera's pose calibration board in the optical virtual space coordinate system, the method further includes:

接收坐标系设置指令,根据所述坐标系设置指令设置光学虚拟空间坐标系和图像坐标系。A coordinate system setting instruction is received, and an optical virtual space coordinate system and an image coordinate system are set according to the coordinate system setting instruction.

可选地,所述将采集到的所述N组坐标参数和所述内参代入预设的相机姿态估计算法中进行计算,得到所述红外摄影机在所述光学虚拟空间坐标系下的位姿的步骤包括:Optionally, substituting the collected N sets of coordinate parameters and the internal reference into a preset camera pose estimation algorithm for calculation to obtain the pose of the infrared camera in the optical virtual space coordinate system. Steps include:

将采集到的所述N组坐标参数和所述内参代入相机姿态估计算法EPNP中,计算得到所述光学虚拟空间坐标系到所述红外摄影机的位姿转换数据,所述位姿转换数据包括旋转矩阵和平移向量;Substitute the collected N sets of coordinate parameters and the internal reference into the camera attitude estimation algorithm EPNP, and calculate the pose transformation data from the optical virtual space coordinate system to the infrared camera, where the pose transformation data includes rotation. matrix and translation vector;

根据所述位姿转换数据计算所述红外摄影机在所述光学虚拟空间坐标系下的位姿。The pose of the infrared camera in the optical virtual space coordinate system is calculated according to the pose transformation data.

可选地,所述根据所述位姿转换数据计算所述红外摄影机在所述光学虚拟空间坐标系下的位姿的步骤包括:Optionally, the step of calculating the pose of the infrared camera in the optical virtual space coordinate system according to the pose transformation data includes:

根据公式

Figure BDA0002253348350000021
分别计算所述红外摄影机在所述光学虚拟空间坐标系下的位置tc和姿态rc;According to the formula
Figure BDA0002253348350000021
and respectively calculating the position t c and the attitude rc of the infrared camera in the optical virtual space coordinate system;

其中,

Figure BDA0002253348350000023
为所述旋转矩阵,
Figure BDA0002253348350000024
为所述平移向量。in,
Figure BDA0002253348350000023
is the rotation matrix,
Figure BDA0002253348350000024
is the translation vector.

此外,为实现上述目的,本发明还提供一种摄影机位姿计算装置,所述装置包括:In addition, in order to achieve the above object, the present invention also provides a camera pose calculation device, the device comprising:

采集模块,用于采集红外摄影机的位姿标定板在光学虚拟空间坐标系下的N个不同位置所对应的N组坐标参数,其中,所述位姿标定板的一个表面上粘贴有预设数量的反光贴,其中一个反光贴粘贴在所述位姿标定板的预设中心点上,所述光学虚拟空间坐标系为预设的三维世界的坐标系,每组坐标参数包括所述预设中心点在所述光学虚拟空间坐标系下的三维坐标,以及在预设图像坐标系中的二维坐标,N为预设值;The acquisition module is used to collect N sets of coordinate parameters corresponding to N different positions of the infrared camera's pose calibration board in the optical virtual space coordinate system, wherein a surface of the pose calibration board is pasted with a preset number of reflective stickers, one of which is pasted on the preset center point of the pose calibration board, the optical virtual space coordinate system is the preset three-dimensional world coordinate system, and each set of coordinate parameters includes the preset center the three-dimensional coordinates of the point in the optical virtual space coordinate system, and the two-dimensional coordinates in the preset image coordinate system, where N is a preset value;

获取模块,用于获取预先保存的所述红外摄影机的内参;an acquisition module for acquiring the pre-saved internal parameters of the infrared camera;

计算模块,用于将采集到的所述N组坐标参数和所述内参代入预设的相机姿态估计算法中进行计算,得到所述红外摄影机在所述光学虚拟空间坐标系下的位姿。The calculation module is used for substituting the collected N sets of coordinate parameters and the internal reference into a preset camera attitude estimation algorithm for calculation, so as to obtain the pose of the infrared camera in the optical virtual space coordinate system.

此外,为实现上述目的,本发明还提供一种摄影机位姿计算设备,所述设备包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的摄影机位姿计算程序,所述摄影机位姿计算程序被所述处理器执行时实现如上所述的摄影机位姿计算方法的步骤。In addition, in order to achieve the above object, the present invention also provides a camera pose calculation device, the device includes: a memory, a processor, and a camera pose calculation program stored on the memory and running on the processor , when the camera pose calculation program is executed by the processor to implement the steps of the camera pose calculation method as described above.

此外,为实现上述目的,本发明还提供一种存储介质,所述存储介质上存储有摄影机位姿计算程序,所述摄影机位姿计算程序被处理器执行时实现如上所述的摄影机位姿计算方法的步骤。In addition, in order to achieve the above object, the present invention also provides a storage medium on which a camera pose calculation program is stored, and when the camera pose calculation program is executed by a processor, the above-mentioned camera pose calculation is realized steps of the method.

本发明通过在红外摄影机的位姿标定板的表面上粘贴预设数量的反光贴,能够便于红外摄影机基于反光贴对位姿标定板在光学虚拟空间中的位置进行定位,其中一个反光贴粘贴在预设中心点上,能够便于通过红外摄影机采集该中心点在所述光学虚拟空间坐标系下的三维坐标;通过采集红外摄影机的位姿标定板在光学虚拟空间坐标系下的N个不同位置所对应的N组坐标参数,然后将采集到的N组坐标参数和预先保存的红外摄影机的内参代入预设的相机姿态估计算法中进行计算,能够得到红外摄影机在光学虚拟空间坐标系下的位姿。In the present invention, a preset number of reflective stickers are pasted on the surface of the posture calibration plate of the infrared camera, so that the infrared camera can locate the position of the posture calibration plate in the optical virtual space based on the reflective stickers, and one of the reflective stickers is pasted on the optical virtual space. On the preset center point, it is convenient to collect the three-dimensional coordinates of the center point under the optical virtual space coordinate system through the infrared camera; The corresponding N sets of coordinate parameters, and then the collected N sets of coordinate parameters and the pre-saved internal reference of the infrared camera are substituted into the preset camera pose estimation algorithm for calculation, and the pose of the infrared camera in the optical virtual space coordinate system can be obtained. .

附图说明Description of drawings

图1是本发明实施例方案涉及的硬件运行环境的设备结构示意图;1 is a schematic diagram of a device structure of a hardware operating environment involved in an embodiment of the present invention;

图2为本发明摄影机位姿计算方法一实施例的流程示意图;FIG. 2 is a schematic flowchart of an embodiment of a camera pose calculation method according to the present invention;

图3为本发明摄影机位姿计算装置一实施例的模块示意图。FIG. 3 is a schematic block diagram of an embodiment of a camera pose calculation apparatus according to the present invention.

本发明目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The realization, functional characteristics and advantages of the present invention will be further described with reference to the accompanying drawings in conjunction with the embodiments.

具体实施方式Detailed ways

应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.

如图1所示,图1是本发明实施例方案涉及的硬件运行环境的设备结构示意图。As shown in FIG. 1 , FIG. 1 is a schematic diagram of a device structure of a hardware operating environment involved in an embodiment of the present invention.

本发明实施例摄影机位姿计算设备可以是计算机或服务器。The camera pose computing device in this embodiment of the present invention may be a computer or a server.

如图1所示,该摄影机位姿计算设备可以包括:处理器1001,例如CPU,网络接口1004,用户接口1003,存储器1005,通信总线1002。其中,通信总线1002用于实现这些组件之间的连接通信。用户接口1003可以包括显示屏(Display)、输入单元比如键盘(Keyboard),可选用户接口1003还可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线接口、无线接口(如WI-FI接口)。存储器1005可以是高速RAM存储器,也可以是稳定的存储器(non-volatile memory),例如磁盘存储器。存储器1005可选的还可以是独立于前述处理器1001的存储装置。As shown in FIG. 1 , the camera pose computing device may include: a processor 1001 , such as a CPU, a network interface 1004 , a user interface 1003 , a memory 1005 , and a communication bus 1002 . Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. Optionally, the network interface 1004 may include a standard wired interface and a wireless interface (eg, a WI-FI interface). The memory 1005 may be high-speed RAM memory, or may be non-volatile memory, such as disk memory. Optionally, the memory 1005 may also be a storage device independent of the aforementioned processor 1001 .

本领域技术人员可以理解,图1中示出的设备结构并不构成对设备的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。Those skilled in the art can understand that the device structure shown in FIG. 1 does not constitute a limitation on the device, and may include more or less components than the one shown, or combine some components, or arrange different components.

如图1所示,作为一种计算机存储介质的存储器1005中可以包括操作系统、网络通信模块、用户接口模块以及摄影机位姿计算程序。As shown in FIG. 1 , the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a camera pose calculation program.

在图1所示的终端中,网络接口1004主要用于连接红外摄影机,与红外摄影机进行数据通信;用户接口1003主要用于连接客户端(用户端),与客户端进行数据通信;而处理器1001可以用于调用存储器1005中存储的摄影机位姿计算程序,并执行下述摄影机位姿计算方法各个实施例中的操作。In the terminal shown in FIG. 1 , the network interface 1004 is mainly used to connect an infrared camera and perform data communication with the infrared camera; the user interface 1003 is mainly used to connect a client (client) and perform data communication with the client; and the processor 1001 can be used to call the camera pose calculation program stored in the memory 1005, and perform the operations in various embodiments of the camera pose calculation method described below.

基于上述硬件结构,提出本发明摄影机位姿计算方法实施例。Based on the above hardware structure, an embodiment of the camera pose calculation method of the present invention is proposed.

参照图2,图2为本发明摄影机位姿计算方法一实施例的流程示意图,所述方法包括:Referring to FIG. 2, FIG. 2 is a schematic flowchart of an embodiment of a camera pose calculation method according to the present invention. The method includes:

步骤S10,采集红外摄影机的位姿标定板在光学虚拟空间坐标系下的N个不同位置所对应的N组坐标参数,其中,位姿标定板的一个表面上粘贴有预设数量的反光贴,其中一个反光贴粘贴在位姿标定板的预设中心点上,光学虚拟空间坐标系为预设的三维世界的坐标系,每组坐标参数包括预设中心点在光学虚拟空间坐标系下的三维坐标,以及在预设图像坐标系中的二维坐标,N为预设值;Step S10, collecting N groups of coordinate parameters corresponding to N different positions of the pose calibration board of the infrared camera in the optical virtual space coordinate system, wherein a preset number of reflective stickers are pasted on one surface of the pose calibration board, One of the reflective stickers is pasted on the preset center point of the pose calibration board. The optical virtual space coordinate system is the preset coordinate system of the three-dimensional world. Each set of coordinate parameters includes the three-dimensional coordinate system of the preset center point in the optical virtual space coordinate system. coordinates, and the two-dimensional coordinates in the preset image coordinate system, N is the preset value;

在本实施例中,为计算红外摄影机在光学虚拟空间坐标系中的位姿,需首先制作一个位姿标定板,该位姿标定板的尺寸可以灵活设置,比如40*40cm,此外,该位姿标定板上可以固定反光球或贴上反光贴作为光学空间下的一个刚体(指在运动中和受力作用后,形状和大小不变,而且内部各点的相对位置不变的物体),本实施例中在位姿标定板的一个表面上粘贴预设数量的反光贴,能够便于红外摄影机基于反光贴对位姿标定板在光学虚拟空间中的位置进行定位,其中一个反光贴粘贴在位姿标定板的预设中心点上,能够便于通过红外摄影机采集该中心点在光学虚拟空间坐标系下的三维坐标。In this embodiment, in order to calculate the pose of the infrared camera in the optical virtual space coordinate system, a pose calibration board needs to be made first. The size of the pose calibration board can be set flexibly, such as 40*40cm. A reflective ball can be fixed on the attitude calibration board or a reflective sticker can be attached as a rigid body in the optical space (referring to an object whose shape and size remain unchanged during motion and after being subjected to force, and the relative position of each internal point remains unchanged), In this embodiment, a preset number of reflective stickers are pasted on one surface of the pose calibration board, which can facilitate the infrared camera to locate the position of the pose calibration board in the optical virtual space based on the reflective stickers. One of the reflective stickers is pasted in place. On the preset center point of the attitude calibration plate, it is convenient to collect the three-dimensional coordinates of the center point in the optical virtual space coordinate system through the infrared camera.

进一步地,上述步骤S10之前,还可以包括:接收坐标系设置指令,根据坐标系设置指令设置光学虚拟空间坐标系和图像坐标系。Further, before the above step S10, the method may further include: receiving a coordinate system setting instruction, and setting the optical virtual space coordinate system and the image coordinate system according to the coordinate system setting instruction.

为方便理解,下面简要介绍现有的摄影机标定过程中要用到的几个坐标系:For ease of understanding, the following briefly introduces several coordinate systems used in the existing camera calibration process:

世界坐标系,由于摄影机可安放在任意位置,在环境中选择一个基准坐标来描述摄影机的位置,并用它描述环境中任何物体的位置,该坐标系称为世界坐标系。The world coordinate system, since the camera can be placed in any position, select a reference coordinate in the environment to describe the position of the camera, and use it to describe the position of any object in the environment, this coordinate system is called the world coordinate system.

摄影机坐标系:在摄影机上建立的坐标系,为了从摄影机的角度描述物体位置而定义,作为沟通世界坐标系和图像/像素坐标系的中间一环。Camera coordinate system: The coordinate system established on the camera is defined to describe the position of the object from the camera's point of view, as an intermediate link between the world coordinate system and the image/pixel coordinate system.

图像坐标系:每幅数字图像在计算机内为M*N数组,M行N列的图像中的每一个元素(称为像素,pixel)的数值即是图像点的灰度值。在图像中定义直角坐标系u,v,每一像素的坐标(u,v)分别是该像素在数组中的列数和行数,所以(u,v)是以像素为单位的图像坐标系坐标。Image coordinate system: Each digital image is an M*N array in the computer, and the value of each element (called pixel) in the image with M rows and N columns is the gray value of the image point. Define the rectangular coordinate system u, v in the image, the coordinates (u, v) of each pixel are the number of columns and rows of the pixel in the array, so (u, v) is the image coordinate system in pixel units coordinate.

像素坐标系:为了描述物体成像后的像点在数字图像上(相片)的坐标而引入,是我们真正从摄影机内读取到的信息所在的坐标系。Pixel coordinate system: Introduced to describe the coordinates of the image point on the digital image (photo) after the object is imaged. It is the coordinate system where the information we actually read from the camera is located.

在本实施例中,光学虚拟空间坐标系即上述世界坐标系,图像坐标系为摄影机坐标系和像素坐标系之间的过渡坐标系,光学虚拟空间坐标系和图像坐标系均由人为设定。In this embodiment, the optical virtual space coordinate system is the above-mentioned world coordinate system, the image coordinate system is a transition coordinate system between the camera coordinate system and the pixel coordinate system, and both the optical virtual space coordinate system and the image coordinate system are manually set.

在制作好位姿标定板,并设置好光学虚拟空间坐标系和图像坐标系后,通过在三维空间中移动位姿标定板采集数据,即可通过采集到的数据计算摄影机位姿。以执行摄影机位姿计算方法的设备为服务器进行说明。首先由红外摄影机捕捉位姿标定板在光学虚拟空间坐标系下的N个不同位置的图像,将该图像发送给服务器,由此服务器能够通过红外摄影机采集到这N个不同位置所对应的N组坐标参数,其中每组坐标参数包括位姿标定板的中心点在光学虚拟空间坐标系下的三维坐标,记为Ri=(xi,yi,zi),以及在预设图像坐标系中的二维坐标,记为Qi=(Ui,Vi),i为位置序号,x、y、z为三维坐标,U、V为像素坐标。After the pose calibration board is made, and the optical virtual space coordinate system and the image coordinate system are set, the camera pose can be calculated by moving the pose calibration board in the three-dimensional space to collect data. The description will take the device that executes the camera pose calculation method as the server. First, the infrared camera captures images of N different positions of the pose calibration board in the optical virtual space coordinate system, and sends the images to the server, so that the server can collect the N groups corresponding to the N different positions through the infrared camera Coordinate parameters, wherein each set of coordinate parameters includes the three-dimensional coordinates of the center point of the pose calibration plate in the optical virtual space coordinate system, denoted as R i =(x i ,y i ,z i ), and in the preset image coordinate system The two-dimensional coordinates in , denoted as Q i =(U i ,V i ), i is the position serial number, x, y, z are three-dimensional coordinates, and U, V are pixel coordinates.

需要说明的是,位姿标定板的中心点可以灵活设置,比如可以是位姿标定板表面的几何中心,也可以是其他指定的位置;N的取值可以灵活设置,比如取8~20之间的任意整数,即采集8~20组坐标参数。It should be noted that the center point of the pose calibration board can be set flexibly, for example, it can be the geometric center of the surface of the pose calibration board, or it can be other designated positions; the value of N can be set flexibly, for example, it can be set between 8 and 20. Any integer between , that is, 8 to 20 sets of coordinate parameters are collected.

在一实施方式中,可以在粘贴有反光贴的标定板表面上设置有一张二维码图像,上述步骤S10之前,还可以包括:接收中心点设置指令,根据中心点设置指令将二维码图像的一个角点设置为位姿标定板的中心点。In one embodiment, a two-dimensional code image may be provided on the surface of the calibration plate pasted with the reflective sticker. Before the above-mentioned step S10, it may also include: receiving a center point setting instruction, and converting one of the two-dimensional code images according to the center point setting instruction. The corner point is set as the center point of the pose calibration plate.

具体地,服务器接收中心点设置指令,根据该指令将二维码图像的一个角点设置为位姿标定板的中心点,需要说明的是,可以将二维码图像四个角点中的任一角点(左上角点、左下角点、右上角点、右下角点中的任一个)设置为位姿标定板的中心点。由于服务器较易识别二维码图像,因此通过将二维码图像的任一角点设置为位姿标定板的中心点,能够便于服务器从多个反光标记点中快速定位中心点,进而获取中心点在图像坐标系中的二维坐标。Specifically, the server receives the center point setting instruction, and according to the instruction, sets one corner of the two-dimensional code image as the center point of the pose calibration board. It should be noted that any one of the four corner points of the two-dimensional code image can be set. A corner point (any one of the upper left corner point, the lower left corner point, the upper right corner point, and the lower right corner point) is set as the center point of the pose calibration board. Since it is easier for the server to recognize the QR code image, by setting any corner of the QR code image as the center point of the pose calibration board, it is convenient for the server to quickly locate the center point from multiple reflective markers, and then obtain the center point. Two-dimensional coordinates in the image coordinate system.

步骤S20,获取预先保存的红外摄影机的内参;Step S20, acquiring the pre-saved internal parameters of the infrared camera;

该步骤中,服务器获取预先保存的红外摄影机的内参,内参即内部参数,用于确定摄影机从三维空间到二维图像的投影关系。内参只与摄影机光学特性和机械特性有关,是摄影机固有的属性。内参包括焦距,主点,缩放比例因子和摄影机畸变因子。In this step, the server obtains the pre-saved internal parameters of the infrared camera, the internal parameters are internal parameters, and are used to determine the projection relationship of the camera from the three-dimensional space to the two-dimensional image. Internal parameters are only related to the optical and mechanical properties of the camera, and are inherent properties of the camera. Intrinsic parameters include focal length, principal point, scaling factor and camera distortion factor.

步骤S30,将采集到的N组坐标参数和内参代入预设的相机姿态估计算法中进行计算,得到红外摄影机在光学虚拟空间坐标系下的位姿。Step S30: Substitute the collected N sets of coordinate parameters and internal reference into a preset camera pose estimation algorithm for calculation, and obtain the pose of the infrared camera in the optical virtual space coordinate system.

该步骤中,服务器将采集到的上述N组坐标参数以及红外摄影机的内参代入预设的相机姿态估计算法中进行计算,即可得到红外摄影机在光学虚拟空间坐标系下的位姿。In this step, the server substitutes the collected N sets of coordinate parameters and the internal reference of the infrared camera into a preset camera pose estimation algorithm for calculation, so as to obtain the pose of the infrared camera in the optical virtual space coordinate system.

具体地,该步骤S30可以进一步包括:将采集到的N组坐标参数和内参代入相机姿态估计算法EPNP中,计算得到光学虚拟空间坐标系到红外摄影机的位姿转换数据,位姿转换数据包括旋转矩阵和平移向量;根据位姿转换数据计算红外摄影机在光学虚拟空间坐标系下的位姿。Specifically, this step S30 may further include: substituting the collected N sets of coordinate parameters and internal reference into the camera attitude estimation algorithm EPNP, and calculating the pose transformation data from the optical virtual space coordinate system to the infrared camera, and the pose transformation data includes rotation. Matrix and translation vector; calculate the pose of the infrared camera in the optical virtual space coordinate system according to the pose transformation data.

服务器将采集到的N组坐标参数以及红外摄影机的内参作为输入参数代入相机位姿估计算法(efficientperspective-n-point,EPNP)中,可以计算得到光学虚拟空间坐标系到红外摄影机的位姿转换数据,该位姿转换数据包括旋转矩阵

Figure BDA0002253348350000071
和平移向量进而根据
Figure BDA0002253348350000073
Figure BDA0002253348350000074
可以计算出红外摄影机在光学虚拟空间坐标系下的位姿,其中,根据相机位姿估计算法EPNP计算旋转矩阵
Figure BDA0002253348350000075
和平移向量
Figure BDA0002253348350000076
的具体方式可以参照现有技术,此处不做赘述。The server takes the collected N sets of coordinate parameters and the internal parameters of the infrared camera as input parameters into the camera pose estimation algorithm (efficient perspective-n-point, EPNP), and can calculate the pose transformation data from the optical virtual space coordinate system to the infrared camera. , the pose transformation data includes the rotation matrix
Figure BDA0002253348350000071
and translation vector and then according to
Figure BDA0002253348350000073
and
Figure BDA0002253348350000074
The pose of the infrared camera in the optical virtual space coordinate system can be calculated, wherein the rotation matrix is calculated according to the camera pose estimation algorithm EPNP
Figure BDA0002253348350000075
and translation vector
Figure BDA0002253348350000076
For the specific manner, reference may be made to the prior art, which will not be repeated here.

进一步地,根据位姿转换数据计算红外摄影机在光学虚拟空间坐标系下的位姿的步骤可以包括:根据公式

Figure BDA0002253348350000078
分别计算红外摄影机在光学虚拟空间坐标系下的位置tc和姿态rc;其中,
Figure BDA0002253348350000079
为旋转矩阵,
Figure BDA00022533483500000710
为平移向量。Further, the step of calculating the pose of the infrared camera in the optical virtual space coordinate system according to the pose transformation data may include: according to the formula and
Figure BDA0002253348350000078
Calculate the position t c and attitude rc of the infrared camera in the optical virtual space coordinate system respectively; where,
Figure BDA0002253348350000079
is the rotation matrix,
Figure BDA00022533483500000710
is the translation vector.

在本实施例中,通过在红外摄影机的位姿标定板的表面上粘贴预设数量的反光贴,能够便于红外摄影机基于反光贴对位姿标定板在光学虚拟空间中的位置进行定位,其中一个反光贴粘贴在预设中心点上,能够便于通过红外摄影机采集该中心点在光学虚拟空间坐标系下的三维坐标;通过采集红外摄影机的位姿标定板在光学虚拟空间坐标系下的N个不同位置所对应的N组坐标参数,然后将采集到的N组坐标参数和预先保存的红外摄影机的内参代入预设的相机姿态估计算法中进行计算,能够得到红外摄影机在光学虚拟空间坐标系下的位姿。In this embodiment, by pasting a preset number of reflective stickers on the surface of the pose calibration plate of the infrared camera, it is convenient for the infrared camera to locate the position of the pose calibration board in the optical virtual space based on the reflective stickers, one of which The reflective sticker is pasted on the preset center point, which can easily collect the three-dimensional coordinates of the center point in the optical virtual space coordinate system through the infrared camera; by collecting N different positions of the infrared camera's pose calibration board in the optical virtual space coordinate system The N sets of coordinate parameters corresponding to the position, and then the collected N sets of coordinate parameters and the pre-saved internal parameters of the infrared camera are substituted into the preset camera attitude estimation algorithm for calculation, and the infrared camera in the optical virtual space coordinate system can be obtained. pose.

本发明还提供一种摄影机位姿计算装置。参照图3,图3为本发明摄影机位姿计算装置一实施例的模块示意图。本实施例中,所述摄影机位姿计算装置包括:The invention also provides a camera pose calculation device. Referring to FIG. 3 , FIG. 3 is a schematic block diagram of an embodiment of a camera pose calculation apparatus according to the present invention. In this embodiment, the camera pose calculation device includes:

采集模块10,用于采集红外摄影机的位姿标定板在光学虚拟空间坐标系下的N个不同位置所对应的N组坐标参数,其中,所述位姿标定板的一个表面上粘贴有预设数量的反光贴,其中一个反光贴粘贴在所述位姿标定板的预设中心点上,所述光学虚拟空间坐标系为预设的三维世界的坐标系,每组坐标参数包括所述预设中心点在所述光学虚拟空间坐标系下的三维坐标,以及在预设图像坐标系中的二维坐标,N为预设值;The acquisition module 10 is used to collect N sets of coordinate parameters corresponding to N different positions of the pose calibration board of the infrared camera in the optical virtual space coordinate system, wherein a surface of the pose calibration board is pasted with a preset A number of reflective stickers, one of which is pasted on the preset center point of the pose calibration board, the optical virtual space coordinate system is a preset three-dimensional world coordinate system, and each set of coordinate parameters includes the preset the three-dimensional coordinates of the center point in the optical virtual space coordinate system, and the two-dimensional coordinates in the preset image coordinate system, where N is a preset value;

获取模块20,用于获取预先保存的所述红外摄影机的内参;an acquisition module 20, configured to acquire the pre-saved internal parameters of the infrared camera;

计算模块30,用于将采集到的所述N组坐标参数和所述内参代入预设的相机姿态估计算法中进行计算,得到所述红外摄影机在所述光学虚拟空间坐标系下的位姿。The calculation module 30 is used for substituting the collected N sets of coordinate parameters and the internal reference into a preset camera pose estimation algorithm for calculation to obtain the pose of the infrared camera in the optical virtual space coordinate system.

进一步地,在粘贴有反光贴的所述表面上还设置有一张二维码图像;所述摄影机位姿计算装置还包括:Further, a two-dimensional code image is also provided on the surface on which the reflective stickers are pasted; the camera pose calculation device further includes:

中心点设置模块,用于接收中心点设置指令,根据所述中心点设置指令将所述二维码图像的一个角点设置为所述位姿标定板的中心点。The center point setting module is configured to receive a center point setting instruction, and set a corner point of the two-dimensional code image as the center point of the pose calibration board according to the center point setting instruction.

进一步地,所述摄影机位姿计算装置还包括:Further, the camera pose calculation device also includes:

坐标系设置模块,用于接收坐标系设置指令,根据所述坐标系设置指令设置光学虚拟空间坐标系和图像坐标系。The coordinate system setting module is used for receiving the coordinate system setting instruction, and setting the optical virtual space coordinate system and the image coordinate system according to the coordinate system setting instruction.

进一步地,所述计算模块还用于:Further, the computing module is also used for:

将采集到的所述N组坐标参数和所述内参代入相机姿态估计算法EPNP中,计算得到所述光学虚拟空间坐标系到所述红外摄影机的位姿转换数据,所述位姿转换数据包括旋转矩阵和平移向量;Substitute the collected N sets of coordinate parameters and the internal reference into the camera attitude estimation algorithm EPNP, and calculate the pose transformation data from the optical virtual space coordinate system to the infrared camera, where the pose transformation data includes rotation. matrix and translation vector;

根据所述位姿转换数据计算所述红外摄影机在所述光学虚拟空间坐标系下的位姿。The pose of the infrared camera in the optical virtual space coordinate system is calculated according to the pose transformation data.

进一步地,所述计算模块还用于:Further, the computing module is also used for:

根据公式

Figure BDA0002253348350000081
Figure BDA0002253348350000082
分别计算所述红外摄影机在所述光学虚拟空间坐标系下的位置tc和姿态rc;According to the formula
Figure BDA0002253348350000081
and
Figure BDA0002253348350000082
respectively calculating the position t c and the attitude rc of the infrared camera in the optical virtual space coordinate system;

其中,

Figure BDA0002253348350000083
为所述旋转矩阵,为所述平移向量。in,
Figure BDA0002253348350000083
is the rotation matrix, is the translation vector.

上述各模块所实现的功能及有益效果可参照本发明摄影机位姿计算方法实施例,此处不再赘述。For the functions and beneficial effects implemented by the above modules, reference may be made to the embodiments of the camera pose calculation method of the present invention, which will not be repeated here.

本发明还提供一种存储介质。The present invention also provides a storage medium.

本发明存储介质上存储有摄影机位姿计算程序,所述摄影机位姿计算程序被处理器执行时实现如上所述的摄影机位姿计算方法的步骤。A camera pose calculation program is stored on the storage medium of the present invention, and when the camera pose calculation program is executed by the processor, the steps of the above-mentioned camera pose calculation method are implemented.

其中,在所述处理器上运行的摄影机位姿计算程序被执行时所实现的方法可参照本发明摄影机位姿计算方法各个实施例,此处不再赘述。For the method implemented when the camera pose calculation program running on the processor is executed, reference may be made to the various embodiments of the camera pose calculation method of the present invention, which will not be repeated here.

需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者系统不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者系统所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者系统中还存在另外的相同要素。It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or system comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or system. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article or system that includes the element.

上述本发明实施例序号仅仅为了描述,不代表实施例的优劣。The above-mentioned serial numbers of the embodiments of the present invention are only for description, and do not represent the advantages or disadvantages of the embodiments.

通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在如上所述的一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本发明各个实施例所述的方法。From the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is better implementation. Based on such understanding, the technical solutions of the present invention can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products are stored in a storage medium (such as ROM/RAM) as described above. , magnetic disk, optical disk), including several instructions to make a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of the present invention.

以上仅为本发明的优选实施例,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。The above are only preferred embodiments of the present invention, and are not intended to limit the scope of the present invention. Any equivalent structure or equivalent process transformation made by using the contents of the description and drawings of the present invention, or directly or indirectly applied in other related technical fields , are similarly included in the scope of patent protection of the present invention.

Claims (10)

1.一种摄影机位姿计算方法,其特征在于,所述摄影机位姿计算方法包括如下步骤:1. A camera pose calculation method, wherein the camera pose calculation method comprises the steps: 采集红外摄影机的位姿标定板在光学虚拟空间坐标系下的N个不同位置所对应的N组坐标参数,其中,所述位姿标定板的一个表面上粘贴有预设数量的反光贴,其中一个反光贴粘贴在所述位姿标定板的预设中心点上,所述光学虚拟空间坐标系为预设的三维世界的坐标系,每组坐标参数包括所述预设中心点在所述光学虚拟空间坐标系下的三维坐标,以及在预设图像坐标系中的二维坐标,N为预设值;Collect N sets of coordinate parameters corresponding to N different positions of the pose calibration board of the infrared camera in the optical virtual space coordinate system, wherein a preset number of reflective stickers are pasted on one surface of the pose calibration board, wherein A reflective sticker is pasted on the preset center point of the pose calibration plate, the optical virtual space coordinate system is a preset coordinate system of the three-dimensional world, and each set of coordinate parameters includes the preset center point in the optical The three-dimensional coordinates in the virtual space coordinate system and the two-dimensional coordinates in the preset image coordinate system, N is the preset value; 获取预先保存的所述红外摄影机的内参;obtaining the pre-saved internal parameters of the infrared camera; 将采集到的所述N组坐标参数和所述内参代入预设的相机姿态估计算法中进行计算,得到所述红外摄影机在所述光学虚拟空间坐标系下的位姿。Substitute the collected N sets of coordinate parameters and the internal reference into a preset camera pose estimation algorithm for calculation to obtain the pose of the infrared camera in the optical virtual space coordinate system. 2.如权利要求1所述的摄影机位姿计算方法,其特征在于,在粘贴有反光贴的所述表面上还设置有一张二维码图像;2. The camera pose calculation method according to claim 1, wherein a two-dimensional code image is further provided on the surface on which the reflective stickers are pasted; 所述采集红外摄影机的位姿标定板在光学虚拟空间坐标系下的N个不同位置所对应的N组坐标参数的步骤之前,还包括:Before the step of collecting the N groups of coordinate parameters corresponding to N different positions of the infrared camera's pose calibration board in the optical virtual space coordinate system, the method further includes: 接收中心点设置指令,根据所述中心点设置指令将所述二维码图像的一个角点设置为所述位姿标定板的中心点。A center point setting instruction is received, and a corner point of the two-dimensional code image is set as the center point of the pose calibration board according to the center point setting instruction. 3.如权利要求1所述的摄影机位姿计算方法,其特征在于,所述采集红外摄影机的位姿标定板在光学虚拟空间坐标系下的N个不同位置所对应的N组坐标参数的步骤之前,还包括:3 . The camera pose calculation method according to claim 1 , wherein the step of collecting N groups of coordinate parameters corresponding to N different positions of the pose calibration plate of the infrared camera in the optical virtual space coordinate system. 4 . Before, also included: 接收坐标系设置指令,根据所述坐标系设置指令设置光学虚拟空间坐标系和图像坐标系。A coordinate system setting instruction is received, and an optical virtual space coordinate system and an image coordinate system are set according to the coordinate system setting instruction. 4.如权利要求1所述的摄影机位姿计算方法,其特征在于,所述将采集到的所述N组坐标参数和所述内参代入预设的相机姿态估计算法中进行计算,得到所述红外摄影机在所述光学虚拟空间坐标系下的位姿的步骤包括:4 . The camera pose calculation method according to claim 1 , wherein the collected N sets of coordinate parameters and the internal reference are substituted into a preset camera pose estimation algorithm for calculation to obtain the said 4 . The steps of the pose of the infrared camera in the optical virtual space coordinate system include: 将采集到的所述N组坐标参数和所述内参代入相机姿态估计算法EPNP中,计算得到所述光学虚拟空间坐标系到所述红外摄影机的位姿转换数据,所述位姿转换数据包括旋转矩阵和平移向量;Substitute the collected N sets of coordinate parameters and the internal reference into the camera attitude estimation algorithm EPNP, and calculate the pose transformation data from the optical virtual space coordinate system to the infrared camera, where the pose transformation data includes rotation. matrix and translation vector; 根据所述位姿转换数据计算所述红外摄影机在所述光学虚拟空间坐标系下的位姿。The pose of the infrared camera in the optical virtual space coordinate system is calculated according to the pose transformation data. 5.如权利要求4所述的摄影机位姿计算方法,其特征在于,所述根据所述位姿转换数据计算所述红外摄影机在所述光学虚拟空间坐标系下的位姿的步骤包括:5. The camera pose calculation method according to claim 4, wherein the step of calculating the pose of the infrared camera in the optical virtual space coordinate system according to the pose transformation data comprises: 根据公式
Figure FDA0002253348340000021
Figure FDA0002253348340000022
分别计算所述红外摄影机在所述光学虚拟空间坐标系下的位置tc和姿态rc
According to the formula
Figure FDA0002253348340000021
and
Figure FDA0002253348340000022
respectively calculating the position t c and the attitude rc of the infrared camera in the optical virtual space coordinate system;
其中,
Figure FDA0002253348340000023
为所述旋转矩阵,
Figure FDA0002253348340000024
为所述平移向量。
in,
Figure FDA0002253348340000023
is the rotation matrix,
Figure FDA0002253348340000024
is the translation vector.
6.一种摄影机位姿计算装置,其特征在于,所述摄影机位姿计算装置包括:6. A camera pose computing device, wherein the camera pose computing device comprises: 采集模块,用于采集红外摄影机的位姿标定板在光学虚拟空间坐标系下的N个不同位置所对应的N组坐标参数,其中,所述位姿标定板的一个表面上粘贴有预设数量的反光贴,其中一个反光贴粘贴在所述位姿标定板的预设中心点上,所述光学虚拟空间坐标系为预设的三维世界的坐标系,每组坐标参数包括所述预设中心点在所述光学虚拟空间坐标系下的三维坐标,以及在预设图像坐标系中的二维坐标,N为预设值;The acquisition module is used to collect N sets of coordinate parameters corresponding to N different positions of the infrared camera's pose calibration board in the optical virtual space coordinate system, wherein a surface of the pose calibration board is pasted with a preset number of reflective stickers, one of which is pasted on the preset center point of the pose calibration board, the optical virtual space coordinate system is the preset three-dimensional world coordinate system, and each set of coordinate parameters includes the preset center the three-dimensional coordinates of the point in the optical virtual space coordinate system, and the two-dimensional coordinates in the preset image coordinate system, where N is a preset value; 获取模块,用于获取预先保存的所述红外摄影机的内参;an acquisition module for acquiring the pre-saved internal parameters of the infrared camera; 计算模块,用于将采集到的所述N组坐标参数和所述内参代入预设的相机姿态估计算法中进行计算,得到所述红外摄影机在所述光学虚拟空间坐标系下的位姿。The calculation module is used for substituting the collected N sets of coordinate parameters and the internal reference into a preset camera attitude estimation algorithm for calculation, so as to obtain the pose of the infrared camera in the optical virtual space coordinate system. 7.如权利要求6所述的摄影机位姿计算装置,其特征在于,所述计算模块还用于:7. The camera pose calculation device according to claim 6, wherein the calculation module is further used for: 将采集到的所述N组坐标参数和所述内参代入相机姿态估计算法EPNP中,计算得到所述光学虚拟空间坐标系到所述红外摄影机的位姿转换数据,所述位姿转换数据包括旋转矩阵和平移向量;Substitute the collected N sets of coordinate parameters and the internal reference into the camera attitude estimation algorithm EPNP, and calculate the pose transformation data from the optical virtual space coordinate system to the infrared camera, where the pose transformation data includes rotation. matrix and translation vector; 根据所述位姿转换数据计算所述红外摄影机在所述光学虚拟空间坐标系下的位姿。The pose of the infrared camera in the optical virtual space coordinate system is calculated according to the pose transformation data. 8.如权利要求7所述的摄影机位姿计算装置,其特征在于,所述计算模块还用于:8. The camera pose calculation device according to claim 7, wherein the calculation module is further used for: 根据公式
Figure FDA0002253348340000031
Figure FDA0002253348340000032
分别计算所述红外摄影机在所述光学虚拟空间坐标系下的位置tc和姿态rc
According to the formula
Figure FDA0002253348340000031
and
Figure FDA0002253348340000032
respectively calculating the position t c and the attitude rc of the infrared camera in the optical virtual space coordinate system;
其中,
Figure FDA0002253348340000033
为所述旋转矩阵,
Figure FDA0002253348340000034
为所述平移向量。
in,
Figure FDA0002253348340000033
is the rotation matrix,
Figure FDA0002253348340000034
is the translation vector.
9.一种摄影机位姿计算设备,其特征在于,所述摄影机位姿计算设备包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的摄影机位姿计算程序,所述摄影机位姿计算程序被所述处理器执行时实现如权利要求1至5中任一项所述的摄影机位姿计算方法的步骤。9. A camera pose computing device, characterized in that the camera pose computing device comprises: a memory, a processor, and a camera pose computing program stored on the memory and running on the processor, When the camera pose calculation program is executed by the processor, the steps of the camera pose calculation method according to any one of claims 1 to 5 are implemented. 10.一种存储介质,其特征在于,所述存储介质上存储有摄影机位姿计算程序,所述摄影机位姿计算程序被处理器执行时实现如权利要求1至5中任一项所述的摄影机位姿计算方法的步骤。10 . A storage medium, wherein a camera pose calculation program is stored on the storage medium, and the camera pose calculation program is executed by a processor to implement the method according to any one of claims 1 to 5 . The steps of the camera pose calculation method.
CN201911042937.4A 2019-10-30 2019-10-30 Camera pose calculation method, device, equipment and storage medium Pending CN110807814A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202210440436.7A CN114820814A (en) 2019-10-30 2019-10-30 Camera pose calculation method, device, equipment and storage medium
CN201911042937.4A CN110807814A (en) 2019-10-30 2019-10-30 Camera pose calculation method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911042937.4A CN110807814A (en) 2019-10-30 2019-10-30 Camera pose calculation method, device, equipment and storage medium

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202210440436.7A Division CN114820814A (en) 2019-10-30 2019-10-30 Camera pose calculation method, device, equipment and storage medium

Publications (1)

Publication Number Publication Date
CN110807814A true CN110807814A (en) 2020-02-18

Family

ID=69489577

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201911042937.4A Pending CN110807814A (en) 2019-10-30 2019-10-30 Camera pose calculation method, device, equipment and storage medium
CN202210440436.7A Pending CN114820814A (en) 2019-10-30 2019-10-30 Camera pose calculation method, device, equipment and storage medium

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202210440436.7A Pending CN114820814A (en) 2019-10-30 2019-10-30 Camera pose calculation method, device, equipment and storage medium

Country Status (1)

Country Link
CN (2) CN110807814A (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111476876A (en) * 2020-04-02 2020-07-31 北京七维视觉传媒科技有限公司 Three-dimensional image rendering method, device and equipment and readable storage medium
CN112508065A (en) * 2020-11-24 2021-03-16 深圳市优必选科技股份有限公司 Robot and positioning method and device thereof
CN113052915A (en) * 2021-03-04 2021-06-29 深圳市瑞立视多媒体科技有限公司 Camera external parameter calibration method and device, augmented reality system, terminal device and storage medium
CN113205591A (en) * 2021-04-30 2021-08-03 北京奇艺世纪科技有限公司 Method and device for acquiring three-dimensional reconstruction training data and electronic equipment
CN114022568A (en) * 2021-11-10 2022-02-08 浙江博采传媒有限公司 Virtual and real camera pose correction method, device, storage medium and electronic device
CN114022466A (en) * 2021-11-11 2022-02-08 南京佗道医疗科技有限公司 Infrared camera calibration method
CN114095657A (en) * 2021-11-22 2022-02-25 成都天翼空间科技有限公司 Automatic calibration method and system based on newly-added camera
CN114366144A (en) * 2022-01-13 2022-04-19 杭州柳叶刀机器人有限公司 Oral image positioning and navigation method and system
CN115345942A (en) * 2022-07-28 2022-11-15 中央广播电视总台 Space calibration method and device, computer equipment and storage medium
CN116485886A (en) * 2023-01-03 2023-07-25 腾讯科技(深圳)有限公司 A lamp synchronization method, device, equipment and storage medium
CN118887284A (en) * 2024-09-27 2024-11-01 中安镜像(杭州)科技有限公司 A device based on virtual-reality interaction and a method for calculating its posture
CN120219500A (en) * 2023-12-27 2025-06-27 广东美的白色家电技术创新中心有限公司 Method, device, equipment and storage medium for calibrating optical parameters of imaging system

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115639909B (en) * 2022-10-11 2025-10-24 歌尔科技有限公司 Position updating method, device, input device and storage medium
CN119991825B (en) * 2025-01-16 2025-11-18 优酷文化科技(北京)有限公司 Camera adjustment methods, devices, and storage media in optical positioning fields

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160364867A1 (en) * 2015-06-11 2016-12-15 Fujitsu Limited Camera pose estimation device and control method
CN106600627A (en) * 2016-12-07 2017-04-26 成都通甲优博科技有限责任公司 Rigid body motion capturing method and system based on mark point
CN106971406A (en) * 2017-03-06 2017-07-21 广州视源电子科技股份有限公司 Object pose detection method and device
CN206441238U (en) * 2017-02-09 2017-08-25 杭州零智科技有限公司 Scaling board and calibration system
US20180192035A1 (en) * 2017-01-04 2018-07-05 Qualcomm Incorporated Systems and methods for object location
CN109697734A (en) * 2018-12-25 2019-04-30 浙江商汤科技开发有限公司 Position and orientation estimation method and device, electronic equipment and storage medium
CN109978960A (en) * 2019-04-01 2019-07-05 易思维(杭州)科技有限公司 Based on photogrammetric high-precision screen-camera pose scaling method

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103761732B (en) * 2014-01-06 2016-09-07 哈尔滨工业大学深圳研究生院 Stereoscopic imaging apparatus that a kind of visible ray and thermal infrared merge and scaling method thereof
CN106228564B (en) * 2016-07-29 2023-04-07 国网河南省电力公司郑州供电公司 External parameter two-step combined online calibration method and system of multi-view camera
CN107610178A (en) * 2017-07-27 2018-01-19 北京航天计量测试技术研究所 A kind of industrial photogrammetry system camera parameter movable type scaling method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160364867A1 (en) * 2015-06-11 2016-12-15 Fujitsu Limited Camera pose estimation device and control method
CN106600627A (en) * 2016-12-07 2017-04-26 成都通甲优博科技有限责任公司 Rigid body motion capturing method and system based on mark point
US20180192035A1 (en) * 2017-01-04 2018-07-05 Qualcomm Incorporated Systems and methods for object location
CN206441238U (en) * 2017-02-09 2017-08-25 杭州零智科技有限公司 Scaling board and calibration system
CN106971406A (en) * 2017-03-06 2017-07-21 广州视源电子科技股份有限公司 Object pose detection method and device
CN109697734A (en) * 2018-12-25 2019-04-30 浙江商汤科技开发有限公司 Position and orientation estimation method and device, electronic equipment and storage medium
CN109978960A (en) * 2019-04-01 2019-07-05 易思维(杭州)科技有限公司 Based on photogrammetric high-precision screen-camera pose scaling method

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111476876B (en) * 2020-04-02 2024-01-16 北京七维视觉传媒科技有限公司 Three-dimensional image rendering method, device, equipment and readable storage medium
CN111476876A (en) * 2020-04-02 2020-07-31 北京七维视觉传媒科技有限公司 Three-dimensional image rendering method, device and equipment and readable storage medium
CN112508065A (en) * 2020-11-24 2021-03-16 深圳市优必选科技股份有限公司 Robot and positioning method and device thereof
CN112508065B (en) * 2020-11-24 2024-05-24 深圳市优必选科技股份有限公司 Robot and positioning method and device thereof
CN113052915A (en) * 2021-03-04 2021-06-29 深圳市瑞立视多媒体科技有限公司 Camera external parameter calibration method and device, augmented reality system, terminal device and storage medium
CN113205591A (en) * 2021-04-30 2021-08-03 北京奇艺世纪科技有限公司 Method and device for acquiring three-dimensional reconstruction training data and electronic equipment
CN113205591B (en) * 2021-04-30 2024-03-08 北京奇艺世纪科技有限公司 Method and device for acquiring three-dimensional reconstruction training data and electronic equipment
CN114022568A (en) * 2021-11-10 2022-02-08 浙江博采传媒有限公司 Virtual and real camera pose correction method, device, storage medium and electronic device
CN114022568B (en) * 2021-11-10 2025-04-29 浙江博采传媒有限公司 Virtual and real camera posture correction method, device, storage medium and electronic equipment
CN114022466A (en) * 2021-11-11 2022-02-08 南京佗道医疗科技有限公司 Infrared camera calibration method
CN114095657B (en) * 2021-11-22 2024-02-27 成都天翼空间科技有限公司 A method and system for automatic calibration based on newly added cameras
CN114095657A (en) * 2021-11-22 2022-02-25 成都天翼空间科技有限公司 Automatic calibration method and system based on newly-added camera
CN114366144A (en) * 2022-01-13 2022-04-19 杭州柳叶刀机器人有限公司 Oral image positioning and navigation method and system
CN114366144B (en) * 2022-01-13 2025-04-18 杭州柳叶刀机器人有限公司 Oral image positioning navigation method and system
CN115345942A (en) * 2022-07-28 2022-11-15 中央广播电视总台 Space calibration method and device, computer equipment and storage medium
CN116485886A (en) * 2023-01-03 2023-07-25 腾讯科技(深圳)有限公司 A lamp synchronization method, device, equipment and storage medium
CN120219500A (en) * 2023-12-27 2025-06-27 广东美的白色家电技术创新中心有限公司 Method, device, equipment and storage medium for calibrating optical parameters of imaging system
CN118887284A (en) * 2024-09-27 2024-11-01 中安镜像(杭州)科技有限公司 A device based on virtual-reality interaction and a method for calculating its posture

Also Published As

Publication number Publication date
CN114820814A (en) 2022-07-29

Similar Documents

Publication Publication Date Title
CN110807814A (en) Camera pose calculation method, device, equipment and storage medium
CN108765498B (en) Monocular vision tracking, device and storage medium
US11503275B2 (en) Camera calibration system, target, and process
US10924729B2 (en) Method and device for calibration
KR101694969B1 (en) Method and apparatus for providing camera calibration
CN110648274B (en) Fisheye image generation method and device
JPWO2018235163A1 (en) Calibration apparatus, calibration chart, chart pattern generation apparatus, and calibration method
CN106023302A (en) Mobile communication terminal, three-dimensional reconstruction method thereof and server
CN109711472B (en) Training data generation method and device
CN110099220A (en) A kind of panorama mosaic method and device
CN113329179B (en) Shooting alignment method, device, equipment and storage medium
WO2024164569A9 (en) Data processing method and apparatus, device, and storage medium
CN107317998A (en) Full-view video image fusion method and device
WO2025077567A1 (en) Three-dimensional model output method, apparatus and device, and computer readable storage medium
CN112017242A (en) Display method and device, equipment, storage medium
CN115830135B (en) An image processing method, apparatus and electronic device
CN117974796A (en) XR augmented reality camera calibration method, device and system
WO2024001847A1 (en) 2d marker, and indoor positioning method and apparatus
JP2014112057A (en) Real-time display method of expected coupling precision, and shape measurement system
JP6700539B2 (en) Video processing device, video processing method, and video processing program
JP2002135807A (en) Method and device for calibration for three-dimensional entry
CN113379843A (en) Parameter calibration method, device and equipment for imaging system of camera module
CN117979166B (en) Image processing method, device and storage medium for free-viewing-angle camera
CN113012182B (en) Offset state testing method, testing device and storage medium
CN113298868B (en) Model building method, device, electronic equipment, medium and program product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200218

RJ01 Rejection of invention patent application after publication