[go: up one dir, main page]

WO2007031947A3 - Frame and pixel based matching of model-generated graphics images to camera frames - Google Patents

Frame and pixel based matching of model-generated graphics images to camera frames Download PDF

Info

Publication number
WO2007031947A3
WO2007031947A3 PCT/IB2006/053244 IB2006053244W WO2007031947A3 WO 2007031947 A3 WO2007031947 A3 WO 2007031947A3 IB 2006053244 W IB2006053244 W IB 2006053244W WO 2007031947 A3 WO2007031947 A3 WO 2007031947A3
Authority
WO
WIPO (PCT)
Prior art keywords
model
frame
world
pixel based
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2006/053244
Other languages
French (fr)
Other versions
WO2007031947A2 (en
Inventor
Carlos Tapang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to JP2008529771A priority Critical patent/JP4909991B2/en
Priority to CA002622327A priority patent/CA2622327A1/en
Priority to EP06796009A priority patent/EP1979874B1/en
Priority to AT06796009T priority patent/ATE531007T1/en
Priority to US11/993,169 priority patent/US8102390B2/en
Publication of WO2007031947A2 publication Critical patent/WO2007031947A2/en
Anticipated expiration legal-status Critical
Publication of WO2007031947A3 publication Critical patent/WO2007031947A3/en
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/75—Determining position or orientation of objects or cameras using feature-based methods involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20048—Transform domain processing
    • G06T2207/20056—Discrete and fast Fourier transform, [DFT, FFT]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Image Analysis (AREA)
  • Image Generation (AREA)

Abstract

This invention allows for triangulation of the camera position without the usual scene analysis and feature recognition. It utilizes an a priori, accurate model of the world within the field of vision. The 3D model is rendered onto a graphics surface using the latest graphics processing units. Each frame coming from the camera is then searched for a best match in a number of candidate renderings on the graphics surface. The count of rendered images to compare to is made small by computing the change in camera position and angle of view from one frame to another, and then using the results of such computations to limit the next possible positions and angles of view to render the a priori world model. The main advantage of this invention over prior art is the mapping of the real world onto a world model.
PCT/IB2006/053244 2005-09-12 2006-09-12 Frame and pixel based matching of model-generated graphics images to camera frames Ceased WO2007031947A2 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
JP2008529771A JP4909991B2 (en) 2005-09-12 2006-09-12 Frame-by-frame and pixel-by-pixel computer image camera frame matching model generation graphics image
CA002622327A CA2622327A1 (en) 2005-09-12 2006-09-12 Frame by frame, pixel by pixel matching of model-generated graphics images to camera frames for computer vision
EP06796009A EP1979874B1 (en) 2005-09-12 2006-09-12 Frame and pixel based matching of model-generated graphics images to camera frames
AT06796009T ATE531007T1 (en) 2005-09-12 2006-09-12 SINGLE-IMAGE AND PIXEL-WISE COMPARISON OF MODEL-GENERATED GRAPHIC IMAGES WITH INDIVIDUAL CAMERA IMAGES
US11/993,169 US8102390B2 (en) 2005-09-12 2006-09-12 Frame by frame, pixel by pixel matching of model-generated graphics images to camera frames for computer vision

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US71613905P 2005-09-12 2005-09-12
US60/716,139 2005-09-12

Publications (2)

Publication Number Publication Date
WO2007031947A2 WO2007031947A2 (en) 2007-03-22
WO2007031947A3 true WO2007031947A3 (en) 2009-08-27

Family

ID=37865350

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2006/053244 Ceased WO2007031947A2 (en) 2005-09-12 2006-09-12 Frame and pixel based matching of model-generated graphics images to camera frames

Country Status (8)

Country Link
US (1) US8102390B2 (en)
EP (1) EP1979874B1 (en)
JP (1) JP4909991B2 (en)
CN (1) CN101636748A (en)
AT (1) ATE531007T1 (en)
CA (1) CA2622327A1 (en)
RU (1) RU2008112164A (en)
WO (1) WO2007031947A2 (en)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI391874B (en) * 2009-11-24 2013-04-01 Ind Tech Res Inst Method and device of mapping and localization method using the same
CN102519481B (en) * 2011-12-29 2013-09-04 中国科学院自动化研究所 Implementation method of binocular vision speedometer
US20150201193A1 (en) * 2012-01-10 2015-07-16 Google Inc. Encoding and decoding techniques for remote screen sharing of media content using video source and display parameters
GB201202344D0 (en) 2012-02-10 2012-03-28 Isis Innovation Method of locating a sensor and related apparatus
GB2501466A (en) 2012-04-02 2013-10-30 Univ Oxford Localising transportable apparatus
JP2014225108A (en) * 2013-05-16 2014-12-04 ソニー株式会社 Image processing apparatus, image processing method, and program
CN104548598B (en) * 2014-12-31 2017-08-08 北京像素软件科技股份有限公司 A kind of method of pathfinding in virtual reality scenario
US9836118B2 (en) 2015-06-16 2017-12-05 Wilson Steele Method and system for analyzing a movement of a person
RU2636745C1 (en) * 2016-08-22 2017-11-28 Общество С Ограниченной Ответственностью "Дисикон" Method and system of monitoring territory using controlled video camera
RU2663884C1 (en) * 2017-03-29 2018-08-13 ООО "Ай Ти Ви групп" Method of emulation of at least two stationary virtual cameras using one ptz camera
CN109978787B (en) * 2019-03-25 2022-03-15 电子科技大学 Image processing method based on biological visual computing model
CN111405251B (en) * 2020-03-25 2021-03-23 杭州叙简科技股份有限公司 Video storage system supporting spatial position retrieval and management method thereof
US11651502B2 (en) * 2020-07-22 2023-05-16 Microsoft Technology Licensing, Llc Systems and methods for updating continuous image alignment of separate cameras

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010024311A1 (en) * 2000-01-06 2001-09-27 Larkin Kieran Gerard Demodulation and phase estimation of two-dimensional patterns
US20050128196A1 (en) * 2003-10-08 2005-06-16 Popescu Voicu S. System and method for three dimensional modeling

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5975357A (en) * 1982-10-22 1984-04-28 Hitachi Ltd Image processing device
US5259040A (en) * 1991-10-04 1993-11-02 David Sarnoff Research Center, Inc. Method for determining sensor motion and scene structure and image processing system therefor
GB9217098D0 (en) * 1992-08-12 1992-09-23 British Broadcasting Corp Derivation of studio camera position and motion from the camera image
US5801970A (en) * 1995-12-06 1998-09-01 Martin Marietta Corporation Model-based feature tracking system
US5850469A (en) * 1996-07-09 1998-12-15 General Electric Company Real time tracking of camera pose
US6249616B1 (en) * 1997-05-30 2001-06-19 Enroute, Inc Combining digital images based on three-dimensional relationships between source image data sets
US6047078A (en) * 1997-10-03 2000-04-04 Digital Equipment Corporation Method for extracting a three-dimensional model using appearance-based constrained structure from motion
JP3342393B2 (en) * 1998-03-19 2002-11-05 株式会社コナミコンピュータエンタテインメントジャパン Video game device, computer-readable recording medium
US6307959B1 (en) * 1999-07-14 2001-10-23 Sarnoff Corporation Method and apparatus for estimating scene structure and ego-motion from multiple images of a scene using correlation
US6704621B1 (en) * 1999-11-26 2004-03-09 Gideon P. Stein System and method for estimating ego-motion of a moving vehicle using successive images recorded along the vehicle's path of motion
US6980690B1 (en) * 2000-01-20 2005-12-27 Canon Kabushiki Kaisha Image processing apparatus
US6985620B2 (en) * 2000-03-07 2006-01-10 Sarnoff Corporation Method of pose estimation and model refinement for video representation of a three dimensional scene
US7522186B2 (en) * 2000-03-07 2009-04-21 L-3 Communications Corporation Method and apparatus for providing immersive surveillance
US6738099B2 (en) * 2001-02-16 2004-05-18 Tektronix, Inc. Robust camera motion estimation for video sequences
US6895103B2 (en) * 2001-06-19 2005-05-17 Eastman Kodak Company Method for automatically locating eyes in an image
US20040052418A1 (en) * 2002-04-05 2004-03-18 Bruno Delean Method and apparatus for probabilistic image analysis
JP3848236B2 (en) * 2002-10-18 2006-11-22 株式会社東芝 Defect information detection sensitivity data determination method, defect information detection sensitivity data determination device, defect detection device management method, semiconductor device defect detection method, and semiconductor device defect detection device
WO2004114063A2 (en) * 2003-06-13 2004-12-29 Georgia Tech Research Corporation Data reconstruction using directional interpolation techniques
GB2411532B (en) * 2004-02-11 2010-04-28 British Broadcasting Corp Position determination
BRPI0514078A (en) * 2004-08-04 2008-05-27 Intergraph Software Tech Co method of preparing a composite image with non-uniform resolution
EP1849123A2 (en) * 2005-01-07 2007-10-31 GestureTek, Inc. Optical flow based tilt sensor

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010024311A1 (en) * 2000-01-06 2001-09-27 Larkin Kieran Gerard Demodulation and phase estimation of two-dimensional patterns
US20050128196A1 (en) * 2003-10-08 2005-06-16 Popescu Voicu S. System and method for three dimensional modeling

Also Published As

Publication number Publication date
EP1979874A2 (en) 2008-10-15
JP2009514066A (en) 2009-04-02
CA2622327A1 (en) 2007-03-22
WO2007031947A2 (en) 2007-03-22
US8102390B2 (en) 2012-01-24
EP1979874B1 (en) 2011-10-26
RU2008112164A (en) 2009-10-20
EP1979874A4 (en) 2010-02-24
JP4909991B2 (en) 2012-04-04
ATE531007T1 (en) 2011-11-15
CN101636748A (en) 2010-01-27
US20100283778A1 (en) 2010-11-11

Similar Documents

Publication Publication Date Title
CN105279372B (en) A kind of method and apparatus of determining depth of building
CN104335005B (en) 3D is scanned and alignment system
US9235928B2 (en) 3D body modeling, from a single or multiple 3D cameras, in the presence of motion
US10068344B2 (en) Method and system for 3D capture based on structure from motion with simplified pose detection
EP4224424B1 (en) Method and system for determining spatial coordinates of a 3d reconstruction of at least part of a real object at absolute spatial scale
KR101791590B1 (en) Object pose recognition apparatus and method using the same
US7196719B2 (en) Angled axis machine vision system and method
CN114746717A (en) System and method for surface normal sensing using polarization
US20170085864A1 (en) Underwater 3d image reconstruction utilizing triple wavelength dispersion and camera system thereof
CN106767399A (en) The non-contact measurement method of the logistics measurement of cargo found range based on binocular stereo vision and dot laser
JP7623487B2 (en) Three-dimensional (3D) facial feature tracking for an automated stereoscopic telepresence system
CN107688391A (en) A kind of gesture identification method and device based on monocular vision
WO2007031947A3 (en) Frame and pixel based matching of model-generated graphics images to camera frames
CN105654547B (en) Three-dimensional rebuilding method
CN107850782A (en) Represent that strengthening depth map represents with reflectance map
CN105513074B (en) A kind of scaling method of shuttlecock robot camera and vehicle body to world coordinate system
CN115035546B (en) Three-dimensional human body posture detection method and device and electronic equipment
CN107590444B (en) Method and device for detecting static obstacle and storage medium
CN110243390A (en) Pose Determination Method, Device and Odometer
JP6282377B2 (en) Three-dimensional shape measurement system and measurement method thereof
KR20150053438A (en) Stereo matching system and method for generating disparity map using the same
EP3371780A1 (en) System and methods for imaging three-dimensional objects
US8340399B2 (en) Method for determining a depth map from images, device for determining a depth map
CN115601438A (en) External parameter calibration method, device and autonomous mobile equipment
Nguyen et al. Improvement to LiDAR-camera extrinsic calibration by using 3D–3D correspondences

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200680037581.X

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 11993169

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 2008529771

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2006796009

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2622327

Country of ref document: CA

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 1207/KOLNP/2008

Country of ref document: IN

WWE Wipo information: entry into national phase

Ref document number: 2008112164

Country of ref document: RU