WO2008114264A4 - A method and apparatus for video image stabilization - Google Patents
A method and apparatus for video image stabilization Download PDFInfo
- Publication number
- WO2008114264A4 WO2008114264A4 PCT/IL2008/000393 IL2008000393W WO2008114264A4 WO 2008114264 A4 WO2008114264 A4 WO 2008114264A4 IL 2008000393 W IL2008000393 W IL 2008000393W WO 2008114264 A4 WO2008114264 A4 WO 2008114264A4
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- view
- sphere
- location
- center
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/80—Geometric correction
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/269—Analysis of motion using gradient-based methods
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
- Television Systems (AREA)
Abstract
A method and apparatus for stabilizing a video image sequence using image warping techniques including a spherical mapping procedure that maintains the image principal point of all images in the sequence.
Claims
1. An apparatus for image stabilization, the apparatus comprising:
a) a light-sensing camera operative to sense light to capture a plurality of scene images including a first scene image at a first point in time and a second scene image at a second point in time after said first point in time;
b) a camera motion-sensor operative to determine for said first and second points in time, a physical displacement of said light-sensing camera in physical rotation- translation space;
c) means for obtaining transformed images for each captured image, said transformed images comprising a mapping of said captured image pixel values onto a sub-region of a predetermined imaginary spherical surface, said imaginary spherical surface being a function of said camera,
d) an image-warper operative: i) to generate a first warped curvilinear image through a first view of a first said transformed image on said spherical surface from a first location in virtual rotation-translation space, said first location being at a position other than the center of said sphere, and said first view being at an angle oriented to intersect the center of said sphere,
ϋ) to generate a second waiped curvilinear image through a second view of a second said transformed image on said spherical surface from a second location in virtual rotation-translation space, said second location being in accordance with said physical displacement that is determined by said camera motion-sensor and being at a position other than the center of said sphere, and said second view being at an angle oriented to intersect the center of said sphere. 33
2. An apparatus according to claim 1, further comprising a display unit operative to display said generated warped images.
3. The apparatus of claim 1 wherein said image-warper is operative to apply said first warping to simulate a view such that an object perceived in said first captured image is perceived in said first warped image from a different view angle.
4. The apparatus of claim 1 wherein said image-warper is operative to apply said second warping to simulate a view such that an object perceived in said second captured image is perceived in said second warped image from a different view angle.
5. The apparatus of claim 4, wherein said view angle perceived in said second warped image differs from said view angle in said first warped image in accordance with said physical displacement that is determined by said camera motion-seπsor-
6. The apparatus of claim 1, wherein said camera motion-sensor is a physical motion sensor mounted on said camera.
7. The apparatus of claim 1, wherein said camera motion sensor is implemented through a computer program.
8. An image stabilization apparatus for use with a light-sensing camera operative to sense light to capture a plurality of scene images including a first scene image at a first point in time and a second scene image at a second point in time after said first point in time, said image stabilization apparatus comprising:
a) a camera motion-sensor operative to determine for said first and second points in time, a physical displacement of said light-sensing camera in physical rotation- translation space; b) means for obtaining transformed images for each captured image, said transformed images comprising a mapping of said captured image pixel values onto a sub-region of a predetermined imaginary spherical surface, said imaginary spherical surface being a function of said camera,
c) an image-warper operative: i) to generate a first warped curvilinear image through a first view of a first said transformed image on said spherical surface from a first location in virtual rotation-translation space, said first location being at a position other than the center of said sphere, and said first view being at an angle oriented to intersect the center of said sphere,
ii) to generate a second warped curvilinear image through a second view of a second said transformed image on said spherical surface from a second location in virtual rotation-translation space, said second location being in accordance with said physical displacement that is determined by said camera motion-sensor and being at a position other than the center of said sphere, and said second view being at an angle oriented to intersect the center of said sphere.
9- An image stabilization apparatus for use with a light-sensing camera operative to sense light to capture a plurality of scene images including a first scene image at a first point in ϋme and a second scene image at a second point in time after said first point in time and a camera motion-sensor operative to determine for said first and second points in time, a physical displacement of said light-sensing camera in physical rotation- translation space, the apparatus comprising:
a) means for obtaining transformed images for each captured image, said transformed images comprising a mapping of said captured image pixel values onto a sub-region of a predetermined imaginary spherical surface, said imaginary spherical surface being a function of said camera, 35
b) an image-warper operative: i) to generate a first warped curvilinear image through a first view of a first said transformed image on said spherical surface from a first location in virtual rotation-translation space, said first location being at a position other than the center of said sphere, and said first view being at an. angle oriented to intersect the center of said sphere,
ii) to generate a second warped curvilinear image through a second view of a second said transformed image on said spherical surface from a second location in virtual rotation-translation space, said second location being in accordance with said physical displacement that is determined by said camera motion-sensor and being at a position other than the center of said sphere, and said second view being at an angle oriented to intersect the center of said sphere.
10. A method for image stabilization, the method comprising:
a) using a light-sensing camera operative to sense light to capture a plurality of scene images including a first scene image at a first point in time and a second scene image at a second point in time after said first point in time;
b) determining for first and second points in time, a physical displacement of said light-sensing camera in physical rotation-translation space;
c) obtaining transformed images for each captured image, said transformed images comprising a mapping of said captured image pixel values onto a sub-region of a predetermined imaginary spherical surface, said imaginary spherical surface being a function of said camera,
d) generating: 36
i) a first warped curvilinear image through a first view of a first said transformed image on said spherical surface from a first location in virtual rotation-translation space, said first location being at a position other than the center of said sphere, and said first view being at an angle oriented to intersect the center of said sphere,
U) a second warped curvilinear image through a second view of a second said transformed image on said spherical surface from a second location in virtual rotation-translation space, said second location being in accordance with said physical displacement that is determined by said camera motion-sensor; and being at a position other than the center of said sphere, and said second view being at an angle oriented to intersect the center of said sphere.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US90710907P | 2007-03-21 | 2007-03-21 | |
| US60/907,109 | 2007-03-21 |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| WO2008114264A2 WO2008114264A2 (en) | 2008-09-25 |
| WO2008114264A3 WO2008114264A3 (en) | 2008-11-06 |
| WO2008114264A4 true WO2008114264A4 (en) | 2008-12-31 |
Family
ID=39639507
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/IL2008/000393 Ceased WO2008114264A2 (en) | 2007-03-21 | 2008-03-20 | A method and apparatus for video image stabilization |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2008114264A2 (en) |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8488010B2 (en) | 2010-09-21 | 2013-07-16 | Hewlett-Packard Development Company, L.P. | Generating a stabilized video sequence based on motion sensor data |
| GB201113824D0 (en) * | 2011-08-11 | 2011-09-28 | Univ Swansea | Fish eye video correction |
| US9232139B2 (en) | 2012-07-24 | 2016-01-05 | Apple Inc. | Image stabilization using striped output transformation unit |
| CN104427241A (en) * | 2013-09-09 | 2015-03-18 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CA2940664C (en) * | 2014-02-26 | 2022-08-30 | Searidge Technologies Inc. | Image stitching and automatic-color correction |
| US10097759B1 (en) | 2015-09-30 | 2018-10-09 | Apple Inc. | 360 degree image presentation |
| WO2018199792A1 (en) | 2017-04-26 | 2018-11-01 | Huawei Technologies Co., Ltd | Apparatuses and methods for encoding and decoding a panoramic video signal |
| EP3610646B1 (en) * | 2017-04-27 | 2025-06-11 | Huawei Technologies Co., Ltd. | Geodesic intra-prediction for panoramic video coding |
| CN109040521B (en) * | 2017-06-08 | 2020-11-13 | 株式会社理光 | Image processing method, image processing device, electronic equipment and computer readable storage medium |
| US10462370B2 (en) | 2017-10-03 | 2019-10-29 | Google Llc | Video stabilization |
| EP3718302B1 (en) * | 2018-04-02 | 2023-12-06 | Samsung Electronics Co., Ltd. | Method and system for handling 360 degree image content |
| US10171738B1 (en) * | 2018-05-04 | 2019-01-01 | Google Llc | Stabilizing video to reduce camera and face movement |
| US11190689B1 (en) | 2020-07-29 | 2021-11-30 | Google Llc | Multi-camera video stabilization |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102004017730B4 (en) * | 2004-04-10 | 2006-05-24 | Christian-Albrechts-Universität Zu Kiel | Method for rotational compensation of spherical images |
-
2008
- 2008-03-20 WO PCT/IL2008/000393 patent/WO2008114264A2/en not_active Ceased
Also Published As
| Publication number | Publication date |
|---|---|
| WO2008114264A2 (en) | 2008-09-25 |
| WO2008114264A3 (en) | 2008-11-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2008114264A4 (en) | A method and apparatus for video image stabilization | |
| Karpenko et al. | Digital video stabilization and rolling shutter correction using gyroscopes | |
| JP2020534608A5 (en) | ||
| CN109691084A (en) | Information processing unit and method and program | |
| US11016560B1 (en) | Video timewarp for mixed reality and cloud rendering applications | |
| US20180167607A1 (en) | Information processing device and information processing method | |
| CN115088254A (en) | Motion smoothing in distributed systems | |
| WO2007011314A3 (en) | Methods and systems for mapping a virtual model of an object to the object | |
| JP6768933B2 (en) | Information processing equipment, information processing system, and image processing method | |
| KR20130068193A (en) | Multi images supplying system and multi images shooting device thereof | |
| TW201239807A (en) | Image capture device and method for monitoring specified scene using the image capture device | |
| CN112166397B (en) | Apparatus, system and method for accelerating position tracking of head mounted displays | |
| US12211139B2 (en) | Method for capturing and displaying a video stream | |
| JP2015079444A5 (en) | ||
| JP7353782B2 (en) | Information processing device, information processing method, and program | |
| WO2009123106A1 (en) | Position detection system, position detection method, program, information storage medium, and image generating device | |
| US8204340B2 (en) | Methods and apparatus for dot marker matching | |
| US10410372B1 (en) | Methods, systems, and computer-readable media for utilizing radial distortion to estimate a pose configuration | |
| US10080956B2 (en) | Detecting the changing position of a face to move and rotate a game object in a virtual environment | |
| CN105721739B (en) | Anti-shaking system and method for screen image | |
| JPWO2020262261A5 (en) | ||
| JP2018033107A (en) | Video distribution device and distribution method | |
| JP2019027894A (en) | Positional information acquisition system, and method and program for acquiring positional information | |
| CN120013780A (en) | Scene rendering method, device, AR device and storage medium | |
| TWI890212B (en) | Immersive content display method, display device and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 08720018 Country of ref document: EP Kind code of ref document: A2 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 08720018 Country of ref document: EP Kind code of ref document: A2 |