[go: up one dir, main page]

WO2018187724A8 - System, method and software for converting images captured by a light field camera into three-dimensional images that appear to extend vertically above or in front of a display medium - Google Patents

System, method and software for converting images captured by a light field camera into three-dimensional images that appear to extend vertically above or in front of a display medium

Info

Publication number
WO2018187724A8
WO2018187724A8 PCT/US2018/026516 US2018026516W WO2018187724A8 WO 2018187724 A8 WO2018187724 A8 WO 2018187724A8 US 2018026516 W US2018026516 W US 2018026516W WO 2018187724 A8 WO2018187724 A8 WO 2018187724A8
Authority
WO
WIPO (PCT)
Prior art keywords
light field
display medium
appear
software
field camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2018/026516
Other languages
French (fr)
Other versions
WO2018187724A1 (en
Inventor
Richard S. FREEMAN
Scott A. HOLLINGER
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Maxx Media Group LLC
Original Assignee
Maxx Media Group LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/481,447 external-priority patent/US10136121B2/en
Priority claimed from US15/829,861 external-priority patent/US10475233B2/en
Application filed by Maxx Media Group LLC filed Critical Maxx Media Group LLC
Publication of WO2018187724A1 publication Critical patent/WO2018187724A1/en
Publication of WO2018187724A8 publication Critical patent/WO2018187724A8/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/557—Depth or shape recovery from multiple images from light fields, e.g. from plenoptic cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/593—Depth or shape recovery from multiple images from stereo images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H04N13/232—Image signal generators using stereoscopic image cameras using a single 2D image sensor using fly-eye lenses, e.g. arrangements of circular lenses
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10052—Images from lightfield camera

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Processing Or Creating Images (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

System, method and software for producing imagery with enhanced 3D effects that is viewed on a display medium (14). To create the imagery with enhanced 3D effects, a light field camera (17) images a scene that contains at least one subject (20). At a given moment in time, the subject (20) is positioned in an initial orientation. Upon imaging, the light field camera (17) produces light field image data (16) that represents the scene. The light field image data (16) is edited to add enhanced 3D effects. Once edited, the enhanced image data (43) is played on a display medium (12), where the added 3D effects cause the subject to appear, at least in part, to extend vertically above, or in front of, the display medium (14).
PCT/US2018/026516 2017-04-06 2018-04-06 System, method and software for converting images captured by a light field camera into three-dimensional images that appear to extend vertically above or in front of a display medium Ceased WO2018187724A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US15/481,447 2017-04-06
US15/481,447 US10136121B2 (en) 2016-04-08 2017-04-06 System, method and software for producing virtual three dimensional images that appear to project forward of or above an electronic display
US15/829,861 US10475233B2 (en) 2016-04-08 2017-12-01 System, method and software for converting images captured by a light field camera into three-dimensional images that appear to extend vertically above or in front of a display medium
US15/829,861 2017-12-01

Publications (2)

Publication Number Publication Date
WO2018187724A1 WO2018187724A1 (en) 2018-10-11
WO2018187724A8 true WO2018187724A8 (en) 2019-05-02

Family

ID=63712660

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2018/026516 Ceased WO2018187724A1 (en) 2017-04-06 2018-04-06 System, method and software for converting images captured by a light field camera into three-dimensional images that appear to extend vertically above or in front of a display medium

Country Status (1)

Country Link
WO (1) WO2018187724A1 (en)

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4903240B2 (en) * 2009-03-31 2012-03-28 シャープ株式会社 Video processing apparatus, video processing method, and computer program
US8749620B1 (en) * 2010-02-20 2014-06-10 Lytro, Inc. 3D light field cameras, images and files, and methods of using, operating, processing and viewing same
US8665304B2 (en) * 2011-03-21 2014-03-04 Sony Corporation Establishing 3D video conference presentation on 2D display
JOP20190237A1 (en) * 2016-04-08 2017-06-16 Maxx Media Group Llc System, method and software for producing virtual three dimensional images that appear to project forward of or above an electronic display

Also Published As

Publication number Publication date
WO2018187724A1 (en) 2018-10-11

Similar Documents

Publication Publication Date Title
US11076142B2 (en) Real-time aliasing rendering method for 3D VR video and virtual three-dimensional scene
US9094675B2 (en) Processing image data from multiple cameras for motion pictures
KR102214827B1 (en) Method and apparatus for providing augmented reality
EP3107065A1 (en) Methods and systems for providing virtual lighting
WO2016103024A3 (en) Three dimensional imaging with a single camera
CN106302132A (en) A kind of 3D instant communicating system based on augmented reality and method
CN104539925A (en) 3D scene reality augmentation method and system based on depth information
CA2927046A1 (en) Method and system for 360 degree head-mounted display monitoring between software program modules using video or image texture sharing
WO2019085022A1 (en) Generation method and device for optical field 3d display unit image
CN110798634B (en) Image self-adaptive synthesis method and device and computer readable storage medium
CA3057513C (en) System, method and software for producing virtual three dimensional images that appear to project forward of or above an electronic display
HK1232329A1 (en) Motion tracking system
CN103269430A (en) Three-dimensional scene generation method based on building information model (BIM)
TW201114244A (en) Method for generating a 3D image
CN108600729B (en) Dynamic 3D model generation device and image generation method
KR101453531B1 (en) 3D Real-Time Virtual Studio System And Method For Producting Virtual Studio Image In Real-Time Virtual Studio System
CN111629194B (en) Method and system for converting panoramic video into 6DOF video based on neural network
WO2018187724A8 (en) System, method and software for converting images captured by a light field camera into three-dimensional images that appear to extend vertically above or in front of a display medium
KR20170077331A (en) Arbitrary View Image Generation Method and System
KR102082131B1 (en) Inserting Method of Augment Reality Information in Drone Moving Picture
CN106954060B (en) A kind of three-dimensional video-frequency generation method and auxiliary filming apparatus towards smart phone
CN109379579B (en) Processing method for acquiring real three-dimensional data of light field in real time
KR102145017B1 (en) 3D virtual studio system, and 3D virtual studio image synthesis method
CN106664396A (en) Stereoscopic video generation
CN203673217U (en) Double pick-up head optical grating vision-separating screen stereoscopic camera

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18781716

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase in:

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18781716

Country of ref document: EP

Kind code of ref document: A1