[go: up one dir, main page]

DuVall et al., 2019 - Google Patents

Compositing light field video using multiplane images

DuVall et al., 2019

Document ID
2439541120715404291
Author
DuVall M
Flynn J
Broxton M
Debevec P
Publication year
Publication venue
ACM SIGGRAPH 2019 Posters

External Links

Snippet

We present a variety of new compositing techniques using Multi-plane Images (MPI's)[Zhou et al. 2018] derived from footage shot with an inexpensive and portable light field video camera array. The effects include camera stabilization, foreground object removal, synthetic …
Continue reading at dl.acm.org (other versions)

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/50—Lighting effects
    • G06T15/60—Shadow generation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/04—Texture mapping
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/50—Lighting effects
    • G06T15/503—Blending, e.g. for anti-aliasing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic or multiview television systems; Details thereof
    • H04N13/02—Picture signal generators
    • H04N13/0203—Picture signal generators using a stereoscopic image camera
    • H04N13/0207—Picture signal generators using a stereoscopic image camera involving a single 2D image pickup sensor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/06—Ray-tracing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic or multiview television systems; Details thereof
    • H04N13/02—Picture signal generators
    • H04N13/0203—Picture signal generators using a stereoscopic image camera
    • H04N13/0239—Picture signal generators using a stereoscopic image camera having two 2D image pickup sensors representing the interocular distance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/005—General purpose rendering architectures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/05—Geographic models
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic or multiview television systems; Details thereof
    • H04N13/0003—Stereoscopic image signal coding, multiplexing, processing, recording or transmission
    • H04N13/0007—Processing stereoscopic image signals
    • H04N13/0011—Transformation of stereoscopic image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic or multiview television systems; Details thereof
    • H04N13/02—Picture signal generators
    • H04N13/0275—Picture signal generators from a 3D object model, e.g. computer generated stereoscopic image signals
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration, e.g. from bit-mapped to bit-mapped creating a similar image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformation in the plane of the image, e.g. from bit-mapped to bit-mapped creating a different image
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic or multiview television systems; Details thereof
    • H04N13/04—Picture reproducers

Similar Documents

Publication Publication Date Title
Serrano et al. Motion parallax for 360 RGBD video
US10839591B2 (en) Stereoscopic rendering using raymarching and a virtual view broadcaster for such rendering
US10621777B2 (en) Synthesis of composite images having virtual backgrounds
JP4783588B2 (en) Interactive viewpoint video system and process
Bonatto et al. Real-time depth video-based rendering for 6-DoF HMD navigation and light field displays
DuVall et al. Compositing light field video using multiplane images
Liu et al. Static scene illumination estimation from videos with applications
JP4996922B2 (en) 3D visualization
Pietroszek et al. Volumetric capture for narrative films
Casas et al. Rapid photorealistic blendshape modeling from RGB-D sensors
Zhang et al. Zerocomp: Zero-shot object compositing from image intrinsics via diffusion
Baričević et al. User-perspective AR magic lens from gradient-based IBR and semi-dense stereo
US8786681B1 (en) Stereoscopic conversion
Waschbüsch et al. 3d video billboard clouds
US9118902B1 (en) Stereoscopic conversion
Nicolet et al. Repurposing a relighting network for realistic compositions of captured scenes
Volino et al. Light field compression using eigen textures
Rajan et al. A realistic video avatar system for networked virtual environments
Hanika et al. Camera space volumetric shadows
Levieux et al. Interactive viewpoint video textures
Li et al. Tour Into the Picture Revisited.
Tomoto et al. Casual real-world VR using light fields
Liu et al. See360: Novel panoramic view interpolation
Noh et al. Soft shadow rendering based on real light source estimation in augmented reality
Andersson et al. Efficient multi-view ray tracing using edge detection and shader reuse