[go: up one dir, main page]

JayBusch et al. - Google Patents

Head-mounted Photometric Stereo for Performance Capture

JayBusch et al.

View PDF
Document ID
7459419790683744824
Author
JayBusch A
PaulDebevec R

External Links

Snippet

Head-mounted cameras are an increasingly important tool for capturing facial performances to drive virtual characters. They provide a fixed, unoccluded view of the face, useful for observing motion capture dots or as input to video analysis. However, the 2D imagery …
Continue reading at scholar.archive.org (PDF) (other versions)

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/50—Lighting effects
    • G06T15/60—Shadow generation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06K—RECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00—Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00221—Acquiring or recognising human faces, facial parts, facial sketches, facial expressions
    • G06K9/00268—Feature extraction; Face representation
    • G06K9/00281—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/04—Texture mapping
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general

Similar Documents

Publication Publication Date Title
Bermano et al. Makeup lamps: Live augmentation of human faces via projection
Thies et al. Facevr: Real-time facial reenactment and eye gaze control in virtual reality
JP6824279B2 (en) Head-mounted display for virtual reality and mixed reality with inside-out position, user body, and environmental tracking
US20120062719A1 (en) Head-Mounted Photometric Facial Performance Capture
US10380802B2 (en) Projecting augmentation images onto moving objects
US5870136A (en) Dynamic generation of imperceptible structured light for tracking and acquisition of three dimensional scene geometry and surface characteristics in interactive three dimensional computer graphics applications
Martull et al. Realistic CG stereo image dataset with ground truth disparity maps
WO2022197024A1 (en) Point-based modeling of human clothing
US7606392B2 (en) Capturing and processing facial motion data
Alexander et al. Creating a photoreal digital actor: The digital emily project
US20140176591A1 (en) Low-latency fusing of color image data
Klein Visual tracking for augmented reality
KR20200087757A (en) Full convolutional point of interest detection and description through homographic adaptation
AU2018292610A1 (en) Method and system for performing simultaneous localization and mapping using convolutional image transformation
Zhao et al. Mask-off: Synthesizing face images in the presence of head-mounted displays
EP4298592A1 (en) Photo relighting and background replacement based on machine learning models
US20240257419A1 (en) Virtual try-on via warping and parser-based rendering
Malleson et al. Rapid one-shot acquisition of dynamic VR avatars
Fukamizu et al. Elamorph projection: Deformation of 3d shape by dynamic projection mapping
Casas et al. Rapid photorealistic blendshape modeling from RGB-D sensors
Zheng Spatio-temporal registration in augmented reality
Farbiz et al. Live three-dimensional content for augmented reality
Schindler Photometric stereo via computer screen lighting for real-time surface reconstruction
KR20250108619A (en) Appearance capture
JayBusch et al. Head-mounted Photometric Stereo for Performance Capture