[go: up one dir, main page]

WO2002009038A3 - Method and system for customizing facial feature tracking using precise landmark finding on a neutral face image - Google Patents

Method and system for customizing facial feature tracking using precise landmark finding on a neutral face image Download PDF

Info

Publication number
WO2002009038A3
WO2002009038A3 PCT/US2001/023337 US0123337W WO0209038A3 WO 2002009038 A3 WO2002009038 A3 WO 2002009038A3 US 0123337 W US0123337 W US 0123337W WO 0209038 A3 WO0209038 A3 WO 0209038A3
Authority
WO
WIPO (PCT)
Prior art keywords
face image
facial feature
feature tracking
neutral face
customizing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2001/023337
Other languages
French (fr)
Other versions
WO2002009038A2 (en
Inventor
Ulrich F Buddenmeier
Hartmut Neven
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Eyematic Interfaces Inc
Original Assignee
Eyematic Interfaces Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Eyematic Interfaces Inc filed Critical Eyematic Interfaces Inc
Priority to JP2002514665A priority Critical patent/JP2004505353A/en
Priority to AU7714801A priority patent/AU7714801A/en
Priority to EP01954934A priority patent/EP1303842A2/en
Priority to AU2001277148A priority patent/AU2001277148B2/en
Priority to KR1020037001107A priority patent/KR100827939B1/en
Publication of WO2002009038A2 publication Critical patent/WO2002009038A2/en
Publication of WO2002009038A3 publication Critical patent/WO2002009038A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—3D [Three Dimensional] animation
    • G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/97—Determining parameters from multiple pictures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/42—Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation
    • G06V10/422—Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation for representing the structure of the pattern or shape of an object therefor
    • G06V10/426—Graphical representations
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20048—Transform domain processing
    • G06T2207/20064—Wavelet transform [DWT]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Processing Or Creating Images (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

The present invention is embodied in a method and system for customizing a visual sensor for facial feature tracking using a neutral face image of an actor. The method may include generating a corrector graph to improve the sensor's performance in tracking an actor's facial features.
PCT/US2001/023337 2000-07-24 2001-07-24 Method and system for customizing facial feature tracking using precise landmark finding on a neutral face image Ceased WO2002009038A2 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
JP2002514665A JP2004505353A (en) 2000-07-24 2001-07-24 Facial feature special method and device by accurate landmark detection on expressionless facial image
AU7714801A AU7714801A (en) 2000-07-24 2001-07-24 Method and system for customizing facial feature tracking using precise landmarkfinding on a neutral face image
EP01954934A EP1303842A2 (en) 2000-07-24 2001-07-24 Method and system for customizing facial feature tracking using precise landmark finding on a neutral face image
AU2001277148A AU2001277148B2 (en) 2000-07-24 2001-07-24 Method and system for customizing facial feature tracking using precise landmark finding on a neutral face image
KR1020037001107A KR100827939B1 (en) 2000-07-24 2001-07-24 Methods and systems for customizing facial feature tracking using precision landmark discovery on expressionless face images

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US22028800P 2000-07-24 2000-07-24
US60/220,288 2000-07-24

Publications (2)

Publication Number Publication Date
WO2002009038A2 WO2002009038A2 (en) 2002-01-31
WO2002009038A3 true WO2002009038A3 (en) 2002-06-27

Family

ID=22822939

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2001/023337 Ceased WO2002009038A2 (en) 2000-07-24 2001-07-24 Method and system for customizing facial feature tracking using precise landmark finding on a neutral face image

Country Status (5)

Country Link
EP (1) EP1303842A2 (en)
JP (1) JP2004505353A (en)
KR (1) KR100827939B1 (en)
AU (2) AU7714801A (en)
WO (1) WO2002009038A2 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101823611B1 (en) 2015-10-05 2018-01-31 주식회사 감성과학연구센터 Method for extracting Emotional Expression information based on Action Unit
KR101783453B1 (en) 2015-10-05 2017-09-29 (주)감성과학연구센터 Method and Apparatus for extracting information of facial movement based on Action Unit
KR20250062029A (en) 2023-10-30 2025-05-08 광운대학교 산학협력단 Method of detecting image frames of facial expression and expressionless state in dynamic video, diagnostic evaluation method and system for grading facial paralysis using the same
KR20250062030A (en) 2023-10-30 2025-05-08 광운대학교 산학협력단 Method of evaluating facial symmetry using landmark vectors in dynamic video, diagnostic evaluation method for grading facial paralysis using the same

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999053443A1 (en) * 1998-04-13 1999-10-21 Eyematic Interfaces, Inc. Wavelet-based facial motion capture for avatar animation
US6031539A (en) * 1997-03-10 2000-02-29 Digital Equipment Corporation Facial image method and apparatus for semi-automatically mapping a face on to a wireframe topology

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6031539A (en) * 1997-03-10 2000-02-29 Digital Equipment Corporation Facial image method and apparatus for semi-automatically mapping a face on to a wireframe topology
WO1999053443A1 (en) * 1998-04-13 1999-10-21 Eyematic Interfaces, Inc. Wavelet-based facial motion capture for avatar animation

Also Published As

Publication number Publication date
KR100827939B1 (en) 2008-05-13
EP1303842A2 (en) 2003-04-23
AU2001277148B2 (en) 2007-09-20
WO2002009038A2 (en) 2002-01-31
KR20030041131A (en) 2003-05-23
AU7714801A (en) 2002-02-05
JP2004505353A (en) 2004-02-19

Similar Documents

Publication Publication Date Title
EP1967941A3 (en) Video-based image control system
EP1221673A3 (en) Method and device for generating a person's portrait and communications terminal using the same
WO1999060788A8 (en) Locating an audio source
WO2004023783A3 (en) Single-camera tracking of an object
CA2376184A1 (en) Head tracker system
EP0835584A4 (en) A system for enhancing the television presentation of an object at a sporting event
CA2240745A1 (en) Image processing apparatus
WO2003009643A1 (en) Sound image localizer
EP1416002A3 (en) Method of separating fluoropolymer from a solution therof and carbon dioxide
WO2004001667A3 (en) Systems and methods for de-blurring motion blurred images
EP1130907A3 (en) Infrared sensor temperature compensated response and offset correction
AU2414597A (en) Method and system for manipulation of objects in a television picture
BR9909611B1 (en) Method and apparatus for detecting facial features in a sequence of image frames comprising an image of a face.
WO1998043105A3 (en) Object tracking system using statistical modeling and geometric relationship
NZ333362A (en) Computer vision system, graphical user interface superimposed on picture from camera
WO2001069535A3 (en) Method and apparatus for performing geo-spatial registration of imagery
WO2002057894A3 (en) Single camera system for gesture-based input and target indication
AU2124297A (en) Method and system for the creation of and navigation through a multidimensional space using encoded digital video
EP1422922A3 (en) Camera system with eye monitoring
WO2001031570A3 (en) Tracking motion of a writing instrument
WO2002005013A3 (en) Impaired vision assist system and method
MY133013A (en) Method of determining relative camera orientation position to create 3-d visual images
WO2003001231A3 (en) Interferometric imaging method apparatus and system
WO1999006950A3 (en) Scanning apparatus and methods
EP0913810A3 (en) Feature extraction and pattern recognition

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
AK Designated states

Kind code of ref document: A3

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWE Wipo information: entry into national phase

Ref document number: 2001277148

Country of ref document: AU

WWE Wipo information: entry into national phase

Ref document number: 1020037001107

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 2001954934

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2001954934

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1020037001107

Country of ref document: KR

WWW Wipo information: withdrawn in national office

Ref document number: 2001954934

Country of ref document: EP