[go: up one dir, main page]

GB2596777B - Facial re-enactment - Google Patents

Facial re-enactment Download PDF

Info

Publication number
GB2596777B
GB2596777B GB2007052.0A GB202007052A GB2596777B GB 2596777 B GB2596777 B GB 2596777B GB 202007052 A GB202007052 A GB 202007052A GB 2596777 B GB2596777 B GB 2596777B
Authority
GB
United Kingdom
Prior art keywords
enactment
facial
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
GB2007052.0A
Other versions
GB202007052D0 (en
GB2596777A (en
Inventor
Zafeiriou Stefanos
Koujan Rami
Doukas Michail-Christos
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to GB2007052.0A priority Critical patent/GB2596777B/en
Publication of GB202007052D0 publication Critical patent/GB202007052D0/en
Priority to PCT/CN2021/093530 priority patent/WO2021228183A1/en
Publication of GB2596777A publication Critical patent/GB2596777A/en
Application granted granted Critical
Publication of GB2596777B publication Critical patent/GB2596777B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/18Image warping, e.g. rearranging pixels individually
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0464Convolutional networks [CNN, ConvNet]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/047Probabilistic or stochastic networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0475Generative networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/088Non-supervised learning, e.g. competitive learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/0895Weakly supervised learning, e.g. semi-supervised or self-supervised learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/09Supervised learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/094Adversarial learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00Animation
    • G06T13/203D [Three Dimensional] animation
    • G06T13/403D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174Facial expression recognition
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/60Editing figures and text; Combining figures or text
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person
    • G06T2207/30201Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Ophthalmology & Optometry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Probability & Statistics with Applications (AREA)
  • Image Analysis (AREA)
GB2007052.0A 2020-05-13 2020-05-13 Facial re-enactment Active GB2596777B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
GB2007052.0A GB2596777B (en) 2020-05-13 2020-05-13 Facial re-enactment
PCT/CN2021/093530 WO2021228183A1 (en) 2020-05-13 2021-05-13 Facial re-enactment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB2007052.0A GB2596777B (en) 2020-05-13 2020-05-13 Facial re-enactment

Publications (3)

Publication Number Publication Date
GB202007052D0 GB202007052D0 (en) 2020-06-24
GB2596777A GB2596777A (en) 2022-01-12
GB2596777B true GB2596777B (en) 2025-04-09

Family

ID=71135033

Family Applications (1)

Application Number Title Priority Date Filing Date
GB2007052.0A Active GB2596777B (en) 2020-05-13 2020-05-13 Facial re-enactment

Country Status (2)

Country Link
GB (1) GB2596777B (en)
WO (1) WO2021228183A1 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112184542A (en) * 2020-07-17 2021-01-05 湖南大学 Posture-guided style-preserving human body image generation method
CN112767287B (en) * 2021-03-10 2024-12-17 百果园技术(新加坡)有限公司 Model training and image processing method, device, equipment and medium
CN113744129A (en) * 2021-09-08 2021-12-03 深圳龙岗智能视听研究院 Semantic neural rendering-based face image generation method and system
CN114373034B (en) * 2022-01-10 2024-08-06 腾讯科技(深圳)有限公司 Image processing method, apparatus, device, storage medium, and computer program
CN114926591B (en) * 2022-05-25 2025-05-02 广州图匠数据科技有限公司 Multi-branch deep learning 3D face reconstruction model training method, system and medium
CN115984949B (en) * 2023-03-21 2023-07-04 威海职业学院(威海市技术学院) Low-quality face image recognition method and equipment with attention mechanism
CN118761935B (en) * 2024-08-30 2024-12-24 合肥安达创展科技股份有限公司 Face reshaping method based on generation countermeasure network, electronic equipment and storage medium

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180068178A1 (en) * 2016-09-05 2018-03-08 Max-Planck-Gesellschaft Zur Förderung D. Wissenschaften E.V. Real-time Expression Transfer for Facial Reenactment

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2012254944B2 (en) * 2012-03-21 2018-03-01 Commonwealth Scientific And Industrial Research Organisation Method and system for facial expression transfer
US9378576B2 (en) * 2013-06-07 2016-06-28 Faceshift Ag Online modeling for real-time facial animation
CN103268623B (en) * 2013-06-18 2016-05-18 西安电子科技大学 A kind of Static Human Face countenance synthesis method based on frequency-domain analysis
CN104008564B (en) * 2014-06-17 2018-01-12 河北工业大学 A kind of human face expression cloning process
US9799096B1 (en) * 2014-07-08 2017-10-24 Carnegie Mellon University System and method for processing video to provide facial de-identification
CN106327482B (en) * 2016-08-10 2019-01-22 东方网力科技股份有限公司 A kind of method for reconstructing and device of the facial expression based on big data
CN108288072A (en) * 2018-01-26 2018-07-17 深圳市唯特视科技有限公司 A kind of facial expression synthetic method based on generation confrontation network
CN109934767A (en) * 2019-03-06 2019-06-25 中南大学 A facial expression conversion method based on identity and expression feature conversion

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180068178A1 (en) * 2016-09-05 2018-03-08 Max-Planck-Gesellschaft Zur Förderung D. Wissenschaften E.V. Real-time Expression Transfer for Facial Reenactment

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) 2019, IEEE, Any-to-one Face Reenactment Based on Conditional Generative Adversarial Network, pages 1657-1664 *
Hyeongwoo Kim et al, "Deep video Portraits", published 2018, Available from: https://arxiv.org/pdf/1805.11714 , Accessed 20 July 2024 *
IEEE Winter Conference on Applications of Computer Vision (WACV) 2020, Published 1 March 2020, IEEE, Kaur Harsimran, Manduchi Roberto EyeGAN: Gaze-Preserving, Mask-Mediated Eye Image Synthesis, pages 299-308 *
IEEE Winter Conference on Applications of Computer Vision (WACV) 2020, Published 1 March 2020, IEEE, Tripathy Soumya et al, ICface: Interpretable and Controllable Face Reenactment Using GANs, pages 3374-3383 *
Thies Justus et al, "FaceVR: Real-Time Facial Reenactment and Eye Gaze Control in Virtual Reality", published 21 March 2018, Available from: https://arxiv.org/pdf/1610.03151, Accessed 14 August 2024 *

Also Published As

Publication number Publication date
WO2021228183A1 (en) 2021-11-18
GB202007052D0 (en) 2020-06-24
GB2596777A (en) 2022-01-12

Similar Documents

Publication Publication Date Title
GB2596777B (en) Facial re-enactment
GB202102648D0 (en) Depilator
CA206560S (en) Lipstick
GB202005890D0 (en) New uses
GB202013672D0 (en) Mult-function beauty device
GB2618921B (en) Depilator
SG11202108852PA (en) Hair treatment composition
CA191781S (en) Cosmetic massage roller
ZA202000346B (en) A personal care composition
ZA202105405B (en) Cosmetic/dermatological composition
GB202006960D0 (en) Therapeutic
GB202001980D0 (en) Therapeutic mentods
GB202015149D0 (en) Gripp-in hair
GB202006236D0 (en) New treatment
GB202004804D0 (en) Skin
GB202003184D0 (en) Cosmetic composition
GB201804226D0 (en) A hair treatment composition
CA216343S (en) Lipstick
GB202112414D0 (en) Eyebrow postiche
GB2631602B (en) Depilator
CA210098S (en) Lipstick
CA210130S (en) Lipstick
CA210128S (en) Lipstick
GB202304771D0 (en) Beauty atmahiling
GB202108300D0 (en) New treatment

Legal Events

Date Code Title Description
COOA Change in applicant's name or ownership of the application

Owner name: HUAWEI TECHNOLOGIES CO., LTD

Free format text: FORMER OWNER: FACESOFT LTD.