[go: up one dir, main page]

RU2017103121A - Активация органов управления на основе отражения - Google Patents

Активация органов управления на основе отражения Download PDF

Info

Publication number
RU2017103121A
RU2017103121A RU2017103121A RU2017103121A RU2017103121A RU 2017103121 A RU2017103121 A RU 2017103121A RU 2017103121 A RU2017103121 A RU 2017103121A RU 2017103121 A RU2017103121 A RU 2017103121A RU 2017103121 A RU2017103121 A RU 2017103121A
Authority
RU
Russia
Prior art keywords
user
alignment
processor
image
reflected
Prior art date
Application number
RU2017103121A
Other languages
English (en)
Other versions
RU2017103121A3 (ru
RU2693308C2 (ru
Inventor
Биунгдзоо ЛИ
Масааки ФУКУМОТО
Original Assignee
МАЙКРОСОФТ ТЕКНОЛОДЖИ ЛАЙСЕНСИНГ, ЭлЭлСи
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by МАЙКРОСОФТ ТЕКНОЛОДЖИ ЛАЙСЕНСИНГ, ЭлЭлСи filed Critical МАЙКРОСОФТ ТЕКНОЛОДЖИ ЛАЙСЕНСИНГ, ЭлЭлСи
Publication of RU2017103121A publication Critical patent/RU2017103121A/ru
Publication of RU2017103121A3 publication Critical patent/RU2017103121A3/ru
Application granted granted Critical
Publication of RU2693308C2 publication Critical patent/RU2693308C2/ru

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/165—Detection; Localisation; Normalisation using facial parts and geometric relationships
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/038—Indexing scheme relating to G06F3/038
    • G06F2203/0381—Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Geometry (AREA)
  • Ophthalmology & Optometry (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)
  • Optical Radar Systems And Details Thereof (AREA)
  • Geophysics And Detection Of Objects (AREA)
  • Telephone Function (AREA)
  • Image Analysis (AREA)

Claims (21)

1. Процессорно-реализуемый способ, содержащий этап, на котором:
активируют орган управления пользовательского интерфейса на основании выравнивания между изображением, отраженным на отражающей поверхности электронного устройства, и физическим положением на отражающей поверхности, причем орган управления пользовательского интерфейса отображается в физическом положении.
2. Процессорно-реализуемый способ по п. 1, дополнительно содержащий этапы, на которых:
обнаруживают выравнивание между отраженным изображением и физическим положением на отражающей поверхности; и
обнаруживают действие выбора при поддержании выравнивания.
3. Процессорно-реализуемый способ по п. 2, в котором действием выбора является перемещение пользователя.
4. Процессорно-реализуемый способ по п. 2, в котором действие выбора обнаруживается с помощью микрофона электронного устройства.
5. Процессорно-реализуемый способ по п. 1, в котором отраженным изображением является отраженная часть пользователя.
6. Процессорно-реализуемый способ по п. 1, в котором отраженным изображением является изображение глаза пользователя.
7. Процессорно-реализуемый способ по п. 1, в котором выравнивание достигается в направлении вдоль линии взгляда пользователя.
8. Электронная система, содержащая:
контроллер пользовательского интерфейса, выполненный с возможностью активации органа управления электронного устройства на основании выравнивания между изображением, отраженным на отражающей поверхности электронного устройства, и физическим положением на отражающей поверхности, причем орган управления пользовательского интерфейса отображается в физическом положении.
9. Электронная система по п. 8, в которой пользовательский интерфейс дополнительно выполнен с возможностью:
обнаруживать выравнивание между отраженным изображением и физическим положением на отражающей поверхности; и
обнаруживать действие выбора при поддержании выравнивания.
10. Электронная система по п. 9, в которой действием выбора является перемещение пользователя.
11. Электронная система по п. 9, в которой действие выбора обнаруживается с помощью микрофона электронного устройства.
12. Электронная система по п. 8, в которой отраженным изображением является отраженная часть пользователя.
13. Электронная система по п. 8, в которой отраженным изображением является изображение глаза пользователя.
14. Электронная система по п. 8, в которой выравнивание достигается в направлении вдоль линии взгляда пользователя.
15. Один или более материальных компьютерно-считываемых носителей данных, кодирующих компьютерную программу, которая, при выполнении блоком обработки, предписывает блоку обработки выполнять способ по любому из пп. 1-7.
RU2017103121A 2014-08-01 2015-07-29 Активация органов управления на основе отражения RU2693308C2 (ru)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US14/449,435 2014-08-01
US14/449,435 US9645641B2 (en) 2014-08-01 2014-08-01 Reflection-based control activation
PCT/US2015/042550 WO2016018957A1 (en) 2014-08-01 2015-07-29 Reflection-based control activation

Publications (3)

Publication Number Publication Date
RU2017103121A true RU2017103121A (ru) 2018-08-01
RU2017103121A3 RU2017103121A3 (ru) 2018-12-20
RU2693308C2 RU2693308C2 (ru) 2019-07-02

Family

ID=53836836

Family Applications (1)

Application Number Title Priority Date Filing Date
RU2017103121A RU2693308C2 (ru) 2014-08-01 2015-07-29 Активация органов управления на основе отражения

Country Status (11)

Country Link
US (1) US9645641B2 (ru)
EP (1) EP3175325B1 (ru)
JP (1) JP6898234B2 (ru)
KR (1) KR102392437B1 (ru)
CN (1) CN107077200B (ru)
AU (1) AU2015296666B2 (ru)
BR (1) BR112017001326A2 (ru)
CA (1) CA2955072C (ru)
MX (1) MX374243B (ru)
RU (1) RU2693308C2 (ru)
WO (1) WO2016018957A1 (ru)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2996020A4 (en) * 2013-05-08 2016-05-25 Fujitsu Ltd INPUT DEVICE AND INPUT PROGRAM
WO2016064311A1 (en) * 2014-10-22 2016-04-28 Telefonaktiebolaget L M Ericsson (Publ) Method and device for providing a touch-based user interface
JP6780315B2 (ja) * 2016-06-22 2020-11-04 カシオ計算機株式会社 投影装置、投影システム、投影方法及びプログラム
US11423879B2 (en) * 2017-07-18 2022-08-23 Disney Enterprises, Inc. Verbal cues for high-speed control of a voice-enabled device
WO2019212569A1 (en) * 2018-05-04 2019-11-07 Google Llc Adapting automated assistant based on detected mouth movement and/or gaze
US11080514B2 (en) * 2019-09-13 2021-08-03 Citrix Systems, Inc. Facial recognition based auto zoom
JP7446913B2 (ja) * 2020-05-21 2024-03-11 キヤノン株式会社 電子機器、電子機器の制御方法、プログラム

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05204526A (ja) * 1992-01-23 1993-08-13 Nec Corp 視点監視入力装置
JPH1097376A (ja) * 1996-09-20 1998-04-14 Canon Inc 視線操作装置
US6088018A (en) * 1998-06-11 2000-07-11 Intel Corporation Method of using video reflection in providing input data to a computer system
RU2316051C2 (ru) * 2005-01-12 2008-01-27 Самсунг Электроникс Ко., Лтд. Способ и система автоматической проверки присутствия лица живого человека в биометрических системах безопасности
JP2008118633A (ja) * 2006-10-11 2008-05-22 Victor Co Of Japan Ltd 電子機器の制御装置及び制御方法
US8726194B2 (en) * 2007-07-27 2014-05-13 Qualcomm Incorporated Item selection using enhanced control
US9002073B2 (en) * 2007-09-01 2015-04-07 Eyelock, Inc. Mobile identity platform
US20110273369A1 (en) 2010-05-10 2011-11-10 Canon Kabushiki Kaisha Adjustment of imaging property in view-dependent rendering
EP3527121B1 (en) * 2011-02-09 2023-08-23 Apple Inc. Gesture detection in a 3d mapping environment
US8625847B2 (en) * 2011-03-21 2014-01-07 Blackberry Limited Login method based on direction of gaze
US8594374B1 (en) 2011-03-30 2013-11-26 Amazon Technologies, Inc. Secure device unlock with gaze calibration
KR101773845B1 (ko) 2011-05-16 2017-09-01 삼성전자주식회사 휴대용 단말기에서 입력 처리 방법 및 장치
US8885882B1 (en) * 2011-07-14 2014-11-11 The Research Foundation For The State University Of New York Real time eye tracking for human computer interaction
US9083532B2 (en) * 2012-03-06 2015-07-14 Ebay Inc. Physiological response PIN entry
JP5456817B2 (ja) * 2012-03-23 2014-04-02 ヤフー株式会社 表示制御装置、表示制御方法、情報表示システム及びプログラム
AU2013205535B2 (en) 2012-05-02 2018-03-15 Samsung Electronics Co., Ltd. Apparatus and method of controlling mobile terminal based on analysis of user's face
TWI590098B (zh) 2012-05-09 2017-07-01 劉鴻達 以臉部表情為輸入的控制系統
WO2013168171A1 (en) * 2012-05-10 2013-11-14 Umoove Services Ltd. Method for gesture-based operation control
US20130342672A1 (en) 2012-06-25 2013-12-26 Amazon Technologies, Inc. Using gaze determination with device input
PT106430B (pt) * 2012-07-03 2018-08-07 Cesar Augusto Dos Santos Silva Sistema para medição da distância interpupilar usando um dispositivo equipado com um ecrã e uma câmara
KR20140073730A (ko) * 2012-12-06 2014-06-17 엘지전자 주식회사 이동 단말기 및 이동 단말기 제어방법
US9274608B2 (en) * 2012-12-13 2016-03-01 Eyesight Mobile Technologies Ltd. Systems and methods for triggering actions based on touch-free gesture detection
KR102012254B1 (ko) * 2013-04-23 2019-08-21 한국전자통신연구원 이동 단말기를 이용한 사용자 응시점 추적 방법 및 그 장치
RU2522848C1 (ru) * 2013-05-14 2014-07-20 Федеральное государственное бюджетное учреждение "Национальный исследовательский центр "Курчатовский институт" Способ управления устройством с помощью глазных жестов в ответ на стимулы
GB2514603B (en) * 2013-05-30 2020-09-23 Tobii Ab Gaze-controlled user interface with multimodal input
TW201518979A (zh) * 2013-11-15 2015-05-16 Utechzone Co Ltd 手持式眼控接目裝置、及密碼輸入裝置、方法以及電腦可讀取記錄媒體及電腦程式產品
US20150227735A1 (en) * 2014-02-13 2015-08-13 Robert Chappell System and method for eye tracking authentication

Also Published As

Publication number Publication date
RU2017103121A3 (ru) 2018-12-20
CA2955072A1 (en) 2016-02-04
AU2015296666B2 (en) 2020-04-30
EP3175325A1 (en) 2017-06-07
JP6898234B2 (ja) 2021-07-07
MX2017001514A (es) 2017-05-09
WO2016018957A1 (en) 2016-02-04
US9645641B2 (en) 2017-05-09
CN107077200A (zh) 2017-08-18
BR112017001326A2 (pt) 2017-11-14
KR102392437B1 (ko) 2022-04-28
US20160034030A1 (en) 2016-02-04
RU2693308C2 (ru) 2019-07-02
KR20170040222A (ko) 2017-04-12
EP3175325B1 (en) 2020-11-18
AU2015296666A1 (en) 2017-02-09
CA2955072C (en) 2022-02-22
MX374243B (es) 2025-03-05
JP2017526096A (ja) 2017-09-07
CN107077200B (zh) 2020-01-21

Similar Documents

Publication Publication Date Title
RU2017103121A (ru) Активация органов управления на основе отражения
EP4435577A3 (en) Method and apparatus for applying free space input for surface constrained control
EP2827225A3 (en) System and method for activating a hidden control
EP3548773A4 (en) USER CONTROL DEVICE WITH USER PRESENCE DETECTION AND ASSOCIATED SYSTEMS AND PROCEDURES
MX2018003613A (es) Dispositivo de control, metodo de control y programa.
EP3218845A4 (en) Facial liveness detection in image biometrics
EP2966561A3 (en) Mobile terminal equipped with touch screen and method of controlling therefor
JP2016515268A5 (ru)
EP4462424A3 (en) Method and apparatus for activating application by speech input
EP3234863A4 (en) Fingerprint enrollment using touch sensor data
MX373032B (es) Aparato domestico de operacion electrica teniendo dispositivo de reconocimiento de voz.
GB2542518A (en) Virtualization of tangible interface objects
EP2706434A3 (en) Gesture recognition apparatus, control method thereof, display instrument, and computer readable medium
JP2015201217A5 (ru)
MX2016000613A (es) Aviso de alerta haptico de vehiculo basado en dispositivo portable.
EP4250738A3 (en) Method for controlling a camera based on processing an image captured by other camera
EP2911050A3 (en) User terminal apparatus and control method thereof
EP3123395A4 (en) Capacitive fingerprint sensor with improved sensing element
EP3092638A4 (en) GENERAL SETS IN AUTOMATIC LANGUAGE IDENTIFICATION SYSTEMS
EP2772811A3 (en) Recognition-based industrial automation control with confidence-based decision support
MX2015016464A (es) Ajuste de velocidad de vehiculo.
TW201612724A (en) Electronic device and display interface adjusting method thereof
EP3356996A4 (en) DEVICE FOR DETECTING DIGITAL IMPRESSIONS WITH COMMON MODE REMOVAL
MX392090B (es) Metodo de control de desplazamiento y aparato de control de desplazamiento.
WO2017116813A3 (en) Haptic feedback for non-touch surface interaction