[go: up one dir, main page]

WO1999035633A3 - Human motion following computer mouse and game controller - Google Patents

Human motion following computer mouse and game controller Download PDF

Info

Publication number
WO1999035633A3
WO1999035633A3 PCT/US1999/000086 US9900086W WO9935633A3 WO 1999035633 A3 WO1999035633 A3 WO 1999035633A3 US 9900086 W US9900086 W US 9900086W WO 9935633 A3 WO9935633 A3 WO 9935633A3
Authority
WO
WIPO (PCT)
Prior art keywords
display
computer
items
motion
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US1999/000086
Other languages
French (fr)
Other versions
WO1999035633A2 (en
Inventor
Robert D Frey
Kevin Grealish
Curtis A Vock
Charles M Marshall
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
VIDEO MOUSE GROUP
Original Assignee
VIDEO MOUSE GROUP
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by VIDEO MOUSE GROUP filed Critical VIDEO MOUSE GROUP
Priority to AU22117/99A priority Critical patent/AU2211799A/en
Publication of WO1999035633A2 publication Critical patent/WO1999035633A2/en
Publication of WO1999035633A3 publication Critical patent/WO1999035633A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1012—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1087—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/66—Methods for processing data by generating or executing the game program for rendering three dimensional images
    • A63F2300/6661—Methods for processing data by generating or executing the game program for rendering three dimensional images for changing the position of the virtual camera
    • A63F2300/6676—Methods for processing data by generating or executing the game program for rendering three dimensional images for changing the position of the virtual camera by dedicated player input

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A human motion following controller (10) is provided by the invention to augment motion of items (e.g., computer cursor or scene view) shown on a computer display. The display (14) is coupled to the computer (20) which controls positioning of the items through operating system controls. A camera (16) captures frames of data corresponding to a first image of at least part of a user (e.g., eyes, hands) at the computer display. Signal processing electronics (18) coupled to the camera (a) detects differences between successive frames of data corresponding to motion of the first image, and (b) communicates differences information to the computer to reposition display of the items through the operating system controls. The items are thus repositioned on the display by an amount corresponding to the motion of first image.
PCT/US1999/000086 1998-01-06 1999-01-04 Human motion following computer mouse and game controller Ceased WO1999035633A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU22117/99A AU2211799A (en) 1998-01-06 1999-01-04 Human motion following computer mouse and game controller

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US7051298P 1998-01-06 1998-01-06
US60/070,512 1998-01-06
US10004698P 1998-09-11 1998-09-11
US60/100,046 1998-09-11

Publications (2)

Publication Number Publication Date
WO1999035633A2 WO1999035633A2 (en) 1999-07-15
WO1999035633A3 true WO1999035633A3 (en) 1999-09-23

Family

ID=26751208

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1999/000086 Ceased WO1999035633A2 (en) 1998-01-06 1999-01-04 Human motion following computer mouse and game controller

Country Status (2)

Country Link
AU (1) AU2211799A (en)
WO (1) WO1999035633A2 (en)

Cited By (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7639233B2 (en) 2002-07-27 2009-12-29 Sony Computer Entertainment Inc. Man-machine interface using a deformable device
US8407725B2 (en) 2007-04-24 2013-03-26 Oblong Industries, Inc. Proteins, pools, and slawx in processing environments
US8531396B2 (en) 2006-02-08 2013-09-10 Oblong Industries, Inc. Control system for navigating a principal dimension of a data space
US8537111B2 (en) 2006-02-08 2013-09-17 Oblong Industries, Inc. Control system for navigating a principal dimension of a data space
US8537112B2 (en) 2006-02-08 2013-09-17 Oblong Industries, Inc. Control system for navigating a principal dimension of a data space
US8840470B2 (en) 2008-02-27 2014-09-23 Sony Computer Entertainment America Llc Methods for capturing depth data of a scene and applying computer actions
US8961313B2 (en) 2009-05-29 2015-02-24 Sony Computer Entertainment America Llc Multi-positional three-dimensional controller
US8976265B2 (en) 2002-07-27 2015-03-10 Sony Computer Entertainment Inc. Apparatus for image and sound capture in a game environment
US9075441B2 (en) 2006-02-08 2015-07-07 Oblong Industries, Inc. Gesture based control using three-dimensional information extracted over an extended depth of field
US9317128B2 (en) 2009-04-02 2016-04-19 Oblong Industries, Inc. Remote devices used in a markerless installation of a spatial operating environment incorporating gestural control
US9329723B2 (en) 2012-04-16 2016-05-03 Apple Inc. Reconstruction of original touch image from differential touch image
US9381424B2 (en) 2002-07-27 2016-07-05 Sony Interactive Entertainment America Llc Scheme for translating movements of a hand-held controller into inputs for a system
US9393487B2 (en) 2002-07-27 2016-07-19 Sony Interactive Entertainment Inc. Method for mapping movements of a hand-held controller to game commands
US9474968B2 (en) 2002-07-27 2016-10-25 Sony Interactive Entertainment America Llc Method and system for applying gearing effects to visual tracking
US9495228B2 (en) 2006-02-08 2016-11-15 Oblong Industries, Inc. Multi-process interactive systems and methods
US9495013B2 (en) 2008-04-24 2016-11-15 Oblong Industries, Inc. Multi-modal gestural interface
US9573056B2 (en) 2005-10-26 2017-02-21 Sony Interactive Entertainment Inc. Expandable control device via hardware attachment
US9582131B2 (en) 2009-06-29 2017-02-28 Apple Inc. Touch sensor panel design
US9606630B2 (en) 2005-02-08 2017-03-28 Oblong Industries, Inc. System and method for gesture based control system
US9684380B2 (en) 2009-04-02 2017-06-20 Oblong Industries, Inc. Operating environment with gestural control and multiple client devices, displays, and users
US9740293B2 (en) 2009-04-02 2017-08-22 Oblong Industries, Inc. Operating environment with gestural control and multiple client devices, displays, and users
US9740922B2 (en) 2008-04-24 2017-08-22 Oblong Industries, Inc. Adaptive tracking system for spatial input devices
US9779131B2 (en) 2008-04-24 2017-10-03 Oblong Industries, Inc. Detecting, representing, and interpreting three-space input: gestural continuum subsuming freespace, proximal, and surface-contact modes
US9823747B2 (en) 2006-02-08 2017-11-21 Oblong Industries, Inc. Spatial, multi-modal control device for use with spatial operating system
US9886141B2 (en) 2013-08-16 2018-02-06 Apple Inc. Mutual and self capacitance touch measurements in touch panel
US9910497B2 (en) 2006-02-08 2018-03-06 Oblong Industries, Inc. Gestural control of autonomous and semi-autonomous systems
US9933852B2 (en) 2009-10-14 2018-04-03 Oblong Industries, Inc. Multi-process interactive systems and methods
US9952673B2 (en) 2009-04-02 2018-04-24 Oblong Industries, Inc. Operating environment comprising multiple client devices, multiple displays, multiple users, and gestural control
US9996175B2 (en) 2009-02-02 2018-06-12 Apple Inc. Switching circuitry for touch sensitive display
US10001888B2 (en) 2009-04-10 2018-06-19 Apple Inc. Touch sensor panel design
US10289251B2 (en) 2014-06-27 2019-05-14 Apple Inc. Reducing floating ground effects in pixelated self-capacitance touch screens
US10365773B2 (en) 2015-09-30 2019-07-30 Apple Inc. Flexible scan plan using coarse mutual capacitance and fully-guarded measurements
US10444918B2 (en) 2016-09-06 2019-10-15 Apple Inc. Back of cover touch sensors
US10488992B2 (en) 2015-03-10 2019-11-26 Apple Inc. Multi-chip touch architecture for scalability
US10642364B2 (en) 2009-04-02 2020-05-05 Oblong Industries, Inc. Processing tracking and recognition data in gestural recognition systems
US10642418B2 (en) 2017-04-20 2020-05-05 Apple Inc. Finger tracking in wet environment
US10705658B2 (en) 2014-09-22 2020-07-07 Apple Inc. Ungrounded user signal compensation for pixelated self-capacitance touch sensor panel
US10795488B2 (en) 2015-02-02 2020-10-06 Apple Inc. Flexible self-capacitance and mutual capacitance touch sensing system architecture
US10936120B2 (en) 2014-05-22 2021-03-02 Apple Inc. Panel bootstraping architectures for in-cell self-capacitance
US11269467B2 (en) 2007-10-04 2022-03-08 Apple Inc. Single-layer touch-sensitive display
US11294503B2 (en) 2008-01-04 2022-04-05 Apple Inc. Sensor baseline offset adjustment for a subset of sensor output values
US11662867B1 (en) 2020-05-30 2023-05-30 Apple Inc. Hover detection on a touch sensor panel

Families Citing this family (71)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB0011455D0 (en) * 2000-05-13 2000-06-28 Mathengine Plc Browser system and method for using it
DE10028713B4 (en) * 2000-06-08 2010-11-25 Art+Com Ag Visualization device and method
US7227526B2 (en) 2000-07-24 2007-06-05 Gesturetek, Inc. Video-based image control system
EP1311803B8 (en) 2000-08-24 2008-05-07 VDO Automotive AG Method and navigation device for querying target information and navigating within a map view
US7058204B2 (en) 2000-10-03 2006-06-06 Gesturetek, Inc. Multiple camera control system
JP2002196877A (en) * 2000-12-25 2002-07-12 Hitachi Ltd Electronic devices using image sensors
SE519254C2 (en) 2001-03-15 2003-02-04 Ulf Parke Apparatus and method for controlling a cursor on a monitor by means of the oral cavity
JP3420221B2 (en) * 2001-06-29 2003-06-23 株式会社コナミコンピュータエンタテインメント東京 GAME DEVICE AND PROGRAM
JP3611807B2 (en) * 2001-07-19 2005-01-19 コナミ株式会社 Video game apparatus, pseudo camera viewpoint movement control method and program in video game
RU2227930C2 (en) * 2002-07-04 2004-04-27 Межрегиональная благотворительная общественная организация инвалидов "ГЕРОНТ" Method and system for contactless data input in computer
US7883415B2 (en) * 2003-09-15 2011-02-08 Sony Computer Entertainment Inc. Method and apparatus for adjusting a view of a scene being displayed according to tracked head motion
US8797260B2 (en) 2002-07-27 2014-08-05 Sony Computer Entertainment Inc. Inertially trackable hand-held controller
US8570378B2 (en) 2002-07-27 2013-10-29 Sony Computer Entertainment Inc. Method and apparatus for tracking three-dimensional movements of an object using a depth sensing camera
US9682319B2 (en) 2002-07-31 2017-06-20 Sony Interactive Entertainment Inc. Combiner method for altering game gearing
EP1573502A3 (en) * 2002-10-09 2005-09-21 Raphael Bachmann Rapid input device
PT1573498E (en) 2002-11-20 2012-03-22 Koninkl Philips Electronics Nv User interface system based on pointing device
US8072470B2 (en) 2003-05-29 2011-12-06 Sony Computer Entertainment Inc. System and method for providing a real-time three-dimensional interactive environment
WO2005010739A1 (en) * 2003-07-29 2005-02-03 Philips Intellectual Property & Standards Gmbh System and method for controlling the display of an image
US10279254B2 (en) 2005-10-26 2019-05-07 Sony Interactive Entertainment Inc. Controller having visually trackable object for interfacing with a gaming system
EP1716473A1 (en) * 2004-02-16 2006-11-02 Simone Soria A process for generating command signals, in particular for disabled users
JP3851907B2 (en) * 2004-02-18 2006-11-29 株式会社ソニー・コンピュータエンタテインメント Image display system and video game system
US20050215319A1 (en) * 2004-03-23 2005-09-29 Harmonix Music Systems, Inc. Method and apparatus for controlling a three-dimensional character in a three-dimensional gaming environment
US8547401B2 (en) 2004-08-19 2013-10-01 Sony Computer Entertainment Inc. Portable augmented reality device and method
KR100663515B1 (en) 2004-11-08 2007-01-02 삼성전자주식회사 Portable terminal device and data input method therefor
GB0505362D0 (en) * 2005-03-15 2005-04-20 Intelligent Earth Ltd Interface control
CN101657825B (en) 2006-05-11 2014-02-19 普莱姆传感有限公司 Modeling Human Figures from Depth Maps
USRE48417E1 (en) 2006-09-28 2021-02-02 Sony Interactive Entertainment Inc. Object direction using video input combined with tilt angle information
EP2065795A1 (en) * 2007-11-30 2009-06-03 Koninklijke KPN N.V. Auto zoom display system and method
US8542907B2 (en) 2007-12-17 2013-09-24 Sony Computer Entertainment America Llc Dynamic three-dimensional object mapping for user-defined control device
US9372576B2 (en) 2008-01-04 2016-06-21 Apple Inc. Image jaggedness filter for determining whether to perform baseline calculations
US8166421B2 (en) 2008-01-14 2012-04-24 Primesense Ltd. Three-dimensional user interface
US8933876B2 (en) 2010-12-13 2015-01-13 Apple Inc. Three dimensional user interface session control
US9035876B2 (en) 2008-01-14 2015-05-19 Apple Inc. Three-dimensional user interface session control
JP5174908B2 (en) 2008-06-30 2013-04-03 株式会社ソニー・コンピュータエンタテインメント Portable game device and method for controlling portable game device
EP2151260A1 (en) 2008-08-08 2010-02-10 Koninklijke Philips Electronics N.V. Calming device
FR2941805A1 (en) 2009-02-02 2010-08-06 Laurent Philippe Nanot DEVICE FOR INTERACTIVE VIRTUAL GUIDED VISIT OF SITES / HISTORICAL EVENTS OR BUILDING PROJECTS AND TRAINING SCENARIOS
US10824238B2 (en) 2009-04-02 2020-11-03 Oblong Industries, Inc. Operating environment with gestural control and multiple client devices, displays, and users
EP2249230A1 (en) 2009-05-04 2010-11-10 Topseed Technology Corp. Non-contact touchpad apparatus and method for operating the same
EP2249229A1 (en) 2009-05-04 2010-11-10 Topseed Technology Corp. Non-contact mouse apparatus and method for operating the same
JP5187280B2 (en) * 2009-06-22 2013-04-24 ソニー株式会社 Operation control device and operation control method
US8565479B2 (en) 2009-08-13 2013-10-22 Primesense Ltd. Extraction of skeletons from 3D maps
WO2011038527A1 (en) * 2009-09-29 2011-04-07 阿尔卡特朗讯 Method for viewing points detecting and apparatus thereof
US9971807B2 (en) 2009-10-14 2018-05-15 Oblong Industries, Inc. Multi-process interactive systems and methods
JP5491217B2 (en) * 2010-01-27 2014-05-14 株式会社バンダイナムコゲームス Program, information storage medium, game system
US8787663B2 (en) 2010-03-01 2014-07-22 Primesense Ltd. Tracking body parts by combined color image and depth processing
JP5300777B2 (en) 2010-03-31 2013-09-25 株式会社バンダイナムコゲームス Program and image generation system
FR2960315A1 (en) * 2010-05-20 2011-11-25 Opynov Method for capturing movement of head, hand and/or finger of person interacted or communicated with e.g. mobile terminal screen, involves estimating human movement from change of identified thermal radiation area
US8594425B2 (en) 2010-05-31 2013-11-26 Primesense Ltd. Analysis of three-dimensional scenes
US8582867B2 (en) 2010-09-16 2013-11-12 Primesense Ltd Learning-based pose estimation from depth maps
US8959013B2 (en) 2010-09-27 2015-02-17 Apple Inc. Virtual keyboard for a non-tactile three dimensional user interface
JP5081964B2 (en) 2010-10-28 2012-11-28 株式会社コナミデジタルエンタテインメント GAME DEVICE, GAME DEVICE CONTROL METHOD, AND PROGRAM
US8872762B2 (en) 2010-12-08 2014-10-28 Primesense Ltd. Three dimensional user interface cursor control
US9285883B2 (en) 2011-03-01 2016-03-15 Qualcomm Incorporated System and method to display content based on viewing orientation
US20130007672A1 (en) * 2011-06-28 2013-01-03 Google Inc. Methods and Systems for Correlating Head Movement with Items Displayed on a User Interface
US8881051B2 (en) 2011-07-05 2014-11-04 Primesense Ltd Zoom-based gesture user interface
US9030498B2 (en) 2011-08-15 2015-05-12 Apple Inc. Combining explicit select gestures and timeclick in a non-tactile three dimensional user interface
US9218063B2 (en) 2011-08-24 2015-12-22 Apple Inc. Sessionless pointing user interface
US9122311B2 (en) 2011-08-24 2015-09-01 Apple Inc. Visual feedback for tactile and non-tactile user interfaces
US9002099B2 (en) 2011-09-11 2015-04-07 Apple Inc. Learning-based estimation of hand and finger pose
KR101922589B1 (en) * 2012-02-15 2018-11-27 삼성전자주식회사 Display apparatus and eye tracking method thereof
US9377863B2 (en) 2012-03-26 2016-06-28 Apple Inc. Gaze-enhanced virtual touchscreen
US9047507B2 (en) 2012-05-02 2015-06-02 Apple Inc. Upper-body skeleton extraction from depth maps
US9019267B2 (en) 2012-10-30 2015-04-28 Apple Inc. Depth mapping with enhanced resolution
US9990046B2 (en) 2014-03-17 2018-06-05 Oblong Industries, Inc. Visual collaboration interface
US9880655B2 (en) 2014-09-02 2018-01-30 Apple Inc. Method of disambiguating water from a finger touch on a touch sensor panel
EP3213173B1 (en) 2014-10-27 2025-10-29 Apple Inc. Pixelated self-capacitance water rejection
US10043279B1 (en) 2015-12-07 2018-08-07 Apple Inc. Robust detection and classification of body parts in a depth map
US10529302B2 (en) 2016-07-07 2020-01-07 Oblong Industries, Inc. Spatially mediated augmentations of and interactions among distinct devices and applications via extended pixel manifold
US10366278B2 (en) 2016-09-20 2019-07-30 Apple Inc. Curvature-based face detector
CN106791317A (en) * 2016-12-30 2017-05-31 天津航正科技有限公司 A kind of motion diagram retrieval device of human motion
RU2750593C1 (en) * 2020-11-10 2021-06-29 Михаил Юрьевич Шагиев Method for emulating pressing of directional arrows on keyboard, joystick, or movement of computer mouse connected to computer device, depending on user's position in space

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4950069A (en) * 1988-11-04 1990-08-21 University Of Virginia Eye movement detector with improved calibration and speed
US5168531A (en) * 1991-06-27 1992-12-01 Digital Equipment Corporation Real-time recognition of pointing information from video
US5252950A (en) * 1991-12-20 1993-10-12 Apple Computer, Inc. Display with rangefinder
US5287473A (en) * 1990-12-14 1994-02-15 International Business Machines Corporation Non-blocking serialization for removing data from a shared cache
US5367315A (en) * 1990-11-15 1994-11-22 Eyetech Corporation Method and apparatus for controlling cursor movement
US5581276A (en) * 1992-09-08 1996-12-03 Kabushiki Kaisha Toshiba 3D human interface apparatus using motion recognition based on dynamic image processing
US5617312A (en) * 1993-11-19 1997-04-01 Hitachi, Ltd. Computer system that enters control information by means of video camera

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4950069A (en) * 1988-11-04 1990-08-21 University Of Virginia Eye movement detector with improved calibration and speed
US5367315A (en) * 1990-11-15 1994-11-22 Eyetech Corporation Method and apparatus for controlling cursor movement
US5287473A (en) * 1990-12-14 1994-02-15 International Business Machines Corporation Non-blocking serialization for removing data from a shared cache
US5168531A (en) * 1991-06-27 1992-12-01 Digital Equipment Corporation Real-time recognition of pointing information from video
US5252950A (en) * 1991-12-20 1993-10-12 Apple Computer, Inc. Display with rangefinder
US5581276A (en) * 1992-09-08 1996-12-03 Kabushiki Kaisha Toshiba 3D human interface apparatus using motion recognition based on dynamic image processing
US5617312A (en) * 1993-11-19 1997-04-01 Hitachi, Ltd. Computer system that enters control information by means of video camera

Cited By (49)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8976265B2 (en) 2002-07-27 2015-03-10 Sony Computer Entertainment Inc. Apparatus for image and sound capture in a game environment
US9393487B2 (en) 2002-07-27 2016-07-19 Sony Interactive Entertainment Inc. Method for mapping movements of a hand-held controller to game commands
US9381424B2 (en) 2002-07-27 2016-07-05 Sony Interactive Entertainment America Llc Scheme for translating movements of a hand-held controller into inputs for a system
US7639233B2 (en) 2002-07-27 2009-12-29 Sony Computer Entertainment Inc. Man-machine interface using a deformable device
US9474968B2 (en) 2002-07-27 2016-10-25 Sony Interactive Entertainment America Llc Method and system for applying gearing effects to visual tracking
US9606630B2 (en) 2005-02-08 2017-03-28 Oblong Industries, Inc. System and method for gesture based control system
US9573056B2 (en) 2005-10-26 2017-02-21 Sony Interactive Entertainment Inc. Expandable control device via hardware attachment
US8537111B2 (en) 2006-02-08 2013-09-17 Oblong Industries, Inc. Control system for navigating a principal dimension of a data space
US9075441B2 (en) 2006-02-08 2015-07-07 Oblong Industries, Inc. Gesture based control using three-dimensional information extracted over an extended depth of field
US9495228B2 (en) 2006-02-08 2016-11-15 Oblong Industries, Inc. Multi-process interactive systems and methods
US9910497B2 (en) 2006-02-08 2018-03-06 Oblong Industries, Inc. Gestural control of autonomous and semi-autonomous systems
US8537112B2 (en) 2006-02-08 2013-09-17 Oblong Industries, Inc. Control system for navigating a principal dimension of a data space
US8531396B2 (en) 2006-02-08 2013-09-10 Oblong Industries, Inc. Control system for navigating a principal dimension of a data space
US9823747B2 (en) 2006-02-08 2017-11-21 Oblong Industries, Inc. Spatial, multi-modal control device for use with spatial operating system
US9471147B2 (en) 2006-02-08 2016-10-18 Oblong Industries, Inc. Control system for navigating a principal dimension of a data space
US9804902B2 (en) 2007-04-24 2017-10-31 Oblong Industries, Inc. Proteins, pools, and slawx in processing environments
US8407725B2 (en) 2007-04-24 2013-03-26 Oblong Industries, Inc. Proteins, pools, and slawx in processing environments
US11269467B2 (en) 2007-10-04 2022-03-08 Apple Inc. Single-layer touch-sensitive display
US11294503B2 (en) 2008-01-04 2022-04-05 Apple Inc. Sensor baseline offset adjustment for a subset of sensor output values
US8840470B2 (en) 2008-02-27 2014-09-23 Sony Computer Entertainment America Llc Methods for capturing depth data of a scene and applying computer actions
US9740922B2 (en) 2008-04-24 2017-08-22 Oblong Industries, Inc. Adaptive tracking system for spatial input devices
US9495013B2 (en) 2008-04-24 2016-11-15 Oblong Industries, Inc. Multi-modal gestural interface
US9779131B2 (en) 2008-04-24 2017-10-03 Oblong Industries, Inc. Detecting, representing, and interpreting three-space input: gestural continuum subsuming freespace, proximal, and surface-contact modes
US9996175B2 (en) 2009-02-02 2018-06-12 Apple Inc. Switching circuitry for touch sensitive display
US9952673B2 (en) 2009-04-02 2018-04-24 Oblong Industries, Inc. Operating environment comprising multiple client devices, multiple displays, multiple users, and gestural control
US9684380B2 (en) 2009-04-02 2017-06-20 Oblong Industries, Inc. Operating environment with gestural control and multiple client devices, displays, and users
US9740293B2 (en) 2009-04-02 2017-08-22 Oblong Industries, Inc. Operating environment with gestural control and multiple client devices, displays, and users
US9471148B2 (en) 2009-04-02 2016-10-18 Oblong Industries, Inc. Control system for navigating a principal dimension of a data space
US9471149B2 (en) 2009-04-02 2016-10-18 Oblong Industries, Inc. Control system for navigating a principal dimension of a data space
US9317128B2 (en) 2009-04-02 2016-04-19 Oblong Industries, Inc. Remote devices used in a markerless installation of a spatial operating environment incorporating gestural control
US10642364B2 (en) 2009-04-02 2020-05-05 Oblong Industries, Inc. Processing tracking and recognition data in gestural recognition systems
US10001888B2 (en) 2009-04-10 2018-06-19 Apple Inc. Touch sensor panel design
US8961313B2 (en) 2009-05-29 2015-02-24 Sony Computer Entertainment America Llc Multi-positional three-dimensional controller
US9582131B2 (en) 2009-06-29 2017-02-28 Apple Inc. Touch sensor panel design
US9933852B2 (en) 2009-10-14 2018-04-03 Oblong Industries, Inc. Multi-process interactive systems and methods
US9329723B2 (en) 2012-04-16 2016-05-03 Apple Inc. Reconstruction of original touch image from differential touch image
US9886141B2 (en) 2013-08-16 2018-02-06 Apple Inc. Mutual and self capacitance touch measurements in touch panel
US10936120B2 (en) 2014-05-22 2021-03-02 Apple Inc. Panel bootstraping architectures for in-cell self-capacitance
US10289251B2 (en) 2014-06-27 2019-05-14 Apple Inc. Reducing floating ground effects in pixelated self-capacitance touch screens
US10705658B2 (en) 2014-09-22 2020-07-07 Apple Inc. Ungrounded user signal compensation for pixelated self-capacitance touch sensor panel
US11625124B2 (en) 2014-09-22 2023-04-11 Apple Inc. Ungrounded user signal compensation for pixelated self-capacitance touch sensor panel
US10795488B2 (en) 2015-02-02 2020-10-06 Apple Inc. Flexible self-capacitance and mutual capacitance touch sensing system architecture
US11353985B2 (en) 2015-02-02 2022-06-07 Apple Inc. Flexible self-capacitance and mutual capacitance touch sensing system architecture
US12014003B2 (en) 2015-02-02 2024-06-18 Apple Inc. Flexible self-capacitance and mutual capacitance touch sensing system architecture
US10488992B2 (en) 2015-03-10 2019-11-26 Apple Inc. Multi-chip touch architecture for scalability
US10365773B2 (en) 2015-09-30 2019-07-30 Apple Inc. Flexible scan plan using coarse mutual capacitance and fully-guarded measurements
US10444918B2 (en) 2016-09-06 2019-10-15 Apple Inc. Back of cover touch sensors
US10642418B2 (en) 2017-04-20 2020-05-05 Apple Inc. Finger tracking in wet environment
US11662867B1 (en) 2020-05-30 2023-05-30 Apple Inc. Hover detection on a touch sensor panel

Also Published As

Publication number Publication date
WO1999035633A2 (en) 1999-07-15
AU2211799A (en) 1999-07-26

Similar Documents

Publication Publication Date Title
WO1999035633A3 (en) Human motion following computer mouse and game controller
EP0797139A4 (en) Three-dimensional image processing system
EP0751481A4 (en) Image processor and electronic apparatus
US8313380B2 (en) Scheme for translating movements of a hand-held controller into inputs for a system
US9393487B2 (en) Method for mapping movements of a hand-held controller to game commands
AU2001272250A1 (en) Camera-based touch system
WO2001087377A3 (en) System for controlling in vivo camera capture and display rate
WO1998036631A3 (en) System for sensing facial movements in virtual reality
EP0913175A3 (en) Video game apparatus and memory medium therefor
WO2002071315A3 (en) Automatic positioning of display depending upon the viewer's location or gesture
CA2344352A1 (en) Input device using scanning sensors
AU2439399A (en) Video camera computer touch screen system
WO1998014863A3 (en) Hand-held image display device
WO1996030856A3 (en) Motion-based command generation technology
EP0847032A3 (en) Enhanced security self-service checkout station
EP1045342A3 (en) Face image data processing devices
EP0629090A3 (en) A video image processing system.
WO2002014982A3 (en) Method of and system for generating and viewing multi-dimensional images
MY118106A (en) Input device using scanning sensors.
WO2001024536A3 (en) Dynamic visual registration of a 3-d object with a graphical model
WO2003060626A3 (en) System and methodology for tracking objects using visually sensible indicators
EP0615386A3 (en) A motion vector processor for compressing video signal.
WO2013083423A1 (en) Method for recognizing gestures and gesture detector
WO2002001336A3 (en) Automated visual tracking for computer access
WO2000020951A3 (en) Hand held computer with see-through display

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG US US UZ VN YU ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW SD SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
AK Designated states

Kind code of ref document: A3

Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG US US UZ VN YU ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW SD SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

NENP Non-entry into the national phase

Ref country code: KR

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWE Wipo information: entry into national phase

Ref document number: 09582806

Country of ref document: US

122 Ep: pct application non-entry in european phase