[go: up one dir, main page]

GB2473236A - Determining the Path of a Wireless Tag - Google Patents

Determining the Path of a Wireless Tag Download PDF

Info

Publication number
GB2473236A
GB2473236A GB0915446A GB0915446A GB2473236A GB 2473236 A GB2473236 A GB 2473236A GB 0915446 A GB0915446 A GB 0915446A GB 0915446 A GB0915446 A GB 0915446A GB 2473236 A GB2473236 A GB 2473236A
Authority
GB
United Kingdom
Prior art keywords
tag
processor
antennas
user
path
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GB0915446A
Other versions
GB2473236B (en
GB0915446D0 (en
Inventor
Adrian Istvan Ashley
David Howells Llewellyn Slocombe
Peter Hohmann
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hitachi Ltd
Original Assignee
Hitachi Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hitachi Ltd filed Critical Hitachi Ltd
Priority to GB1405497.7A priority Critical patent/GB2511438B/en
Priority to GB0915446.9A priority patent/GB2473236B/en
Priority to GB1405507.3A priority patent/GB2511216B/en
Publication of GB0915446D0 publication Critical patent/GB0915446D0/en
Publication of GB2473236A publication Critical patent/GB2473236A/en
Application granted granted Critical
Publication of GB2473236B publication Critical patent/GB2473236B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/08Methods or arrangements for sensing record carriers, e.g. for reading patterns by means detecting the change of an electrostatic or magnetic field, e.g. by detecting change of capacitance between electrodes
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/10009Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation sensing by radiation using wavelengths larger than 0.1 mm, e.g. radio-waves or microwaves

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Toxicology (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Electromagnetism (AREA)
  • General Health & Medical Sciences (AREA)
  • User Interface Of Digital Computer (AREA)
  • Microelectronics & Electronic Packaging (AREA)
  • Computer Hardware Design (AREA)

Abstract

A device comprises a processor 31 for analysing signals dependent upon responses of at least two antennas 28 which are spaced apart to allow detection of a path taken by a wireless tag (25 Figure 1) when waved by a user. The processor is configured to determine the path of the wireless tag and to identify an instruction in dependence upon the path. The antennas may be spaced between 1cm and 10cm apart and may comprise a coil or loop. The device may also include a tag reader 30 and a multiplexer 29 and it may provide feedback to the user using either a light emitter 34 and/or a sound emitter 35. It may also transmit a signal to another device and provide feedback in response to a reply from the other device. The wireless tag maybe a Radio Frequency identity tag (RFID) or a near field communication device (NFC).

Description

Determining a path of a wireless tag
Description
The present invention relates to determining a path of a wireless tag and a user input device.
Wireless tag technologies, such as radio frequency identification (RFTD) and near-field communication (NFC), have many applications including access control, inventory management and electronic payment.
Tags can also be used in the home or office to trigger retrieval of data or sending of messages. A tag reading device is connected to a personal computer or mobile telephone which is connected to the Internet. Articles or items, such as a set of keys, umbrella, book or postcard, can be tagged with a wireless tag. Placing a tagged item on the tag reading device triggers an appropriate action. For example, the item may be a set of keys. When a user arrives or leaves home they can place the set of keys on the tag reading device. This can trigger, for example, sending of an e-mail to report that the user has arrived home or is on their way to work. In another example, the item may be an umbrella. The user can obtain a weather forecast, by passing the umbrella over the tag reading device. However, the tag reading device has a drawback that it can provide only limited control. For example, it can only be used to trigger one predefined action for an article.
Wireless tags can be used in other applications. For example, US 2006/0125691 Al describes a motion capture system for digitising movement of an actor and creating images for use in motion pictures, video games and virtual reality systems. The system includes at least four stationary receivers placed at known positions around a capture 2one, at least one stationary radio frequency transmitter defining a reference tag and a number of radio frequency transmitters defining marker tags that are Jo placed on the actor. A processing algorithm is used to compute double difference measurements using pseudorange measurements from the reference tag and the marker tags. The motion capture system is only used to track tags. Moreover, it requires considerable processing power. Each radio frequency receiver employs several floating point digital signal processors (DSPs).
As explained earlier, a tag reading device can be used to trigger retrieval of data.
Other different types of information access system are known. For example, "InfoRod" is a swing motion based information access method for use in a public area. A cellular phone has a three-axis accelerometer and a GPS sensor. When the user sees a poster, they can swing their cellular phone. Motion is detected by the accelerometer and, based on the motion and location, the cellular phone can retrieve a URL over the cellular network. The user can employ a web browser on the cellular phone to follow the URL and retrieve information. However, this type of information access system requires an accelerometer-enabled cellular telephone.
According to a first aspect of the present invention there is provided a device comprising processor for analysing signals dependent upon responses of at least two antennas which are spaced apart so as to allow detection of a path taken by a wireless tag when waved or moved by a user, the processor configured to determine a path of the wireless tag and to identify an instruction in dependence upon the path.
Thus, the device can be used to analyse a gesture, captured by the antennas, made by the user holding the wireless tag or an article carrying such a tag and executing a corresponding instruction or command. Different gestures can be used to give different instructions, each gesture triggering a different action. This can help to provide a more powerful user interface. Moreover, the wireless can be used to identify the user and so help to ensure that only authorised users provide instructions.
To detect the path, the processor need not compute range, but can simply detect io proximity to antennas, for example, by simply determining whether the tag is present. Using proximity-based measurements can help to provide robustness against noise and reduce power consumption compared, for example, with action-at-a-distance range-based measurements.
The processor may comprise a multi-core processor or multiple processors. The processor may comprise a microcontroller or other processing system.
The device may comprise at least two antennas which are spaced apart so as to allow detection of a path taken by a wireless tag when waved by a user.
Thus, the device can be used as a user input device by capturing a gesture made by the user holding the wireless tag or an article carrying such a tag and executing a corresponding instruction or command.
Adjacent antennas may be spaced apart by a distance between about 1 cm and about cm. Thus, the user can make small gestures, e.g. by waving their hand at the wrist. However, adjacent antennas may be spaced apart by a distance by more than about 10 cm and so the user can make larger gestures, e.g. by waving their arm.
Each antenna may comprise a coil or loop.
The device may comprise a wireless tag reader operatively connected to the antennas and to the processor. This can be used to validate the tag and, thus, act upon gestures made using a valid tag.
The device may further comprise a multiplexer for operatively connecting the wireless tag reader or the at least one processor to the antennas.
The device may be configured, in response to an antenna receiving a signal from the tag, to provide feedback to the user. For example, the device may comprise light emitters, such as light emitting diodes, wherein each antenna is provided with a respective light emitter and the device is configured, in response to a given antenna receiving a signal from the tag, to illuminate a respective light emitter. This can help the user to track their gesture.
The device may be configured, in response to identifying the tag, to provide feedback to the user. For example, the device may comprise at least one light emitter, for instance a green light, and the device may be configured, in response to identifying the tag, to illuminate the light emitter. Additionally or alternatively, the device may comprise a sound emitter and the device may be configured, in response to identifying the tag, to output a signal, e.g. a synthesised voice, via the sound emitter.
The processor may be configured to compare a signal pattern dependent upon responses of the antennas with at least one signal pattern so as to identify the path.
The processor may be configured, in response to identifying the path, to provide feedback to the user. For example, the processor may confirm the instruction.
The processor may be configured, in response to the instruction, to transmit a signal to another device. The processor may also be configured, in response to receiving a reply from the other device, to provide feedback to the user.
The wireless tag is a radio frequency identity tag or a near-field communication device.
The device may be configured to identify orientation of an object having more than one wireless tag. Thus, more complex gestures can be used.
According to a second aspect of the invention there is provided a method comprising determining a path of a wireless tag and identifying an instruction in dependence upon the path.
According to a third aspect of the invention there is provided a computer program which, when executed by data processing apparatus, causes the data processing apparatus to perform the method.
According to a fourth aspect of the invention there is provided a computer program product comprising a computer readable medium storing the computer program.
Embodiments of the present invention will now be described, by way of example, with reference to the accompanying drawings in which: Figure 1 is a schematic diagram of a home and a home automation network deployed in the home including an input device; Figure 2 is schematic block diagram of an input device; Figure 2a illustrates non-volatile memory in an input device; Figure 3 is a perspective view of an example of an input device; Figure 4 is schematic block diagram of a wireless tag; Figure 5 is schematic block diagram of a home automation network manager; Figure 6 illustrates a first pattern made by moving a tag; Figure 7 illustrates a second pattern made by moving a tag; Figures 8a to 8d illustrates strokes made by moving a tag and which can be linked to form complex patterns; Figures 8e to 8g illustrate patterns comprising linked strokes; Figure 9 is a process flow diagram of a method of operating an input device; Figure 10 illustrates exchange of data between an input device and a home automation network manager or other device; and Figure 11 illustrates another system including an input device and another device, such as a personal computer.
Referring to Figure 1, a network I is shown comprising a plurality of nodes 2 and a main node 3 (herein referred to as a "home automation network manager" or "home automation box") arranged in a point-to-multipoint or mesh configuration and deployed in a home 4, e.g. house, flat or other residential environment.
However, the network may be deployed in commercial environments, such as shops, offices or hotels, in industrial environments, such as a factory shop floor, public or Jo municipal environments, such as railway stations and leisure centres, and other non-residential environments.
Nodes 2 can be wirelessly connected to the home automation network manager 3 either directly or via an optional range extender 5 through respective low-power, low-data rate, short-range wireless data links 6, for example conforming to ZigBeeTM specification and IEEE 802.15.4 physical radio standard. However, other low-power, low-data rate, short-range wireless standards may be used.
Some or all of the nodes 2 can be connected via wired links, such as universal serial bus (USB) or wired Ethernet connections.
The network manager 3 serves as a coordinator for the network I providing networking facilities, such as device and service discovery caching and, optionally, channel management and trust centre operations. The network manager 3 also provides TCP/IP gateway functionality via hub 7 and broadband modem 8 to an external network 9. As shown in Figure 1, the external network 9 can be used to access, for example, telecommunication company server(s) 10, web server(s) 11 and e-mail server(s) 12.
As shown in Figure 1, the nodes 2 can be grouped according to different uses or applications including, for example, security-related devices 13, power control and profiling devices 14 and configuration and analysis devices 15.
The security-related devices 13 may include an alarm system 16, intrusion detection sensors such as passive infrared detectors 17 and floor-based pressure sensors 18.
The security-related devices 13 may include one or more devices 19 for providing user input (herein also referred to as an "access panel"). The user input device(s) 19 can be used, for example, to activate and deactivate the alarm system 16.
The power control and profiling devices 14 may include one or more power monitoring devices 20 for detecting current flowing through mains power cable(s).
The power monitoring devices 20 may be installed at various points throughout the electrical power distribution system in the home. For example, a device 20 may be installed in or immediately downstream from a distribution board (not shown) for measuring power consumption for the whole home. A device 20 may be provided for each or some circuit, e.g. lighting circuit, first floor circuit, room circuit etc. Power monitoring device(s) 20 may have sockets 21 for receiving plugs 212 for supplying power to appliances 22, such as television sets, media players, game consoles, computers, microwave ovens and other household (or office) appliances.
The configuration and analysis devices 15 can include a personal computer 23 (which may or may not be a node 2 forming part of the wireless network 1) and a portable display device 24.
As explained earlier, there may be one or more user input devices 19. A user input device 19 may be connected to the network manager 3 by a wireless or wired link.
A user input device 19 can take one of many different forms and may be located at a convenient or appropriate location. For example, a user input device 19 may be located inside or outside the home 4 by a front door, back door or other external door or exit. Additionally or alternatively, a user input device 19 may be positioned next to a home computer 23. A user input device 19 need not be a stand-alone device, but can be integrated into another device, such as the network manager 3, appliance 22 or home computer 23. There may be more than one user input device 19. For example, devices 19 may be located on either side of a door.
As will be explained later, a user input device 19 need not be used as part of a home automation network I and can be used in other applications which may be primarily intended for the user's personal or private use, or for public use. For example, the user input device 19 can be used, for instance, in conjunction with a computer 91 (Figure 11) or vehicle. Alternatively, the user input device 19 can be used, for example, in a ticket barrier for a transport system.
A user input device 19 cooperates with one or more wireless tags 25 to allow a user to provide user input by capturing a gesture made by a user holding the tag 25. The tag 25 may be incorporated or carried by an article or item, such as a set of keys.
Gestures may include, for example, waving the tag 25 in a single pass from left to right, waving the tag multiple times back and forth or tracing out more complicated patterns, which can be made, for example, by flicking wrist or waving the arm. The response of the user input device 19 may depend on the identity of the tag 25. For example, the user input device 19 can be programmed to trigger different actions in response to the same gesture but made using different cards. Furthermore, the user input device 19 may only respond if the tag 25 is recognised or validated. Thus, the user input device 19 can be used to provide secure user input.
In some embodiments, the article or item (herein also referred to as an "object") may have more than one tag 25. Thus, the user input device 19 can be used to determine the orientation of the object. This can allow more complex gestures to be used involving, for example, turning or flipping over the object.
Referring to Figures 2 and 3, circuitry 26 of the user input device 19 is shown.
The user input device 19 includes an antenna array 27 comprising two or more antennas 28, an array controller 29, a tag reader 30, a processor 31, for example in the form of a microprocessor, non-volatile random access memory 32 and volatile random access memory 33. An antenna 28 may take the form of a loop, coil or other coupling element. The array controller 29 allows a single tag reader 30 to be used with more than antennas 28 by, for example, multiplexing signals. The tag reader 30 is used to interrogate the tag 25, for example, by supplying an energi2ing signal and demodulating a backscattered signal. The processor 31 may take the form of a microcontroller or other form of processing system. The processor 31 may be divided into more than one block, unit or system. For example, the processor 31 may include a processor for analysing signals and another processor for controlling the rest of the device.
The user input device 19 can provide feedback to the user via one or more light emitting diodes 34 and a speaker 35. For example, light emitting diodes 34 (or outputs of light guides connected to light emitting diodes 34) can be placed in front of, behind, in the middle of or around respective antennas 28 and arranged such that a light emitting diode 34 lights up when the tag 25 is successfully read by the corresponding antenna 28. Optionally, a display 36, for example in the form of a liquid crystal display, can be provided.
The user input device 19 also includes network interface 37. For example, the network interface 37 can take the form of a ZigBee" wireless transceiver which is connected to an antenna 38. However, the network interface 37 may be network card connected to a wired connection 39, e.g. twisted pair, Ethernet, USB etc. The user input device 19 may include buttons, keypad, scroll wheel, joystick, touch screen or touch pads, slider bar etc. or other forms of input device.
The processor 31 and other parts of circuitry 26 are powered by a battery 40.
Mditionaliy or alternatively, the device may include a power supply unit 41 powered via a Imains supply 42.
Referring also to Figure 2; the non-volatile random access memory 32 stores a set of patterns 43 and corresponding instructions 44. As win be explained in more detail later, the processor 31 identifies a path taken by the tag 25 (Figure 1), tries to match the path to one of the patterns 43 and, thus, identify a corresponding instruction 44. Alternatively, it can record the responses of the antennas 28 and report these to another device, e.g. network manager 3, which identifies a path taken by the tag 25 (Figure 1). The non-volatile random access memory 32 also stores a list of identities 45 of one or more registered tags 25 (Figure 1). The non-volatile random access memory 32 also stores software 45 for controlling the device 19.
Referring to Figure 3, an example of a form factor of the user input device 19 is shown.
The user input device 19 has a front face 47 which may carry printed indicia 48 for identifying an area or areas where the user should present the tag 25 (Figure 1). The antennas 28 are disposed behind the face 47. The device 19 might be arranged to lie on a horizontal surface, such as a desk-or table-top or shelf, or be mounted on a vertical surface, such as a wan.
-10 -The user input device 19 may take different forms and the antennas 28 may be arranged differently. For example, the antennas 28 may be placed on or behind more than one face. The antennas 28 need not be arranged in one plane. At least a portion of the front face 47 may be translucent for allowing light emitting diodes 34 located behind the cover to be seen when illuminated. The antennas 28 may be placed behind a protective sheet, e.g. formed of glass or plastic. In some embodiments, the input device 19 may be provided behind a sheet of glass, e.g. in a shop, bank, information kiosk or other commercial or public place.
Referring to Figure 4, circuitry 50 of the wireless tag 25 is shown. In this example, the wireless tag 25 is a passive device which harvests power from the input device 19 (Figure 3). However, the wireless tag 25 be differently configured. For example, the wireless tag 25 may be an active device and may have its own power source, such as a battery.
The wireless tag 25 includes an antenna 51 and a controller 52 which is operatively connected to non-volatile memory 53. The tag 25 includes a power management unit 54 which is connected to the antenna 51 which harvests power from an interrogating field generated by the tag reader 30 (Figure 2) by rectifying an a.c.
signal and supplying a d.c. voltage to the controller 52. The tag 25 also includes a demodulator 55 and a modulator 56.
Referring to Figure 5, circuitry 60 of the home automation network manager 3 is shown in more detail.
The network manager 3 includes a network interface 61, for example in the form of a ZigBeeTM wireless transceiver, user input device(s) 62, e.g. in the form of one or more keys or buttons (not shown), output device(s) 63, e.g. the form of one or more light emitting diodes (not shown), a processor 64, for example, an ARM-or Power-Jo PC-based processor, non-volatile random access memory 65, volatile random access memory 66 and a wired network interface 67. The network manager 3 is mains-powered, but may have a rechargeable battery (not shown) as a back-up supply.
-11 -The network manager 3 may have an antenna 68 for communicating wirelessly with the device 19 and other devices 2. Additionally or alternatively, the network manager 3 may have a wire connection 69.
Referring again to Figure 1, the user input device 19 is used to capture motion of the tag 25 and, in some cases, to cooperate with the network manager 3.
Referring also to Figure 6, the user input device 19 and the tag 25 are shown in use.
In this example, the user input device 19 has two antennas 28 having respective interaction regions or spaces 70. In this example, the interactions regions 70 do not overlap. This can help to resolve the position of the tag 25. However, in some embodiments, the interactions regions 70 may overlap which can allow the position of the tag 25 in space to be computed.
The user passes the tag 25 from left to right along a path 71 which crosses the interaction region 70 of the first antenna 28 and then the interaction region 702 of the second antenna 282.
As will be explained in more detail later, the processor 31 (Figure 2) identifies this path 71 as corresponding to a pattern 43, namely a single pass in a forward direction (i.e. left to right), as illustrated in Figure 6a.
This action can be used to provide a first instruction. A second, different instruction can be provided by another action, e.g. a single pass in a reverse direction (i.e. right to left).
With two antennas 28 as shown in Figure 6, additional actions may include single passes at different speeds and multiple passes, e.g. repeated stokes or strokes back-and-forth.
Additional antennas 28 can be used to allow detection more complex actions and, thus, allow for a larger "alphabet" or "vocabulary" of gestures and instructions.
-12 -For example, referring to Figure 7, the user input device 19 may have five antennas 28 arranged in a cruciform shape and having respective interaction regions 70.
The user can pass the tag 25 up the middle or spine of the cruciform and turn back on the right-hand side to pass a right side antenna to form a path 71. This is a more complex pattern 43, i.e. a single, right-hand turn.
The antennas 28 and the interaction regions 70 may be differently configured to detect different gestures and paths.
Referring to Figure 8a to 8d, a set of simple patterns 433, 434 are shown.
These patterns 433, 434 include single passes forwards and reverse, i.e. right, left, up and down.
To distinguish all four of these simple patterns 433, 434, three or more antennas 28 (Figure 2) are be used. For example, three antennas 28 (Figure 2) may be arranged in a triangle, four antennas 28 (Figure 2) may be arranged in a rectangle (particularly a diamond), five antennas 28 (Figure 2) can be arranged in a cruciform, for example as shown earlier in Figure 7, or nine antennas can be arranged in a three-by-three rectangular array. Other antenna arrangements can be used. These may be regularly arranged, for example in a rectangular or polar array, or irregularly positioned, for example randomly.
Additional patterns may be defined by virtue of the speed of a stroke. For example, eight patterns can be defined using the basic strokes depending on whether the stroke is fast (e.g. made by a quick flick of the wrist) or slowly (e.g. made by gently and smoothly swiping the tag 25 over the course of a few seconds).
Referring to Figure 8e and 8f, a first set of more complex patterns 435, is shown.
These patterns 434, 43 include repeated strokes (e.g. two, three or more times) in the same direction. Between strokes, the tag 25 may be lifted away from the device -13- 19 beyond the interaction regions 70 (Figure 6), for example, by more than 10 cm from the surface of the device.
Referring to Figure 8g and 8h, a second set of more complex patterns 437, 43 is shown. These patterns 43, 437 include at least one forward stroke and at least one back stroke, e.g. forwards and then backwards (or tãe wrsa), or forwards, backwards and then forwards again. A inii1sr set of patterns can be formed using strokes up and down.
Referring to Figure 8i and 8j, further complex patterns 439, 43 are shown. These patterns 43, 439 include at least one stroke in one direction and at least one stroke in a transverse (e.g. orthogonal) direction.
In Figures 8a to 8j, strokes are shown which are aligned along orthogonal directions. However, strokes can be misaligned (e.g. rotated by a few degrees) while stili having a significant component in these directions.
The antennas 28 (Figure 2) can be arranged to detect non-orthogonal strokes, e.g. diagonal strokes.
Other patterns can be defined. For example, the patterns need not comprise straight-line strokes, but can be arcuate or serpentine.
Complex patterns can be assembled from simpler patterns and strokes. For example, straight-line and curved strokes can be combined.
As mentioned earlier, if more than one tag is used, then the antennas 28 (Figure 28) can be used to determine the orientation of an object A stroke can have an orientation or "sense". For example, a stroke from left to right can be made with an object facing up or down. Thus, the device 19 can be used to distinguish between an "up-facing" stroke and a "down-facing" stroke. An orientation can include a combination of pitch, yaw and/or ron. -14-
A stroke can start, finish and/or be punctuated by changes in orientation. For example, a stroke from left to right may be followed by a 90 degree turn of the object (e.g. by a "yaw" or in-plane turn of the hand at the wrist) or a 180 degree flip of the object (by a "roll" or twist of the hand or wrist) and then followed by another stroke, for example from right to left. A change in orientation can be used to mark or delineate a section (or "phrase") within a gesture. A change in orientation, such as an open or close action (by a "pitch" or raising or lowing of the hand relative to the wrist), can be used to signal to start or end of stroke or gesture.
A stroke can include changes on orientation during a stroke. For example, the object can be turned, flipped and/or rotated while being moved.
Referring to Figures 2, 4 and 9, a method of operating the user input device 19 will now be described.
In a "standby" state, the array controller 29 and tag reader 30 cooperate to poll all or some the antennas 28, for example in a predefined order (step SI) until a tag 25 is detected (step S2). For example, an antenna 28 in the array 27 may be polled every few hundreds of milliseconds. However, as will be explained later, an antenna 28 can be polled more slowly, for example every second or so, or even not polled at all.
All of the antennas 28 can be polled. However, if there are a large number of antennas 28, then this might result in each antenna 28 being polled too infrequently.
For example, the tag reader 30 and/or processor 31 may only be able to poll antenna(s) a given number, p, of times every second (e.g. about 15 times a second).
Therefore, if there are q antennas, then it may be only possible to poil an antenna about p/q times every second. In some cases, this poll rate may be too slow to detect the beginning of a stroke reliably. Therefore, in some embodiments, only those antennas 28 located where a stroke is expected to begin need be polled.
Two or more of the antennas 28, for example ali of the antennas 28, can be polled simultaneously. This can be used to detect the presence of an antenna, but not necessarily the position of an antenna.
If a tag 25 is detected, then the processor 31 (using data received from the array controller 29or tag reader 30) identifies the antenna 28 which first detected the tag (step S3) and using data received from the tag reader 30 identifies the tag 25 (step S4). These steps may be performed by the tag reader 30.
The processor 31 determines whether the tag 25 is registered (step S5), for example, by compsring the identity of the tag 25 with one or more identities 45 stored in memory 32.
If the tag 25 is not recognised, then the processor 31 may provide feedback to the user (step S6), for example, by illnniinsting a red light emitting diode 34, displaying a suitable message (such as "Tag not recognised") on a display 36 and/or causing the speaker 35 to output a suitable audible signal.
If the tag 25 is recognised, then the processor 31 may provide feedback to the user (step S7), for instance, by ilinniinsting a green light emitting diode 34, displaying a suitable message on a display 36 and/or causing the speaker 35 to output a suitable audible signal.
If an object carries more than one tag 31, then only one tag need be identified.
However, in some embodiments, more than one tag can be identified.
Once a tag 25 has been detected, the processor 31 may switch into an "active" state, in which the antennas 28 are polled more regularly and/or signals are processed differently.
In an "active" state, the array controller 29 and tag reader 30 continue (or start) to poll the antennas 28 in order to identify the path of the tag 25 (step S8). The -16 -antennas 28 may be polled more frequently than in the standby state, for example, every few tens of milliseconds.
The array controller 29 and tag reader 30 need not poll all of the antennas 28. For example, if an antenna 28 reads the tag 25, then that antenna 28 need not be polled again immediately. This is because it can be assumed that the tag 25 will move and, thus, not linger at that antenna 28 currently detecting it Additionally or alternatively, only antennas 28 which are immediately adjacent to the antenna 28 currently detecting it need be polled. In certain embodiments, only antennas 28 which lie on possible paths of the moving tag 25 need be polled.
If an antenna 28 is not polled, then it may be omitted from polling for an appropriate number of poll cycles or for a given duration of time. The number of poll cycles or the duration of time may be fixed, e.g. one or two cycles or a given number of milliseconds. Alternatively, the number of poll cycles or the duration of time may depend on, for example, at which point during the stroke the tag is thought to be and/or whether the tag is expected to return to the same position.
For example, if the antenna is located at the beginning of what is expected to be a long straight stroke, then the antenna need not be polled for some time. On the other hand, if the antenna is located in the middle of a pattern which is expected to go back and forth several times, then the antenna can be polled sooner.
Limiting the number or antennas 28 polled, in particular not polling an antenna which has just detected the tag, can help to avoid accidental detection and, in particular, particularly multiple accidental detection by the same antenna.
Two or more of the antennas 28 can be polled simultaneously. This can be used, for example, if there are a large number of antennas and the device determines, part way through a stroke, that the stroke is expected to be simple and that resolution is not critical.
The processor 31 identifies which antenna 28 currently senses the tag (step S9) and may provide feedback to the user (step Sb), for example, by illuminating a light -17 -emitting diode 34 associated with the antenna 28. The processor 31 may determine that more than one antenna 28 can sense the tag 25. If more than one antenna 28 can be identified, then the processor 31 may infer a position of the tag 25.
The processor 31 receives and stores data regarding the path 71 taken by the tag 25, for example in terms of antenna (position) with time. If there is more than one tag, then the processor 31 can record data regarding the path of each tag.
Data points may be spaced evenly in time and may take the form {n, t1} where n is antenna identity and t1 is time. Thus, taking the example shown in Figure 6, a set of tag path data points may take the form of, for instance, {1, 0},{1, 500},{2, 1000} and{2, 1500}, where n I or 2 depending on whether the left-hand or right-hand antenna 28, 282 detects the tag 25 and time is measured, for example, in milliseconds. Other ways of encoding antenna identity and time may be used. Also, the time period may be different, e.g. more frequent or less frequent.
Data points need not be measured regularly in time, but can be recorded, for example, whenever a new antenna detects the tag 25. In some embodiments, particularly if interaction regions 70 overlap, data points can be recorded and a position can be calculated, e.g. using triangulation. Furthermore, data points can be processed, for example, using statistical analysis, to find a most probable path or to remove anomalous data points.
The processor 31 continues to poll antennas 28 and to identify the antennas 28 which sense the tag 25 until it determines that the user has finished gesturing (step SlI), for example, by identifying that no antenna 28 has sensed the tag 25 for a predetermined period of time (e.g. one second or a few seconds) or until a pattern has been recognised. For example, this may include the same antenna detecting the tag successively a given number of times or for a given duration of time, i.e. Jo indicating the tag is being held in the same place.
This technique can also be used to prime the device 19, i.e. to switch the input into an "active" state, at the beginning of the process. The user can ready the device by -18 -holding the tag in the same position so that the same antenna reads the tag in several polling cycles. Once the device 19 has captured the tag identity, it can notify the user by providing positive feedback, which provides a cue to the user to carry out the stroke.
The processor 31 may try to predict the pattern while the user is still gesturing.
This can be used to set a time limit for continuing to capture signals from the antennas 28. This can be helpful to provide faster response. For example, if the user makes a stroke and patterns are formed from a maximum of two strokes, then the processor 31 may keep allow polling of the antennas 28 for the time it expects the second stroke to take. A Viterbi (or similar) algorithm can be used to identify the pattern, for example, in real time.
If more than one tag is used, then orientation can be determined by comparing positions of tags 25.
Once the processor 31 determines that the gesture has finished or that it has enough data, the processor 31 compares the path with patterns 43 stored in memory 32 (step 512).
If the processor 31 cannot match the path with one of the patterns 43, then the processor 31 may provide feedback to the user (step 513), for example, illuminating a red light emitting diode 34, displaying a suitable message (such as "Gesture not recognised") on a display 36 and/or causing the speaker 35 to output a suitable audible signal.
If the path is recognised, then the processor 31 may provide feedback to the user (step 514), for instance, by illuminating a green light emitting diode 34, displaying a suitable message on a display 36 and/or causing the speaker 35 to output a suitable audible signal. The message may prompt the user to confirm the action.
The processor 31 executes the instruction associated with the gesture (step 516) and, once the instruction has been completed, may report this to the user (step S 17).
-19 -As explained earlier, in the "standby" state, an antenna 28 may be polled, for example, every few hundreds of milliseconds. However, slower polling (e.g. with a periodicity of about 1 s or longer) can be used. Furthermore, one or just a few of the antennas 28 can be polled. For example, if the tag 25 can be detected when it is still several centimetres away from the device 19, then the device 19 can wake-up' or be activated' whereby faster polling is used and/or additional antennas are polled. This can help to reduce power consumption.
During a polling cycle in the standby state, antennas 28 can be polled in quick succession. For example, if a first antenna is polled at time t1, then the next antenna may be polled at time t2 -t1 + A, where A may be of the order of 10 or 100 ms. However, the periodicity, p, with which an antenna 28 is polled may be largely determined by the length of a delay, d, between finishing one cycle and starting another, where d >> A. For example, the first antenna may be polled in a first cycle at time t1 and is polled in a second subsequent cycle at time t1 + d.
Likewise, during a polling cycle in the active state, antennas 28 can be polled in quick succession which may be even quicker than in the standby state. For example, if a first antenna is polled at time t1', then the next antenna may be polled at time t2' t1' + A', where A' is less than A. A delay, d', between finishing one cycle and starting another may be introduced.
The values for time differences, A and, between polling antennas in one cycle and, if used, the delay, d and d', between cycles can be found by routine experiment.
The values may depend on the spacing of the antennas and also on the interaction range. The duration during which an antenna is activated in the standby and active states, s and s', may also be found by routine experiment. The values may depend on the response time of antenna 28, processing speed of the tag 25 and processing speed of the tag reader 30.
In an active state, once the tag reader 30 has identified the tag 25, it need not identify the tag 25 again. This means that a shorter excitation signal can be used -20 -and/or the response from the tag need not be processed in full to obtain a tag identifier.
As explained earlier, the input device 19 can be used in a home automation network 1 and can cooperate with a network manager 3.
Referring to Figure 10, the input device 19, having captured a gesture and identified an instruction, can send a message 80 to the network manager 3 (step S16.1) for the network manager 3 to perform (step S16.2). The message 80 may include the identity of the tag 25 and the instruction. The message 80 may be divided into sub units. The message 80 may be encrypted. Once the network manager 3 has carried out the instruction, e.g. retrieving data, setting an alarm etc., it can send a reply 81 confirming that the necessary action has been taken (step S16.3). The device 19 may perform an action, for example, by storing data (step S16.4).
In some embodiments, the input device 19 does not identify the pattern. Instead, the input device 29 records a set of tag path data points and, once the stroke has finished or time out occurred, sends a message, including the identity of the tag and the data points, to another device where the pattern is identified.
As explained earlier, the input device 19 can be used in other applications and need not be used in a home automation network.
Referring to Figure 11, a system 90 is shown which comprises the input device 19 and a personal computer 91, e.g. desktop computer, laptop computer or PDA. The input device 19 may be integrated into the computer 91. The personal computer 91 may be networked, e.g. connectable to a network 92.
The input device 90 can be used to provide secure user input. For example, the input device 90 can be used in a similar way to a smart-card reader, e.g. to log into the computer 91. However, gestures can be used to provide instructions including, for example locking the computer 91, switching the computer 91 into sleep mode, retrieving c-mails and opening or closing a particular application.
-21 -If the tag 25 is a near field communication tag, then additional functionality may be provided. For example, the tag may form part of mobile communications device, e.g. a smart phone. Thus, an appropriate gesture may be used to pair the device with a computer, synchronise files or c-mails, etc. Tags may be registered with user input device 19 (Figure 1 & 11) in different ways.
For example, the network manager 3 (Figure 1) or computer 91 (Figure 11) can have a control panel which the user can access to identify a new tag. Additionally or alternatively, tags can be registered using the input device 19 (Figure 1 & 11). For example, a user can gesture with an existing tag 25 (Figure 1 & 11) to instruct the input device 19 (Figure 1 & 11) to register a new tag. The user then swipes the new tag to allow the user device 19 (Figure 1 & 11) to obtain and store the identity of the tag.
The user input device 19 (Figure 1 & 11) may be arranged such that the action or path produces different results using different tags. Thus, in the case of home automation network, a user (e.g. a parent or guardian) can have a master' tag which can be used to control alarms and other important functions, as well as other less-important functions, such as switching on lights. Other users may possess a tag which only allows them to switch on lights.
It will be appreciated that many modifications may be made to the embodiments hereinbefore described. For example, polling can be controlled different combinations of the array controller, tag reader and processor. One or more of these elements can be combined into a single block.

Claims (21)

  1. -22 -Claims 1. A device comprising: a processor for analysing signals dependent upon responses of at least two antennas which are spaced apart so as to allow detection of a path taken by a wireless tag when waved by a user, the processor configured to determine a path of a wireless tag and to identify an instruction in dependence upon the path.
  2. 2. A device according to claim 1, comprising: at least two antennas which are spaced apart so as to allow detection of a path taken by a wireless tag when waved by a user.
  3. 3. A device according to claim 2, wherein adjacent antennas are spaced apart by a distance between about 1 cm and about 10 cm.
  4. 4. A device according to claim 2 or 3, wherein each antenna comprises a coil or loop.
  5. 5. A device according to anyone of claims 2 to 4, further comprising: a wireless tag reader operatively connected to the antennas and to the processor.
  6. 6. A device according claim 5, further comprising: a multiplexer for operatively connecting the wireless tag reader to the antennas.
  7. 7. A device according to any preceding claim, wherein the device is configured, in response to an antenna receiving a signal from the tag, to provide feedback to the user.
  8. 8. A device according to claim 7, wherein the device further comprises: light emitters; wherein each antenna is provided with a respective light emitter and the device is configured, in response to a given antenfit receiving a signal from the tag, to ilinminste a respective light emitter.
  9. 9. A device according to any preceding chini, wherein the device is configured, in response to identifying the tag, to provide feedback to the user.
  10. 10. A device according to risini 9, wherein the device further comprises: at least one light emitter wherein the device is configured, in response to identifying the tag, to ilinniintte the light emitter.
  11. 11. A device according to risini 9 or 10, wherein the device further comprises: a sound emitter; wherein the device is configured, in response to identifying the tag, to output a signal via sound emitter.
  12. 12. A device according to any preceding risini, the processor is configured to compare a signal pattern dependent upon responses of the antennas with at least one signal pattern so as to identify the path.
  13. 13. A device according to any preceding chini, wherein the processor is configured, in response to identifying the path, to provide feedback to the user.
  14. 14. A device according to any preceding risini, wherein the processor is configured, in response to the instruction, to transmit a signal to another device.
  15. 15. A device aceording to risini 14, wherein the processor is configured, in response to receiving a reply from the other device, to provide feedback to the user.
  16. 16. A device according to any preceding risini, wherein the wireless tag is a radio frequency identity tag. -24-
  17. 17. A device according to any preceding claim, wherein the wireless tag is a near-field communication device.
  18. 18. A device according to any preceding claim, wherein the processor is configured to identify orientation of an object having more than one wireless tag.
  19. 19. A method comprising: determining a path of a wireless tag; and identifying an instruction in dependence upon the path.
  20. 20. A computer program which, when executed by data processing apparatus, causes the data processing apparatus to perform a method according to claim 19.
  21. 21. A computer program product comprising a computer readable medium storing a computer program according to claim 20.
GB0915446.9A 2009-09-04 2009-09-04 Determining a path of a wireless tag Expired - Fee Related GB2473236B (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
GB1405497.7A GB2511438B (en) 2009-09-04 2009-09-04 Determining a path of a wireless tag
GB0915446.9A GB2473236B (en) 2009-09-04 2009-09-04 Determining a path of a wireless tag
GB1405507.3A GB2511216B (en) 2009-09-04 2009-09-04 Determining a path of a wireless tag

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB0915446.9A GB2473236B (en) 2009-09-04 2009-09-04 Determining a path of a wireless tag

Publications (3)

Publication Number Publication Date
GB0915446D0 GB0915446D0 (en) 2009-10-07
GB2473236A true GB2473236A (en) 2011-03-09
GB2473236B GB2473236B (en) 2015-01-07

Family

ID=41203184

Family Applications (3)

Application Number Title Priority Date Filing Date
GB0915446.9A Expired - Fee Related GB2473236B (en) 2009-09-04 2009-09-04 Determining a path of a wireless tag
GB1405507.3A Expired - Fee Related GB2511216B (en) 2009-09-04 2009-09-04 Determining a path of a wireless tag
GB1405497.7A Expired - Fee Related GB2511438B (en) 2009-09-04 2009-09-04 Determining a path of a wireless tag

Family Applications After (2)

Application Number Title Priority Date Filing Date
GB1405507.3A Expired - Fee Related GB2511216B (en) 2009-09-04 2009-09-04 Determining a path of a wireless tag
GB1405497.7A Expired - Fee Related GB2511438B (en) 2009-09-04 2009-09-04 Determining a path of a wireless tag

Country Status (1)

Country Link
GB (3) GB2473236B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2642437A1 (en) * 2012-03-19 2013-09-25 Redwood Systems, Inc. Device tracking with lighting system
WO2015117354A1 (en) * 2014-07-17 2015-08-13 中兴通讯股份有限公司 Gesture track determination method, electronic device and computer storage medium
WO2025049060A1 (en) * 2023-08-31 2025-03-06 Apple Inc. Electronic device with dynamic sensor polling

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102020120249A1 (en) 2020-07-31 2022-02-03 Miele & Cie. Kg Transponder-based gesture control

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060077039A1 (en) * 2004-09-30 2006-04-13 Fujitsu Limited Reader/writer and RFID system
US20070119932A1 (en) * 2005-11-30 2007-05-31 Fujitsu Limited Tag access control system, tag access control method and recording medium storing tag access control program
US20070159332A1 (en) * 2006-01-07 2007-07-12 Arthur Koblasz Using RFID to prevent or detect falls, wandering, bed egress and medication errors
JP2008074600A (en) * 2006-09-25 2008-04-03 Toppan Forms Co Ltd Article management system and wireless communication medium
US20090027203A1 (en) * 2007-07-27 2009-01-29 Lucomm Technologies, Inc. Systems and methods for object localization and path identification based on rfid sensing

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7394346B2 (en) * 2002-01-15 2008-07-01 International Business Machines Corporation Free-space gesture recognition for transaction security and command processing
CN101297330A (en) * 2005-12-16 2008-10-29 诺基亚公司 Method and apparatus for controlling and providing indication of communication events
US7986917B2 (en) * 2006-07-10 2011-07-26 Sony Ericsson Mobile Communications Ab Method and system for data transfer from a hand held device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060077039A1 (en) * 2004-09-30 2006-04-13 Fujitsu Limited Reader/writer and RFID system
US20070119932A1 (en) * 2005-11-30 2007-05-31 Fujitsu Limited Tag access control system, tag access control method and recording medium storing tag access control program
US20070159332A1 (en) * 2006-01-07 2007-07-12 Arthur Koblasz Using RFID to prevent or detect falls, wandering, bed egress and medication errors
JP2008074600A (en) * 2006-09-25 2008-04-03 Toppan Forms Co Ltd Article management system and wireless communication medium
US20090027203A1 (en) * 2007-07-27 2009-01-29 Lucomm Technologies, Inc. Systems and methods for object localization and path identification based on rfid sensing

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2642437A1 (en) * 2012-03-19 2013-09-25 Redwood Systems, Inc. Device tracking with lighting system
WO2015117354A1 (en) * 2014-07-17 2015-08-13 中兴通讯股份有限公司 Gesture track determination method, electronic device and computer storage medium
CN105260010A (en) * 2014-07-17 2016-01-20 中兴通讯股份有限公司 Method for determining gesture track, and electronic equipment
WO2025049060A1 (en) * 2023-08-31 2025-03-06 Apple Inc. Electronic device with dynamic sensor polling

Also Published As

Publication number Publication date
GB2511216A (en) 2014-08-27
GB2511438B (en) 2015-01-07
GB2473236B (en) 2015-01-07
GB0915446D0 (en) 2009-10-07
GB201405507D0 (en) 2014-05-14
GB201405497D0 (en) 2014-05-14
GB2511438A (en) 2014-09-03
GB2511216B (en) 2015-01-21

Similar Documents

Publication Publication Date Title
US11626004B2 (en) Methods and systems for improving infection control in a facility
Asadzadeh et al. Gesture recognition using RFID technology
Zhou et al. Design and implementation of an RFID-based customer shopping behavior mining system
US20100019906A1 (en) Article management system and method for managing article
CN107004334B (en) For improving the shop intelligence sensor platform of Customer Experience and data analysis
Alanwar et al. Selecon: Scalable iot device selection and control using hand gestures
CN102741893A (en) Systems, methods, and apparatuses for managing configurable monitoring devices
US9832644B2 (en) Systems and methods for hybrid hardware authentication
JP2013070326A (en) Control apparatus and power supply control system
CN107408169A (en) Portable electron device for remote control
GB2473236A (en) Determining the Path of a Wireless Tag
CN202735785U (en) Intelligent household object positioning management system
WO2020006943A1 (en) Rfid senseless control method, device and system based on range sensor
Singh et al. Passive visible light positioning systems: An overview
CN104246668A (en) Method and apparatus for activating electronic devices with gestures
Cui et al. ShakeReader:‘Read’UHF RFID using smartphone
US20200264769A1 (en) System, method and devices for touch, user and object sensing for iot experiences
Krukowski et al. RFID-based positioning for building management systems
Liu et al. Enabling fine-grained shopping behavior information acquisition with dual RFID tags
CN107851369B (en) Information processing apparatus, information processing method, and computer-readable storage medium
KR100782340B1 (en) Route providing device and method using RDF / WSN
JP4896928B2 (en) File management system and file management method
WO2017029161A1 (en) Universal contactless gesture control system
Cai Towards RFID-Based Cyber-Physical Connection Systems
EP3599522B1 (en) Real estate monitoring system

Legal Events

Date Code Title Description
PCNP Patent ceased through non-payment of renewal fee

Effective date: 20170904