[go: up one dir, main page]

GB2394589A - Speech recognition device - Google Patents

Speech recognition device Download PDF

Info

Publication number
GB2394589A
GB2394589A GB0224797A GB0224797A GB2394589A GB 2394589 A GB2394589 A GB 2394589A GB 0224797 A GB0224797 A GB 0224797A GB 0224797 A GB0224797 A GB 0224797A GB 2394589 A GB2394589 A GB 2394589A
Authority
GB
United Kingdom
Prior art keywords
speech recognition
recognition device
microphones
plane
target direction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GB0224797A
Other versions
GB2394589B (en
GB0224797D0 (en
Inventor
Douglas Ralph Ealey
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Motorola Solutions Inc
Original Assignee
Motorola Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Motorola Inc filed Critical Motorola Inc
Priority to GB0224797A priority Critical patent/GB2394589B/en
Publication of GB0224797D0 publication Critical patent/GB0224797D0/en
Priority to AU2003282109A priority patent/AU2003282109A1/en
Priority to PCT/EP2003/050685 priority patent/WO2004038695A1/en
Publication of GB2394589A publication Critical patent/GB2394589A/en
Priority to HK04106099.3A priority patent/HK1063372B/en
Application granted granted Critical
Publication of GB2394589B publication Critical patent/GB2394589B/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/226Procedures used during a speech recognition process, e.g. man-machine dialogue using non-speech characteristics
    • G10L2015/227Procedures used during a speech recognition process, e.g. man-machine dialogue using non-speech characteristics of the speaker; Human-factor methodology
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • G10L21/0216Noise filtering characterised by the method used for estimating noise
    • G10L2021/02161Number of inputs available containing the signal or the noise to be suppressed
    • G10L2021/02166Microphone arrays; Beamforming

Landscapes

  • Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Telephone Function (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Navigation (AREA)

Abstract

A speech recognition device (300), comprising one or more microphones and means to determine the direction of a signal source received by the microphones, together with means for permitting recognition processing by the device. Permission is determined by comparing the direction of the signal source with a target direction (314), and allowing recognition processing if the source direction is within an angular threshold ( r ) of the target direction.

Description

SPEECH RECOGNITION DEVICE AND METHOD
Technical Field
5 The invention relates to the field of speech recognition.
Background
There is an emergent market for voice-controlled multi 10 modal, multimedia and telematic devices. This market raises the problem that such devices must be able to discern whether or not an utterance was addressed to that particular device, or to some third party.
15 With devices that use voiced keywords or voiced dialling, one does not want the device to perform actions as a consequence of overhearing chance instances of those keywords or names whilst it rests on a desk or in a pocket.
The consequences may be for the device to inadvertently 20 call someone mentioned in an overheard conversation, or to change mode/application, making it confusing to the user to find the device interface changing apparently 'randomly' from use to use. Both behaviours would be seen as a severe ... disadvantage to voice control by the user.
Àe One cannot simply rely on the volume level to differentiate cca. À,,,.. between overheard casual speech and close-talking use as . with a normal 'phone, because multimedia and multi-modal devices and telematic control systems are generally . . '' 30 intended to be used at arms length, either to view a , À display or because the device is on the dashboard.
Thus there is a need for an alternative method.
The general approach in the art is to use a non-obvious keyword to precede interaction with the device, for example giving it a name to be addressed by. However, having to call your personal appliances by name is not likely to be a 5 practical or particularly desirable solution in many circumstances. Summary of the Invention
10 In a first aspect, the present invention provides a speech recognition device, as claimed in claim 1.
In a second aspect, the present invention provides a method for controlling speech recognition, as claimed in claim 12.
Further aspects are as claimed in the dependent claims.
Brief description of the drawings
20 FIG. 1 illustrates a possible microphone configuration in accordance with a preferred embodiment of the invention; FIG. 2 illustrates a target direction for the user's voice, together with an angular threshold of deviation theta from À - À.... 25 the target direction.
FIG. 3 illustrates an arc of possible target directions for À À the user's voice, ranging between 'normal to the plane of the user interface' and 'parallel to the plane of the user .. . 30 interface'.
. FIG.4 illustrates a system for the control of speech recognition in accordance with the preferred embodiment.
Detailed description of preferred embodiment
In a preferred embodiment, a speech recognition device is described in accordance with figure 4, comprising an input 5 signal 404 and an estimate of the direction 406 of the input signal. The target direction selected from the target options stored in store 412 is compared with the direction 406 of the input signal by a processor 430. This comparison uses a threshold of deviation from the target direction 10 stored in 410 to determine whether the input signal 404 should be passed as output 408 to a recogniser.
Figure 1 illustrates the preferred embodiment, comprising at least three microphones 160, 162, 164 that provide input 15 to a means to determine the direction of a signal source.
The speech recognition process is then controlled, by: (i) Comparing the direction of the signal source with a given target direction. Target directions are illustrated as direction 210 of figure 2, and directions generally 20 shown as 314 in figure 3; and (ii) Permitting recognition processing if the source direction is within an angular threshold 220, 320 of the target direction.
À ee.: À À. À. . 25 FIG. 2 illustrates a target direction for the user's voice that is substantially normal to the plane of the user À. À interface and microphones, together with an angular I... À À threshold of deviation theta from the target direction À. . . 30 In figure 2, the initial target direction 210 assumes that À À. the user will wish to look at the user interface 250 of device 200 when controlling it. Consequently in this preferred embodiment the microphones should be distributed to form a plane substantially in parallel with the plane of 35 the user interface 250. The target direction 210 can then
be taken to be normal to the plane of the microphones and thus implicitly the plane of user interface 250. It is anticipated that the user will rarely be aligned exactly normal to the plane of the user interface 250, and so an 5 angular threshold 220 is introduced, wherein the speech recognition process is still permitted if the user is within angle 230 of the target direction.
An alternative target direction can be selected either by 10 the user via a user interface 450 or by automatic control 440 if the device is placed in a power and/or data cradle, or if it is left alone on a substantially horizontal surface. This target direction is described in accordance with figure 3.
FIG. 3 illustrates an arc of possible target directions for the user's voice, ranging between 'normal to the plane of the user interface' and 'parallel to the plane of the user interface', in the direction downwards and vertical to the 20 plane of the user interface, together with an angular threshold of deviation theta from the possible target directions. À ".: So the alternative target direction may be anywhere on an À. 25 arc 314 that is centred on the vertical axis of the plane . of the user interface 350. Arc 314 extends between the Àe. normal to the plane of the user interface 310, and precedes down the vertical axis until parallel to the plane of the À À. user interface 312.
À À.: 30..DTD: À À. It is anticipated that the user need not be exactly aligned on this arc. Therefore an angular threshold 320 is introduced, wherein the speech recognition process is still
permitted if the user is within angle 330 of the target direction. The angular control of the speech recognition system can be 5 specified by the user in situations where the user needs to control the device from a relative position other than those permitted by the configurations above. In such an instance the user may manually indicate the wish to redefine the target direction via the user interface 450, 10 and then speak from that direction to set the device.
In the preferred embodiment, the user's direction is determined by comparing the relative signal delay between pairs of microphones 160, 162, 164, and then using these 15 delays and the positions of the corresponding microphones to calculate the signal direction.
The angular control of the speech recognition system can be overridden automatically in situations where the signal 20 from any one microphone 160, 162, 164 falls below an amplitude ratio with respect to the signals from the remaining microphones, as in when the device is held in a typical phone position, so favouring reception by any microphone near the mouth.
"'. 25
. Finally, in the preferred embodiment it is desirable to a. .. provide a facility to reversibly enable or disable the angular control of the speech recognition system via the , ,,. user interface 450, for example in a dictation scenario.
.: 30 .,

Claims (12)

Claims
1. A speech recognition device (100), comprising: 5 one or more microphones (160, 162, 164); means to determine the direction of a signal source received by the one or more microphones (160, 162, 164); means for permitting recognition processing by the device, characterized by: 10 means for comparing the direction of the signal source with a target direction (210, 314), and permitting recognition processing if the source direction is within an angular threshold (theta) of the target direction (210,314).
2. A speech recognition device (100), according to claim 1, wherein the target direction (210) is substantially normal to the plane of the user interface.
20
3. A speech recognition device (100), according to claim 1 or claim 2, wherein the target direction (314) is anywhere on an arc . (314) centred on the vertical axis of the plane of the user À interface, the arc being from substantially normal (310) to À À. 25 the plane of the user interface and proceeding down the À. vertical axis until substantially parallel (312) to the À. plane of the user interface.
"a: À..
4. A speech recognition device (100), according to claim me. 30 1 or claim 2, .. wherein the device is adapted to change the target direction automatically to that of claim 3 when either the device is placed in a cradle provided for it, or the device determines that it has been stationary for a predetermined 3 5 period of time.
5. A speech recognition device (100), according to any previous claim, wherein user-operable means are provided, the user-operable means being adapted to enable the 5 operator to redefine the target direction manually.
6. A speech recognition device (100) according to any previous claim, wherein the microphones (160, 162, 164) are distributed in a plane substantially parallel to the plane 10 of the user interface of the device.
7. A speech recognition device (100) according to any previous claim, further comprising means for comparing the relative signal delay between any given pair of microphones 15 (160, 162, 164).
8. A speech recognition device (100) according to any previous claim, comprising means for calculating signal direction using relative signal delays between microphone 20 pairs and the positions of the microphones (160, 162, 164).
9. A speech recognition device (100) according to any previous claim, wherein the use of an angular threshold to permit recognition processing is overridden if the signal À. 25 from any one microphone (160, 162, 164) falls below an amplitude ratio with respect to the signals from the À. . remaining microphones.
À: À..
10. A speech recognition device (100) according to any ... 30 previous claim, wherein the use of an angular threshold to permit recognition processing may be reversibly enabled or disabled by the user via the user interface.
11. A speech recognition device (100) according to any previous claim, wherein the recognition comprises identifying the talker.
5
12. A method for control of speech recognition, comprising: provision of at least one microphone (160, 162, 164), the at least one microphone providing input to a means for determining the direction of a signal source; 10 provision of means for permitting recognition processing by the device, characterized by: comparing the direction of the signal source with a target direction (210, 314), and permitting recognition processing if the source direction is within an angular 15 threshold (theta) of the target direction.
. À.: À e.. *.. 1 À.. I. I. À À À À. À.:
GB0224797A 2002-10-25 2002-10-25 Speech recognition device and method Expired - Lifetime GB2394589B (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
GB0224797A GB2394589B (en) 2002-10-25 2002-10-25 Speech recognition device and method
AU2003282109A AU2003282109A1 (en) 2002-10-25 2003-10-03 Directional speech recognition device and method
PCT/EP2003/050685 WO2004038695A1 (en) 2002-10-25 2003-10-03 Directional speech recognition device and method
HK04106099.3A HK1063372B (en) 2004-08-13 Speech recognition device and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB0224797A GB2394589B (en) 2002-10-25 2002-10-25 Speech recognition device and method

Publications (3)

Publication Number Publication Date
GB0224797D0 GB0224797D0 (en) 2002-12-04
GB2394589A true GB2394589A (en) 2004-04-28
GB2394589B GB2394589B (en) 2005-05-25

Family

ID=9946532

Family Applications (1)

Application Number Title Priority Date Filing Date
GB0224797A Expired - Lifetime GB2394589B (en) 2002-10-25 2002-10-25 Speech recognition device and method

Country Status (3)

Country Link
AU (1) AU2003282109A1 (en)
GB (1) GB2394589B (en)
WO (1) WO2004038695A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008156941A1 (en) * 2007-06-21 2008-12-24 Bose Corporation Sound discrimination method and apparatus
US8611554B2 (en) 2008-04-22 2013-12-17 Bose Corporation Hearing assistance apparatus
US9078077B2 (en) 2010-10-21 2015-07-07 Bose Corporation Estimation of synthetic audio prototypes with frequency-based input signal decomposition
EP2911149A1 (en) * 2014-02-19 2015-08-26 Nokia Technologies OY Determination of an operational directive based at least in part on a spatial audio property

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9691413B2 (en) 2015-10-06 2017-06-27 Microsoft Technology Licensing, Llc Identifying sound from a source of interest based on multiple audio feeds
CN112216275B (en) * 2019-07-10 2024-07-19 阿里巴巴集团控股有限公司 Voice information processing method and device and electronic equipment

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5884254A (en) * 1995-08-02 1999-03-16 Sensimetrics Corporation Method and apparatus for restricting microphone acceptance angle
US6219645B1 (en) * 1999-12-02 2001-04-17 Lucent Technologies, Inc. Enhanced automatic speech recognition using multiple directional microphones
JP2002091491A (en) * 2000-09-20 2002-03-27 Sanyo Electric Co Ltd Voice control system for plural pieces of equipment

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001359185A (en) * 2000-06-13 2001-12-26 Matsushita Electric Ind Co Ltd Hands-free device and its audio signal processing method
DE10058786A1 (en) * 2000-11-27 2002-06-13 Philips Corp Intellectual Pty Method for controlling a device having an acoustic output device
US20030125959A1 (en) * 2001-12-31 2003-07-03 Palmquist Robert D. Translation device with planar microphone array
JP3910898B2 (en) * 2002-09-17 2007-04-25 株式会社東芝 Directivity setting device, directivity setting method, and directivity setting program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5884254A (en) * 1995-08-02 1999-03-16 Sensimetrics Corporation Method and apparatus for restricting microphone acceptance angle
US6219645B1 (en) * 1999-12-02 2001-04-17 Lucent Technologies, Inc. Enhanced automatic speech recognition using multiple directional microphones
JP2002091491A (en) * 2000-09-20 2002-03-27 Sanyo Electric Co Ltd Voice control system for plural pieces of equipment

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008156941A1 (en) * 2007-06-21 2008-12-24 Bose Corporation Sound discrimination method and apparatus
JP2010530718A (en) * 2007-06-21 2010-09-09 ボーズ・コーポレーション Sound identification method and apparatus
US8767975B2 (en) 2007-06-21 2014-07-01 Bose Corporation Sound discrimination method and apparatus
US8611554B2 (en) 2008-04-22 2013-12-17 Bose Corporation Hearing assistance apparatus
US9078077B2 (en) 2010-10-21 2015-07-07 Bose Corporation Estimation of synthetic audio prototypes with frequency-based input signal decomposition
EP2911149A1 (en) * 2014-02-19 2015-08-26 Nokia Technologies OY Determination of an operational directive based at least in part on a spatial audio property
WO2015124831A1 (en) * 2014-02-19 2015-08-27 Nokia Technologies Oy Determination of an operational directive based at least in part on a spatial audio property
CN106030700A (en) * 2014-02-19 2016-10-12 诺基亚技术有限公司 Determination of an operational directive based at least in part on a spatial audio property
US20160351191A1 (en) * 2014-02-19 2016-12-01 Nokia Technologies Oy Determination of an Operational Directive Based at Least in Part on a Spatial Audio Property
JP2017509917A (en) * 2014-02-19 2017-04-06 ノキア テクノロジーズ オサケユイチア Determination of motion commands based at least in part on spatial acoustic characteristics
US10152967B2 (en) * 2014-02-19 2018-12-11 Nokia Technologies Oy Determination of an operational directive based at least in part on a spatial audio property
CN106030700B (en) * 2014-02-19 2019-12-06 诺基亚技术有限公司 determining operational instructions based at least in part on spatial audio properties

Also Published As

Publication number Publication date
GB2394589B (en) 2005-05-25
HK1063372A1 (en) 2004-12-24
WO2004038695A1 (en) 2004-05-06
GB0224797D0 (en) 2002-12-04
AU2003282109A1 (en) 2004-05-13

Similar Documents

Publication Publication Date Title
US8249525B2 (en) Mobile electronic device and method for locating the mobile electronic device
US4945570A (en) Method for terminating a telephone call by voice command
US9300795B2 (en) Voice input state identification
KR102447381B1 (en) Method for providing artificial intelligence service during a call and electronic device therefor
US20140314242A1 (en) Ambient Sound Enablement for Headsets
US9680883B1 (en) Techniques for integrating voice control into an active telephony call
KR20210105785A (en) Electronic device and method for controlling audio output thereof
CN113727318B (en) Headset communication method, headset device and computer readable storage medium
EP0393059A1 (en) Method for terminating a telephone call by voice command.
CN106412259A (en) Mobile terminal call control method, device and mobile terminal
GB2394589A (en) Speech recognition device
US8861740B2 (en) Automatic computer audio input and output control
KR20090027817A (en) Background sound output method and mobile communication terminal using same
KR102308022B1 (en) Apparatus for recognizing call sign and method for the same
JP2001154694A (en) Speech recognition device and method
US12039977B2 (en) Call termination apparatus and method thereof
JP6759370B2 (en) Ring tone recognition device and ring tone recognition method
JPH1127376A (en) Voice communication device
US10861463B2 (en) Method for speech processing and speech processing device
KR100384697B1 (en) How to check the hands-free status of your mobile cordless phone
US20040042590A1 (en) Method for operating a device for message storage in a communications terminal, and a communications device
KR20050039876A (en) Communication apparatus and software
US20230036921A1 (en) Unmuted microphone notification
JP2023138594A (en) Information processing equipment and programs
CN107230483A (en) Speech volume processing method, storage medium and mobile terminal based on mobile terminal

Legal Events

Date Code Title Description
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1063372

Country of ref document: HK

REG Reference to a national code

Ref country code: HK

Ref legal event code: GR

Ref document number: 1063372

Country of ref document: HK

732E Amendments to the register in respect of changes of name or changes affecting rights (sect. 32/1977)

Free format text: REGISTERED BETWEEN 20110120 AND 20110126

732E Amendments to the register in respect of changes of name or changes affecting rights (sect. 32/1977)

Free format text: REGISTERED BETWEEN 20170831 AND 20170906

PE20 Patent expired after termination of 20 years

Expiry date: 20221024