[go: up one dir, main page]

JP2014092777A - Activation of mobile communication device via voice - Google Patents

Activation of mobile communication device via voice Download PDF

Info

Publication number
JP2014092777A
JP2014092777A JP2012257958A JP2012257958A JP2014092777A JP 2014092777 A JP2014092777 A JP 2014092777A JP 2012257958 A JP2012257958 A JP 2012257958A JP 2012257958 A JP2012257958 A JP 2012257958A JP 2014092777 A JP2014092777 A JP 2014092777A
Authority
JP
Japan
Prior art keywords
voice
mobile communication
command
communication device
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2012257958A
Other languages
Japanese (ja)
Inventor
Hiroshi Mizunuma
広 水沼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MAGIC HAND KK
Original Assignee
MAGIC HAND KK
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by MAGIC HAND KK filed Critical MAGIC HAND KK
Priority to JP2012257958A priority Critical patent/JP2014092777A/en
Publication of JP2014092777A publication Critical patent/JP2014092777A/en
Pending legal-status Critical Current

Links

Landscapes

  • Telephone Function (AREA)

Abstract

PROBLEM TO BE SOLVED: To activate a smartphone having a voice response system via an online service out of sleep mode and also activate an application on the smartphone, without the necessity of complex operation by a user.SOLUTION: A mobile communication device in the invention has speaker authentication capability and voice recognition capability and an activation instruction command and a location inquiry command by voice by a user are registered on the mobile communication device by the user in advance, and the voice prints are set as templates. While a smartphone is in a sleep mode, sounds occurring around a microphone of the device are constantly monitored through the microphone, and when a voice command by the user that corresponds to either of the templates is detected and it is the activation instruction command, the smartphone is activated with a response provided and an application of an online voice response service is activated at the same time. Alternatively, when the voice command corresponds to the voice print of the location inquiry command, the location of the smartphone is notified to the user by illuminating an LED monitor lamp or a screen and emitting sound.

Description

本発明は、スマートフォン、タブレットＰＣ等のモバイル通信機器の、スリープモードからの起動方法に関するものであり、ユーザーが物理的操作によらず、音声によりモバイル通信機器を操作する環境を補完するものである。  The present invention relates to a method for activating a mobile communication device such as a smartphone or a tablet PC from a sleep mode, and complements an environment in which a user operates a mobile communication device by voice regardless of physical operation. .

スマートフォンに於いては、オンラインサービスにより音声による応答、対話によってウェブの検索やアプリケーションの操作等のサービスを行うシステムが一般化しつつあるが、スリープモードからの起動に始まり音声応答のアプリケーションを起動するまでは、一連の物理的操作を行わなければならない。  In smartphones, systems that provide services such as voice response through online services and web search and application operations through conversations are becoming more common, but starting from sleep mode until voice response applications are started Must perform a series of physical operations.

モバイル通信機器に於いては、省電力の為や誤動作防止の為、スリープモード中は自動的なデータ通信と着信呼び出し以外には反応しない。またロックモード中であれば、手動でこれを解除しなければならない。しかし、車両等の運転中や作業中に素早くスマートフォン等のモバイル通信機器を操作したい時、音声で起動できれば便利であるし、置き場所が分からないとき、また就寝時のような暗中に於いて、音声に反応して所在が分かれば便利である。ましてオンラインによる音声応答システムが使えるのであれば、物理的に起動せずとも呼びかけるだけでも起動し、音声で応答してくれると更に便利である。  Mobile communication devices do not respond to anything other than automatic data communication and incoming calls during sleep mode to save power and prevent malfunctions. If you are in lock mode, you must release it manually. However, when you want to quickly operate a mobile communication device such as a smartphone while driving or working on a vehicle etc., it is convenient if you can start it with voice, when you do not know where it is placed, or in the dark like sleeping, It is convenient if the location is known in response to voice. Furthermore, if an online voice response system can be used, it is more convenient if it is activated even if it is called without being physically activated and responds with voice.

この課題を解決するために、請求項１に於いて、スマートフォンやタブレットＰＣ等のモバイル通信機器に、スリープモード中に作動する話者照合及び音声認識機能を持たせ、これにユーザーの肉声による起動コマンドの声紋を登録させてテンプレートとし、当該機器のスリープモード中に機器のマイクを通して周囲の音声を常時モニターさせ、テンプレートに合致する声紋を検出した時、これを起動コマンドと判断して音声で返答しつつ当該機器をスリープモードから起動せしめるようにする。  In order to solve this problem, in claim 1, mobile communication devices such as smartphones and tablet PCs are provided with speaker verification and voice recognition functions that operate during the sleep mode, and this is activated by the user's real voice. Register the voice print of the command as a template, and monitor the surrounding voice through the device's microphone during the sleep mode of the device. When a voice print matching the template is detected, this is judged as a startup command and responded with a voice. At the same time, the device is activated from the sleep mode.

上記の機能を当該機器の回路に付与する際、常時音声をモニターすることによる電池の消耗を抑制する必要がある場合、機器のＣＰＵの一部に低消費電力で駆動する回路を設けるか、または基板上に低消費電力で作動するＩＣを組み込んで、上記機能を担わせることを請求項２で提示した。  When it is necessary to suppress battery consumption by constantly monitoring audio when the above function is added to the circuit of the device, a circuit that is driven with low power consumption is provided in a part of the CPU of the device, or It is presented in claim 2 that an IC that operates with low power consumption is incorporated on a substrate to perform the above functions.

また、本発明による音声起動方法を持つモバイル通信機器がロックモード中の時には、当該機器が音声によってユーザーに手動でロックを解除するよう告げるか，もしくは事前に機器に登録したユーザーの音声コマンドの声紋テンプレートと、起動コマンドの音声との話者照合の一致を持ってロックを解除せしめることとする。  Further, when the mobile communication device having the voice activation method according to the present invention is in the lock mode, the device tells the user to release the lock manually by voice, or the voice print of the user's voice command registered in the device in advance. It is assumed that the lock is released with a matching of speaker verification between the template and the voice of the activation command.

また、就寝中などの暗所に於いて，或いは機器の置き場所が分からなくなった時など、声をかければ反応して音と光で位置を知らせてくれれば便利である。そこで起動コマンドの声紋のほかに、当該機器の所在を尋ねる音声コマンドの声紋を登録しておき、この音声コマンドに反応してＬＥＤモニターランプやスクリーンを光らせつつ音を発して機器の所在を知らせる機能を、請求項５によって提示した。  Also, it is convenient if you speak and respond to the position with sound and light when you speak in a dark place such as when you are sleeping, or when you know where to place the device. Therefore, in addition to the startup command voiceprint, a voice command voiceprint that asks for the location of the device is registered, and in response to this voice command, the LED monitor lamp or screen emits a sound to notify the location of the device Was presented by claim 5.

さらにまた、スリープモード中に低消費電力で稼働する音声起動専用の回路を有する請求項２のモバイル通信機器が、本体回路上乃至オンラインサービスによる音声応答機能を有する場合、音声コマンドによって起動したとき同時に本体の音声応答機能のアプリケーションを自動的に起動し、シームレスに本体の音声応答機能に音声応答を引き継ぐ機能を、請求項６によって提示した。  Furthermore, when the mobile communication device of claim 2 having a voice activation dedicated circuit that operates with low power consumption during the sleep mode has a voice response function on the main circuit or through an online service, it is simultaneously activated when activated by a voice command. The function of automatically starting the application of the voice response function of the main body and seamlessly taking over the voice response to the voice response function of the main body is presented by claim 6.

オンラインサービスによる音声応答システムを持つスマートフォンを使用するとき、手指で操作することなく音声による対話で操作できるので、作業中など手が離せないときなどは誠に便利であるが、スリープモード中は手動で起動しなければならない。  When using a smartphone with an online service voice response system, it can be operated by voice dialogue without operating with fingers, so it is very convenient when you can not take your hands off, such as during work, but manually in sleep mode Must start.

このようなとき、声で呼びかけるだけで起動し、そのまま音声での対話のみで操作できなければ、こうした音声応答システムは万全とは言えない。さらにまた当該機器がロックモード中であるとき、いちいち手動で解除せずとも事前に機器に登録したユーザーの音声コマンドを話者照合して生体認証とし、これによってロック解除できればさらに便利である。  In such a case, such a voice response system is not perfect if it can be activated simply by calling it with a voice and cannot be operated simply by voice dialogue. Furthermore, when the device is in the lock mode, it is more convenient if the user's voice command registered in the device is collated with the speaker for biometric authentication without releasing it manually, thereby unlocking it.

また機器が見当たらないとき、声による呼びかけに反応して光や音で置き場所を知らせてくれる機能があれば、わざわざ着信音を鳴らすような手間が省けることも多く、日常生活の中では助けられることの多い機能である。  Also, if you can't find a device, there is a function that can respond to a call by voice and inform you where to place it with light or sound. It is a function with many things.

オンラインによる音声応答サービス機能を持つスマートフォンのＣＰＵまたは基板上に、低消費電力で作動する回路を構成し、これに話者照合機能及び音声認識機能を持たせ、ユーザーの肉声による起動命令コマンド及び所在質問コマンドの音声を、ユーザー自身が事前に当該機器に登録し、この声紋をテンプレートとする。  A circuit that operates with low power consumption is configured on the CPU or board of a smartphone that has an online voice response service function, which has a speaker verification function and a voice recognition function. The voice of the question command is registered in the device by the user in advance, and this voiceprint is used as a template.

当該スマートフォンがスリープモード中の時に、機器のマイクを通して周囲の音声を常時モニターさせておき、テンプレートに合致するユーザーの音声コマンドを検知したとき、これが起動命令コマンドの声紋であれば返答しつつスマートフォンを起動し、同時にオンラインによる音声応答サービスのアプリケーションを起動する。  When the smartphone is in sleep mode, the surrounding voice is always monitored through the microphone of the device, and when the voice command of the user that matches the template is detected, if this is a voice print of the start command command, the smartphone Start up and simultaneously start up the online voice response service application.

また、所在質問コマンドの声紋であれば、ＬＥＤモニターランプやスクリーンを光らせつつ音を発して当該スマートフォンの所在をユーザーに知らせる。  If the voiceprint is a location question command, a sound is emitted while illuminating the LED monitor lamp or the screen to notify the user of the location of the smartphone.

以上のように、話者照合及び音声認識による起動システムで、スマートフォンのオンラインサービスによる音声応答システムを補完することにより、スマートフォンに個人用の秘書としての機能を与えることができるのである。  As described above, the function as a personal secretary can be given to the smartphone by complementing the voice response system based on the online service of the smartphone with the activation system based on speaker verification and voice recognition.

Claims (6)

スマートフォンやタブレットＰＣ等のモバイル通信機器に於いて、スリープモード中に作動する話者照合及び音声認識機能を持たせ、ユーザーの発話による起動コマンドの音声をユーザー自身に事前に登録させ、この声紋をテンプレートとし、当該機器のスリープモード中に機器のマイクを通して周囲の音声を常時モニターさせ、テンプレートと一致する声紋を検出したとき当該機器を起動する、モバイル通信機器の音声起動方法。  In mobile communication devices such as smartphones and tablet PCs, speaker verification and voice recognition functions that operate during sleep mode are provided, and the voice of the start command by the user's utterance is registered in advance by the user himself, and this voiceprint is stored. A voice activation method for a mobile communication device, in which a template is used, the surrounding audio is constantly monitored through a microphone of the device during the sleep mode of the device, and the device is activated when a voiceprint matching the template is detected. モバイル通信機器のＣＰＵまたは基板上に、スリープモード中に低消費電力で駆動を続ける回路を設け、これに音声起動機能を担わせる、請求項１の音声起動方法。  The voice activation method according to claim 1, wherein a circuit that continues to be driven with low power consumption during a sleep mode is provided on a CPU or a substrate of a mobile communication device, and this has a voice activation function. 請求項１のモバイル通信機器に於いて、これがロックモードにあるとき、事前に登録したユーザーの声紋テンプレートと起動を命じるコマンド音声との一致によってロックモードを解除する、請求項１及び請求項２の音声起動方法。  3. The mobile communication device according to claim 1, wherein when the mobile communication device is in the lock mode, the lock mode is canceled by matching the pre-registered user's voiceprint template with a command voice commanding activation. Voice activation method. 請求項１のモバイル通信機器に於いて、これがロックモードにあるとき、音声によってユーザーに手動でロックを解除するように告げる、請求項１及び請求項２の音声起動方法。  3. The voice activation method according to claim 1, wherein when the mobile communication device is in the lock mode, the user is instructed to release the lock manually by voice. 請求項１のモバイル通信機器に於いて、起動コマンドの声紋のほかに、当該機器の所在を尋ねる音声コマンドの声紋をテンプレートとし、就寝中などの暗中に於いて、或いは置き場所が不明の時などにこの音声コマンドに反応し、ＬＥＤモニターランプやスクリーンを光らせつつ音を発して機器の所在を知らせる機能を併せ持つ、請求項１，請求項２、請求項３、請求項４の音声起動方法。  In the mobile communication device according to claim 1, in addition to the voice command of the activation command, the voice command of the voice command that asks for the location of the device is used as a template, in the dark such as at bedtime, or when the location is unknown 5. The voice activation method according to claim 1, further comprising a function of responding to the voice command and emitting a sound while illuminating the LED monitor lamp or the screen to notify the location of the device. 請求項１のモバイル通信機器に於いて、これが基板上或いはオンラインによる音声応答機能を持つとき、音声コマンドによって当該機器が起動した後、シームレスに機器の音声応答機能に切り替わるようにした、請求項１、請求項２、請求項３の音声起動方法。  The mobile communication device according to claim 1, wherein when the device has a voice response function on a board or online, after the device is activated by a voice command, the voice response function of the device is seamlessly switched. 4. A voice activation method according to claim 2 or claim 3.
JP2012257958A 2012-11-06 2012-11-06 Activation of mobile communication device via voice Pending JP2014092777A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2012257958A JP2014092777A (en) 2012-11-06 2012-11-06 Activation of mobile communication device via voice

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2012257958A JP2014092777A (en) 2012-11-06 2012-11-06 Activation of mobile communication device via voice

Publications (1)

Publication Number Publication Date
JP2014092777A true JP2014092777A (en) 2014-05-19

Family

ID=50936861

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2012257958A Pending JP2014092777A (en) 2012-11-06 2012-11-06 Activation of mobile communication device via voice

Country Status (1)

Country Link
JP (1) JP2014092777A (en)

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104123115A (en) * 2014-07-28 2014-10-29 联想(北京)有限公司 Audio information processing method and electronic device
CN104360872A (en) * 2014-10-15 2015-02-18 深圳市学立佳教育科技有限公司 External device for starting app under IOS (Iphone Operation System) environment by utilizing audio interface
KR20160014465A (en) * 2014-07-29 2016-02-11 삼성전자주식회사 electronic device for speech recognition and method thereof
CN106164921A (en) * 2014-07-18 2016-11-23 谷歌公司 Speaker Verification Using Co-location Information
JP2017072857A (en) * 2014-10-09 2017-04-13 グーグル インコーポレイテッド Hotword detection in multiple devices
CN107343087A (en) * 2017-06-15 2017-11-10 北京小米移动软件有限公司 Smart machine control method and device
JP2018533064A (en) * 2015-10-09 2018-11-08 ユウトウ・テクノロジー（ハンジョウ）・カンパニー・リミテッド Rapid identification method and intelligent robot for home use
CN109065060A (en) * 2018-10-23 2018-12-21 维沃移动通信有限公司 A kind of voice awakening method and terminal
JP2019502947A (en) * 2015-11-30 2019-01-31 ゼットティーイー コーポレイション Voice wakeup implementation method, apparatus and terminal, and computer storage medium
JP2019184809A (en) * 2018-04-10 2019-10-24 シャープ株式会社 Voice recognition device and voice recognition method
US10497364B2 (en) 2017-04-20 2019-12-03 Google Llc Multi-user authentication on a device
JP2020500331A (en) * 2016-11-07 2020-01-09 グーグル エルエルシー Recorded media hot word trigger suppression
JP2020515913A (en) * 2017-04-10 2020-05-28 北京猟戸星空科技有限公司 Voice response method, device and smart device
JP2020112778A (en) * 2019-01-11 2020-07-27 バイドゥ オンライン ネットワーク テクノロジー （ベイジン） カンパニー リミテッド Wake-up method, device, facility and storage medium for voice interaction facility
CN112513783A (en) * 2019-05-23 2021-03-16 深圳博芯科技股份有限公司 Voice interaction intelligent bracelet
US12046241B2 (en) 2014-10-09 2024-07-23 Google Llc Device leadership negotiation among voice interface devices

Cited By (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10147429B2 (en) 2014-07-18 2018-12-04 Google Llc Speaker verification using co-location information
CN106164921A (en) * 2014-07-18 2016-11-23 谷歌公司 Speaker Verification Using Co-location Information
JP2017517027A (en) * 2014-07-18 2017-06-22 グーグル インコーポレイテッド Speaker verification using collocation information
CN104123115A (en) * 2014-07-28 2014-10-29 联想(北京)有限公司 Audio information processing method and electronic device
CN104123115B (en) * 2014-07-28 2017-05-24 联想(北京)有限公司 Audio information processing method and electronic device
KR102246900B1 (en) 2014-07-29 2021-04-30 삼성전자주식회사 Electronic device for speech recognition and method thereof
KR20160014465A (en) * 2014-07-29 2016-02-11 삼성전자주식회사 electronic device for speech recognition and method thereof
JP2019133198A (en) * 2014-10-09 2019-08-08 グーグル エルエルシー Hotword detection on multiple devices
JP2022017569A (en) * 2014-10-09 2022-01-25 グーグル エルエルシー Hotword detection on multiple devices
JP7354210B2 (en) 2014-10-09 2023-10-02 グーグル エルエルシー Hotword detection on multiple devices
US10134398B2 (en) 2014-10-09 2018-11-20 Google Llc Hotword detection on multiple devices
JP7664335B2 (en) 2014-10-09 2025-04-17 グーグル エルエルシー Hotword detection on multiple devices
US12254884B2 (en) 2014-10-09 2025-03-18 Google Llc Hotword detection on multiple devices
JP2017227912A (en) * 2014-10-09 2017-12-28 グーグル エルエルシー Hotword detection on multiple devices
US10909987B2 (en) 2014-10-09 2021-02-02 Google Llc Hotword detection on multiple devices
US12046241B2 (en) 2014-10-09 2024-07-23 Google Llc Device leadership negotiation among voice interface devices
US11915706B2 (en) 2014-10-09 2024-02-27 Google Llc Hotword detection on multiple devices
JP2023174674A (en) * 2014-10-09 2023-12-08 グーグル エルエルシー Hotword detection on multiple devices
US11557299B2 (en) 2014-10-09 2023-01-17 Google Llc Hotword detection on multiple devices
US10593330B2 (en) 2014-10-09 2020-03-17 Google Llc Hotword detection on multiple devices
JP2017072857A (en) * 2014-10-09 2017-04-13 グーグル インコーポレイテッド Hotword detection in multiple devices
CN104360872A (en) * 2014-10-15 2015-02-18 深圳市学立佳教育科技有限公司 External device for starting app under IOS (Iphone Operation System) environment by utilizing audio interface
JP2018533064A (en) * 2015-10-09 2018-11-08 ユウトウ・テクノロジー（ハンジョウ）・カンパニー・リミテッド Rapid identification method and intelligent robot for home use
JP2019502947A (en) * 2015-11-30 2019-01-31 ゼットティーイー コーポレイション Voice wakeup implementation method, apparatus and terminal, and computer storage medium
US10867600B2 (en) 2016-11-07 2020-12-15 Google Llc Recorded media hotword trigger suppression
US11798557B2 (en) 2016-11-07 2023-10-24 Google Llc Recorded media hotword trigger suppression
JP2020500331A (en) * 2016-11-07 2020-01-09 グーグル エルエルシー Recorded media hot word trigger suppression
US11257498B2 (en) 2016-11-07 2022-02-22 Google Llc Recorded media hotword trigger suppression
JP2020515913A (en) * 2017-04-10 2020-05-28 北京猟戸星空科技有限公司 Voice response method, device and smart device
US11238848B2 (en) 2017-04-20 2022-02-01 Google Llc Multi-user authentication on a device
US11087743B2 (en) 2017-04-20 2021-08-10 Google Llc Multi-user authentication on a device
US11721326B2 (en) 2017-04-20 2023-08-08 Google Llc Multi-user authentication on a device
US11727918B2 (en) 2017-04-20 2023-08-15 Google Llc Multi-user authentication on a device
US10522137B2 (en) 2017-04-20 2019-12-31 Google Llc Multi-user authentication on a device
US10497364B2 (en) 2017-04-20 2019-12-03 Google Llc Multi-user authentication on a device
CN107343087A (en) * 2017-06-15 2017-11-10 北京小米移动软件有限公司 Smart machine control method and device
JP7197992B2 (en) 2018-04-10 2022-12-28 シャープ株式会社 Speech recognition device, speech recognition method
JP2019184809A (en) * 2018-04-10 2019-10-24 シャープ株式会社 Voice recognition device and voice recognition method
CN109065060A (en) * 2018-10-23 2018-12-21 维沃移动通信有限公司 A kind of voice awakening method and terminal
JP2020112778A (en) * 2019-01-11 2020-07-27 バイドゥ オンライン ネットワーク テクノロジー （ベイジン） カンパニー リミテッド Wake-up method, device, facility and storage medium for voice interaction facility
CN112513783A (en) * 2019-05-23 2021-03-16 深圳博芯科技股份有限公司 Voice interaction intelligent bracelet

Similar Documents

Publication Publication Date Title
JP2014092777A (en) Activation of mobile communication device via voice
US8452597B2 (en) Systems and methods for continual speech recognition and detection in mobile computing devices
KR102592769B1 (en) Electronic device and operating method thereof
KR20190051368A (en) Electronic apparatus and Method of executing a function by speech recognition between the electronic apparatus
KR102216048B1 (en) Apparatus and method for recognizing voice commend
KR102729069B1 (en) Lamp device for inputting or outputting voice signals and a method of driving the lamp device
US12197204B2 (en) User input processing method and electronic device supporting same
US10084500B2 (en) Video recording device holster
WO2015180447A1 (en) Alarming method, terminal, and storage medium
KR102421824B1 (en) Electronic device for providing voice based service using external device and operating method thereof, the external device and operating method thereof
RU2018142910A (en) Device and method for voice communication with confidentiality
CN105278655A (en) Control method and device of fingerprint sensor
US20230289130A1 (en) Systems and methods for notifying video conferencing status with visual status indicator
KR102786492B1 (en) System for processing user utterance and controlling method thereof
WO2016138769A1 (en) State switching method and device
WO2014077333A1 (en) Illumination device
JP2006067488A (en) Mobile communication terminal
CN105408835A (en) Method and apparatus for controlling power consumption of portable terminal
JP2022063273A (en) Electric tool
TW201512987A (en) Method and device for controlling start-up of application and computer-readable storage medium
KR20210044509A (en) An electronic device supporting improved speech recognition
KR20190066474A (en) Electronic device having structure with gas sensor
CN108322588A (en) A kind of method of controlling operation thereof and device of mobile terminal
JP2007158670A (en) Car-mounted handsfree device and car-mounted handsfree system
US20200319695A1 (en) Voice-enabled external smart battery processing system