TWI633484B - Activation assisting apparatus, speech operation system and method thereof - Google Patents

Abstract

An auxiliary starting device for assisting in turning on a voice system of a mobile terminal device. The mobile terminal device includes a first wireless transmission module and a voice system coupled to the first wireless transmission module. The auxiliary starting device comprises a second wireless transmission module and a trigger module. The second wireless transmission module is matched with the first wireless transmission module, and the trigger module is coupled to the second wireless transmission module. When the trigger module is triggered, the second wireless transmission module is coupled to the first wireless transmission module of the mobile terminal device via a wireless communication protocol to activate the voice system of the mobile terminal device.

Description

Auxiliary starting device, voice control system and method thereof

The present invention relates to a technique for turning on a voice function, and more particularly to an auxiliary activation device, a voice control system, and a method thereof.

With the development of technology, mobile terminal devices with voice systems have become increasingly popular. The above voice system is a voice understanding technology that allows the user to communicate with the mobile terminal device. For example, if the user speaks a certain request to the mobile terminal device, for example, if he wants to check the number of times, check the weather, or want to make a call, the system will take corresponding actions according to the user's voice signal. The above actions may be to answer the user's question by voice or to drive the system of the mobile terminal device to operate according to the user's instruction.

However, in the process of technological development of the voice system, there are some problems to be solved. For example: voice combined with the data security of the cloud server, the convenience of the voice system startup and so on.

In terms of voice and cloud server security, the concept of voice interaction system combined with cloud technology is complex and requires powerful computing power. The voice processing process is performed by the cloud server. Although such an approach can significantly reduce the cost of configuring the hardware required for the mobile terminal device. However, for the need to make calls and send text messages through the address book, the confidentiality of the address book will be an important issue because it is necessary to upload the address book to the cloud server to find the object of the call or the text message. Although the cloud server can use encrypted connection and adopts the method of ready-to-use and non-storage, it is difficult to eliminate the user's concerns about the above-mentioned practices.

On the other hand, in terms of the convenience of voice system startup, most of the current The application displayed by the screen of the mobile terminal device is activated or activated by a physical button set by the mobile terminal device. The above design must be initiated by the mobile terminal device itself, but in some cases, the above design is quite inconvenient. For example, during driving, when the mobile terminal device is placed in a pocket or a bag, or when cooking in the kitchen, it is necessary to dial a mobile phone located in the living room to ask the user for details of the recipe, etc., and the user cannot immediately touch the mobile terminal device. , but the voice system needs to be turned on.

In addition, the sound reinforcement function in the mobile terminal device also has similar questions. question. Although the user can currently operate the mobile phone through a finger, or hold the mobile phone with a single hand to bring the mobile phone close to the ear to activate the sound amplification function. However, when the user cannot immediately access the mobile terminal device, but needs to make the sound amplification function, the design that needs to be activated by the mobile terminal device itself still causes inconvenience to the user.

Therefore, how to improve these shortcomings has become an urgent issue to be solved.

The invention provides an auxiliary starting device, a voice control system and a method thereof, which enable a user to wirelessly activate a voice dialogue function provided by the mobile communication device through the auxiliary starting device to improve the convenience in use.

The invention provides a voice control system comprising an auxiliary starting device and a mobile terminal device. The auxiliary activation device is configured to assist in opening a voice system of the mobile terminal device, and the auxiliary activation device includes a first wireless transmission module. The mobile terminal device includes a second wireless transmission module and the voice system described above. The second wireless transmission module is matched with the first wireless transmission module, and the voice system is coupled to the second wireless transmission module. When the auxiliary activation device is triggered, the first wireless transmission module is coupled to the second wireless transmission module of the mobile terminal device via a wireless communication protocol to activate the voice system of the mobile terminal device.

The invention further provides an auxiliary starting device for assisting in opening a voice system of a mobile terminal device. The mobile terminal device includes a first wireless transmission module and a voice system coupled to the first wireless transmission module. The auxiliary starting device comprises a second wireless transmission module and a trigger module. The second wireless transmission module is matched with the first wireless transmission module, and the trigger module is coupled to the second wireless transmission module. When the trigger module is triggered, the second wireless transmission module is coupled to the first wireless transmission module of the mobile terminal device via a wireless communication protocol to activate the voice system of the mobile terminal device.

The invention further proposes a voice manipulation method suitable for a mobile terminal device and an auxiliary activation device. The auxiliary starting device is used to assist in turning on the voice system of the mobile terminal device. The auxiliary starting device and the mobile terminal device respectively have mutual Matching the first wireless transmission module and the second wireless transmission module. The above voice control method is that the first wireless transmission module receives a trigger signal. Then, the first wireless transmission module is activated and a wireless transmission signal is transmitted. Then, the second wireless transmission module receives the wireless transmission signal to activate the voice system.

Based on the above, when the mobile communication device receives the wireless transmission signal from the auxiliary activation device to activate the voice system, the mobile communication device can start receiving the user's voice signal to parse the voice signal through the voice understanding module. In this way, the user wirelessly activates the voice conversation function provided by the mobile communication device through the auxiliary activation device, thereby improving the convenience of use.

The above described features and advantages of the present invention will be more apparent from the following description.

100,200‧‧‧ voice control system

110‧‧‧Auxiliary starter

112, 122‧‧‧Wireless transmission module

114‧‧‧Trigger module

116‧‧‧Wireless rechargeable battery

1162‧‧‧ battery unit

1164‧‧‧Wireless charging module

120, 220, 420‧‧‧ mobile terminal devices

121, 426‧‧ ‧ voice system

124, 610‧‧‧Voice sampling module

127‧‧‧Voice output interface

128, 424‧‧‧Communication Module

130, 410‧‧‧ (cloud) server

132‧‧‧Voice Understanding Module

1322‧‧‧Voice recognition module

1324‧‧‧Voice Processing Module

400‧‧‧Voice Interactive System

412, 422, 660‧‧ ‧ processing unit

414‧‧‧Transmission module

428‧‧‧ storage unit

429‧‧‧Contacts

330‧‧‧Display unit

620‧‧‧ input unit

630‧‧‧Dial-up unit

640‧‧‧ earpiece

650‧‧‧Audio equipment

670‧‧‧ headphones

S302~S312, S501~S519, S710~S770‧‧‧ steps

DRC‧‧‧Call receiving data

DTC‧‧‧Call transmission data

SAI‧‧‧ input audio signal

SAO‧‧‧ output audio signal

SIO‧‧‧ input operation signal

1 is a block diagram of a voice control system in accordance with an embodiment of the invention.

2 is a block diagram of a voice manipulation system in accordance with another embodiment of the present invention.

FIG. 3 is a flow chart of a voice control method according to an embodiment of the invention.

4 is a block diagram of a voice interaction system in accordance with an embodiment of the present invention.

FIG. 5 is a voice communication for a voice interaction system according to an embodiment of the invention Schematic diagram of the process.

FIG. 6 is a schematic diagram of a system of a mobile terminal device according to an embodiment of the invention.

FIG. 7 is a flowchart of a method for automatically starting a call amplification function of a mobile terminal device according to an embodiment of the present invention.

Although the mobile terminal device of the present invention can provide a voice system for the user to make a voice to communicate with the mobile terminal device, the user must still activate the mobile terminal device itself when the voice system is activated. Therefore, when the user cannot immediately touch the mobile terminal device, but the voice system needs to be turned on, the user's immediate needs are often not met. To this end, the present invention proposes an apparatus for assisting the activation of a voice system and a corresponding method thereof, so that the user can turn on the voice system more conveniently. In order to clarify the content of the present invention, the following specific examples are given as examples in which the present invention can be implemented.

1 is a block diagram of a voice control system in accordance with an embodiment of the invention. Referring to FIG. 1 , the voice control system 100 includes an auxiliary activation device 110 , a mobile terminal device 120 , and a server 130 . In the present embodiment, the auxiliary activation device 110 activates the voice system of the mobile terminal device 120 by wirelessly transmitting signals, so that the mobile terminal device 120 communicates with the server 130 according to the voice signal.

In detail, the auxiliary activation device 110 includes a first wireless transmission module 112 and a trigger module 114 , wherein the trigger module 114 is coupled to the first wireless transmission module 112 . The first wireless transmission module 112 supports, for example, wireless compatible authentication (Wireless) Fidelity, Wi-Fi, Worldwide Interoperability for Microwave Access (WiMAX), Bluetooth, Ultra-wideband (UWB) or Radio-frequency Identification (RFID) A protocol device that can transmit a wireless transmission signal to establish a wireless connection with another wireless transmission module. The trigger module 114 is, for example, a button, a button, or the like. In this embodiment, after the user presses the trigger module 114 to generate a trigger signal, the first wireless transmission module 112 receives the trigger signal and starts, and the first wireless transmission module 112 sends a wireless transmission signal. And transmitting the wireless transmission signal to the mobile terminal device 120 through the first wireless transmission module 112. In an embodiment, the auxiliary activation device 110 may be a Bluetooth headset.

It should be noted that although some hands-free headsets/microphones currently have a design to activate certain functions of the mobile terminal device 120, in another embodiment of the present invention, the auxiliary activation device 110 may be different from the earphone/microphone described above. The above-mentioned earphone/microphone performs listening/talking by replacing the earphone/microphone on the mobile terminal device 120 by connecting with the mobile terminal device, and the startup function is an additional design, but the auxiliary activation device 110" of the present invention is only used for Turning on the voice system in the mobile terminal device 120 does not have the function of listening/talking, so the internal circuit design can be simplified and the cost is low. In other words, the auxiliary starting device 110 is another device with respect to the above-mentioned hands-free headset/microphone, that is, the user may have both the hands-free earphone/microphone and the auxiliary starting device 110 of the present case.

In addition, the shape of the above-mentioned auxiliary starting device 110 may be an item that the user can easily access, such as a ring, a watch, an earring, a necklace, a glasses, and the like. That is, various portable items, or mounting members, such as a traveling accessory disposed on the steering wheel, are not limited to the above. That is to say, the auxiliary activation device 110 is a "living" device, and through the setting of the internal system, the user can easily touch the trigger module 114 to turn on the voice system. For example, when the shape of the auxiliary activation device 110 is a ring, the user can easily move the finger to press the trigger module 114 of the ring to be triggered. On the other hand, when the shape of the auxiliary starting device 110 is a device disposed on the driving accessory, the user can also easily trigger the triggering module 114 of the driving accessory device during driving. In addition, the auxiliary activation device 110 of the present invention can turn on the voice system in the mobile terminal device 120, and even turn on the amplification function (described later), compared to the discomfort of listening/talking with the earphone/microphone. Therefore, the user can still listen/talk directly through the mobile terminal device 120 without wearing the earphone/microphone. In addition, for the user, these "living" auxiliary starting devices 110 are items that would otherwise be worn or used, so there is no problem of uncomfortable or uncomfortable use, that is, no flowers are needed. Time to adapt. For example, when a user is cooking in a kitchen and needs to dial a mobile phone placed in a living room, assuming that it is wearing the auxiliary activation device 110 of the present invention having a ring, a necklace or a watch shape, the ring and the necklace can be tapped. Or watch to turn on the voice system to ask for friend recipe details. Although some earphones/microphones with start-up function can achieve the above purposes, in the process of cooking, not every time you need to call a friend, so for the user, wear headphones at any time. It is quite inconvenient to cook the microphone in order to control the mobile terminal device at any time.

In other embodiments, the auxiliary activation device 110 can also be configured with a wireless charger. The electric battery 116 is configured to drive the first wireless transmission module 112. Further, the wireless charging battery 116 includes a battery unit 1162 and a wireless charging module 1164. The wireless charging module 1164 is coupled to the battery unit 1162. Here, the wireless charging module 1164 can receive energy supplied from a wireless power supply device (not shown) and convert the energy into power to charge the battery unit 1162. In this way, the first wireless transmission module 112 of the auxiliary activation device 110 can be conveniently charged through the wireless rechargeable battery 116.

On the other hand, the mobile terminal device 120 is, for example, a Cell phone, a Personal Digital Assistant (PDA) mobile phone, a smart phone, or a Pocket PC equipped with a communication software (Pocket PC). ), Tablet PC or laptop, and more. The mobile terminal device 120 can be any portable mobile device with communication function, and the scope is not limited herein. Further, the mobile terminal device 120 may use an Android operating system, a Microsoft operating system, an Android operating system, a Linux operating system, etc., without being limited to the above.

The mobile terminal device 120 includes a second wireless transmission module 122, and the second wireless transmission module 122 can be matched with the first wireless transmission module 112 of the auxiliary activation device 110, and adopts a corresponding wireless communication protocol (for example, wireless compatibility). A communication protocol such as authentication, global interoperability microwave access, Bluetooth, ultra-wideband communication protocol or radio frequency identification is established to establish a wireless connection with the first wireless transmission module 112. It should be noted that the "first" wireless transmission module 112 and the "second" wireless transmission module 122 are used to describe that the wireless transmission module is configured in different devices, and is not intended to limit the present invention. Bright.

In other embodiments, the mobile terminal device 120 further includes a voice system 121. The voice system 121 is coupled to the second wireless transmission module 122. Therefore, after the user triggers the trigger module 114 of the auxiliary activation device 110, the user can transmit the first The wireless transmission module 112 and the second wireless transmission module 122 wirelessly activate the voice system 121. In an embodiment, the voice system 121 can include a voice sampling module 124 and a voice output interface 127. The voice sampling module 124 is configured to receive a voice signal from a user. The voice sampling module 124 is, for example, a device for receiving audio such as a microphone. The above-described voice output interface 127 is, for example, a speaker or an earphone.

In addition, the mobile terminal device 120 may also be configured with a communication module 128. The communication module 128 is, for example, an element capable of transmitting and receiving wireless signals, such as a radio frequency transceiver. Further, the communication module 128 enables the user to answer or make a call through the mobile terminal device 120 or use other services provided by the carrier. In this embodiment, the communication module 128 can receive the response information from the server 130 through the Internet, and establish a call connection between the mobile terminal device 120 and the at least one electronic device according to the response information, wherein the electronic device The device is, for example, another mobile terminal device (not shown).

The server 130 is, for example, a web server or a cloud server, and has a speech understanding module 132. In this embodiment, the voice recognition module 132 includes a voice recognition module 1322 and a voice processing module 1324. The voice processing module 1324 is coupled to the voice recognition module 1322. Here, the speech recognition module 1322 receives the speech signal transmitted from the speech sampling module 124 to convert the speech signal into a plurality of segmentation languages. Meaning (such as words or words, etc.). The speech processing module 1324 can parse the meanings (such as intent, time, location, etc.) represented by the segmentation semantics according to the segmentation semantics, and thereby determine the meaning represented in the speech signal. In addition, the voice processing module 1324 also generates corresponding response information according to the parsed result. In this embodiment, the speech understanding module 132 can be implemented by a hardware circuit composed of one or several logic gates, or can be implemented by a computer program code. It is worth mentioning that in another embodiment, the voice understanding module 132 can be configured in the mobile terminal device 220, such as the voice control system 200 shown in FIG.

The following is a description of the voice manipulation method in conjunction with the voice control system 100 described above. FIG. 3 is a flow chart of a voice control method according to an embodiment of the invention. Referring to FIG. 1 and FIG. 3 simultaneously, in step 302, the auxiliary activation device 110 transmits a wireless transmission signal to the mobile terminal device 120. The detailed description is that when the first wireless transmission module 112 of the auxiliary activation device 110 is triggered by receiving a trigger signal, the auxiliary activation device 110 transmits a wireless transmission signal to the mobile terminal device 120. Specifically, when the trigger module 114 in the auxiliary activation device 110 is pressed by the user, the trigger module 114 is triggered by the trigger signal, and the first wireless transmission module 112 sends the wireless transmission signal to the mobile terminal. The second wireless transmission module 122 of the device 120 is configured such that the first wireless transmission module 112 is coupled to the second wireless transmission module 122 via a wireless communication protocol. The above-mentioned auxiliary starting device 110 is only used to activate the voice system in the mobile terminal device 120, and does not have the function of listening/talking, so the internal circuit design can be simplified and the cost is low. In other words, the auxiliary starting device 110 is another with respect to the hands-free headset/microphone attached to the general mobile terminal device 120. The device, that is, the user may have both a hands-free headset/microphone and an auxiliary activation device 110 of the present invention.

It is worth mentioning that the shape of the auxiliary starting device 110 described above may be The portable items that are accessible to the user, such as rings, watches, earrings, necklaces, glasses, and the like, or the mounting members, such as the traveling accessories disposed on the steering wheel, are not limited to the above. That is to say, the auxiliary activation device 110 is a "living" device, and through the setting of the internal system, the user can easily touch the trigger module 114 to turn on the voice system 121. Therefore, the auxiliary activation device 110 of the present invention can turn on the voice system 121 in the mobile terminal device 120, and even turn on the sound amplification function (which will be described in detail later), so that the user can directly directly without using the earphone/microphone. Listening/talking is performed through the mobile terminal device 120. In addition, for the user, these "living" auxiliary starting devices 110 are items that would otherwise be worn or used, so there is no problem of uncomfortable or uncomfortable use.

In addition, both the first wireless transmission module 112 and the second wireless transmission module 122 can be in a sleep mode or an operating mode. The sleep mode refers to the wireless transmission module being in a closed state, that is, the wireless transmission module does not receive/detect wireless transmission signals, and cannot be connected with other wireless transmission modules. The working mode refers to the wireless transmission module being turned on, that is, the wireless transmission module can continuously detect wireless transmission signals, or can transmit wireless transmission signals at any time, and can be connected with other wireless transmission modules. Here, when the trigger module 114 is triggered, if the first wireless transmission module 112 is in the sleep mode, the trigger module 114 wakes up the first wireless transmission module 112, and causes the first wireless transmission module 112 to enter the working mode. And causing the first wireless transmission module 112 The wireless transmission module is sent to the second wireless transmission module 122, and the first wireless transmission module 112 is coupled to the second wireless transmission module 122 of the mobile terminal device 120 via the wireless communication protocol.

On the other hand, in order to avoid the first wireless transmission module 112 being continuously maintained The working mode consumes too much power. Within a preset time (for example, 5 minutes) after the first wireless transmission module 112 enters the working mode, if the triggering module 114 is not triggered again, the first wireless transmission module 112 The sleep mode is entered from the work mode, and the second wireless transmission module 120 of the mobile terminal device 120 is stopped.

Thereafter, in step 304, the second wireless transmission of the mobile terminal device 120 The transmission module 122 receives the wireless transmission signal to activate the voice system 121. Next, in step S306, when the second wireless transmission module 122 detects the wireless transmission signal, the mobile terminal device 120 can activate the voice system 121, and the 121 sampling module 124 of the voice system can start receiving the voice signal, for example, "Today How many degrees?", "Call to Pharaoh.", "Please check the phone number."

In step S308, the voice sampling module 124 transmits the voice signal. The speech understanding module 132 in the server 130 analyzes the speech signal and generates response information through the speech understanding module 132. Further, the speech recognition module 1322 in the speech understanding module 132 receives the speech signal from the speech sampling module 124 and divides the speech signal into a plurality of segmentation semantics, and the speech processing module 1324 The segmentation semantics perform speech understanding to generate response information for responding to the speech signal.

In another embodiment of the present invention, the mobile terminal device 120 is more receivable. The response information generated by the voice processing module 1324 is used to output the content of the response information or perform the operation of the response information through the voice output interface 127. In step S310, the mobile terminal device 120 receives the response information generated by the speech understanding module 132, and generates a speech response according to the content (such as a vocabulary or a sentence) in the response information. And, in step S312, the voice output interface 127 receives and outputs the voice response.

For example, when the user presses the trigger mode in the auxiliary activation device 110 In the group 114, the first wireless transmission module 112 transmits a wireless transmission signal to the second wireless transmission module 122, so that the mobile terminal device 120 activates the voice sampling module 124 of the voice system 121. Here, assuming that the voice signal from the user is a query sentence, such as "Today's temperature is a few degrees?", the voice sampling module 124 receives and transmits the voice signal to the voice understanding module 132 in the server 130. The speech understanding module 132 can transmit the response information generated by the parsing back to the mobile terminal device 120. Assuming that the content of the response information generated by the speech understanding module 132 is "30 ° C", the speech output interface 127 can broadcast the speech to the user.

In another embodiment, assume that the voice signal from the user is a command For example, "call to Pharaoh.", the speech understanding module 132 can recognize the command sentence as "a request to dial a phone to Pharaoh." In addition, the voice understanding module 132 will generate new response information, such as "Please confirm whether to dial to Pharaoh", and transmit the new response information to the mobile terminal device 120. Here, the new response message is broadcast to the user via the voice output interface 127. Further, when the user's response is a positive answer such as "Yes", similarly, the voice sampling module 124 can receive and The voice signal is transmitted to the server 130 for the voice understanding module 132 to parse. After the speech understanding module 132 finishes parsing, a dialing command information is recorded in the response information and transmitted to the mobile terminal device 120. At this time, the communication module 128 queries the phone number of the "Pharaoh" according to the contact information recorded in the phone database to establish a call connection between the mobile terminal device 120 and another electronic device, that is, Dial to "Pharaoh."

In other embodiments, in addition to the voice control system 100 described above, the voice operation system 200 or other similar system may be used to perform the above operation method, which is not limited to the above embodiments.

In summary, in the voice control system and method of the embodiment, the auxiliary activation device can wirelessly activate the voice function of the mobile terminal device. Moreover, the shape of the auxiliary starting device may be a "living" item accessible by the user, such as a ring, a watch, an earring, a necklace, an eyeglass, etc., that is, various portable items, or a mounting member. For example, the traveling accessory disposed on the steering wheel is not limited to the above. As a result, it is more convenient to use the auxiliary activation device 110 of the present invention to turn on the voice system in the mobile terminal device 120 compared to the current discomfort of wearing the hands-free headset/microphone.

It should be noted that the server 130 with the voice understanding module may be a network server or a cloud server, and the cloud server may involve the privacy of the user. For example, the user needs to upload a complete address book to the cloud server in order to complete operations related to the address book such as making a call, sending a text message, and the like. Even if the cloud server uses encrypted connection, and it is not saved, it is difficult to eliminate. In addition to the user's superiority. Accordingly, the following provides another voice control method and a corresponding voice interaction system thereof, and the mobile terminal device can perform a voice interaction service with the cloud server without uploading the complete address book. In order to clarify the content of the present invention, the following specific examples are given as examples in which the present invention can be implemented.

4 is a block diagram of a voice interaction system in accordance with an embodiment of the present invention. Referring to FIG. 4, the voice interaction system 400 can include a cloud server 410 and a mobile terminal device 420. The cloud server 410 and the mobile terminal device 420 can be connected to each other. The voice interaction system 400 is a voice interaction service through the cloud server 410. That is, the voice recognition is processed by the cloud server 410 having powerful computing capability, thereby reducing the data processing load of the mobile terminal device 420, and improving the accuracy and recognition speed of the voice recognition.

The mobile terminal device 420 includes a processing unit 422, a communication module 424, a voice system 426, and a storage unit 428. In an embodiment, the mobile terminal device 420 is further configured with a display unit 430. The processing unit 422 is coupled to the communication module 424, the voice system 426, the storage unit 428, and the display unit 430. An address book 429 is further stored in the storage unit 428.

The processing unit 422 is a hardware (for example, a chipset, a processor, or the like) having computing power for controlling the overall operation of the mobile terminal device 420. The processing unit 422 is, for example, a central processing unit (CPU), or other programmable microprocessor (Microprocessor), a digital signal processor (DSP), a programmable controller, and a special application. Application Specific Integrated Circuits (ASIC), programmable logic Programmable Logic Device (PLD) or other similar device.

The communication module 424 is, for example, a network card, which can communicate with the cloud server 410 via wired transmission or wireless transmission. The speech system 426 described above includes at least a microphone such as a microphone to convert the sound into an electrical signal. The storage unit 428 is, for example, a random access memory (RAM), a read-only memory (ROM), a flash memory, or a magnetic disk storage device. )Wait. The display unit 430 is, for example, a liquid crystal display (LCD) or a touch screen with a touch module.

On the other hand, the cloud server 410 is a physical host with powerful computing power, or can be a super virtual computer composed of a group of physical hosts, so as to perform large tasks. Here, the cloud server 410 includes a processing unit 412 and a communication module 414. Here, the communication module 414 of the cloud server 410 is coupled to its processing unit 412. The communication module 414 is configured to communicate with the communication module 424 of the mobile terminal device 420. The communication module 414 is, for example, a network card, which can communicate with the mobile terminal device 420 via wired transmission or wireless transmission.

In addition, the processing unit 412 in the cloud server 410 is a CPU array having more powerful computing capabilities, such as a multi-core CPU or a plurality of CPUs. The processing unit 412 of the cloud server 410 includes, for example, at least the speech understanding module 132 as shown in FIG. The processing unit 412 can parse the voice signal received from the mobile terminal device 420 through the voice understanding module. The cloud server 410 transmits the parsed result to the mobile terminal device 420 through the communication module 414, so that the line The mobile terminal device 420 can perform a corresponding action depending on the result.

The voice exchange process in the voice interaction system will be described below with reference to FIG. 4 described above.

FIG. 5 is a schematic diagram of a voice communication flow for a voice interaction system according to an embodiment of the invention. Referring to FIG. 4 and FIG. 5 simultaneously, in step S501, the first voice signal is received by the voice system 426 in the mobile terminal device 420, and the first voice signal is transmitted to the cloud through the communication module 424 in step S503. Server 410. Here, the mobile terminal device 420 receives the first voice signal from the user, for example, through a component such as a microphone in the voice system 426. For example, if the mobile terminal device 420 is a mobile phone, and the user speaks "call to Pharaoh" to the mobile phone, the voice system 426 will receive the voice signal "calling the Pharaoh" and then pass the communication module. 424 transmits the voice signal "call to Lao Wang" to the cloud server 410. In an embodiment, the voice system 426 can be activated by the auxiliary activation device shown in FIGS. 1 to 3.

Next, in step S505, in the cloud server 410, the processing unit 412 parses the first voice signal using the voice understanding module, and in step S507, the processing unit 412 will obtain the communication target obtained by the first voice signal, It is transmitted to the mobile terminal device 420 through the communication module 414. Taking the content of the first voice signal "calling Pharaoh" as an example, the processing unit 412 of the cloud server 410 can use the voice understanding module to parse the first voice signal, thereby obtaining the communication command and the communication target. That is, the voice understanding module can parse out the first voice signal including "calling" and "pharaoh", according to which the processing unit 412 of the cloud server 410 can determine the communication. The command is a dialing command, and the communication target is "Pharaoh" and transmitted to the mobile terminal device 420 through the communication module 414.

Then, in step S509, in the mobile terminal device 420, the action ends The processing unit 422 of the end device 420 searches the address book 429 in the storage unit 428 according to the communication target, and obtains a selection list conforming to the communication target. For example, the processing unit 422 of the mobile terminal device 420 finds a plurality of contact information with "king" in the process of searching for the address book, thereby generating a selection list and displaying it in the display unit 430 for the user to make a selection.

For example, the selection list is shown in the following table, for example, in the address book. Find contact information that meets the communication target "Pharaoh". In this example, assume that 4 matching contact information is found, and the contact names in the contact information, namely "Wang Cong", "Wang Wu", "Wang Anshi" and "Wang Wei", are written to the selection list. in.

If the user speaks to the mobile terminal device 420, the mobile terminal device 420 receives the second voice signal through the voice system 426 as shown in step S511. While the mobile terminal device 420 receives the second voice signal, the mobile terminal device 420 transmits the second voice signal and the selection list in step S513. The communication module 424 is simultaneously transmitted to the cloud server 410. For example, after the user views the selection list and speaks the content of "1st stroke" or "Wang smart" to the mobile terminal device 420, and forms a second voice signal, the mobile terminal device 420 will use the second voice. The signal is transmitted to the cloud server 410 along with the selection list.

In addition, the user can also freely say other content, that is, regardless of What is said by the user is that as long as the mobile terminal device 420 receives the second voice signal, the second voice signal and the selection list are simultaneously transmitted to the cloud server 410.

It is worth mentioning that in this case, the "complete" address book was not uploaded. To the cloud server 410, only the communication target is uploaded to the cloud server 410 in the form of a "selection list" for the second voice signal analysis. In other words, only "partial" contact information will be uploaded. In an embodiment, the mobile terminal device 420 uploads to the selection list of the cloud server 410 to include only the contact name, not the phone number or other information. The content of the uploaded selection list can be set according to the needs of the user.

In addition, it is worth noting that in this case, the second voice signal and selection The list is simultaneously transmitted to the cloud server 410. Compared with the current communication method that does not need to upload the address book, each voice signal and each list need to be parsed in stages, that is, only one piece of information is included in one step, and the voice exchange method in this case is more For the quick.

Then, in the cloud server 410, the processing unit 412 utilizes voice. The module is understood to parse the second speech signal as shown in step S515. For example, using the voice understanding module to parse out that the content included in the second voice signal is “the third one”, then the cloud The processing unit 412 of the end server 410 can further compare the third contact information in the selection list received from the mobile terminal device 420. Taking Table 1 as an example, the third contact information is “Wang Anshi”.

It is worth noting that through the speech understanding module 132 as shown in FIG. Design, the user does not need to completely tell the content of the selection list as the second voice signal, such as "the first pen king smart", just need to tell the contents of some selection lists, such as "1st pen" or "Wang smart" As the second voice signal, and simultaneously with the selection list uploaded to the voice understanding module 132 of the cloud server, the selected target can be parsed. In other words, the selection list content includes a plurality of item information, and each item information has at least a number and a content corresponding to the number (eg, name, phone number, etc.), and the second voice signal is from a part of the content corresponding to the number or Numbering.

Thereafter, in step S517, the cloud server 410 transmits through its communication module. 414 transmits the communication command and the selection target to the mobile terminal device 420. In other embodiments, after the first voice signal is parsed in step S505, the cloud server 410 may first transmit the communication command to the mobile terminal device 420 for storage, and then transmit the selection target, where the communication command is not limited. Transfer time point.

After the mobile terminal device 420 receives the communication command and the selection target, In step S519, the mobile terminal device 420 transmits a communication operation corresponding to the communication command to the selection target through its processing unit 422. The communication command is, for example, a command for using the address of the address book, such as a dialing instruction or a communication command, and the communication command is obtained by the cloud server 410 based on the first voice signal. For example, if the content of the first voice signal is "call to Pharaoh", the cloud server 410 is called "calling". And it is judged that the communication command is a dialing instruction. For another example, if the content of the first voice signal is “send a message to Pharaoh”, the cloud server 410 determines that the communication command is a communication command by “transmitting the message”. In addition, the above selection target is obtained by the cloud server 410 based on the second voice signal and the selection list. Taking the selection list shown in Table 1 as an example, if the content of the second voice signal is “3rd”, the cloud server 410 can determine that the selection target is “Wang Anshi”. For example, make a call to select a destination, or launch a messaging interface to send a newsletter to a selected destination.

It is to be noted that the mobile terminal device 420 obtains the above step S509. The list of choices you can include only the contact name, not the phone number or other information. Therefore, when the mobile terminal device 420 receives the communication command and the selection target from the cloud server 410, the processing unit 422 of the mobile terminal device 420 extracts the phone number corresponding to the selected target from the address book, and executes the communication command according to the phone number. Corresponding communication action.

In addition, in other embodiments, the mobile terminal device 420 is in the above steps. The selection list obtained by S509 may also include the contact name and phone number, or may include other information. Therefore, in step S515, the processing unit 412 of the cloud server 410 can obtain the telephone number of the selection target based on the second voice signal and the selection list, and in step S517, transmit the communication instruction and the telephone number to the mobile terminal. Device 420. According to this, in step S519, the mobile terminal device 420 executes the communication operation corresponding to the communication command in accordance with the telephone number.

In summary, this case utilizes the selection column generated by simultaneously uploading the first voice. The manner in which the table and the second voice signal are generated to select a target to have powerful computing power The cloud server performs the speech understanding program, and this selection list only contains part of the address book. Therefore, the voice control system of the present case can maintain high processing performance and better security at the same time.

On the other hand, it is worth noting that although the above auxiliary starter solution It is decided that the user cannot immediately touch the mobile terminal device, but the voice system problem is required, so that the user can perform the question and answer with the mobile terminal device through the voice understanding technology. However, in the case where the amplification function is required to be turned on, it is still necessary to activate the sound reinforcement function through the mobile terminal device itself. When the user cannot immediately touch the mobile terminal device, but needs to make the sound amplification function, it is currently required to pass through the mobile terminal device itself. The design to be launched will still cause inconvenience to the user. To this end, the present invention provides a method for turning on the sound amplification function and a corresponding device thereof, so that the user can turn on the sound reinforcement function more conveniently. In order to clarify the content of the present invention, the following specific examples are given as examples in which the present invention can be implemented.

FIG. 6 is a schematic diagram of a system of a mobile terminal device according to an embodiment of the present invention; Figure. Referring to FIG. 6, in the embodiment, the mobile terminal device 600 includes a voice system, an input unit 620, a dialing unit 630, an earpiece 640, a sound amplification device 650, and a processing unit 660. In another embodiment of the present invention, the mobile terminal device 600 may further include an earphone 670. The mobile terminal device 600 can be a mobile phone or other similar electronic device, which is similar to the mobile terminal device 120 of FIG. 1 . For details, refer to the foregoing content, and details are not described herein again. The processing unit 660 is coupled to the voice sampling module 610, the input unit 620, the dialing unit 630, the earpiece 640, the sound amplification device 650, and the earphone 670. The voice system includes a voice sampling module 610, and the voice sampling module 610 converts the voice into a voice. The voice sampling module 610 can be a microphone or similar electronic component. In other words, the voice sampling module 610 can be regarded as a part of the voice system, and the voice system is similar to the voice system 121 of FIG. 1 . For details, refer to the foregoing content, and details are not described herein. The input unit 620 provides an input operation signal SIO corresponding to the user's operation, and the input unit 620 may be a keyboard, a touch panel, or the like. The dialing unit 630 is configured to control the processing unit 660 to perform a dialing function. The earpiece 640, the sound amplification device 650, and the earphone 670 are used to convert the output speech signal SAO provided by the processing unit 660 into a sound, so that it can be regarded as a sound output interface. The above-described sound amplification device 650 is, for example, a speaker or the like. The earphone 670 described above may be at least one of a wired earphone and a wireless earphone.

As can be seen from the above, the voice function can be turned on by pressing the mobile communication device. The physical button, the manipulation screen or the auxiliary activation device of the present invention. When the voice function is turned on, when the user speaks to the mobile terminal device 600, the voice sampling module 610 can convert the voice into the input voice signal SAI, and the processing unit 660 can respond to the input voice signal SAI. When the information such as the contact name or the phone number is recorded for content matching, when the information in the address book matches the input voice signal SAI, the processing unit 660 can enable the dialing function of the dialing unit 630 and the sound amplification device 650. In order to be connected, the user can talk to the contact person. In detail, the processing unit 660 converts the input speech signal SAI into an input string and compares the input string with information such as a plurality of contact names, a plurality of telephone numbers, and the like in the address book. When the input string matches one of the contact name, the phone number, and the like, the processing unit 660 opens the dialing unit 630. Dial-up feature. Conversely, when the input string does not match the contact names and the phone numbers, the processing unit 660 does not turn on the dialing function of the dialing unit 630.

In other words, in this embodiment, when the processing unit 660 confirms the input voice message When the number SAI matches the content in the address book, the processing unit 660 provides a start signal to automatically turn on the call amplification function of the mobile terminal device 100. In detail, the processing unit 660 automatically provides an activation signal to the sound amplification device 650, and converts the input voice signal SAI into a call transmission data DTC, and transmits the call transmission data DTC to the contact person through the dial-up unit 630 (another mobile terminal) Device, not shown). At the same time, the processing unit 660 receives the call receiving data DRC through the dialing unit 630, and provides the output audio signal SAO to the sound amplifying device 650 according to the call receiving data DRC, to convert the output audio signal SAO into sound, and expands the sound. Output the sound.

It is worth mentioning that, in the current way of starting the sound reinforcement function, it is still It is implemented by means of the mobile terminal device itself, but when the user cannot immediately access the mobile terminal device but needs to use the sound amplification function, the current design will cause inconvenience to the user. Therefore, in the embodiment, when the voice system is turned on, the voice amplification function can be further activated through the voice dialing action, which is convenient for the user to make a call.

In another embodiment, when both the sound amplification device 650 and the earphone 670 are connected to the mobile terminal device 600 (ie, the sound amplification device 650 and the earphone 670 are coupled to the processing unit), if the processing unit 660 is provided as an input. The voice signal SAI, the processing unit 660 can make the earphone 670 talk to the first priority call mode (preset value) according to the user's setting, and the sound amplification device 650 is the second priority call mode. Or, will be amplifying equipment The 650 is set as the first priority call mode (preset value), and the headset 670 call is set as the second priority call mode. The order of the above-described call mode is set because the user may not be able to touch the mobile terminal device 600 immediately, so that the speaker device 670 is used to make a call using the sound amplifying device 650.

In addition, in another embodiment, when the user sends through the input unit 620 When the operation signal SIO is input, it indicates that the user does not have the problem that the mobile terminal device cannot be touched immediately. Therefore, after the processing unit 660 performs the matching of the address data according to the input operation signal SIO, the processing unit 660 and the dialing unit 630 can output the output. The audio signal SAO is transmitted to a sound output interface such as the sound amplification device 650, the earpiece 640 or the earphone 670, and the end is determined by the user's preset output interface (preset value).

For example, when the user speaks to the mobile terminal device, "call the old Wang, at this time, the voice sampling module 610 receives the sound and converts it into an input voice signal SAI, and the input voice signal SAI is analyzed by the voice understanding module to obtain a communication command (for example, a call) and a communication target. (for example: Pharaoh), and then get the selected target (for example: Wang Anshi). Because it is a communication command parsed from "speech", the processing unit 660 automatically provides a start signal to turn on the sound amplifying device 650, so as to facilitate subsequent expansion. That is, after the dial-up unit completes the dial-up, the user can directly talk to the Lao Wang using the sound-amplifying device. Or, in another example, when the user speaks to the mobile terminal device, "answer the call". At this time, the voice sampling module 610 receives the sound and converts it into an input voice signal SAI, and the input voice signal SAI is parsed through the voice understanding module to obtain a communication command (eg, answering a call). The voice" parses the communication command, so the processing unit 660 automatically provides the start signal and turns on the expansion The audio device 650 is provided so that the user can directly talk to the Lao Wang using the sound amplifying device. The configuration manners and related details of the voice understanding module described above have been described in the foregoing embodiments, and details are not described herein again. In addition, regarding the communication target and the final selection target, the implementation manner may adopt the foregoing method using the cloud server or other similar methods, and details are not described herein again. Of course, as described above, when the sound reinforcement device 650 and the earphone 670 coexist, the processing unit 660 can make the earphone 670 talk as the first priority call mode according to the user's setting, and the sound amplification device 650 is the second priority. Call method.

In another example, if the user transmits a display unit similar to that of FIG. 430, when using the button or the touch to select "Wang Anshi" in the address book, since the input operation signal SIO is provided through the input unit 620, the processing unit 660 performs the matching of the address book according to the input operation signal SIO, and through the processing The setting of the unit 660, the dialing unit 630 and the user transmits the output audio signal SAO to the sound output interface such as the sound amplification device 650, the earpiece 640 or the earphone 670, so that the user can talk to Wang Anshi.

According to the above, a call amplification function of a mobile terminal device can be integrated The automatic start method can be. FIG. 7 is a flowchart of a method for automatically starting a call amplification function of a mobile terminal device according to an embodiment of the present invention. Referring to FIG. 7, at the same time, in the present embodiment, it is determined whether the processing unit 660 of the mobile terminal device 600 will turn on the dialing function (step S710). In other words, the input operation signal SIO from the input unit 620 or the input speech signal SAI of the speech sampling module 610 is not necessarily related to dialing, and it is possible to perform other operations. For example, enabling computer functions in a mobile terminal device, or using a voice system to ask for weather, and the like. When the processing unit 660 is based on the input When the input signal determines that the dialing function of the dialing unit 630 is to be enabled, that is, the input signal is related to a dialing action, if the answer of step S710 is YES, step S720 is performed; otherwise, when the processing unit 660 is based on the input signal When it is judged that the dialing function will not be dialed, that is, if the result of the determination in step S710 is "NO", the automatic starting method of the call sounding function is ended.

Next, in step S720, it is determined whether the processing unit 660 receives the Turn on the input voice signal SAI of the dial-up function. When the processing unit 660 receives the input voice signal SAI from the voice sampling module 610 to enable the dialing function, that is, the determination result of step S720 is YES, it is detected whether the processing unit 660 is connected to the earphone 670 (step S730). ). When the processing unit 660 is connected to the earphone 670, that is, the determination result of step S730 is YES, the processing unit 660 automatically provides an activation signal to activate the earphone, and outputs the audio signal SAO to the earphone 670 (step S740); When the unit 660 is not connected to the earphone 670, that is, the determination result of step S730 is "NO", the processing unit 660 automatically provides an activation signal to activate the sound amplification device 650, and outputs the voice signal SAO to the sound amplification device 650 of the mobile terminal device 600. To activate the call amplification function of the mobile terminal device 600 (step S750). It is worth mentioning that when the processing unit 660 receives the input voice signal for opening the dialing function, the above steps 730 to 750 are performed by the user setting the earphone 670 as a priority sound output interface (assuming the sound amplification device 650) This is done in the case where the headphones 670 are connected. In other embodiments, the user can also set the sound amplifying device 650 as a priority sound output interface. Of course, when only one of the earphones 670 and the sound amplification device 650 is connected, the connected device can be set as the priority sound output interface. The above The steps are those skilled in the art, and the corresponding changes can be made according to their needs.

On the other hand, when the processing unit 660 does not receive the input voice signal SAI from the voice sampling module 610 to enable the dialing function, that is, the determination result of step S720 is "NO", it is next detected whether the processing unit 660 is The headset 670 is connected (step S760). In detail, the processing unit 660 does not receive the input voice signal SAI from the voice sampling module 610, but the processing unit will turn on the dialing function again, indicating that the processing unit 660 receives the input operation signal SIO from the input unit 620, and the input operation The signal SIO is related to a dialing action. When the processing unit 660 is connected to the earphone 670, that is, the determination result of step S760 is YES, the processing unit 660 automatically provides an activation signal to activate the earphone 670, and outputs the voice signal SAO to the earphone 670 (step S740). On the other hand, when the processing unit 660 is not connected to the earphone 670, that is, the determination result of the step S760 is "NO", the processing unit 660 provides the output voice signal SAO to one of the sound amplification device and the earpiece according to a preset value (step S770). The order of the above steps is for illustrative purposes, and the embodiment of the present invention is not limited thereto. It is worth mentioning that when the determination in step 760 is YES, the output audio signal SAO will be provided to the earphone 670. The above situation is that the user sets the earphone 670 as a priority sound output interface (assuming the earpiece 640, the sound amplifying device 650) The condition that the earphones 670 are connected. In other embodiments, the user can also set the earpiece 640 or the sound amplifying device 650 as a priority sound output interface. Of course, when only one of the earpiece 640, the sound amplification device 650, and the earphone 670 device is connected, the connected device can be set as the priority sound output interface. The above implementation steps are suitable for those skilled in the art to make corresponding changes according to their needs.

In summary, the mobile terminal device and the automatic activation method of the call amplification function according to the embodiment of the present invention, when the processing unit receives the input voice signal for opening the dial-up function, in addition to the dial-up function, The sound amplification function is automatically turned on to output a voice signal to the sound amplification device. In this way, when the user cannot immediately touch the mobile terminal device, but needs to make the sound amplification function, the sound amplification function can be activated through the voice system to improve the convenience of using the mobile terminal.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the present invention, and any one of ordinary skill in the art can make some changes and refinements without departing from the spirit and scope of the present invention. The scope of the invention is defined by the scope of the appended claims.

Claims (23)

A voice control system includes: an auxiliary activation device for assisting in opening a voice system of a mobile terminal device, the auxiliary activation device comprising a first wireless transmission module; and the mobile terminal device, the mobile terminal device comprising: a second wireless transmission module is matched with the first wireless transmission module; and the voice system is coupled to the second wireless transmission module, wherein when the auxiliary activation device is triggered, the first wireless transmission module The second wireless transmission module of the mobile terminal device is coupled to the voice system of the mobile terminal device via a wireless communication protocol. The voice control system of claim 1, wherein the auxiliary activation device is only used to assist in turning on the voice system of the mobile terminal device, and does not have the functions of a headset, a microphone, or a combination of the two. The voice control system of claim 1, further comprising a hands-free headset connected to the mobile terminal device. The voice control system of claim 1, further comprising a hands-free microphone connected to the mobile terminal device. The voice control system of claim 1, wherein the auxiliary activation device further includes a trigger module coupled to the first wireless transmission module. a voice control system as described in claim 5, wherein When the trigger module is triggered, if the first wireless transmission module is in a sleep mode, the trigger module wakes up the first wireless transmission module, and the first wireless transmission module enters a working mode, and transmits the The wireless communication protocol is coupled to the second wireless transmission module of the mobile terminal device. The voice control system of claim 6, wherein the first wireless transmission module is in a preset time after the first wireless transmission module enters the working mode, and if the triggering module is not triggered, the first wireless transmission The module enters the sleep mode from the working mode, and stops connecting with the second wireless transmission module of the mobile terminal device. The voice control system of claim 1, wherein the auxiliary activation device is a Bluetooth headset. The voice control system of claim 1, wherein the auxiliary starting device is in the form of an ornament. The voice control system of claim 9, wherein the accessory comprises a ring, a watch, an earring, a necklace, and glasses. The voice control system of claim 1, wherein the mobile terminal device uses an Android operating system. An auxiliary activation device for assisting in opening a voice system of a mobile terminal device, the mobile terminal device comprising a first wireless transmission module, and the voice system coupled to the first wireless transmission module, the auxiliary activation device The second wireless transmission module is matched with the first wireless transmission module; and a trigger module is coupled to the second wireless transmission module, wherein when the trigger module is triggered, the second wireless Transmission module through a The line communication protocol is coupled to the first wireless transmission module of the mobile terminal device to activate the voice system of the mobile terminal device. The auxiliary starting device of claim 12, wherein the auxiliary starting device is only used to assist in opening the voice system of the mobile terminal device, and does not have the function of a headset, a microphone or a combination of the two. The auxiliary activation device of claim 12, wherein when the trigger module is triggered, if the second wireless transmission module is in a sleep mode, the trigger module wakes up the second wireless transmission module. And causing the second wireless transmission module to enter an operational mode, and connecting to the first wireless transmission module of the mobile terminal device by using the wireless communication protocol. The auxiliary activation device of claim 14, wherein the second wireless transmission module is in a preset time after the second wireless transmission module enters the working mode, and if the trigger module is not triggered, the second wireless transmission The module enters the sleep mode from the working mode, and stops connecting with the first wireless transmission module of the mobile terminal device. The auxiliary starting device of claim 12, wherein the auxiliary starting device is a Bluetooth headset. The auxiliary starting device of claim 12, wherein the auxiliary starting device has a shape of an ornament. The auxiliary starting device of claim 17, wherein the accessory comprises a ring, a watch, an earring, a necklace, and glasses. The auxiliary activation device of claim 12, wherein the mobile terminal device uses an Android operating system. A voice control method is applicable to a mobile terminal device and an auxiliary activation device, the auxiliary activation device is configured to assist in starting a voice system of the mobile terminal device, and the auxiliary activation device and the mobile terminal device respectively have a matching one. The first wireless transmission module and the second wireless transmission module, the voice control method includes: the first wireless transmission module receives a trigger signal; activates the first wireless transmission module, and transmits a wireless transmission signal; And the second wireless transmission module receives the wireless transmission signal to activate the voice system. The method of voice control according to claim 20, wherein the auxiliary activation device is only used to assist in opening the voice system of the mobile terminal device, and does not have the functions of a headset, a microphone or a combination of the two. The method of voice control according to claim 20, wherein the auxiliary activation device is a Bluetooth headset. The method of voice control according to claim 20, wherein the mobile terminal device uses an Android operating system.