CN114400003A

CN114400003A - Control method and system for automatically switching microphones, electronic equipment and storage medium

Info

Publication number: CN114400003A
Application number: CN202210022173.8A
Authority: CN
Inventors: 顾文彪
Original assignee: Beijing Zhijian Technology Co ltd
Current assignee: Beijing Zhijian Technology Co ltd
Priority date: 2022-01-10
Filing date: 2022-01-10
Publication date: 2022-04-26
Anticipated expiration: 2042-01-10
Also published as: CN114400003B

Abstract

The invention provides a control method, a system, electronic equipment and a storage medium for automatically switching microphones, wherein the method comprises the following steps: performing mode detection by responding to voice starting operation of a user to obtain a detection result; determining to start a vehicle microphone or an external equipment microphone according to the detection result; and voice signals are collected through the started car microphone or the started external equipment microphone. The invention can dynamically switch the car microphone or the external equipment microphone according to the scene requirement, thereby avoiding occupying the car microphone for a long time.

Description

Control method and system for automatically switching microphones, electronic equipment and storage medium

Technical Field

The present invention relates to the field of audio signal technology, and in particular, to a method and system for controlling automatic microphone switching, an electronic device, and a storage medium.

Background

In recent years, with the rapid development of intellectualization, smart devices such as mobile phones and home smart speakers almost have a voice recognition function, which brings great convenience to people.

The sound effect on the car is liked and favored by everybody, but not much to speech recognition function application at present on the car, though install the microphone on some cars, can carry out speech recognition, but user's speech recognition demand changes in a flexible way, if open in the car for a long time microphone be used for detecting user's speech recognition will cause in-car microphone to be taken up for a long time, and the effect that relies on in-car microphone to realize speech recognition only still remains to be improved moreover.

The above drawbacks are expected to be overcome by those skilled in the art.

Disclosure of Invention

Technical problem to be solved

In order to solve the above problems in the prior art, the present invention provides a control method, a system, an electronic device and a storage medium for automatically switching microphones, so as to solve the problem in the prior art that the voice recognition mode is not flexible enough.

(II) technical scheme

In order to achieve the purpose, the invention adopts the main technical scheme that:

in a first aspect, the present invention provides a control method for automatically switching microphones, including:

performing mode detection by responding to voice starting operation of a user to obtain a detection result;

determining to start a vehicle microphone or an external equipment microphone according to the detection result;

and voice signals are collected through the started car microphone or the started external equipment microphone.

In an exemplary embodiment of the present invention, the voice-on operation is triggering an in-vehicle button including an answering phone button or a voice assistant button or calling a voice wake-up word.

In an exemplary embodiment of the present invention, the performing the mode detection in response to a voice-on operation of the user, and obtaining the detection result includes:

and when the voice starting operation is to trigger a phone answering button, determining that the detection result is a call mode.

In an exemplary embodiment of the present invention, the determining to turn on the car microphone or the external device microphone according to the detection result includes:

when the detection result is a call mode, determining to start the car microphone;

and detecting the sound source position through the vehicle microphone, determining to turn on the vehicle microphone closest to the sound source position, and turning off other vehicle microphones.

and when the voice starting operation is to trigger a voice assistant button or call out a wake-up word, determining that the detection result is a voice recognition mode.

when the detection result is in a voice recognition mode, starting a vehicle microphone or an external equipment microphone;

if the car microphone is started, the car microphone also comprises the following parts after voice signals are collected:

sending the collected voice signal to an external device, performing networking recognition on the voice signal through the external device to obtain corresponding information, and sending the corresponding information to the vehicle machine again;

if the microphone of the external equipment is started, directly performing networking recognition on the acquired voice signal and acquiring corresponding information;

In an exemplary embodiment of the present invention, the determining to turn on the car microphone or the external device microphone according to the detection result further includes:

and judging whether the environment sound is contained according to the preliminarily collected voice signal, and if the environment sound is contained, determining to start the vehicle microphone, wherein the environment sound is sound other than the voice signal.

In a second aspect, the present invention further provides a system for automatically switching microphones, comprising:

the mode detection module is used for carrying out mode detection by responding to the voice starting operation of a user to obtain a detection result;

the microphone starting module is used for determining to start the car microphone or the external equipment microphone according to the detection result;

and the signal acquisition module is used for acquiring voice signals through the started vehicle microphone or the started external equipment microphone.

In a third aspect, the present invention also provides an electronic device, including:

a processor;

a memory for storing executable instructions of the processor;

wherein the processor is configured to perform the control method of automatically switching microphones as described in any one of the above.

In a fourth aspect, the present invention also provides a non-transitory computer-readable storage medium, wherein instructions, when executed by a processor of an electronic device, enable the electronic device to perform the control method for automatically switching microphones as described in any one of the above.

(III) advantageous effects

The technical scheme provided by the embodiment of the invention has the following beneficial effects: under the condition that the car machine and external equipment are provided with microphones, the user behavior is detected so as to flexibly start the car machine microphone or the external equipment microphone to collect and process voice signals, and the car machine microphone is prevented from being occupied for a long time.

Drawings

Fig. 1 is a flowchart illustrating steps of a control method for automatically switching microphones according to the present invention;

FIG. 2 is a schematic diagram of a microphone circuit according to an embodiment of the present invention;

fig. 3 is a schematic diagram of a control system for automatically switching microphones according to another embodiment of the present invention;

fig. 4 is a schematic structural diagram of a computer system of an electronic device for implementing an embodiment of the present invention.

Detailed Description

For the purpose of better explaining the present invention and to facilitate understanding, the present invention will be described in detail by way of specific embodiments with reference to the accompanying drawings.

All technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.

Fig. 1 is a flowchart illustrating steps of a control method for automatically switching microphones according to an embodiment of the present invention, as shown in fig. 1, specifically including the following steps:

as shown in fig. 1, in step S110, a mode detection is performed by responding to a voice-on operation of a user to obtain a detection result;

as shown in fig. 1, in step S120, it is determined to turn on the car microphone or the external device microphone according to the detection result;

as shown in fig. 1, in step S130, a voice signal is collected through a car microphone or an external device microphone that is turned on.

Based on the method, under the condition that the car machine and the external equipment are provided with the microphones, the user behavior is detected so as to flexibly start the car machine microphone or the external equipment microphone to collect and process the voice signals, and the car machine microphone is prevented from being occupied for a long time.

The method shown in fig. 1 is described in detail below:

in step S110, a mode detection is performed in response to a voice-on operation of the user, and a detection result is obtained.

In an exemplary embodiment of the present invention, the voice on operation is to trigger an in-vehicle button or to call out a voice wake-up word, where the in-vehicle button includes a phone answering button or a voice assistant button, and may also be other physical buttons or virtual buttons on a touch screen in the vehicle, which have similar functions to those of the phone answering or the voice assistant, and the present invention is not limited in particular. In addition, besides being triggered by an application entity button (the setting position in the vehicle includes but is not limited to a central control host and/or a steering wheel) or a virtual button, voice wake-up can be carried out through a wake-up word of a voice assistant, and a specific wake-up word can be set according to needs, so that the limitation that a user needs to operate manually can be relieved, voice wake-up is directly adopted in the vehicle, and better driving experience and safety are brought to the user.

The scenes that a user needs to use more microphones in the driving process are generally classified into conversation and voice recognition, when the car machine and the external equipment are in a communication connection state, the scenes that the microphone needs to be used can be automatically detected, for example, if the situation that the user triggers a telephone answering button on the car machine or an answering button of a touch screen, the scene is currently in a conversation scene, and the microphone in a conversation mode is correspondingly started according to a detection result. In the call mode, the microphone needs to work with high power consumption for a period of time in the call process, and voice signals in the call are collected.

In an exemplary embodiment of the present invention, this step may also be implemented by using a voice-on operation, and when the voice-on operation is triggering a voice assistant button or calling a wake-up word, the detection result is determined to be a voice recognition mode. The microphone in the voice recognition mode maintains low-power-consumption continuous operation in an un-awakened state, enters high-power-consumption operation after being awakened, collects voice signals, and automatically enters a low-power-consumption state (immediately or within a preset time when the voice signals are not detected) after the voice signals are collected, which is different from a call mode, and the call mode and the voice recognition mode can be switched. For example, if the user is detected to call out a voice wake-up word (e.g., "Small A"), then voice recognition mode is enabled, or the user triggers a voice helper button to also enable voice recognition mode. The method mainly comprises the steps of carrying out recognition and judgment on keywords by detecting voice of a user in a voice recognition mode, switching to a conversation mode if recognized keywords contain specific words (such as 'call XXX for calling', 'call for helping me' and the like), and enabling a microphone to enter a state of continuously working with high power consumption.

It should be noted that the external device in the present invention may be an embedded device, the supported system is not specifically limited, and the external device may communicate with the car machine in a wired or wireless manner.

In step S120, the in-vehicle microphone or the external device microphone is determined to be turned on according to the detection result.

In an exemplary embodiment of the present invention, the step of specifically determining the microphone turning on mode includes:

and when the detection result is in a voice recognition mode, determining to start the car microphone or the external equipment microphone.

The vehicle-mounted microphone can be a single microphone or a microphone array, and the microphone array can be distributed at different positions of front and rear rows in the vehicle, so that the voice of a user can be acquired more effectively and directionally. If the vehicle microphone is a microphone array, detecting the sound source position through the vehicle microphone, determining to turn on the vehicle microphone closest to the sound source position, and turning off other vehicle microphones. For example, the microphone arrays in the vehicle are distributed at the corresponding positions of the front row and the rear row, so that the voice signals can be collected and judged according to the multiple microphone arrays, and then whether the sound source position is in the front row or the rear row is determined.

In the conversation mode, because the microphone continuously works with high power consumption for a period of time, the microphone closest to the sound source on the vehicle is selected to collect the voice signal in the conversation. When a user uses voice to wake up the voice assistant in the vehicle, the external equipment microphone is automatically used, but the source of voice in the voice recognition mode may be in front-row main driving, or in front-row auxiliary driving or rear-row riding position, and in order to better collect voice signals, the external equipment microphone or the vehicle-mounted microphone can be selected to be continuously used or switched according to the position of the sound source. For example, if the detected sound source is only in the front row, the external equipment microphone is continuously used, and if the sound source comprises the rear row position, the voice signal collected by the microphone at the nearest position in the mobile phone microphone array is switched to be clearer.

Fig. 2 is a schematic diagram of a microphone circuit connection provided in an embodiment of the present invention, and as shown in fig. 2, both the in-vehicle microphone 210 and the external device microphone 220 are connected to the processor 230 through interfaces, but the in-vehicle microphone 210 and the external device microphone 220 are not only separately provided with two processing branches in parallel, but may dynamically switch two paths of microphones and select which one or ones of the microphone arrays starts a high power consumption operating state according to processing signals of the processor.

and judging whether the environment sound is contained according to the preliminarily collected voice signal, and if the environment sound is contained, determining to start the vehicle microphone, wherein the environment sound is sound other than the voice signal. Therefore, the microphone closest to the microphone can be used for collecting voice signals, the microphones at other positions can work in a low-power-consumption state, power consumption can be saved, voice signals with the least interference, such as environmental sounds, can be collected, and a better basis is provided for voice collection and subsequent semantic recognition.

In step S130, a voice signal is collected through the turned-on in-vehicle microphone or the turned-on external device microphone.

In the step, the voice signal is collected according to the determined microphone, interference signals are reduced as much as possible according to the collected voice signals, if the scene is not high in recognition accuracy, semantic recognition can be directly carried out without preprocessing the voice signals to obtain recognition results, the processing flow and the power consumption of a processor are reduced, and if the scene is high in recognition accuracy, the voice signals can be preprocessed more quickly to obtain the recognition results.

In summary, the control method for automatically switching microphones provided by the embodiment of the present invention has the following effects:

under the condition that the car machine and external equipment are provided with microphones, the user behavior is detected so as to flexibly start the car machine microphone or the external equipment microphone to collect and process voice signals, and the car machine microphone is prevented from being occupied for a long time. When a user uses a key to trigger the voice assistant in the car, the microphone of the car machine is automatically used, the intention of the user is met, and a better conversation effect is achieved; when a user wakes up the voice assistant by using a voice command in a vehicle, an external microphone is automatically used for voice acquisition and recognition, and the sound source position can be further determined to be switched to a vehicle microphone at a corresponding position for voice signal acquisition under some scenes, namely, the microphone at the closest position is automatically switched to acquire a voice signal, the microphones at other positions can enter a low-power-consumption state to work, so that the power consumption can be saved, the voice signals with the least interference, such as environmental sound, and the like can be acquired, the interference is reduced for voice acquisition and subsequent semantic recognition, the processing speed can be increased, and the processing power consumption is reduced.

In accordance with the above method, fig. 3 is a schematic diagram of a control system for automatically switching microphones according to another embodiment of the present invention, as shown in fig. 3, the system 300 includes: a mode detection module 310, a microphone turn-on module 320, and a signal acquisition module 330.

The mode detection module 310 is configured to perform mode detection by responding to a voice start operation of a user to obtain a detection result; the microphone opening module 320 is configured to determine to open the car microphone or the external device microphone according to the detection result; the signal collecting module 330 is used for collecting voice signals through the turned-on car microphone or the turned-on external device microphone.

The specific implementation process and technical effects of the control system for automatically switching microphones provided by the embodiment of the present invention are described in the above method embodiments, and are not described herein again.

Referring now to FIG. 4, shown is a block diagram of a computer system suitable for use with the electronic device implementing an embodiment of the present invention. The computer system 400 of the electronic device shown in fig. 4 is only an example, and should not bring any limitation to the function and the scope of use of the embodiments of the present invention.

As shown in fig. 4, the computer system 400 includes a Central Processing Unit (CPU)401 that can perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)402 or a program loaded from a storage section 408 into a Random Access Memory (RAM) 403. In the RAM 403, various programs and data necessary for system operation are also stored. The CPU 401, ROM 402, and RAM 403 are connected to each other via a bus 404. An input/output (I/O) interface 405 is also connected to bus 404.

The following components are connected to the I/O interface 405: an input section 406 including a keyboard, a mouse, and the like; an output section 407 including a display device such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage section 408 including a hard disk and the like; and a communication section 409 including a network interface card such as a LAN card, a modem, or the like. The communication section 409 performs communication processing via a network such as the internet. A driver 410 is also connected to the I/O interface 405 as needed. A removable medium 411 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 410 as necessary, so that a computer program read out therefrom is mounted into the storage section 408 as necessary.

In particular, according to an embodiment of the present invention, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the invention include a computer program product comprising a computer program embodied on a computer-readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 409, and/or installed from the removable medium 411. The above-described functions defined in the system of the present application are executed when the computer program is executed by a Central Processing Unit (CPU) 401.

It should be noted that the computer readable medium shown in the present invention can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present invention, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present invention, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units described in the embodiments of the present invention may be implemented by software, or may be implemented by hardware, and the described units may also be disposed in a processor. Wherein the names of the elements do not in some way constitute a limitation on the elements themselves.

As another aspect, the present application also provides a computer-readable medium, which may be contained in the electronic device described in the above embodiments; or may exist separately without being assembled into the electronic device. The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to implement the control method for automatically switching microphones as described in the above embodiments.

For example, the electronic device may implement the following as shown in fig. 1: step S110, performing mode detection by responding to voice starting operation of a user to obtain a detection result; step S120, determining to turn on the car microphone or the external equipment microphone according to the detection result; and step S130, acquiring voice signals through the started car microphone or the started external equipment microphone.

It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the invention. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.

Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiment of the present invention can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the embodiment of the present invention.

Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

Claims

1. A control method for automatically switching microphones is characterized by comprising the following steps:

2. The method of claim 1, wherein the voice on operation is triggering an in-car button or calling a voice wake-up word, and the in-car button comprises an answering phone button or a voice assistant button.

3. The control method for automatically switching microphones as claimed in claim 2, wherein said performing the mode detection in response to the voice-on operation of the user, and obtaining the detection result includes:

4. The method for controlling automatic microphone switching according to claim 3, wherein the determining to turn on the car microphone or the external device microphone according to the detection result comprises:

5. The control method for automatically switching microphones as claimed in claim 2, wherein said performing the mode detection in response to the voice-on operation of the user, and obtaining the detection result includes:

6. The method for controlling automatic microphone switching according to claim 5, wherein the determining to turn on the car microphone or the external device microphone according to the detection result comprises:

7. The method for controlling automatic microphone switching according to any one of claims 1 to 6, wherein the determining to turn on the car microphone or the external device microphone according to the detection result further comprises:

8. A control system for automatically switching microphones, comprising:

9. An electronic device, comprising:

a processor;

a memory for storing executable instructions of the processor;

wherein the processor is configured to execute the control method of automatically switching microphones of any of claims 1 to 7.

10. A non-transitory computer-readable storage medium, wherein instructions in the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the method of controlling automatically switching microphones of any of claims 1 to 7.