CN108810198B - Voice control method, device, electronic device and computer readable medium - Google Patents

Abstract

The embodiment of the application provides a sound production control method and device, an electronic device and a computer readable medium, and belongs to the technical field of electronic devices. The method comprises the following steps: acquiring environmental noise of the electronic device in the current environment based on the acquired sounding request; acquiring the sound intensity of the environmental noise; setting vibration parameters of the vibration component according to the sound intensity; and controlling the vibration component to vibrate according to the set vibration parameters. The electronic device can not only sound through the vibration mode of the screen or the shell, but also avoid the sound holes arranged on the electronic device, and can adjust the vibration of the vibration component according to the sound intensity of the environmental noise by considering the influence of the environmental noise on the sound emitted by the electronic device, thereby adjusting the vibration sound.

Description

Voice control method, device, electronic device and computer readable medium

technical field

The present application relates to the technical field of electronic devices, and more particularly, to a sound production control method, device, electronic device, and computer-readable medium.

Background technique

Currently, electronic devices, such as mobile phones, tablet computers, etc., emit sound through speakers to output sound signals. However, the arrangement of the speaker occupies a large design space, so that the electronic device does not conform to the direction of thin design.

SUMMARY OF THE INVENTION

The present application proposes a voice control method, device, electronic device and computer-readable medium to improve the above-mentioned defects.

In a first aspect, an embodiment of the present application provides a sound production control method, which is applied to an electronic device. The electronic device includes a vibrating component capable of vibrating and producing sound, and the vibration component is at least one of a screen or a housing of the electronic device. . The method includes: collecting the environmental noise in the current environment of the electronic device based on the acquired voice request; acquiring the sound intensity of the environmental noise; setting the vibration parameters of the vibration component according to the sound intensity; The vibration parameter controls the vibration of the vibrating component.

In a second aspect, an embodiment of the present application further provides a sound production control device, which is applied to an electronic device. The electronic device includes a vibrating component capable of vibrating and producing sound, and the vibration component is at least one part of a screen or a casing of the electronic device. One. The device includes: a collection unit, an acquisition unit, a setting unit and a sounding unit. A collection unit, configured to collect environmental noise in the current environment of the electronic device based on the acquired voice request. an acquiring unit, configured to acquire the sound intensity of the environmental noise. A setting unit, configured to set vibration parameters of the vibration component according to the sound intensity. The sound-emitting unit is used to control the vibration component to emit sound according to the set vibration parameters.

In a third aspect, an embodiment of the present application further provides an electronic device, which is characterized by comprising a vibrating component capable of vibrating and producing sound, the vibrating component being at least one of a screen or a casing of the electronic device; further comprising a memory and a A processor, the memory coupled to the processor. The memory stores instructions that, when executed by the processor, cause the processor to perform the following operations: based on the acquired utterance request, collect environmental noise in the current environment of the electronic device; acquire the environment the sound intensity of the noise; set the vibration parameters of the vibration component according to the sound intensity; control the vibration of the vibration component according to the set vibration parameters.

In a fourth aspect, an embodiment of the present application further provides a computer-readable medium having program code executable by a processor, where the program code enables the processor to execute the above method.

Embodiments of the present application provide a sound emission control method, device, electronic device, and computer-readable medium. After acquiring the sound emission request, based on the acquired sound emission request, the environmental noise in the current environment of the electronic device is collected, and then, the The sound intensity of the environmental noise, and the vibration of the vibration part is controlled according to the sound intensity. Therefore, not only can sound be produced by the vibration of the screen or the casing, it is possible to avoid setting sound holes on the electronic device, but also the influence of environmental noise on the sound emitted by the electronic device can be considered, and the sound intensity of the environmental noise can be adjusted according to the sound intensity. The vibration of the vibrating part, thereby adjusting the vibration to sound.

Other features and advantages of the embodiments of the present application will be set forth in the description that follows, and in part will be apparent from the description, or learned by practice of the embodiments of the present application. The objectives and other advantages of the embodiments of the application may be realized and attained by the structure particularly pointed out in the written description, claims, and drawings.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings that are used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained from these drawings without creative effort.

FIG. 1 shows a schematic structural diagram of an electronic device provided by an embodiment of the present application from a first perspective;

FIG. 2 shows a schematic structural diagram of an electronic device provided by an embodiment of the present application from a second perspective;

FIG. 3 shows a method flow chart of the sound production control method provided by the first embodiment of the present application;

FIG. 4 shows a method flow chart of the sound production control method provided by the second embodiment of the present application;

FIG. 5 shows a schematic diagram of a call interface provided by an embodiment of the present application;

Fig. 6 shows the method flow chart of the sound production control method provided by the third embodiment of the present application;

FIG. 7 shows a method flow chart of the sound production control method provided by the fourth embodiment of the present application;

FIG. 8 shows a schematic diagram of a vibration area provided by an embodiment of the present application;

FIG. 9 shows a block diagram of a module of a sound emission control device provided by an embodiment of the present application;

FIG. 10 shows a module block diagram of an electronic device provided by an embodiment of the present application for executing the method provided by the embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application generally described and illustrated in the drawings herein may be arranged and designed in a variety of different configurations. Thus, the following detailed description of the embodiments of the application provided in the accompanying drawings is not intended to limit the scope of the application as claimed, but is merely representative of selected embodiments of the application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative work fall within the protection scope of the present application.

It should be noted that like numerals and letters refer to like items in the following figures, so once an item is defined in one figure, it does not require further definition and explanation in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", etc. are only used to distinguish the description, and cannot be understood as indicating or implying relative importance.

Display screens usually play a role in electronic devices such as mobile phones and tablet computers to display content such as text, pictures, icons, or videos. With the development of touch technology, more and more electronic devices set the display screen to be a touch display screen. In the case of setting a touch display screen, when it is detected that the user is dragging on the touch display screen , click, double-click, slide and other touch operations, it can respond to the user's touch operations.

As users have higher and higher requirements for the clarity and fineness of the displayed content, more electronic devices use larger touch display screens. However, in the process of setting up a touch display screen with a larger size, it is found that functional devices such as a front camera, a proximity light sensor, and an earpiece set at the front end of the electronic device will affect the area that the touch display screen can expand to.

Generally, an electronic device includes a front panel, a back cover, and a frame. The front panel includes the upper forehead area, the middle screen area and the lower key area. Usually, the upper forehead area is provided with functional devices such as the earpiece sound hole and the front camera, the middle screen area is provided with a touch display screen, and the lower key area is provided with one to three physical buttons. With the development of technology, the lower key area is gradually cancelled, and the physical keys originally set in the lower key area are replaced by virtual keys in the touch screen.

The earpiece sound hole set in the upper forehead area is more important for the function support of the mobile phone, and it is not easy to cancel easily, so it is difficult to expand the displayable area of the touch screen to cover the upper forehead area. After a series of studies, the inventor found that the sound can be produced by controlling the vibration of the screen, frame or back cover of the mobile phone, so that the setting of the earpiece sound hole can be cancelled.

Illustratively, please refer to FIGS. 1 and 2, which show an electronic device 100 provided by an embodiment of the present application. 1 is a front view of the electronic device, and FIG. 2 is a side view of the electronic device.

The electronic device 100 includes an electronic body portion 10, the electronic body portion 10 includes a casing 12 and a screen 120 disposed on the casing 12, the casing 12 includes a front panel 125, a rear cover 127 and a frame 126, and the frame 126 is used for The front panel 125 and the rear cover 127 are connected, and the screen 120 is disposed on the front panel 125 .

The electronic device further includes an exciter 131, which is used to drive the vibration part of the electronic device to vibrate. Specifically, the vibration part is at least one of the screen 120 or the casing 12 of the electronic device, that is, the vibration part can It is the screen 120 , the casing 12 , or the combination of the screen 120 and the casing 12 . As an embodiment, when the vibration component is the housing 12 , the vibration component may be the back cover of the housing 12 .

In the embodiment of the present application, the vibration component may be the screen 120 , and the exciter 131 is connected to the screen 120 for driving the screen 120 to vibrate. Specifically, the exciter 131 is attached below the screen 120, and the exciter 131 may be a piezoelectric driver or a motor. As an embodiment, the exciter 131 is a piezoelectric driver. The piezoelectric driver transmits its own deformation to the screen 120 through the action of torque, so that the screen 120 vibrates and emits sound. The screen 120 includes a touch screen 109 and a display panel 111 . The display panel 111 is located below the touch screen 109 , and the piezoelectric driver is attached below the display panel 111 , that is, the side of the display panel 111 away from the touch screen 109 . Piezoelectric drivers include multilayer piezoelectric ceramic sheets. When a multilayer piezoelectric ceramic sheet expands and contracts with sound, it will drive the screen to bend and deform. Repeatedly, the entire screen forms a bending vibration, so that the screen can push the air and generate sound.

As an embodiment, the electronic device 100 includes a detection circuit and a drive circuit, and the detection circuit is configured to collect environmental noise in the current environment of the electronic device based on the acquired voice request, and acquire the sound intensity of the environmental noise, Vibration parameters of the vibrating member are set according to the sound intensity.

The exciter 131 is connected to the drive circuit of the electronic device, and the drive circuit is used to input a control signal value to the exciter 131 according to the vibration parameter to drive the exciter 131 to vibrate, thereby driving the vibrating component to vibrate. Specifically, the driving circuit may be a processor of an electronic device, or may be an integrated circuit capable of generating a driving voltage or current in the electronic device. The drive circuit outputs high and low level drive signals to the exciter 131, and the exciter 131 vibrates according to the drive signal, and the electrical parameters of the drive signals output by the drive circuit are different, which will cause the vibration parameters of the exciter 131 to be different, for example, the drive signal The duty cycle corresponds to the vibration frequency of the exciter 131 , and the amplitude of the driving signal corresponds to the vibration amplitude of the exciter 131 .

In this embodiment of the present application, a plurality of exciters 131 may be evenly distributed on the screen 120, so that the screen 120 is evenly divided into a plurality of areas where sound is produced independently. For example, if the number of exciters is 4, the screen can be divided into 4 square areas along the vertical and horizontal center lines. The 4 exciters are arranged below the 4 square areas, and the 4 The block square areas correspond one-to-one. Of course, the number of exciters is not limited in the embodiments of the present application.

When the screen vibrates and emits sound, the surrounding environment is disturbed by environmental noise, so that the sound heard by the user from the screen vibration is not clear enough. Therefore, in order to solve this technical problem, the embodiment of the present application provides a sound control For the method, please refer to FIG. 3 . The method is used to reduce the influence of ambient noise on the sound of the screen. Specifically, the method includes: S301 to S304 .

S301: Collect environmental noise in the current environment of the electronic device based on the acquired voice request.

Among them, the sound request is the information that the user instructs the electronic device and needs to control the vibration of the screen to sound. As an implementation manner, the voice request may be a reminder message or a voice playback request.

The reminder information includes call reminder information, SMS reminder information, and alarm reminder information, etc., which are used to remind the user that certain events have been triggered. For example, if the call reminder information is used to remind the user that there is an incoming call, the method of the present application may be executed after the reminder information is obtained, but before the sound is emitted, and then, after the vibration parameters are obtained, the screen is controlled to vibrate and sound, so as to emit a sound. Sounds for reminders, for example, ringtones for incoming calls.

As another implementation manner, the voice request may be a request to play voice every time during the process of the electronic device making voice. Then, the method of the embodiment of the present application is used to collect environmental noise and adjust the vibration of the vibrating component in the process of sound production of the electronic device, and then adjust the sound production.

The electronic device is provided with a sound collection device, which may be a microphone provided on the electronic device, and is used to collect environmental noise in the current environment, that is, to convert the sound signal of the environmental noise into a voice signal. Of course, the sound collection device can also be the vibration component itself. If the vibration component includes a casing and a screen, the screen is used to vibrate and produce sound, that is, the vibration is controlled by the exciter to produce sound, and the casing can be used to collect surrounding sounds. In the embodiment of the present application, both sound generation and sound collection can be completed by the screen, and when the screen vibrates and sounds, the sound collection operation is not performed to avoid mutual interference.

Then the vibrating parts, for example, the screen can pick up the sound, the principle is similar to the microphone. The material of the screen can vibrate. If the sound wave of the current ambient noise causes the air pressure to change, the screen will bend as the air pressure changes, and a backplane is set on the bottom of the screen. The backplane acts as a motor of the capacitor, and the screen acts as a capacitor. Due to the vibration of the screen, the other electrode of the screen will change the capacitance between the screen and the backplane, so that the change of the capacitance can be converted into an electrical signal, so as to collect the sound. As an implementation manner, a certain area of the screen can be set as a screen made of flexible material, and the thickness is small enough to be more easily vibrated due to the influence of external sound waves.

S302: Acquire the sound intensity of the ambient noise.

After the environmental noise is collected, the sound characteristics of the environmental noise can be obtained. The sound characteristics include characteristics such as the frequency, sound intensity, or vibration period of the environmental noise, which can be obtained through mathematical models such as spectrum analysis.

S303: Set the vibration parameter of the vibration component according to the sound intensity.

After the sound intensity is acquired, the vibration parameters of the vibrating component are adjusted according to the sound intensity, so that the user can more easily hear the sound emitted by the electronic device in the ambient noise.

As an embodiment, the specific implementation of setting the vibration parameter of the vibration member according to the sound intensity is: setting the vibration amplitude of the vibration member according to the sound intensity, so as to increase the intensity of the sound emitted by the vibration member .

Wherein, the vibration amplitude of the vibrating member can increase the intensity, ie, the loudness, of the sound emitted by the vibrating member, and increasing the vibration amplitude can make the sound louder. Therefore, the intensity of the sound emitted by the vibrating member can be increased by increasing the vibration amplitude.

Specifically, obtain the current volume of the electronic device, that is, the volume pre-set by the electronic device for the voice request. For example, if the voice request is a call request, the call request corresponds to a preset volume, and the preset volume is preset by the user for the call operation. volume, and there is a preset vibration parameter corresponding to the preset volume, the preset vibration parameter is used to emit the preset volume, and the preset vibration parameter includes a preset vibration amplitude, then the preset vibration is used as the current vibration magnitude. Of course, if the vibration component is currently vibrating, the vibration parameters stored in the exciter are directly read to obtain the current vibration amplitude.

Determine whether the sound intensity of the environmental noise is greater than the current volume, if it is greater than, then increase the volume of the sound emitted by the electronic device, specifically, obtain the volume difference between the sound intensity of the environmental noise and the current volume, and determine to increase according to the volume difference Specifically, the corresponding relationship between the volume and the vibration amplitude is pre-stored in the electronic device, and different volumes correspond to different vibration amplitudes. Thus, according to the corresponding relationship, the vibration amplitude to be increased corresponding to the volume difference can be obtained. , and further, obtain the vibration amplitude to be adjusted, and then send the adjusted vibration amplitude to the exciter, so that the exciter controls the vibration of the vibration component according to the adjusted vibration amplitude.

S304: Control the vibration of the vibration component according to the set vibration parameters.

The drive circuit of the electronic device adjusts the drive signal according to the set vibration parameter. For example, if the set vibration parameter is an increased vibration amplitude, the drive circuit increases the level value of the high level of the drive signal. For example, set The latter vibration parameter is the increased vibration frequency, and the drive circuit increases the frequency of the drive signal.

The drive circuit sends the drive signal to the exciter, and the exciter controls the vibration of the vibrating part according to the adjusted drive signal, so that the parameters such as the vibration frequency or amplitude of the vibrating part can be adjusted, so as to change the intensity or frequency of the emitted sound. characteristic information.

In addition, when the electronic device uses the headset to make a call, it is unnecessary to collect ambient noise in the current environment, because the vibration component does not need to vibrate when the user uses the headset to receive the voice from the electronic device. Therefore, based on the acquired voice request, the implementation of collecting the environmental noise in the current environment of the electronic device includes: determining whether the voice request corresponds to a non-headphone call mode; if it corresponds to a non-headphone call mode, collecting the electronic device's Ambient noise in the current environment. Specifically, please refer to FIG. 5 , the method is used to reduce the influence of ambient noise on the screen sound. Specifically, the method includes: S401 to S405.

S401: Determine whether the voice request corresponds to a non-earphone call mode.

Then, the voice request at this time may be a request to answer the call.

When the electronic device receives an incoming call, that is, when the phone ringing or the vibration reminder rings, the electronic device can detect and display the incoming call interface on the screen. On the other hand, the user clicks the answer button in the incoming call interface, so as to establish a call connection between the current SIM card number of the electronic device and the incoming call number. Specifically, the phone state of the electronic device can be monitored through a phone manager in the system of the electronic device, thereby being able to monitor whether the electronic device is in a call mode. The phone manager is an application module in the system of the electronic device, and the user obtains the call status of the electronic device. For example, when the system of the electronic device is the Android system, the phone manager is the TelephonyManager.

The type of the call mode of the electronic device can be determined by detecting several state values of the electronic device. Specifically, to determine whether the electronic device is connected to an earphone, specifically, it can be determined by checking the state of the earphone connection hole of the electronic device. For example, when the earphone connection hole of the electronic device is connected to the earphone, the first state value is returned, and when the connection hole When the inner earphone is pulled out, the second state value is returned, and whether the current electronic device is connected to the earphone can be determined by detecting the first state value and the second state value. Specifically, the android system will send a broadcast when the headset is inserted and unplugged, so the electronic device can determine whether the current electronic device is connected to the headset by monitoring the broadcast. Thereby, it can be determined whether the electronic device is in the headset talk mode.

The monitoring of the handset mode and the hands-free mode can be determined by monitoring the state value of the key used for switching between the handset mode and the hands-free mode. For example, in the call interface shown in FIG. 5 , a hands-free button is displayed, the user clicks the hands-free button, the hands-free button is selected, and the color changes in appearance to indicate that the hands-free button is pressed by the user. The electronic device detects whether the hands-free button is in the selected state, and if so, it is determined that the electronic device is currently in the hands-free mode, and if not, it is determined that the electronic device is currently in the handset mode. It should be noted that the monitoring of the handset mode and the hands-free mode is performed when the electronic device is in the non-earphone call mode.

When the voice request corresponds to the non-earphone call mode, that is, corresponds to the handset mode or the hands-free mode, the electronic device can vibrate and emit sounds by controlling vibrating components such as the screen, so that the user can hear the voice, and then execute S402. If the voice request corresponds to The headset call mode ends this operation.

S402: Collect environmental noise in the current environment of the electronic device.

S403: Acquire the sound intensity of the environmental noise.

S404: Set the vibration parameter of the vibration component according to the sound intensity.

S405: Control the vibration of the vibration component according to the set vibration parameters.

It should be noted that, for parts not described in detail in the above steps, reference may be made to the foregoing embodiments, and details are not described herein again.

In addition, considering the high intensity of environmental noise, simply increasing the intensity of the sound emitted by the electronic device may not be enough to enable the user to clearly hear the sound emitted by the electronic device. Therefore, the frequency of the sound emitted by the electronic device can be adjusted. Specifically, referring to FIG. 6 , the method is used to reduce the influence of ambient noise on the screen sound. Specifically, the method includes: S601 to S605.

S601: Collect environmental noise in the current environment of the electronic device based on the acquired voice request.

S602: Acquire the sound intensity and sound frequency of the environmental noise.

After the voice signal of the environmental noise is collected, the spectrum information of the voice signal is obtained, and the sound intensity and sound frequency of the environmental noise can be obtained.

S603: Set the vibration amplitude of the vibration component according to the sound intensity.

S604: Set the vibration frequency of the vibration component according to the sound frequency.

After the sound frequency is obtained, the frequency region where the sound frequency of the environmental noise is mainly distributed can be obtained, and the vibration frequency of the vibrating component is set according to the frequency region, so that the frequency distribution region of the sound emitted by the vibration component is the same as the sound of the environmental noise. The frequency regions of the main frequency distribution are different, that is, although there is an appropriate overlap, but not exactly the same, there are different regions. For example, the frequency region where the sound frequency of environmental noise is mainly distributed is 800Hz to 1200Hz, and the vibration frequency of the vibrating part is set to 600Hz to 900Hz, although the frequency of the sound emitted by the environmental noise and the vibrating part in the region of 800Hz to 900Hz has Overlapping, however, the region between 600 Hz and 799 Hz does not overlap, whereby the frequency of the sound emitted by the vibrating member can be made different from the sound frequency of the ambient noise.

S605: Control the vibration component to emit sound according to the set vibration frequency and vibration amplitude.

The sound emitted by the vibrating part is controlled by controlling the vibration of the exciter. Specifically, the control of the vibration frequency of the vibrating part can be that the drive circuit adjusts the frequency of the output drive signal. For example, if the drive signal is a square wave signal, the control The period of the square wave signal can control the frequency of the driving signal, and the exciter outputs mechanical energy at a high level to drive the screen to vibrate, but does not vibrate at a low level. The higher the frequency of the signal, the more frequently the exciter drives the screen to vibrate, resulting in a higher frequency of the sound produced by the screen vibration, and vice versa.

It should be noted that, if the frequency distribution of the sound emitted by the above-mentioned electronic device and the frequency distribution of the environmental noise have an overlapping area, it is possible to set the vibration frequency of the vibrating component to have the highest vibration amplitude in the non-overlapping area, so as to make the vibrating component vibrate. The emitted sound is mainly concentrated in the non-overlapping region, that is, the main lobe of the sound emitted by the vibration is located in the non-overlapping region. For example, the vibration frequency of the above-mentioned vibrating component is set to 600Hz to 900Hz, and the frequency region where the sound frequency of environmental noise is mainly distributed is 800Hz to 1200Hz, and the sound emitted by the vibration is mainly concentrated between 600Hz and 799Hz.

It should be noted that, for parts not described in detail in the above steps, reference may be made to the foregoing embodiments, and details are not described herein again.

Furthermore, the vibration component can also be divided into multiple areas, and each area corresponds to an exciter, so as to control the vibration sound of the electronic device more flexibly. For example, the more vibration areas used for this vibration sound, The higher the volume, specifically, please refer to FIG. 7 , the method is used to reduce the influence of ambient noise on the screen sound. Specifically, the method includes: S701 to S704.

S701: Collect environmental noise in the current environment of the electronic device based on the acquired voice request.

S702: Acquire the sound intensity of the ambient noise.

S703: Determine the vibration area of the vibration component according to the sound intensity.

In the embodiment of the present application, the vibration component is a screen, then the screen is divided into a plurality of vibration areas, as shown in FIG. Control the vibration of the screen area in the vibration area, and by reasonably setting the contact area between the exciter and the screen so that the contact area is too small relative to the vibration area, there can be no vibration interference or vibration interference between adjacent vibration areas. can be ignored.

The vibration parameters corresponding to each vibration area may be the same or different. However, each vibration area corresponds to a vibration threshold, for example, the upper limit of the vibration amplitude or the upper limit of the vibration frequency. The more zones, the theoretically higher maximum intensity and frequency of the sound produced.

As an embodiment, the corresponding relationship between the sound intensity and the vibration area may be stored in the electronic device in advance. Specifically, the electronic device stores the corresponding relationship between the sound intensity of the environmental noise and the vibration area. One sound front corresponds to one or more For example, the intensity A corresponds to the vibration area Q1, and the intensity B corresponds to the vibration areas Q1 and Q2. That is to say, when the sound intensity of the environmental noise is the intensity A, the vibration area Q1 participates in the vibration sound, and the sound of the environmental noise When the intensity is intensity B, the vibration areas Q1 and Q2 participate in the vibration sound, and the vibration area participating in the vibration sound is the vibration area of the set vibration component. Therefore, according to the corresponding relationship between the sound intensity of the environmental noise and the vibration area, the vibration area corresponding to the collected sound intensity of the environmental noise in the current environment of the electronic device can be determined.

As another implementation manner, the implementation manner of determining the vibration area of the vibration component according to the sound intensity is:

Determine whether the sound intensity is greater than a preset value. The preset value is a preset sound intensity value, and the sound intensity value may be the sound intensity of the sound emitted by the current electronic device, for example, the system volume of the current electronic device or the application program corresponding to the sound request. The set volume may also be the above-mentioned preset volume. The preset value corresponds to the preset vibration area of the vibration component, and the corresponding preset vibration area is used to emit the volume corresponding to the preset value.

If the sound intensity of the collected environmental noise is greater than the preset value, the preset vibration area is increased, and the increased preset vibration area is used as the vibration area for vibrating sound this time, that is, increasing Participate in the vibration area of this vibration sound to make the sound of the vibration sound bigger.

For example, the preset vibration areas are the vibration areas Q1 and Q2, that is, corresponding to two vibration areas, then when the sound intensity of the collected environmental noise is greater than the preset value, the preset vibration areas are modified to the vibration areas Q1, Q2 and Q3, namely Corresponding to three vibration areas, the vibration areas Q1, Q2 and Q3 are used as the vibration areas set this time.

For another example, the preset vibration areas are vibration areas Q2, Q3 and Q4, that is, corresponding to three vibration areas, then when the sound intensity of the collected environmental noise is less than the preset value, the preset vibration areas are modified to vibration areas Q2 and Q3, That is, two vibration areas are corresponding, and the vibration areas Q2 and Q3 are used as the vibration areas set this time.

Therefore, when the sound intensity of the environmental noise is high, more vibration areas can be controlled to vibrate and sound, thereby increasing the volume of the sound emitted by the electronic device, so that the user can hear the sound emitted by the electronic device more clearly. When the sound intensity of the environmental noise is low, less vibration areas are controlled to vibrate and emit sound, which can reduce the power consumption of the electronic device while ensuring that the sound emitted by the electronic device can be heard clearly by the user. It should be noted that when the sound intensity of the collected environmental noise is less than the preset value, the preset vibration area may remain unchanged without changing, or the preset vibration may be reduced for the consideration of energy consumption and the life of the screen. area.

In addition, in order to avoid that after adjusting the preset vibration area, even if the environmental noise does not change much, the vibration area will still be adjusted, resulting in too frequent adjustment. Therefore, the electronic device records the sound intensity of the environmental noise collected this time. After adjusting the vibration area, the sound intensity of the environmental noise is collected next time, and the change range from the sound intensity of the environmental noise collected last time is obtained. If the change range is smaller than the preset value, the determination based on the sound intensity is no longer performed. Operation of the vibrating region of the vibrating member. The preset value is set according to requirements and is used to indicate that the variation range is small, and the variation range may be the absolute value of the difference between the two sound intensities.

S704: Control the vibration region of the vibration component to vibrate and emit sound.

It should be noted that, for parts not described in detail in the above steps, reference may be made to the foregoing embodiments, and details are not described herein again.

Please refer to FIG. 9 , which shows a sound emission control device 900 provided by an embodiment of the present application. The device is used to reduce the influence of environmental noise on screen sound production. Specifically, the device includes: a collection unit 901 , an acquisition unit 902 , and a setting unit 903 and sounding unit 904.

The collection unit 901 is configured to collect environmental noise in the current environment of the electronic device based on the acquired voice request.

The obtaining unit 902 is configured to obtain the sound intensity of the environmental noise.

A setting unit 903 is configured to set vibration parameters of the vibration component according to the sound intensity.

The sound generating unit 904 is configured to control the vibration component to emit sound according to the set vibration parameters.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, for the specific working process of the above-described devices and units, reference may be made to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

Please refer to FIG. 1 again. Based on the above method and device, an embodiment of the present application further provides an electronic device 100 .

Exemplarily, the electronic device 100 may be any one of various types of computer system devices that are mobile or portable and perform wireless communication (only one form is exemplarily shown in FIG. 1 ). Specifically, the electronic device 100 may be a mobile phone or a smart phone (eg, iPhone TM-based, Android TM-based phones), portable game devices (eg Nintendo DS TM, PlayStation Portable TM, Gameboy Advance TM, iPhone TM), laptop laptops, PDAs, portable Internet devices, music players, and data storage devices, other handheld devices and such as watches, earphones, pendants, earphones, etc. The electronic device 100 can also be other wearable devices (eg, such as electronic glasses, electronic Clothing, electronic bracelets, electronic necklaces, electronic tattoos, head-mounted devices (HMDs) for electronic devices or smart watches).

The electronic device 100 may also be any of a number of electronic devices including, but not limited to, cellular phones, smart phones, other wireless communication devices, personal digital assistants, audio players, other media players, music recorders , video recorders, cameras, other media recorders, radios, medical equipment, vehicle transportation equipment, calculators, programmable remote controls, pagers, laptops, desktop computers, printers, netbooks, personal digital assistants (PDAs), portable Multimedia players (PMP), Moving Picture Experts Group (MPEG-1 or MPEG-2) Audio Layer 3 (MP3) players, portable medical devices and digital cameras and combinations thereof.

In some cases, the electronic device 100 may perform various functions (eg, play music, display video, store pictures, and receive and send phone calls). If desired, the electronic device 100 may be a portable device such as a cellular phone, media player, other handheld device, wristwatch device, pendant device, handset device, or other compact portable device.

The electronic device 100 shown in FIG. 1 includes an electronic body part 10 , and the electronic body part 10 includes a casing 12 and a screen 120 disposed on the casing 12 . The casing 12 can be made of metal, such as steel or aluminum alloy. In this embodiment, the screen 120 usually includes the display panel 111 , and may also include a circuit for responding to a touch gesture performed on the display panel 111 , and the like. The display panel 111 may be a liquid crystal display panel (Liquid Crystal Display, LCD). In some embodiments, the display panel 111 is a touch screen 109 at the same time.

Please refer to FIG. 10 at the same time. In an actual application scenario, the electronic device 100 can be used as a smart phone terminal. In this case, the electronic body 10 usually includes one or more (only shown in the figure). a) processor 102 , memory 104 , RF (Radio Frequency, radio frequency) module 106 , audio circuit 110 , sensor 114 , input module 118 , and power module 122 . Those skilled in the art can understand that the structure shown in FIG. 10 is only for illustration, and does not limit the structure of the electronic body portion 10 . For example, the electronic body portion 10 may also include more or fewer components than those shown in FIG. 10, or have a different configuration than that shown in FIG. 1 .

Those skilled in the art can understand that, with respect to the processor 102, all other components belong to peripheral devices, and the processor 102 and these peripheral devices are coupled through a plurality of peripheral device interfaces 124. The peripheral interface 124 can be implemented based on the following standards: Universal Asynchronous Receiver/Transmitter (UART), General Purpose Input/Output (GPIO), Serial Peripheral Interface (Serial Peripheral Interface) , SPI), Inter-Integrated Circuit (I2C), but not limited to the above standards. In some examples, the peripheral interface 124 may only include a bus; in other examples, the peripheral interface 124 may also include other elements, such as one or more controllers, for example, for connecting the display panel 111's display controller or a memory controller for connecting to memory. In addition, these controllers can also be separated from the peripheral interface 124 and integrated into the processor 102 or corresponding peripherals.

The memory 104 can be used to store software programs and modules, and the processor 102 executes various functional applications and data processing by running the software programs and modules stored in the memory 104 . The memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory located remotely from the processor 102, and these remote memories may be connected to the electronic body 10 or the screen 120 via a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

The RF module 106 is used for receiving and sending electromagnetic waves, realizing mutual conversion between electromagnetic waves and electrical signals, so as to communicate with a communication network or other devices. The RF module 106 may include various existing circuit elements for performing these functions, eg, antennas, radio frequency transceivers, digital signal processors, encryption/decryption chips, Subscriber Identity Module (SIM) cards, memory, etc. . The RF module 106 can communicate with various networks such as the Internet, an intranet, a wireless network, or with other devices through a wireless network. The aforementioned wireless network may include a cellular telephone network, a wireless local area network, or a metropolitan area network. The above-mentioned wireless network can use various communication standards, protocols and technologies, including but not limited to Global System for Mobile Communication (GSM), Enhanced Data GSM Environment (EDGE), wideband code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Wireless Fidelity (Wire ess, Fidelity) , WiFi) (such as IEEE 802.10A, IEEE 802.11b, IEEE802.11g and/or IEEE 802.11n), Internet telephony (Voice over internet protocal, VoIP), Worldwide Interoperability for Microwave Access, Wi-Max), other protocols for mail, instant messaging, and short messaging, and any other suitable communication protocols, even those that are not currently being developed.

The audio circuit 110 , the sound jack 103 and the microphone 105 together provide an audio interface between the user and the electronic body 10 or the screen 120 . Specifically, the audio circuit 110 receives sound data from the processor 102, converts the sound data into electrical signals, and transmits the electrical signals to the exciter 131, so that the audio circuit 110 can be used as the above-mentioned driving circuit. The electric signal is used as the driving signal of the exciter 131, and the exciter 131 controls the vibration of the vibrating component according to the electric signal, thereby converting the sound data into sound waves that can be heard by the human ear. The audio circuit 110 also receives electrical signals from the microphone 105, converts the electrical signals into sound data, and transmits the sound data to the processor 102 for further processing. Audio data may be obtained from the memory 104 or through the RF module 106. In addition, audio data may also be stored in the memory 104 or transmitted through the RF module 106 .

The sensor 114 is disposed in the electronic body 10 or in the screen 120 , and examples of the sensor 114 include, but are not limited to, a light sensor, a pressure sensor, an acceleration sensor 114F, a proximity sensor 114J, and other sensors.

Specifically, the light sensor may include a light sensor. The light sensor can adjust the brightness of the screen according to the light in the environment where the electronic device is located. For example, the screen will be bright in a well-lit place, and conversely, if it is in a dark place, the screen will be darker (also related to the screen brightness setting), which protects the eyes and saves power.

Among them, the pressure sensor can detect the pressure generated by pressing on the electronic device 100 . That is, the pressure sensor detects the pressure generated by the contact or pressing between the user and the electronic device, for example, the pressure generated by the contact or pressing between the user's ear and the electronic device. Therefore, the pressure sensor can be used to determine whether contact or pressing occurs between the user and the electronic device 100, and the magnitude of the pressure.

Please refer to FIG. 1 again. Specifically, in the embodiment shown in FIG. 1 , the light sensor and the pressure sensor are disposed adjacent to the display panel 111 . The light sensor can turn off the display output of the processor 102 when an object approaches the screen 120, for example, when the electronic body 10 moves to the ear.

As a kind of motion sensor, the acceleration sensor 114F can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when stationary, and can be used for applications that recognize the posture of the electronic device 100 (such as horizontal and vertical orientation). screen switching, related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc. In addition, the electronic body 10 can also be configured with other sensors such as gyroscopes, barometers, hygrometers, thermometers, etc., which will not be repeated here.

In this embodiment, the input module 118 may include the touch screen 109 disposed on the screen 120, and the touch screen 109 may collect the user's touch operations on or near it (for example, the user uses a finger, a stylus, etc. A suitable object or accessory is operated on or near the touch screen 109 ), and the corresponding connection device is driven according to a preset program. Optionally, the touch screen 109 may include a touch detection device and a touch controller. Wherein, the touch detection device detects the touch orientation of the user, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, and sends the signal to the touch controller. The touch information is converted into contact coordinates, and then sent to the processor 102, and the commands sent by the processor 102 can be received and executed. In addition, the touch detection function of the touch screen 109 can be realized by various types such as resistive type, capacitive type, infrared ray and surface acoustic wave.

The screen 120 is used to display the information input by the user, the information provided to the user, and various graphical user interfaces of the electronic body 10. These graphical user interfaces can be composed of graphics, text, icons, numbers, videos, and any of them. In one example, the touch screen 109 can be disposed on the display panel 111 to form a whole with the display panel 111 .

The power module 122 is used to provide power supply to the processor 102 and other components. Specifically, the power module 122 may include a power management system, one or more power sources (such as batteries or AC power), a charging circuit, a power failure detection circuit, an inverter, a power status indicator, and any other components related to the electronic body. components related to the generation, management and distribution of power within the unit 10 or the screen 120 .

The electronic device 100 further includes a locator 119, and the locator 119 is used to determine the actual location where the electronic device 100 is located. In this embodiment, the locator 119 uses a positioning service to realize the positioning of the electronic device 100. The positioning service should be understood as obtaining the position information (such as latitude and longitude coordinates) of the electronic device 100 through a specific positioning technology ), a technology or service that marks the location of the located object on an electronic map.

In summary, the embodiments of the present application provide a voice control method, device, electronic device, and computer-readable medium. After acquiring the voice request, based on the acquired voice request, the environment in the current environment of the electronic device is collected. Then, the sound intensity of the environmental noise is obtained, and the vibration part is controlled to vibrate according to the sound intensity. Therefore, not only can sound be produced by the vibration of the screen or the casing, it is possible to avoid setting sound holes on the electronic device, but also the influence of environmental noise on the sound emitted by the electronic device can be considered, and the sound intensity of the environmental noise can be adjusted according to the sound intensity. The vibration of the vibrating part, thereby adjusting the vibration to sound.

In the description of this specification, description with reference to the terms "one embodiment," "some embodiments," "example," "specific example," or "some examples", etc., mean specific features described in connection with the embodiment or example , structure, material or feature is included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, those skilled in the art may combine and combine the different embodiments or examples described in this specification, as well as the features of the different embodiments or examples, without conflicting each other.

In addition, the terms "first" and "second" are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implying the number of indicated technical features. Thus, a feature delimited with "first", "second" may expressly or implicitly include at least one of that feature. In the description of the present application, "plurality" means at least two, such as two, three, etc., unless expressly and specifically defined otherwise.

Any description of a process or method in the flowcharts or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing a specified logical function or step of the process , and the scope of the preferred embodiments of the present application includes alternative implementations in which the functions may be performed out of the order shown or discussed, including performing the functions substantially concurrently or in the reverse order depending upon the functions involved, which should It is understood by those skilled in the art to which the embodiments of the present application belong.

The logic and/or steps represented in flowcharts or otherwise described herein, for example, may be considered an ordered listing of executable instructions for implementing the logical functions, may be embodied in any computer-readable medium, For use with, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a system including a processor, or other system that can fetch instructions from and execute instructions from an instruction execution system, apparatus, or apparatus) or equipment. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport the program for use by or in connection with an instruction execution system, apparatus, or apparatus. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections with one or more wiring (electronic devices), portable computer disk cartridges (magnetic devices), random access memory (RAM), Read Only Memory (ROM), Erasable Editable Read Only Memory (EPROM or Flash Memory), Fiber Optic Devices, and Portable Compact Disc Read Only Memory (CDROM). In addition, the computer readable medium may even be paper or other suitable medium on which the program may be printed, as the paper or other medium may be optically scanned, for example, followed by editing, interpretation, or other suitable medium as necessary process to obtain the program electronically and then store it in computer memory.

It should be understood that various parts of this application may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or a combination of the following techniques known in the art: Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, Programmable Gate Arrays (PGA), Field Programmable Gate Arrays (FPGA), etc.

Those skilled in the art can understand that all or part of the steps carried by the methods of the above embodiments can be completed by instructing the relevant hardware through a program, and the program can be stored in a computer-readable storage medium, and the program can be stored in a computer-readable storage medium. When executed, one or a combination of the steps of the method embodiment is included. In addition, each functional unit in each embodiment of the present application may be integrated into one processing module, or each unit may exist physically alone, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules. If the integrated modules are implemented in the form of software functional modules and sold or used as independent products, they may also be stored in a computer-readable storage medium.

The above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, and the like. Although the embodiments of the present application have been shown and described above, it should be understood that the above embodiments are exemplary and should not be construed as limitations to the present application. Embodiments are subject to variations, modifications, substitutions and variations.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand: it can still be Modifications are made to the technical solutions described in the foregoing embodiments, or some technical features thereof are equivalently replaced; and these modifications or replacements do not drive the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions in the embodiments of the present application.

Claims (8)

1. A sound production control method is applied to a mobile terminal, the mobile terminal comprises a vibration component capable of vibrating to produce sound, the vibration component is a screen of the mobile terminal, a back plate is positioned on the bottom surface of the screen, the back plate is used as one electrode of a capacitor, and the screen is used as the other electrode of the capacitor, and the method comprises the following steps:

acquiring environmental noise of the mobile terminal in the current environment through the acquired change of the capacitance value of the capacitor under the condition that the screen does not vibrate and sound based on the acquired sound production request;

acquiring the sound intensity and the sound frequency of the environmental noise;

increasing the vibration amplitude of the vibration member according to the sound intensity;

setting the vibration frequency of the vibration component according to the sound frequency, wherein the vibration frequency is different from the sound frequency, a non-overlapping area exists between the sound frequency and the vibration frequency, and the vibration amplitude corresponding to the vibration frequency in the non-overlapping area is the highest;

and controlling the vibration component to emit sound according to the set vibration frequency and the set vibration amplitude, so that the frequency of the sound emitted by the vibration component is different from the sound frequency of the environmental noise.

2. The method of claim 1, wherein the setting of the vibration amplitude of the vibrating member according to the sound intensity; setting a vibration frequency of the vibration member according to the sound frequency; controlling the vibration component to make a sound according to the set vibration frequency and the set vibration amplitude, and the method comprises the following steps:

determining a vibration region of the vibration member according to the sound intensity;

setting a vibration frequency of a vibration area of the vibration member according to the sound frequency;

and controlling the vibration area of the vibration component to vibrate and sound.

3. The method of claim 2, wherein said determining a vibration region of said vibrating component from said sound intensity comprises:

judging whether the sound intensity is larger than a preset value or not, wherein the preset value corresponds to a preset vibration area of the vibration component;

if the vibration area is larger than the preset value, increasing the preset vibration area, and taking the increased preset vibration area as the vibration area for vibration sounding;

and if the preset vibration area is smaller than the preset value, reducing the preset vibration area, and taking the reduced preset vibration area as the vibration area for vibration sounding.

4. The method of claim 2, wherein said setting a size of a vibration region of the vibration member according to the sound intensity comprises:

and determining a vibration area corresponding to the acquired sound intensity of the environmental noise in the current environment of the mobile terminal according to the preset corresponding relation between the sound intensity of the environmental noise and the vibration area.

5. The method according to any one of claims 1 to 4, wherein the acquiring, based on the acquired sounding request, ambient noise in the current environment of the mobile terminal through the acquired capacitance change between the screen and the back panel comprises:

determining whether the request to speak corresponds to a non-headset mode of conversation;

and if the mobile terminal corresponds to the non-earphone call mode, acquiring the environmental noise of the mobile terminal in the current environment through the acquired capacitance change between the screen and the back plate.

6. The utility model provides a vocal controlling means, its characterized in that is applied to mobile terminal, mobile terminal is including the vibration part that can vibrate the sound production, the vibration part does mobile terminal's screen, a backplate are located the bottom surface of screen, the backplate is as an electrode of a electric capacity, the screen is as another electrode of electric capacity, the device includes:

the acquisition unit is used for acquiring the environmental noise of the mobile terminal in the current environment through the acquired capacitance change under the condition that the screen does not vibrate and sound based on the acquired sound production request;

an acquisition unit configured to acquire a sound intensity and a sound frequency of the environmental noise;

a setting unit configured to set a vibration amplitude of the vibration member according to the sound intensity, and set a vibration frequency of the vibration member according to the sound frequency, the vibration frequency being different from the sound frequency, a non-overlapping region being present between the sound frequency and the vibration frequency, and the vibration amplitude corresponding to the vibration frequency located in the non-overlapping region being highest;

and the sound production unit is used for controlling the vibration component to produce sound according to the set vibration frequency and the set vibration amplitude, so that the frequency of the sound produced by the vibration component is different from the sound frequency of the environmental noise.

7. A mobile terminal is characterized by comprising a vibration component capable of vibrating and sounding, wherein the vibration component is a screen of the mobile terminal, a back plate is positioned on the bottom surface of the screen, the back plate is used as one electrode of a capacitor, and the screen is used as the other electrode of the capacitor; further comprising a memory and a processor, the memory coupled with the processor; the memory stores instructions that, when executed by the processor, cause the processor to perform the method of any of claims 1-5.

8. A computer-readable medium having program code executable by a processor, wherein the program code causes the processor to perform the method of any one of claims 1-5.

Images