CN108055406B - Communication message interaction method and mobile terminal - Google Patents

Abstract

The present invention relates to the technical field of electronic devices, and in particular to a communication message interaction method and a mobile terminal, comprising: a first mobile terminal receives and determines whether a communication message sent by a second mobile terminal is an instant interactive message, the communication message at least includes a voice message, and when the judgment result is yes, detects whether a microphone is in a holding state, and when the detection result is yes, the first mobile terminal sends a communication message to the microphone to trigger the microphone to play the communication message. It can be seen that the implementation of the embodiments of the present invention can improve the convenience of interaction.

Description

A kind of communication message interaction method and mobile terminal

technical field

The present invention relates to the technical field of electronic devices, and in particular, to a communication message interaction method and a mobile terminal.

Background technique

With the continuous popularization of various mobile terminals, many parents can choose to conduct voice conversations with their children through mobile terminals. During the voice conversation, parents usually send voice messages to the child's mobile terminal. If the child is using the microphone device associated with the mobile terminal at this time, the child often needs to put down the microphone device first, and then pick up the mobile terminal to open it. The voice conversation interface, and then click to play the voice message, the interaction process of the entire voice message is cumbersome, which reduces the convenience of interaction.

SUMMARY OF THE INVENTION

The embodiments of the present invention disclose a communication message interaction method and a mobile terminal, which can simplify the communication message interaction process and improve the convenience of interaction.

A first aspect of the embodiments of the present invention discloses a communication message interaction method, and the method includes:

The first mobile terminal receives the communication message sent by the second mobile terminal, and determines whether the communication message is an instant interactive message, and the communication message at least includes a voice message;

When the judgment result is yes, the first mobile terminal detects whether the microphone is in a holding state, and the microphone is pre-connected to the first mobile terminal through a wired connection or a wireless connection;

When the detection result is yes, the first mobile terminal sends the communication message to the microphone to trigger the microphone to play the communication message.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, the method further includes:

If the first mobile terminal detects that the microphone is in a holding state, the first mobile terminal acquires the sound signal of the current environment collected by the microphone;

The first mobile terminal analyzes the sound signal of the current environment to obtain a noise intensity value of the current environment;

The first mobile terminal sends a volume adjustment instruction to the microphone according to the noise intensity value, and executes the sending of the communication message to the microphone, so as to trigger the microphone to play the communication message, and the volume The adjustment instruction is used to adjust the playback volume of the communication message played by the microphone.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, after the first mobile terminal sends the communication message to the microphone to trigger the microphone to play the communication message, the method Also includes:

receiving, by the first mobile terminal, a reply message for the communication message collected by the microphone;

The first mobile terminal performs endpoint detection on the reply message to obtain at least one speech segment;

The first mobile terminal performs speech recognition on each of the speech segments to obtain the recognized text of each of the speech segments;

The first mobile terminal determines a key speech segment from all the speech segments according to the recognized text of each of the speech segments;

The first mobile terminal sends the key speech segment to the second mobile terminal.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, the first mobile terminal detects whether the microphone is in a holding state, including:

The first mobile terminal obtains the tilt angle of the microphone;

The first mobile terminal determines whether the inclination angle of the microphone is greater than a preset angle, and when the determination result is yes, it is determined that the microphone is in a holding state.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, the first mobile terminal determines whether the communication message is an instant interactive message, including:

obtaining, by the first mobile terminal, the reception time of the communication message;

acquiring, by the first mobile terminal, contact state information between the first mobile terminal and the second mobile terminal, and calculating a weight value of the second mobile terminal according to the contact state information;

The first mobile terminal determines whether the time difference between the current time and the receiving time is less than a preset time difference, and whether the weight value of the second mobile terminal is higher than the preset weight value;

When judging that the time difference is smaller than the preset time difference and the weight value of the second mobile terminal is higher than the preset weight, the first mobile terminal determines that the communication message is an instant interactive message.

A second aspect of the embodiments of the present invention discloses a mobile terminal, including:

a first receiving unit, configured to receive a communication message sent by the second mobile terminal, where the communication message at least includes a voice message;

a judging unit for judging whether the communication message is an instant interactive message;

The first detection unit is configured to detect whether the microphone is in a holding state when the determination unit determines that the communication message is the instant interactive message, and the microphone is pre-wired or wirelessly connected to the connected by the first mobile terminal;

A first sending unit, configured to send the communication message to the microphone when the first detection unit detects that the microphone is in a holding state, so as to trigger the microphone to play the communication message.

As an optional implementation manner, in the second aspect of the embodiment of the present invention, the mobile terminal further includes:

an acquisition unit, configured to acquire the sound signal of the current environment collected by the microphone when the first detection unit detects that the microphone is in a holding state;

an analysis unit, configured to analyze the sound signal of the current environment to obtain a noise intensity value of the current environment;

a second sending unit, configured to send a volume adjustment instruction to the microphone according to the noise intensity value, where the volume adjustment instruction is used to adjust the playback volume of the communication message played by the microphone;

The first sending unit is specifically configured to send the data to the microphone when the first detection unit detects that the microphone is in a holding state and after the second sending unit sends the volume adjustment instruction. the communication message to trigger the microphone to play the communication message.

As an optional implementation manner, in the second aspect of the embodiment of the present invention, the mobile terminal further includes:

a second receiving unit, configured to receive a reply message for the communication message collected by the microphone;

a second detection unit, configured to perform endpoint detection on the reply message to obtain at least one speech segment;

A recognition unit for performing speech recognition on each of the speech segments to obtain the recognized text of each of the speech segments;

a determining unit for determining a key speech segment from all the speech segments according to the recognized text of each of the speech segments;

A third sending unit, configured to send the key speech segment to the second mobile terminal.

As an optional implementation manner, in the second aspect of the embodiment of the present invention, the first detection unit includes:

a first obtaining subunit, configured to obtain the tilt angle of the microphone when the judgment unit judges that the communication message is the instant interactive message;

a first judging subunit, configured to judge whether the inclination angle of the microphone is greater than a preset angle when the judging unit judges that the communication message is the instant interactive message;

The first determination subunit is configured to determine that the microphone is in a holding state when the determination subunit determines that the inclination angle of the microphone is greater than a preset angle.

As an optional implementation manner, in the second aspect of the embodiment of the present invention, the judging unit includes:

a second acquiring subunit, configured to acquire the reception time of the communication message and the contact status information between the mobile terminal and the second mobile terminal;

a calculation subunit, configured to calculate the weight value of the second mobile terminal according to the contact state information;

a second judging subunit, configured to judge whether the time difference between the current time and the receiving time is less than a preset time difference, and whether the weight value of the second mobile terminal is higher than the preset weight value;

a second determination subunit, configured to determine the communication when the second determination subunit determines that the time difference is smaller than the preset time difference and the weight value of the second mobile terminal is higher than the preset weight The message is an instant interactive message.

A third aspect of the embodiments of the present invention discloses a mobile terminal, which is characterized by comprising:

a memory in which executable program code is stored;

a processor coupled to the memory;

The processor invokes the executable program code stored in the memory to execute the communication message interaction method disclosed in the first aspect of the embodiments of the present invention.

A fourth aspect of the embodiments of the present invention discloses a computer-readable storage medium, characterized in that it stores a computer program, and the computer program enables a computer to execute the communication message interaction method disclosed in the first aspect of the embodiments of the present invention.

Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

In the embodiment of the present invention, the first mobile terminal receives and judges whether the communication message sent by the second mobile terminal is an instant interactive message, the communication message includes at least a voice message, and when the judgment result is yes, it detects whether the microphone is in a holding state, When the detection result is yes, the first mobile terminal sends a communication message to the microphone to trigger the microphone to play the communication message. It can be seen that the embodiment of the present invention can simplify the interaction process of communication messages, that is, the user of the first mobile terminal can interact with the communication message of the user of the second mobile terminal while using the microphone, which is different from the first mobile terminal in the prior art. Compared with the cumbersome interaction process that the user of the mobile terminal needs to suspend the use of the microphone and use the first mobile terminal to interact with the communication message of the second mobile terminal, the embodiment of the present invention improves the convenience of interaction.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present invention more clearly, the following briefly introduces the drawings required in the embodiments. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without any creative effort.

1 is a schematic flowchart of a method for exchanging communication messages disclosed in an embodiment of the present invention;

2 is a schematic flowchart of another communication message interaction method disclosed in an embodiment of the present invention;

3 is a schematic flowchart of another communication message interaction method disclosed in an embodiment of the present invention;

4 is a schematic structural diagram of a mobile terminal disclosed in an embodiment of the present invention;

5 is a schematic structural diagram of another mobile terminal disclosed in an embodiment of the present invention;

6 is a schematic structural diagram of another mobile terminal disclosed in an embodiment of the present invention;

FIG. 7 is a schematic structural diagram of another mobile terminal disclosed in an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

It should be noted that the terms "comprising" and "having" and any modifications thereof in the embodiments of the present invention and the accompanying drawings are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes unlisted steps or units, or optionally also includes For other steps or units inherent to these processes, methods, products or devices.

The embodiments of the present invention disclose a communication message interaction method and a mobile terminal, which can simplify the communication message interaction process and improve the convenience of interaction. Each of them will be described in detail below.

Example 1

Please refer to FIG. 1. FIG. 1 is a schematic flowchart of a communication message interaction method disclosed in an embodiment of the present invention. The interaction method of communication messages described in FIG. 1 is applicable to various types of mobile terminals such as tutoring machines, learning mobile phones, and learning tablets, which are not limited in the embodiment of the present invention. The operating systems of various mobile terminals may include but are not limited to Android operating systems, IOS operating systems, Symbian (Symbian) operating systems, BlackBerry (Blackberry) operating systems, Windows Phone 8 operating systems, etc. limited. As shown in FIG. 1, the interaction method of the communication message may include the following operations:

101. A first mobile terminal receives a communication message sent by a second mobile terminal.

In this embodiment of the present invention, the communication message may include at least a voice message. The first mobile terminal and the second mobile terminal may be electronic devices with a communication function, such as a smart tablet computer, a mobile phone, or a tutoring machine, which is not limited in this embodiment of the present invention.

For example, the first mobile terminal may be a tutoring machine used by a child, and the second mobile terminal may be a mobile phone used by a parent. The parent may send a voice message to the child's tutoring machine through an APP of the mobile phone to conduct a voice conversation with the child. Preferably, before the parent sends a voice message to the child's home-teaching machine through the mobile phone APP, the mobile phone and the home-teaching machine can be bound according to the unique serial number of the child's home-teaching machine to establish a legal communication connection with the home-teaching machine. It can be seen that, in this embodiment of the present invention, by establishing a legal communication connection between mobile terminals, fast and safe interaction of communication messages between mobile terminals can be realized.

102. The first mobile terminal determines whether the communication message is an instant interactive message, and when the determination result is yes, executes step 103, otherwise, ends the process.

In this embodiment of the present invention, the first mobile terminal may receive at least one communication message sent by at least one mobile device including the second mobile terminal that has established a legal communication connection with the first mobile terminal, where the communication message may include but not Limited to one or more of voice messages, text messages, and picture messages.

As an optional implementation manner, determining whether the communication message is an instant interactive message by the first mobile terminal may include:

The first mobile terminal obtains the reception time of the communication message;

The first mobile terminal acquires the contact state information between the first mobile terminal and the second mobile terminal, and calculates the weight value of the second mobile terminal according to the contact state information;

The first mobile terminal determines whether the time difference between the current time and the receiving time is less than the preset time difference, and whether the weight value of the second mobile terminal is higher than the preset weight value;

When it is determined that the time difference is smaller than the preset time difference and the weight value of the second mobile terminal is higher than the preset weight, the first mobile terminal determines that the communication message is an instant interactive message.

In this embodiment of the present invention, the communication message received by the first mobile terminal includes time information of the communication message, and the first mobile terminal can obtain the reception time of the communication message through the time information; in addition, the first mobile terminal can also obtain the time information of the communication message. Contact status information between the first mobile terminal and the second mobile terminal, where the contact status information may include multiple preset parameters, such as the number of contacts between the first mobile terminal and the second mobile terminal, the contact time period, and the last contact time, etc., each preset parameter is assigned a corresponding sub-weight value according to the actual situation, and the weight value of the second mobile terminal may be equal to the sum of the sub-weight values of each preset parameter in the contact status information; the first mobile terminal may Calculate the difference (time difference) between the reception time of the received communication message and the current time, and the first mobile terminal is preset with a preset time difference, for judging and calculating the difference between the reception time of the received communication message and the current time (time difference) ) is less than the preset time difference, in addition, the first mobile terminal can judge whether the weight value obtained by the sum of the sub-weight values of each preset parameter in the state contact information of the second mobile terminal is higher than the preset weight value; When the mobile terminal determines that the difference value (time difference) is smaller than the preset time difference, it indicates that the communication message is an instant message, and when the first mobile terminal determines that the weight value of the second mobile terminal is greater than the preset weight value, it indicates that the communication message is an instant message. It is an interactive message. Further, it is explained that the user of the mobile device sending the communication message is an important contact of the user of the first mobile terminal, so only when the results of the above two judgments are both yes, the first mobile terminal can determine the communication The message is an instant interactive message. It can be seen that the embodiments of the present invention screen the communication messages by judging whether the immediacy and interactivity of the communication messages meet the preset conditions, thereby improving the pertinence of acquiring the communication messages and improving the user experience.

For example, the contact state information may include three preset parameters, the number of times of contact between the first mobile terminal and the second mobile terminal, the time period of contact, and the time of the last contact. For the preset parameter of the number of contacts of the terminal, when the number of contacts is less than five times, the corresponding sub-weight value is 1; when the number of contacts is greater than or equal to five times and less than or equal to fifteen times, the corresponding sub-weight value is 2 ; When the number of contacts is greater than fifteen times, the corresponding sub-weight value is 3. For the preset parameter of the contact time period, when the contact time period is between 6:00 am and 9:00 am, the corresponding sub-weight value is 1; the contact time period is between 9:00 am and 9:00 pm The corresponding sub-weight value is 2; when the contact time period is between 9:00 pm and 6:00 am the next day, the corresponding sub-weight value is 3. For the preset parameter of the last contact time, if the last contact time is more than one month, the corresponding sub-weight value is 1; if the last contact time is within one month, the corresponding sub-weight value is 2; The time of the last contact is within 24 hours, and the corresponding sub-weight value is 3. The weight value is equal to the sum of the sub-weight values corresponding to the three preset parameters of the number of times of contact between the first mobile terminal and the second mobile terminal, the time period of the contact, and the time of the last contact. In this embodiment of the present invention, the preset weight value may be 5, and the weight value of the second mobile terminal may be 8, which is not limited in the present invention. In this case, the weight value of the second mobile terminal is greater than the preset weight value, and it can be determined that the Communication messages are interactive messages.

It should be noted that the preset time difference and the preset weight value can be changed and set according to actual needs, for example, can be actively triggered by the user of the first mobile terminal, or can be adjusted every preset time.

103. The first mobile terminal detects whether the microphone is in a holding state. When the detection result is yes, step 104 is performed; otherwise, the process ends.

It should be noted that the microphone is pre-connected to the first mobile terminal through a wired connection or a wireless connection.

In this embodiment of the present invention, the first mobile terminal may determine whether the microphone is in use at this time by detecting whether the microphone is in a holding state.

As an optional implementation manner, the specific manner in which the first mobile terminal detects whether the microphone is in a holding state may be as follows: the first mobile terminal sends a detection instruction to the microphone, and the detection instruction is used to trigger the microphone to control its built-in infrared sensor Obtain the temperature value of the current microphone; the first mobile terminal receives the temperature value returned by the microphone for the detection instruction, and determines whether the temperature value is within the preset temperature value range, and if the temperature value is not within the preset temperature value range, it can be determined The microphone is held at this time.

As another optional implementation manner, the specific manner in which the first mobile terminal detects whether the microphone is in a holding state may be as follows: the first mobile terminal sends a detection instruction to the microphone, where the detection instruction is used to trigger the microphone to control its built-in pressure The sensor obtains the pressure value of the current microphone; the first mobile terminal receives the pressure value returned by the microphone for the detection instruction, and judges whether the pressure value is within the preset pressure value range, and if the pressure value is within the preset pressure value range, it can be Make sure the microphone is held at this time.

As another optional implementation manner, the first mobile terminal detects whether the microphone is in a holding state. The corresponding energy value, if the signal energy is greater than the energy value corresponding to the ripple noise, it can be determined that the microphone is in a holding state at this time.

It can be seen that in this embodiment of the present invention, the current state of the microphone can be flexibly acquired in various ways, and when it is determined that the microphone is in the holding state, step 104 is executed, and when it is determined that the microphone is not in the holding state, that is, the disabled state , ending the process, avoiding the first mobile terminal from sending a communication message to the microphone when the microphone is in a deactivated state, thereby reducing the power consumption of the first mobile terminal.

104. The first mobile terminal sends a communication message to the microphone to trigger the microphone to play the communication message.

In this embodiment of the present invention, after detecting that the microphone is in a holding state, the first mobile terminal sends a communication message to the microphone to trigger the microphone to start the built-in audio playback device to play the communication message. In particular, the first mobile terminal sends a communication message to the microphone. Multiple communication messages can be sent to the microphone, and the microphone can play the communication messages in chronological order in which they are received.

It can be seen that, by implementing the method for interacting communication messages described in FIG. 1 , a legal communication connection between mobile terminals can be established to realize fast and safe interaction of communication messages between mobile terminals; the immediacy and interactivity of communication messages can be judged by Whether these two aspects meet the preset conditions, the communication messages are screened, thereby improving the pertinence of acquiring the communication messages and improving the user experience; it can also prevent the first mobile terminal from sending a communication to the microphone when the microphone is in a deactivated state. message, thereby reducing the power consumption of the first mobile terminal.

In addition, to implement the interaction method of communication messages described in FIG. 1 , for example, the first mobile terminal may be a tutoring machine used by children, and the second mobile terminal may be a mobile phone used by parents, wherein the microphone can communicate with the tutoring machine through Bluetooth When the parent sends a voice message to the child's tutoring machine through the APP on the mobile phone, once the tutoring machine determines that the voice message is an instant interactive message and detects that the microphone is in a holding state, it immediately sends the voice message to the microphone, so that the The microphone plays the voice message, thereby avoiding the inconvenience of the child putting down the microphone and returning to the tutoring machine to operate and obtain the voice message, improving the convenience of using the tutoring machine and the microphone together, and ensuring the timeliness and convenience of parent-child interaction between parents and children.

Embodiment 2

Please refer to FIG. 2. FIG. 2 is a schematic flowchart of another communication message interaction method disclosed in an embodiment of the present invention. As shown in FIG. 2, the interaction method of the communication message may include the following steps:

In this embodiment of the present invention, the method for interacting with a communication message further includes steps 201 to 204. For the description of steps 201 to 204, please refer to the detailed description of steps 101 to 104 in Embodiment 1, and this embodiment of the present invention does not Repeat.

205. The first mobile terminal receives a reply message for the communication message collected by the microphone.

206. The first mobile terminal performs endpoint detection on the reply message to obtain at least one speech segment.

In this embodiment of the present invention, the method of endpoint detection may be endpoint detection based on short-term energy and short-term average zero-crossing rate, endpoint detection based on cepstral features, endpoint detection based on entropy, etc., which is not limited in the present invention. Since the above-mentioned reply message is a voice signal collected by a microphone, the first mobile terminal performs endpoint detection on the above-mentioned reply message, and can accurately determine the starting point and the end point of the voice from the reply message, and distinguish the voice and non-voice signals, The interference of the silent segment or the noise segment in the reply message can be reduced.

207. The first mobile terminal performs speech recognition on each of the above-mentioned speech segments, and obtains the recognized text of each of the above-mentioned speech segments.

208. The first mobile terminal determines a key speech segment from all the speech segments according to the recognized text of each speech segment.

In this embodiment of the present invention, the specific manner in which the first mobile terminal determines the key speech segment according to the recognized text may be as follows: the first mobile terminal detects whether the recognized text of each of the above-mentioned speech segments contains a preset keyword, and if so, determines The speech segment containing the preset keywords is the key speech segment. It can be seen that the embodiment of the present invention can select key speech segments when the reply message is too long, avoiding the situation that it is difficult to find valuable reply content in a timely and accurate manner when the data volume and time length of the reply message are too long, and improve the It improves the efficiency of users to obtain key information, thereby improving the user experience.

209. The first mobile terminal sends the key speech segment to the second mobile terminal.

As an optional implementation manner, before sending the key speech segment to the second mobile terminal, the first mobile terminal may also detect whether the sound clarity of the key speech segment is lower than the preset clarity, and if so, then The speech rate when the key speech segment is played is adjusted to a slow speed, and the adjusted key speech segment is sent to the second mobile terminal. It can be seen that in this embodiment of the present invention, the playback speed of the key speech segment can be adjusted when the sound quality of the key speech segment is poor and the playback is not clear enough, so that the user of the second mobile terminal can hear the key speech segment clearly when playing the key speech segment. The content of key speech segments improves user experience.

It can be seen that, by implementing the method for interacting communication messages described in FIG. 2 , a legal communication connection between mobile terminals can be established to realize fast and safe interaction of communication messages between mobile terminals; the immediacy and interactivity of communication messages can be judged by Whether these two aspects meet the preset conditions, the communication messages are screened, thereby improving the pertinence of acquiring the communication messages and improving the user experience; it can also prevent the first mobile terminal from sending a communication to the microphone when the microphone is in a deactivated state. message, thereby reducing the power consumption of the first mobile terminal; in addition, the first mobile terminal performs endpoint detection on the above reply message, and can accurately determine the starting point and the end point of the voice from the reply message, and distinguish the voice and non-voice The voice signal can reduce the interference of the silent segment or the noise segment in the reply message; it is also possible to select the key speech segment when the reply message is too long, avoiding the difficulty of being timely and accurate when the data volume and duration of the reply message are too long. The situation that valuable reply content can be found in a timely manner improves the efficiency for users to obtain key information, thereby improving the user experience; it is also possible to adjust the playback of key speech segments when the sound quality of key speech segments is poor and the playback is not clear enough. The speech rate enables the user of the second mobile terminal to hear the content of the key speech segment clearly when playing the key speech segment, and also improves the user experience.

Embodiment 3

Please refer to FIG. 3 . FIG. 3 is a schematic flowchart of another communication message interaction method disclosed by an embodiment of the present invention. As shown in Figure 3, the interaction method of the communication message may include the following steps:

301. A first mobile terminal receives a communication message sent by a second mobile terminal.

Wherein, the communication message includes at least a voice message.

302. The first mobile terminal judges whether the communication message is an instant interactive message, and when the judgment result is yes, executes step 303, otherwise, ends the process.

303. The first mobile terminal acquires the tilt angle of the microphone.

In this embodiment of the present invention, the first mobile terminal may acquire the inclination angle of the microphone through a level built in the microphone.

304. The first mobile terminal determines whether the inclination angle of the microphone is greater than the preset angle, and when the determination result is yes, it is determined that the microphone is in a holding state, and step 305 is executed; otherwise, the process ends.

In particular, since the microphone is not in use, the user of the first mobile terminal usually places the microphone on the microphone base, and the inclination angle of the microphone when the microphone is placed on the microphone base is 0°.

305. The first mobile terminal acquires the sound signal of the current environment collected by the microphone.

306. The first mobile terminal analyzes the sound signal of the current environment to obtain a noise intensity value of the current environment.

307. The first mobile terminal sends a volume adjustment instruction to the microphone according to the noise intensity value, where the volume adjustment instruction is used to adjust the playback volume of the communication message played by the microphone.

By implementing steps 305 to 307, the noise intensity value of the current environment can be obtained by acquiring and analyzing the sound signal of the current environment collected by the microphone, and comparing the noise intensity value with a preset list of noise standard intensity values to obtain the noise intensity value. The noise intensity value corresponds to the playback volume value in the preset noise standard intensity value list, and the microphone sends a volume adjustment instruction carrying the playback volume value, so that the microphone adjusts the volume of the communication message to the above playback volume value. It can be seen that by implementing steps 305 to 307, the purpose of adjusting the volume of the communication message played by the microphone can be achieved, and the playback process of the communication message is optimized.

In this embodiment of the present invention, the method for interacting a communication message further includes steps 308 to 313. For the description of steps 308 to 313, please refer to the detailed description of steps 204 to 209 in Embodiment 2, and this embodiment of the present invention does not Repeat.

It can be seen that, by implementing the method for interacting communication messages described in FIG. 3 , a legal communication connection between mobile terminals can be established to realize fast and safe interaction of communication messages between mobile terminals; the immediacy and interactivity of communication messages can be judged by Whether these two aspects meet the preset conditions, the communication messages are screened, thereby improving the pertinence of acquiring the communication messages and improving the user experience; it can also prevent the first mobile terminal from sending a communication to the microphone when the microphone is in a deactivated state. message, thereby reducing the power consumption of the first mobile terminal; in addition, the first mobile terminal performs endpoint detection on the above reply message, and can accurately determine the starting point and the end point of the voice from the reply message, and distinguish the voice and non-voice The voice signal can reduce the interference of the silent segment or the noise segment in the reply message; it is also possible to select the key speech segment when the reply message is too long, avoiding the difficulty of being timely and accurate when the data volume and duration of the reply message are too long. The situation that valuable reply content can be found in a timely manner improves the efficiency for users to obtain key information, thereby improving the user experience; it is also possible to adjust the playback of key speech segments when the sound quality of key speech segments is poor and the playback is not clear enough. The speech rate enables the user of the second mobile terminal to hear the content of the key speech segment clearly when playing the key speech segment, and also improves the user experience.

In addition, by implementing the method for interacting communication messages described in FIG. 3 , when the current environment is relatively noisy, the volume of the above-mentioned communication messages can be increased, so that the user of the first mobile terminal can obtain complete information without being affected by the surrounding environment. The communication message sent by the second mobile terminal optimizes the playing process of the communication message and further improves the user experience.

Embodiment 4

Please refer to FIG. 4 , which is a schematic structural diagram of a mobile terminal disclosed in an embodiment of the present invention. As shown in Figure 4, the mobile terminal may include:

The first receiving unit 401 is configured to receive a communication message sent by the second mobile terminal, and provide the communication message to the judging unit 402, where the communication message at least includes a voice message.

The determining unit 402 is configured to determine whether the above-mentioned communication message is an instant interactive message.

The first detection unit 403 is used to detect whether the microphone is in a holding state when the above-mentioned determination unit 402 determines that the communication message is an instant interactive message, and the microphone is pre-connected to the first mobile terminal through a wired connection or a wireless connection. .

The first sending unit 404 is configured to send the communication message to the microphone when the first detection unit 403 detects that the microphone is in a holding state, so as to trigger the microphone to play the communication message.

The above-mentioned communication message sent by the first sending unit 404 to the microphone is received by the first receiving unit 401 .

It can be seen that the implementation of the mobile terminal described in FIG. 4 can realize fast and safe interaction of communication messages between mobile terminals by establishing legal communication connections between mobile terminals; the immediacy and interactivity of communication messages can be judged by two In terms of whether the preset conditions are met, the communication messages are screened, thereby improving the pertinence of obtaining communication messages and improving the user experience; it can also prevent the first mobile terminal from sending communication messages to the microphone when the microphone is in a disabled state, thereby The power consumption of the first mobile terminal is reduced.

Embodiment 5

Please refer to FIG. 5 , which is a schematic structural diagram of another mobile terminal provided by an embodiment of the present invention, wherein the mobile terminal shown in FIG. 5 is obtained by further optimizing the mobile terminal shown in FIG. 4 . Compared with the mobile terminal shown in FIG. 4 , the mobile terminal shown in FIG. 5 may further include:

The second receiving unit 405 is configured to receive a reply message for the above communication message collected by the microphone, and provide the reply message to the second detection unit 406 .

Specifically, after the first sending unit 404 sends the communication message to the microphone, the second receiving unit 405 is triggered to start.

The second detection unit 406 is configured to perform endpoint detection on the reply message, obtain at least one speech segment, and provide the at least one speech segment to the identification unit 407 .

In this embodiment of the present invention, the second detection unit 406 may perform endpoint detection by means of endpoint detection based on short-term energy and short-term average zero-crossing rate, endpoint detection based on cepstral features, and endpoint detection based on entropy. Do limit. Since the above-mentioned reply message is the voice signal collected by the microphone received by the second receiving unit 405, the second detection unit 406 performs endpoint detection on the above-mentioned reply message, and can accurately determine the starting point and the end point of the voice from the reply message, Distinguishing voice and non-voice signals can reduce the interference of silent segments or noise segments in the reply message.

The recognition unit 407 is configured to perform speech recognition on each of the above-mentioned speech segments to obtain the recognized text of each of the above-mentioned speech segments.

The determining unit 408 is configured to determine a key speech segment from all the above-mentioned speech segments according to the recognized text of each of the above-mentioned speech segments recognized by the recognizing unit 407 .

The third sending unit 409 is configured to send the key speech segment determined by the determining unit 408 to the second mobile terminal.

It can be seen that, by implementing the mobile terminal described in Figure 5, a legal communication connection between the mobile terminals can be established to realize the fast and safe interaction of communication messages between the mobile terminals; the immediacy and interactivity of the communication messages can be judged by two aspects. Whether the preset conditions are met, the communication messages are screened, thereby improving the pertinence of obtaining communication messages and improving the user experience; it can also prevent the first mobile terminal from sending communication messages to the microphone when the microphone is in a disabled state, thereby reducing the The power consumption of the first mobile terminal is reduced; in addition, the first mobile terminal performs endpoint detection on the above-mentioned reply message, and can accurately determine the starting point and the end point of the voice from the reply message, and distinguish the voice and non-voice signals. Reduce the interference of silent segments or noise segments in the reply message; it is also possible to select key speech segments when the reply message is too long, avoiding the difficulty of finding valuable information in a timely and accurate manner when the data volume and duration of the reply message are too long In this case, the reply content of the user is improved, which improves the efficiency of users to obtain key information, thereby improving the user experience; it is also possible to adjust the playback speed of key speech segments when the sound quality of key speech segments is poor and the playback is not clear enough, so that the When the user of the second mobile terminal is playing the key speech segment, the content of the key speech segment can be heard clearly, which also improves the user experience.

Embodiment 6

Please refer to FIG. 6. FIG. 6 is a schematic structural diagram of another mobile terminal disclosed in an embodiment of the present invention. The mobile terminal shown in FIG. 6 is obtained by optimizing the mobile terminal shown in FIG. 5 . Compared with the mobile terminal shown in FIG. 5 , the mobile terminal shown in FIG. 6 further includes:

The acquisition unit 410 is configured to acquire the sound signal of the current environment collected by the microphone when the first detection unit 403 detects that the microphone is in a holding state, and provide it to the analysis unit 411 .

The analyzing unit 411 is configured to analyze the sound signal of the current environment, and obtain the noise intensity value of the current environment.

The second sending unit 412 is configured to send a volume adjustment instruction to the microphone according to the noise intensity value obtained by the analysis unit 411, where the volume adjustment instruction is used to adjust the playback volume of the communication message played by the microphone.

The above-mentioned first sending unit 404 is specifically configured to send the above-mentioned communication message to the microphone to trigger the microphone when the above-mentioned first detecting unit 403 detects that the microphone is in a holding state, and after the above-mentioned second transmitting unit 412 sends a volume adjustment instruction Play the communication message.

As an optional implementation manner, as shown in FIG. 6 , the first detection unit 403 may include:

The first obtaining sub-unit 4031 is configured to obtain the inclination angle of the microphone when the above-mentioned determining unit 402 determines that the communication message is an instant interactive message, and provide it to the first determining unit 4032 .

The first determination subunit 4032 is used to determine whether the inclination angle of the microphone is greater than a preset angle.

The first determination subunit 4033 is configured to determine that the microphone is in a holding state when the determination subunit 4032 determines that the inclination angle of the microphone is greater than a preset angle.

As an optional implementation manner, as shown in FIG. 6 , the judging unit 402 may include:

The second acquisition sub-unit 4021 is configured to acquire the reception time of the above-mentioned communication message and the contact state information between the mobile terminal and the second mobile terminal, and provide them to the calculation sub-unit 4022 .

The calculation subunit 4022 is configured to calculate the weight value of the second mobile terminal according to the above contact state information, and trigger the second judgment subunit 4023 to start.

The second judging subunit 4023 is configured to judge whether the time difference between the current time and the above receiving time is less than the preset time difference, and whether the weight value of the second mobile terminal is higher than the preset weight value.

The second determination subunit 4024 is configured to determine that the communication message is an instant interactive message when the second determination subunit 4023 determines that the time difference is less than the preset time difference and the weight value of the second mobile terminal is higher than the preset weight.

In this embodiment of the present invention, the communication message received by the first receiving unit 401 includes time information of the communication message, and the second obtaining subunit 4021 can obtain the receiving time of the communication message through the time information; in addition, the second obtaining The sub-unit 4021 can also obtain contact status information between the first mobile terminal and the second mobile terminal, where the contact status information may include multiple preset parameters, such as the number of contacts between the first mobile terminal and the second mobile terminal, the number of contacts The time period and the time of the last contact, etc., each preset parameter is assigned a corresponding sub-weight value according to the actual situation, and the weight value of the second mobile terminal can be equal to the sum of the sub-weight values of the preset parameters in the contact status information The calculation subunit 4022 can calculate the difference (time difference) between the reception time of the received communication message and the current time, and the second judgment subunit 4023 is preset with a preset time difference, for judging and calculating the reception time of the received communication message and Whether the difference (time difference) of the current time is less than the preset time difference, in addition, the second judgment subunit 4023 can judge whether the weight value obtained by the sum of the sub-weight values of the preset parameters in the status contact information of the second mobile terminal is high or not at the preset weight value; when the second judgment subunit 4023 judges that the difference (time difference) is less than the preset time difference, it indicates that the communication message is an instant message, and when the second judgment subunit 4023 judges that the second mobile terminal When the weight value is greater than the preset weight value, it indicates that the communication message is an interactive message, and further indicates that the user of the mobile device that sends the communication message is an important contact of the first mobile terminal user, so only when the results of the above two judgments When both are yes, the second determining subunit 4024 may determine that the communication message is an instant interactive message. It can be seen that the embodiments of the present invention screen the communication messages by judging whether the immediacy and interactivity of the communication messages meet the preset conditions, thereby improving the pertinence of acquiring the communication messages and improving the user experience.

For example, the contact state information may include three preset parameters, the number of times of contact between the first mobile terminal and the second mobile terminal, the time period of contact, and the time of the last contact. For the preset parameter of the number of contacts of the terminal, when the number of contacts is less than five times, the corresponding sub-weight value is 1; when the number of contacts is greater than or equal to five times and less than or equal to fifteen times, the corresponding sub-weight value is 2 ; When the number of contacts is greater than fifteen times, the corresponding sub-weight value is 3. For the preset parameter of the contact time period, when the contact time period is between 6:00 am and 9:00 am, the corresponding sub-weight value is 1; the contact time period is between 9:00 am and 9:00 pm The corresponding sub-weight value is 2; when the contact time period is between 9:00 pm and 6:00 am the next day, the corresponding sub-weight value is 3. For the preset parameter of the last contact time, if the last contact time is more than one month, the corresponding sub-weight value is 1; if the last contact time is within one month, the corresponding sub-weight value is 2; The time of the last contact is within 24 hours, and the corresponding sub-weight value is 3. The weight value is equal to the sum of the sub-weight values corresponding to the three preset parameters of the number of times of contact between the first mobile terminal and the second mobile terminal, the time period of the contact, and the time of the last contact. In this embodiment of the present invention, the preset weight value may be 5, and the weight value of the second mobile terminal may be 8, which is not limited in the present invention. In this case, the weight value of the second mobile terminal is greater than the preset weight value, and it can be determined that the Communication messages are interactive messages.

It should be noted that the preset time difference and the preset weight value can be changed and set according to actual needs, for example, can be actively triggered by the user of the first mobile terminal, or can be adjusted every preset time.

It can be seen that, by implementing the mobile terminals described in FIG. 6 , a legal communication connection between the mobile terminals can be established to realize the fast and safe interaction of communication messages between the mobile terminals; the immediacy and interactivity of the communication messages can be judged by the two In terms of whether the preset conditions are met, the communication messages are screened, thereby improving the pertinence of obtaining communication messages and improving the user experience; it can also prevent the first mobile terminal from sending communication messages to the microphone when the microphone is in a disabled state, thereby The power consumption of the first mobile terminal is reduced; in addition, the first mobile terminal performs endpoint detection on the above-mentioned reply message, and can accurately determine the starting point and the end point of the voice from the reply message, and distinguish the voice and non-voice signals, It can reduce the interference of silent segments or noise segments in the reply message; it is also possible to select key speech segments when the reply message is too long, so as to avoid the difficulty of timely and accurate finding out when the data volume and duration of the reply message are too long. The situation of valuable reply content improves the efficiency of users to obtain key information, thereby improving the user experience; it is also possible to adjust the playback speed of key speech segments when the sound quality of key speech segments is poor and the playback is not clear enough. The user of the second mobile terminal can hear the content of the key speech segment clearly when playing the key speech segment, which also improves user experience.

In addition, by implementing the mobile terminal described in FIG. 6 , when the current environment is relatively noisy, the volume of the microphone playing the above-mentioned communication message can be increased, so that the user of the first mobile terminal is not affected by the surrounding environment and can completely obtain the second The communication message sent by the mobile terminal optimizes the playback process of the communication message and further improves the user experience.

Please refer to FIG. 7, which is a schematic structural diagram of another mobile terminal disclosed in an embodiment of the present invention. As shown in Figure 7, the mobile terminal may include:

a memory 701 storing executable program code;

a processor 702 coupled to the memory 701;

The processor 702 invokes the executable program code stored in the memory 701 to execute any one of the communication message interaction methods shown in FIGS. 1 to 3 .

An embodiment of the present invention discloses a computer-readable storage medium, which stores a computer program, wherein the computer program causes a computer to execute any one of the communication message interaction methods in FIG. 1 to FIG. 3 .

Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium includes a read-only storage medium. Memory (Read-Only Memory, ROM), Random Access Memory (Random Access Memory, RAM), Programmable Read-only Memory (PROM), Erasable Programmable Read Only Memory (Erasable Programmable Read Only Memory, EPROM), One-time Programmable Read-Only Memory (OTPROM), Electronically Erasable Programmable Read-Only Memory (EEPROM), CompactDisc Read -Only Memory, CD-ROM) or other optical disk storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

A method for interacting a communication message and a mobile terminal disclosed in the embodiments of the present invention have been described above in detail. The principles and implementations of the present invention are described in this paper by using specific examples. The descriptions of the above embodiments are only used to help understanding. The method of the present invention and its core idea; at the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation and application scope. In summary, the content of this specification should not be It is understood as a limitation of the present invention.

Claims (10)

1. A method for communicating messages, the method comprising:

a first mobile terminal receives a communication message sent by a second mobile terminal and judges whether the communication message is an instant interactive message or not, wherein the communication message at least comprises a voice message;

when the judgment result is yes, the first mobile terminal detects whether a microphone is in a holding state, wherein the microphone is connected with the first mobile terminal in advance in a wired connection mode or a wireless connection mode;

when the detection result is yes, the first mobile terminal sends the communication message to the microphone to trigger the microphone to play the communication message;

the first mobile terminal receives a reply message which is collected by the microphone and aims at the communication message;

the first mobile terminal carries out end point detection on the reply message to obtain at least one voice section;

the first mobile terminal performs voice recognition on each voice segment to obtain a recognition text of each voice segment;

the first mobile terminal determines key voice sections from all the voice sections according to the identification text of each voice section;

and when the sound definition of the key voice segment is lower than the preset definition, adjusting the speed of the key voice segment during playing to be slow, and sending the adjusted key voice segment to the second mobile terminal.

2. The method of claim 1, further comprising:

if the first mobile terminal detects that the microphone is in a holding state, the first mobile terminal acquires a sound signal of the current environment collected by the microphone;

the first mobile terminal analyzes the sound signal of the current environment to obtain a noise intensity value of the current environment;

and the first mobile terminal sends a volume adjusting instruction to the microphone according to the noise intensity value, and executes the communication message sent to the microphone to trigger the microphone to play the communication message, wherein the volume adjusting instruction is used for adjusting the playing volume of the communication message played by the microphone.

3. The method according to claim 1 or 2, wherein the first mobile terminal detects whether a microphone is in a holding state, comprising:

the first mobile terminal acquires the inclination angle of a microphone;

the first mobile terminal judges whether the inclination angle of the microphone is larger than a preset angle or not, and when the judgment result is yes, the microphone is determined to be in a holding state.

4. The method according to claim 1 or 2, wherein the determining, by the first mobile terminal, whether the communication message is an instant interactive message comprises:

the first mobile terminal acquires the receiving time of the communication message;

the first mobile terminal acquires contact state information of the first mobile terminal and the second mobile terminal, and calculates a weight value of the second mobile terminal according to the contact state information;

the first mobile terminal judges whether the time difference between the current time and the receiving time is smaller than a preset time difference or not and whether the weighted value of the second mobile terminal is higher than a preset weighted value or not;

and when the time difference is judged to be smaller than the preset time difference and the weight value of the second mobile terminal is higher than the preset weight value, the first mobile terminal determines that the communication message is an instant interactive message.

5. A mobile terminal, comprising:

a first receiving unit, configured to receive a communication message sent by a second mobile terminal, where the communication message at least includes a voice message;

the judging unit is used for judging whether the communication message is an instant interactive message or not;

the first detection unit is used for detecting whether a microphone is in a holding state or not when the judgment unit judges that the communication message is the instant interactive message, wherein the microphone is connected with a first mobile terminal in advance in a wired connection mode or a wireless connection mode;

the first sending unit is used for sending the communication message to the microphone to trigger the microphone to play the communication message when the first detecting unit detects that the microphone is in a holding state;

the second receiving unit is used for receiving reply messages which are collected by the microphone and aim at the communication messages;

the second detection unit is used for carrying out end point detection on the reply message to obtain at least one voice section;

the recognition unit is used for carrying out voice recognition on each voice section to obtain a recognition text of each voice section;

the determining unit is used for determining key voice sections from all the voice sections according to the identification text of each voice section;

and the third sending unit is used for adjusting the speech speed of the key speech segment during playing to be slow speed when the sound definition of the key speech segment is lower than the preset definition, and sending the adjusted key speech segment to the second mobile terminal.

6. The mobile terminal of claim 5, wherein the mobile terminal further comprises:

the acquisition unit is used for acquiring the sound signal of the current environment collected by the microphone when the first detection unit detects that the microphone is in a holding state;

the analysis unit is used for analyzing the sound signal of the current environment to obtain a noise intensity value of the current environment;

a second sending unit, configured to send a volume adjustment instruction to the microphone according to the noise intensity value, where the volume adjustment instruction is used to adjust a playing volume of the microphone for playing the communication message;

the first sending unit is specifically configured to send the communication message to the microphone when the first detecting unit detects that the microphone is in a holding state and after the second sending unit sends the volume adjustment instruction, so as to trigger the microphone to play the communication message.

7. The mobile terminal according to claim 5 or 6, wherein the first detecting unit comprises:

the first obtaining subunit is configured to obtain a tilt angle of a microphone when the determining unit determines that the communication message is the instant interaction message;

the first judgment subunit is used for judging whether the inclination angle of the microphone is larger than a preset angle or not;

the first determining subunit is configured to determine that the microphone is in a holding state when the first determining subunit determines that the tilt angle of the microphone is greater than a preset angle.

8. The mobile terminal according to claim 5 or 6, wherein the judging unit comprises:

the second acquiring subunit is configured to acquire the receiving time of the communication message and contact state information of the mobile terminal and the second mobile terminal;

the calculating subunit is used for calculating a weight value of the second mobile terminal according to the contact state information;

a second judging subunit, configured to judge whether a time difference between the current time and the receiving time is smaller than a preset time difference, and whether a weight value of the second mobile terminal is higher than a preset weight value;

a second determining subunit, configured to determine that the communication message is an instant interaction message when the second determining subunit determines that the time difference is smaller than the preset time difference and the weight value of the second mobile terminal is higher than the preset weight value.

9. A mobile terminal, comprising:

a memory storing executable program code;

a processor coupled with the memory;

the processor calls the executable program code stored in the memory to execute the interaction method of the communication message according to any one of claims 1 to 4.

10. A computer-readable storage medium characterized by storing a computer program that causes a computer to execute the method of interacting with communication messages according to any one of claims 1 to 4.

Images