CN118573693A - Message pushing method and device, electronic equipment and storage medium - Google Patents

Abstract

The disclosure relates to a message pushing method and device, electronic equipment and storage medium. The method comprises the following steps: acquiring information of the environmental sounds detected by at least two environmental sound detection devices respectively; determining whether the environmental sounds with consistent information exist according to the information of the environmental sounds detected by the environmental sound detection devices; in response to the presence of the information-consistent ambient sound, a notification message is determined and pushed for the information-consistent ambient sound. By the method, repeated notification of the same environmental sound can be reduced, and notification efficiency of the environmental sound is improved.

Description

Message push method and device, electronic device and storage medium

Technical Field

The present disclosure relates to the technical field of electronic devices, and in particular to a message push method and device, an electronic device, and a storage medium.

Background Art

With the rapid development of electronic devices and Internet of Things technology, electronic devices are widely used in smart home systems. For example, electronic devices collect information about the whole house and send corresponding notification messages to users, so that users can keep abreast of what is happening in the home at any time.

In a smart home system, if a single electronic device is used to collect information about the entire house, the information collected may be inaccurate due to the limited coverage of the single electronic device. In addition, when multiple types of information appear at the same time, some information may be missed. Therefore, how to accurately and efficiently collect information about the entire house through electronic devices and push it to users has become a highly concerned issue.

Summary of the invention

The present invention provides a message push method and device, an electronic device and a storage medium.

According to a first aspect of an embodiment of the present disclosure, a message push method is provided, which is applied to an electronic device, and includes:

Obtaining information about ambient sounds detected by at least two ambient sound detection devices respectively;

Determining whether there is environmental sound with consistent information based on the environmental sound information detected by each of the environmental sound detection devices;

In response to the existence of the ambient sound that is consistent with the information, a notification message is determined and pushed for the ambient sound that is consistent with the information.

In some embodiments, the information of the ambient sound includes: the time when the ambient sound is detected and the sound source of the ambient sound;

The determining whether there is an ambient sound with consistent information according to the ambient sound information detected by each of the ambient sound detection devices includes:

If, among the information of the ambient sounds detected by each of the ambient sound detection devices, there is ambient sound having a consistent sound source and the time when the ambient sound is detected is within a preset time range, it is determined that there is ambient sound having consistent information.

In some embodiments, the ambient sound information further includes: a location where the ambient sound is collected;

The determining whether there is an ambient sound with consistent information according to the ambient sound information detected by each of the ambient sound detection devices includes:

If the information of the ambient sound detected by each of the ambient sound detection devices contains ambient sound with a consistent sound source, a collection position within a preset position difference range, and a time when the ambient sound is detected within a preset time range, it is determined that there is ambient sound with consistent information.

In some embodiments, the electronic device includes a user terminal, and in response to the presence of the ambient sound consistent with the information, determining and pushing a notification message for the ambient sound consistent with the information includes:

In response to the existence of ambient sound with consistent information, a notification message is determined for the ambient sound with consistent information, and the notification message is pushed to a device associated with the same user account and/or the same family account as the user terminal.

In some embodiments, the electronic device includes a server, and in response to the presence of the ambient sound consistent with the information, determining and pushing a notification message for the ambient sound consistent with the information includes:

In response to the existence of ambient sound with consistent information, a notification message is determined for the ambient sound with consistent information, and the notification message is pushed to a user terminal with the same user account and/or the same family account associated with the ambient sound detection device.

In some embodiments, the method further comprises:

Acquire information representing the priority of each of the ambient sound detection devices;

In response to the existence of the ambient sound with the same information, determining and pushing a notification message for the ambient sound with the same information, includes:

In response to the existence of the environmental sound with the consistent information, for the environmental sound with the consistent information, the information of the environmental sound corresponding to the environmental sound detection device with the highest priority is determined as the notification message and pushed.

In some embodiments, the method further comprises:

Determining whether a function representing multi-device ambient sound detection in the electronic device is enabled;

The obtaining of information about ambient sound detected by at least two ambient sound detection devices respectively includes:

In response to the function characterizing multi-device ambient sound detection being turned on, information about the ambient sound respectively detected by the at least two ambient sound detection devices is obtained.

According to a second aspect of an embodiment of the present disclosure, a message push device is provided, which is applied to an electronic device, and the device includes:

An acquisition module, used to acquire information of ambient sound detected by at least two ambient sound detection devices respectively;

A determination module, used to determine whether there is an ambient sound with consistent information based on the information of the ambient sound detected by each of the ambient sound detection devices;

The push module is used to determine and push a notification message for the environmental sound consistent with the information in response to the existence of the environmental sound consistent with the information.

In some embodiments, the information of the ambient sound includes: the time when the ambient sound is detected and the sound source of the ambient sound; the determination module is also used to determine that there is ambient sound with consistent information if there is ambient sound with consistent sound source and the time when the ambient sound is detected is within a preset time range in the information of the ambient sound detected by each of the ambient sound detection devices.

In some embodiments, the information of the ambient sound also includes: the collection location of the ambient sound; the determination module is also used to determine that there is ambient sound with consistent information if there is ambient sound with a consistent sound source, a collection location within a preset location difference range, and a time when the ambient sound is detected within a preset time range in the information of the ambient sound detected by each of the ambient sound detection devices.

In some embodiments, the electronic device includes a user terminal, and the push module is further used to determine a notification message in response to the presence of ambient sound consistent with the information, and push the notification message to a device associated with the same user account and/or the same family account as the user terminal.

In some embodiments, the electronic device includes a server, and the push module is further used to determine a notification message in response to the presence of ambient sound consistent with the information, and push the notification message to a user terminal associated with the same user account and/or the same family account as the ambient sound detection device.

In some embodiments, the acquisition module is also used to acquire information representing the priority of each of the ambient sound detection devices; the push module is also used to respond to the existence of ambient sounds with consistent information, and for the ambient sounds with consistent information, determine the information of the ambient sound corresponding to the ambient sound detection device with the highest priority as the notification message and push it.

In some embodiments, the device also includes: a detection module, used to determine whether a function characterizing multi-device ambient sound detection in the electronic device is turned on; the acquisition module is also used to obtain the information of the ambient sound detected by the at least two ambient sound detection devices respectively in response to the function characterizing multi-device ambient sound detection being turned on.

According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

processor;

a memory for storing processor-executable instructions;

Wherein, the processor is configured to execute the message pushing method as described in the first aspect above.

According to a fourth aspect of an embodiment of the present disclosure, there is provided a storage medium, including:

When the instructions in the storage medium are executed by the processor of the terminal, the terminal is enabled to execute the message pushing method as described in the first aspect above.

The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

In an embodiment of the present disclosure, an electronic device can reduce the occurrence of unrecognized sounds and improve the accuracy of identifying ambient sounds by acquiring information on ambient sounds detected by multiple ambient sound detection devices. Furthermore, after determining that there is ambient sound with consistent information among the information on multiple ambient sounds, a notification message is determined and pushed for the ambient sound with consistent information, which can reduce the occurrence of repeated notifications of the same ambient sound and improve the efficiency of pushing ambient sound messages.

It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

FIG. 1 is a flow chart of a message push method according to an embodiment of the present disclosure.

FIG. 2 is a schematic diagram of an ambient sound notification message received by a mobile phone shown in an embodiment of the present disclosure.

FIG. 3 is an architecture diagram of a message push method according to an embodiment of the present disclosure.

FIG. 4 is a schematic diagram of an ambient sound detection function setting interface of a mobile phone shown in an embodiment of the present disclosure.

Fig. 5 is a diagram showing a message pushing device according to an exemplary embodiment.

Fig. 6 is a block diagram of an electronic device 800 according to an exemplary embodiment.

DETAILED DESCRIPTION

Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

In order to make the purpose, technical solutions and advantages of the present disclosure clearer, the technical solutions of the present disclosure are further elaborated in detail below in conjunction with the drawings and embodiments. The described embodiments should not be regarded as limiting the present disclosure. All other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present disclosure.

In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which the present disclosure belongs. The terms used herein are only for the purpose of describing the present disclosure and are not intended to limit the present disclosure.

FIG. 1 is a flow chart of a message push method shown in an embodiment of the present disclosure. As shown in FIG. 1 , the message push method applied in an electronic device includes the following steps:

S11, obtaining information of ambient sounds detected by at least two ambient sound detection devices respectively;

S12, determining whether there is environmental sound with consistent information based on the environmental sound information detected by each of the environmental sound detection devices;

S13: In response to the existence of ambient sound that is consistent with the information, a notification message is determined and pushed for the ambient sound that is consistent with the information.

In the disclosed embodiment, the electronic device includes a terminal device and a server. The terminal device includes: a mobile device and a fixed device; the mobile device includes: a mobile phone, a tablet computer or a wearable device, etc. The fixed device includes but is not limited to a personal computer (PC). The electronic device and the ambient sound detection device can be connected wirelessly or wired, and the communication connection method involved may include: Bluetooth, mobile hotspot (Wireless Fidelity, WiFi), etc.

In step S11, the electronic device obtains information about ambient sounds detected by at least two ambient sound detection devices. Among them, the ambient sound detection device can be, but is not limited to, a device with a sound collection function, such as a mobile phone, a tablet computer, a smart speaker, a smart camera, etc. The ambient sound detection device can detect the sound in the surrounding environment in real time through a sound collection component (such as a microphone). After the ambient sound detection device detects the sound information, the detected sound information can be input into the sound recognition model through the built-in sound recognition engine to obtain the sound source corresponding to the sound information; the detected sound information can also be uploaded to the server for identification, and the sound source obtained by the identification can be received from the server. For example, when a smart camera detects the sound of "woo wow, woo wow", it can be determined that the sound source is "baby crying"; when a smart speaker detects the sound of "ding dong, ding dong", it can be determined that the sound source is "doorbell ringing"; when a mobile phone detects the sound of "woo hum, woo hum", it can be determined that the sound source is "fire alarm ringing".

It should be noted that in the embodiments of the present disclosure, multiple ambient sound detection devices can be used to cover the entire sound detection space to form an ambient sound recognition network. After detecting the sound information, each ambient sound detection device in the ambient sound recognition network can record the time when the sound was detected, the collection location, the source of the sound, and other information, and send the recorded information to the electronic device in the form of a notification. For example, in a whole-house smart scene, a smart camera can be set in the bedroom and a smart speaker in the living room. The smart camera in the bedroom can detect and send a notification of "There is a baby crying in the bedroom at 08:30" to the electronic device, and the smart speaker in the living room can detect and send a notification of "The doorbell rings in the living room at 14:00" to the electronic device.

In an embodiment of the present disclosure, an electronic device obtains information on ambient sound detected by at least two ambient sound detection devices respectively, which may include information on ambient sound detected by the electronic device through its own sound collection component, and the electronic device itself is also an ambient sound detection device; it may also include information on ambient sound sent by other ambient sound detection devices. In an embodiment of the present disclosure, the electronic device and other ambient sound detection devices can obtain information on ambient sound sent by other ambient sound detection devices based on the aforementioned communication connection method.

In step S12, after the electronic device obtains the information of the ambient sound of each ambient sound detection device, it determines whether there is an ambient sound with consistent information according to the preset judgment rule of whether the information of the ambient sound is consistent. Among them, the judgment rule can be set according to the various information in the ambient sound information. Exemplarily, the judgment rule can be set to the same sound source, or it can be set to the same sound source and the same collection location. For example, when the judgment rule is set to the same sound source, if the electronic device obtains the information of two ambient sounds "08:30 there is a baby crying sound" detected by the smart speaker and "08:30 there is a baby crying sound" detected by the smart camera, it indicates that there is an ambient sound with consistent information; if the electronic device obtains the information of two ambient sounds "08:30 there is a baby crying sound" detected by the smart speaker and "08:30 there is a doorbell ringing sound" detected by the smart camera, it indicates that there is no ambient sound with consistent information.

In step S13, when there is an ambient sound with consistent information, the electronic device can determine and push a notification message based on the order of the detection time of the ambient sound, or can determine and push a notification message based on the priority corresponding to the ambient sound detection device. The method of determining a notification message can be to select one from multiple ambient sound information as a notification message; or to generate a notification message based on multiple ambient sound information with consistent information, which is not limited in the embodiments of the present disclosure.

In the embodiments of the present disclosure, the electronic device may actively push the notification message to the device to be notified; or the device to be notified may poll the notification message in the electronic device. Among them, the notification message may include the device information for detecting the sound, the source of the sound, the collection location, etc., such as "the sound of a baby crying from the smart speaker in the bedroom in Nanjing". Figure 2 is a schematic diagram of an ambient sound notification message received by a mobile phone shown in an embodiment of the present disclosure. As shown in Figure 2, 201 is an interface for a mobile phone to receive a notification message pushed based on the ambient sound detected by itself; 202 is an interface for a mobile phone to receive a notification message pushed based on the information of the ambient sound detected by the smart camera; 203 is an interface for a mobile phone to receive a notification message pushed based on the information of the ambient sound detected by the smart camera; 204 is an interface for a mobile phone to receive a notification message with location information.

It should be noted that in the embodiments of the present disclosure, for ambient sounds with inconsistent information, the electronic device can push notification messages corresponding to each ambient sound. The electronic device can push the notification messages in the order of the detection time of each ambient sound, or according to the priority level corresponding to the detection device of each ambient sound, or according to the importance level corresponding to the sound source of each ambient sound, which is not limited by the embodiments of the present disclosure.

It can be understood that in the embodiments of the present disclosure, the electronic device can reduce the occurrence of unrecognized sounds and improve the accuracy of identifying ambient sounds by obtaining information on ambient sounds detected by multiple ambient sound detection devices; further, after determining that there is ambient sound with consistent information among the information on multiple ambient sounds, a notification message is determined and pushed for the ambient sound with consistent information, which can reduce the occurrence of repeated notifications of the same ambient sound and improve the efficiency of pushing ambient sound messages.

In some embodiments, the information of the ambient sound includes: the time when the ambient sound is detected and the sound source of the ambient sound;

The determining whether there is an ambient sound with consistent information according to the ambient sound information detected by each of the ambient sound detection devices includes:

If, among the information of the ambient sounds detected by each of the ambient sound detection devices, there is ambient sound having a consistent sound source and the time when the ambient sound is detected is within a preset time range, it is determined that there is ambient sound having consistent information.

In the disclosed embodiment, the ambient sound information includes the time when the ambient sound is detected and the sound source of the ambient sound. When the ambient sound detection device detects the ambient sound, the current time can be obtained and determined as the time when the ambient sound is detected. For example, at 9 o'clock in the morning, the smart speaker detects the sound of "ding dong, ding dong", and the smart speaker generates the ambient sound information of "the doorbell rings at 09:00".

In the disclosed embodiment, the electronic device obtains information about multiple pieces of ambient sound detected by multiple ambient sound detection devices, and can determine whether there is ambient sound with consistent information based on the time when the ambient sound is detected and the sound source of the ambient sound in the ambient sound information. If there is ambient sound with consistent sound source within a preset time range, it is determined that there is ambient sound with consistent information; if there is ambient sound with inconsistent sound source within the preset time range, it is determined that there is no ambient sound with consistent information; if there is ambient sound with consistent sound source, but the detection time of the ambient sound is not within the preset time range, it is determined that there is no ambient sound with consistent information.

Exemplarily, when the preset time range is "09:00:00 to 09:00:05", if there are three pieces of environmental sound information of "09:00:01 baby crying", "09:00:02 baby crying", and "09:00:03 baby crying", it is determined that there are three pieces of environmental sound information with consistent information; if there are three pieces of environmental sound information of "09:00:01 baby crying", "09:00:02 doorbell ringing", and "09:00:03 fire alarm ringing", it is determined that there are no environmental sounds with consistent information; if there are "09:00:02 baby crying", and "09:00:07 baby crying", it is determined that there are no environmental sounds with consistent information.

It can be understood that in the embodiments of the present disclosure, the electronic device determines whether there is ambient sound with consistent information based on the sound source in the ambient sound information and the time when the ambient sound is detected. Since multiple ambient sounds with the same sound source detected within a certain time range are very likely to be the same ambient sound, the electronic device only pushes one notification message for ambient sound with consistent information, which can improve the efficiency of pushing ambient sound messages.

In some embodiments, the ambient sound information further includes: a location where the ambient sound is collected;

The determining whether there is an ambient sound with consistent information according to the ambient sound information detected by each of the ambient sound detection devices includes:

If the information of the ambient sound detected by each of the ambient sound detection devices contains ambient sound with a consistent sound source, a collection position within a preset position difference range, and a time when the ambient sound is detected within a preset time range, it is determined that there is ambient sound with consistent information.

In the disclosed embodiment, the ambient sound information also includes the location where the ambient sound is collected, and the location where the ambient sound is collected can be information such as the city where the ambient sound is collected, the room where the ambient sound is collected, etc. The location where the ambient sound is collected can be based on the information pre-set by the user for the ambient sound detection device; or the location where the ambient sound is collected can be obtained in real time through the positioning function when the ambient sound detection device detects the surrounding ambient sound. For example, "the doorbell of the living room in Nanjing rang at 09:00"; another example is "there is the sound of running water in the kitchen in Nanjing at 09:20".

In the disclosed embodiment, the electronic device obtains information about multiple pieces of ambient sound detected by multiple ambient sound detection devices, and can determine whether there is ambient sound with consistent information based on the time when the ambient sound is detected in the ambient sound information, the sound source of the ambient sound, and the collection location of the ambient sound. If there is ambient sound with consistent sound source and consistent collection location within a preset time range, it is determined that there is ambient sound with consistent information; if there is ambient sound with inconsistent sound source and/or inconsistent collection location within the preset time range, it is determined that there is no ambient sound with consistent information; if there is ambient sound with consistent sound source and consistent collection location, but the detection time of the ambient sound is not within the preset time range, it is determined that there is no ambient sound with consistent information.

Exemplarily, when the preset time range is "09:00:00 to 09:01:00", if there are three pieces of environmental sound information of "09:00:01 Nanjing bedroom baby crying", "09:00:02 Nanjing bedroom baby crying", and "09:00:03 Nanjing bedroom baby crying", it is determined that there are three pieces of environmental sound information with consistent information; if there are two pieces of environmental sound information of "09:00:01 Nanjing bedroom baby crying", and "09:00:02 Nanjing living room baby crying", it is determined that there are no environmental sounds with consistent information; if there are "09:00:02 Nanjing bedroom baby crying", and "09:03:00 Nanjing bedroom baby crying", it is determined that there are no environmental sounds with consistent information.

In the embodiment of the present disclosure, the electronic device determines whether there is ambient sound with consistent information based on the sound source in the ambient sound information, the time when the ambient sound is detected, and the collection location of the ambient sound. Since multiple ambient sounds with the same sound source detected within a certain time range and position difference range are very likely to be the same ambient sound, the electronic device only pushes one notification message for ambient sound with consistent information, which can improve the efficiency of pushing messages for ambient sound.

In some embodiments, the electronic device includes a user terminal, and in response to the presence of the ambient sound consistent with the information, determining and pushing a notification message for the ambient sound consistent with the information includes:

In response to the existence of ambient sound with consistent information, a notification message is determined for the ambient sound with consistent information, and the notification message is pushed to a device associated with the same user account and/or the same family account as the user terminal.

In the embodiment of the present disclosure, the electronic device may be a user terminal, such as a mobile phone, a tablet computer, etc. FIG3 is an architecture diagram of a message push method shown in the embodiment of the present disclosure. As shown in FIG3, after each listening device (ambient sound detection device) detects the ambient sound information around the device, the ambient sound information is pushed to the user terminal (such as a mobile phone or a tablet computer) through each notification processing service, so that when the user terminal determines that there is an ambient sound with consistent information based on the acquired multiple ambient sound information, a notification message is determined for the ambient sound with consistent information and pushed.

In the disclosed embodiment, the user terminal can push the notification message to the device associated with the same user account. For example, as shown in FIG3 , the notification message is pushed to the watch and/or bracelet associated with the same user account as the user's mobile phone.

In the disclosed embodiment, the user terminal can also push notification messages to devices associated with the same family account as the electronic device. As shown in Figure 3, notification messages are pushed to devices associated with the same family account as the electronic device. For example, user one in Beijing and user two in Nanjing are associated with the same family account, and a mobile phone is associated with the user account of user one, and a smart watch is associated with the user account of user two. Then, when the mobile phone of user one obtains the information of the ambient sound, the notification message will be pushed to the mobile phone of user one and the smart watch of user two, and the notification message on the device of user one in Beijing will be shared with the device of user two in Nanjing. By pushing messages based on family accounts, messages of ambient sound can be pushed across regions.

It should be noted that, in some embodiments, the electronic device can obtain its own user account identifier and send the user account identifier to the server. The server queries the device identifiers of each associated device bound to the user account based on the user account identifier, and sends the device identifier to the electronic device, so that the electronic device can push messages based on each device identifier, so that the electronic device can push notification messages to each device associated with the same user account. In other embodiments, the electronic device can also store the device identifiers of devices associated with the same user account to push messages based on the pre-stored device identifiers.

In addition, the server can also query the family account identifier to which the user account belongs, thereby querying each user account bound to the family account, and then determine the device identifier of each associated device based on the user account, and send the device identifier of each device associated with the same family account as the electronic device to the electronic device, so that the electronic device can push notification messages to each device associated with the same family account. Of course, the electronic device can also store the device identifiers of devices associated with the same family account to push messages based on the pre-stored device identifiers. In the disclosed embodiment, when the user terminal implements the message push method, on the one hand, the user terminal can push notification messages to other devices associated with the same user account, so that each device under the same user account can receive the notification message, reducing the occurrence of missing messages when the user receives notifications through a single device, and improving the reliability of message push; on the other hand, the user terminal can also push notification messages to other devices associated with the same family account, so that each device under the same family account shares the notification message, expanding the scope of message push.

In some embodiments, the electronic device includes a server, and in response to the presence of the ambient sound consistent with the information, determining and pushing a notification message for the ambient sound consistent with the information includes:

In response to the existence of ambient sound with consistent information, a notification message is determined for the ambient sound with consistent information, and the notification message is pushed to a user terminal with the same user account and/or the same family account associated with the ambient sound detection device.

In the disclosed embodiment, the electronic device may be a server. After the server obtains the ambient sound information detected by each ambient sound detection device, when it is determined that there is ambient sound with consistent information based on multiple ambient sound information, a notification message is determined for the ambient sound with consistent information and is pushed.

In the disclosed embodiment, the server can push notification messages to devices associated with the same user account as the ambient sound detection device. For example, a smart bracelet associated with the same user account as a smart speaker or a smart camera, when the server obtains the information of the ambient sound detected by the smart speaker or the smart camera, the server pushes a notification message to the smart bracelet.

In the disclosed embodiment, the server can push notification messages to devices associated with the same family account as the ambient sound detection device. For example, a smart speaker and a smart camera are associated with the same family account, and the family account is also associated with the smart watch of user three and the mobile phone of user four. Then, when the server obtains the information of the ambient sound detected by the smart speaker and the smart camera, it will push notification messages to the smart watch of user three and the mobile phone of user four.

In the disclosed embodiment, the message push method can also be implemented on the server side, and the notification message can be pushed to each device under the same user account and/or the same family account associated with the ambient sound detection device. Pushing the notification message on the server side can improve the efficiency of the terminal receiving the notification message, because the server has a fast processing speed and the server can also reduce the consumption of terminal resources when running, thereby improving the efficiency of message push.

In some embodiments, the method further comprises: obtaining information characterizing the priority of each of the ambient sound detection devices;

In response to the existence of the ambient sound with the same information, determining and pushing a notification message for the ambient sound with the same information, includes:

In response to the existence of the environmental sound with the consistent information, for the environmental sound with the consistent information, the information of the environmental sound corresponding to the environmental sound detection device with the highest priority is determined as the notification message and pushed.

It should be noted that the ambient sound detection devices include various terminal devices such as mobile phones, tablet computers, smart speakers, and smart cameras. Different ambient sound detection devices may have different accuracy in sound recognition, and different ambient sound detection devices may also have different information processing speeds. For example, the accuracy of mobile phones in sound recognition is higher than that of smart cameras, and the accuracy of smart cameras in sound recognition is higher than that of smart speakers; for another example, the processing speed of mobile phones is higher than that of smart speakers, and the processing speed of smart speakers is higher than that of smart cameras. Therefore, priority information can be set for ambient sound detection devices based on the characteristics of each ambient sound detection device.

In the disclosed embodiment, the electronic device obtains information representing the priority of each ambient sound detection device, and the priority information can be represented by text information such as "high, medium, low", or by numerical information such as "1, 2, 3", where the smaller the number, the higher the priority. For example, the priority of an ambient sound detection device with high detection accuracy and fast detection speed can be set to high.

When the electronic device determines that there is environmental sound with consistent information, for the environmental sound with consistent information, the environmental sound information corresponding to the environmental sound detection device with the highest priority is determined as a notification message and pushed. For example, the priority of the mobile phone is pre-set to "high" and the priority of the smart speaker is "medium". When the electronic device obtains environmental sound with consistent information detected by the mobile phone and the smart speaker respectively, for example, the sound sources recognized by the mobile phone and the smart speaker are consistent, but the mobile phone collects the environmental sound earlier than the smart speaker; for another example, the sound sources recognized by the mobile phone and the smart speaker are consistent, but the positioning position of the mobile phone is more accurate, so the environmental sound information detected and sent by the mobile phone can be determined as a notification message, and the notification message can be pushed.

In the disclosed embodiment, the electronic device obtains the priority information of each ambient sound detection device, determines the ambient sound corresponding to the ambient sound detection device with the highest priority as the notification message, and when there are multiple ambient sounds with the same information, pushes the information of the ambient sound corresponding to the device with the best ambient sound detection function, thereby improving the accuracy of the electronic device in pushing ambient sound notification messages.

In some embodiments, the method further comprises:

Determining whether a function representing multi-device ambient sound detection in the electronic device is enabled;

The obtaining of information about ambient sound detected by at least two ambient sound detection devices respectively includes:

In response to the function characterizing multi-device ambient sound detection being turned on, information about the ambient sound respectively detected by the at least two ambient sound detection devices is obtained.

In an embodiment of the present disclosure, when it is determined that the function of representing multi-device ambient sound detection in an electronic device is turned on, the electronic device will obtain information about ambient sounds detected by at least two ambient sound detection devices respectively, and will determine and push notification messages based on the information about multiple ambient sounds, wherein the at least two ambient sound detection devices may include the electronic device itself. In addition, in an embodiment of the present disclosure, when it is determined that the function of representing the ambient sound detection of the electronic device itself is turned on, the electronic device will obtain information about the ambient sound detected by itself, and push the detected ambient sound information.

FIG4 is a schematic diagram of an ambient sound detection function setting interface of a mobile phone shown in an embodiment of the present disclosure. As shown in FIG4 , when “ambient sound recognition” (i.e., the above-mentioned function of representing the ambient sound detection by itself) is turned on, it represents the recognition of the surrounding ambient sound by the sound recognition component of the mobile phone itself; when “intelligent device recognition notification” (i.e., the above-mentioned function of representing the ambient sound detection of multiple devices) is turned on, it represents that the mobile phone can receive information about ambient sound recognized by at least two ambient sound detection devices. If the switch of “intelligent device recognition notification” is turned on, the ambient sound information actively reported by each ambient sound detection device communicating with the mobile phone after detecting the ambient sound can be received.

It should be noted that in the embodiments of the present disclosure, the electronic device can also set the sound source for receiving notification messages. For example, referring to FIG. 4 above, the "sound category" function can set the sound source for receiving notifications. When the "sound category" function is turned on, the mobile phone will notify the set sound category; for the unset sound category, even if the relevant ambient sound information is obtained, it will not be pushed, so that users can receive important notifications they care about as needed, avoiding frequent notifications of all sound categories to disturb users.

In the disclosed embodiment, by detecting whether the function representing multiple ambient sound detection in the electronic device is turned on, it is determined whether to use multiple devices for ambient sound detection and information push, so that the user can decide whether to turn on the multiple ambient sound detection function according to needs, which is highly intelligent.

Fig. 5 is a diagram of a message push device according to an exemplary embodiment. Referring to Fig. 5, in an optional embodiment, the device includes:

An acquisition module 501 is used to acquire information of ambient sound detected by at least two ambient sound detection devices respectively;

A determination module 502 is used to determine whether there is an environmental sound with consistent information according to the information of the environmental sound detected by each of the environmental sound detection devices;

The push module 503 is used to determine and push a notification message for the environmental sound with consistent information in response to the existence of the environmental sound with consistent information.

In some embodiments, the information of the ambient sound includes: the time when the ambient sound is detected and the sound source of the ambient sound; the determination module 502 is also used to determine that there is ambient sound with consistent information if there is ambient sound with consistent sound source and the time when the ambient sound is detected is within a preset time range in the information of the ambient sound detected by each of the ambient sound detection devices.

In some embodiments, the information of the ambient sound also includes: the collection location of the ambient sound; the determination module 502 is also used to determine the existence of ambient sound with consistent information if, in the information of the ambient sound detected by each of the ambient sound detection devices, there is ambient sound with a consistent sound source, a collection location within a preset location difference range, and a time when the ambient sound is detected within a preset time range.

In some embodiments, the electronic device includes a user terminal, and the push module 503 is further used to determine a notification message in response to the presence of ambient sound consistent with the information, and push the notification message to a device associated with the same user account and/or the same family account as the user terminal.

In some embodiments, the electronic device includes a server, and the push module 503 is also used to determine a notification message in response to the existence of ambient sound consistent with the information, and push the notification message to a user terminal associated with the same user account and/or the same family account as the ambient sound detection device.

In some embodiments, the acquisition module 501 is also used to obtain information representing the priority of each of the ambient sound detection devices; the push module 503 is also used to respond to the existence of ambient sounds with consistent information, and for the ambient sounds with consistent information, determine the information of the ambient sound corresponding to the ambient sound detection device with the highest priority as the notification message and push it.

In some embodiments, the device also includes: a detection module, used to determine whether the function of characterizing multi-device ambient sound detection in the electronic device is turned on; the acquisition module 501 is also used to obtain the information of the ambient sound detected by the at least two ambient sound detection devices respectively in response to the function of characterizing multi-device ambient sound detection being turned on.

Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

Fig. 6 is a block diagram of an electronic device 800 according to an exemplary embodiment. For example, the device 800 may be a mobile phone, a mobile computer, etc.

6 , the device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input/output (I/O) interface 812 , a sensor component 814 , and a communication component 816 .

The processing component 802 generally controls the overall operation of the device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

The power component 806 provides power to the various components of the device 800. The power component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 800.

The multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and/or a rear camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the device 800 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

I/O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the device 800. For example, the sensor assembly 814 can detect the open/closed state of the device 800, the relative positioning of components, such as the display and keypad of the device 800, and the sensor assembly 814 can also detect the position change of the device 800 or a component of the device 800, the presence or absence of user contact with the device 800, the orientation or acceleration/deceleration of the device 800, and the temperature change of the device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to facilitate wired or wireless communication between the device 800 and other devices. The device 800 can access a wireless network based on a communication standard, such as Wi-Fi, 4G or 5G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, the apparatus 800 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above method.

In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, and the instructions can be executed by the processor 820 of the device 800 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of a terminal, enables the terminal to perform an information processing method, the method comprising:

Obtaining information about ambient sounds detected by at least two ambient sound detection devices respectively;

Determining whether there is environmental sound with consistent information based on the environmental sound information detected by each of the environmental sound detection devices;

In response to the existence of the ambient sound that is consistent with the information, a notification message is determined and pushed for the ambient sound that is consistent with the information.

Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the claims above.

It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (10)

1. A message push method, characterized in that it is applied to an electronic device, the method comprising: Obtaining information about ambient sounds detected by at least two ambient sound detection devices respectively; Determining whether there is environmental sound with consistent information based on the environmental sound information detected by each of the environmental sound detection devices; In response to the existence of the ambient sound that is consistent with the information, a notification message is determined and pushed for the ambient sound that is consistent with the information. 2. The method according to claim 1, characterized in that the information of the ambient sound includes: the time when the ambient sound is detected and the sound source of the ambient sound; The determining whether there is an ambient sound with consistent information according to the ambient sound information detected by each of the ambient sound detection devices includes: If, among the information of the ambient sounds detected by each of the ambient sound detection devices, there is ambient sound having a consistent sound source and the time when the ambient sound is detected is within a preset time range, it is determined that there is ambient sound having consistent information. 3. The method according to claim 2, characterized in that the information of the ambient sound further includes: the collection location of the ambient sound; The determining whether there is an ambient sound with consistent information according to the ambient sound information detected by each of the ambient sound detection devices includes: If the information of the ambient sound detected by each of the ambient sound detection devices contains ambient sound with a consistent sound source, a collection position within a preset position difference range, and a time when the ambient sound is detected within a preset time range, it is determined that there is ambient sound with consistent information. 4. The method according to claim 1, wherein the electronic device comprises a user terminal, and the step of determining and pushing a notification message for the environmental sound with consistent information in response to the presence of the environmental sound with consistent information comprises: In response to the existence of ambient sound with consistent information, a notification message is determined for the ambient sound with consistent information, and the notification message is pushed to a device associated with the same user account and/or the same family account as the user terminal. 5. The method according to claim 1, wherein the electronic device comprises a server, and in response to the presence of the ambient sound with the same information, determining and pushing a notification message for the ambient sound with the same information, comprises: In response to the existence of ambient sound with consistent information, a notification message is determined for the ambient sound with consistent information, and the notification message is pushed to a user terminal with the same user account and/or the same family account associated with the ambient sound detection device. 6. The method according to claim 1, characterized in that the method further comprises: Acquire information representing the priority of each of the ambient sound detection devices; In response to the existence of the ambient sound with the same information, determining and pushing a notification message for the ambient sound with the same information, includes: In response to the existence of the environmental sound with the consistent information, for the environmental sound with the consistent information, the information of the environmental sound corresponding to the environmental sound detection device with the highest priority is determined as the notification message and pushed. 7. The method according to claim 1, characterized in that the method further comprises: Determining whether a function representing multi-device ambient sound detection in the electronic device is enabled; The obtaining of information about ambient sound detected by at least two ambient sound detection devices respectively includes: In response to the function characterizing multi-device ambient sound detection being turned on, information about the ambient sound respectively detected by the at least two ambient sound detection devices is obtained. 8. A message push device, characterized in that the device comprises: An acquisition module, used to acquire information of ambient sound detected by at least two ambient sound detection devices respectively; A determination module, used to determine whether there is an ambient sound with consistent information based on the information of the ambient sound detected by each of the ambient sound detection devices; The push module is used to determine and push a notification message for the environmental sound consistent with the information in response to the existence of the environmental sound consistent with the information. 9. An electronic device, comprising: processor; a memory for storing processor-executable instructions; The processor is configured to execute the message pushing method as described in any one of claims 1 to 7. 10. A non-transitory computer-readable storage medium, characterized in that when the instructions in the storage medium are executed by a processor of a terminal, the terminal is enabled to execute the message pushing method according to any one of claims 1 to 7.