CN115534812A - Method and device for reminding vehicle exterior warning signal - Google Patents

Abstract

The present invention relates to the technical field of driving assistance systems, in particular to a method and device for reminding warning signals outside a vehicle, including a system-on-a-chip that is standard equipped with the vehicle itself and an audio component connected to it, a camera module, a distance measuring module, a display module and a vehicle window Based on the status acquisition module, some external pickup modules or interior pickup modules are added to automatically identify various usage scenarios. When the driver cannot effectively obtain warning signals outside the vehicle, the external monitoring is performed to obtain the external audio. The system intelligently judges whether there is a warning signal, so as to determine whether to prompt the driver, and then display the external warning signal in the form of audio and video in a timely manner, so that the user can make timely and effective responses to ensure the safety of the user's driving while improving the user's driving. Experience, high vehicle safety, low assembly cost.

Description

Reminder method and device for warning signal outside vehicle

technical field

The invention relates to the technical field of driving assistance systems, in particular to a method and device for reminding warning signals outside a vehicle.

Background technique

With the improvement of people's requirements for the comfort of the car environment, more and more cars are equipped with passive noise reduction or even active noise reduction functions, but while bringing users a quiet and comfortable driving experience, there are also certain security risks. When there are other warning signals such as the whistle of other vehicles, or the sirens of public security organs on duty such as 110, 120, 119, etc., these warning signals transmitted through sound are often actively noise-reduced Or passive noise reduction is eliminated, causing users to hinder the public security organs from performing their duties and even cause traffic accidents. In addition, traditional cars also have the same problem when the environment inside the car is noisy, or when music is played at a high volume. Therefore, it is necessary to provide a method for users to obtain external warning signals in a timely manner.

The current existing technology can only prompt the user audibly, and only roughly judges the direction of the warning sound source. When the feedback is given to the user, it is also reflected in the auditory sense in a relatively vague way, which is not intuitive or accurate enough to assist the user to quickly and effectively response. Its coverage of the scene is not sufficient, only based on the status of the window to determine whether to open the function, but when the window is open, if the car is in a noisy environment, the user needs to manually open the function, for users who have been in a noisy environment in the car for a long time It is still difficult to quickly and easily obtain warning signals from the outside world.

Contents of the invention

The invention provides a reminding method and device for warning signals outside the vehicle, which solves the technical problem that the existing auxiliary driving system cannot effectively identify the warning signals outside the vehicle and remind the driver in time, causing potential safety hazards in driving the vehicle.

In order to solve the above technical problems, the present invention provides a reminder method for warning signals outside the vehicle, comprising the steps of:

S1. Obtain the status information of the current vehicle;

S2. Determine the vehicle scene according to the state information, and then enter the next step when the vehicle scene meets the reminder condition;

S3. Execute monitoring outside the vehicle to obtain and identify the audio outside the vehicle, and enter the next step when it is recognized that the audio outside the vehicle contains a warning signal;

S4. Locate the sound source target corresponding to the warning signal, and give an avoidance reminder.

This basic solution automatically recognizes various vehicle usage scenarios. When the driver cannot effectively obtain the warning signal outside the vehicle, it performs outside monitoring to obtain the audio outside the vehicle. The system intelligently judges whether there is a warning signal, so as to determine whether to prompt the driver, and then It can display external warning signals in the form of audio and video in a timely manner, so that users can make timely and effective responses.

In a further embodiment, in the step S1: the status information includes the current vehicle's in-vehicle sound pickup data and the status of the window opening.

In a further embodiment, said step S2 comprises the steps of:

S21. Determine whether the environment in the car is noisy according to the sound pickup data in the car, if not, go to step S22, if not, go to step S23;

S22. Determine whether the noise reduction of the vehicle is turned on according to the opening state of the vehicle window, if not, determine that the current vehicle is in scene one, and if so, determine that the current vehicle is in scene three;

S23. Determine whether the noise reduction of the vehicle is turned on according to the opening state of the vehicle window, if not, determine that the current vehicle is in scene two, and if so, determine that the current vehicle is in scene four;

S24. Determine whether the current vehicle is in scene one, if so, end the reminder process, otherwise enter the next step.

Based on the interference of the vehicle environment on the driver's acquisition of warning signals, this solution divides 4 types of vehicle scenarios (Scene 1, Scene 2, Scene 3 and Scene 4), through real-time collection of in-vehicle sound pickup data and window opening status determination Whether the driver can recognize the warning signal without any influence, if not, enter the next step of the external monitoring and reminder process, and use technological monitoring to assist the driver to obtain the warning signal, thereby improving the safe driving performance of the vehicle.

In a further embodiment, said step S3 comprises the steps of:

S31. Start the pickup device outside the car to monitor outside the car to obtain audio outside the car;

S32. Acquiring the volume of background noise to set a dynamic threshold;

S33. When a target audio signal exceeding the dynamic threshold is obtained from the audio outside the vehicle, compare the target audio signal with the warning database, and if the comparison is successful, determine that the audio outside the vehicle contains a warning signal Enter the next step, otherwise end the reminder process;

The warning database includes at least one audio frequency spectrum of a warning signal, and the warning signal includes a siren of a car and one or more of 110 alarm sounds, 120 alarm sounds, and 119 alarm sounds.

In a further embodiment, in the step S33, the comparing the target audio signal with the warning database is specifically: performing spectrum analysis on the target audio signal to obtain its acquisition frequency characteristics, and The collected frequency features are compared with the audio frequency spectrum in the warning database.

This program sets a dynamic threshold to filter out the background noise in the vehicle environment, and effectively extract the target audio signal in the audio outside the vehicle; by analyzing the frequency characteristics of the current warning signal, a warning database is established to analyze the audio frequency spectrum of the warning signal When the target audio signal of the grass carp dynamic threshold is obtained, it is directly compared with the warning database to quickly determine whether there is a warning signal, effectively improving the recognition efficiency.

In a further embodiment, said step S4 comprises the steps of:

S41. Using the multilateration principle to determine the sound source direction of the sound source target corresponding to the warning signal;

S42. Perform distance measurement according to the direction of the sound source, acquire the relative position of the sound source target and the vehicle, and then generate and display a corresponding relative position map, and at the same time give a voice reminder.

This solution measures the direction and distance of the sound source for the sound source target outside the vehicle, so that the accurate positioning of the sound source target can be obtained, the corresponding relative position map is generated and displayed, and the voice reminder is given at the same time. With double reminders, the user is given an intuitive And accurate tips.

In a further embodiment, the present invention further comprises the steps of:

S5. Obtain the real-scene picture behind the vehicle, mark the sound source target on the real-scene picture and carry out a picture display reminder; and/or turn on the transparent mode, switch the audio output in the current vehicle to the real-time collected target audio signal.

This solution also has a selective prompt option. Through the real-time picture annotation display and the real-time playback of the target audio signal, the warning signal outside the car can be fed back to the user in a more intuitive and accurate manner in a timely manner, ensuring the driving safety of the user. At the same time improve the user's driving experience.

The present invention provides a reminder device for warning signals outside the vehicle, which is applied to realize the above-mentioned reminder method for warning signals outside the vehicle, including a system on chip and an audio component connected thereto, a camera module, a distance measuring module, a display module and a vehicle window A state acquisition module; the audio module includes a sound pickup module in the car, a sound pickup module outside the car and an audio playback module;

The sound pickup module in the car is installed in the cockpit for picking up the environment in the cockpit to obtain sound pickup data in the car;

The window status acquisition module is used to acquire the window opening status;

The system-on-a-chip is used to determine the vehicle scene according to the sound pickup data in the vehicle and the opening state of the vehicle window;

The sound pickup module outside the car is installed on the rear end of the car body, and is used for picking up sound in the environment outside the car to obtain the audio outside the car, and determine the sound source direction of the warning signal corresponding to the sound source target;

The ranging module is also installed at the rear end of the vehicle body for performing distance measurement and obtaining the relative distance between the sound source target and the vehicle;

The system-on-a-chip is used to identify the target audio signal in the audio outside the vehicle, locate the sound source target according to the sound source direction and the relative distance, and control the camera module, the audio playback module, The display module performs an avoidance reminder;

The camera module is installed directly behind the vehicle, and is used to shoot the real scene picture behind the vehicle;

The audio playback module is used for voice reminder or output real-time collected target audio signal;

The display module is used for displaying the relative position map and/or the real picture.

In a further embodiment, the sound pickup module outside the vehicle is installed on the outside of the vehicle body close to the distance measuring module, corresponding to the distance measuring modules one by one.

This solution is based on the standard system-on-chip of the vehicle itself and the audio components connected to it, the camera module, the distance measurement module, the display module and the window state acquisition module, and adds some external pickup modules or interior pickup modules, namely The above-mentioned reminder method can be applied to realize automatic recognition of vehicle scenes, automatic capture of warning signals outside the vehicle, and timely feedback of warning signals to users through screen and voice, so as to ensure the safety of driving and improve the safety of users. Driving experience, high vehicle safety, low assembly cost.

Description of drawings

Fig. 1 is a working flow diagram of a reminder method for a warning signal outside a vehicle provided by an embodiment of the present invention;

Fig. 2 is a system frame diagram of a reminder device for warning signals outside a vehicle provided by an embodiment of the present invention;

FIG. 3 is a schematic diagram of the installation of the external sound pickup module 7 provided by the embodiment of the present invention.

detailed description

The embodiment of the present invention will be explained in detail below in conjunction with the accompanying drawings. The examples given are only for the purpose of illustration, and cannot be interpreted as limiting the present invention. The accompanying drawings are only for reference and description, and do not constitute the scope of patent protection of the present invention. limitations, since many changes may be made in the invention without departing from the spirit and scope of the invention.

Example 1

The embodiment of the present invention provides a method and device for reminding warning signals outside the vehicle, as shown in Figure 1, in this embodiment, steps S1 to S5 are included:

S1. After the vehicle is started, manually or automatically start the system to obtain the status information of the current vehicle;

In this embodiment, the status information includes the current vehicle interior sound pickup data, and the status of the windows being opened.

In this embodiment, a detection mechanism can be specifically set. After the vehicle engine is started, the user can selectively turn on or off the detection mechanism, enter steps S1-S5, and continuously detect whether there is a warning signal outside the vehicle until the engine is turned off.

S2. Determine the vehicle scene according to the state information, and then enter the next step when the vehicle scene meets the reminder condition, including steps S21-S24:

S21, judge whether the environment in the car is noisy according to the sound pickup data in the car, if not, go to step S22, if not, go to step S23;

S22. Determine whether the noise reduction of the vehicle is turned on according to the opening state of the window, if not, determine that the current vehicle is in scene one, and if so, determine that the current vehicle is in scene three;

S23. Determine whether the noise reduction of the vehicle is turned on according to the open state of the window, if not, determine that the current vehicle is in scene two, and if so, determine that the current vehicle is in scene four;

S24. Determine whether the current vehicle is in scene one, if so, end the reminder process, otherwise enter the next step.

The specific scenarios are divided into the following table 1:

Table 1

This embodiment divides 4 types of vehicle scenes (scene one, scene two, scene three and scene four) based on the interference of the in-vehicle environment on the driver's acquisition of warning signals. Determine whether the driver can recognize the warning signal without any impact, if not, enter the next step of the monitoring and reminder process outside the car, and use technological monitoring to assist the driver to obtain the warning signal, thereby improving the safe driving performance of the vehicle.

S3. Execute monitoring outside the vehicle to obtain and identify the audio outside the vehicle. When it is recognized that the audio outside the vehicle contains a warning signal, proceed to the next step, including steps S31 to S33:

S31. Start the pickup device outside the car to monitor outside the car to obtain audio outside the car;

S32. Acquiring the volume of background noise to set a dynamic threshold;

In this embodiment, the dynamic threshold can be set in real time according to the volume of the background noise, so as to effectively avoid false triggering of the program in a noisy environment.

S33. When the target audio signal exceeding the dynamic threshold is obtained from the audio outside the vehicle, compare the target audio signal with the warning database, and if the comparison is successful, enter the next step when it is determined that the audio outside the vehicle contains a warning signal, otherwise end this chapter reminder process;

Wherein, the warning database includes at least one audio frequency spectrum of a warning signal, and the warning signal includes a siren of a car and one or more of 110 alarm sounds, 120 alarm sounds, and 119 alarm sounds.

In this embodiment, comparing the target audio signal with the warning database specifically includes: performing spectrum analysis on the target audio signal to obtain its collection frequency characteristics, and comparing the collection frequency characteristics with the audio spectrum in the warning database.

This embodiment sets the dynamic threshold to filter out the background noise in the vehicle environment and effectively extract the target audio signal in the audio outside the vehicle; by analyzing the frequency characteristics of the current warning signal, a warning database is established to carry out the audio frequency spectrum of the warning signal When the target audio signal of the grass carp dynamic threshold is obtained, it is directly compared with the warning database to quickly determine whether there is a warning signal and effectively improve the recognition efficiency.

S4. Locate the sound source target corresponding to the warning signal, and give an avoidance reminder, including steps S41-S42:

S41. Using the principle of multipoint positioning to determine the sound source direction of the sound source target corresponding to the warning signal;

S42. Measure the distance according to the direction of the sound source, obtain the relative position of the sound source target and the own vehicle, and then generate and display the corresponding relative position map, and at the same time give a voice reminder.

In this embodiment, the sound source direction measurement and distance measurement are performed on the sound source target outside the vehicle, and the accurate positioning of the sound source target can be obtained, and the corresponding relative position map is generated and displayed, and the voice reminder is given at the same time. Under the double reminder, the user is intuitive specific and accurate prompts.

S5. Obtain the real-scene picture behind the vehicle, mark the sound source target on the real-scene picture, and perform a picture display reminder; and/or turn on the transparent mode, and switch the audio output in the current vehicle to the target audio signal collected in real time.

In this embodiment, the driver can proceed to step S5 according to the selection, for example, an option "whether to display the real scene image" and/or "whether to enable the see-through mode" pops up on the central control screen.

This embodiment is also provided with a selective prompt option. Through the real-time picture annotation display and the real-time playback of the target audio signal, the warning signal outside the car is fed back to the user in a more intuitive and accurate manner in a timely manner, ensuring the driving safety of the user. while improving the user's driving experience.

In the embodiment of the present invention, by automatically identifying various vehicle use scenarios, when the driver cannot effectively obtain the warning signal outside the vehicle, the vehicle is monitored outside the vehicle to obtain the audio outside the vehicle, and the system intelligently judges whether there is a warning signal, so as to determine whether to prompt the driver. Furthermore, external warning signals can be displayed in the form of audio and video in a timely manner, so that users can make timely and effective responses.

Example 2

The reference numerals in the accompanying drawings of the embodiment of the present invention include: system-on-chip 1, camera module 2, distance measuring module 3, display module 4, vehicle window status acquisition module 5, in-vehicle sound pickup module 6, and out-of-vehicle sound pickup module 7 , audio playback module 8.

An embodiment of the present invention provides a warning device for warning signals outside a vehicle, referring to FIG. 2 and FIG. Connected audio components, camera module 2, distance measuring module 3, display module 4 and vehicle window status acquisition module 5; the audio module includes a sound pickup module 6 inside the car, a sound pickup module 7 outside the car and an audio playback module 8;

The pickup module 6 in the car is installed in the cockpit for picking up the environment in the cockpit to obtain the pickup data in the car;

The window status acquisition module 5 is used to acquire the window opening status;

The system-on-chip 1 is used to determine the vehicle scene according to the sound pickup data in the vehicle and the opening state of the vehicle window;

The sound pickup module 7 outside the car is installed at the rear end of the car body, and is used for picking up the sound outside the car to obtain the audio outside the car and determine the sound source direction of the warning signal corresponding to the sound source target;

The distance measuring module 3 is also installed on the rear end of the vehicle body, and is used to perform distance measurement to obtain the relative distance between the sound source target and the vehicle;

The system on chip 1 is used to identify the target audio signal in the audio outside the car, and locate the sound source target according to the direction of the sound source and the relative distance, and control the camera module 2, the audio playback module 8, and the display module 4 to perform avoidance reminders;

Specifically, the system-on-chip 1 performs data analysis on the signals with the same frequency characteristics collected on the loudest external pickup module 7 and its two adjacent external pickup modules 7 to locate the direction of the sound source. The relative positions where the three pickup modules are installed combine the amplitude difference and phase difference between the collected target audio signals to calculate the direction of the localized sound source. After the direction of the sound source is obtained, the distance of the sound source target is obtained through the ranging module 3, and then a relative position map of the sound source target and the vehicle is generated and displayed on the central control screen.

The camera module 2 is installed directly behind the vehicle, and is used to photograph the real scene picture behind the vehicle;

The audio playing module 8 is used for voice prompting or outputting target audio signals collected in real time; including a power amplifier and a loudspeaker.

The display module 4 is used to display the relative position map and/or the real picture, including the screen drive and the central control screen.

In this embodiment, the sound pickup module 7 outside the vehicle is installed on the outside of the rear end of the vehicle body close to the distance measuring module 3 , corresponding to the distance measuring module 3 one by one.

Since the driver can see the vehicle conditions in front, there is no need to monitor, just monitor the rear of the vehicle, as shown in the figure, install an external sound pickup module 7 and a distance measuring module 3 at the positions indicated by the arrows of the vehicle. The solution does not limit the specific number, and the recognition accuracy of the sound source direction can be improved by increasing the number of sound pickup modules 7 and distance measuring modules 3 outside the vehicle.

The embodiment of the present invention is based on the standard system-on-chip 1 of the vehicle itself and the audio components connected to it, the camera module 2, the distance measurement module 3, the display module 4 and the vehicle window state acquisition module 5, and adds a part of the external sound pickup module 7 Or the sound pickup module 6 in the car can apply the above-mentioned reminder method, from realizing the automatic recognition of the vehicle scene, the automatic capture of the warning signal outside the car, and then timely feedback the warning signal to the user through the mode of picture and voice, ensuring that the user While driving safety, the user's driving experience is improved, the vehicle safety is high, and the assembly cost is low.

The above-mentioned embodiment is a preferred embodiment of the present invention, but the embodiment of the present invention is not limited by the above-mentioned embodiment, and any other changes, modifications, substitutions, combinations, Simplifications should be equivalent replacement methods, and all are included in the protection scope of the present invention.

Claims (9)

1. A reminding method of a warning signal outside a vehicle is characterized by comprising the following steps:

s1, acquiring state information of a current vehicle;

s2, determining a vehicle scene according to the state information, and entering the next step when the vehicle scene meets a reminding condition;

s3, monitoring outside the vehicle to obtain the audio outside the vehicle and identify the audio, and entering the next step when the audio outside the vehicle is identified to contain a warning signal;

and S4, positioning the sound source target corresponding to the warning signal, and performing avoidance reminding.

2. A method for reminding an outside warning signal of a vehicle as claimed in claim 1, wherein in said step S1: the state information comprises the pickup data in the vehicle and the opening state of the vehicle window of the current vehicle.

3. A method for reminding an outside warning signal of a vehicle as claimed in claim 2, wherein said step S2 comprises the steps of:

s21, judging whether the environment in the car is noisy according to the pickup data in the car, if not, entering the step S22, and if so, entering the step S23;

s22, judging whether the noise reduction of the vehicle is started or not according to the opening state of the vehicle window, if not, determining that the current vehicle is in a first scene, and if so, determining that the current vehicle is in a third scene;

s23, judging whether the noise reduction of the vehicle is started or not according to the opening state of the vehicle window, if not, determining that the current vehicle is in a second scene, and if so, determining that the current vehicle is in a fourth scene;

and S24, judging whether the current vehicle is in the scene I, if so, ending the reminding process, and if not, entering the next step.

4. A method for reminding an outside warning signal of a vehicle as claimed in claim 1, wherein said step S3 comprises the steps of:

s31, starting an external sound pickup device to execute external monitoring to acquire external audio;

s32, acquiring background noise volume to set a dynamic threshold;

s33, when a target audio signal exceeding the dynamic threshold value is obtained from the outside audio, comparing the target audio signal with a warning database, if the comparison is successful, determining that the outside audio contains a warning signal, entering the next step, and if not, ending the reminding process;

the warning database at least comprises an audio frequency spectrum of a warning signal, wherein the warning signal comprises a whistle sound of an automobile and one or more of a 110 warning sound, a 120 warning sound and a 119 warning sound.

5. The method for reminding an outside vehicle alarm signal according to claim 4, wherein in the step S33, the comparing the target audio signal with an alarm database specifically comprises: and carrying out spectrum analysis on the target audio signal to obtain the collection frequency characteristic of the target audio signal, and comparing the collection frequency characteristic with the audio frequency spectrum in the warning database.

6. A method for reminding an outside warning signal of a vehicle as claimed in claim 1, wherein said step S4 comprises the steps of:

s41, determining the sound source direction of a sound source target corresponding to the warning signal by adopting a multipoint positioning principle;

and S42, performing distance measurement according to the direction of the sound source, acquiring the relative position of the sound source target and the vehicle, further generating and displaying a corresponding relative position map, and simultaneously performing voice reminding.

7. The method for reminding an outside-vehicle warning signal as claimed in claim 4, further comprising the steps of:

s5, acquiring a live-action picture behind the vehicle, and carrying out picture display reminding after the sound source target is marked on the live-action picture; and/or opening a through mode, and switching the audio output in the current vehicle into the target audio signal acquired in real time.

8. A reminding device of a warning signal outside a vehicle is applied to realize the reminding method of the warning signal outside the vehicle as claimed in any one of claims 1 to 7, and is characterized in that: the system comprises a system on chip, and an audio component, a camera module, a distance measuring module, a display module and a vehicle window state acquisition module which are connected with the system on chip; the audio module comprises an in-vehicle pickup module, an out-vehicle pickup module and an audio playing module;

the in-vehicle pickup module is arranged in the cockpit and used for picking up the environment in the cockpit to obtain in-vehicle pickup data;

the vehicle window state acquisition module is used for acquiring a vehicle window opening state;

the system on chip is used for determining a vehicle scene according to the pickup data in the vehicle and the opening state of the vehicle window;

the pickup module outside the vehicle is arranged at the rear end outside the vehicle body and used for picking up the sound of the environment outside the vehicle to obtain the audio outside the vehicle and determining the sound source direction of the warning signal corresponding to the sound source target;

the distance measurement module is also arranged at the rear end outside the vehicle body and is used for executing distance measurement and acquiring the relative distance between the sound source target and the vehicle;

the system on chip is used for identifying a target audio signal in the external audio, positioning the sound source target according to the sound source direction and the relative distance, and controlling the camera module, the audio playing module and the display module to execute avoidance reminding;

the camera module is arranged right behind the vehicle and is used for shooting a real scene picture behind the vehicle;

the audio playing module is used for carrying out voice reminding or outputting a target audio signal acquired in real time;

the display module is used for displaying the relative position graph and/or the live-action picture.

9. The reminding device of the warning signal outside the vehicle as claimed in claim 8, wherein: the pickup module outside the car is close to the ranging module is installed outside the car body, with ranging module one-to-one.

Images