KR102603896B1 - Visualization method for external sound source of vehicle - Google Patents

Abstract

The present invention includes a first step of recording sound sources outside the vehicle through a plurality of microphones, a second step of analyzing each of the sound sources to select one of the sound sources as a display sound source, and checking information about the display sound source. a third step of converting information about the display sound source into an electrical signal and transmitting it to a display unit installed in the vehicle, and a fourth step of visualizing the display sound source by the display unit. Provides a method of visualizing sound sources.

Description

Visualization method for external sound source of vehicle}

The present invention relates to a method for visualizing sound sources external to a vehicle, and more specifically, to a method for visualizing sound sources external to a vehicle to visually convey information about the driving environment to a driver.

In general, various sounds can occur inside and outside a running vehicle. In addition, as vehicle manufacturing technology develops, functions that help the convenience of vehicle operation are developed, and at the same time, sound insulation and acoustic technology to block noise outside the vehicle are acting as a factor in consumers' purchasing decisions.

Expensive vehicles have advanced soundproofing equipment to the point where most external noise is blocked, but for general vehicles, due to the relatively low production cost, they mainly rely on acoustic technology to block external noise. However, sound insulation methods that rely on acoustic technology cannot distinguish between simple noise and traffic situation information, making it difficult for drivers to recognize the risk of accidents that may occur from horn sounds around the vehicle and driving blind spots.

Meanwhile, hearing-impaired drivers are insensitive to various sounds while driving (for example, vehicle crash sounds, horn sounds, sirens, etc.), so they can easily get into an unexpected accident from a blind spot such as the rear of the vehicle. Therefore, there is a need for the vehicle to provide the driver with driving environment information, such as what sounds are generated around and from which direction, by visualizing them to help the driver's overall driving control.

Republic of Korea Patent Publication No. 10-2017-0054714 (2017.05.18)

The purpose of the present invention, which was devised to solve the above-mentioned problems, is to provide a method of visualizing sound sources external to the vehicle that visually conveys information about the driving environment to the driver.

In order to achieve the above-described object, an embodiment of the present invention includes a first step of recording sound sources from outside the vehicle through a plurality of microphones, analyzing each of the sound sources, and selecting one of the sound sources as a display sound source. A second step of selecting and confirming information about the display sound source, a third step of converting the information about the display sound source into an electrical signal and transmitting it to the display unit installed in the vehicle, and the display sound source is displayed by the display unit. It includes the fourth step of visualization.

In one embodiment of the present invention, in the second step, the information about the display sound source may be a direction toward the display sound source and a volume of the display sound source.

In one embodiment of the present invention, in the third step, information about the display sound source may be transmitted to the display unit from a microphone in which a sound source with the highest volume among the plurality of microphones is recorded.

In one embodiment of the present invention, the display unit is a windshield of the vehicle, and may be divided into a plurality of display areas along an inner edge of the display unit.

In one embodiment of the present invention, in the third step, information about the display sound source may be transmitted to the display area from a microphone in which a sound source with the highest volume among the plurality of microphones is recorded.

In one embodiment of the present invention, the display area may include a front display area, a rear display area, a left room display area, a right room display area, and first to fourth corner display areas.

In one embodiment of the present invention, the number of display areas is equal to the number of microphones, and each display area may be individually electrically connected to each microphone.

In one embodiment of the present invention, the display unit may be comprised of a plurality of light emitting elements arranged along an inner edge of the display unit.

In one embodiment of the present invention, the light emitting device may display the volume of the sound for the display sound source on the display unit based on the amount of light and Red-Green-Blue (RGB).

According to the problem solving means of the present invention as discussed above, various effects including the following can be expected. However, the present invention does not require all of the following effects to be achieved.

The method for visualizing external sound sources of a vehicle according to an embodiment of the present invention provides real-time situational information around the vehicle to elderly and hearing-impaired drivers by visually providing information on external sound sources of the vehicle recorded from a microphone in the vehicle on the display unit. It can be delivered.

In addition, the display unit is provided with a plurality of display areas, so that unexpected situations around the vehicle that may occur while the driver is driving are provided as information in a specific direction visualized based on the amount of light and RGB (Red-Green-Blue), so that the vehicle can be careful. You can recognize the situation specifically.

1 is a flowchart showing a method for visualizing sound sources external to a vehicle according to the present invention.
Figure 2 is a diagram for explaining the principle of recording sound sources outside a vehicle according to the present invention.
Figures 3 and 4 are schematic diagrams showing the principle of displaying recorded external sound sources of a vehicle on a display unit using light quantity and RGB according to the present invention.
Figure 5 is a diagram showing the principle by which information about surrounding situations is transmitted to the driver while the vehicle is driving according to the present invention.
Figure 6 is a diagram showing the principle by which information about the surrounding situation is transmitted to the driver while the vehicle is waiting for a signal according to the present invention.
7 and 8 are schematic diagrams showing the principle of displaying a recorded external sound source of a vehicle according to the present invention on a display unit using light quantity and RGB, according to another embodiment.

In order to fully understand the configuration and effects of the present disclosure, preferred embodiments of the present disclosure will be described with reference to the attached drawings. However, the present disclosure is not limited to the embodiments disclosed below, and may be implemented in various forms and various changes may be made. Hereinafter, in describing the present invention, if it is determined that related known functions may unnecessarily obscure the gist of the present invention as they are obvious to those skilled in the art, the detailed description thereof will be omitted.

Terms such as first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The above terms may be used only for the purpose of distinguishing one component from another. For example, a first component may be referred to as a second component, and similarly, the second component may be referred to as a first component without departing from the scope of the present disclosure.

The terms used in this application are merely used to describe specific embodiments and are not intended to limit the invention. Singular expressions include plural expressions unless the context clearly dictates otherwise.

In this application, terms such as “comprise” or “have” are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more other features. It should be understood that this does not exclude in advance the possibility of the existence or addition of elements, numbers, steps, operations, components, parts, or combinations thereof. Unless otherwise defined, terms used in the embodiments of the present disclosure may be interpreted as meanings commonly known to those skilled in the art.

Hereinafter, specific embodiments of the present invention will be described in detail with reference to the drawings.

Figure 1 is a flowchart showing a method for visualizing sound sources external to a vehicle according to the present invention, Figure 2 is a diagram showing the principle of recording sound sources external to a vehicle according to the present invention, and Figures 3 and 4 are diagrams showing the recorded sound source according to the present invention. This is a schematic diagram showing the principle by which a vehicle's external sound source is displayed on the display unit using light quantity and RGB.

1 to 4, the method for visualizing sound sources external to the vehicle 100 according to the present invention records sound sources external to the vehicle 100 through a plurality of microphones 51 to 54 in the first step ( S10). For this purpose, the vehicle 100 is equipped with a plurality of microphones 51 to 54 to acquire external information of the vehicle 100 as a sound source in real time.

Although not specifically shown, the vehicle 100 may be equipped with a database, a data logger, and a control unit for converting sound sources recorded from a plurality of microphones 51 to 54 into information, but is not necessarily limited thereto, and may be physically acquired. Any equipment that can use the sound source as an electrical signal can be implemented in a variety of ways.

A plurality of microphones 51 to 54 are preferably provided inside the vehicle 100 in order to prevent limited recording due to weather conditions such as weather and various situations such as when the vehicle 100 is running, slowing down, or temporarily stopping. .

After the sound sources around the vehicle 100 are recorded, each sound source is analyzed, one of the sound sources is selected as the display sound source, and a second step is performed to check information about the display sound source (S20).

A plurality of microphones 51 to 54 record different volume levels of each sound source, and a display sound source is selected through mutual analysis of the volume difference between the sound sources using the time difference of the recorded sound sources.

The display sound source may be any one of the sound sources recorded at the highest volume among the plurality of microphones 51 to 54 at a certain time. This display sound source may change with a certain preset time period. Here, information about the display sound source means the volume and direction of the display sound source.

After confirming the information about the display sound source, a third step is performed in which the information about the display sound source is converted into an electrical signal and transmitted to the display unit 110 installed in the vehicle (S30).

After the second step, information about the display sound source is converted into electrical signals for wired or wireless transmission to the display unit 110. Here, the wireless transmission may be CAN communication within the vehicle or any one of general short-range wireless communication technologies. CAN communication refers to a standard communication standard designed for microcontrollers or devices to communicate with each other in a vehicle without a host computer. At this time, the display sound source is converted into a digital signal through a data logger, and then the data value can be input and stored in the database.

Meanwhile, the driver can preset the standard value (e.g., decibel) of the sound source to be recorded outside the vehicle 100, and if unnecessary sound sources are obtained, such as the recorded sound source is below the standard value or contains noise, filtering is performed. This can be removed through this process.

Meanwhile, it is preferable that information about the display sound source is transmitted to the display unit from a microphone in which the sound source with the highest volume is recorded among the plurality of microphones. In other words, it is transmitted directly from each microphone to the display unit.

Additionally, information about the display sound source may be transmitted to the display area from a microphone in which a sound source with the highest volume is recorded among a plurality of microphones. In this case, the display sound source may be displayed (emitted) throughout the display area. In contrast, the display sound source may be displayed limited to a portion of the display area. The display area may include at least one light emitting device. At this time, the display sound source may be displayed limited to one light emitting element disposed in a position closer to the direction indicating the display sound source within the display area based on direction information about the display sound source.

As described above, at least one light emitting element may be disposed in the display sound source. At this time, information about the display sound source may be transmitted from the microphone in which the sound source with the highest volume among the plurality of microphones is recorded to one of the light emitting elements. That is, the sound source at the highest volume can be transmitted directly from the recorded microphone to any light-emitting element disposed on the display unit.

After the third step, the fourth step of visualizing information about the display sound source by the display unit 110 is performed (S40). The display unit 110 may be the front glass of the vehicle 100. The display unit 110 is not necessarily limited to this, and can be implemented by various means as long as it can provide the driver with information about the display sound source in a geometric shape using an electrical signal system.

As such, the display unit 110 may be divided into a plurality of display areas along the inner edge of the display unit 110. Additionally, the number of display areas is equal to the number of microphones, and it is desirable that each display area be individually electrically connected to each microphone. Here, it is preferable that the number of microphones is at least four. The microphone can independently measure sound sources in the front, left, right, and rear of the vehicle.

Meanwhile, the display area is divided and set based on directionality to respond to the current situation, such as the driver, the vehicle 100, and the surroundings of the vehicle 100. For example, as shown in FIGS. 3(b) and 4(b), the display area is the front display area located at the front (top of the inner border based on the display unit) and the display area located at the rear (bottom of the inner border based on the display unit). The arranged rear display area consists of a left room display area placed in the left room (the left end of the inner border with respect to the display unit) and a right room display area placed in the right room (the other right end of the inner border with respect to the display unit). It may include a first display area.

In addition, the display areas include a first corner display area located at the front left corner, a second corner display area located at the front right corner, a third corner display area located at the rear left corner, and a third corner display area located at the rear right corner. It may include a second display area consisting of a fourth corner display area.

In one embodiment of the present invention, the display area of the display unit 110 is set to the front display area, rear display area, left room display area, right room display area, and first to fourth corner display areas. It is not necessarily limited. That is, the display area of the display unit 110 is a plurality of display areas formed to provide the driver with a detailed visualization of the external situation of the vehicle 100 and at the same time respond to the driver, the vehicle 100, and other environmental factors. If so, the division can be set up in various ways.

The display unit 110 may be composed of a plurality of light emitting elements 115 arranged along the inner edge of the display unit 110 corresponding to a plurality of set display areas. The light emitting device may display the volume of the sound for the display sound source on the display unit based on the light quantity and RGB (Red-Green-Blue). As such, the display unit 110 may be set to use at least one of the light emitting elements 115 as well as light sources based on electrical signals, but is not necessarily limited thereto, and is not necessarily limited to this, and is not limited to the light emitting element 115, but is not limited to this, and is not limited to the light emitting element 115. If the situation can be collected and visually communicated and displayed, it can be implemented through various means and methods.

Meanwhile, the number of light-emitting devices is equal to the number of microphones, and each light-emitting device can be individually electrically connected to each microphone.

Hereinafter, with reference to the above-described content and FIGS. 3 and 4, the principle of displaying a display sound source on the display unit through a light-emitting element will be explained.

For example, as shown in FIGS. 3(a) and 3(b), when the display sound source is displayed through the light emitting element 115 in the right room display area on the display unit 110 with a Red value of the highest light intensity, the driver Based on the information provided on the display unit 110, it is possible to take follow-up measures by recognizing that the display sound source with the highest volume is obtained in the right direction of the vehicle 100.

For example, as shown in FIGS. 4(a) and 4(b), when the display sound source is displayed through the light emitting element 115 with a low light intensity Blue value in the third corner display area on the display unit 110, Based on the information provided on the display unit 110, the driver can recognize that the display sound source with the lowest volume is obtained in the left direction of the vehicle 100 and take follow-up action.

In other words, the display sound source can be displayed through a combination of the amount of light and color. In addition, the display unit 110 directly displays the direction of the sound source on the display unit 110, providing visual information about the direction from which the sound source was generated when the vehicle 100 is running or stopped. can be provided.

The display sound source transmitted to the display unit 110 may be converted into numerical values for color expressed as RGB values. Additionally, if the RGB value for the display sound source is included in the range constituting any one color information, the display unit 110 may generate and display this as color information.

Figure 5 is a diagram showing the principle by which information about the surrounding situation is transmitted to the driver while the vehicle according to the present invention is driving, and Figure 6 is a diagram showing the principle by which information about the surrounding situation is transmitted to the driver while the vehicle according to the present invention is waiting for a signal. Since it is a drawing, it will be described with reference to FIGS. 1 to 4 described above.

As shown in FIG. 5, when an accident occurs in other vehicles behind the driving driver's vehicle 100, the sound source generated by the collision of the other vehicles is recorded in each of the plurality of microphones 51 to 54. It can be.

After the sound source is recorded, each sound source recorded from the plurality of microphones 51 to 53 is analyzed, and through this, the sound source recorded from the fourth microphone 54 with the highest volume is selected as the display sound source and information about it is displayed. Confirm.

Information about the display sound source is transmitted to the display unit 110 of the vehicle 100 based on an electrical conversion operation, and then displayed based on the Red value in any display area associated with the fourth microphone 54, Through this, information on traffic accidents that occurred outside of the vehicle 100 is provided to the driver in real time.

In contrast, referring to FIG. 7, information about the display sound source is transmitted to the display unit 110 of the vehicle 100 based on an electrical conversion operation and then displayed in any one display area associated with the fourth microphone 54. Any one light-emitting element 115 inside is displayed based on the Red value, and information on traffic accidents that occurred outside the vehicle 100 is provided to the driver in real time through the display area at a position corresponding to the displayed light-emitting element 115. It can be provided as

In addition, the driver can respond to surrounding situations based on the direction information of the sound source displayed on the display unit 110 and take measures such as driving slowly or parking on the shoulder to prevent secondary damage.

As shown in FIG. 6, when an accident occurs with other vehicles in the opposite lane while the driver's vehicle 100 is waiting at a signal, sound sources generated by the collision of other vehicles are recorded in the plurality of microphones 51 to 54. do.

After the sound source is recorded, each sound source recorded from the plurality of microphones 51 to 53 is analyzed, the sound source recorded from the third microphone 53 with the highest volume is selected as the display sound source, and information about it is checked. .

Information about the display sound source is transmitted to the display unit 110 of the vehicle 100 based on an electrical conversion operation, and then displayed based on the Red value in any display area associated with the third microphone 53, Through this, information on traffic accidents that occurred outside of the vehicle 100 can be provided to the driver in real time.

In contrast, referring to FIG. 8, information about the display sound source is transmitted to the display unit 110 of the vehicle 100 based on an electrical conversion operation and then displayed in any one display area associated with the third microphone 53. Any one light-emitting element 115 inside is displayed based on the Red value, and information on traffic accidents that occurred outside the vehicle 100 is provided to the driver in real time through the display area at a position corresponding to the displayed light-emitting element 115. It can be provided as

Those skilled in the art to which the present invention pertains will understand that the present invention can be implemented in other specific forms without changing its technical idea or essential features. Therefore, the embodiments described above should be understood in all respects as illustrative and not restrictive. The scope of the present invention is indicated by the scope of the claims described below rather than the detailed description above, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts are included in the scope of the present invention. must be interpreted.

51 to 54: Microphone 100: Vehicle
110: display unit 115: light emitting device

Claims (8)

A first step of recording sound sources from outside the vehicle through a plurality of microphones;
A second step of analyzing each of the sound sources to select one of the sound sources as a display sound source and confirming information about the display sound source;
A third step of converting information about the display sound source into an electrical signal and transmitting it to a display unit installed in the vehicle; and
A fourth step of visualizing the display sound source by the display unit,
In the second step, the information about the display sound source is,
The direction of the display sound source and the volume of the display sound source,
The display unit is the front glass of the vehicle,
The display unit is divided into a plurality of display areas along the inner edge,
The display area is set to a front display area, rear display area, left room display area, right room display area, and first to fourth corner display areas based on directionality,
In step 3, information about the display sound source is,
The sound source with the highest volume among the plurality of microphones is transmitted from the recorded microphone to the display area,
The display area includes at least one light emitting element,
The display sound source is displayed limited to one light emitting element disposed in a position closer to the direction indicating the display sound source within the display area based on direction information about the display sound source. A method of visualizing sound sources external to a vehicle.
delete According to claim 1,
In the third step, the information about the display sound source is,
A method of visualizing sound sources external to a vehicle, characterized in that the sound source with the highest volume among a plurality of microphones is transmitted to the display unit from a microphone in which the sound source is recorded.
delete delete According to claim 1,
The number of display areas is equal to the number of microphones,
A method for visualizing sound sources external to a vehicle, wherein each display area is individually electrically connected to each microphone.
According to claim 1,
A method of visualizing sound sources external to a vehicle, wherein the display unit consists of a plurality of light emitting elements arranged along an inner edge of the display unit.
According to claim 7,
A method for visualizing sound sources external to a vehicle, wherein the light emitting device displays the volume of sound for the display sound source on the display unit based on light quantity and RGB (Red-Green-Blue).