JP2014092796A - Speech information notification device, speech information notification method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To preferentially perform notification of speech information having high urgency.SOLUTION: A risk level setting part (110e) sets a risk level around a specified current position on the basis of map information on the current position and around the current position. A sound source risk level determination part (110h) determines a risk level in a sound source direction of a speech signal inputted from a plurality of microphones (20) on the basis of the direction of a specified device and the risk level set by the risk level setting part (110e). A notification control part (110i) performs notification according to the risk level on the basis of the determination of the sound source risk level determination part (110h).

Description

  The present invention relates to an audio information notification apparatus, an audio information notification method, and a program for acquiring and notifying surrounding sounds.

  There are cases where hearing is impaired, and even a normal person cannot recognize surrounding audio information by using headphones. In such a case, there is a device that acquires peripheral audio information and notifies the user of the audio information using vision or touch (Patent Document 1 and Patent Document 2).

JP 2010-251916 A JP-A-2005-99418

  Examples of audio information detected when the user is outdoors include siren sounds of emergency vehicles and car horns. In many outdoor sound information, such alarm sounds are likely to be urgent to the user, and therefore need to be preferentially notified over other sound information.

  The present invention has been made in view of such problems, and an object of the present invention is to provide a voice information notification apparatus, a voice information notification method, and a program for preferentially reporting voice information with high urgency.

  In order to achieve the above object, a voice information notification device (100) according to the present invention includes a current position specifying unit (110c) for specifying a current position of the device, and the current position specified by the current position specifying unit (110c). Map information acquisition unit (110d) for acquiring map information based on the risk information setting unit (110e) for setting a risk level around the current position based on the map information acquired by the map information acquisition unit (110d), an apparatus A direction specifying unit (110f) for specifying the direction of the sound source, a sound source direction specifying unit (110g) for specifying the direction of the sound source based on audio signals input from a plurality of microphones (20) provided in different directions, and the direction Based on the direction of the device specified by the specifying unit (110f) and the risk set by the risk setting unit (110e), the sound source direction specifying unit (110g) A sound source risk determination unit (110h) that determines the risk level in the direction of the sound source, and a control that performs notification by changing the notification form of the audio signal according to the risk level based on the determination by the sound source risk determination unit (110h). And a notification control unit (110i) for performing the operation.

  The audio information display method according to the present invention includes a current position specifying step for specifying a current position of the device, a map information acquiring step for acquiring map information based on the current position specified in the current position specifying step, and the map A risk setting step for setting the risk around the current position based on the map information acquired in the information acquisition step, a direction specifying step for specifying the orientation of the apparatus, and a plurality of microphones (20 The sound source direction specifying step for specifying the direction of the sound source based on the audio signal input from the above), the sound source direction specifying step based on the direction of the device specified in the direction specifying step and the risk set in the risk setting step Sound source risk judgment that determines the risk in the direction of the sound source identified in the step A sound source risk determination step for associating the direction of the sound source specified in the sound source direction specifying step with the direction of the device specified in the direction specifying step and the risk set in the risk setting step, A notification control step of performing control for changing the notification form of the audio signal according to the risk level based on the determination in the sound source risk level determination step.

  The program according to the present invention is based on the current position specified in the current position specifying step, the current position specifying step for specifying the current position of the apparatus in the computer (110) included in the voice information notification apparatus (100). A map information acquisition step for acquiring map information, a risk setting step for setting a risk level around the current position based on the map information acquired in the map information acquisition step, a direction specifying step for specifying the orientation of the device, and different Set in the sound source direction specifying step for specifying the direction of the sound source based on audio signals input from a plurality of microphones provided in the direction, the device direction specified in the direction specifying step, and the risk setting step Based on the degree of risk, it was identified in the sound source direction identification step A sound source risk determination step for determining the risk level in the direction of the source, and a notification control step for performing control for changing the notification mode of the audio signal according to the risk level based on the determination in the sound source risk determination step It is characterized by making it.

  According to the present invention, highly urgent voice information can be preferentially notified.

It is an external appearance perspective view of the audio | voice information alerting | reporting apparatus which concerns on this embodiment. It is a block diagram of the configuration of the voice information notification apparatus according to the present embodiment. It is a flowchart which shows the operation example of the audio | voice information alerting | reporting apparatus which concerns on 1st Embodiment. It is a flowchart which shows the example of a risk setting process. It is a conceptual diagram explaining the example of a danger level setting. It is a conceptual diagram explaining the example of a danger level setting. It is a flowchart which shows the example of a sound source direction specific process. It is the figure which showed the sound source direction corresponding to the position of the microphone of an audio | voice information alerting | reporting apparatus. It is a flowchart which shows the example of a risk determination process. It is a conceptual diagram explaining the example of risk determination. It is a flowchart which shows the example of alerting | reporting process. It is a figure which shows the example of alerting | reporting. It is a figure which shows the example of alerting | reporting. It is a flowchart which shows the example of the risk level setting process which concerns on 2nd Embodiment. It is a flowchart which shows the example of the risk degree setting process which concerns on 3rd Embodiment.

  Hereinafter, the structure of the audio | voice information alerting | reporting apparatus 100 which concerns on embodiment of this invention is demonstrated with reference to FIG. 1 and FIG.

  As an example of the audio information notification apparatus 100, a small apparatus having a display function as shown in FIG. 1 is used. Specifically, it is preferable that the mobile phone terminal or the tablet terminal is small and easy to carry. In addition to the dedicated device, the voice information notification device 100 may be realized by installing a program for causing the mobile phone or various information terminals to operate as the voice information notification device 100. In this case, a cellular phone or various information terminals that operate as the audio information notification device 100 are connected to or attached to a unit or the like having a plurality of microphones 20, and an audio signal input to the microphone 20 is a cellular phone or various information terminals. Is input.

  As shown in FIG. 1, the audio information notification device 100 includes a display surface of the display unit 140 on a surface formed by the housing 10, and includes microphones 20 at four corners of the rectangular housing 10.

  For convenience, the microphones 20 provided at the four corners of the audio information notification device 100 indicate their positions as a microphone 20A, a microphone 20B, a microphone 20C, and a microphone 20D. In the present embodiment, four microphones 20 are arranged so as to surround the display unit 140, but the arrangement position and the number of the microphones 20 are not limited as long as the direction of the sound source can be specified. Further, the shape of the audio information notification device 100 is not limited to a rectangle. It is preferable that each of the microphones 20 has directivity with respect to a direction in which sound is detected.

  As shown in FIG. 2, the voice information notification device 100 includes a control unit 110, a voice signal input unit 120, a storage unit 130, a display unit 140, an operation unit 150, a GPS reception unit 160, a sensor unit 170, and a communication unit. 180, a vibration unit 190, and a microphone 20. The communication unit 180 and the vibration unit 190 may be provided as necessary. In addition, the audio information notification device 100 includes various necessary constituent elements (not shown) such as a power supply function for operating each unit of the device.

  The control part 110 performs operation control of each part which comprises the audio | voice information alerting | reporting apparatus 100, a process or calculation of various data, etc. The control unit 110 includes, for example, a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), a DSP (Digital Signal Processor), and the like, and executes various programs stored in the ROM. Thus, operation control of each part constituting the voice information notification apparatus 100, processing or calculation of signals and data input from each part, file processing, and the like are performed.

  The control unit 110 implements various functions by executing programs. In the present embodiment, the control unit 110 includes a display control unit 110a, an operation control unit 110b, a current position specifying unit 110c, a map information acquisition unit 110d, a risk setting unit 110e, a direction specifying unit 110f, a sound source direction specifying unit 110g, and a sound source risk. A degree determination unit 110h, a notification control unit 110i, a sound recognition unit 110j, and a communication control unit 110k are realized.

  The display control unit 110a controls the display unit 140 to display various information. For example, various display forms and characters stored in the storage unit 130, various GUIs (Graphical User Interfaces) linked to a touch panel operation unit (not shown), and the like are displayed.

  The operation control unit 110b performs control to execute processing based on an operation signal generated when the operation unit 150 is operated.

  The current position specifying unit 110c performs control to specify the current position of the device at the time of reception based on the GPS signal and time information received by the GPS receiving unit 160.

  The map information acquisition unit 110d performs control for acquiring peripheral map information based on the current position specified by the current position specification unit 110c. Hereinafter, the map information will be described on the assumption that it is stored in the storage unit 130. However, the map information may be acquired from an external server or the like using the communication unit 180 under the control of the communication control unit 110k described later.

  The risk level setting unit 110e performs control to set the risk level around the current position based on the map information acquired by the map information acquisition unit 110d.

  The direction specifying unit 110f performs control for specifying the direction in which the device is facing by an electronic compass function such as a geomagnetic sensor provided in the sensor unit 170. The direction of the device specified by the direction specifying unit 110f is based on the upper display direction of the display unit 140 in the direction in which the audio information notification device 100 is normally used, for example. In this case, in FIG. 1, the direction in which the microphone 20A and the microphone 20D are provided is defined as the upper display direction, and the direction in which the upper display direction faces is specified.

  The sound source direction specifying unit 110g performs control for specifying the sound source direction, which is the direction in which the sound signal is emitted, based on the input level of each sound signal input to the microphone 20.

  The sound source risk level determination unit 110h performs control for determining the risk level in the sound source direction based on the direction of the sound source direction specified by the sound source direction specifying unit 110g and the risk level set by the risk level setting unit 110e.

  The notification control unit 110i performs control to perform notification corresponding to the risk determined by the sound source risk determination unit 110h. The notification by the notification control unit 110i is, for example, a form in which the display form of the display unit 140 is changed according to the notification form, and the display control unit 110a controls display on the display unit 140 based on the control of the notification control unit 110i. As a result, various notification forms are displayed.

  The sound recognition unit 110j compares the sound data input from the microphone 20 and acquired from the sound signal input unit 120 with, for example, pattern data of various sounds stored in the storage unit 130, and specifies the input sound. I do. The voice data collation by the sound recognition unit 110j may be collated by an external server or the like using the communication unit 180 under the control of the communication control unit 110k described later.

  The communication control unit 110k controls the communication operation by the communication unit 180. More specifically, the communication unit 180 controls transmission / reception of data, control information, and the like.

  The audio signal input unit 120 converts the audio signal input from the microphone 20 under control of the control unit 110 into data for the control unit 110 to process. The audio signal input unit 120 includes, for example, an A / D conversion unit 121 and an amplification unit 122. The amplification unit 122 is, for example, an operational amplifier that amplifies the audio signal input from the microphone 20. The A / D conversion unit 121 performs A / D (Analog-Digital) conversion on the audio signal amplified by the amplification unit 122 and sends the audio data to the control unit 110.

  The storage unit 130 includes, for example, a flash memory or an HDD (Hard Disk Drive), and stores various data necessary for the voice information notification device 100 and data to be recorded input from the outside such as the microphone 20. Through this process, a storage operation and a read operation are performed. The storage unit 130 is not limited to the one built in the voice information notification apparatus 100 but may be an external storage device connected by a predetermined interface. Examples of the external storage device include a USB memory connected to a USB (Universal Serial Bus) terminal, an external HDD device, and a memory card connected by a predetermined memory card slot.

  The display unit 140 includes, for example, a liquid crystal display element, an organic EL (Electro Luminescence) display element, and a circuit unit that drives them, and displays various display contents and display forms under the control of the display control unit 110a.

  The operation unit 150 is a user interface for the user to perform various processes and operation instructions to the voice information notification device 100. It is comprised by the touchscreen operation part which is not shown in figure. When the operation unit 150 is operated, a signal based on the operation is output to the operation control unit 110b described later, and the operation of each unit and various processes based on the operation are executed.

  The GPS receiving unit 160 is a receiving device including an antenna that receives a GPS signal from a GPS satellite, and sends the received GPS signal and time information to the current position specifying unit 110c.

  The sensor unit 170 includes various sensors used in the audio information notification device 100 and sends signals from the various sensors to the control unit 110. In the present embodiment, a geomagnetic sensor 171 is provided, and an output value based on the geomagnetism measured by the geomagnetic sensor 171 is sent to the orientation identifying unit 110f. The sensor unit 170 may include an acceleration sensor, an atmospheric pressure sensor, and the like in addition to the above.

  The communication unit 180 is a device that communicates with other devices, base stations, and the like under the control of the communication control unit 110k, and includes an antenna for communication. A communication method of the communication unit 180 may be a short-range communication method such as a Bluetooth method in addition to a Wi-Fi method or a communication method for mobile phones, and a plurality of communication methods may be provided.

  The vibration unit 190 is a vibration element such as a vibration motor that vibrates under the control of the notification control unit 110i.

  Next, processing as the first embodiment in the audio information notification device 100 will be described with reference to FIGS. 3 to 13.

  FIG. 3 is an overall flow of processing according to the present invention in the voice information notification device 100. The processing according to the flow of FIG. 3 is performed while the power of the voice information notification device 100 is turned on or the voice information notification device. In 100, while the process of performing notification corresponding to the degree of risk is selected and executed, it is sequentially executed. Further, the order of the processes in FIG. 3 may be changed as long as there is no problem.

  First, the current position specifying unit 110c specifies the current position of the voice information notification device 100 (step S10). The current position specified here is specified as a numerical value by latitude and longitude. It is assumed that the current position specified here has sufficient accuracy. In recent years, GPS information with high positioning accuracy can be obtained by a quasi-zenith satellite system, and the current position specified by the current position specifying unit 110c may have a positioning error of less than 1 m by such a high-precision system. preferable.

  Next, based on the current position specified in step S10, the map information acquisition unit 110d acquires map information based on the current position (step S11). The map data acquired here does not have to be accompanied by a map image. Specifically, it includes information about roads and information about facilities around the current position.

  Next, based on the map information acquired in step S11, the risk level setting unit 110e sets the risk level around the current position (step S12). An example of the risk setting process by the risk setting unit 110e in step S12 will be described with reference to FIG.

  First, the risk setting unit 110e determines whether or not the current position identified in step S10 is located on the road in the map information acquired in step S11 (step S121). The road here is a road through which automobiles and pedestrians can pass, excluding automobile-only roads and pedestrian-only roads. The term “on the road” includes a roadway and sidewalks and median strips attached to the roadway.

  If it is determined in step S121 that the current position is not on the road (step S121: No), the risk setting unit 110e sets all directions centered on the current position as the risk “low” (step S125). ), This process is terminated. When it is determined that the current position is on the road (step S121: Yes), the risk setting unit 110e determines whether the current position is an end of the road (step S122). The end of the road here is the range of the sidewalk if it is a road with a sidewalk, and the range according to a preset range or road width from the end of the road if it is a road without a sidewalk Etc. As an example, in the case of an 8 m wide road that does not have a sidewalk, 1 m is set as an end from each end of the road.

  If it is determined in step S122 that the current position is not the end of the road (step S122: No), it means that the current position is the center of the road or road. Therefore, the risk level setting unit 110e sets all directions around the current position as the risk level “high” (step S127). In step S122, when it is determined that the current position is an end of the road (step S122: Yes), the risk setting unit 110e determines whether the current position is within the intersection (step S123). The intersection here is a range defined by intersecting roads and may include a sidewalk.

  If it is determined in step S123 that the current position is within the intersection (step S123: Yes), the risk level setting unit 110e sets all directions centered on the current position as the risk level “high” (step S127). ). In step S123, when it is determined that the current position is not within the intersection (step S123: No), the risk setting unit 110e determines the road where the current position is located based on the map information acquired in step S11. A direction is acquired (step S124). The direction of the road acquired here is a direction in which the road is installed, for example, a south-north direction, a north-northwest-south-east direction, or the like.

  Next, the risk level setting unit 110e sets the center direction of the road as the risk level “high” around the current position, and sets the end direction of the road as the opposite direction to the risk level “low” ( Step S126).

  The process of FIG. 4 will be described using a specific example of FIGS. 5 and 6. FIG. 5 schematically shows an area where a road A with a sidewalk and a road B without a sidewalk intersect, and the buildings A, B, and C are built around it. In this area, assume a voice information notification device 100A, a voice information notification device 100B, a voice information notification device 100C, and a voice information notification device 100D whose current positions are indicated by black circles.

  The voice information notification device 100A is on the sidewalk as the end of the road A, but is within a range defined as an intersection where the road A and the road B intersect. Yes, and all directions are set as the risk “high” (step S127). Since the current position of the voice information notification device 100B is on the sidewalk as the end of the road A and not within the range of the intersection, step S123 in FIG. 4 is No, and the processing in step S124 and the processing in step S125 are performed. It becomes a target to do.

  FIG. 6 is an enlarged view of the position of the voice information notification device 100B in FIG. 5, and is a diagram for explaining steps S124 and S125.

  The current position of the audio information notification device 100B in which the determination in step S123 is No is located on the sidewalk of the road A as shown in FIG. Here, step S124 acquires the direction of the road A based on the map information acquired in step S11. For example, in FIG. 6, it is assumed that the road A is a road extending in the north-south direction. Next, as the processing in step S126, the risk is set to “high” for the road center direction centered on the current position of the voice information notification device 100B, and the risk “low” is set for the end direction of the road as the opposite direction. In FIG. 6, the road center direction centering on the current position of the audio information notification device 100B is the east side, and is the right side of the drawing from the broken line. The opposite end direction of the road is the west side, which is the left side of the drawing from the broken line. For this reason, in the current position shown in FIGS. 5 and 6, the risk level setting unit 110 e of the voice information notification device 100 </ b> B has a risk level “high” on the east side and a risk level “low” on the west side. Set to.

  The voice information notifying device 100C is not located at the end of the road B, and step S122 in FIG. 4 is No, and all directions are set as the risk “high” (step S127). Since the current position of the voice information notification device 100D is located inside the building C, step S121 of FIG. 4 is No, and the risk is set to “low” in all directions (step S125).

  Returning to FIG. 3, the direction specifying unit 110 f specifies the direction of the audio information notification device 100 (step S <b> 13). The process in step S13 is the direction of the device at the time when the current position is specified in step S10. Based on the output signal from the geomagnetic sensor 171, the direction in which the audio information notification device 100 is normally used as described above as an example. The upper part of the display unit 140 in the display direction is used as a reference of the direction, and it is specified which direction the reference is directed.

  Next, the sound source direction specifying unit 110 g is input to the microphone 20, and an audio signal having a predetermined sound pressure or higher is input to one or a plurality of microphones 20 based on the audio data acquired from the audio signal input unit 120. It is determined whether or not it has been done (step S14). The processing from step S10 to step S13 may be triggered by an input of a predetermined sound pressure or higher in step S14.

  The determination of the sound pressure in step S14 is, for example, PWM (Pulse Width Modulation) that changes the ratio of the pulse width between the H level and the L level according to the level of the input signal with respect to the audio data input from the audio signal input unit 120. ) Convert and judge by the pulse width. This PWM conversion may be performed for each frequency band. In that case, audio data is selected for each desired frequency band by BPF (Band Pass Filter) before PWM conversion. The PWM conversion is performed for each of the plurality of microphones 20.

  The predetermined sound pressure determined in step S14 may be set arbitrarily, but as a specific example, the sound pressure level is 70 dB or more. This numerical value may be set in advance, or the setting may be changed according to the user's hearing level.

  In step S14, when it is determined that no input has been made (step S14: No), this process ends. When it is determined in step S14 that an audio signal having a predetermined sound pressure or higher is input (step S14: Yes), the sound source direction specifying unit 110g analyzes the direction of the sound source based on the input audio data from each microphone 20. (Step S15).

  The process of step S15 is demonstrated based on FIG. 7 and FIG. First, the sound source direction specifying unit 110g specifies the microphone having the maximum sound pressure of the input sound signal based on the sound data corresponding to each of the microphones 20A to 20D (step S151). For the audio data of each microphone 20 to be compared when performing the process of step S151, the maximum value in a predetermined time width may be detected, or the maximum value in the integrated value of the predetermined time width may be detected. In addition, when the difference between the maximum values of the plurality of microphones 20 is smaller than a predetermined value, for example, when the difference between the maximum sound pressures is within 2 dB, the sound pressures of the microphones 20 may be the same.

  If it is determined in step S151 that the microphone 20 having the maximum sound pressure can be specified (step S151: Yes), the sound source direction specifying unit 110g determines that the direction of the microphone 20 specified to have the maximum sound pressure is the sound source direction. Judgment is made (step S152). 8 indicate examples of directions in which the direction of a sound source is specified by the microphone 20. Since the actual usage is arranged or gripped so that the display unit 140 is horizontal with respect to the ground, the directions A to H are oriented in the horizontal direction with respect to the ground with the audio information notification device 100 as the center. For example, when the microphone 20A is identified as the microphone to which the maximum sound pressure is input in FIG. 8, it is determined that the direction B is the sound source direction. Similarly, it is determined that the direction is D in the case of the microphone 20B, the direction F in the case of the microphone 20C, and the direction H in the case of the microphone 20D.

  In step S151, when it is determined that the microphone 20 having the maximum sound pressure cannot be specified (step S151: No), the sound source direction specifying unit 110g can specify two microphones 20 having the same sound pressure whose sound pressure is larger than the other. Whether or not (step S153). Also in the process of step S153, the error for determining the same sound pressure may be the same as in step S151. In step S153, when the two microphones 20 having the same sound pressure larger than the other can be identified (step S153: Yes), the sound source direction identifying unit 110g has the two microphones 20 having the same sound pressure larger than the other. Is determined as the sound source direction (step S154).

  The determination in step S154 is, for example, when the microphone 20A and the microphone 20B are identified as two microphones 20 having the same sound pressure that is higher than the others in FIG. 8, and the direction C is determined to be the sound source direction. The Similarly, when it is determined that the microphone 20B and the microphone 20C are two microphones 20 having the same sound pressure, the direction F is determined to be the sound source direction, and the microphone 20C and the microphone 20D are the other. When it is specified that the two microphones 20 have the same sound pressure with a higher sound pressure, the direction G is determined to be the sound source direction, and the microphone 20D and the microphone 20A have the same sound pressure of 2 with a higher sound pressure than the other. When it is specified that there are two microphones 20, it is determined that the direction A is the sound source direction.

  In step S153, when the two microphones 20 having the same sound pressure higher than the others cannot be specified (step S153: No), the sound source direction specifying unit 110g determines that the direction of the sound source cannot be specified (step S155). .

  Returning to FIG. 3, the sound source risk determination unit 110h performs a process of determining the risk in the sound source direction specified in step S15 based on the direction of the device specified in step S13 and the risk set in step S12. This is performed (step S16).

  Here, the risk determination process in step S16 will be described with reference to FIGS. In the flowchart of FIG. 9, the sound source risk determination unit 110h specifies the direction based on the direction of the audio information notification device 100 specified in step S13 with respect to the sound source direction specified in step S15 (step S161).

  Next, the sound source risk determination unit 110h associates the direction of the sound source specified in step S162 with the risk set in step S12, and determines the sound source risk (step S162).

  The processing in FIG. 9 will be described based on an example using FIG. 10. The current position specified in step S10 is the position of the voice information notification device 100B, and the direction of the voice information notification device 100B specified in step S13. Is north-northeast. In such a state, the correspondence with each direction shown in FIG. 8 is as follows: direction A is north-northwest, direction B is north-northeast, direction C is east-northeast, direction D is east-southeast, direction E is south-southeast, and direction F is south-southwest , Direction G is west-southwest, and direction H is west-northwest.

  In step S12, the road A is acquired as a road extending in the northeast-southeast direction. The road A in FIG. ”And the southwest direction is set to“ Low ”.

Therefore, the sound source direction by the microphone 20 in the audio information notification device 100B of FIG.

  For example, in the example of FIG. 10, the direction of the voice information notification device 100B is northwest, and the direction serving as the setting boundary between the risk “high” and the risk “low” indicated by the broken line in FIG. If the direction coincides with the direction specified in, the degree of danger is set to “high” for the coincident direction.

  Returning to FIG. 3, the notification control unit 110 i performs notification based on the risk level of the sound source direction determined in step S <b> 16.

  The process of step S16 is demonstrated based on FIG. First, the notification control unit 110i determines whether or not the direction of the sound source specified in step S15 is the risk “high” (step S171). In step S171, when it is determined that the degree of risk is “high” (step S172), the notification control unit 110i performs notification corresponding to the degree of risk “high” (step S172). When it is determined in step S171 that the degree of risk is not “high” (step S171: No), the notification control unit 110i performs notification corresponding to the degree of risk “low” (step S173).

The notification form executed in step S172 and step S173 will be described with reference to Table 2, FIG. 12 and FIG.

  Table 2 is an example of a notification form corresponding to the degree of risk by the notification control unit 110i. In the case of the notification example 1, as shown in FIGS. 12 and 13, the display size of the notification for the audio signal is changed according to the degree of risk. FIG. 12 is an example showing a display form when the direction B, which is the direction of the microphone 20A, has a high risk level. Based on the control of the notification control unit 110i, the display control unit 110a displays a display graphic 300 that can determine that the sound source direction is the direction of the microphone 20a. FIG. 13 is an example showing a display form when the direction G, which is the direction between the microphone 20C and the microphone 20D, has a danger level “low”.

  In notification example 1 in Table 2, when the degree of danger is “high”, the display size of the display graphic 300 is displayed large for notification of the audio signal, and when the degree of danger is “low”, the display of the display figure 300 is displayed. Make the size smaller. 12 and 13 show displays based on the notification example 1, FIG. 12 shows a state in which the display graphic 300 is displayed in a large size, and FIG. 13 shows a state in which the display graphic 300 is displayed in a small size.

  Similarly, in the notification example 2, when the degree of danger is “high”, the color tone of the notification display figure 300 for the audio signal is displayed in a red color, and when the degree of danger is “low”, the display figure 300 is displayed. Is displayed in green color. In the notification example 2, the color system is not limited and may be a single color or a combination of a plurality of colors. However, when the degree of danger is “high”, a color that can be recognized as dangerous is displayed. When the degree of danger is “low”, a color that can be recognized as not dangerous is used.

  In notification example 3, when the degree of danger is “high”, the color of the display graphic 300 for notification with respect to the audio signal is displayed darkly, and when the degree of danger is “low”, the color of the display graphic 300 is displayed lightly. Also, in the notification example 4, when the risk level is “high”, the notification control unit 110i vibrates the vibration unit 190, and when the risk level is “low”, the notification control unit 110i does not vibrate.

  In the notification example 5, when the degree of danger is “high”, some kind of notification is given to the audio signal, and when the degree of danger is “low”, no notification is performed.

  The notification form by the notification control unit 110i is not limited to the above, but it is necessary that the notification is clearly distinguishable between a case where the degree of risk is “high” and a case where the degree of risk is “low”. In addition, notification forms such as Table 2 may be combined and executed.

  Also, as shown in FIG. 12, when the degree of risk is “high”, the result of collation by the sound recognition unit 110j for the voice data input from the voice signal input unit 120 may be displayed. In FIG. 12, it is obtained by collation processing by the sound recognition unit 110j that the audio signal acquired from the direction of the microphone 20A is an ambulance siren sound, and “Ambulance” is displayed on the display unit 140 as the display information 310. This is an example. Further, the sound pressure of the acquired audio signal may be displayed on the display graphic 300. FIG. 12 is an example in which it is displayed that the maximum audio signal acquired from the direction of the microphone 20A is 80 dB.

  As described above, in the first embodiment, the surrounding risk level is set for each current position of the audio information notification device 100, and the audio signal corresponding to the sound source direction is notified according to the risk level. Notification based on the audio signal can be reduced, and the burden on the user is reduced. Moreover, the danger level of an audio | voice signal can also be estimated with the form of alerting | reporting.

  Next, the process as the second embodiment in the audio information notification apparatus 100 will be described with reference to FIG. FIG. 14 corresponds to the risk setting processing in the first embodiment shown in FIG. The configuration of the voice information notification device 100 in the second embodiment is the same as that of the first embodiment, and the processing example is the same except for the risk setting processing in step S12 of FIG. In the risk level setting process, the description of the same process is omitted.

  If it is determined in step S121 of FIG. 14 that the current position is on the road (step S121: Yes), the risk setting unit 110e determines that the road to which the current position belongs is greater than or equal to the predetermined value based on the map information acquired in step S11. It is determined whether or not the road has a width of (step S221). For example, in the case of a narrow road in an urban area, there is a sidewalk that is not provided side by side, and the road is separated only by a white line, or there is a road without a break.

  In the case of such a road, it is not realistic to classify the risk level depending on whether the current position is the end or the center of the road in the process of step S122. If the road is not, the process proceeds to step S127, and the risk is set to “high” in all directions.

  For example, the determination in step S221 is performed using a road width of 6 m as a threshold value. In addition, the determination in step S221 is based on not only the road width value but also the content of the map information acquired in step S11. For example, if the road has a sidewalk with a step or a fence at the boundary with the roadway, step S221 is set to Yes. It is good.

  By such processing, it is possible to more appropriately notify the audio signal according to the degree of danger.

  Next, processing as a third embodiment in the audio information notification device 100 will be described with reference to FIG. FIG. 15 corresponds to the risk setting processing in the first embodiment shown in FIG. The configuration of the voice information notification device 100 in the third embodiment is the same as that in the first embodiment, and the processing example is the same except for the risk level setting processing in step S12 in FIG. In the risk level setting process, the description of the same process is omitted.

  In step S124 of FIG. 15, after acquiring the direction of the road to which the current position belongs based on the map data, the risk setting unit 110e determines whether the facility adjacent to the current position on the road is a park. (Step S421). When it is determined in step S421 that the vehicle is not a park (step S421: No), the risk level setting unit 110e sets the road center direction as the risk level “high” around the current position, and sets the road edge direction as the risk level. “Medium” is set (step S422). If it is determined in step S421 that it is a park (step S421: Yes), the risk level setting unit 110e sets the road center direction as the high risk level around the current position, and sets the road edge direction as the risk level. “Low” is set (step S423).

  As a reason for the determination in step S421, for example, when the current position is a road edge such as a sidewalk, the road side is not changed to a high risk level, but a facility adjacent to the road is a park or the like. By making a difference in the degree of danger between the case and the case of a building, it is possible to make a more appropriate audio The purpose is to provide information.

An example of a notification mode of the degree of danger set in step S422 and step S423 will be described with reference to Table 3. In Table 3, in any of the notification examples, when the degree of risk is “low”, the notification is not performed. In notification example 1 in Table 3, when the degree of danger is “high”, the display size of the display graphic 300 is displayed large as shown in FIG. 12, and when the degree of danger is “medium”, as shown in FIG. The display size of the display graphic 300 is displayed small.

  Similarly, in the notification example 2, when the degree of danger is “high”, the color tone of the display graphic 300 is displayed using a color such as a red color that can identify danger, and the degree of danger is “medium”. In some cases, a green color or the like is used for display. Notification example 3, when the risk level is “high”, the color of the display graphic 300 is displayed darkly, and when the risk level is “medium”, the color of the display graphic 300 is displayed lightly. Also, in the notification example 4, when the risk level is “high”, the notification control unit 110i vibrates the vibration unit 190 strongly, and when the risk level is “low”, it vibrates weakly.

  As described above, in the third embodiment, since the risk level is set according to the facility adjacent to the road, it is possible to appropriately notify the audio signal according to the risk level.

  The embodiment of the present invention can be variously modified without departing from the gist thereof. For example, although the setting of the risk level is classified by the example of the broken line shown in FIG. 10, the direction of the device specified in step S <b> 13 is highly likely to be the traveling direction of the user of the voice information notification device 100. For this reason, the setting of the risk level may be changed between the direction of the apparatus and the opposite direction. For example, since there is a high possibility that the direction opposite to the direction of the device is behind the user, the range of the risk “high” is widened. In this case, the sound source direction F in Table 1 is set to a high risk level.

  Moreover, in each said embodiment, although the alerting | reporting by the alerting | reporting control part 110i was demonstrated about the visual alerting | reporting using the display part 140, if it is an alerting | reporting form in which a user can recognize a sound source direction and the risk level of the sound source, it is. It is not limited to visual notification.

20: Microphone, 100: Audio information display device, 110: Control unit, 110c: Current position specifying unit, 110d: Map information acquiring unit, 110e: Risk level setting unit, 110f: Direction specifying unit, 110g: Sound source direction specifying unit, 110h: sound source risk determination unit, 110i: notification control unit

Claims (7)

A current position specifying unit for specifying the current position of the device;
A map information acquisition unit for acquiring map information based on the current position specified by the current position specifying unit;
A risk level setting unit that sets a risk level around the current position based on the map information acquired by the map information acquisition unit;
An orientation identifying unit that identifies the orientation of the device,
A sound source direction identifying unit that identifies the direction of a sound source based on audio signals input from a plurality of microphones provided in different directions;
A sound source risk determination unit for determining a risk in the direction of the sound source specified by the sound source direction specifying unit based on the direction of the device specified by the direction specifying unit and the risk set by the risk setting unit;
A notification control unit that performs control for changing the notification mode for the audio signal according to the risk level based on the determination by the sound source risk level determination unit,
A voice information notification device comprising: If the current position specified by the current position specifying unit is specified as a sidewalk attached to a roadway, the risk level setting unit sets a high risk level on the roadway side and sets a low risk level on the sidewalk side. To
The voice information notification apparatus according to claim 1, wherein The risk setting unit sets the risk when the current position specified by the current position specifying unit is specified as being on a road having a predetermined width or more,
The voice information notifying device according to claim 1 or 2, characterized by the above. The risk setting unit sets a risk according to a facility adjacent to the current position based on the current position information;
The voice information notification apparatus according to any one of claims 1 to 3, wherein the voice information notification apparatus is characterized. The notification control unit notifies the audio signal only when the degree of danger with respect to the direction of the sound source is higher than a predetermined level.
The voice information notification apparatus according to any one of claims 1 to 4, wherein the voice information notification apparatus is characterized. A current position identifying step for identifying the current position of the device;
A map information acquiring step for acquiring map information based on the current position specified in the current position specifying step;
A risk setting step for setting a risk around the current position based on the map information acquired in the map information acquisition step;
An orientation identification step for identifying the orientation of the device,
A sound source direction specifying step for specifying the direction of a sound source based on audio signals input from a plurality of microphones provided in different directions;
A sound source risk determination step for determining a risk in the direction of the sound source specified in the sound source direction specifying step based on the direction of the device specified in the direction specifying step and the risk set in the risk setting step;
A sound source risk determination step for associating the sound source direction specified in the sound source direction specifying step with the direction of the device specified in the direction specifying step and the risk set in the risk setting step;
A notification control step for performing control for changing the notification form of the audio signal according to the risk based on the determination in the sound source risk determination step;
A voice information notification method comprising: In the computer provided in the voice information notification device,
A current position identifying step for identifying the current position of the device;
A map information acquiring step for acquiring map information based on the current position specified in the current position specifying step;
A risk setting step for setting a risk around the current position based on the map information acquired in the map information acquisition step;
An orientation identification step for identifying the orientation of the device,
A sound source direction specifying step for specifying the direction of a sound source based on audio signals input from a plurality of microphones provided in different directions;
A sound source risk determination step for determining a risk in the direction of the sound source specified in the sound source direction specifying step based on the direction of the device specified in the direction specifying step and the risk set in the risk setting step;
A notification control step for performing control for changing the notification form of the audio signal according to the risk based on the determination in the sound source risk determination step;
A program characterized by having executed.

Images