JP2010030356A - Door opening detection device, microphone device, door opening detection program, and door opening detection method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To detect a door opening with high accuracy without adding a complicated circuit constitution. <P>SOLUTION: In this door opening detection device, when a sound signal (raw signal 111) received by microphones MC1 and MC2 mounted in a vehicle 100 is input, adjustment processing is performed for the raw signal 111 to generate a processed signal 112. A waveform of the processed signal 112 is compared with each waveform read from a waveform library 120 in which a waveform of the sound signal for each door opening operation of the vehicle 100 is recorded in advance. When the waveform of the processed signal coincides with one of each waveform, information that the door opening operation corresponding to the coinciding waveform is executed is output. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a door opening detection device, a microphone device, a door opening detection program, and a door opening detection method for detecting opening of a vehicle door.

  2. Description of the Related Art Conventionally, techniques for detecting vehicle door release have been provided. Normally, when an automobile door is opened, vibration of air in the vehicle compartment is generated due to a change in air pressure in the vehicle compartment that is in a sealed state. The door opening can be detected by capturing this phenomenon with a microphone.

  When capturing vibrations of air in the vehicle interior using a microphone, erroneous detection may occur if the sound signal or pressure signal detected by the microphone is used as it is. Therefore, a technique is used in which a door opening is detected by a waveform pattern generated by removing a noise component from a signal detected by a microphone using a high-pass filter or an integration circuit (for example, see Patent Documents 1 and 2 below). .).

JP 2007-190948 A JP 2001-93082 A

  However, in the case of the conventional door opening detection technology as described above, since the sound generated by the operation related to the door opening to be detected is composed of low frequency components, the detection accuracy greatly depends on the microphone sensitivity. there is a possibility. As a result, there is a problem in that erroneous detection may occur because the detected voice signal and pressure signal vary.

  Moreover, the technique regarding the door open detection of the said patent documents 1, 2 is implement | achieved by the analog circuit. Therefore, the circuit configuration becomes complicated, and the waveform of the signal detected by the microphone changes greatly from time to time, so that there is a problem that erroneous detection is likely to occur. In addition, in order to prevent false detection, a dedicated analog circuit such as a high-pass filter or an integration circuit as described above must be provided, leading to an increase in cost and pressure on the space in the vehicle compartment. there were.

  In addition, as a background to the need for high-accuracy door opening detection technology, attempts to divert door opening detection technology to crime prevention technology such as notifying the user and the outside of abnormal door opening due to criminal acts such as car vandalism There is. However, in order to detect abnormal door opening using the conventional door opening detection, a dedicated detector must be further installed in the vehicle, resulting in higher costs than the above-described analog circuit, There was also a problem of squeezing the space.

  In order to solve the above-described problems caused by the prior art, the present invention provides a door opening detection device, a microphone device, a door opening detection program, and a door that can detect door opening with high accuracy without adding a complicated circuit configuration. An object is to provide an open detection method.

  In order to solve the above-described problems and achieve the object, the door opening detection device, the microphone device, the door opening detection program, and the door opening detection method are configured to input an audio signal received by a microphone mounted in a vehicle. The process of receiving, the process of comparing the waveform of the received audio signal with each waveform read from the recording means in which the waveform of the audio signal for each door opening operation of the vehicle is recorded in advance, and the comparison process, And a process of outputting information indicating that the door opening operation corresponding to the matched waveform is executed when the waveform of the signal matches any of the waveforms recorded in the recording unit. .

  According to the door opening detection device, the microphone device, the door opening detection program, and the door opening detection method, it is possible to detect what operation relating to the door opening has been executed using the audio signal detected by the microphone.

  According to the door opening detection device, the microphone device, the door opening detection program, and the door opening detection method, the door opening can be detected with high accuracy without adding a complicated circuit configuration.

  Exemplary embodiments of a door opening detection device, a microphone device, a door opening detection program, and a door opening detection method will be described below in detail with reference to the accompanying drawings. In this door opening detection device, microphone device, door opening detection program, and door opening detection method, the waveform of the sound signal received by the microphone mounted in the vehicle and the door opening operation detected in advance. By comparing with the waveform of the audio signal, it is possible to detect what kind of door opening has been executed. In addition, if a door is opened in a different situation than usual using a function that can detect what kind of door opening has been performed, it may be detected as an unauthorized door opening and notified to the user. it can.

(Outline of door opening detection process)
First, the outline | summary of the door opening detection process concerning this Embodiment is demonstrated. FIG. 1 is an explanatory diagram showing an outline of the door opening detection process according to the present embodiment. As shown in FIG. 1, in the door opening detection process according to the present embodiment, the door 102 (102R, 102L) is used by using the audio signal received by the microphones MC (MC1 and MC2) mounted inside the vehicle 100. Detect release of

  In the present embodiment, the microphones MC1 and MC2 acquire voice information by receiving the voice inside the vehicle 100. However, if the signal represents a change in the sound inside the vehicle 100, the voice signal Not exclusively. For example, it may be a signal representing the detection result of pressure or vibration, and a signal detectable by a microphone mounted inside the vehicle can be used. Although the present embodiment describes an example in which two microphones MC1 and MC2 are mounted on the vehicle 100, the number of microphones is not limited to two.

  The microphones MC <b> 1 and MC <b> 2 are connected to the door opening detection device 101, and an audio signal received by the microphones MC <b> 1 and MC <b> 2 is input to the door opening detection device 101. The door opening detection device 101 is equipped with functions as a signal processing unit 110 and a waveform library 120.

  The signal processing unit 110 performs processing on the raw signal 111 as it is input from the microphones MC1 and MC2, and generates a processed signal 112. The raw signal 111 is a detection waveform of each of the microphones MC1 and MC2. As shown in FIG. 1, the microphones MC <b> 1 and MC <b> 2 are arranged inside the vehicle 100 at a predetermined interval. Accordingly, the microphones MC1 and MC2 generally exhibit different amplitude and phase detection waveforms depending on which door of the right door 102R and the left door 102L is opened and what is opened. Is.

  Therefore, the signal processing unit 110 adjusts the plurality of raw signals 111 to one processed signal 112 by performing amplification processing for aligning the amplitude and delay processing for aligning the phases on the raw signal 111. Based on any one of the plurality of raw signals 111 (for example, the detection waveform of MC1), other signals (for example, the detection waveform of MC2) are amplified and delayed to obtain the same waveform. A waveform comparison process between the waveform of the processed signal 112 and the waveform pattern recorded in the waveform library 120 is performed.

  In the waveform library 120, waveforms of sound signals received by the microphones MC1 and MC2 in advance for each of various operations related to the opening process of the doors 102R and 102L of the vehicle 100 are stored. Examples of the various operations related to the opening process include a normal door opening operation, a door opening operation without a handle sound, a window opening operation, and idling that occurs before or after the door opening process. The sound signals during these operations may be created by using the same vehicle model in which the same type microphones are mounted in advance, or the sound signals actually received by the microphones MC1 and MC2 of the vehicle 100 may be stored in the waveform library. The obtained waveform library may be transplanted to the waveform library 120 of the door opening detection device 101 and used.

  When the waveform comparison matches the waveform in the waveform library 120, the execution of the operation corresponding to the matching waveform is detected. In other words, when the waveform pattern of the normal door opening operation coincides with that of the normal door opening operation, it is detected that the normal door opening operation is executed in the vehicle 100.

  The procedure described above is a basic flow of the door opening detection process according to the present embodiment. Further, in order to improve the detection accuracy, whether or not the audio signal received using the raw signal 111 received by the microphones MC1 and MC2 is appropriate as a signal used for door opening detection, that is, the sound related to the door opening operation is actually used. You may perform the process which judges whether it is a signal.

  For example, in the procedure described above, adjustment processing (amplification and delay) is performed on the raw signal 111, so that the raw signals 111 of the microphones MC1 and MC2 have the same waveform, but they do not necessarily coincide completely. Therefore, normally, when the signal falls within a predetermined error set as the allowable range, it is handled as the processed signal 112 having the same waveform. Here, even if adjustment processing is performed on each of the raw signals 111 of the microphones MC1 and MC2, if the peak position interval or the zero cross (based on the steady state) position interval does not fall within a predetermined error, It is determined that the audio signal is not suitable for the door opening detection process, and the waveform comparison process is not performed.

  In addition, a function for detecting an abnormal door opening can be realized by using the door opening detection process described above. As a specific method, first, there is a method of detecting an abnormal door opening by accumulating a waveform pattern when a special operation such as window glass destruction or unlocking is performed in the waveform library 120. Such a special waveform pattern is created by using the same vehicle model in which the same type microphone is mounted in advance because it is difficult to actually store the sound signal received by the microphones MC1 and MC2 of the vehicle 100. The added waveform may be added to the library and accumulated. Second, there is a method in which a waveform pattern of a normal unlocking operation is accumulated as a waveform pattern, and an abnormal door opening is detected depending on whether or not the vehicle 100 is currently locked. Either of these methods may be used, or both methods may be applied simultaneously.

  As described above, in the door opening detection process according to the present embodiment, it is detected what operation related to the door opening is performed by using the audio signal detected by the microphone without mounting a new detection device. be able to. Furthermore, since it is possible to determine what operation has been performed, it is also possible to detect that an abnormal door opening has been performed.

  Next, the configuration and processing procedure of the door opening detection device that realizes the door opening detection process described above will be described in order.

(Hardware configuration of door opening detection device)
First, the hardware configuration of the door opening detection device 101 will be described. FIG. 2 is a block diagram illustrating a hardware configuration of the door opening detection device. As shown in FIG. 2, microphones MC1 and MC2 are connected to the door opening detection device 101. In the following description, the door opening detection device 101 to which the external microphones MC1 and MC2 are connected will be described. However, the actual device has a door opening detection function having a configuration in which the microphones MC1 and MC2 are incorporated. You may implement | achieve as a microphone apparatus.

  Before describing the internal configuration of the door opening detection device 101, first, the distance between the microphones MC1 and MC2 will be described. As illustrated in FIG. 1, the microphones MC1 and MC2 are arranged at a predetermined interval. The optimum value of this arrangement interval depends on the sampling frequency of the audio signal received by the microphones MC1 and MC2.

  For example, in an in-vehicle hands-free telephone, the sampling frequency of the AD converter is set to 8 kHz in accordance with the voice band 4 kHz of the mobile phone. If the wavelength of the sound wave corresponding to this sampling frequency is equal to the distance between the microphones, aliasing of the sound wave signal does not occur and the uniqueness of digital signal processing can be secured (Shannon's sampling theorem). That is, 340 m / s (sound speed) ÷ 8 kHz (sampling frequency) = 42.5 mm (microphone interval).

  In the case of the microphones MC1 and MC2 of the door opening detection device 101, since it is not a voice call heard by a human but an audio signal processing related to the door opening, only a sound with a more limited frequency is handled. Therefore, it is possible to reduce the data processing resource by lowering the sampling frequency, which can be realized at a lower cost. For example, if the sampling frequency is 3.4 kHz, 340 m / s (sound speed) ÷ 3.4 kHz (sampling frequency) = 100 mm (microphone interval). Therefore, in this case, the optimum arrangement interval between the microphones MC1 and MC2 is 10 cm.

  Next, the internal configuration of the door opening detection device 101 will be described. The sound signal received by the two microphones MC1 and MC2 as described above becomes an input signal to the door opening detection device 101. Note that when the vehicle 100 is equipped with other equipment (for example, a navigation device) that performs processing using audio signals received by the microphones MC1 and MC2, the audio signal is only the door opening detection device 101. In addition, it is input to these other devices.

  The door opening detection device 101 includes a filter circuit 201, an amplifier circuit 202, an A / D converter 203, and a processor 204, and performs door opening detection using these functions. . The door opening detection device 101 is connected to the notification device 205 as a means for outputting the detection result to the outside.

  In addition, the filter circuit 201, the amplifier circuit 202, and the A / D converter 203 of the door opening detection device 101 respectively process a system that processes an input signal from the microphone MC1 and an input signal from the microphone MC2. Since it is necessary to carry out the system in parallel, circuits for two systems are prepared.

  The filter circuit 201 removes unnecessary noise components from the audio signals input from the microphones MC1 and MC2. Then, the amplifier circuit 202 amplifies the audio signal and performs level adjustment. In general, since the level of the raw signal 111 (see FIG. 1) received by the microphones MC1 and MC2 is small, sufficient resolution cannot be obtained even if waveform comparison is performed by subsequent processing. Therefore, it is preferably amplified by the amplifier circuit 202. The audio signal is converted from an analog signal to a digital signal by the A / D converter 203 and input to the processor 204.

  Note that the filter circuit 201 and the amplifier circuit 202 are normally equipped as long as the device is equipped with a microphone, and therefore need not be newly added for the door opening detection device 101. Further, when the audio signals input from the microphones MC1 and MC2 can be used as they are (the noise is low and the level is high), the filter circuit 201 and the amplifier circuit 202 are passed through and input to the A / D converter 203 as they are. May be.

(Functional configuration of the processor)
Next, a functional configuration of the processor 204 will be described. FIG. 3 is a block diagram showing a functional configuration of the processor. As illustrated in FIG. 3, the processor 204 includes an input unit 301, an adjustment unit 302, a recording unit 303, a comparison unit 304, and an output unit 305. The input unit 301, the adjustment unit 302, the comparison unit 304, and the output unit 305 function as the signal processing unit 110, and the recording unit 303 functions as the waveform library 120.

  In addition, the functions (input unit 301 to output unit 305) serving as the above-described control units are, specifically, specific application ICs (hereinafter simply referred to as “ASIC”) such as standard cells and structured ASIC (Application Specific Integrated Circuit). And a PLD (Programmable Logic Device) such as an FPGA. Specifically, for example, the processor 204 can be realized by defining the function of each control unit described above by HDL description, logically synthesizing the HDL description and giving it to the ASIC or PLD.

  Input unit 301 receives an input of an audio signal received by microphones MC <b> 1 and MC <b> 2 mounted in vehicle 100. The audio signal input to the input unit 301 is a signal that has been processed by the filter circuit 201 and the amplifier circuit 202 and then converted to a digital signal by the A / D converter 203 as described with reference to FIG.

  The adjustment unit 302 adjusts the amplitude and phase of the sound signal waveform of each of the microphones MC1 and MC2 mounted on the vehicle 100 so as to match any one of the waveforms. As a method for determining a waveform to be a reference when adjusting the waveform, for example, a method having a maximum amplitude may be selected. That is, as shown in FIG. 1, the amplitude of the detection waveform of the microphone MC2 is amplified with the detection waveform of the microphone MC1 as a reference, and the phase is delayed. In addition to making adjustments to match any one waveform, adjustments may be made in accordance with the amplitude and phase of the waveform pattern recorded in the waveform library 120.

  In the recording unit 303, a waveform of an audio signal for each door opening operation of the vehicle 100 is recorded in advance. As described above, as a waveform to be recorded in the recording unit 303, an audio signal actually received by the microphones MC <b> 1 and MC <b> 2 of the vehicle 100 may be used, or a waveform library 120 prepared in advance is used. May be.

  The comparison unit 304 performs comparison processing for two types of purposes. The first is a comparison process for determining what operation the voice signal received by the microphones MC1 and MC2 represents regarding the door opening. In this case, the comparison unit 304 compares the waveform of the audio signal input to the input unit 301 with each waveform recorded in the recording unit 303.

  The second is a comparison process for determining whether or not the audio signal received by the microphones MC1 and MC2 can be used for the detection of the door opening process. In this case, the comparison unit 304 compares the waveforms of the audio signals received by the microphones MC1 and MC2, and determines whether or not they are within an allowable range. Then, only when it is determined that it falls within the allowable range, the above-described first comparison process is performed, so that any one of the waveforms is compared with each waveform recorded in the recording unit 303.

  Further, the comparison unit 304 may perform comparison processing limited to audio signals in a specific frequency band. For example, when unlocking a door lock of a specific vehicle type, the generated sound may be a very low frequency voice. Therefore, each function of the processor 204 may be a specification for further improving the accuracy of door opening detection. For example, in the recording unit 303, the waveform library 120 with a pattern is recorded in a waveform having a frequency equal to or lower than a threshold value. Then, the comparison unit 304 extracts only the waveform having a frequency equal to or lower than the threshold value from the received audio signal, and compares it with each waveform recorded in the recording unit 303.

  When the waveform of the audio signal matches any of the waveforms recorded in the recording unit 303 by the comparison process by the comparison unit 304, the output unit 305 indicates that the door opening operation corresponding to the matched waveform has been executed. Output information. Information output from the output unit 305 is input to the notification device 205.

The notification device 205 is a device that notifies the user of the vehicle 100 of information input from the door opening detection device 101. Specifically, information indicating that the door opening operation has been performed is output to the user's portable terminal via the speaker and the display of the vehicle 100 and the communication I / F.
In addition, when an abnormal door opening operation as described later is executed to make an emergency notification or to function as an alarm, a function of outputting a siren or a beep sound may be provided.

  In the door opening detection device 101, since all the processing relating to waveform comparison is executed by a digital circuit, a large-scale circuit is not required. In addition, since it can be realized by adding a scale that fits within the space of the existing microphone module, it can be easily applied to the existing microphone module.

(Door open detection procedure)
Next, a procedure of door opening detection processing of information related to door opening / closing by the door opening detection device 101 will be described. FIG. 4 is a flowchart illustrating a procedure of door opening detection processing. As described with reference to FIGS. 1 and 2, the vehicle 100 is equipped with two microphones MC1 and MC2. In order for the door opening detection device 101 to activate the door opening detection process, first, it is determined whether or not the input signals from the microphones MC1 and MC2 are equal to or greater than a threshold value (step S401).

  In step S401, the process waits until an input signal equal to or greater than the threshold value is confirmed (step S401: No loop). The waveform period: n is set to 1 (step S402), and the waveform detection processing of the microphones MC1 and MC2 is started in parallel.

  The value of the nth maximum value is detected from the waveform input from the microphone MC1 (step S403). Here, since the first maximum value is detected, the first positive peak value is detected. Then, the zero cross next to the nth maximum value detected in step S403 is detected (step S404). The zero cross is a value straddling the reference point (0) when the steady value is the reference point (0). As an example, referring to the waveform of FIG. 5A, the first maximum value is Max1, and the next zero cross after the first maximum value is 0X1.

  Next, the value of the nth minimum value is detected (step S405). Here, in order to detect the value of the first minimum value, the first negative peak is detected. Then, the zero cross next to the nth minimum value detected in step S405 is detected (step S406). Again, referring to the waveform of FIG. 5A as an example, the value of the first minimum value is Min1, and the next zero cross of the first minimum value is 0X2.

Then, the following calculation process is performed on the waveform of the nth cycle (here, the waveform of the first cycle) (step S407).
(1) Maximum value / minimum value (2) Time difference between zero crosses (3) Time difference between maximum value and minimum value

  When the calculation process in step S407 ends, it is determined whether n has reached a predetermined number (step S408). In step S408, the predetermined number serving as a determination criterion is set in consideration of the number of cycles of the waveform of the audio signal for each opening operation. In other words, if the waveform of the audio signal for each opening operation is a three-cycle waveform on average, n is set to 4 so that at least three cycles can be sampled.

  In step S408, when n is less than the predetermined number (step S408: No), n is incremented (step S409), and the processing of step S403 to step S407 is executed for the next second period.

  On the other hand, in the waveform input from the microphone MC2, the value of the nth maximum value is detected in the same manner as the waveform input from the microphone MC1 (step S410). Thereafter, Steps S411 to S416 are executed in the same manner as Steps S404 to S409.

  When n reaches a predetermined number for the waveforms input from the microphones MC1 and MC2 (steps S408 and 415: Yes), the calculation processing results of the microphones MC1 and MC2 are compared (step S417). The comparison process in step S417 corresponds to the second comparison process described in the comparison unit 304. Then, it is determined whether or not the comparison result in step S417 is within the error range (preset allowable range) (step S418).

  If it is determined in step S418 that the comparison result in step S417 is within the error range (step S418: Yes), collation processing with the waveform pattern recorded in the recording unit 303 is performed (step S419). The process ends. If it is determined in step S418 that the comparison result in step S417 is out of the error range (step S418: No), the audio signals received by the microphones MC1 and MC2 are not related to the door opening. It returns to the process of step S401 and waits for the next process. The collation process in step S419 corresponds to the first comparison process described in the comparison unit 304. If any waveform matches in the comparison process, the output unit 305 outputs information indicating that the door opening operation corresponding to the matched waveform has been executed.

  Note that the processing performed in S403 to S409 and S410 to S416 in FIG. 4 changes as appropriate according to the number of microphones. For example, if the number of microphones is three, the same processing as in S403 to S409 may be further added between S402 and S417 for the third microphone and executed in parallel in S403 to S409.

(Verification processing of processed signal and waveform pattern)
Next, the collation process between the processed signal and the waveform pattern executed in step S419 will be described. As described above, the door opening detection apparatus 101 is provided with the waveform library 120, and compares each waveform pattern with the waveform of the audio signal actually received by the microphones MC1 and MC2. At this time, the comparison unit 304 specifically performs a comparison process between the processed signal and the waveform pattern as the comparison process, and regards the waveform that satisfies the reference set by the comparison process as a matched waveform.

  5A is a chart showing an example of a waveform pattern when the door is normally opened, FIG. 5B is a chart showing an example of a waveform pattern when the door is open without a handle sound, and FIG. Fig. 5-4 is a chart showing examples of waveform patterns, and Fig. 5-4 is a chart showing examples of waveform patterns during idling. Each waveform in FIGS. 5-1 to 5-4 represents a change in frequency of the audio signal over time. As is apparent from the waveforms in FIGS. 5-1 to 5-4, the shape of the wavelength varies greatly depending on the operation to be performed. However, since the position where each operation is executed and the external environment influence, the waveform of the audio signal received by the microphones MC1 and MC2 must completely match the waveforms shown in FIGS. Is difficult.

  Therefore, as described above, the comparison unit 304 performs the matching process between the processed signal and the waveform pattern, and regards the waveform that satisfies the reference set by the matching process as the matched waveform. FIG. 6 is an explanatory diagram showing a collation process between the processed signal and the waveform pattern. A chart 600 in FIG. 6 shows a waveform example of a sound signal received by the microphones MC1 and MC2.

  At this time, positive peak values Max1 and Max2, negative peak values Min1 and Min2, and zero crosses 0X1 to 0X4 are extracted from the waveform. These extracted values are values used when comparing the waveforms of the audio signals received by the microphones MC1 and MC2 described in the flowchart of FIG.

  Then, it is determined whether or not the position of each extracted value matches the position of each value of the waveform pattern. At this time, since an error occurs in each of the positive and negative peak values, it may be determined that they match if they are within the error regions 601 to 604 as shown in FIG.

  Next, detection of abnormal door opening using the door opening detection process described above will be described. In recent years, vehicles are usually equipped with a microphone for voice input for navigation devices and a microphone for vehicle interior noise reduction devices. By executing the door opening detection process using these microphones, the crime prevention function can be realized without using a new device by utilizing the equipment.

  Generally, a low frequency of 10 Hz or less is generated when a door is opened or a window glass is broken. When a single microphone receives a low frequency of 10 Hz or less, a detection error is large and causes a malfunction. However, it can be generated without malfunction by simultaneously detecting with a plurality of microphones as in this embodiment. It becomes possible to specify.

(Theft notification process)
Next, a procedure for performing a theft notification process using the output result of the door opening detection device 101 described above will be described. FIG. 7 is a flowchart showing the procedure of the theft notification process. In the flowchart of FIG. 7, first, it is determined whether or not the collation result of step S419 has been output by the door opening detection process described in FIG. 4 (step S701). Here, it waits until the collation result is output (step S701: No loop). When the collation result is output (step S701: Yes), whether the collation result is an operation related to theft / unlocking or not. Is determined (step S702). The operation related to the theft / unlocking is an operation with a possibility of theft such as a window glass destruction or a pry opening operation, and the corresponding operation is registered in advance from the waveform pattern. Here, when it is not operation | movement regarding a theft unlocking (step S702: No), a series of processes are complete | finished as it is.

  In step S702, if the operation is related to theft / unlocking (step S702: Yes), it is next determined whether or not an unlocking sound is confirmed within a predetermined time (step S703). The unlocking sound is also recorded in the waveform library 120 as a waveform pattern. Therefore, if the unlocking operation is not performed from the unlocking sound as the door opening detection process within the predetermined time, the unlocking sound is not confirmed. Here, when detecting the unlocking sound with higher accuracy, for example, it may include a determination as to whether the unlocking sound is in the 1 to 3 kHz band. If the door is normally opened by the user holding the key, the unlocking sound falls within the 1 to 3 kHz band. On the other hand, in the case of an improper unlocking sound, since a releasing tool or the like is used, the releasing sound is different from the normal time. In addition to the bands exemplified here, if there is a characteristic in the frequency band of the release sound depending on the shape of the vehicle or key, the corresponding band may be set.

  Therefore, when the unlocking sound is confirmed in step S703 (step S703: Yes), it is determined that the door is normally opened, and the series of processes is terminated. On the other hand, when the unlocking sound has not been confirmed (step S703: No), since there is a high possibility that the theft has been performed, a notification process (e-mail transmission, (Alarm output) is performed (step S704), and the series of processes is terminated.

  Thus, in the door opening detection device 101, a crime prevention system can be constructed without adding a new device using the output result of the door opening detection and without sacrificing the space in the vehicle. Further, by adjusting the algorithm of the flowchart of FIG. 7, it becomes possible to detect separation such as door opening, broken window glass, mischief to various vehicles, and the like.

  As described above, according to the present embodiment, the waveform of the audio signal received by the microphone mounted in the vehicle and the waveform of the audio signal for each door opening operation that has been detected in advance. By comparing, it is possible to detect what kind of door opening has been executed. Furthermore, if a door is opened in a different situation than usual, using a function that can detect what kind of door opening has been performed, it is detected as an illegal door opening such as theft, and the user is notified. You can also sound an alarm.

  The door opening detection method described in this embodiment can be realized by executing a program prepared in advance on a computer such as a personal computer or a workstation. This program is recorded on a computer-readable recording medium such as a hard disk, a flexible disk, a CD-ROM, an MO, and a DVD, and is executed by being read from the recording medium by the computer. Further, this program may be a medium that can be distributed via a network such as the Internet.

  The following additional notes are disclosed with respect to the embodiment described above.

(Additional remark 1) The input means which receives the input of the audio | voice signal received by the microphone mounted in the vehicle,
Recording means in which a waveform of an audio signal for each door opening operation of the vehicle is recorded in advance,
A comparison means for comparing the waveform of the audio signal received by the input means with each waveform recorded in the recording means;
When the waveform of the audio signal matches one of the waveforms recorded in the recording means by the comparison processing by the comparison means, information indicating that the door opening operation corresponding to the matched waveform has been executed is output. Output means;
A door opening detection device comprising:

(Additional remark 2) It has the extraction means which extracts the zero cross position on the basis of the peak position and steady value of the waveform of the sound signal received by the input means,
The comparison means makes a waveform match determination by comparing the peak position and zero cross position extracted by the extraction means with the peak position and zero cross position of each waveform recorded in the recording means. The door opening detection device according to appendix 1.

(Supplementary Note 3) When there are a plurality of microphones mounted on the vehicle, adjustment means for adjusting the amplitude and phase of the sound signal waveform of each microphone received by the input means so as to match any one waveform Prepared,
The comparing means determines whether or not each waveform adjusted by the adjusting means is within an allowable range, and when it is determined that the respective waveforms are within an allowable range, The door opening detection device according to appendix 1 or 2, wherein the one waveform is compared with each waveform recorded in the recording means.

(Additional remark 4) Each said microphone is arrange | positioned within the predetermined space | interval, The door opening detection apparatus of Additional remark 3 characterized by the above-mentioned.

(Additional remark 5) The door opening detection apparatus as described in any one of additional remarks 1-4 provided with the noise removal means which removes the noise component of the audio | voice signal received by the said input means.

(Supplementary note 6) Any one of Supplementary notes 1 to 5, further comprising amplification means for amplifying the amplitude of the audio signal received by the input means so as to match the amplitude of each waveform recorded in the recording means. The door opening detection apparatus as described in one.

(Additional remark 7) The waveform of the frequency below a threshold value is recorded on the said recording means among the audio | voice signals for every door opening operation | movement of the said vehicle,
The comparison means compares a waveform having a frequency equal to or lower than the threshold value in the audio signal received by the input means with each waveform recorded in the recording means. The door opening detection apparatus as described in any one of these.

(Additional remark 8) The said comparison means starts the said comparison process, when the audio | voice signal received by the said input means is a predetermined waveform, The additional description 1-7 characterized by the above-mentioned Door open detection device.

(Supplementary note 9) a microphone mounted in the vehicle;
Input means for receiving an input of an audio signal received by the microphone;
Recording means in which a waveform of an audio signal for each door opening operation of the vehicle is recorded in advance,
A comparison means for comparing the waveform of the audio signal received by the input means with each waveform recorded in the recording means;
When the waveform of the audio signal matches one of the waveforms recorded in the recording means by the comparison processing by the comparison means, information indicating that the door opening operation corresponding to the matched waveform has been executed is output. Output means;
A microphone device comprising:

(Appendix 10)
An input means for receiving an input of an audio signal received by a microphone mounted in the vehicle;
Recording means in which a waveform of an audio signal for each door opening operation of the vehicle is recorded in advance.
Comparison means for comparing the waveform of the audio signal received by the input means with each waveform recorded in the recording means;
When the waveform of the audio signal matches one of the waveforms recorded in the recording means by the comparison processing by the comparison means, information indicating that the door opening operation corresponding to the matched waveform has been executed is output. Output means,
A door opening detection program characterized by functioning as:

(Appendix 11) The computer
An input process for receiving an input of an audio signal received by a microphone mounted in the vehicle;
A comparison step of comparing the waveform of the audio signal received by the input step with each waveform read from the recording means in which the waveform of the audio signal for each door opening operation of the vehicle is recorded in advance;
If the waveform of the audio signal matches any of the waveforms recorded in the recording means by the comparison process in the comparison step, information indicating that the door opening operation corresponding to the matched waveform has been executed is output. An output process;
The door opening detection method characterized by performing.

It is explanatory drawing which shows the outline | summary of the door opening detection process concerning this Embodiment. It is a block diagram which shows the hardware constitutions of a door opening detection apparatus. It is a block diagram which shows the functional structure of a processor. It is a flowchart which shows the procedure of a door open detection process. It is a graph which shows the example of a waveform pattern at the time of normal door opening. It is a chart which shows the example of a waveform pattern at the time of door opening without a handle sound. It is a graph which shows the waveform pattern example at the time of a window opening. It is a graph which shows the waveform pattern example at the time of idling. It is explanatory drawing which shows the collation process with the signal after a process, and a waveform pattern. It is a flowchart which shows the procedure of a theft alerting | reporting process.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Vehicle MC1, MC2 Microphone 101 Door opening detection apparatus 102R Right door 102L Left door 110 Signal processing part 120 Waveform library 201 Filter circuit 202 Amplifier circuit 203 A / D converter 204 Processor 205 Notification apparatus 301 Input part 302 Adjustment part 303 Recording part 304 Comparison unit 305 Output unit

Claims (5)

Input means for receiving an input of an audio signal received by a microphone mounted in the vehicle;
Recording means in which a waveform of an audio signal for each door opening operation of the vehicle is recorded in advance,
A comparison means for comparing the waveform of the audio signal received by the input means with each waveform recorded in the recording means;
When the waveform of the audio signal matches one of the waveforms recorded in the recording means by the comparison processing by the comparison means, information indicating that the door opening operation corresponding to the matched waveform has been executed is output. Output means;
A door opening detection device comprising: When there are a plurality of microphones mounted on the vehicle, the apparatus includes an adjusting unit that adjusts the amplitude and phase of the sound signal waveform of each microphone received by the input unit so as to match any one of the waveforms,
The comparing means determines whether or not each waveform adjusted by the adjusting means is within an allowable range, and when it is determined that the respective waveforms are within an allowable range, 2. The door opening detection device according to claim 1, wherein the one waveform is compared with each waveform recorded in the recording means. A microphone mounted in the vehicle;
Input means for receiving an input of an audio signal received by the microphone;
Recording means in which a waveform of an audio signal for each door opening operation of the vehicle is recorded in advance,
A comparison means for comparing the waveform of the audio signal received by the input means with each waveform recorded in the recording means;
When the waveform of the audio signal matches one of the waveforms recorded in the recording means by the comparison processing by the comparison means, information indicating that the door opening operation corresponding to the matched waveform has been executed is output. Output means;
A microphone device comprising: Computer
An input means for receiving an input of an audio signal received by a microphone mounted in the vehicle;
Recording means in which a waveform of an audio signal for each door opening operation of the vehicle is recorded in advance.
Comparison means for comparing the waveform of the audio signal received by the input means with each waveform recorded in the recording means;
When the waveform of the audio signal matches one of the waveforms recorded in the recording means by the comparison processing by the comparison means, information indicating that the door opening operation corresponding to the matched waveform has been executed is output. Output means,
A door opening detection program characterized by functioning as: Computer
An input process for receiving an input of an audio signal received by a microphone mounted in the vehicle;
A comparison step of comparing the waveform of the audio signal received by the input step with each waveform read from the recording means in which the waveform of the audio signal for each door opening operation of the vehicle is recorded in advance;
If the waveform of the audio signal matches any of the waveforms recorded in the recording means by the comparison process in the comparison step, information indicating that the door opening operation corresponding to the matched waveform has been executed is output. An output process;
The door opening detection method characterized by performing.

Images