WO2019123865A1 - Sensing system, program, information processing device, and information processing method - Google Patents

Abstract

The present invention issues notification that the odor of a target object has intensified. The sensing system according to the present invention is provided with: a sensor device including at least one detection element for detecting the amount of an odor-causing substance included in air in the vicinity of a target object; and an information processing device having a determination unit for determining the intensity of the odor of the air in the vicinity of the target object on the basis of a pattern indicating detection values of each of the at least one detection element, and an alarm output unit for outputting an alarm when the intensity of the odor of the air in the vicinity of the target object is greater than a pre-set threshold value.

Description

Sensing system, program, information processing apparatus and information processing method

The present invention relates to a sensing system, a program, an information processing apparatus, and an information processing method.

In recent years, odor sensor elements have been widely developed. For example, as an odor sensor element, a QCM (Quartz Crystal Microbalance) sensor in which a film that adsorbs odor causing substances is provided on the surface of a quartz oscillator is known. In the AT-cut quartz oscillator, the resonance frequency changes due to the mass change. The QCM sensor detects the mass of the causative substance by vibrating the AT-cut quartz oscillator and detecting the amount of change in the resonance frequency.

There is also known a sensor device provided with a plurality of odor sensor elements each detecting the mass of a different cause substance. Such a sensor device can output the mass of each of a plurality of causal substances. The information processing apparatus receives each amount of the plurality of causative substances output from such a sensor device, and compares the pattern of each amount of the plurality of causative substances received with the pattern registered in advance. Thus, the information processing apparatus can identify the type of odor.

Such a sensor device is combined with, for example, information processing technology such as IOT (Internet of Things) technology, for example, management of the environment in the room or in the vehicle, food hygiene management, factory process control, and human beings Or it can apply to physical condition management of a pet etc.

Patent Document 1 and Patent Document 2 describe a technique for notifying of the time to replace the filter of the air cleaning device. Patent Document 3 describes a technique for controlling the environment in a vehicle according to the odor in the vehicle.

Japanese Patent Application Laid-Open No. 11-156131 JP 2000-210518 A JP, 2016-199098, A

By the way, the space in the vehicle is very narrow and sealed, and the passenger stays for a long time. For this reason, the inside of the vehicle is likely to have a strong smell. The smell of space in the vehicle is one of the causes of the dirt on the seat. The dirt on the sheet is difficult to remove as the accumulated amount increases.

However, it is difficult for the passenger himself to notice that the dirt in the seat has enhanced the smell of the space in the vehicle. Therefore, when it is noticed that the sheet is stained, there is a possibility that it becomes difficult to remove the sheet dirt even if it is cleaned. For this reason, it is required to detect and notify that the smell of the sheet has become strong.

The present invention has been made in view of the above, and it is an object of the present invention to provide a sensing system, a program, an information processing apparatus, and an information processing method capable of notifying that the smell of a target object has become strong. .

In order to solve the problems described above and to achieve the object, a sensing system according to the present invention includes a sensor device including at least one detection element that detects an amount of odor causing substance contained in air in the vicinity of a target object. A determination unit that determines the intensity of the odor of air in the vicinity of the target object based on a pattern representing the detection value of each of the at least one detection element; and the intensity of the odor of air in the vicinity of the target object And an information processing apparatus having an alarm output unit that outputs an alarm when the threshold value is larger than a predetermined threshold.

According to the present invention, it can be notified that the smell of the target object has become strong.

FIG. 1 is a diagram showing a sensing system according to an embodiment. FIG. 2 is a diagram showing the configuration of the sensor device. FIG. 3 is a diagram showing an example of the configuration of the sensor unit. FIG. 4 is a diagram for explaining the odor determination process. FIG. 5 is a diagram showing the flow of air in the first mode. FIG. 6 is a diagram showing the flow of air in the second mode. FIG. 7 is a diagram showing a functional configuration of the information processing apparatus. FIG. 8 is a flowchart showing an example of the flow of odor detection processing by the information processing apparatus. FIG. 9 is a view showing a display example of an alarm image of the information processing apparatus. FIG. 10 is a diagram showing a display example of the information processing apparatus. FIG. 11 is a flowchart showing the flow of the process of detecting the smell of a passenger by the information processing apparatus. FIG. 12 is a view showing a part of the configuration of a sensor device according to a modification. FIG. 13 is a diagram showing a hardware configuration of the information processing apparatus.

Hereinafter, the sensing system 10 according to the present embodiment will be described with reference to the drawings.

FIG. 1 is a diagram showing a sensing system 10 according to the embodiment. The sensing system 10 notifies by an alarm that the odor originating from the target object is intensified. In the present embodiment, the sensing system 10 is applied to a vehicle 18. The sensing system 10 applied to the vehicle 18 detects an odor originating from the seat 32 in the vehicle 18 (inside the vehicle). Sensing system 10 may be applied not only to seat 32 in vehicle 18 but also to other devices. For example, the sensing system 10 may detect an odor originating from a bed, a chair or a toilet.

The sensing system 10 includes an information processing device 20 and at least one sensor device 30.

The information processing device 20 is a computer having a data processing function, a communication function, and a display function. For example, the information processing apparatus 20 is a computer such as, for example, a smartphone, a tablet, a wearable computer, a mobile phone, or a laptop computer. In addition, the information processing device 20 may be a dedicated or general-purpose computer provided inside the vehicle 18. In addition, the information processing device 20 may be a server or the like connectable via a communication device. The information processing device 20 is used by a user (a passenger) who uses the vehicle 18.

Each of the at least one sensor device 30 comprises at least one detection element. Each of the at least one detection element detects the amount of odor causing substance that causes the smell contained in the air. The detection element detects the mass of the causative substance as the amount of the causative substance. Alternatively, the detection element may detect the volume or molecular weight of the causative substance as the quantity of the causative substance.

The sensor device 30 transmits a signal representing a detection value of each of at least one built-in detection element to the information processing device 20 by wireless communication. For example, the sensor device 30 can communicate with the information processing device 20 by wireless LAN (Local Area Network) such as IEEE 802.11 or short distance wireless communication for digital devices such as IEEE 802.15. In addition, when the information processing device 20 is a dedicated or general-purpose computer provided in the vehicle 18, the sensor device 30 performs wired communication of signals representing detection values of at least one of the built-in detection elements. May be transmitted to the information processing apparatus 20.

Each of the at least one sensor device 30 is mounted proximate to the seat 32 in the vehicle 18. The sensor device 30 is mounted, for example, on the seat 32 in close proximity to either a seat, a backrest or a headrest. Thus, the sensor device 30 can detect the amount of the causative substance originating from the seat 32 (for example, a seat, a backrest or a headrest).

When the vehicle 18 includes a plurality of seats 32, the sensing system 10 may include a plurality of sensor devices 30 corresponding to each of the plurality of seats 32. The sensing system 10 may also include a plurality of sensor devices 30 corresponding to the seat, the backrest, or the headrest in the seat 32, respectively.

The information processing device 20 receives, from each of the at least one sensor device 30, a signal representing a detected value of each of the at least one detection element. The information processing device 20 detects, for each of the at least one sensor device 30, the odor of the surrounding air to which the target sensor device 30 is attached, based on the received detection value of the at least one detection element. For example, the information processing apparatus 20 determines the type and the intensity of the odor of air around the mounting position. Subsequently, the information processing device 20 compares the intensity of the odor of air around the mounting position with a predetermined threshold. Then, the information processing device 20 outputs an alarm when the intensity of the odor of air around the mounting position is larger than the threshold. For example, the information processing apparatus 20 performs the determination of the intensity of the odor of the air around the mounting position and the comparison with the threshold at predetermined time intervals.

Further, the information processing device 20 may output information representing the smell of the seat 32 (seat, backrest or headrest) to which the sensor device 30 is attached, based on the detected smell. For example, the information processing apparatus 20 outputs information indicating the type and strength of the odor of the attached seat 32 (seat, backrest or headrest). Furthermore, the information processing device 20 may estimate and output the cleaning time of the seat 32 (seat, backrest, or headrest) to which the sensor device 30 is attached, based on the result of the odor determination in the past.

FIG. 2 is a diagram showing the configuration of the sensor device 30. As shown in FIG. The sensor device 30 has, for example, a size that can be carried by one hand. For example, the sensor device 30 is housed in a housing having a size of several mm to several cm on one side. The shape of the sensor device 30 is an example, and may be any shape.

The sensor device 30 includes a filter 34, a first fan 36, a second fan 38, a sensor unit 40, a communication unit 48, a control unit 50, and a battery 52.

The filter 34 allows air to pass through and removes odor causing substances from the passed air. The filter 34 removes at least one odor causing substance to be detected. The filter 34 may remove some odor causing substances out of at least one odor causing substance to be detected.

The first fan 36 takes in air and passes the taken air through the filter 34 to supply it to the sensor unit 40. For example, the first fan 36 is disposed between the filter 34 and the sensor unit 40, and delivers the air that has passed through the filter 34 to the sensor unit 40. In addition, the sensor apparatus 30 is arrange | positioned so that the intake port of the air of the 1st fan 36 may be located in the vicinity of a target object (for example, the seat part of a sheet | seat 32, a backrest, or a headrest). The first fan 36 takes in air from the vicinity of the target object, passes through the filter 34, and supplies it to the sensor unit 40. Thereby, the first fan 36 can take in the air containing the minute substance attached to the target object, pass through the filter 34, and can be supplied to the sensor unit 40.

The second fan 38 takes in air and supplies the taken-in air to the sensor unit 40 without passing through the filter 34. For example, the second fan 38 is disposed between the air intake and the sensor unit 40, and sends out the air not passing through the filter 34 to the sensor unit 40. In addition, the sensor apparatus 30 is arrange | positioned so that the intake port of the air of the 2nd fan 38 may be located in the vicinity of a target object (for example, the seat part of a sheet | seat 32, a backrest, or a headrest). The second fan 38 takes in air from the vicinity of the target object and supplies the air to the sensor unit 40 without passing through the filter 34. As a result, the second fan 38 can take in the air containing the minute substance attached to the target object, and can supply the air to the sensor unit 40 without passing through the filter 34.

The sensor unit 40 includes at least one of the above-described detection elements. The air passed through the filter 34 and the air not passed through the filter 34 are provided to the sensor unit 40 at different times. Each of the at least one detection element detects the amount of odor causing substance when air passed through the filter 34 is provided. Furthermore, each of the at least one detection element detects the amount of odor causing substance even when air not passing through the filter 34 is provided.

The sensor unit 40 does not pass through the filter 34 of the at least one detection element and the detection value indicating the amount of the odor causing substance contained in the air that has passed through the filter 34 of each of the at least one detection element. It outputs a detected value indicating the amount of odor causing substance contained in the air. Specifically, the sensor unit 40 receives air from each of the at least one detection element when air passed through the filter 34 blown from the first fan 36 is supplied, and is blown from the second fan 38. When air not passing through the filter 34 is given, the detected value of each of the at least one detection element is output.

When the sensor unit 40 includes a plurality of detection elements, the plurality of detection elements are elements of different types.

For example, any two detection elements included in the sensor unit 40 detect the amount of odor causing substances of different types. For example, the first detection element detects the amount of substance X, and the second detection element detects the amount of substance Y. Also, for example, any two detection elements included in the sensor unit 40 may detect the amount of odor-causing substance of the same type with different sensitivities. For example, the first detection element detects the amount of substance X at a first sensitivity, and the second detection element detects the amount of substance X at a second sensitivity lower than the first sensitivity.

Also, for example, any two detection elements included in the sensor unit 40 may detect the amount of a plurality of odor causing substances of combinations of different types. For example, the first detection element detects the total amount of substance X and substance Y, and the second detection element detects the total amount of substance X and substance Z. Also, for example, any two detection elements included in the sensor unit 40 may detect the amounts of the odor causing substances of the plurality of combinations of the same type with different sensitivities. For example, the first detection element detects the total amount of the substance X and the substance Y at a first sensitivity, and the second detection element detects the total amount of the substance X and the substance Y lower than the first sensitivity It may be detected at the second sensitivity.

The communication unit 48 transmits the signal detected by the sensor unit 40 to the information processing apparatus 20. That is, the communication unit 48 outputs a signal representing a detection value indicating the amount of odor causing substance contained in the air that has passed through the filter 34 of each of the at least one detection element, and the filter 34 of each of the at least one detection element. A signal representing a detected value indicating the amount of the odor causing substance contained in the air not passing through is transmitted to the information processing apparatus 20.

The control unit 50 manages and controls the operations of the first fan 36, the second fan 38, the sensor unit 40, and the communication unit 48. For example, the control unit 50 controls the operation start timing and the operation end timing of the first fan 36 and the second fan 38.

The battery 52 supplies operating power to the first fan 36, the second fan 38, the communication unit 48 and the control unit 50. The sensor device 30 may have a power acquisition unit that acquires a power source provided in the vehicle 18 instead of the battery 52. The power acquisition unit supplies operating power to the first fan 36, the second fan 38, the sensor unit 40, the communication unit 48, and the control unit 50.

FIG. 3 is a diagram showing the configuration of the sensor unit 40. As shown in FIG. In the present embodiment, the sensor unit 40 is a QCM sensor capable of detecting the mass of the minute substance contained in the air. The sensor unit 40 is not limited to the QCM sensor, but may be another type of sensor such as a gas sensor using a semiconductor thin film.

In the present embodiment, the sensor unit 40 has a support portion 58, at least one gas detection element 60, and a drive detection circuit 62. The support portion 58 is attached with each of at least one gas detection element 60.

The gas detection element 60 is an example of a detection element. In the example of FIG. 3, the sensor unit 40 has six gas detection elements 60-A to 60-F of different types. For example, each of the six gas detection elements 60-A to 60-F detects different types of odor causing substances.

Each of the at least one gas detection element 60 includes at least one of a quartz crystal vibrator which is vibratably cut by a piezoelectric effect, two electrodes provided on flat surfaces on both sides of the quartz crystal vibrator, and a flat surface of the quartz crystal vibrator. And an adsorption film provided.

A part of the side surface of the crystal unit is vibratably held by the support 58. An alternating voltage is applied to the two electrodes from the drive detection circuit 62. The adsorption film adsorbs a specific detection element contained in the surrounding air. Each of the at least one gas detection element 60 includes an adsorption film that adsorbs different substances. Specifically, each of the at least one gas detection element 60 includes an adsorption film that adsorbs the detection element to be detected by the sensor device 30.

In such a gas detection element 60, when an alternating voltage at a resonance frequency is applied to the two electrodes, the crystal oscillator vibrates due to the piezoelectric effect. The fundamental resonant frequency of the quartz oscillator is determined by mass and visco-elasticity. Therefore, when the detection element is adsorbed to the adsorption film and the mass changes, the basic resonance frequency of the gas detection element 60 changes according to the change of the adsorbed mass.

The drive detection circuit 62 applies an alternating voltage to each of the at least one gas detection element 60 when the first fan 36 or the second fan 38 blows, and the fundamental resonance frequency of each of the at least one gas detection element 60 To detect changes in Thus, the drive detection circuit 62 detects, for each of the at least one gas detection element 60, the mass of the odor-causing substance contained in the air given by the air blowing from the first fan 36 or the second fan 38. Can. The drive detection circuit 62 supplies the detected value to the communication unit 48.

FIG. 4 is a diagram for explaining the odor determination process.

The information processing device 20 acquires, from the sensor device 30, a signal representing a detection value of each of at least one detection element. For example, in the example of FIG. 4, the information processing apparatus 20 includes a gas detection element 60-A, a gas detection element 60-B, a gas detection element 60-C, a gas detection element 60-D, a gas detection element 60-E and A signal representing each detected value of the gas detection element 60-F is acquired.

In addition, the information processing device 20 stores reference patterns representing detection values of at least one detection element, which are acquired when a predetermined type of odor occurs. For example, in the example of FIG. 4, the information processing apparatus 20 represents the detection values of the gas detection elements 60 -A to 60 -F when each of the aging odor, the mold odor and the odor of sweat is detected. The reference pattern is stored.

The information processing device 20 detects at least one of detection patterns representing detection values of at least one detection element included in a signal acquired from the sensor device 30 and a predetermined type of smell stored in advance. The reference pattern representing the detection value of each of the two detection elements is matched. Then, when the detection pattern acquired from the sensor device 30 matches the reference pattern, the information processing device 20 determines that the odor of air given to the sensor device 30 is a predetermined type of odor. The information processing apparatus 20 may store reference patterns for a plurality of types of odors, and determine to which odor reference pattern one detected pattern matches. For example, in the example of FIG. 4, the information processing device 20 determines that the odor of air given to the sensor device 30 is a musty odor.

Furthermore, the information processing apparatus 20 may also determine the intensity of the odor by matching for each type of odor. For example, the information processing apparatus 20 stores the reference pattern for each type of odor and for each intensity of the odor, and detects the detection pattern acquired from the sensor device 30, for each type of odor stored in advance, and the intensity of the odor May be matched with each reference pattern.

In addition, even if the information processing apparatus 20 updates the reference pattern stored in advance as learning data, using the detection pattern obtained when the user feels that the predetermined type of odor is generated, as learning data Good. The information processing apparatus 20 may periodically acquire, from the server or the like, a reference pattern for each of a plurality of odor types and odor intensities, and update the stored reference patterns.

The information processing apparatus 20 may determine the type and strength of the odor by another method instead of such pattern matching. For example, the information processing device 20 may determine the type of odor and the intensity of the odor using a technique such as a neural network.

In the example of FIG. 4, an example is shown in which the sensor device 30 outputs detection values of six types of gas detection elements 60-A to 60-F. However, the sensor device 30 may output detection values of the number of detection elements smaller than six or more than six. Moreover, in the example of FIG. 4, the example which determines the smell of an aging smell, a musty smell, and a sweat is shown. However, the information processing apparatus 20 may determine odors other than these. Moreover, the sensor apparatus 30 of this embodiment may output the detection value of one detection element.

Here, the sensor device 30 passes through the detection value indicating the amount of odor causing substance contained in the air that has passed through the filter 34 of each of the at least one detection element, and the filter 34 of each of the at least one detection element. It outputs a detected value that indicates the amount of odor-causing substance contained in air. Then, the sensor device 30 outputs these detected values to the information processing device 20.

The information processing apparatus 20 has a first pattern representing a detection value indicating the amount of odor causing material contained in the air that has passed through the filter 34 of each of the at least one detection element, and the filter 34 of each of the at least one detection element. Calculating a difference pattern representing a difference from the second pattern representing the detected value indicating the amount of the odor causing substance contained in the air not passing through. Then, the information processing device 20 detects the odor of air based on the difference pattern. For example, the information processing apparatus 20 matches the difference pattern with the reference pattern stored in advance, and determines the type and strength of the odor of air.

FIG. 5 is a diagram showing the flow of air in the first mode. The control unit 50 of the sensor device 30 switches between the first mode and the second mode when detecting an odor. In the first mode, the control unit 50 operates the first fan 36 to stop the second fan 38. Then, in the first mode, the sensor unit 40 detects the amount of the odor causing substance from the air blown from the first fan 36 using each of at least one built-in detection element. Thereby, the sensor unit 40 can output the detection value which shows the quantity of the cause substance of the odor contained in the air which passed each filter 34 of at least 1 detection element.

FIG. 6 is a diagram showing the flow of air in the second mode. In the second mode, the control unit 50 stops the first fan 36 and operates the second fan 38. Then, in such a second mode, the sensor unit 40 detects the amount of odor causing substance from the air blown from the second fan 38 using each of at least one built-in detection element. Thereby, the sensor unit 40 can output the detection value which shows the quantity of the cause substance of the odor contained in the air which has not passed through each filter 34 of at least 1 detection element.

FIG. 7 is a diagram showing a functional configuration of the information processing apparatus 20. As shown in FIG. The information processing apparatus 20 implements the functions shown in each block shown in FIG. 7 by executing a predetermined application program.

The information processing apparatus 20 that realizes such functions includes a first acquisition unit 72, a second acquisition unit 74, a difference calculation unit 76, a pattern storage unit 78, a determination unit 80, and an alarm output unit 82. A log storage unit 84, an estimation unit 86, and an information output unit 88 are included.

The first acquisition unit 72 acquires, from the sensor device 30, a signal representing a detection value indicating the amount of odor causing substance contained in the air that has passed through the filters 34 of at least one detection element. For example, the first acquisition unit 72 acquires a signal from the sensor device 30 every predetermined time. The second acquisition unit 74 acquires, from the sensor device 30, a signal representing a detection value indicating the amount of the odor causing substance contained in the air that has not passed through the filters 34 of at least one detection element. For example, the second acquisition unit 74 acquires a signal from the sensor device 30 in synchronization with the first acquisition unit 72 every predetermined time. The first acquisition unit 72 and the second acquisition unit 74 may be realized by common hardware or may be realized by separate hardware.

The difference calculation unit 76 has a first pattern representing the detection value of the at least one detection element acquired by the first acquisition unit 72 and a detection value of the at least one detection element acquired by the second acquisition unit 74. A difference pattern representing the difference between the two patterns is calculated. That is, the difference calculation unit 76 sets each of the first pattern representing the detection value indicating the amount of the odor causing substance contained in the air that has passed through the filter 34 of each of the at least one detection element, and the at least one detection element. A difference pattern representing a difference from the second pattern representing the detected value indicating the amount of the odor causing substance contained in the air not passing through the filter 34 is calculated.

For example, the difference calculating unit 76 subtracts the value representing the detection value of the corresponding detection element included in the first pattern from the value representing the detection value of each of the at least one detection element included in the second pattern. The difference pattern calculated in this manner is each detection value of at least one detection element excluding an error component such as a noise caused by the adsorption of a substance other than the detection element to the adsorption film and an offset of the sensor device 30. Represents

The pattern storage unit 78 stores one or more reference patterns in association with each of a plurality of types of odors. The reference pattern represents a detection value indicating the amount of odor causing substance contained in the air of the corresponding type of odor of each of the at least one detection element. For example, the pattern storage unit 78 stores a reference pattern representing each detection value of at least one detection element acquired by the sensor device 30 when each of an aging odor, a mold odor and a sweat odor is detected. Do. The pattern storage unit 78 may store patterns of other types of odors as well as such types of odors. Furthermore, the pattern storage unit 78 may store a reference pattern for each odor intensity for each type of odor.

The determination unit 80 performs matching between the difference pattern and one or more reference patterns stored in the pattern storage unit 78. Then, when the difference pattern matches any reference pattern, the determination unit 80 determines that the odor is any type. More specifically, the determination unit 80 selects one of the one or more reference patterns that matches the difference pattern or any reference pattern that falls within a predetermined range. Then, the determination unit 80 determines that the type of odor corresponds to the selected reference pattern.

The case where the patterns match means not only when the two patterns completely match, but also when they match with a predetermined error or less, or when the closest reference pattern is selected from a plurality of reference patterns, etc. Including.

Furthermore, the determination unit 80 determines the intensity of the odor for each type of odor. Thereby, the determination unit 80 can determine the type of odor and the intensity of the odor. Further, the determination unit 80 may determine the type of odor and the intensity of the odor by other methods as well as such pattern matching. For example, the determination unit 80 may determine the type of odor and the intensity of the odor matching the difference pattern using a neural network or the like.

The alarm output unit 82 compares the odor intensity determined by the determination unit 80 with a predetermined threshold each time the determination unit 80 determines the odor intensity. The alarm output unit 82 outputs an alarm when the odor intensity is greater than the threshold. As a result, the alarm output unit 82 can notify the user that the degree of contamination of the sheet 32 (for example, the seat, the backrest, or the headrest) that is the target object has become larger than a predetermined value.

For example, the alarm output unit 82 causes the display unit to display an image for notifying the user that the contamination degree of the sheet 32 has become larger than a predetermined value. The alarm output unit 82 may output by voice that the contamination degree of the sheet 32 has become larger than a predetermined value, or may transmit it to another device via a network.

Further, the alarm output unit 82 may output an alarm when the intensity of the particular type of odor selected in advance is larger than a threshold. For example, the alarm output unit 82 may output an alarm when the intensity of sweat odor is greater than a threshold, or may output an alarm when the intensity of aging odor exceeds a threshold. It is also good.

For example, the alarm output unit 82 may store different threshold values for each type of odor (for example, for each age-related odor, mold odor, or odor of sweat). In this case, the alarm output unit 82 determines, for each type of odor, whether the intensity of the odor has become greater than a threshold. Then, the alarm output unit 82 outputs an alarm when the intensity of the odor becomes larger than the threshold for any type of odor, and information indicating the type of the odor whose intensity becomes larger than the threshold Output

The log storage unit 84 stores the difference pattern calculated by the difference calculation unit 76 in association with the acquisition time of each detection value of at least one detection element that is the basis of the difference pattern. Furthermore, the log storage unit 84 also stores the difference pattern calculated in the past and the acquisition time in association with each other. The log storage unit 84 may store the first pattern and the second pattern instead of the difference pattern.

The estimation unit 86 estimates a differential pattern predicted to be calculated at an arbitrary time based on the differential pattern stored in the log storage unit 84 and the corresponding acquisition time. For example, the estimation unit 86 estimates a difference pattern at a first time based on at least one difference pattern before any first time. For example, for each of the plurality of difference detection values included in the difference pattern, the estimation unit 86 identifies a function representing time change of the difference detection value, and substitutes the first time into the identified function. Thereby, the estimation part 86 can estimate the difference pattern in 1st time.

Furthermore, the estimation unit 86 matches the difference pattern at the first time with the pattern stored in the pattern storage unit 78, and estimates the odor generated at the first time. For example, the estimation unit 86 estimates the type and intensity of the odor at the first time.

Then, when the odor generated at the first time is estimated by the estimation unit 86, the information output unit 88 outputs the estimation result of the odor generated at the first time. For example, the information output unit 88 causes the display unit to display the estimation result of the odor generated at the first time.

Furthermore, the estimation unit 86 may estimate the time when the predetermined type of odor occurs based on the plurality of difference patterns stored in the log storage unit 84 and the plurality of corresponding acquisition times. For example, the estimation unit 86 estimates a time when the predetermined type of odor has a predetermined intensity. In this case, for example, the estimation unit 86 identifies, for each of the plurality of difference detection values included in the difference pattern, a function representing time change of the difference detection value. Then, based on the function representing the time change of each of the plurality of difference detection values, the time at which the pattern of the plurality of difference detection values matches the pattern stored in the pattern storage unit 78 is calculated.

The information output unit 88 outputs information indicating the odor of air determined by the determination unit 80. For example, the information output unit 88 outputs the type of odor and the intensity of the odor. For example, the information output unit 88 outputs the type of odor and the intensity of the odor when the user performs an operation of instructing display. The information output unit 88 may output information indicating the type of odor and the intensity of the odor by voice or may transmit the information to another device via a network. In addition, the information output unit 88 determines the degree of contamination of the target sheet 32 (for example, a seat, a backrest, or a headrest) based on the type of odor and the intensity of the odor based on the odor source, and determines the contamination. You may display the degree.

Further, when the estimation unit 86 estimates the time at which a predetermined type of odor is generated, the information output unit 88 outputs the time at which a predetermined type of odor is generated. For example, the information output unit 88 causes the display unit to display the time when a predetermined type of odor occurs. In addition, the information output unit 88 may output information prompting replacement or cleaning of the seat 32 (seat, backrest, or headrest) that is the target object at a time when a predetermined type of odor is generated.

When the sensing system 10 includes a plurality of sensor devices 30, the information processing device 20 causes each of the plurality of sensor devices 30 to execute processing in each block. Further, the information processing device 20 causes the sensor device 30 to acquire the first pattern and the second pattern at predetermined time intervals, and causes the processing in each block to be executed based on the first pattern and the second pattern acquired at predetermined time intervals. May be

FIG. 8 is a flowchart showing an example of the flow of odor detection processing by the information processing apparatus 20. The information processing device 20 executes, for example, the processing from step S11 to step S20 of FIG. 8 for each of the plurality of sensor devices 30 and at predetermined time intervals.

First, in step S11, the information processing device 20 determines whether a predetermined time has come. For example, the information processing apparatus 20 determines whether the time when the vehicle 18 is not used, for example, a specific time in a day (a specific time such as midnight or early morning) has come. If the information processing apparatus 20 does not have the predetermined time (No in S11), the information processing apparatus 20 waits for the process in step S11 or ends the present flow.

If the predetermined time has come (Yes in S11), the information processing device 20 proceeds with the process to step S12. In step S12, the information processing device 20 determines whether a passenger is present in the vehicle 18. When there is a passenger in the vehicle 18 (Yes in S12), the information processing apparatus 20 waits for the process in step S12 or ends the present flow.

If a passenger is not present in the vehicle 18 (No in S12), the information processing device 20 proceeds with the process to step S13. In step S13, the information processing device 20 acquires, from the sensor device 30, a first pattern representing a detection value indicating the amount of odor causing material contained in the air that has passed through the filters 34 of at least one detection element. . Subsequently, in step S14, the information processing device 20 represents a detection value indicating the amount of the odor causing substance contained in the air not passing through the filter 34 of each of the at least one detection element from the sensor device 30. Get 2 patterns.

Subsequently, in step S15, the information processing device 20 calculates a difference pattern representing the difference between the first pattern and the second pattern. For example, the information processing apparatus 20 calculates a difference pattern by subtracting the detection value of the corresponding detection element included in the first pattern from the detection value of each of the at least one detection element included in the second pattern. .

Subsequently, in step S16, the information processing apparatus 20 detects the type of odor and the intensity of the odor by matching the difference pattern with the reference pattern.

Subsequently, in step S17, the information processing apparatus 20 determines whether the detected odor intensity is larger than a predetermined threshold. For example, the information processing apparatus 20 determines whether a predetermined type of odor (for example, odor of sweat or age-related odor) is larger than a threshold. If the detected odor intensity is equal to or less than the threshold (No in S17), the information processing device 20 advances the process to S19.

If the detected odor intensity is greater than the threshold (Yes in S17), the information processing device 20 proceeds with the process to step S18. In step S18, the information processing device 20 outputs an alarm. For example, the information processing apparatus 20 causes the display unit to display an image for notifying the user that the contamination degree of the sheet 32 has become larger than a predetermined value. The information processing apparatus 20 may output by voice that the contamination degree of the sheet 32 has become larger than a predetermined value, or may transmit it to another apparatus via a network. Thereby, the information processing apparatus 20 can notify the user that the degree of contamination of the sheet 32 (for example, the seat, the backrest, or the headrest) which is the target object has become larger than a predetermined value. When the information processing apparatus 20 completes the process of S18, the process proceeds to S19.

Subsequently, in step S19, the information processing apparatus 20 estimates a time at which a predetermined type of odor becomes a predetermined odor intensity, based on the plurality of difference patterns calculated in the past and the plurality of corresponding acquisition times.

Subsequently, in step S20, the information processing device 20 outputs information indicating the determined odor. For example, the information processing apparatus 20 displays, on the display unit, information indicating the type and the intensity of the determined odor. Furthermore, in step S20, the information processing apparatus 20 displays the time when the predetermined type of odor has a predetermined odor intensity. The information processing apparatus 20 may display information indicating the type and strength of the determined odor when the user performs an operation to instruct display.

After completing the process of step S20, the information processing apparatus 20 returns the process to step S11, and repeatedly executes the above process at predetermined intervals. The information processing apparatus 20 may end the present flow after step S20, start again after a predetermined time, and repeat the process from S11. Further, when the sensing system 10 includes a plurality of sensor devices 30, the information processing device 20 executes the above-described process for each of the plurality of sensor devices 30.

FIG. 9 is a view showing an example of the alarm image 90 displayed on the information processing apparatus 20. As shown in FIG. When outputting an alarm in S18, the information processing apparatus 20 may display an alarm image 90 as shown in FIG.

The information processing apparatus 20 may display the alarm image 90 by pop-up processing used to forcibly notify information, for example, in a state where a standby screen or the like is displayed. Thereby, the information processing apparatus 20 notifies the user that the degree of contamination of the seat 32 (for example, the seat portion, the backrest, or the headrest) is larger than a predetermined value without activating a specific application program. Can.

FIG. 10 is a view showing a display example of the information processing apparatus 20. As shown in FIG. The information processing apparatus 20 executes, for example, a specific application program after executing the processing from step S11 to step S20 on the sensor device 30 attached to the headrest of the seat 32, for example, as shown in FIG. Display an image.

The information processing apparatus 20 determines, for example, whether or not an age odor, a mold odor, and a sweat odor are generated. Furthermore, the information processing apparatus 20 also determines the intensity of each of the odor of age, mold and odor of sweat. Then, the information processing device 20 displays information indicating the intensity of each of the odor of age, mold and odor of sweat.

In addition, the information processing device 20 estimates a time when any of the aging odor, the mold odor and the odor of sweat becomes a predetermined strength. The information processing apparatus 20 displays the estimated time as information indicating the headrest cleaning time.

In addition, the information processing apparatus 20 may further display a button to be pressed when it is felt that any of an aging odor, a mold odor or a sweat odor is generated from the headrest. For example, the information processing apparatus 20 may have an aging odor button for pressing when it feels that aging odor is generated, a mold odor button for pressing when it is felt that mold odor is generated, and sweat You may display a sweat smell button to press when you feel the smell is occurring. When any one of these buttons is pressed, the information processing device 20 acquires the detection result of the odor from the sensor device 30 provided in the vicinity of the headrest. Then, the information processing apparatus 20 updates the reference pattern of the corresponding odor type by learning processing, using the difference pattern calculated based on the detection result as teacher data. For example, the information processing apparatus 20 updates the reference pattern of the aging odor when the aging odor button is pressed, and updates the reference pattern of the mold odor when the mold odor button is pressed, and the sweating When the odor button is pressed, the sweat odor reference pattern is updated. By performing such processing, the information processing apparatus 20 can detect an odor more accurately.

Furthermore, the information processing apparatus 20 further displays a button to be pressed when it is felt that the intensity of the predetermined type of odor generated from the headrest is the intensity of the odor emitted when the headrest cleaning time has been reached. It is also good. When the button is pressed, the information processing apparatus 20 acquires the detection result of the odor from the sensor device 30 provided in the vicinity of the headrest. Then, the information processing apparatus 20 updates the reference pattern representing the odor having a strength exceeding the threshold value by learning processing, using the difference pattern calculated based on the detection result as teacher data. By performing such processing, the information processing apparatus 20 can more accurately detect whether the intensity of the odor exceeds the threshold.

In addition, the information processing apparatus 20 may store a threshold for outputting an alarm for each type of odor (for example, for each age-related odor, mold odor or odor of sweat). In this case, the information processing apparatus 20 may display a button to be pressed when it is felt that the headrest cleaning time has come, for each type of odor. Then, when any one of these buttons is pressed, the information processing device 20, based on the result of detection of the smell from the sensor device 30, determines that the type of smell corresponding to the pressed button exceeds the threshold value. The reference pattern representing the odor is updated by the learning process.

FIG. 11 is a flowchart showing the flow of the process of detecting the smell of a passenger by the information processing apparatus 20. The information processing apparatus 20 may further execute the processing from step S21 to step S27 in FIG. 11 to determine the smell of the passenger.

First, in step S <b> 21, the information processing device 20 determines whether a passenger has got on the vehicle 18. For example, the information processing apparatus 20 determines the timing when the door is opened using the key, the timing when the vehicle 18 is activated using the key, or the timing when the steering wheel is gripped as the timing when the passenger gets on.

When a passenger is not on the vehicle 18 (No in S21), the information processing device 20 stands by for processing in step S21. When a passenger gets on the vehicle 18 (Yes in S21), the information processing device 20 proceeds with the process to step S22.

In step S22, the information processing device 20 identifies a passenger. For example, the information processing apparatus 20 performs face authentication or glow authentication based on an image captured by an on-vehicle camera or the like mounted on the vehicle 18, and authenticates whether the passenger is a pre-registered user. Good. Also, for example, the information processing apparatus 20 may perform fingerprint authentication based on an image captured by a fingerprint image sensor mounted on the vehicle 18, and may authenticate whether the passenger is a user registered in advance.

If the authentication is successful, the information processing device 20 proceeds with the process of step S23 and subsequent steps. Further, when the authentication fails, the information processing apparatus 20 may end the process at step S22, or may advance the processes after step S23 without specifying the passenger.

In step S23, the information processing device 20 acquires, from the sensor device 30, a first pattern representing a detection value indicating the amount of odor causing substance contained in the air that has passed through the filters 34 of at least one detection element. . Subsequently, in step S24, the information processing device 20 indicates a detection value indicating the amount of the odor causing substance contained in the air not passing through the filter 34 of each of the at least one detection element from the sensor device 30. Get 2 patterns.

Subsequently, in step S25, the information processing apparatus 20 calculates a difference pattern representing the difference between the first pattern and the second pattern. Note that the information processing device 20 represents the difference between the difference pattern of the timing when the rider gets on the vehicle 18 and the difference pattern before the rider gets on the vehicle 18 (when the rider is absent). A difference pattern may be calculated. As a result, the information processing apparatus 20 can more accurately detect the odor that is increased as a rider gets on the vehicle 18.

Subsequently, in step S26, the information processing device 20 detects an odor by matching the difference pattern (or the two-time difference pattern) with the reference pattern. For example, the information processing device 20 determines the type of odor and the intensity of the odor.

Subsequently, in step S27, the information processing apparatus 20 notifies the application program for health management of the information indicating the determined odor of air together with, for example, the user information on the identified passenger. And the application program for physical condition management matches the information which shows the acquired smell with user information, and memorize | stores it. Furthermore, the application program for health management may determine the physical condition or the health condition of the passenger based on the information indicating the acquired odor, and may display the determination result.

FIG. 12 is a view showing a part of the configuration of a sensor device 30 according to a modification. The sensor unit 40 may be configured as shown in FIG. 12 instead of the configuration shown in FIG. A sensor unit 40 according to the modification shown in FIG. 12 includes a first sensor 94 and a second sensor 96. Each of the first sensor 94 and the second sensor 96 has the same configuration as the sensor unit 40 shown in FIG.

In the modification, the first fan 36 takes in air from the outside, passes the taken air through the filter 34, and supplies it to the first sensor 94. The second fan 38 takes in air from the outside and supplies the taken-in air to the second sensor 96 without passing through the filter 34. That is, air that has passed through the filter 34 is supplied to the first sensor 94 but is not supplied to the second sensor 96. Further, air not passing through the filter 34 is supplied to the second sensor 96 but not supplied to the first sensor 94. For example, the sensor device 30 according to the modification has a wall 68 that separates the first fan 36 and the first sensor 94, and the second fan 38 and the second sensor 96.

The first sensor 94 detects the amount of the odor causing substance contained in the air blown from the first fan 36 using each of at least one detection element contained therein. Thereby, the first sensor 94 can output a detection value indicating the amount of odor causing substance contained in the air that has passed through the filter 34 of each of the at least one detection element.

The second sensor 96 detects the amount of the odor causing substance contained in the air blown from the second fan 38 using each of at least one detection element contained therein. Thereby, the second sensor 96 can output a detection value indicating the amount of the odor causing substance contained in the air not passing through the filter 34 of each of the at least one detection element.

(Effect of the embodiment)
The sensing system 10 according to the present embodiment has been described above. Such a sensing system 10 according to the present embodiment has, for example, the following effects.

The sensing system 10 according to the present embodiment can determine an odor (for example, the type and intensity of an odor) originating from the sheet 32 (for example, a seat, a backrest, or a headrest) that is a target object. Then, the sensing system 10 outputs an alarm when the intensity of the odor originating from the target object is larger than the threshold. As a result, the sensing system 10 can surely notify the user that the odor originating from the target object has become strong. Therefore, since the sensing system 10 according to the present embodiment can, for example, allow the user to clean the target object at an appropriate time, it is possible to avoid a situation where dirt is accumulated on the target object and removal becomes difficult. be able to.

Moreover, since the sensing system 10 according to the present embodiment can attach the sensor device 30 in proximity to the target object, the odor of the target object can be determined with certainty. In addition, since the sensing system 10 performs measurement at the timing when no passenger is present, it is possible to accurately determine the odor of the target object by eliminating the smell from the passenger.

In addition, since the sensing system 10 according to the present embodiment estimates a time when a predetermined smell is generated (for example, a time when a predetermined type of odor has a predetermined strength), the user can appropriately target It can clean the object. As a result, the sensing system 10 according to the present embodiment can reduce the burden of cleaning on the user, and can prevent a situation in which dirt is accumulated on the target object and removal thereof becomes difficult.

In addition, the sensing system 10 according to the present embodiment can determine the smell of the passenger by measuring the smell at the timing when the passenger enters the vehicle 18. In addition, since the sensing system 10 includes the sensor device 30 in a space that can be identified by the user such as the vehicle 18, it is possible to identify an individual and determine the smell of a passenger. Thereby, the sensing system 10 can use the detected smell for personal health management information and the like.

(Hardware configuration of the information processing apparatus 20)
FIG. 13 is a diagram showing a hardware configuration of the information processing apparatus 20. As shown in FIG. The information processing apparatus 20 is realized by, for example, the same hardware configuration as a general computer. The information processing apparatus 20 includes a central processing unit (CPU) 201, an operation device 202, a display device 203, a microphone 204, a read only memory (ROM) 205, a random access memory (RAM) 206, and a storage device 207. , A communication device 208, and a bus 209. Each unit is connected by a bus 209.

The CPU 201 executes various processes in cooperation with various programs stored in advance in the ROM 205 or the storage device 207 by using a predetermined area of the RAM 206 as a work area, and collectively controls the operations of the units constituting the information processing apparatus 20. . The CPU 201 operates the operation device 202, the display device 203, the microphone 204, the communication device 208, and the like in cooperation with a program stored in advance in the ROM 205 or the storage device 207.

The operation device 202 is an input device such as a touch panel, a mouse, and a keyboard, and receives information input from a user as an instruction signal, and outputs the instruction signal to the CPU 201.

The display device 203 is a display unit such as an LCD (Liquid Crystal Display). The display device 203 displays various information based on the display signal from the CPU 201. For example, the display device 203 displays the type of odor, the intensity of the odor, the estimated time, and the like.

The microphone 204 is a device that receives an audio signal. When recognizing an audio signal recorded in advance or an audio signal input from the communication device 208, the information processing device 20 may not include the microphone 204.

The ROM 205 stores a program used to control the information processing apparatus 20, various setting information, and the like in a non-rewritable manner. The RAM 206 is a volatile storage medium such as SDRAM (Synchronous Dynamic Random Access Memory). The RAM 206 functions as a work area of the CPU 201.

The storage device 207 is a rewritable storage device such as a storage medium made of a semiconductor such as a flash memory, or a storage medium that can be magnetically or optically recorded. The storage device 207 stores a program used to control the information processing device 20. The storage device 207 also functions as a pattern storage unit 78 and a log storage unit 84.

The communication device 208 exchanges data with the sensor device 30. The communication device 208 may transmit and receive data to and from a server or the like via a network.

The program executed by the information processing apparatus 20 according to the present embodiment is stored, for example, on a computer connected to a network such as the Internet, and is provided by being downloaded via the network. Further, the program executed by the information processing apparatus 20 of the present embodiment may be provided by being incorporated in a portable storage medium or the like in advance.

The program executed by the information processing apparatus 20 according to the present embodiment includes a first acquisition module, a second acquisition module, a difference calculation module, a determination module, an alarm output module, an estimation module, and an information output module. It has a module configuration that includes. The CPU 201 (processor) reads such a program from a storage medium or the like, and loads the respective modules into the RAM 206 (main storage device). Then, the CPU 201 (processor) executes such a program to obtain the first acquisition unit 72, the second acquisition unit 74, the difference calculation unit 76, the determination unit 80, the alarm output unit 82, the estimation unit 86, and the information output. It functions as the section 88. Note that even if part or all of the first acquisition unit 72, the second acquisition unit 74, the difference calculation unit 76, the determination unit 80, the alarm output unit 82, the estimation unit 86, and the information output unit 88 are configured by hardware. Good.

While the embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. The embodiment can make various changes.

Reference Signs List 10 sensing system 18 vehicle 20 information processing device 30 sensor device 32 seat 36 filter 36 first fan 38 second fan 40 sensor unit 48 communication unit 50 control unit 52 battery 58 support unit 60 gas detection element 62 drive detection circuit 68 wall 72 second 1 Acquisition Unit 74 Second Acquisition Unit 76 Difference Calculation Unit 78 Pattern Storage Unit 80 Determination Unit 82 Alarm Output Unit 84 Log Storage Unit 86 Estimation Unit 88 Information Output Unit 90 Alarm Image 94 First Sensor 96 Second Sensor

Claims (12)

A sensor device comprising at least one detection element for detecting the amount of odor causing material contained in the air in the vicinity of the target object;
A determination unit that determines the intensity of the odor of the air near the target object based on the pattern representing the detection value of each of the at least one detection element; and the intensity of the odor of the air near the target object in advance An information processing apparatus having an alarm output unit that outputs an alarm when the threshold value is larger than a predetermined threshold value;
Sensing system equipped with The sensor device detects the amount of odor causing substance every predetermined time,
The sensing system according to claim 1, wherein the determination unit determines the intensity of the odor of air in the vicinity of the target object each time the sensor device detects the amount of the odor causing substance. The sensor device has a filter that removes odor causing substances contained in the air near the target object, and a sensor unit that includes the at least one detection element.
The information processing apparatus passes through the filter of each of the at least one detection element, and a detection value indicating the amount of odor causing material contained in the air that has passed through the filter of each of the at least one detection element. The system further includes a difference calculation unit that calculates a difference between the detected value that indicates the amount of odor-causing substance contained in air,
The sensing system according to claim 1, wherein the determination unit determines the odor of air based on the calculated difference. The sensor device is
A first fan passing through the filter and supplying the sensor unit;
A second fan that supplies the sensor unit without passing through the filter;
The sensing system according to claim 3, further comprising: The sensor device further includes a control unit that switches between a first mode in which the first fan is operated to stop the second fan and a second mode in which the first fan is stopped to operate the second fan. Have
The difference calculation unit calculates a difference between a detection value of each of the at least one detection element in the first mode and a detection value of each of the at least one detection element in the second mode. Sensing system described. The information processing apparatus further includes a pattern storage unit that associates and stores one or more reference patterns for each of a plurality of types of odors,
The reference pattern represents a detection value indicating the amount of odor causing material contained in the air of the corresponding odor of each of the at least one detection element,
The determination unit is configured to pass through the filter of each of the at least one detection element, and a detection value indicating the amount of odor causing material contained in the air that has passed through the filter of each of the at least one detection element. The sensing system according to claim 3, wherein the type of the odor of air is determined by matching the difference pattern representing the difference between the detected value indicating the amount of the odor causing substance contained in the air and the reference pattern. The information processing apparatus estimates the difference pattern at a first time after the acquisition time, based on the difference pattern and an acquisition time of detection values of the at least one detection element that is a basis of the difference pattern. The sensing system according to claim 6, further comprising an estimation unit that determines an odor of air at the first time. A vehicle having a seat on which a passenger sits and a sensor device provided in proximity to the seat and including at least one detection element that detects an amount of an odor causing substance contained in air near the seat;
A determination unit that determines the intensity of the odor of the air near the sheet based on the pattern representing the detection value of each of the at least one odor detection element; and the intensity of the odor of the air near the sheet is predetermined An information processing apparatus having an alarm output unit that outputs an alarm when the threshold value is larger than the threshold value;
Sensing system equipped with 9. The sensing system according to claim 8, wherein the sensor device detects an amount of an odor causing substance contained in air in the vicinity of the seat when a passenger is not present in a car. In the information processing apparatus,
Acquiring, from a sensor device including at least one detection element, an amount of an odor causing substance contained in air in the vicinity of the target object;
A determination step of determining the intensity of the odor of air in the vicinity of the target object based on a pattern representing a detection value of each of the at least one detection element;
An alarm output step of outputting an alarm when the intensity of the odor of air in the vicinity of the target object is larger than a predetermined threshold value;
A program to run a program. An acquisition unit configured to acquire an amount of an odor causing substance contained in air in the vicinity of the target object from a sensor device including at least one detection element;
A determination unit that determines the intensity of the odor of air in the vicinity of the target object based on a pattern representing the detection value of each of the at least one detection element;
An alarm output unit that outputs an alarm when the odor intensity of air in the vicinity of the target object is larger than a predetermined threshold value;
An information processing apparatus comprising: Obtaining from the sensor device including at least one detection element the amount of odor causing substance contained in the air in the vicinity of the target object;
Determining an odor intensity of air in the vicinity of the target object based on a pattern representing a detection value of each of the at least one detection element;
An information processing method comprising: outputting an alarm when the intensity of the odor of air in the vicinity of the target object is larger than a predetermined threshold.

Images