TWI742497B - System and method for environmental monitoring - Google Patents

Abstract

The present invention discloses a system for environment monitoring. The system includes at least one thermal imaging module, an image processing module, an image analysis module and an environmental analysis module. The thermal imaging module acquires a thermal image of a monitoring environment every interval time. The image processing module receives the thermal images, and obtains a pixel matrix corresponding to each of the thermal images respectively, and the pixel matrix includes a plurality of pixel areas and a temperature coefficient corresponding to each of the pixel areas. The image analysis module selects at least two temperature fields in each pixel matrix according to the temperature coefficient of each pixel area, and the temperature fields include a biological temperature field. The environmental analysis module overlaps the pixel matrix acquired at different time, the biological temperature field is compared to acquire an active area, and the other area is defined as an obstacle area.

Description

Environmental monitoring system and method

The present invention relates to an environmental monitoring system and method.

As the public pays more and more attention to the quality and safety of the living environment, as well as the efficiency of communication systems and devices, various types of remote monitoring systems are used in different environments or situations. A common application scenario is to install the image capture device in an outdoor or part of the indoor environment, and connect it to the electronic device of the user (or related industry) through the network communication system, so that the user can remotely use real-time images , To check the status of the monitoring environment at any time. The environmental monitoring system can also be further applied to the safety protection system, such as the communication connection with the alarm elimination or ambulance system, when it is judged that there is an emergency situation, the alarm elimination or ambulance system can be notified. Moreover, as countries gradually enter an aging society, environmental monitoring systems are further applied to the home environment. For example, users can watch real-time images of family members or pets remotely, thereby achieving the function of home care. However, being able to watch live images at the remote end also means that the privacy of the viewer (person in the surveillance environment) may be violated. What's more serious is that if there is an outflow of image information, the furnishings of the home environment may be passed into the hands of unscrupulous people, which will seriously affect the safety of the home environment.

Therefore, most users are still unwilling to use real-time image environmental monitoring systems, and there are environmental monitoring systems for some functions. For example, monitoring a specific location through a thermal image sensor module can be used to monitor the patient's body temperature, thereby achieving the function of remote home care. Or, set up a thermal image sensor module and a smoke sensor at the same time, and apply it to monitor the temperature and smoke of the environment to achieve the effect of fire warning. However, once there is an emergency, the alarm or rescue system cannot judge the distribution of the home environment (such as the furnishings) from the monitored ambient temperature distribution, and thus cannot evaluate the rescue route.

Therefore, how to provide an environmental monitoring system and method that can simultaneously solve the appropriate privacy that the conventional real-time imaging technology cannot provide, and the conventional thermal image sensing technology cannot provide specific rescue routes, and become engaged in the safety management of home life The problem that the industry needs to solve urgently.

In view of the above-mentioned problems, the main purpose of the present invention is to provide an environmental monitoring system and method, by comparing the active area of the biological temperature field, and obtaining the obstacle area, so as to solve the problem that the conventional environmental monitoring system cannot take into account privacy and provide at the same time. The issue of ambulance route information.

To achieve the above objective, the present invention provides an environment monitoring system, which includes at least one thermal image sensing module, an image processing module, an image analysis module, and an environment analysis module. The thermal image sensing module captures a thermal image of a monitored environment at intervals of a preset time to generate a plurality of the thermal images at different time points. The image processing module is coupled to the thermal image sensing module and receives the thermal image. The image processing module respectively obtains a pixel matrix corresponding to the thermal image, which includes a plurality of pixel regions and a corresponding temperature coefficient. The image analysis module is coupled with the image processing module, and each pixel matrix is circled to select at least two temperature fields according to the temperature coefficient of each pixel area, and it includes a biological temperature field. The environment analysis module is coupled with the image analysis module, and the environment analysis module includes a field analysis unit. After superimposing the pixel matrices at different time points, the field analysis unit compares the biological temperature field and obtains an active area, and defines other areas as an obstacle area.

In order to achieve the above objective, the present invention also provides an environmental monitoring method applied to an environmental monitoring system. The environment monitoring system includes at least one thermal image sensing module, an image processing module, an image analysis module, and an environment analysis module. The environmental monitoring method includes the following steps: the thermal image sensing module captures a thermal image of a monitored environment at intervals of a preset time to generate a plurality of the thermal images at different time points; the image processing module receives the thermal images, and Obtain a pixel matrix corresponding to the thermal image, which includes a plurality of pixel regions and a corresponding temperature coefficient; the image analysis module selects at least two temperature fields in each pixel matrix according to the temperature coefficient of each pixel region Domain, and it includes a biological temperature field; and the environmental analysis module superimposes the pixel matrix at different time points, compares the biological temperature field and obtains an active area, and defines other areas as obstacle areas

According to an embodiment of the present invention, the environment analysis module overlaps the pixel matrix for at least 10 days to obtain the active area by comparison.

According to an embodiment of the present invention, the image analysis module circles the pixel regions with a temperature coefficient of 15 to 40 as an indoor field, and circles the pixel regions with a temperature coefficient of 35 to 40 as Biological temperature field.

According to an embodiment of the present invention, the image analysis module circles the pixel regions with a temperature coefficient of 41 to 100 as a heated field.

According to an embodiment of the present invention, the environment analysis module further includes a warning unit coupled to the field analysis unit. When the pixel matrix has a heated field and exceeds a preset heating range or a preset temperature rise rate, a warning notification is issued.

According to an embodiment of the present invention, the environmental monitoring method further includes the following steps: when the pixel matrix has a heated field and exceeds a predetermined heating range or a predetermined temperature rise rate, the environmental analysis module issues a warning notification.

According to an embodiment of the present invention, after the field analysis unit of the environmental analysis module superimposes the pixel matrices at different time points, it extracts a moving trajectory with a moving speed greater than a preset value in the biological temperature field, and evaluates It is a smooth path.

As mentioned above, according to the environmental monitoring system and method of the present invention, the thermal image at different time points is obtained by the thermal image sensing module, and the image analysis module can be circled based on the temperature coefficient calculated by the image processing module For the biological temperature field, the environmental analysis module superimposes the pixel matrix at different time points to compare the biological temperature field and obtain the active area, and define other areas as obstacle areas. Once there is an emergency, the obstacle area can be used as a factor for the judgment of the rescue route. In other words, the effect of maintaining privacy can be achieved through the monitoring of thermal images, and the effect of evaluating the rescue route can be achieved by judging the obstacle area at the same time.

In order to allow your reviewer to better understand the technical content of the present invention, preferred specific embodiments are described as follows.

FIG. 1 is a schematic block diagram of an embodiment of the environmental monitoring system of the present invention, and FIG. 2 is a schematic diagram of the setting environment of the thermal image sensing module shown in FIG. 1, please refer to FIG. 1 and FIG. 2. The environmental monitoring system 1 of this embodiment can be applied to the monitoring of the home environment. The environment monitoring system 1 includes at least one thermal image sensing module 11, an image processing module 12, an image analysis module 13 and an environment analysis module 14. Among them, the thermal image sensing module 11 can be installed in an environment to be monitored in real time, for example, in each room of a home, one thermal image sensing module 11 can be installed respectively. More than two thermal image sensing modules 11 can also be installed in an area (room) with a larger space. The present invention does not limit the number of thermal image sensing modules 11. The image processing module 12 is coupled to the thermal image sensing module 11 to thereby receive real-time thermal images from the thermal image sensing module 11. Preferably, a thermal image sensor module 11 can correspond to a space with an area of 4 m ² to 6 m ² , and the installation height can preferably be 2.5 m to 3 m. It can also be based on the thermal image sensor module 11 The performance is adjusted.

In addition, the image processing module 12, the image analysis module 13, and the environment analysis module 14 can be coupled to each other for data transmission. In this embodiment, the environmental monitoring system 1 can be divided into a local device A and a remote device B. Among them, the local device A is a module set in a home environment, which includes a thermal image sensing module 11, an image processing module 12, and an image analysis module 13; the remote device B can be a cloud server, which includes environmental analysis Module 14. The image processing module 12 and the image analysis module 13 are coupled to each other, and the image analysis module 13 (local device A) further includes a transmission unit 131 and is communicatively connected with the environment analysis module 14 provided on the remote device B. For data transfer. The way of data transmission is different depending on the hardware architectures that cooperate with each other. Specifically, it can be implemented through wired or wireless data transmission technologies such as Ethernet, 3G, Wi-Fi, or 4G LTE. The following describes the environmental monitoring system 1 of this embodiment with a preferred structure.

It should be noted that the aforementioned modules can be configured as hardware devices, software programs, firmware, or a combination thereof, and can also be configured by circuit loops or other appropriate types. The connection between each module is wired or wireless. They are connected to each other for data reception and transmission; besides, each module can be configured separately or in combination. A preferred embodiment is that each module is a software program stored in the storage module (not shown in the figure, it can be set in the local device A and/or the remote device B, the present invention is not limited), by the environmental monitoring system A processor (not shown) in 1 executes each module to achieve the functions of the invention. In addition, this embodiment only exemplifies a preferred embodiment of the present invention, and in order to avoid redundant description, all possible variations and combinations are not described in detail. However, those skilled in the art should understand that not all the above-mentioned modules or components are necessary. In order to implement the present invention, other more detailed conventional modules or components may also be included. Each module or component may be omitted or modified as required, and there may not be other modules or components between any two modules.

The storage module of the environmental monitoring system 1 can be, for example, but not limited to, storage media such as flash memory, optical disk, or magnetic disk, and can be divided into a plurality of storage units to store different data. For example, the storage module can store an environmental monitoring method, which is applied to the environmental monitoring system 1, that is, the method can be executed by each module of the environmental monitoring system 1. Fig. 3 is a schematic flow chart of an embodiment of the environmental monitoring method of the present invention. Please refer to Figs. 1 to 2 first. The following describes the actions of each module according to the steps of the environmental monitoring method.

Step S10: The thermal image sensing module 11 captures a thermal image of a monitored environment every predetermined time interval.

In this embodiment, the thermal image sensing module 11 can be an infrared thermal imager, and can capture a thermal image of the space (herein referred to as the monitoring environment) where it is located at a predetermined time interval. After a period of time, the thermal image sensing module 11 can generate a plurality of thermal images of the monitoring environment at different time points.

Step S20: The image processing module 12 receives the thermal image, and obtains a pixel matrix 20 corresponding to the thermal image.

As mentioned above, the image processing module 12 is coupled to the thermal image sensing module 11 to receive thermal images at different time points. Among them, the thermal image carries (stores) temperature information in the form of a pixel matrix (see FIG. 2), that is, the thermal image can be divided into a plurality of pixel regions 21, which respectively have temperature information measured by the pixel regions 21. In other words, the image processing module 12 can respectively obtain a pixel matrix 20 corresponding to each thermal image (as shown in FIG. 2 ). Each pixel matrix 20 includes a plurality of pixel regions 21 and a corresponding temperature coefficient. In addition, the temperature coefficient is the estimated temperature of the pixel area. As shown in FIG. 2, a creature (human) is located at the position corresponding to the pixel area 21a. If the measured temperature of the pixel area 21a is 36°C (human body temperature), the temperature coefficient corresponding to the pixel area 21a is 36. In addition, if there is no living thing in the pixel area 21b, if the measured temperature of the pixel area 21b is 25°C (room temperature), the temperature coefficient corresponding to the pixel area 21b is 25.

Preferably, the image processing module 12 (containing a set of temperature and humidity meters) can also use the indoor temperature measured by a general thermometer as a reference point (environmental reference) to fine-tune the temperature measured by the thermal image sensor module 11. The temperature coefficient corresponding to each pixel area 21. In addition, the image processing module 12 can also use interpolation to enlarge the resolution of the pixels. That is, the intermediate interpolated temperature of two adjacent pixel regions 21 is calculated in a linear ratio, thereby expanding the temperature matrix (pixel matrix 20). Taking a magnification of 4 times as an example, if the temperature coefficients of two adjacent pixel areas 21 are a and b, respectively, the temperature coefficients of the three pixel areas added between two adjacent pixel areas 21 are (3a+b)/ 4. (2a+2b)/4, (a+3b)/4. The pixel resolution is enlarged by interpolation so that the moving area and movement path of the creature (user) can be more accurately evaluated later.

Step S30: The image analysis module 13 selects at least two temperature fields T in each pixel matrix 20 according to the temperature coefficient of each pixel area 21 (21a), and they include a biological temperature field T1.

FIG. 4 is a schematic diagram of the temperature field circled by the pixel matrix shown in FIG. 2, please refer to FIG. 1 to FIG. 4. The image analysis module 13 of this embodiment is coupled to the image processing module 12 to receive the pixel matrix 20 processed by the image processing module 12. The image analysis module 13 selects at least two temperature fields T from each pixel matrix 20 according to the temperature coefficient of each pixel area 21, and includes a biological temperature field T1 to facilitate subsequent image (or environmental) analysis. For example, the image analysis module 13 may circle the pixel area 21 (21b) with a temperature coefficient of 15 to 40 as an indoor field T2 (as shown in the overall range of FIG. 4), and set the temperature coefficient of 35 to The pixel area 21 (21a) of 40 is circled as the biological temperature field T1. Generally speaking, the indoor temperature is usually between 15°C and 40°C, so the pixel area 21 with a temperature coefficient between 15 and 40 can be defined as the indoor field T2. It should be noted that the temperature coefficient range can be adjusted to other ranges according to the different regions where the environmental monitoring system 1 is installed, and the present invention is not limited. In addition, the normal temperature of the human body is usually between 35°C and 40°C, so the pixel area 21 with a temperature coefficient of between 35 and 40 is defined as the biological temperature field T1, which means that there are organisms (which can be human or human Animals) exist.

Preferably, the image analysis module 13 can further circle the pixel area 21 with a temperature coefficient of 41 to 100 as a heated field (not shown). Specifically, if the temperature exceeds 40°C, it is not a normal indoor temperature and may be an emergency situation. Therefore, the heated field can be additionally circled to facilitate subsequent analysis by the environmental analysis module 14. Preferably, the image analysis module 13 can further subdivide the heated field into different levels. For example, the pixel area 21 with a temperature coefficient ranging from 41 to 60 can be defined as a level one heated field; the pixel area 21 with a temperature coefficient ranging from 61 to 80 can be defined as a level two heated field; with a temperature coefficient ranging from 81 to The pixel area 21 of 100 can be defined as a level three heated field. Among them, the situation in the heat-receiving area of Grade 3 is the most critical. It should be noted that the range of different temperature fields T can also be adjusted according to the region or environment to which the environmental monitoring system 1 is applied, and the monitoring environment (such as kitchen, or bedroom, etc.) can also be adjusted. The above data range is only an example. .

Step S40: After stacking the pixel matrix 20 at different time points, the environment analysis module 14 compares the biological temperature field T1 to obtain an active area 22, and defines other areas as an obstacle area 23.

FIG. 5 is a schematic diagram of superimposing a plurality of pixel matrices of the circled temperature field shown in FIG. 4, please refer to FIG. 1 to FIG. 5. In this embodiment, the image analysis module 13 can communicate with the environment analysis module 14 through the transmission unit 131, so that the environment analysis module 14 can receive the information processed by the image analysis module 13 with the temperature field T information. Pixel matrix 20. The environmental analysis module 14 of this embodiment includes a field analysis unit 141 for analyzing the information covered by the temperature field T circled in step S30. Specifically, the field analysis unit 141 may superimpose a plurality of pixel matrices 20 at different time points, and compare the movement of the biological temperature field T1. FIG. 5 is drawn with the movement of living beings (human beings) as an example. Obtain an activity area 22, and define other areas (that is, exclude the activity area 22) as an obstacle area 23.

In detail, the pixel area 21 once circled as the biological temperature field T1 can be considered as an area where living things (humans or animals) can move, so it is defined as the active area 22. Conversely, the pixel area 21 (or the area outside the active area 22) that has never been circled as the biological temperature field T1 may be an area with large furniture or obstacles such as close to the wall, so it is defined as an obstacle The object area 23 is shown in FIG. 6. Fig. 6 is a schematic diagram of the installation items in the obstacle area shown in Fig. 5. The field analysis unit 141 of this embodiment can evaluate the obstacle area 23, and once there is an emergency, it can transmit the information of the obstacle area 23 to the emergency rescue or rescue system at the same time as a factor for judging the rescue route.

Preferably, the field analysis unit 141 superimposes a plurality of pixel matrices 20 at different time points, and compares the movement trajectory of the biological temperature field T1 (with a temperature coefficient of 35 to 40), and finds that the movement speed is between 0.4 km The moving area between feet/second and 1.2 meters/second or the area where the stay time is greater than 2 seconds is defined as the active area 22. Specifically, for a person with a height greater than 110 cm, the distance between two steps is about 120 cm (1.2 meters), and it can be completed in about 3 seconds. In addition, when an average person moves purposefully, he can take two steps in about 1 to 3 seconds. Therefore, the aforementioned moving speed for judgment is calculated based on moving 1.2 meters within 1 second to 3 seconds. More preferably, the field analysis unit 141 can extract a moving trajectory whose moving speed of the biological temperature field T1 is greater than a preset value (for example, 0.4 m/s), and evaluate it as a clear path. That is, a route that can be passed smoothly without obstacles can also be sent to the alarm cancellation or rescue system to be used as a factor for the judgment of the rescue route. It should be noted that the aforementioned moving speed used for judgment and the preset value are preferred embodiments, and the protection scope of the present invention is still subject to the content recorded in the scope of the patent application.

Step S50: When the pixel matrix 20 has a heated field and exceeds a preset heating range or a preset temperature rising speed, the environmental analysis module 14 issues a warning notification.

Preferably, the environmental analysis module 14 of this embodiment further includes a warning unit 142 coupled to the field analysis unit 141. In addition, the warning unit 142 can be a wired or wireless transmission unit, and can be in communication connection with an alarm or rescue system, and can also be in communication connection with a user's electronic device (such as a smart phone, a notebook computer, etc.).

When the pixel matrix 20 has a heated field, the field analysis unit 141 superimposes the pixel matrix 20 at different time points, and analyzes that the heated field exceeds a preset heating range (for example, the area where the kitchen utensils are placed can be defined as a preset If the heating range is exceeded) or exceeds a preset temperature rise rate (for example, the temperature rises by more than 5°C within 10 seconds), the field analysis unit 141 evaluates the critical state and can send a signal to the warning unit 142. The warning unit 142 then issues a warning notification and transmits it to the alarm cancellation or rescue system, or the user's personal electronic device. Preferably, the obstacle area 23 or the unobstructed path information obtained in step S40 can also be sent to the alarm cancellation or rescue system along with the warning notification.

The above description is based on fire early warning as an example, the environmental monitoring system 1 can also be applied to home care. For example, the field analysis unit 141 analyzes that the biological temperature field T1 stays in a fixed place for more than 10 minutes, and the temperature coefficient exceeds 40 or is lower than 30, indicating that there may be fever or loss of temperature, and the warning unit 142 can also be controlled to issue a warning Notify the user’s personal electronic device, alarm, or ambulance system.

In summary, according to the environmental monitoring system and method of the present invention, the thermal image at different time points is obtained by the thermal image sensing module, and the image analysis module can circle and select according to the temperature coefficient calculated by the image processing module For the biological temperature field, the environmental analysis module superimposes the pixel matrix at different time points to compare the biological temperature field and obtain the active area, and define other areas as obstacle areas. Once there is an emergency, the obstacle area can be used as a factor for the judgment of the rescue route. In other words, the effect of maintaining privacy can be achieved through the monitoring of thermal images, and the effect of evaluating the rescue route can be achieved by judging the obstacle area at the same time.

It should be noted that many of the above-mentioned embodiments are given as examples for the convenience of description, and the scope of rights claimed in the present invention should be subject to the scope of the patent application, rather than being limited to the above-mentioned embodiments.

1: Environmental monitoring system 11: Thermal image sensor module 12: Image processing module 13: Image analysis module 131: Transmission Unit 14: Environmental Analysis Module 141: Field Analysis Unit 142: warning unit 20: pixel matrix 21, 21a, 21b: pixel area 22: Activity area 23: Obstacle area A: Local device B: remote device T: temperature field T1: Biological temperature field T2: indoor field

Fig. 1 is a block diagram of an embodiment of the environmental monitoring system of the present invention. Fig. 2 is a schematic diagram of a use environment of an embodiment of the environmental monitoring system shown in Fig. 1. FIG. 3 is a schematic flowchart of an embodiment of the environmental monitoring method of the present invention. FIG. 4 is a schematic diagram of the temperature field circled by the pixel matrix shown in FIG. 2. FIG. 5 is a schematic diagram of superimposing a plurality of pixel matrices of the circled and circled temperature field shown in FIG. 4. Fig. 6 is a schematic diagram of the installation items in the obstacle area shown in Fig. 5.

1: Environmental monitoring system

11: Thermal image sensor module

12: Image processing module

13: Image analysis module

131: Transmission Unit

14: Environmental Analysis Module

141: Field Analysis Unit

142: warning unit

A: Local device

B: remote device

Claims (8)

An environment monitoring system, which is communicatively connected with an alarm cancellation system or an ambulance system, includes: at least one thermal image sensing module, which captures a thermal image of a monitored environment at intervals of a preset time, so as to be generated at different time points An image processing module, coupled to the thermal image sensing module, receives the thermal images, and obtains a pixel matrix corresponding to the thermal images, which includes a plurality of pixel areas and Respectively corresponding to a temperature coefficient; an image analysis module, coupled to the image processing module, according to the temperature coefficient of each pixel area, circle at least two temperature fields in each pixel matrix, and It includes a biological temperature field, the image analysis module circles the pixel areas with a temperature coefficient of 41 to 100 as a heated field; and an environmental analysis module coupled to the image analysis module, The environment analysis module includes: a field analysis unit, which after superimposing the pixel matrices at different time points, compares the biological temperature field to obtain an active area, and defines other areas as an obstacle area; and The warning unit is coupled to the field analysis unit. When the pixel matrix exists in the heated field and exceeds a preset heating range or a preset temperature rise rate, the warning unit sends out a warning notification and transmits the obstacle Information of the area to the alarm cancellation system or the ambulance system. The environmental monitoring system described in item 1 of the scope of patent application, wherein the environmental analysis module is superimposed on the pixel matrices for at least 10 days to obtain the active area by comparison. For the environmental monitoring system described in item 1 of the scope of patent application, wherein the image analysis module circles the pixel regions with the temperature coefficient between 15 and 40 as an indoor field, and the temperature coefficient is between 35 The pixel regions up to 40 are circled as the biological temperature field. For example, in the environmental monitoring system described in item 1 of the scope of patent application, the field analysis unit extracts a moving speed of the biological temperature field greater than a preset value after superimposing the pixel matrices at different time points Trajectory, and evaluated as a clear path. An environmental monitoring method applied to an environmental monitoring system, which is in communication connection with an alarm cancellation system or an ambulance system. The environmental monitoring system includes at least one thermal image sensing module, an image processing module, and an image analysis module And an environmental analysis module, the environmental monitoring method includes the following steps: the thermal image sensing module captures a thermal image of a monitored environment at a predetermined time interval to generate a plurality of the thermal images at different time points; The image processing module receives the thermal images, and obtains a pixel matrix corresponding to the thermal images, which includes a plurality of pixel regions and a temperature coefficient corresponding to each; The image analysis module encircles at least two temperature fields in each pixel matrix according to the temperature coefficient of each pixel area, and it includes a biological temperature field, and sets the temperature coefficient between 41 to 100 The pixel areas are circled as a heated field; the environmental analysis module superimposes the pixel matrices at different time points, compares the biological temperature field and obtains an active area, and defines other areas as an obstacle Area; and when the pixel matrix exists in the heated field and exceeds a preset heating range or a preset temperature rise rate, the environmental analysis module sends out a warning notification and sends information about the obstacle area to the alarm System or the ambulance system. According to the environmental monitoring method described in item 5 of the scope of patent application, the environmental analysis module overlaps the pixel matrices for at least 10 days to obtain the active area by comparison. According to the environmental monitoring method described in item 5 of the scope of patent application, the step of circle selecting at least two temperature fields includes: the image analysis module circle selects the pixel areas with a temperature coefficient of 15-40 as one An indoor field, and the pixel regions with a temperature coefficient of 35-40 are circled as the biological temperature field. For example, the environmental monitoring system described in item 5 of the scope of patent application, wherein after the environmental analysis module is superimposed on the pixel matrices at different time points, a movement of the biological temperature field with a moving speed greater than a preset value is extracted Trajectory, and evaluated as a clear path.

Images