JPH08124078A - Method and apparatus for displaying sensor information - Google Patents

Abstract

(57) [Abstract] [Purpose] To provide a sensor information display device capable of easily knowing sensor information while watching a monitor TV that displays a monitoring image sent from an imaging device [Configuration] The images obtained by capturing with the video cameras 11 and 12 are displayed on the monitor TV 40 via the video image capturing unit 20 and the image processing unit 30. Various sensors 42a to 42d are arranged at the site, and the detection result is sent to the programmable controller 41, where necessary sensor information is determined. The determined sensor information is
The image is superimposed and displayed on the monitor TV via the image processing unit. The display position of the sensor information is set to a position corresponding to the detection target part of the sensor in the image of the scene captured by the video camera. As a result, it is possible to easily know which part of the site the displayed sensor information is based on.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a sensor information display method and device, and is suitable for a monitoring system for monitoring a predetermined area at a remote location.

[0002]

2. Description of the Related Art When a predetermined indoor / outdoor area is to be monitored at a remote place away from it, for example, a video camera is used to image the monitored area and the obtained image data is moved away from the monitored area. Display on a monitor TV installed in a place (central monitoring room, etc.). Then, the observer determines whether or not there is an abnormality while looking at the screen (actual image) displayed on the monitor TV.

Further, in the case of performing more strict monitoring, in addition to monitoring by the video camera, predetermined sensors (temperature sensor, proximity sensor (window / door open / closed detection), infrared sensor (intrusion) are provided at various places in the monitoring area. (Detection of the presence or absence of a person) is installed, and the sensor output is output to a display device installed at a predetermined position such as the central monitoring room. As a mode of this display device, for example, a display lamp is installed, and when an abnormality occurs, the display lamp blinks in red or the like, or a CRT of a computer (a monitor TV connected to the video monitor is different from the above. The output of each sensor is displayed as numerical data.

[0004]

However, in the above-mentioned conventional display device, the monitor displays the output of many sensors in addition to the monitor TV (lamp, CRT).
Etc.), and the monitoring process is complicated. Further, since the display means for sensor output and the monitor TV are separately installed, when an abnormality is detected in the sensor output, if an attempt is made to check the abnormal portion on the monitor TV, the abnormality will occur at any place. It is difficult to instantly understand what happened, and subsequent rapid processing cannot be performed.

The present invention has been made in view of the above background. An object of the present invention is to solve the above problems and to display a monitor image or the like sent from an image pickup apparatus (monitor TV). The sensor information can be easily seen while looking at the screen of the above, and the location where the sensor detects an abnormality can be easily and accurately found on the display device in a short time, and the sensor information can be displayed easily for subsequent processing. A method and apparatus are provided.

[0006]

In order to achieve the above-mentioned object, in the sensor information display method according to the present invention, an image based on an actual photograph sent from the image pickup device is displayed on the display device, and the image pickup device displays the image. The sensor information corresponding to the sensor output sent from the sensor installed in the imaged area is superimposed and displayed on a predetermined position on the image.

Preferably, the predetermined position for displaying the sensor information is a position corresponding to a detection target portion of the sensor in the image based on the actual image. Also,
The sensor information may be, for example, at least one of a character or a figure corresponding to the detection result of the sensor, or a predetermined value in a window set on the display screen of the display device according to the detection result of the sensor. It is possible to use the one with the color of. Further, it is more preferable that a function as an icon is provided in the window and a predetermined function registered in the window is activated by instructing the window.

In the sensor information display device according to the present invention suitable for carrying out the above method, an image pickup device for picking up an image of a predetermined area, a sensor for detecting a predetermined situation of the predetermined area, and the image pickup device are provided. The display device outputs the sent image data, and the processing means for displaying predetermined sensor information at a predetermined position on the display device in a superimposed state with the image data based on the sensor output sent from the sensor.

The processing means includes a predetermined controller to which the sensor is connected and an image processing means for generating and outputting an image to be output to the display device based on a control signal from the controller. . At that time, the controller has a function of receiving the detection result from the sensor, determining predetermined sensor information to be displayed on the display device, and outputting data necessary for outputting the sensor information to the image processing means. The image processing means has a function of superimposing predetermined sensor information on an image based on an actual image sent from the image pickup device based on the given data and outputting the superimposed image to the display device.

Further, the image pickup device has a plurality of image pickup devices having different image pickup areas and / or magnifications, and an image from a predetermined image pickup device can be displayed on the display device according to a sensor output from the sensor. Good.

Further, the sensor information displayed on the display device is an icon in which a function required for subsequent processing is registered, and input means for designating the icon,
It is preferable to further include means for executing a predetermined function designated by the input means, and in such a case, the input means is more preferably a touch panel mounted on the display device.

[0012]

In general, the image data picked up by the image pickup device is displayed on the display device. At this time, at the same time, the state of a predetermined part of the area being imaged by various sensors is monitored, and the detection result of the sensor is sent to, for example, the controller. Then, it is determined whether or not there is information that should be displayed on the display device, such as whether there is an abnormality, and if necessary, the predetermined sensor information is displayed on the display device via the image processing means. At this time, the sensor information is displayed so as to be superimposed on the image data sent from the image pickup apparatus, and more preferably, it is displayed so as to be superimposed on the screen corresponding to the target area detected by the sensor. From this, it is possible to visually understand as an image what part is in what state by looking at the display device, and since the sensor information is also displayed in the same place, based on that information More accurate judgment can be made quickly.

When a function as an icon is added to the sensor information, for example, a predetermined process for avoiding / eliminating an abnormality can be easily instructed / executed while looking at the display device, and if it is unknown, Can cut the screen 15 and display an enlarged image on the display device.

[0014]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the sensor information display method and device according to the present invention will be described in detail below with reference to the accompanying drawings.
FIG. 1 shows an overall configuration diagram of an embodiment of the present invention.
As shown in the figure, outputs (video signals) of video cameras 11, 12, ...
Is connected to the video image capturing unit 20, and the image data of the monitoring area is digitized and stored. Then, the predetermined image data (digital) captured by the video image capturing unit 20 is transferred to the image processing unit 30 and displayed on the monitor TV 40 externally connected to the image processing unit 30.

The configuration of each of the above-mentioned parts for displaying the monitor screen on the monitor TV 40 will be described in detail. The video cameras 11, 12, ... As shown in FIG. A wide-angle video camera 11 capable of capturing an image of the entire room, and a detail video camera 12 capable of capturing a detailed state of each part. The detail video camera 12 is a predetermined part (in the example shown, the interior of the room). It is arranged at a predetermined position where an image can be enlarged by enlarging a door portion which is an entrance / exit to and from. 1 and 2, one whole video camera 11 and one detailed video camera 12 are shown.
However, it is okay to install more than one camera for each camera, if necessary, and use a single video camera with a zoom function, and change the magnification as necessary, The details may be switched appropriately.

In the video image capturing section 20, the video signal (analog) sent from each of the video cameras 11, 12, ... Is received by the video input section 21, separated into horizontal / vertical synchronizing signals, sampled, and then A / D. The brightness level is digitized by the converter 22 and sequentially stored in the video memory 23 according to the X and Y addresses. Then, actually, one of the plurality of video cameras is selected and electrically connected to the video input unit 21 based on the switching command control signal from the image processing unit 30 side, and the connection is made. Field (surveillance area) obtained by digitizing a video image based on the video signal of the recorded video camera
The image data of is stored in the video memory 23.

The image processing unit 30 normally transfers the image data (digital image) being captured, which is stored in the video memory 23, to the graphic memory (frame memory) 31 in a through state as it is according to a control command from the CPU 33. , The data temporarily stored in the memory 31 is D
A / A converter 32 converts to analog signal, then monitor TV
40 is displayed on the display screen 40a.

As the monitor TV 40, a color liquid crystal display is used in this example, and a touch panel 43 is attached so as to cover the front surface of the display screen 40a. It should be noted that the present invention is not limited to the liquid crystal display described above, and other display devices such as a CRT may of course be used.

In the present invention, a programmable controller (PC) 41 is connected to the image processing section 30, and the programmable controller 41 is connected to various sensors 42a to 42d installed at various places in the monitoring area. . If you show an example of the installation situation of these various sensors,
As shown in FIG. 2, for example, the proximity sensor 42a is arranged in the vicinity of the doorway to the room and detects the open / closed state of the doorway. Embedded vibration sensor 42c
Is a showcase or window (in the showcase in the example shown)
It is installed in a room, etc., and detects the shaking of the installation site and detects whether a person, etc., has passed in the vicinity. Further, the infrared sensor 42d is installed, for example, on the ceiling or the like and detects a change in the temperature distribution in the room that occurs when a person moves. In addition, the sensor to be connected is not limited to this, and for example, monitors the energization state of OA equipment and electric appliances (power supply O
N / OFF) can be detected and various sensors can be connected as required.

Then, the detection signals of the respective sensors 42a to 42d are given to the programmable controller 41, and the programmable controller 41 is based on the sensor information.
Sends a predetermined control command to the image processing unit 30, and the image processing unit 30 outputs a predetermined image (sensor information) based on the given control command at a predetermined position on the monitoring image (image based on actual image). The output screen is displayed on the display screen 40a of the monitor TV 40 in a state of being superposed on the screen.

That is, for example, when the proximity sensor 42a detects opening / closing of the door of the entrance / exit as shown in FIG.
Information indicating the opening / closing by superimposing on the target door portion on the monitor TV 40, for example, a predetermined color is displayed in a frame, or a message (character) indicating the opening / closing is displayed. The same applies to the other sensors 42b to 42d. Also, when the sensor is a temperature sensor, etc., the detected current room temperature is displayed numerically, or the image of the actual thermometer is displayed (the pointer of the thermometer to be displayed indicates the detected temperature). For example, depending on the content of the sensor information, the monitor is displayed in such a manner that it can be easily visually recognized.

The image data (sensor information) to be superimposed is generated in advance and stored in the main memory 34, or the HDD connected to the image processing unit 30.
45, stored in a storage medium (magnetic disk) read and written by the FDD 46, and the programmable controller 41 sends address data of the stored image data. The image processing unit 30 that has received the address data displays the image data stored according to the address data at a predetermined position on the monitor TV 40. When displaying numerical data, information about the display area (display position, frame, etc.) is stored in a predetermined storage means, and the programmable controller 41 outputs the data together with the address at which the data about the display area is stored. The numerical value is sent. The image processing unit 30, which has received the address data and the like, displays the numerical value set in the display frame at a predetermined position on the monitor TV 40 (specific processing will be described later).

As shown in FIG. 1, the image processing unit 30
I / O control 35 is built into each device 41,
45 and 46 through the I / O control 35 (in the case of the programmable controller 41, the interface (PC-I / F 47) is further interposed),
Information is exchanged with the image processing unit 30. Further, a predetermined input device 44 is connected to the image processing unit 30 via the I / O control 35. As the input device 44, various devices such as a keyboard, a mouse, a trackball and the like can be used.

Further, in this example, the CP in the image processing unit 30
By U33, an icon for a predetermined function (for example, switching of a video camera) is displayed at a predetermined position on the display screen 40a of the monitor TV 40, or an input screen (numeric keypad, etc.) for data change (program change) to the programmable controller 41 is displayed. You can display it. And
The displayed icon or input screen can be touched directly on the touch panel 43 or can be instructed using the input device 44.
It should be noted that the icons and input screens are also video cameras 11 and 1
The image data sent from 2, ... Is superimposed and displayed.

Here, the programmable controller 41 and the image processing unit 30 (CPU 33) which are the main parts of the present invention.
The specific function of will be described. First, as shown in the flowchart of FIG. 3, the programmable controller 41 first acquires sensor information (temperature, presence or absence of vibration, ...) From each connected sensor (ST1), and the content of the acquired sensor information. Is determined, and it is determined whether or not it is necessary to display on the monitor TV 40 (ST2).

Here, whether or not it is necessary to display on the monitor TV 40 is determined by whether or not each sensor information is within the normal range. That is, the sensor output is compared with the minimum value and the maximum value registered corresponding to each output of each sensor. If the sensor output is within the range of the corresponding minimum and maximum values, it is determined to be normal, and if it is out of the range, it is determined to be abnormal. If it is determined to be abnormal, it is necessary to display it. Even if the output of each sensor is within the normal range, it may be judged as abnormal when viewed as a combination of a plurality of sensors.

Therefore, in this example, as shown in Table 1 below, for example, the display information (normal value (multi-value sensor)) and normal value (binary sensor) for a sensor (including a combination of sensors) and a normal value (binary sensor) are created in advance (Sensor information) determination reference data is stored in the programmable controller 41, and the programmable controller 41 accesses the determination reference data based on the output from each sensor to determine whether it is within a normal range (display is unnecessary). The outside of the normal range (needs to be displayed) is discriminated (the process is the branch determination process of step 2).

[0028]

[Table 1] Further, since central coordinate data (display position) for displaying processing and sensor information (window, icon, etc.) at the time of abnormality is stored in the reference data in association with each other, the programmable controller 41 needs to display the sensor information. If it is determined that the above-mentioned determination reference data is accessed, data such as necessary processing is acquired, and necessary processing is performed based on the acquired data.

That is, when it is necessary to display, referring to the above-mentioned judgment reference data according to the contents,
Steps 3 and 5 based on the read processing contents at the time of abnormality
In accordance with the branch processing of step 1, any one of steps 4, 6 and 8 is performed. In this example, three types of icon switching (ST4), window area display (ST6) and numerical data display (ST7) are prepared, and icon switching (ST4)
For example, when switching the area to be imaged by the video camera, that is, when there is some abnormality and it is better to enlarge and display the predetermined area with the video camera for details, click on the icon for the switching. Is performed automatically without the need for an observer to perform such a predetermined function (start). Is set. Then, specifically, the programmable controller 41 corresponding to each icon in advance on the image processing unit 30 side.
The data area inside is designated, and the programmable controller 41 sets a flag in the data area corresponding to the designated predetermined icon.

Display of window area (ST6)
Encloses an abnormal place with a frame and gives it a predetermined color (blinks it if necessary),
This is executed when it is necessary to display the detection result of the sensor such as the thermometer described above in a predetermined figure (actual image, graphic, graph, etc.). In this example, since the screen area for displaying each image data (graphic, color (whether or not blinking)) is uniquely determined, the programmable controller 41 specifies the window to be used and the attribute (color) of the image to be embedded therein. , With or without flicker).

Furthermore, the numerical data display (ST7) is
The sensor output such as a temperature display is represented by a numerical value, and other predetermined data is displayed on the display screen 40a of the monitor TV 40. Specifically, the image processing unit 30 side corresponds to each display location on the screen in advance. Programmable controller 41
The data area inside is designated, and the programmable controller 41 sets the numerical data to be displayed in the data area corresponding to the designated display location.

The display information determining reference data shown in Table 1 which is a reference for executing various determinations and predetermined processing is externally written to the programmable controller by an operator or the like. Further, a combination of a vibration sensor and an infrared sensor is shown as an example of a combination of a plurality of sensors, and an example in which a predetermined coefficient is multiplied as the calculation formula and addition is performed is shown, but the invention is not limited to this. Of course. And since the dimensions of vibration and infrared are different, it is not possible to simply add the two as they are, but the notation is that the predetermined feature amount (no dimension) is extracted from each output and the predetermined calculation processing is performed based on it. It conceptually shows what to do.

The programmable controller 41
Transfers the data stored in the data area to the image processing unit 30 side in a predetermined scan cycle (ST8). Further, after this processing is completed, or when it is determined in step 2 that the display is unnecessary, the processing jumps to step 9, and the image processing unit 3
Whether or not there is an instruction from the 0 side (numerical value in the designated data area) is confirmed, and if a predetermined numerical value is input, sequence processing according to the data is executed (ST10). Then, as an example of this sequence processing, there are power-off for turning off the power, turning off the illumination, locking the door, and the like.

After this processing is completed, or when it is determined in step 9 that there is no numerical input, the process jumps to step 11 to execute the sequence program set in the normal programmable controller 41. Then, the above steps 1 to 11 are sequentially repeated.

On the other hand, the function of the CPU 33 of the image processing unit 30 is that the image data (actual image) of the monitoring area, which is picked up by a predetermined video camera (usually the video camera 11 for the whole) and sent, is directly displayed on the monitor TV 40. Output to. Then, in this state, according to the flowchart shown in FIG.
A predetermined image (graphics, characters, etc.) is superimposed on the captured image and displayed. First, the contents of the data area transferred from the programmable controller 41 are read (ST
21).

When the read data content is designated as "icon No.", since it is an icon switching processing command, the function registered in the designated icon is executed (ST22, ST23).

When the "window area attribute" is designated, the color of the window at a predetermined location is changed according to the attribute, and the window painted in red, for example, is superimposed and displayed on the abnormal portion. By doing so, the observer is intuitively notified of the abnormal portion. Also, by blinking (flicker) that color as needed,
It can also be made more alert. Furthermore, a predetermined figure (thermometer, etc.) is displayed in a superimposed manner on a predetermined position. As a result, sensor information is displayed at the location of the detected sensor, and at which location the sensor is activated and in what state it is possible to easily and accurately instantly understand just by watching the monitor TV. Can (ST2
4, ST25). The size and installation position of the window to be displayed are stored in the image processing unit 30 (main memory 34).

Further, when the "display of numerical data" is designated, the numerical data (the detection result of the sensor is stored in a character / text at a predetermined location (stored in the image processing unit 30 (main memory 34)). Display numerical value) (ST
26, ST27).

By the above steps 22 to 27, the process of superimposing and displaying the sensor information in the image of the picked-up monitoring area is completed. By the way, in this example, the displayed window also has a function as an icon. Therefore, when the process of step 27 is completed, it is determined whether or not the window displayed in step 25 has been touched (ST28). If it is touched, the function registered in the window (icon) is executed (ST29).

As an example of a specific function, when the sensor information is, for example, a window blinking due to forgetting to turn off the power, a command to turn off the power source by touching the window is issued by the programmable controller 41. If you need to magnify and view an abnormal spot that has been transferred to another device, or if you need to magnify the spot, touch the window of the abnormal spot to capture an image of that spot from the detailed video camera. To switch to the screen,
A control signal is output to the image reading unit 20 side. Further, there are various processes other than the transfer of a numerical data change command to the programmable controller 41.

Further, the icon displayed on the screen can be clicked at an arbitrary timing without being directly related to the display of the sensor information, and when the icon is clicked, the icon is registered in the icon. Perform the specified function. Then, the above steps 21 to 29 are sequentially repeated.

Next, a preferred embodiment of the method for displaying sensor information according to the present invention, which is an operation of the above-described embodiment, will be described. In this example, an example applied to a monitoring system for monitoring a predetermined room is shown. First, usually
As shown in FIG. 3, the image capturing section 20 converts a field (indoor) image captured by the video camera 11 for the whole into digital image data, and transfers the converted image data to the graphic memory 31 in the image processing section 30. To do. As a result, for example, as shown in FIG. 6, the state of the room as the monitoring target is output and displayed on the monitor TV 40.

In this example, the detailed video camera 12 is used.
Icon 50 with the function to switch to
Is displayed on the upper left of the screen. And this icon 50
Click to enlarge the image taken from the opposite side of the entire camera (the side facing the camera on the icon).

If, for example, a temperature sensor is installed near the window and the temperature sensor is connected to the programmable controller 41, the sensor information from the temperature sensor indicates the installation location (temperature detection) as shown in FIG. The image of the thermometer is displayed in the window 51 at the window corresponding to the (location) in the state of the actual image of the thermometer (the thermometer needle indicates the temperature detected at that time). The actual image 51 is obtained by capturing a plurality of thermometers indicating the respective temperatures in advance as described above and storing them in various storage means. Then, the programmable controller 41 sets the address on the storage means in which the image of the thermometer indicating the detected temperature is stored based on the temperature information sent from the temperature sensor, and the image processing unit 30 transfers the address. Upon receiving the received address data, the image data stored at that address is read out and output in the predetermined window 51. As described above, since the image stored in advance is only output-displayed at a predetermined position on the display device 40 as needed, it can be performed at high speed. Further, the predetermined data of the programmable controller 41 is displayed in a strip-shaped window 52 set at the lower left of the screen.

If, for example, the abnormal information in the room is received from various sensors connected to the programmable controller 41, the programmable controller 4
1 designates the window of the abnormal portion and sets the color to be displayed in that window and the presence / absence of flicker.
Then, based on this, the image processing unit 30 performs a predetermined display in the corresponding window.

As a result, for example, as shown in FIG. 7, a predetermined color (in the example shown in the figure, shaded) is given in a window 53 surrounding a personal computer installed on a desk, or The window 54 surrounding the door of the entrance / exit is displayed with a predetermined color (in the example shown in the drawing, shaded) and is blinked as necessary. The window 53 attached to the personal computer has a colored window for notifying the observer that he / she has forgotten to turn off the power when, for example, the personal computer is still on (normally off when unattended). It is superimposed and displayed on the screen. Further, in the case of the window 54 attached to the door, for example, when the door is opened, a colored window is displayed so as to be superimposed on the monitor screen so as to notify the observer.

The windows 53 and 54 also have a function as icons in this example, and the window (icon) is clicked (since the touch panel 43 is attached, the monitor directly on the screen). Touch the window) to activate the function registered for that icon. Specifically, when the window 53 on the personal computer side is pressed, a predetermined control signal is sent from the image processing unit 30 side to the programmable controller 41 in order to automatically turn off the power source of the personal computer. It is turned on (ST9 of FIG. 3 through ST28 and 29 of FIG. 4,
10 processing is performed). Also, instead of the automatic screen switching described above, it is also possible to register a screen switching function of enlarging and displaying the corresponding part by a predetermined detail video camera when a predetermined window is touched,
Functions necessary for post-processing to be performed next based on the content of the sensor information are registered as icons. Then, even if the user is uncertain about the next process to be performed, the user can touch the displayed window (icon) to execute the required process image.

Further, the personal computer P on the back side of the screen shown in FIG.
When information is received from a predetermined sensor that some abnormality has occurred on the side, the state cannot be visually confirmed in the image taken by the video camera 11 for the whole, and therefore the output is displayed on the monitor TV 40. It is necessary to switch the image data to be used to the video signal from the video camera 12 for details.

Therefore, the programmable controller 41
Is an icon N for switching the image (video camera).
o. (Number corresponding to the icon 50 displayed in the figure)
Is set, and the image processing unit 30 displays the icon No. Activate the function (screen switching) registered in the icon corresponding to. As a result, an image in which the corresponding personal computer P is in front is enlarged and displayed as shown in FIG. Note that such an image can be switched and displayed by a manual operation when the monitor actually clicks the icon 50.

Further, in this example, as shown in FIG. 9, a ten key 54 for predetermined input can be superimposed and displayed on the monitor image displayed on the monitor TV 40. And
This ten-key pad is for changing the numerical data for performing the process of step 29 in the flowchart of FIG. 4, and the touch panel 43 is touched by directly touching a predetermined position of the ten-key pad generated by the displayed image data. A data change command of the programmable controller 41 can be input via the.

As described above, in this example, the sensor information is superposed on the image of the monitor area transferred from the video camera on the screen of the monitor TV 40, and the sensor information is directly or predetermined image data based on the sensor information (not to mention graphics, characters). Is also displayed), it is possible to visually monitor the site and check the sensor on one screen, and the monitoring process can be performed easily and accurately. Further, a control command for performing a predetermined process when an abnormal situation occurs or when controlling the pro-crammable controller 41 or the like is also displayed on the monitor TV.
It can be performed through an image pattern for input such as an icon or a numeric keypad displayed on 40, and various processing can be performed without providing the input device 44 as an external device.

In the above-described embodiment, the sensor output is once received by the programmable controller, the predetermined determination processing is performed, and then it is sent to the image processing section, which is constituted by separate hardware. However, the present invention is not limited to this. Without
A sensor may be directly connected to a predetermined computer or the like, and necessary sensor information may be determined by an integrated device and displayed on a display device.

The sensor information does not necessarily have to be iconized. Further, when the icon function is added, the selection of the icon is performed by the touch panel 4 in the above-mentioned embodiment.
Although it is possible to perform a simple and quick process by using 3, the present invention is not limited to this, and for example, a cursor displayed on the display device 40 by using the input device 44,
Various methods can be adopted, such as moving a pointer or the like onto predetermined sensor information to select it, or inputting a predetermined number.

Further, in the above-mentioned embodiment, the function registered in the icon is automatically executed in a predetermined case as a result of the sensor output. However, the present invention is not limited to this, and the predetermined function is executed. Monitor TV icon to run
It may be displayed at a predetermined position above.

[0055]

As described above, in the sensor information display method and apparatus according to the present invention, predetermined sensor information is displayed by being superimposed on the image data sent from the image pickup apparatus.
By just looking at one screen, the information obtained from the sensor can be known at the same time while visually confirming the state of the scene being imaged. In addition, the location of the detected sensor information can be easily and instantly known by superimposing the sensor information on the screen corresponding to the target area detected by the sensor. Therefore, it is possible to make an accurate determination and quickly deal with the processing that should be performed thereafter.

Further, when the function as an icon is added to the sensor information, for example, a predetermined process for avoiding / eliminating the abnormality can be easily instructed / executed while looking at the display device, and when it is unknown. The screen can be cut and the enlarged image can be displayed on the display device, which further improves the convenience.

[Brief description of drawings]

FIG. 1 is a block diagram showing a preferred embodiment of a display device according to the present invention.

FIG. 2 is a diagram showing an arrangement state of various sensors.

FIG. 3 is a flowchart showing functions of a programmable controller used in this embodiment.

FIG. 4 is a flowchart showing functions of a CPU used in this embodiment.

FIG. 5 is a diagram showing a display screen of a monitor TV displayed in each step of the embodiment of the display method according to the present invention.

FIG. 6 is a diagram showing a display screen of a monitor TV displayed in each step of the embodiment of the display method according to the present invention.

FIG. 7 is a diagram showing a display screen of a monitor TV displayed in each step of the embodiment of the display method according to the present invention.

FIG. 8 is a diagram showing a display screen of a monitor TV displayed in each step of the embodiment of the display method according to the present invention.

FIG. 9 is a diagram showing a display screen of a monitor TV displayed in each step of the embodiment of the display method according to the present invention.

[Explanation of symbols]

 11 Video Camera (Imaging Device) 12 Video Camera (Imaging Device) 20 Video Image Capture Unit 30 Image Processing Unit 31 Graphic Memory 32 D / A Converter 33 CPU 34 Main Memory (Storage Means) 40 Monitor TV (Display Means) 41 Programmable Controller 42a-d Sensor 43 Touch panel 44 HDD (storage means) 45 FDD (storage means) 46 Input device 50-53 Sensor information

Claims (10)

[Claims] 1. An image based on an actual photograph sent from an image pickup device is displayed on a display device, and sensor information according to a sensor output sent from a sensor installed in an area imaged by the image pickup device is displayed. A sensor information display method for displaying the image superimposed on a predetermined position on the image. 2. A predetermined position for displaying the sensor information is
The sensor information display method according to claim 1, wherein the position is a position corresponding to a detection target portion of the sensor in the image based on the actual photograph. 3. The sensor information display method according to claim 1, wherein the sensor information is at least one of a character or a figure corresponding to a detection result of the sensor. 4. The sensor information according to claim 1, wherein a predetermined color is added to a window set in the display screen of the display device according to the detection result of the sensor. Displayed sensor information method. 5. The window has a function as an icon, and a predetermined function registered in the window is activated by designating the window.
4. The sensor information display method according to any one of 4 above. 6. An image pickup device for picking up an image of a predetermined area, a sensor for detecting a predetermined situation of the predetermined area, a display device for outputting image data sent from the image pickup device, and a sensor output sent from the sensor. On the basis of the above, a sensor information display device comprising: processing means for displaying predetermined sensor information at a predetermined position on the display device in a state of being superimposed on the image data. 7. The controller includes a predetermined controller to which the sensor is connected, and an image processing unit that generates and outputs an image to be output to the display device based on a control signal from the controller, the controller Has a function of receiving a detection result from the sensor, determining predetermined sensor information to be displayed on a display device, and outputting data necessary for outputting the sensor information to an image processing unit, 7. The sensor information display according to claim 6, wherein the image processing means has a function of superimposing predetermined sensor information on an image based on an actual image sent from the imaging device based on given data and outputting the superimposed image to the display device. apparatus. 8. The image pickup device has a plurality of image pickup devices having different image pickup areas and / or magnifications, and an image from a predetermined image pickup device can be displayed on the display device according to a sensor output from the sensor. The sensor information display device according to claim 6 or 7. 9. The sensor information displayed on the display device is an icon in which a function required for subsequent processing is registered, and input means for designating the icon, and a predetermined information designated by the input means. 9. The sensor information display device according to claim 6, further comprising a unit that executes a function. 10. The sensor information display device according to claim 9, wherein the input unit is a touch panel mounted on the display device.