JP2005167798A - Camera control and notification system linked to changes in power status of remote devices - Google Patents

Abstract

PROBLEM TO BE SOLVED: To monitor by a network camera that can be operated remotely. The PTZ of the camera is automatically controlled according to a change in the power supply state of a device located at a remote place, and the device that has changed is monitored.
Conventionally, a system that combines a plurality of modules such as a power supply control device, a power supply monitoring device, and a camera device has been used for device control and monitoring by remote monitoring. However, this configuration is not convenient and has relatively simple functions, so it is difficult to handle detailed monitoring. In addition, there has been no example of power supply monitoring in combination with a PTZ camera. In this proposal, in order to improve the convenience of such a system, an integrated PTZ camera capable of detecting and controlling a change in the power state of the device is proposed. By integrating the power tap and PTZ camera, various flexible power control and state grasping becomes possible.
[Selection] Figure 1

Description

  The present invention relates to camera control that operates in conjunction with the power state of a device that remotely monitors control of a remotely operable PTZ camera.

  In the technology for monitoring an object to be monitored at a remote place, information on the object to be monitored and an image of the remote place are often handled separately. However, with these developments of digital remote management networks, examples of linking images and operations by monitoring images and remote device operations using a digital signal network are beginning to appear. For example, as disclosed in Japanese Patent Laid-Open No. 8-154243, it is possible to automatically respond to remotely generated alarm information and to turn on / off the power of the camera at a remote location. Japanese Patent Application Laid-Open No. 7-271426 makes it possible to perform device monitoring and device control using a remote camera.

  In addition, network PTZ cameras capable of panning, tilting, and zooming that enable remote monitoring are now in practical use, and digital networks such as the Internet network (TCP / IP network) can be used using them. It has become possible to browse and control cameras from remote locations.

  As shown in the prior art, although notification of abnormalities of monitored objects at remote locations has actually been performed, remote control capable of pan, tilt and zoom operations like a network PTZ camera There has been no technology in which a possible camera can perform panning, tilting, and zooming operations independently in response to changes in an object to be monitored.

  For this reason, even if a network PTZ camera capable of remotely operating the monitoring target is used, it is necessary to manually operate the monitoring target, which is a laborious operation.

  In addition, a system that combines a plurality of modules such as a power supply control device, a power supply monitoring device, and a camera device has been used for device control and monitoring by remote monitoring. However, this configuration is not convenient and has relatively simple functions, so it is difficult to handle detailed monitoring. There was no example of power monitoring in combination with a PTZ camera.

  The purpose of the proposed invention is to perform remote automatic monitoring using a digital network by using a pan / tilt / zoom camera in response to a change in the state of an object to be monitored at a remote location. .

  In this proposal, in order to improve the convenience of such a system, we propose an integrated PTZ camera that can detect and control changes in the power supply state of equipment. By integrating the power strip and the PTZ camera, various flexible power control and status monitoring are possible. The monitoring target is captured as a device that handles the power supply, and the network PTZ camera operates according to the change in the power supply voltage, thereby enabling independent long-distance monitoring.

  As a result, it is possible to constantly monitor the state change of the monitored object, pan, tilt, and zoom in accordance with the change state, and view or store the video with the network camera.

  As described above, according to the present invention, remote automatic monitoring using a digital network is performed by using a pan / tilt / zoom camera in response to a change in the state of a monitored object at a remote location. It becomes possible to do.

(First embodiment)
The present embodiment is an embodiment of a method for detecting an intruder into a room and acquiring an image by automatically operating a PTZ camera and storing or transmitting it as details and application examples regarding the entire system.

  FIG. 1 is a configuration diagram showing the entire system of this embodiment. 100-001 and 100-002 are the monitored items. This monitored object indicates a device to be monitored in the figure. The object to be monitored is a device, but it may be other than the device. For example, a part, a person, or a place that is affected by the action of the device may be taken as an object of photographing. The power source of these monitoring target devices is connected to the proposed system shown in 100-003. The proposed system is further connected to the power source shown at 100-004. Device A (100-001) and Device B (100-002) each receive power distribution from the proposed system 100-003. This makes it possible for the proposed system to monitor power supply voltage fluctuations of device A (100-001) and device B (100-002), and at the same time turn the power on and off by the system. .

  The proposed system is connected to the Internet network indicated by 100-005. As this Internet network, an existing TCP / IP network may be used, or a digital network having the same function may be used.

  Furthermore, as indicated by 100-006, the client device can be remotely operated via an electronic device such as a personal computer. This device is not particularly limited, and any means or device may be used as long as it uses a protocol that can be connected to the Internet network and can be connected to 100-003. In this embodiment, the HTTP protocol is particularly used. As shown in 100-007, a GUI or moving image using an HTML page or the like is provided for the image of 100-006. The client device 100-006 can provide a GUI by using standard WWW browser software or Java (registered trademark) execution environment.

  Further, the proposed system 100-003 has a process of sending an electronic mail. As a result, the client device 100-006 can also know changes in the devices A and B in the form of an e-mail.

  FIG. 2 shows the details of the overview device of the proposed system.

  200-001 indicates a PTZ camera portion. Since the camera part can pan, tilt, and zoom, it is possible to project a wide range of shooting. Reference numeral 200-005 denotes the entire main body. Each device and software are installed in this part. Reference numeral 200-003 denotes a network connection unit. As described above, TCP / IP such as the Internet can be connected to the network. However, the present invention is not limited to this, and any other digital network may be used. Reference numeral 200-004 denotes a power supply unit. A device to be monitored whose power is monitored supplies power using this port. 200-002 is a part for acquiring the entire power supply.

  By supplying and managing the power supply of the device to be monitored from the proposed system in this way, this proposal provides means for solving the problem.

  FIG. 3 shows the internal configuration of the proposed system.

  The internal configuration is centered around the bus line shown at 300-012. All the internal devices are connected by this bus line. Reference numeral 300-001 denotes a central processing unit. This is the part that interprets and executes software and gives instructions to each device. Reference numeral 300-007 denotes a main storage device. Generally, it is a memory, and temporarily stores data that has been subjected to calculation processing by the central processing unit 300-001, or a software program itself is arranged. Reference numeral 300-002 denotes an auxiliary storage device. In this embodiment, a hard disk is particularly used. However, the present invention is not limited to this, and any auxiliary storage device having a large capacity may be used. At present, it is possible to use a magneto-optical disk or an external memory. Reference numeral 300-003 denotes an image input device. This is a device for acquiring an image of a PTZ camera indicated by 200-001 as digital data from a central processing unit. This device is connected to a 300-004 CCD camera. In this embodiment, a CCD camera is used. However, other cameras or the like may be used as long as the image input device 300-003 can normally acquire the image of the camera and can play the same role. . Reference numeral 300-009 denotes a network communication device. This device can be connected to the network indicated by 300-008. In this embodiment, 10 / 100BaseT is used. However, the present invention is not particularly limited to this and can be changed depending on the network to be used. Reference numeral 300-010 denotes a camera control device. The camera control device is connected to a pan / tilt head control device indicated by 300-011. This device enables the central processing unit to pan, tilt, and zoom the PTZ camera.

  The proposed system can operate using the system configuration described above.

  FIG. 4 shows an example of GUI and information displayed on the client device 100-006.

  400-001 can display live images from PTZ cameras. This is a part that has already been put into practical use, and is not specifically mentioned in this proposal.

  400-002 is a GUI used when the power supply device is manually turned on or off. It shows the current power status as well as the GUI.

  Reference numeral 400-003 denotes a portion for displaying the stored video. It is a GUI that displays the video recorded in the auxiliary storage device in the proposed system. This makes it possible to check past images.

  Reference numeral 400-004 denotes a history of the power supply voltage. As a result, it is possible to confirm past changes in the device state in the same manner as the accumulated moving image.

  FIG. 5 shows a power supply monitoring schedule setting GUI.

  Since the proposed system is characterized by the fact that it performs operations determined with respect to changes in power, time, etc., this section will show details in particular.

  500-003 indicates all items for which a schedule relating to a power supply change is set. The added schedule is displayed in this part. 500-002 is a GUI for adding schedule items. Using the status list, it is possible to set the status related to the power supply. This power supply state can be checked to determine the state of various power supplies, such as detecting when the OFF state continues for a certain state regardless of the change from ON to OFF and OFF to ON. It is possible to choose. In the action list, you can set what to do in the selected state.

  It is also possible to select a plurality of these and set them in order. In this operation list, it is possible to pan / tilt / zoom the camera, treat a certain position as a preset, perform pan / tilt / zoom, accumulate video, and send the contents via email Can be notified, and further, power control of the connected devices can be performed.

  In 500-001, the one selected by these settings is displayed. By pressing the “Set” button with the set contents, it is added to the list of 500-003.

  In this way, the proposed system can flexibly store images, perform camera pan / tilt / zoom operations, and send notifications via e-mail, depending on changes in the power status of the device. Or control the power supply of the device.

  FIG. 6 shows the data groups maintained in the proposed system.

  Reference numeral 600-001 denotes a power supply line table. Holds power line status data. 600-002 indicates operation schedule data. Information regarding power monitoring conditions and operations set by the user shown in FIG. 5 is held. Reference numeral 600-003 denotes video accumulation data. The recorded moving image information is held in this data. 600-004 indicates a power supply line state master. This data is shown in FIG. 5 and holds information on what power state variations can be monitored for user settings. Reference numeral 600-005 indicates history data of the power supply line. Records of fluctuations in power supply voltage and the ON / OFF status of the proposed system. Reference numeral 600-006 denotes an operation master. The operation master can additionally write how the proposed system operates at the time of user setting shown in FIG. Reference numeral 600-007 denotes preset position information. Preset is an easy-to-use name for pan / tilt / zoom positions where it can be panned, tilted and zoomed. Convenience is increased by using this in the setting GUI.

  Details of these internally held data will be described later.

  FIG. 7 shows details of the power supply line table.

  This data shows a list of devices to be monitored connected to the proposed system and the state of the power supply.

  Based on this information, a determination is made based on this information regarding the display of the power state of the GUI and the correspondence of the power state by the schedule operation.

  FIG. 8 shows details of the power supply line state master.

  Detailed information about what kind of power supply state the proposed system can detect is described.

  This information is referred to when the power supply is monitored by the proposed system.

  FIG. 9 shows details of the operation master.

  The operation master has a table of contents that operate when the proposed system detects an operation condition.

  This information is referred to when the power supply is monitored by the proposed system.

  FIG. 10 shows details of the operation schedule data.

  This schedule data records the power supply monitoring condition set by the user and how it operates when the condition is detected.

  FIG. 11 shows details of history information of the power supply line.

  Here, voltage information of the power supply line, power supply control information by a schedule operation, and the like are described.

  With this information, it becomes possible to know the past fluctuation state of the power source, the occurrence of an event, and the like.

  FIG. 12 shows details of a table indicating preset positions.

  This table gives easy-to-understand names and numbers for camera pan, tilt, and zoom positions.

  By using this preset name when the user sets the camera position, convenience can be improved.

  FIG. 13 shows details of the video accumulation data.

  In this information, an accumulated video when an event occurs, a time when the video is recorded, a pan / tilt / zoom position, and the like are recorded.

  This can be referred to later, which makes it possible to use the proposed system for monitoring purposes.

  These pieces of information are used by processes described below.

  A block diagram showing the operation of the proposed system is shown below.

  FIG. 14 shows a block diagram of the proposed system.

  140-001 indicates a power supply port connected to a device to be monitored. This port is connected to the power supply monitoring circuit shown at 140-002. Furthermore, the power supply line is connected to a power supply control circuit indicated by 140-003. By using this circuit, the proposed system can control the power supply for the device to be monitored. 140-004 indicates connection to an external power source. Connect this part to a normal commercial power supply.

  Reference numeral 140-005 denotes a power supply monitoring process. This software means constantly monitors the power supply monitoring circuit 140-002, and always monitors fluctuations in the power supply state. The power control process indicated by 140-006 is connected to the power control circuit 140-003. The power control process 140-006 outputs information to the power control circuit, and controls power ON / OFF. According to the configuration of these parts, it is possible to detect the state of the power source and control the power source of the connected device to be monitored.

  On the other hand, another important element of the proposed system, the PTZ camera 140-010, is connected to the PTZ camera process 140-009. This allows the PTZ camera control process to pan, tilt and zoom the camera. The video is also connected to the video acquisition process 140-001. With such an apparatus configuration, the camera can be panned, tilted and zoomed, and at the same time, an image can be displayed.

  At the heart of this proposal is the schedule / alarm execution process shown in 140-008.

  This process is configured based on the operation schedule information by detecting temporal or power line voltage abnormality by a power monitoring process, a timer notification process indicated by 140-007, or the like.

  By sending information such as the PTZ camera control process by these alarms, it is possible to perform pan / tilde / zoom operations of the camera.

  Also, the video is stored at 140-012. This also works according to the instructions of 140-008.

  Further, the mail transmission process indicated by 140-013 makes it possible to send information about an abnormality in the power supply line by e-mail.

  Each of these processes operates according to a flow as described later.

  FIG. 16 shows the flow of the camera server management process.

  This process starts up the entire process and manages internal data.

  Processing starts from 160-001, and information such as each master and data is read from the auxiliary storage device at 160-002. Each process is started in 160-003 to 160-010. Thereafter, this process does not perform any particularly characteristic operations until the end.

  FIG. 17 shows a flow of the power supply monitoring process.

  The role of the power supply monitoring process is to monitor fluctuations in the power supply voltage of the devices to be monitored, and to notify the schedule / alarm execution process of the contents when there is a change.

  Processing starts from 170-001. Read or initialize information related to power management at 170-002. Wait until the power status changes at 170-003. When a change in the power supply state is detected, the power supply voltage is read in 170-004, and in 170-005, it is verified whether the actual state is matched with the power supply line master information. If a change in state relating to the power supply information existing in the master is detected, the schedule / alarm execution process is notified at 170-006. After the notification, the power line monitoring state is entered again.

  Through this operation, the proposed system can grasp the state change of the power supply voltage.

  FIG. 18 shows a flow of the power supply control process.

  The role of the power control process is to turn the power on and off. The power supply ON / OFF command itself is performed by the schedule / alarm execution process.

  Processing begins at 180-001. The power control process is initialized at 180-002. After that, at 180-003, it waits for a command to turn the power on and off from the schedule / alarm execution process. When there is a command from the schedule / alarm execution process, the power of the monitored equipment is turned ON / OFF in accordance with the command at 180-004.

  Through such operations, the proposed system can control fluctuations in the power supply of the device.

  FIG. 19 shows the flow of the timer notification process.

  The role of the timer notification process is to notify the schedule / alarm execution process of the passage of time. This process is necessary because the proposed system considers time-dependent operations.

  Processing begins at 190-001. Initialize the timer at 190-002. Then, wait for the unit time to elapse at 190-003. The progress of the unit time is notified to the schedule / alarm execution process at 190-004.

  FIG. 20 shows the flow of the PTZ camera control process.

  The role of the PTZ camera control process is to issue instructions to the hardware to actually perform pan / tilt / zoom operations for the pan / tilt head device. In this operation, the operation position of the camera is determined by a schedule / alarm execution process.

  Processing starts at 200-001. At 200-002, the pan head device is initialized. Thereafter, at 200-003, the camera waits for a camera operation request from the schedule / alarm execution process. If there is a request, the camera performs PTZ control at 200-004.

  FIG. 21 shows the flow of the video acquisition process.

  The role of the video acquisition process is to actually acquire video information from the camera. The acquired image information notifies the process that has requested the image.

  Processing starts at 210-001. At 210-002, the video acquisition process is initialized. Thereafter, after acquiring the video in 210-003, it is checked in 210-004 whether there is a request for an image from the process. If there is, at 210-005, the video data is transferred to the requested process, and the image is acquired again. Thereafter, such processing is repeated.

  A request for image data is received from a video storage process, a mail transmission process, or the like.

  It is always possible to provide the latest images for the request.

  FIG. 22 shows the flow of the video accumulation process.

  The role of the video accumulation process is to record actual video in an auxiliary storage device or the like.

  Processing starts at 220-001. At 220-002, the video accumulation process is initialized. After that, the operation request is waited at 220-003. The operation is instructed by a schedule / alarm execution process. When this request is made, an image request is made to the video acquisition process at 220-004, and the image data acquired at 220-005 is recorded in the auxiliary storage device. Thereafter, in 220-006, the accumulation operation is performed for the length as instructed, and upon completion, the request is waited again.

  FIG. 23 shows the flow of the mail transmission process.

  The role of the mail transmission process is to notify the client of the state change from the server side.

  The process is executed from 230-001. The email transmission process is initialized at 230-002. After that, a mail transmission request from the schedule / alarm execution process is waited at 230-003, and when there is a request, power supply information and video information of the device are actually mailed at 230-004.

  FIG. 24 shows the flow of the client communication process.

  The role of the client communication process is to notify the request and information from the client.

  Therefore, a very large number of commands and requests are made, processing is performed for them, or request information is presented.

  Processing starts at 240-001. At 240-002, the client transmission process is initialized. After that, it waits for a request from the client at 240-003. If there is a request, 240-004 interprets the request and actually executes the process.

  240-005 to 240-023 show the flow of processing that is actually executed for processing from the client.

  Processing includes live image request 240-005, camera control request 240-006, power line status information acquisition request 240-007, power line actual ON-OFF control 240-008, stored image request 240-009, Perform setting acquisition 240-010, status setting 240-011 from the client, etc.

  Through these processes, all requests from clients are provided as services. Since the result and the GUI are presented by HTML information and XML information, the client can request browsing and processing of these using existing browser software or the like.

  FIG. 15 shows the flow of the schedule / alarm execution process.

  The role of the schedule / alarm execution process is a process that actually performs processing for a power change event and time under conditions set by the client.

  Processing starts at 250-001. The schedule / alarm execution process is initialized at 250-002, operation schedule data is read at 250-003, and an event is waited at 250-004.

  The event is processed when a unit time elapses (notification from the timer process) or a change in the state of the power supply line (power supply monitoring process). 250-005 to 250-014 are performing the processing.

  At 250-011, a request is made to the PTZ camera control process to move the PTZ camera to the set pan / tilt / zoom position according to the setting data. After that, according to the setting data, the video storage process is requested to store. Furthermore, the power supply of the device is controlled according to the setting data. This is done by 250-013 and makes a request to the power control process. After such processing has been performed the set number of times, the event waits again.

  Such processing is not particularly different in unit time lapse events and power line state change events.

  The proposed system solves the problem by the above operation.

  In the first embodiment, such a system is used to detect an intruder in a room.

  Actually, the power supply of the room lighting etc. is connected to the proposed system, the amount of electricity used in the room is monitored by the proposed system, and if there is a change, the whole room video is accumulated for a certain period of time It becomes possible.

  It is also possible to acquire real-time information that has entered the room by e-mail notification.

(Second embodiment)
In the second embodiment, it is possible to monitor devices using the system described in the first embodiment.

  For example, when the setting is made so as to detect that the power of the connected device is turned off, it is possible to monitor the fuse used by the device being used. By sending a mail to the client in the same way as in the first embodiment, it is possible to monitor in real time that the fuse has blown.

(Third embodiment)
In the third embodiment, it is possible to monitor the frequency of use of a device for a certain period of time using the system described in the first embodiment. For example, the connected device can monitor whether or not the pot is used within a certain time using an electric pot or the like.

  Furthermore, it is also possible to use an auto-cruise function that sequentially cycles through certain presets when usage conditions for a certain period of time are not seen.

  This function seems to be useful for analogy of the health of the elderly, etc., depending on the frequency of use of the electric pots of the elderly in remote locations. This can be applied to elderly care.

  It is also possible to check the state through a remotely operable camera.

Overall system configuration Equipment overview Proposed internal configuration diagram Status history for each power line Power monitoring schedule setting Data group in camera server Data: Power line table Data: Power line status master Data: Operation master Data: Operation schedule data Data: Power Line History Data: Preset position table Data: Video accumulation data Proposed device block diagram Schedule / alarm execution process flow Camera server management process flow Power monitoring process flow Power control process flow Timer notification process flow PTZ camera control process flow Video acquisition process flow Video accumulation process flow Email sending process flow Client communication process flow

Claims (4)

In a communication device capable of controlling a camera connected to a network,
Video acquisition characterized by acquiring video that performs operations such as pan / tilt according to means for monitoring the power supply of other devices, means for controlling the power supply of other devices, and changes in the power supply of other devices Transmission storage device.   2. The video acquisition / transmission apparatus according to claim 1, further comprising a video acquisition / transmission apparatus capable of acquiring the video, recording it in an auxiliary storage device, and the like according to a change in power source.   2. The video acquisition / transmission apparatus according to claim 1, further comprising: acquiring the video and information in accordance with a change in power supply and transmitting the video and information to a remote client by mail. The video acquisition / transmission apparatus according to claim 1, further capable of performing operations such as power ON / OFF of devices connected to the apparatus of the present embodiment in accordance with a change in power.

Images