JP2013062559A - Imaging monitor screen and omnidirectional imaging screen monitoring system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging monitor screen and an omnidirectional imaging screen monitoring system capable of providing a sharp image even if the resolution of an image is rough at the periphery of the imaging area of an omnidirectional imaging screen.SOLUTION: The omnidirectional imaging screen monitoring system S comprises: fixed first imaging means 10 capable of taking an omnidirectional image as a moving image; fixed second imaging means 20 capable of taking an image as a moving image; recording means 30 for recording the moving images taken by the first imaging means 10 and the second imaging means 20; control means 40 for controlling the recording means 30; and display means 50 for displaying the images from the first imaging means 10, the second imaging means 20, and the recording means 30. The second imaging means 20 is disposed at a position for imaging the periphery of the imaging region of the first imaging means 10.

Description

  The present invention relates to an imaging monitoring screen and an omnidirectional imaging screen monitoring system, and more particularly to an imaging monitoring screen and an omnidirectional imaging screen monitoring that realize real-time division and panorama development display for an omnidirectional video of an omnidirectional imaging capable camera. About the system.

Conventionally, as a monitoring system with a simple configuration capable of monitoring all of a wide range of monitoring target areas without omission, an omnidirectional imaging camera that can equiangularly image the entire monitoring target area with a fisheye lens has been used. Technology has been proposed (Patent Document 1).
There has also been proposed a surveillance camera device that suppresses the amount of recorded data while leaving an omnidirectional image as a record (Patent Document 2).

  In the technique of Patent Document 1, an omnidirectional image obtained through a fisheye lens is recorded in a recording device as it is, and the omnidirectional image is specified by specifying the recording time and a monitoring area to be noted for the recorded image. A monitoring image developed in plan view with a specified orientation is obtained from the image, and thus, the pan / tilt effect on the monitoring area is obtained by going back in time, in other words, going back to the past. A monitoring image of an arbitrary attention point is appropriately obtained while preventing omission of monitoring for the entire target region.

  In the technique of Patent Document 2, an imaging unit that uses a wide-angle lens or a convex mirror capable of capturing an omnidirectional image, and the omnidirectional image captured by the imaging unit is recorded as compressed still data in time series as compressed data. An omnidirectional monitoring camera apparatus comprising: a recording unit; and an image conversion unit that converts the omnidirectional image into an image having a normal angle of view by a non-linear resolution conversion process, wherein the image conversion unit is configured to capture the photographic unit during shooting. The omnidirectional image photographed in the above is input, and at the time of reproduction, the omnidirectional image developed from the compressed data recorded in the recording means is input.

Japanese Patent Laying-Open No. 2005-286820 (see paragraph 0007 and FIGS. 1 to 3) JP 2005-303340 A

  However, each of the above techniques has a problem in that there is no clear solution for a case where the resolution of the video on the outer periphery of the imaging area of the omnidirectional imaging screen is rough.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide an imaging monitoring screen capable of obtaining a clear image even when the resolution of the video on the outer periphery of the imaging area of the omnidirectional imaging screen is rough. The object is to provide an omnidirectional imaging screen monitoring system.

According to the omnidirectional imaging screen monitoring system of the present invention, the problem is that the first imaging means fixed to be capable of capturing at least one omnidirectional as a moving image and the first imaging means fixed to be capable of capturing as at least one moving image. Two imaging means, a recording means for recording a moving image taken by the first imaging means and the second imaging means, a control means for controlling the recording means, the first imaging means, and the second Imaging means, and display means for displaying the imaging from the recording means, and the second imaging means is arranged at a position for imaging the outer periphery of the imaging area of the first imaging means. Solved.
With this configuration, since the first imaging unit has a coarse and dense image resolution at the center and end surface (outer periphery of the imaging area) of the imaging range, the second imaging unit additionally captures the image of the end surface. It is possible to perform omnidirectional imaging with the first imaging means on the same time axis, and the rough portion of the imaging range end face of the first imaging means is supplemented with the second imaging means to provide a clear image It becomes possible.
Since the display means for displaying the image from the first image pickup means, the second image pickup means, and the recording means is provided, the live image from the first image pickup means and the second image pickup means, the recording from the recording means. The recorded image file can be reproduced and displayed by the video and the control means.

  It is preferable that the second imaging means is an auto zoom camera. As a result, the part is zoomed up by autofocus, and a change in the image and the characteristics of the person can be captured more clearly.

  At least the first imaging means is fixed by an imaging means installation housing, the imaging means installation housing has an imaging means mounting bracket disposed therein, and the imaging means mounting bracket has a mounting angle of the imaging means. It is preferable that it can be freely set and is slidable in the vertical direction of the imaging axis, whereby the imaging means can freely set the mounting position. With this configuration, it is possible to reduce the influence of disturbance light as much as possible.

  According to the imaging monitoring screen of the present invention, the subject is an imaging monitoring screen used in the omnidirectional imaging screen monitoring system according to any one of claims 1 to 3, wherein the imaging monitoring screen is The first imaging means, the second imaging means, and the display means for displaying the imaging from the recording means, and the display means includes an imaging display area and an operation area, The imaging display area includes a display area for the video imaged by the first imaging means, a display area for the video imaged by the second imaging means for imaging the outer periphery of the imaging area of the first imaging means, and Is displayed adjacent to each other.

  With this configuration, it is possible to provide a clear image by compensating for a rough portion of the imaging range end face of the first imaging means on the same time axis on the imaging monitoring screen.

The present invention has the following effects.
Even if the resolution of the image of the first imaging unit capable of omnidirectional imaging is coarse, it is possible to additionally capture a coarse image with the second imaging unit, and imaging with the first imaging unit on the same time axis It is possible to provide a clear image by supplementing the rough portion of the range end surface with the second imaging means.
The recorded image file can be reproduced and displayed by the live image from the first imaging means, the second imaging means, the recorded video from the recording means, and the control means. In addition, since there are few imaging means, the number of attachment points is reduced, and at the same time, the cost can be reduced.
This part can be zoomed up by auto-focusing so that changes in images and human characteristics can be captured more clearly.
Furthermore, since the imaging means mounting bracket is used, the influence of disturbance light can be minimized.
Further, on the imaging monitoring screen, it is possible to compensate for the rough portion of the imaging range end face of the first imaging means on the same time axis and provide a clear image.
As described above, the “invisible part” can be obtained by capturing a wide range of offices in all directions, such as being able to display nearby and distant objects simultaneously, which was not possible with conventional omnidirectional imaging screen monitoring systems. Is overwhelmingly reduced.

It is a basic composition explanatory view of the omnidirectional imaging screen monitoring system concerning the present invention. It is an external view of the housing for imaging means installation. It is explanatory drawing of the attachment format of a 1st imaging means. It is a figure of the state which divided | segmented the camera housing. It is explanatory drawing of the attachment metal fitting of a 1st imaging means. It is a figure which shows the example of a change of the housing for imaging means installation. It is a figure of the state which divided | segmented the camera housing of the example of a change. It is explanatory drawing of the attachment metal fitting of the example of a change. It is a figure which shows the installation format of the camera which can image omnidirectionally. It is explanatory drawing of the imaging display area and operation area of an imaging monitoring screen. It is explanatory drawing of a video set setting screen. It is explanatory drawing of the image | video displayed on an imaging display area (the 1). It is explanatory drawing of the image | video displayed on an imaging display area (the 2). It is explanatory drawing of the image | video displayed on an imaging display area (the 3). It is explanatory drawing of the image | video displayed on an imaging display area (the 4). It is explanatory drawing of the image | video displayed on an imaging display area (the 5). It is explanatory drawing of the image | video displayed on an imaging display area (the 6). It is a figure regarding the division mode of an imaging display area. It is a figure which shows the procedure which displays the image | video of an imaging means on an imaging monitoring screen. It is a figure which shows an example of the image | video displayed on an imaging display area. It is explanatory drawing of the process which superimposes the image | video of a 1st image pickup means, and the image | video of a 2nd image pickup means. It is a figure which shows the modification of the image | video displayed on an imaging display area. It is basic composition explanatory drawing of the omnidirectional imaging screen monitoring system which concerns on a modification.

Hereinafter, an embodiment (this embodiment) of the present invention will be described with reference to the drawings. It should be noted that members, arrangements, and the like described below do not limit the present invention, and it goes without saying that various modifications can be made in accordance with the spirit of the present invention.
FIGS. 1 to 17 relate to the present invention, FIG. 1 is an explanatory diagram of the basic configuration of an omnidirectional imaging screen monitoring system according to the present invention, FIG. 2 is an external view of an imaging means installation housing, and FIG. FIG. 4 is a diagram illustrating a state in which the camera housing is divided, FIG. 5 is a diagram illustrating a mounting bracket for the first image capturing device, and FIG. 6 illustrates a modification example of the housing for installing the image capturing device. FIGS. 7A and 7B are diagrams showing a state in which the camera housing of the modified example is divided, FIG. 8 is an explanatory diagram of the mounting bracket of the modified example, and FIGS. 9A and 9B show the installation type of the camera capable of omnidirectional imaging. 10 and 10 are explanatory diagrams of the imaging display area and the operation area of the imaging monitoring screen, FIG. 11 is an explanatory diagram of the video set setting screen, FIGS. 12A to 12F are explanatory diagrams of videos displayed in the imaging display area, and FIG. Is a diagram related to the division mode of the imaging display area 4 is a diagram illustrating a procedure for displaying the image of the imaging unit on the imaging monitoring screen, FIG. 15 is a diagram illustrating an example of the image displayed in the imaging display area, and FIG. 16 is a diagram illustrating the image of the first imaging unit and the second imaging. FIG. 17 is a diagram illustrating a modified example of the image displayed in the imaging display area, and FIG. 18 is a diagram illustrating the basic configuration of the omnidirectional imaging screen monitoring system according to the modified example. .

<< Configuration of Omnidirectional Imaging Screen Monitoring System of Present Embodiment >>
First, a schematic configuration of the omnidirectional imaging screen monitoring system S of the present embodiment will be described with reference to FIGS. As shown in FIG. 1, the omnidirectional imaging screen monitoring system S of the present embodiment includes a first imaging unit 10, a second imaging unit 20, a recording unit 30, a control unit 40, and a display unit 50. Are provided as main components. Hereinafter, these means will be described individually.

<First imaging means>
The first imaging means 10 of the present embodiment uses a fixed camera that can image all directions as a moving image. This omnidirectional image-capable camera as the first image capturing means 10 is an image capturing means having a wide angle lens (or fisheye lens) or a convex mirror and having an angle of view of about 360 ° in the horizontal direction / 180 ° in the vertical direction. Then, an omnidirectional image (capable of 360 ° in the horizontal direction and 180 ° in the vertical direction) and an omnidirectional image are taken as wide-angle captured images by an omnidirectional imaging camera fixed to the ceiling or wall surface. In particular, the omnidirectional imaging screen monitoring system S of the present embodiment employs a megapixel IP camera with an omnidirectional lens mounted as the first imaging means 10, thereby enabling video monitoring without blind spots. To do.

  The omnidirectional camera capable of taking an omnidirectional image as the first image pickup means 10 picks up an image through the dome-shaped transparent cover 12 while being housed in a substantially barrel-shaped camera housing 11 having the appearance shown in FIG. . The camera housing 11 is an imaging means installation housing, and the one shown in FIG. 2 is for outdoor use. Further, the camera housing 11 is fixed to a ceiling or a wall via a fixed frame 15, and FIG. 3 illustrates an aspect in which the camera housing 11 is fixed to the ceiling.

  Hereinafter, the camera housing 11 fixed to the ceiling so that the height direction matches the vertical direction (vertical direction) will be described as an example. When the omnidirectional imaging camera is installed on the ceiling, if the ceiling height is 2.6 m, a circular range with a diameter of 10 m centering on the omnidirectional imaging camera is the recommended imaging range, and the ceiling When the height is 5 m, a recommended range is a circular range having a diameter of 20 m.

  As shown in FIG. 4, the camera housing 11 shown in FIG. 2 can be divided into a lower side portion 13 (side on which the transparent cover 12 is provided) and an upper side portion 14 in the height direction. In addition, an attachment table 16 to which the omnidirectional imaging camera is attached via the imaging means mounting brackets 17a and 17b shown in FIG. As shown in FIG. 5, a pair of imaging means mounting brackets 17a and 17b are provided, and each has a substantially L-shaped cross-sectional shape. The pair of imaging means mounting brackets 17a and 17b sandwich and support an omnidirectional imaging camera.

  Here, the omnidirectional imaging camera is attached to the imaging means mounting brackets 17a and 17b by, for example, bolts and nuts. At the time of mounting, the mounting angle of the omnidirectional imaging camera to the imaging means mounting brackets 17a and 17b ( It is possible to adjust the rotation angle when rotating around the bolt.

  That is, during the mounting operation, the omnidirectional imaging camera is tilted with respect to the imaging means mounting brackets 17a and 17b, and the imaging means mounting brackets 17a and 17b are tightened with bolts and nuts while the omnidirectional imaging camera is tilted to a desired angle. An omnidirectional camera is fastened. Thus, in this embodiment, the imaging means mounting brackets 17a and 17b are disposed inside the imaging means installation housing, and the mounting angle of the first imaging means can be freely set by the imaging means mounting brackets 17a and 17b. It is configured to be configurable.

  Furthermore, in this embodiment, the mounting position of the omnidirectional camera capable of imaging with respect to the imaging means mounting brackets 17a and 17b can be adjusted in the height direction of the camera housing 11 (the direction indicated by the arrow in FIG. 5). . That is, during the mounting operation, the omnidirectional imaging camera sandwiched between the imaging means mounting brackets 17a and 17b is slid to the desired position along the height direction, and then all the cameras are captured at the position. Fix the camera capable of azimuth imaging with bolts and nuts. That is, in the present embodiment, the imaging axis (the optical axis of the imaging engineering system) is configured to be slidable in the vertical direction, and this makes it possible to freely set the mounting position of the omnidirectional imaging camera. .

  As described above, the omnidirectional imaging camera which is the first imaging unit 10 can freely set the mounting angle and the mounting position by the imaging unit mounting brackets 17a and 17b provided in the camera housing 11. It has become. That is, in the present embodiment, the fixing method of the omnidirectional imaging capable camera is devised so as to minimize the influence of disturbance light during imaging by the omnidirectional imaging capable camera.

  The above configuration has been described by taking the outdoor camera housing 11 as an example, but it can also be applied to the indoor camera housing 111 (an example of an imaging means installation housing) shown in FIG. . That is, the indoor camera housing 111 can be divided as shown in FIG. 7, and the imaging means mounting brackets 117a and 117b shown in FIG. 8 are arranged therein, and the imaging means mounting bracket 117a. , 117b may be configured to freely set the mounting angle and mounting position of the omnidirectional imaging camera.

  6 corresponds to FIG. 2, FIG. 7 corresponds to FIG. 4, and FIG. 8 corresponds to FIG. 5, and each part of the indoor camera housing 111 (for example, the transparent cover 112, the lower part 113, the upper part 114). The mounting table 116 and the imaging means mounting brackets 117a and 117b) have the same basic configuration as that of the outdoor camera housing 11, and thus the description of the configuration is omitted.

  In addition, the above configuration has been described by taking an example of a camera that can be omnidirectionally imaged installed on the ceiling. However, the omnidirectional imageable camera is not limited to being installed on the ceiling. As shown to 9B, it is also possible to install on a wall, a floor, and a desktop, and also to embed in a ceiling, a wall, and a floor (desktop). And even if it is a style other than installing on the ceiling, by providing an imaging means mounting bracket in the imaging means installation housing, by making it possible to freely set the mounting angle and mounting position of the omnidirectional imaging camera, It is possible to avoid the influence of ambient light during imaging.

<Second imaging means>
The second imaging unit 20 of the present embodiment is fixed so as to be able to capture an image as a moving image, and is mainly fixed toward a rough imaging location of the first imaging unit 10. More specifically, in general, in an omnidirectional camera capable of imaging, the resolution of the image appears at the center and the end surface (outer periphery of the imaging area) of the imaging range. Make up with means. For this purpose, the second imaging unit 20 is arranged at a position for imaging the outer periphery of the imaging area of the first imaging unit 10.

  In the present embodiment, two fixed cameras as the second imaging unit 20 are installed for one omnidirectional camera capable of imaging. However, the number of fixed cameras is not limited to two, and at least one fixed camera may be provided.

  As described above, in the omnidirectional camera capable of being omnidirectionally imaged as the first image pickup means 10, the resolution of the image appears at the center and end face (outer periphery of the image pickup area) of the image pickup range. By performing additional imaging with the fixed camera as the imaging means 20, it is possible to compensate for the rough portion of the end face of the camera imaging range that can be imaged in all directions on the same time axis and provide a clear image.

  In the present embodiment, as the fixed camera serving as the second imaging means 20, a fixed IP camera (a network camera conforming to the TCP / IP communication protocol), pan, tilt and zoom (pan, tilt, zoom, Hereinafter, it is preferable to use an IP camera compatible with PTZ), particularly an auto zoom camera (a camera having an auto zoom function).

  By disposing an auto zoom camera as a fixed camera as the second image pickup means 20, a setting area condition is added to the image at the entrance, exit, etc., and the portion is partially zoomed up by auto focus, and the change of the image and the person It becomes the structure which can image the feature etc. more clearly.

  More specifically, for example, when the lobby or entrance of a building is captured with an omnidirectional camera, the images of the entrance and exit (elevator, stairs, or counter) are the end faces of the imaging area (the outer periphery of the imaging area) Will be located. At such a position, as described above, the resolution of the video becomes coarse. On the other hand, from the viewpoint of security and the like, when a person enters and exits, the image of the entrance / exit located on the end face of the imaging area is important in identifying the person.

  Here, if the image of the entrance / exit located on the end face of the imaging area is additionally imaged with a fixed camera, the omnidirectional imaging can be performed on the same time axis. it can. Furthermore, by disposing an auto-zoom camera as a fixed camera that is the second imaging unit 20, it is possible to expand the imaging area of the fixed camera.

  In other words, if an auto-zoom camera is used as a fixed camera, it is possible to automatically zoom in on a person when entering or exiting by setting a specific setting area such as an entrance or exit as zoom-in conditions. As a result, it is possible to capture clearer images of the characteristics of the person entering and leaving the building, thereby appropriately managing the entry and exit of the building.

<Recording means>
The recording unit 30 of the present embodiment records and saves (that is, records) video (moving image) captured by the first imaging unit 10 and the second imaging unit 20 as data. In this embodiment, a digital video recorder (Digital
video Recorder (hereinafter referred to as DVR), and a known technique can be used for the DVR itself. In the following description, a configuration using a hybrid DVR (hereinafter referred to as a hybrid recorder) as the recording means 30 will be described as an example.

  As shown in FIG. 1, the recording unit 30 includes an omnidirectional imaging camera that is a first imaging unit 10 and a second imaging unit via a POE switching hub 60 (a kind of hub that is a relay device of a network). A fixed camera which is means 20 is connected. Further, as described above, in this embodiment, one set of the first omnidirectional camera capable of imaging and two fixed cameras is set, and in this embodiment, the hybrid recorder as the recording means 30 has a maximum Two sets can be connected.

  Here, since it is possible for the user to freely set the number of sets connected to the hybrid recorder to one set or two sets, in FIG. 1, one of the two sets is indicated by a broken line. (The same applies to FIG. 17).

  Furthermore, in the present embodiment, a recording screen display monitor 32 is connected to the hybrid recorder, and the recorded video recorded by the hybrid recorder can be confirmed on the monitor 32.

<Control means>
The control means 40 of this embodiment is a device connected to the first imaging means 10, the second imaging means 20, and the recording means 30 via the POE switching hub 60. PC)), and controls the first imaging means 10, the second imaging means 20, and the recording means 30. More specifically, the control unit 60 causes the first imaging unit 10 and the second imaging unit 20 to capture an image and records the captured image data in the recording unit 30, or the first imaging unit 10 and the second imaging unit 20. The imaging data of the second imaging unit 20 is output to the display unit 50 described later, or PTZ control is performed on the video of the omnidirectional imaging camera or the PTZ IP camera.

  Further, the control means 40 can also perform panorama development display when displaying the imaging data (live video and playback video) of the omnidirectional imaging capable camera on the display means 50. Further, when an auto-zoom camera is employed as the second imaging unit 20, the control unit 40 uses a preset setting area within the range captured by the auto-zoom camera as a zoom-up condition, and a person or the like is set in the setting area. When the is entered, the setting area portion is partially enlarged automatically by autofocus.

  The configuration of the control means 40 that performs the above-described control will be described. Various storage devices such as a CPU, RAM, ROM, HDD, CD / DVD, and BL, and an input unit such as a mouse are provided. The above-described control is performed by reading and executing the program stored in. The above program is viewer software that displays an omnidirectional video (spherical video) from an omnidirectional camera, and is hereinafter referred to as an omnidirectional camera application.

  The omnidirectional camera application controls the omnidirectional imaging camera, fixed camera, and hybrid recorder connected to the control means 40 via the POE switching hub 60, and the video captured by each camera is converted into digital data as a hybrid recorder. In addition to storing the data, live video and recorded video data are received via the network through communication with the hybrid recorder.

<Display means>
The display means 50 of the present embodiment displays the images taken from the first imaging means 10, the second imaging means 20, and the recording means 30. In particular, the display means 50 of the present embodiment can display file video, live video, and recorded video. The file video is a video based on a video file stored on a PC that is the control means 40 or a video based on a video file stored on a server (not shown) that can communicate with the PC via a network. A live image is a live image captured by an omnidirectional camera and a fixed camera. The recorded video is a video displayed by reproducing the recorded data recorded in the hybrid recorder which is the recording means 30.

  The display unit 50 includes a known display (specifically, a high-definition monitor with an HDMI terminal), and is connected to the control unit 40 to display the imaging monitoring screen SMG shown in FIG. .

  Next, the imaging monitoring screen SMG will be described in detail. The imaging monitoring screen SMG is a screen for displaying the imaging from the first imaging means 10, the second imaging means 20, and the recording means 30, and more specifically, by executing an omnidirectional camera application. FIG. 11 is an expanded window shown in FIG. 10.

  The window (that is, the imaging monitoring screen SMG) includes an imaging display area R1 and an operation area R2. The imaging display area R <b> 1 is a view area for displaying video captured by the omnidirectional imaging camera that is the first imaging unit 10, video captured by the fixed camera that is the second imaging unit 20, and the like.

  In addition, when simultaneously displaying the video imaged by the omnidirectional camera and the video imaged by the fixed camera, the display area of the video imaged by the omnidirectional camera (specifically, the following description is given) 1 area R1a) and a display area (specifically, a second area R1b and a third area R1c, which will be described later) are displayed adjacent to each other (for example, FIGS. 12D to 12D). 12F).

  As described above, in the omnidirectional camera capable of imaging, the resolution of the image is coarse and dense at the center and the end surface (outer periphery of the imaging area) of the imaging range. Therefore, in this embodiment, the end surface image is additionally captured by the fixed camera. It is possible to compensate for the rough portion of the end face of the imaging range of the camera capable of omnidirectional imaging on the same time axis and provide a clear image.

  For example, if the lobby or entrance of a building is imaged with an omnidirectional camera, the images of the entrance and exit (elevator, stairs, or counter) are placed on the end face of the imaging area. This is because the image of the entrance / exit located on the end face of the imaging area is important in order to identify the person when going in / out. Although the entire image captured by an omnidirectional camera has a wide imaging range, as described above, the resolution of the image at the edge of the area is rough, so the characteristics of the person can be characterized by clear images captured by a fixed camera that can ensure the resolution. By capturing, people can be identified, and their flow lines and actions become clear.

  Furthermore, by displaying the video imaged by the omnidirectional camera and the video imaged by the fixed camera in the adjacent display area, the supervisor (that is, the user of the omnidirectional imaging screen monitoring system S) can When viewing a display area where video captured by an omnidirectional camera is displayed, and when it is recognized that a person has come to the end face of the imaging range of the omnidirectional camera In contrast to the area (display area of the video imaged by the fixed camera), it becomes possible to immediately recognize the characteristics of the person (face shape, etc.).

  In this embodiment, as described above, one set of the omnidirectional camera and two fixed cameras is set, and a maximum of two sets can be connected to the hybrid recorder as the recording means 30. Is possible. When two sets of hybrid recorders are connected, the panoramic video obtained by panoramic development of the omnidirectional video (spherical video) of one of the two cameras capable of omnidirectional imaging in the imaging display area R1. And a fixed camera image that is set together with the omnidirectional imaging camera on the selected side.

  The operation area R2 is a GUI providing area for accepting an operation performed by the user regarding the display in the imaging display area R1. The operations performed by the user include a video type selection operation for selecting the type of video to be displayed in the imaging display area R1, a screen division determination operation for determining screen division in the imaging display area R1, and an omnidirectional imaging camera. There are PTZ operations for PZT control of video. When these operations are accepted in the operation area R2, the omnidirectional camera application executes processing corresponding to the above operations in cooperation with the CPU of the PC that is the control means 40.

  The above operation may be performed by clicking a button or tab in the operation area R2 described later with a mouse, or when the display means 50 is a touch pad of a PDF terminal, the touch panel. It is good also as performing by the touch operation with respect to.

  Hereinafter, buttons and tabs provided in the operation area R2 will be described with reference to FIG. The video type tab R2a is provided to select the type of video to be displayed in the imaging display area R1, and specifically, one of file video, live video, and recorded video is selected.

  The reproduction video designation button R2b is for designating a video file and date / time to be displayed in the imaging display area R1. More specifically, when the playback video designation button R2b is pressed, a file selection screen (or video selection screen) (not shown) is displayed, and the file name of the video to be displayed or the video is captured on the screen. Specify the date and time. When a live video is selected on the video type tab R2a, the playback video designation button R2b is not displayed and cannot be operated.

  The division determination button R2c is provided for determining screen division in the imaging display region R1. More specifically, in the present embodiment, when only the image of one omnidirectional image-capable camera is displayed (hereinafter, omnidirectional display), one omnidirectional imageable camera and two fixed cameras are displayed. There are cases where both images are displayed (hereinafter, combined display). As the division determination button R2c for omnidirectional display, a 1-division display button c1, a 2-division display button c2, and a 4-division display button c3 are provided.

  When the one-division display button c1 is pressed, as shown in FIG. 12A, the spherical image of the omnidirectional image-capable camera is displayed in the entire imaging display region R1. That is, in the one-segment display, the spherical image is displayed without dividing the area. Note that in one-division display, one omnidirectional imaging camera can be displayed and controlled as one PTZ camera.

  When the two-divided display button c2 is pressed, as shown in FIG. 12B, the imaging display region R1 is vertically divided into two, and a panoramic image obtained by expanding the spherical image into a panorama is displayed on each divided screen. When the quadrant display button c3 is pressed, as shown in FIG. 12C, the imaging display region R1 is divided into four, and the spherical image and the three panoramic images obtained by expanding the panorama of the spherical image are respectively displayed on the corresponding divided screens. Is displayed. In the 4-split display, one omnidirectional imaging camera can be virtually realized as four PTZ cameras, and PTZ control can be performed on each of the divided videos.

  On the other hand, as the division determination button R2c for composite display, a first composite display button c4, a second composite display button c5, and a third composite display button c6 are provided. When these three buttons are pressed, the imaging display area R1 includes a first area R1a having a length corresponding to 2/3 of the entire width of the imaging display area R1 from the left end of the imaging display area R1, and a first area. The first region R1a is adjacent to the region adjacent to R1a. The region adjacent to the first region R1a is composed of two regions partitioned in the vertical direction. The region located on the upper side is the second region R1b, and the region located on the lower side is the third region R1c. To do.

  When the first composite display button c4 is pressed, as shown in FIG. 12D, a spherical image is displayed on the entire first region R1a, and two units are displayed on the second region R1b and the third region R1c. Each image of the fixed camera is displayed. When the second composite display button c5 is pressed, as shown in FIG. 12E, two panoramic images obtained by expanding the spherical image into a panorama are displayed in the first region R1a, and the second region R1b and the third region R1c are displayed. Displays the images of each of the two fixed cameras. When the third composite display button c6 is pressed, as shown in FIG. 12F, a spherical image and three panoramic images obtained by expanding the spherical image are displayed in the first region R1a and two fixed images are displayed. Each image of the camera is displayed in the second region R1b and the third region R1c.

  The video set selection button R2d is for selecting one video set from video sets preset by the user. Here, the video set is associated with which camera video is displayed on each divided screen of the imaging display region R1 divided by the operation of the division determination button R2c.

  More specifically, the user can set a video set on the setting screen STG shown in FIG. In the setting screen STG in FIG. 6, the user decides which camera is assigned to the display video channel of the hybrid recorder that is communicably connected to the PC that is the control means 40, and inputs the input fields d1, d2, and so on. Enter the camera number in d3.

  Here, the number of display video channels of the hybrid recorder is a fixed number (3 in this embodiment), and input fields d1, d2, and d3 are provided for each channel. For example, the input field d1 corresponds to channel 1 among the display video channels of the hybrid recorder, and the video of the camera assigned to channel 1 is displayed in the first region R1a described above. Similarly, the input field d2 corresponds to channel 2, the video of the camera assigned to channel 2 is displayed in the above-described second region R1b, and the input field d3 corresponds to channel 3. The video of the camera assigned to channel 3 is displayed in the third region R1c described above.

  More specifically, in a configuration in which two sets of omnidirectional imaging cameras and two fixed cameras are connected to the hybrid recorder, the number of the omnidirectional imaging capable camera belonging to one set is 1. The numbers of the two fixed cameras belonging to the same set are 2 and 3, the numbers of the omnidirectional imaging cameras belonging to the other set are 4, and the numbers of the two fixed cameras belonging to the same set are 5 and 6. Then, the number 1 is input into the input field d1, the number 2 is input into the input field d2, and the number 3 is input into the input field d3 to set the video set. When such a video set is selected, the video of the omnidirectional camera belonging to one set is displayed in the first area R1a of the imaging display area R1, and two cameras belonging to the same set are displayed in the second area R1b and the third area Rlc. Images of each of the fixed cameras are displayed.

  Similarly, when a number 4 is input in the input field d1, a number 5 is input in the input field d2, a number 6 is input in the input field d3, and a video set is set, when the video set is selected, the imaging display The image of the omnidirectional camera belonging to the other set is displayed in the first region R1a of the region R1, and the images of the two fixed cameras belonging to the same set are displayed in the second region R1b and the third region Rlc. Is done.

  If the camera number is not input in the input fields d1, d2, and d3, no video is displayed for the uninputted fields in the input fields d1, d2, and d3. In the present embodiment, as shown in FIG. 10, it is possible to register a video set of up to 8 patterns. However, the maximum number of registrations is not limited to 8 patterns, and any number can be registered. Can be set.

  The playback control button R2e is used to control video playback such as playback / pause, rewind, and fast forward. The still image acquisition button R2f is used to capture a playback video when the button R2f is pressed as a still image file. These two buttons R2e and R2f are not displayed and cannot be operated while the live video is displayed.

  The PTZ button R2g is used for PTZ control of images from an omnidirectional camera, and more specifically, the PT buttons g1, g2, g3, and g4 are used for executing a pan operation and a tilt operation. Z buttons g5 and g6 are zoom buttons. For example, when the PTZ button R2g is operated while a live video is being displayed, the omnidirectional camera capable of performing the PTZ operation according to the button operation. On the other hand, when the PTZ button R2g is operated during the display of the file video or the recorded video, the PTZ process corresponding to the button operation is performed on the video of the omnidirectional imaging camera, and as a result, the display video is displayed as the PTZ. It will be changed to the contents after processing.

  The video set setting button R2h is provided for setting the above-described video set. When the button R2h is pressed, the above setting screen STG is displayed, and the camera number is displayed in the input fields d1, d2, and d3. Can be input.

  The end button R2i is for closing the imaging monitoring screen SMG and ending the omnidirectional camera application. That is, when the end button R2i is pressed, the video display of each camera is ended. When the omnidirectional camera application is terminated by the end button R2i, the state immediately before that is saved, and when the application is started next time, the state immediately before is resumed. Here, the contents for each video set are to be saved, and specifically, all the setting items performed in the operation area R2 such as the setting items related to the photographing monitoring screen SMG and the PTZ state are stored.

  The imaging monitoring screen SMG configured as described above is displayed on the display means 50, and any one of the file video, live video, and recorded video is displayed in the imaging display area R1 of the imaging monitoring screen SMG. And imaging display area R1 is divided | segmented according to either of six types of division modes.

  That is, in the omnidirectional camera application, as shown in FIG. 13, an omnidirectional display pattern that displays only the image of one omnidirectional image mountable camera in the imaging display area R1, and one omnidirectional imageable camera A composite display pattern that displays images from both of the two fixed cameras can be selected.

  Furthermore, in the omnidirectional display pattern, a one-division display mode for displaying an omnidirectional image (spherical image) of an omnidirectional image-capable camera, and a two-division display mode for displaying two panoramic images obtained by panoramic development of a spherical image; A 4-split display mode for displaying a spherical image and three panoramic images can be selected.

  On the other hand, in the composite display pattern, an image of an omnidirectional camera is displayed in the first region R1a, and images of each of the two fixed cameras are displayed in the second region R1b and the third region R1c. There are three modes depending on the format of the video displayed in the region R1a. More specifically, a first composite display mode for displaying one omnidirectional image (spherical image) of an omnidirectional image-capable camera, a second composite display mode for displaying a spherical image and two panoramic images, and a spherical surface A third composite display mode for displaying video and three panoramic videos can be selected.

  In each mode, if one of the divided screens (unit area when the imaging display area R1 is subdivided by the number corresponding to the division mode) is specified by a mouse click operation or the like, the designation is made. The split screen becomes active. In the present embodiment, for example, when a mouse double-click operation is performed on this active divided screen, the active divided screen is displayed in full screen (displayed in the entire imaging display region R1). ). The full screen display state is canceled by, for example, pressing the “Esc” key on the keyboard, and the original display state is restored.

  Furthermore, in this embodiment, when one of the divided screens is in the active state, for example, by rotating the mouse wheel, the video displayed on the divided screen is zoomed up / down. For example, when the mouse pointer is placed on the active split screen and the mouse pointer is dragged while pressing the left mouse button, the video displayed on the split screen is panned in the drag direction. Or come to tilt.

  As described above, in this embodiment, when one of the divided screens is in the active state, the PTZ control is performed on the camera image displayed on the divided screen by executing a predetermined mouse operation. Is possible.

  By the way, assuming a composite display that displays images from both one omnidirectional imaging camera and two fixed cameras, it is suitable to use a 16: 9 ratio display as the display means 50. Further, the video ratio (that is, the size and ratio of the imaging display area R1) will be described in more detail. The video ratio is affected by the resolution of the display. On the other hand, the video displayed in the imaging display region R1 is based on a ratio according to the resolution of the camera video.

  More specifically, with regard to the video display range (portion in which video is actually displayed) in the imaging display area R1, an appropriate range in which the video can be displayed at the largest size in the selected display format is automatically set. Calculate and set to a range according to the calculation result. This range is an actual video display area based on the camera resolution ratio.

<< Video display on imaging monitoring screen >>
Next, in the omnidirectional imaging screen monitoring system S configured as described above, a procedure for displaying the images of the omnidirectional imaging camera and the fixed camera on the imaging monitoring screen SMG will be described with reference to FIG.

  In displaying an image on the imaging monitoring screen SMG, first, the omnidirectional camera application is activated (S001), and the imaging monitoring screen SMG is displayed on the display means 50. In this embodiment, in conjunction with the activation of the omnidirectional camera application, the omnidirectional imaging capable camera, fixed camera, hybrid recorder, and incidental devices of these devices operate, and imaging by the camera and recording of the imaging data ( Recording) starts. During normal monitoring, the wide-angle imaging data of the omnidirectional imaging camera that is the first imaging unit 10 is recorded in the recording unit 30, and at the same time, the imaging of the omnidirectional imaging camera is recorded on the recording screen display monitor 32. indicate.

  Next, on the imaging monitoring screen SMG, a button and a tab provided in the operation area R2 are operated to perform a video display preparation process. Specifically, the video type tab R2a is operated to select the type of video to be displayed in the imaging display area R1 (S002). When a file video or a recorded video is selected as the display video (“file video” or “recorded video” in S002), the playback video designation button R2b is pressed thereafter, and a file selection screen (or video selection not shown) is selected. Screen) specifies the file and date / time of the video to be displayed in the imaging display area R1 (S003).

  Next, one of the image set selection buttons R2d is selected (S004). By this selection operation, the combination of video images of the camera to be displayed in the imaging display area R1 is determined. Thereafter, the division determination button R2c is operated to determine the screen division in the imaging display region R1 (S005).

Here, in the video set selected in step S004, the combination of the division determination buttons R2c that can be operated changes depending on the relationship between the display video channel of the hybrid recorder and the camera assigned to the display video channel. come. More specifically, the relationship between the display video channel and the cameras assigned to the display video channel is the following four patterns.
(1) When a camera capable of omnidirectional imaging is assigned to channel 1 and a fixed camera is assigned to at least one of channels 2 and 3, (2) A camera capable of omnidirectional imaging is assigned to channel 1, and channel 2 3 when no camera is assigned (3) When a fixed camera is assigned to channel 1 and when a fixed camera is assigned to at least one of channels 2 and 3 (4) Channel 1 If a fixed camera is assigned to and no camera is assigned to either channel 2 or 3

  When the video set having the pattern (1) is selected, all of the division determination buttons R2c are displayed as selectable buttons. In the pattern (2), only the division determination button R2c for omnidirectional display (specifically, the 1-division display button c1, the 2-division display button c2, and the 4-division display button c3) among the division decision buttons R2c. Displayed as selectable buttons. In the pattern (3), only the 1-division display button c1 and the first composite display button c4 are displayed as selectable buttons among the division determination buttons R2c. In the pattern (4), only the one-division display button c1 is displayed as a selectable button.

  When the division determination button R2c is operated, the imaging display area R1 is divided in a format based on the operation, and a corresponding video is displayed on each divided screen (S006). For example, when the image set having the pattern (1) is selected and the third composite display button c6 is pressed, the spherical image and the spherical image of the camera capable of omnidirectional imaging are displayed as shown in FIG. The three panoramic images developed in the panorama are displayed in the first region R1a of the imaging display region R1, and the images of the two fixed cameras are displayed in the second region R1b and the third region R1c.

  Thereafter, the video display on the imaging monitoring screen SMG continues until the end button R2i is operated, and ends when the end button R2i is pressed (S007). When the PTZ button R2g is operated while the video display on the imaging monitoring screen SMG is continued (S008), the video of the omnidirectional imaging camera is controlled based on the operation (S009). Thereafter, the video display on the imaging monitoring screen SMG is continuously performed with the contents after the control (specifically, the orientation, tilt, etc. of the camera).

<< Modified example of omnidirectional imaging screen monitoring system >>
Hereinafter, first to third modified examples will be described as modified examples of the omnidirectional imaging screen monitoring system S. In the configuration of each modified example, the same reference numerals are given to the same members, arrangements, devices, and the like as those in the above-described embodiment (this example), and detailed description thereof will be omitted.

<First Modification>
The omnidirectional imaging screen management system S according to the first modification is substantially the same as this example in terms of the device configuration. On the other hand, as shown in FIG. 16, the omnidirectional camera application of the first modified example has a second area in a specific area when the panoramic image is captured by the omnidirectional camera capable of being the first imaging unit 10. It is possible to superimpose clear images captured by a fixed camera (PTZ type IP camera or IP camera) that is the imaging means 20. That is, the first modified example is different from the present example in that it is possible to superimpose a higher-resolution image of the fixed camera on the digital zoom image of the omnidirectional camera capable of imaging.

  Furthermore, in the first embodiment, when a fixed camera is linked to the image of the designated area captured by the omnidirectional camera, and the omnidirectional camera is zoomed to the designated area in the live image, the fixed image is fixed to the digital zoom image. It is possible to display images simultaneously by superimposing camera images.

  As described above, as the configuration of the imaging display area R1, as in the present example, the display area (first area R1a) for displaying the spherical image of the omnidirectional imaging camera and the display for displaying the image of the fixed camera are displayed. In addition to a mode in which the regions (second region R1b, third region R1c) are arranged as individual regions, the high resolution image of the fixed camera is included in the spherical image of the omnidirectional camera as in the first modification. It is conceivable to superimpose the two. Therefore, as shown in FIG. 17, when the video of the omnidirectional image displayable camera is displayed in the imaging display area R1 (that is, during execution of the omnidirectional display pattern), By superimposing the video of the fixed camera on the range of the specific area, an imaging display area consisting of the display area of the video captured by the omnidirectional imaging camera and the display area of the video captured by the fixed camera is configured. Will be.

<Second Modification>
As shown in FIG. 17, in the omnidirectional imaging screen management system S according to the second modification, the PC as the control means 40 has a giga switching hub (a switching port corresponding to 1000BASE-T / 100BASE-TX / 10BASE-T). A maximum of four recording units 30 (specifically, hybrid recorders) are connected via a switching hub 70 equipped with a plurality of ports. Note that the number of connected hybrid recorders is not limited to four, and can be arbitrarily set.

  Each of the plurality of hybrid recorders connected to the giga switching hub 70 is connected to the hybrid recorder via the POE switching hub 60 under the control of the video surveillance control device 80 connected to each hybrid recorder via the giga switching hub 70. Record the video of the camera you are using. Also, each hybrid recorder can be connected to a maximum of two sets of omnidirectional imaging cameras and two fixed cameras as in this example.

  And the omnidirectional camera application which concerns on a 2nd modification communicates with the designated hybrid recorder among the some hybrid recorders connected to PC which is the control means 40, and the image | video of the camera connected to this hybrid recorder Are displayed in the imaging display area R1 of the imaging monitoring screen SMG. More specifically, in the imaging display area R1, the hybrid recorder is provided for a panoramic video in which a spherical video of an omnidirectional imaging camera connected to a designated hybrid recorder is panorama developed and a specific area in the panoramic video. And an image captured by a fixed camera connected to the.

  The designation of the hybrid recorder is performed when the above-described video set is set. Specifically, on the setting screen STG shown in FIG. 11, information for designating the hybrid recorder is input to the input fields t1, t2, t3, and t4. More specifically, the IP address of the hybrid recorder to be designated is input in the input field t1, the port number is input in the input field t2, the login ID is input in the input field t3, and the login password is input in the input field t4.

  As described above, in the second modified example, since a plurality of hybrid recorders are connected to the PC that is the control means 40, the number of cameras that can display video on the display means 50 is increased. As a result, it is possible to monitor a plurality of areas with a single control means 40.

<Third Modification>
The omnidirectional imaging screen management system S according to the third modification is substantially the same as the second modification in terms of the device configuration. That is, in the third modified example, the PC as the control means 40 is connected to a maximum of four hybrid recorders via the giga switching hub 70, and each hybrid recorder includes an omnidirectional camera and two cameras. Up to two sets of fixed cameras can be connected.

  On the other hand, the omnidirectional camera application of the third modified example has a fixed camera (IP) connected to the hybrid recorder in a specific area when the panoramic image of the omnidirectional imageable camera connected to the designated hybrid recorder is developed. It is possible to superimpose clear images from the camera. That is, the third modification is an embodiment in which the function of the omnidirectional camera application in the first modification is added to the configuration according to the second modification.

  Furthermore, in the third modification, as in the first modification, when displaying a live video on the imaging monitoring screen SMG, it is possible to superimpose the video by linking the PTZ position to the designated area of the omnidirectional camera. It is.

<Fourth Modification>
In the above embodiment, an auto-zoom camera is employed as the second image pickup means 20, so that, for example, when a person enters or exits a building, the person is automatically zoomed in, and the person's The feature can be clearly imaged, and the entrance / exit management of the building is appropriately performed. However, depending on the specification of the fixed camera, when the fixed camera is zoomed up, the recording target video of the fixed camera may become a video after zooming up. In such a case, if a recorded video is to be confirmed at a later date, the video of the fixed camera that can be displayed on the imaging monitoring screen SMG becomes the video after zooming up, and it is impossible to display a video with a wider range than the zoomed up state. In particular, when displaying the recorded video on the imaging monitoring screen SMG, when superimposing the fixed camera image on the spherical image of the omnidirectional imaging camera, if the imaging range of the fixed camera fluctuates due to the zoom operation, the omnidirectional imaging is performed. In the image captured by the camera, the range where the image of the fixed camera is overlapped with the image captured by the fixed camera will not match.

  As described above, if you perform a zoom operation on a fixed camera, when you try to check the recorded video at a later date, you will not be able to see a wider range of images as a fixed camera image than when zoomed up. Therefore, the zoom operation may not be intentionally performed for the fixed camera.

<< Effectiveness of Imaging Monitoring Screen and Omnidirectional Imaging Screen Monitoring System According to Present Invention >>
As described above, according to the imaging monitoring screen and the omnidirectional imaging screen monitoring system according to the present invention, simple operation is possible with the feeling of operating a normal personal computer, and the user is not used to the system. You can easily operate.
Furthermore, by adopting a dual display system, it is possible to separate image data management of multiple cameras and multi-eye image management, and it is possible to instantaneously monitor an image to be viewed.
And, it is a flexible device configuration, the scene where importance is placed on live is an existing camera, the place where high-quality video is required is a megapixel camera, and if it is necessary to use a network camera, a free device such as a network camera Configuration is possible.

10 first imaging means, 11 camera housing, 12 transparent cover,
13 Lower side, 14 Upper side, 15 Fixed frame, 16 Mounting table,
17a, 17b Imaging means mounting bracket,
20 second imaging means, 30 recording means, 32 recording screen display monitor,
40 control means, 50 display means,
60 POE switching hub, 70 giga switching hub,
80 video surveillance control device,
111 camera housing, 112 transparent cover, 113 lower side,
114 upper part, 116 mounting table,
117a, 117b Imaging means mounting bracket,
S Omnidirectional imaging screen monitoring system,
R1 imaging display area, R1a first area, R1b second area, R1c third area,
R2 operation area, R2a video type tab, R2b playback video designation button,
R2c division determination button, R2d video set selection button,
R2e playback control button, R2f still image acquisition button,
R2g PTZ button, R2h video set setting button, R2i end button,
SMG imaging monitoring screen, STG setting screen,
c1 1 split display button, c2 2 split display button, c3 4 split display button,
c4 first composite display button, c5 second composite display button, c6 third composite display button,
d1, d2, d3 input fields,
g1, g2, g3, g4 PT button, g5, g6 Z button,
t1, t2, t3, t4 input fields

Claims (4)

A fixed first imaging unit capable of capturing at least one omnidirectional image as a moving image, a fixed second imaging unit capable of capturing an image as at least one moving image, the first imaging unit, and the second imaging unit Recording means for recording a moving image imaged by the imaging means, control means for controlling the recording means, the first imaging means, the second imaging means, and display means for displaying the imaging from the recording means; With
The omnidirectional imaging screen monitoring system, wherein the second imaging unit is arranged at a position for imaging an outer periphery of an imaging region of the first imaging unit.   The omnidirectional imaging screen monitoring system according to claim 1, wherein the second imaging means is an auto zoom camera.   At least the first imaging means is fixed by an imaging means installation housing, the imaging means installation housing has an imaging means mounting bracket disposed therein, and the imaging means mounting bracket has a mounting angle of the imaging means. The omnidirectional imaging screen according to claim 1, wherein the omnidirectional imaging screen can be freely set and is slidable in the vertical direction of the imaging axis, whereby the imaging means can freely set the mounting position. Monitoring system. An imaging monitoring screen used in the omnidirectional imaging screen monitoring system according to any one of claims 1 to 3,
The imaging monitoring screen is displayed on the display means for displaying the imaging from the first imaging means, the second imaging means, and the recording means. The display means includes an imaging display area and An operation area,
The imaging display area includes a display area for images captured by the first imaging means and a display area for images captured by the second imaging means that captures the outer periphery of the imaging area of the first imaging means. An imaging monitoring screen characterized by being displayed adjacent to each other.

Images