JP2011155686A - Camera control system and method, and storage medium storing operation processing program therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To quickly control a camera to a desired operation state.
In a camera control system capable of controlling the imaging direction and zoom magnification of a camera, an imageable area display means for displaying an imageable area of the camera by controlling the imaging direction of the camera; Instruction means for designating two points on the imageable area displayed by the imageable area display means and instructing control of the imaging direction and zoom magnification of the camera based on the position and distance of the designated two points; And when the distance between the designated two points is less than a predetermined value, the instruction means instructs control only in the imaging direction of the camera based on the position of the designated two points. To do.
[Selection] Figure 1

Description

  The present invention relates to a camera control system suitable for use in, for example, a monitoring camera for monitoring a remote place.

  In recent years, systems capable of controlling panning, tilting, and zooming of cameras installed at remote locations from a monitoring terminal via a network are becoming widespread, and monitoring capability is improving. In such a monitoring system, for example, there is a configuration for displaying a camera control window as shown in FIG. 9 on the monitor on the monitoring terminal side. This camera control window includes a system including a video display area output from a remote camera and a camera control button disposed below the video display area. Then, when the user clicks each camera control button with a pointing device such as a mouse, panning, tilting and zooming of the remote camera are controlled.

  An object of the present invention is to provide a user interface that further improves the operability related to camera control as described above.

  In order to achieve the above-described object, the camera control system of the present invention has, for example, the following configuration. That is, in a camera control system capable of controlling the imaging direction and zoom magnification of a camera, display control means for displaying an imageable area indicating an area that can be imaged by the camera, and the imaging capability displayed by the display control means If a rectangle passing through two points designated on the area and the diagonal length of the rectangle having a predetermined aspect ratio is equal to or greater than a predetermined value, the diagonal point of the rectangle and the diagonal point of the imaging range of the camera are Is a rectangle that passes through two designated points on the imageable area, and the length of the diagonal line in the rectangle having the predetermined aspect ratio is the predetermined value. And an instruction means for giving an instruction to control the zoom magnification to a predetermined zoom magnification.

  ADVANTAGE OF THE INVENTION According to this invention, the user interface which further improved the operativity regarding control of a camera can be provided.

1 is a block diagram of a camera control system of the present embodiment. The figure which shows an example of a video display window. The figure which shows an example of a camera operation window. The operation | movement process flowchart of the terminal device of this Embodiment. The figure which shows the example of a movement of the scope 301. FIG. The figure for demonstrating the movement process of the scope 301. FIG. The operation | movement process flowchart of the terminal device of this Embodiment. The figure which shows the example of a movement of the scope 301. FIG. The figure which shows an example of the conventional camera operation window.

  Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

(First embodiment)
FIG. 1 is a schematic block diagram of the camera control system of the present embodiment.

  The terminal device 100 includes a personal computer or the like, and has the following configuration in detail.

  The CPU 101 performs overall control of the terminal device 100 as a whole. The main storage unit 102 is composed of a RAM, the external storage device 103 is composed of a removable storage medium such as a floppy disk or a CD-ROM, and the secondary storage device 104 is composed of a hard disk or the like. The mouse 105 functions as a pointing device. Reference numeral 106 denotes a keyboard. The I / F 107 transmits a control signal to the remote camera control device 110 and receives an image signal and camera control information captured by the camera 111 from the camera control device 110. The monitor 109 displays an image display window for displaying an image captured by the camera 111 and a camera operation window for performing a camera operation. The system bus 112 connects the components in the terminal device 100 described above to each other.

  On the other hand, the camera control device 110 connected to the terminal device 100 via a network such as the Internet compresses video information with an A / D conversion function that converts an analog video signal output from the camera 111 into a digital signal. A video compression function. Further, the camera control device 110 controls the camera 111 based on the camera control signal output from the terminal device 100. The camera 111 has a pan head, and based on a control signal from the camera control device, the imaging direction can be changed, and the zoom magnification and focus can be changed.

  FIG. 2 shows an image display window displayed on the monitor 109. The image display window includes an image display unit 201 that displays an image captured by the camera 111, a scroll bar 202a for operating the camera 111 in the pan direction, and a scroll bar for operating the tilt direction of the camera 111. 202b, a scroll bar 202c for controlling the zoom magnification of the camera 111, and the like.

  FIGS. 3A and 3B both show camera operation windows displayed on the monitor 109.

  An area 300 indicates an area that can be imaged by the camera 111 by performing pan, tilt, and zoom driving. An area (hereinafter referred to as a scope) 301 indicates the current imaging range of the camera 111. The vertical direction of the scope 301 indicates the field angle range of the camera 111 in the vertical direction, and the horizontal direction indicates the field angle range in the horizontal direction. The center of the scope 301 indicates the direction of the current imaging optical axis of the camera 111. Note that the vertical / horizontal ratio of the scope depends on the standard received from the camera 111, but is set to 4: 3 in the present embodiment. An area 302 indicates a range in which the imaging optical axis (center of the captured image) of the camera can be changed. The cursor 303 can be moved by a mouse operation, and the position and size of the scope 301 can be changed.

  In the area 300 in FIG. 3A, nothing is displayed in the area, but as shown in FIG. 3B, a panoramic image is displayed using the image captured by the camera 111 in the area 300. It is also possible to improve the operability by displaying.

  The operation on the camera 111 can also be executed using the camera operation window shown in FIGS. In this case, the imaging direction of the camera 111 can be operated by changing the position of the scope 301 in the region 300 using the mouse 105 or the like, and the zoom magnification of the camera 111 can be changed by changing the size of the scope 301. Can be operated.

  As described above, the operator can open the camera operation window and execute the operation of the camera 111 as necessary. In this case, the image display window and the camera operation window are simultaneously displayed on the screen of the monitor 109. It will be.

  FIG. 4 is a flowchart for generating a control command for the camera 111 by the CPU 101. 5A to 5C show the display on the camera operation window when the position and size of the scope 301 for executing the operation of the camera 111 are changed.

  First, in S101, it is determined whether or not a mouse down operation has been executed by the user. If it is determined that the mouse down operation has been executed, the position on the area 300 when the mouse down operation is executed is designated as the first position. (FIG. 5A).

  Here, the horizontal direction of the region 300 is the x axis, the vertical direction is the y axis, the coordinates of the first position are (x1, y1), and the coordinates indicated by the cursor 303 during mouse dragging are (x, y) in S102. ) And a rectangle indicated by a dotted line is displayed (FIG. 5B). Then, it is determined whether or not | x−x1 | / | y−y1 | ≧ 4/3. If | x−x1 | / | yy1 | ≧ 4/3, the process proceeds to S103. If | x−x1 | / | y−y1 | ≧ 4/3, the process proceeds to S104.

  In S103, as shown in FIG. 6A, the line segment connecting (x1, y1) and (x, y1-3 / 4 (x-x1)) is a diagonal line (or (x1, y1) and ( The rectangle connecting the line connecting x, y1 + 3/4 (x−x1)) with a diagonal line is displayed with a dotted line.

  In S104, as shown in FIG. 6B, the line segment connecting (x1, y1) and (x1 + 4/3 (y−y1), y) is a diagonal line (or (x1, y1) and (x1−y1)). The rectangle connecting the line connecting 4/3 (y-y1) and y) with a diagonal line is displayed with a dotted line.

  The dotted rectangles shown in S103 and S104 indicate areas where the position and size of the scope 103 are to be changed when the mouse is moved up at that time. As described above, since the scope 301 does not have to be precisely aligned with the drag position of the cursor 303 within the range of the aspect ratio 3: 4 captured by the camera 111, the operation is easy.

  In S105, it is determined whether or not the mouse drag has been released and a mouse up operation has been performed. When it is determined that the mouse up operation has been performed, a rectangle displayed as a dotted line is displayed as a solid line in S103 and S104, and the rectangle is defined as the scope 301. The first position (x1, y1) located at the end point of the diagonal line of the scope 301 and the end point located on the opposite side are defined as the second position (x2, y2).

  In S <b> 106, it is determined whether or not the center of the scope 301 exists in the area 302. When the center does not exist within the region 302, that is, when the position of the scope 103 exceeds the imaging range of the camera 111, the process proceeds to (1).

  FIG. 7 is a flowchart of the subroutine (1). 8A to 8C show display examples of the camera operation panel.

  First, in S <b> 201, it is determined whether or not the center of the scope 301 exists in the area 302. If it is determined that the center does not exist in the region 302 (FIG. 8A), the center of the scope 301 is moved to a position in the region 302 closest to the center of the scope 301 (FIG. 8B). .

  Further, in S202, it is determined whether or not the entire area of the scope 301 immediately before moving in the process of S201 exists in the area of the scope 301 after moving. On the other hand, if it is determined that the center of the scope 301 immediately before the movement does not exist within the area of the scope 301 after the movement, the process proceeds to S203, the scope 301 is enlarged, and the process returns to S202.

  If it is determined that the center of the scope 301 immediately before moving is within the area of the scope 301 after moving, the process proceeds to S114.

  Here, the process returns to S106 again. However, if the center of the scope 301 exists in the region 302, the process proceeds to S107.

  In S107, when the length l of the diagonal line of the scope 301 is less than l1, the process proceeds to S108, and it is determined that the positions of the mouse down and the mouse up are substantially the same. That is, it is determined that the operation is simply a mouse click, and in this case, the scope size is not changed, and the center point of the diagonal line is moved to the center of the scope 301 (that is, only the shooting direction of the camera 111). Is changed and the camera zoom magnification is maintained). Then, the process proceeds to S114.

  When the length l of the diagonal line of the scope 301 is 11 or more, the process proceeds to S109. In S109, when the length l of the diagonal line of the scope 301 is l1 ≦ l <l2 (l2 is the length of the diagonal line of the scope 301 when the camera 111 is at the maximum telephoto), the process proceeds to S110.

  In S110, the center point of the diagonal line is moved to be the center of the scope 301, and the scope 301 is enlarged so that the length of the diagonal line becomes l2 (that is, the shooting direction of the camera 111 is changed). , The zoom magnification is changed to the maximum telephoto). Then, the process proceeds to S114.

  In S109, when the length l of the diagonal line of the scope 301 is not l1 ≦ l <l2, the process proceeds to S111.

  In S111, when the length l of the diagonal line of the scope 301 is equal to or greater than l3 (l2 is the length of the diagonal line of the scope 301 when the camera 111 has the maximum wide angle), the process proceeds to S112.

  In S112, the center point of the diagonal line is moved to the center of the scope 301, and the scope 301 is further reduced in size so that the length of the diagonal line becomes l3 (that is, the shooting direction of the camera 111 is changed). , The zoom magnification is changed to the maximum wide angle). Then, the process proceeds to S114.

  In S109, when the length l of the diagonal line of the scope 301 is equal to or smaller than l3, that is, when l2 ≦ l ≦ l3, the process proceeds to S113. In S113, the rectangle displayed with a solid line in S105 is used as the area of the scope 301 as it is. Then, the process proceeds to S114.

  In S114, based on the changed position and size of the scope 301, a pan, tilt, and zoom control command for the camera 111 is generated (that is, the camera corresponding to the midpoint position of the first and second positions). 111, the zoom magnification is controlled so that the first and second positions are diagonal points of the imaging range of the camera in proportion to the distance between the first and second positions. And output to the camera control device 110.

  As described above, even if the first position and the second position specified by the operator are unsuitable for the control of the camera 111, the scope 301 desired by the operator within the controllable range of the camera 111. Since the scope is automatically changed so as to be as close as possible to the position and size, the operability is greatly improved.

  In addition to the above-described embodiment, the size of a rectangle displayed as a dotted line as a candidate for the scope 301 displayed during the drag operation of the mouse 105 as shown in S103 or S104 is the zoom magnification of the camera 111. By limiting so as to correspond to the control range, the actual imageable range may be visually shown to the operator. In this case, the length l of the rectangular diagonal line displayed as a dotted line is limited to l2 ≦ l ≦ l3, and the diagonal line has one end point at the first position (x1, y1).

  In the above-described embodiment, after the first position (x1, y1) is specified, the cursor 303 can be freely moved on the area 300. However, in the other embodiments, the first position After designating (x1, y1), the movement region of the cursor 303 may be limited so as to correspond to the aspect ratio of the imaging range of the camera 111. That is, when the aspect ratio of the imaging range of the camera 111 is 3: 4, the cursor 303 moves on y−y1 = ± 3/4 (x−x1). In this way, it becomes easy to change the size of the scope 301.

  As an example, the present invention supplies a recording medium that records software program codes for realizing the functions of the above-described embodiments to a system or apparatus, and the computer (or CPU or MPU) of the system or apparatus stores the recording medium. This can be achieved by reading and executing the stored program code.

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention.

  As a storage medium for supplying the program code, for example, a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CDR, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) operating on the computer based on the instruction of the program code. A case where part or all of the actual processing is performed and the functions of the above-described embodiments are realized by the processing is also included.

  Further, after the program code read from the storage medium is written to the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. The CPU or the like provided in the board or the function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing. When the present invention is applied to the storage medium, the program code corresponding to the flowchart described above is stored in the storage medium, but in brief, it is an indispensable module for the camera control system of the present invention. Is stored in a storage medium.

100 Terminal device 101 CPU
102 Main memory 103 External memory 104 Secondary memory 105 Mouse 106 Keyboard 107 I / F
108 Video Board 109 Monitor 110 Camera Control Device 111 Camera 300 Imageable Area 301 Scope

Claims (24)

In a camera control system that can control the imaging direction and zoom magnification of the camera,
Display control means for displaying an imageable area indicating an area that can be imaged by the camera;
If the rectangle passing through the two points designated on the imageable area displayed by the display control means and the length of the diagonal line in the rectangle having a predetermined aspect ratio is greater than or equal to a predetermined value, the diagonal point of the rectangle Is a rectangle that passes through the two designated points on the imageable area, instructing control of the zoom magnification of the camera so as to correspond to the diagonal points of the imaging range of the camera, the predetermined aspect ratio The camera control system further comprising: an instruction unit that instructs to control the zoom magnification to a predetermined zoom magnification when the length of the diagonal line in the rectangle is less than the predetermined value.   The display control means is a rectangle passing through two points designated on the imageable area, and the rectangle having the predetermined aspect ratio is displayed before the instruction means instructs the zoom magnification control. The camera control system according to claim 1, wherein the camera control system is displayed on the imageable area.   The instruction means gives an instruction to control the zoom magnification to the maximum magnification when the length of the diagonal line of the rectangle having the predetermined aspect ratio is less than the predetermined value. The camera control system according to claim 1.   The instruction means instructs the control of the imaging direction of the camera so that the position of the middle point of the rectangle having the predetermined aspect ratio is a rectangle passing through the two specified points and becomes the optical axis of the camera. The camera control system according to claim 1. In a camera control system that can control the imaging direction and zoom magnification of the camera,
Display control means for displaying an imageable area indicating an area that can be imaged by the camera;
If the rectangle passing through the two points designated on the imageable area displayed by the display control means and the length of the diagonal line in the rectangle having a predetermined aspect ratio is less than a predetermined value, the diagonal point of the rectangle Is a rectangle that passes through the two designated points on the imageable area, instructing control of the zoom magnification of the camera so as to correspond to the diagonal points of the imaging range of the camera, the predetermined aspect ratio The camera control system comprising: an instruction unit that instructs to control the zoom magnification to a predetermined zoom magnification when the length of the diagonal line in the rectangle is equal to or greater than the predetermined value.   The display control means is a rectangle passing through two points designated on the imageable area, and the rectangle having the predetermined aspect ratio is displayed before the instruction means instructs the zoom magnification control. 6. The camera control system according to claim 5, wherein the camera control system is displayed on an imageable area.   The instruction means gives an instruction to control the zoom magnification to the lowest magnification when the length of the diagonal line of the rectangle having the predetermined aspect ratio is equal to or greater than the predetermined value. The camera control system according to claim 5.   The instruction means instructs the control of the imaging direction of the camera so that the position of the middle point of the rectangle having the predetermined aspect ratio is a rectangle passing through the two specified points and becomes the optical axis of the camera. The camera control system according to claim 5. In a camera control method that enables control of the imaging direction and zoom magnification of a camera,
A display control step of displaying an imageable area indicating an area that can be imaged by the camera;
If the rectangle passing through the two points designated on the imageable area displayed by the display control step and the length of the diagonal line in the rectangle having a predetermined aspect ratio is greater than or equal to a predetermined value, the diagonal point of the rectangle Is a rectangle that passes through the two designated points on the imageable area, instructing control of the zoom magnification of the camera so as to correspond to the diagonal points of the imaging range of the camera, the predetermined aspect ratio An instruction step of giving an instruction to control the zoom magnification to a predetermined zoom magnification when the length of the diagonal line in the rectangle is less than a predetermined value.   The display control step is a rectangle passing through two points designated on the imageable area, and the rectangle having the predetermined aspect ratio is displayed before the instruction step instructs the zoom magnification control. The camera control method according to claim 9, wherein display is performed on an imageable area.   In the instruction step, if the length of the diagonal line of the rectangle having the predetermined aspect ratio is less than the predetermined value, the instruction to control the zoom magnification to the maximum magnification is performed. The camera control method according to claim 9.   The instructing step instructs the control of the imaging direction of the camera so that the position of the middle point of the rectangle having the predetermined aspect ratio is a rectangle passing through the two specified points and becomes the optical axis of the camera. The camera control method according to claim 9. In a camera control method that enables control of the imaging direction and zoom magnification of a camera,
A display control step of displaying an imageable area indicating an area that can be imaged by the camera;
If the rectangle passing through the two points designated on the imageable area displayed by the display control step and the length of the diagonal line in the rectangle having a predetermined aspect ratio is less than a predetermined value, the diagonal point of the rectangle Is a rectangle that passes through the two designated points on the imageable area, instructing control of the zoom magnification of the camera so as to correspond to the diagonal points of the imaging range of the camera, the predetermined aspect ratio And an instruction step of giving an instruction to control the zoom magnification to a predetermined zoom magnification when the length of the diagonal line in the rectangle is equal to or greater than a predetermined value.   The display control step is a rectangle passing through two points designated on the imageable area, and the rectangle having the predetermined aspect ratio is displayed before the instruction means instructs the zoom magnification control. The camera control system according to claim 13, wherein the camera control system is displayed on an imageable area.   The instruction step is an instruction to control the zoom magnification to the lowest magnification when the rectangle passing through the two specified points and the diagonal length of the rectangle having the predetermined aspect ratio is equal to or greater than the predetermined value. The camera control method according to claim 13.   The instructing step instructs the control of the imaging direction of the camera so that the position of the middle point of the rectangle having the predetermined aspect ratio is a rectangle passing through the two specified points and becomes the optical axis of the camera. The camera control method according to claim 13. To a computer that can control the imaging direction and zoom magnification of the camera,
A display control procedure for displaying an imageable region indicating an imageable region of the camera;
A rectangle passing through two points designated on the imageable area displayed by the display control procedure, and the diagonal length of the rectangle having a predetermined aspect ratio is equal to or greater than a predetermined value, the diagonal point of the rectangle Is a rectangle that passes through the two designated points on the imageable area, instructing control of the zoom magnification of the camera so as to correspond to the diagonal points of the imaging range of the camera, the predetermined aspect ratio A computer-readable storage medium storing a program for executing an instruction procedure for instructing to control the zoom magnification to a predetermined zoom magnification when the length of a diagonal line in the rectangle is less than the predetermined value .   The display control procedure is a rectangle passing through two points designated on the imageable area, and the rectangle having the predetermined aspect ratio is displayed before the instruction procedure instructs the zoom magnification control. The storage medium according to claim 17, wherein the storage medium is displayed on an imageable area.   The instruction procedure executes an instruction to control the zoom magnification to the maximum magnification when the rectangle passing through the two specified points and the diagonal length of the rectangle having the predetermined aspect ratio is less than the predetermined value. The storage medium according to claim 17, wherein:   The instruction procedure is to execute control of the imaging direction of the camera so that the position of the middle point of the rectangle having the predetermined aspect ratio is a rectangle passing through the two specified points and is the optical axis of the camera. The storage medium according to claim 17. To a computer that can control the imaging direction and zoom magnification of the camera,
A display control procedure for displaying an imageable region indicating an imageable region of the camera;
If the rectangle passing through the two points designated on the imageable area displayed by the display control procedure has a diagonal length less than a predetermined value in a rectangle having a predetermined aspect ratio, the diagonal point of the rectangle Is a rectangle that passes through the two designated points on the imageable area, instructing control of the zoom magnification of the camera so as to correspond to the diagonal points of the imaging range of the camera, the predetermined aspect ratio A computer-readable storage medium storing a program for executing an instruction procedure for instructing to control the zoom magnification to a predetermined zoom magnification when the length of a diagonal line in the rectangle is equal to or greater than the predetermined value .   The display control procedure is a rectangle passing through two points designated on the imageable area, and the rectangle having the predetermined aspect ratio is displayed before the instruction procedure instructs the zoom magnification control. The storage medium according to claim 21, wherein the storage medium is displayed on an imageable area.   The instruction procedure executes an instruction to control the zoom magnification to the lowest magnification when the rectangle passing through the two specified points and the diagonal length of the rectangle having the predetermined aspect ratio is less than the predetermined value. The storage medium according to claim 21, wherein:   The instruction procedure instructs the control of the imaging direction of the camera so that the position of the middle point of the rectangle having the predetermined aspect ratio is a rectangle passing through the two specified points and becomes the optical axis of the camera. The storage medium according to claim 21, wherein:

Images