JP2010166218A - Camera system and method of controlling the same - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a camera system easily operating a plurality of cameras; and to provide a method of controlling the same. <P>SOLUTION: The camera system includes a master camera, a conversion device, one or more drive devices, and one or more slave cameras. The master camera picks up a motion picture, and detects an operation parameter related to an operation from the outside to transmit the operation parameter to the conversion device. The conversion device converts the operation parameter transmitted from the master camera into drive parameters for each slave camera to transmit the drive parameters to the drive devices of the one or more corresponding slave cameras. The one or more drive devices drive the corresponding slave cameras based on the drive parameters transmitted from the conversion device. The one or more slave cameras are operated in response to drive of the corresponding drive devices. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a camera system that controls a plurality of cameras simultaneously.

  Conventionally, in order to realize a stereoscopic moving image such as a stereoscopic method by actual shooting, it is necessary to capture slightly different moving images corresponding to the left and right eyes of a human. As these photographic equipment, a stereo camera or the like in which two small cameras are bonded side by side has already been developed. A stereoscopic moving image is, for example, a moving image obtained by superimposing moving images of two small cameras that are bonded side by side, and shows a stereoscopic moving image to a person wearing predetermined glasses. It was made to be able to.

  On the other hand, in the field of moving images, as a technique for combining moving images taken by a plurality of cameras into one combined moving image, a method of inlay combining by electrical processing such as chroma key has been established. It is widely used.

  As a combination of synthesized moving images by the method of inset synthesis, a moving image by computer graphics or the like is generally used in addition to a real moving image. In order to make a synthesized moving image as a result of synthesizing these moving images natural, it is necessary to match various shooting parameters with respect to camera movements, including the angle of view of each moving image.

  For example, in order to match various shooting parameters with respect to the movement of the camera, a composite image generation shooting system applied to shooting when images shot by a plurality of camera units are combined to generate a single combined image. Thus, a technique for controlling a plurality of camera units so as to perform the same operation based on signals transmitted from a common controller has been proposed (see, for example, Patent Document 1).

  On the other hand, drawing technology by computer graphics (a kind of virtual reality) is rapidly progressing. For example, in the field of movies and packaged video works, computers based on moving images by computer graphics and moving images of live action are used. Synthetic moving images based on graphics are common. Also in the field of stereoscopic moving images, moving images based on computer graphics are becoming mainstream.

JP 2004-297283 A

  However, in order to shoot stereoscopic moving images such as stereoscopic images, special special equipment is required and there are many optical restrictions due to the mechanical conditions of lenses and the like, so that general planar moving images (composite moving images) are required. Image) at the same time, and a natural moving image by a general television photographing technique cannot be easily expressed.

  Further, in the case of the above-described stereo camera or the like, two image pickup devices and lenses, that is, the interval between two viewpoints is fixed, and a wide stereo expression and three-dimensionality can be obtained by taking an interval between any two viewpoints. There is a problem that it is not possible to flexibly cope with the movement of the subject at the time of shooting.

  On the other hand, in the field of synthesized moving images, in any of a plurality of cameras, the angle of view and focus position (zoom, focus) due to lens operation, and movement of the optical axis in the vertical and horizontal directions due to pan head operation (rotation angle, There is no system that easily synchronizes elevation angle), pan head height change, movement, and the like.

  That is, as shown in Patent Document 1 described above, at present, a plurality of electric pan heads and electric lenses can be operated from a single operation terminal (remote controller or the like) by remote control using various electric servo technologies. By transmitting the same command, it is possible to shoot a plurality of live-action moving images having the same shooting parameters.

  However, in the above-mentioned Patent Document 1, it is difficult to reflect normal camera operation (camera work) that a human like a cameraman has on a moving image captured by a plurality of other cameras at the same time. There is a problem in that it is impossible to directly reflect a natural moving image expression such as panning, tilting, focusing, trimming, and the like by the television photographing technique as it is.

  In addition to the above-mentioned Patent Document 1, for example, by using a specially designed equipment, when a movement of one camera is stored and played back on the camera or another camera, or when one camera is operated, it is already There are systems where a single camera works in the same way.

  However, in the above-mentioned system, the camera and pan head are specialized for the system. Therefore, when there are two cameras, including installation and operation methods, the installation location and method of each camera, communication control connection However, there are many restrictions, and there is a problem that it cannot be shared with general photography equipment. In the above-described system, basically, a command for performing the same operation is recorded and reproduced, and as a result, it is transmitted as it is to the lens and pan head of another camera as it is. There is a problem that it cannot be applied to photographing stereoscopic moving images such as stereoscopic images in which a subtle difference in parameters is required for each image.

  The present invention has been made in consideration of the above points, and proposes a camera system that can easily operate a plurality of cameras and a control method thereof.

  In order to solve such a problem, in the present invention, a camera system includes a master camera, a conversion device, one or a plurality of driving devices, and one or a plurality of slave cameras, and the master camera is a moving image. An image is taken and an operation parameter related to an operation from the outside is detected and transmitted to the conversion device, and the conversion device uses the operation parameter transmitted from the master camera as a drive parameter for each slave camera. Converting and transmitting to the corresponding one or more slave camera drive devices, and the one or more drive devices drive the corresponding slave camera based on the drive parameters transmitted from the conversion device One or a plurality of the slave cameras operate in response to driving by the corresponding driving device. To.

  According to the present invention, there is provided a control method for a camera system including a master camera, a conversion device, one or more drive devices, and one or more slave cameras, wherein the master camera captures a moving image. And a first step of detecting an operation parameter related to an operation from the outside and transmitting the operation parameter to the conversion device, and the conversion device drives the operation parameter transmitted from the master camera for each slave camera. A second step of converting to a parameter and transmitting to the corresponding one or more slave camera drive devices, and one or more of the drive devices based on the drive parameters transmitted from the conversion device, A third step of driving the corresponding slave camera and one or a plurality of the slave cameras correspond to the corresponding drive; Characterized in that it comprises a fourth step of operation in response to the driving of the device.

  Therefore, the slave camera is synchronized with the master camera based on the normal camera operation (camera work) performed by the human in the master camera, not directly by the human being with respect to the slave camera, or the mechanical operation of the so-called remote control camera. Thus, a natural moving image expression by the master camera and the slave camera can be reflected in real time on the entire area of the synthesized moving image (stereoscopic moving image).

  In addition, since the positional relationship between the master camera and slave camera can be set freely, for example, the viewpoint expression of giant creatures such as dinosaurs, stereoscopic exaggeration expression on subjects located at a long distance from the camera, and large zooming operation Various expression methods can be taken.

  ADVANTAGE OF THE INVENTION According to this invention, the camera system which can operate a some camera easily, and its control method are realizable.

It is a block diagram which shows the structure of the camera system by 1st Embodiment. It is a block diagram which shows the structure of a master camera. It is a block diagram which shows the structure of a data converter. It is a conceptual diagram with which it uses for description of the principle of the slave camera which operate | moves based on operation in a master camera. It is a flowchart with which it uses for description of the data conversion process of a data converter. It is a block diagram which shows the structure of the camera system by 2nd Embodiment. It is a block diagram which shows the structure of the camera system by 3rd Embodiment. It is a block diagram which shows the structure of the camera system by 4th Embodiment. FIG. 10 is a conceptual diagram for explaining display of a synthesized moving image when operations such as panning, tilting, focusing, and trimming are performed.

  Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. Note that the present invention is not limited thereby.

(1) 1st Embodiment FIG. 1: has shown an example of the structure of the camera system 1 by 1st Embodiment. The camera system 1 is configured by connecting a master camera 2, a slave camera 3, a data aggregation device 4, a data conversion device 5, and a drive device 6.

  FIG. 2 shows an example of the configuration of the master camera 2. The master camera 2 is configured, for example, by placing the master camera unit 2A on the camera platform 2B and the camera platform 2B on the pedestal 2C. The camera platform 2B of the master camera 2 moves the optical axis of the master camera unit 2A up, down, left and right, and the pedestal 2C of the master camera 2 changes the height of the master camera unit 2A, or the master camera unit Or move 2A.

  The master camera unit 2A of the master camera 2 includes, for example, a photographing unit 11, a control unit 12, an operation unit 23, a display unit 14, a recording unit 15, an input / output unit 16, and the like. Then, a moving image of the subject T (FIG. 1) is captured. In this case, the control unit 12 of the master camera unit 2A converts the moving image of the subject T acquired through the lens of the shooting unit 11 into a first moving image signal, for example, according to the shooting operation in the operation unit 13, A moving image based on the first moving image signal is displayed on the display unit 14, and the first moving image signal is recorded on the recording unit 15. In addition, the control unit 12 of the master camera unit 2A controls the lens of the photographing unit 11 according to the operation of the operation unit 13, for example, to zoom up or zoom out the subject T or to focus on the subject T. To do.

  Furthermore, the control unit 12 of the master camera unit 2A transmits, for example, the first moving image signal to a predetermined moving image synthesizing device via the input / output unit 16. In this case, the moving image synthesizing device creates a synthesized moving image signal of the first moving image signal and the second moving image signal based on the moving image captured by the slave camera 3, and transmits the synthesized moving image signal to the master camera 2. Alternatively, the second moving image signal based on the moving image captured by the slave camera 3 is transmitted to the master camera 2. Furthermore, when the control unit 12 of the master camera unit 2A acquires the synthesized moving image signal from the moving image synthesizing device via the input / output unit 16, the moving image based on the first moving image signal is performed according to the switching operation of the operation unit 13. And a moving image based on the second moving image signal and a synthesized moving image based on the synthesized moving image signal are switched and displayed.

  On the other hand, the imaging unit 11 of the master camera unit 2A detects the zoom operation related to the angle of view and the focus operation related to the focus position (focus distance), and also represents the first view of the angle of view in the zoom operation and the focus distance in the focus operation. The first detection sensor 17 for detecting the parameters is provided. When the first detection sensor 17 detects a zoom operation and a focus operation, the control unit 12 of the master camera unit 2A transmits the first parameter to the data aggregation device 4 via the input / output unit 16.

  In addition, the pan head 2B on which the master camera unit 2A is placed detects a moving operation in the horizontal direction of the optical axis of the master camera unit 2A and a moving operation in the vertical direction of the optical axis, and detects the left and right of the optical axis. A second detection sensor 18 that detects a second parameter representing a rotation angle in the movement operation related to the direction and an elevation angle in the movement operation related to the vertical direction of the optical axis is arranged. The second detection sensor 18 transmits a second parameter to the data aggregating device 4 when detecting a movement operation in the horizontal direction and the vertical direction of the optical axis of the master camera unit 2A.

  Further, the pedestal 2C on which the master camera unit 2A and the pan head 2B are placed detects the moving operation of the pan head 2B and the moving operation of the pan head 2B in the front-rear and left-right directions, and the pan head A third detection sensor 19 for detecting a third parameter representing the movement distance in the movement operation related to the height of 2B and the front and rear, left and right directions is arranged. The third detection sensor 19 transmits a third parameter to the data aggregating apparatus 4 when detecting a moving operation related to the height of the camera platform 2B and the front / rear / left / right direction.

  Returning to FIG. 1, the slave camera 3 is arranged at a predetermined distance d from the master camera 2 (described later), and photographs the subject T. As with the master camera 2, the slave camera 3 is configured, for example, by placing a slave camera unit on a pan head and a pedestal.

  The slave camera unit of the slave camera 3 includes, for example, an imaging unit, a control unit, an operation unit, a display unit, a recording unit, and the like. In this case, the control unit of the slave camera unit converts, for example, the moving image of the subject acquired through the lens of the shooting unit into the second moving image signal according to the shooting operation in the operation unit, and the second moving image A moving image based on the signal is displayed on the display unit, and the second moving image signal is recorded on the recording unit. In addition, the control unit of the slave camera unit controls the lens of the photographing unit, for example, according to an operation on the operation unit, and zooms in and out of the subject or focuses on the subject.

  Further, the control unit of the slave camera unit transmits, for example, the second moving image signal to a predetermined moving image synthesizing device. As a result, the moving image synthesizing apparatus creates a synthesized moving image signal of the second moving image signal and the first moving image signal based on the moving image captured by the master camera 2 and transmits the synthesized moving image signal to the master camera 2. be able to.

  Further, the slave camera 3 is configured to operate in synchronization with the operation of the master camera 2. Details of this synchronization operation will be described later.

  The data aggregating apparatus 4 is configured, for example, by connecting a CPU (Central Processing Unit), a memory, and a communication interface via an internal bus or the like. The data aggregating device 4 aggregates information on the angle of view and focus from the lens of the master camera 2 and information on the rotation angle and elevation angle from the camera platform, and outputs the data to the data conversion device 5 as serial data.

  In this case, the CPU of the data aggregation device 4 receives the first to third parameters transmitted from the input / output unit 16, the second detection sensor 18, and the third detection sensor 19 of the master camera 2 in the communication interface. Then, for example, the first to third parameters are stored in the memory. Subsequently, the CPU of the data aggregation device 4 aggregates the first to third parameters and converts the first to third parameters into serial data such as VR data (Virtual Reality data). Then, the CPU of the data aggregation device 4 transmits the VR data to the data conversion device 5 via the communication interface.

  FIG. 3 shows an example of the configuration of the data conversion device 5. For example, the data conversion device 5 is configured by connecting a CPU 21, a memory 22, an operation unit 23, a display unit 24, a first input / output unit 25, and a second input / output unit 26 via an internal bus 27 or the like. Has been.

  The data conversion apparatus 5 collects various parameters such as zoom related to the angle of view from the master camera 2, focus related to the focus position, rotation angle related to the right and left of the optical axis, and elevation angle related to the vertical direction of the optical axis as serial data from the data aggregation apparatus 4. Receive. Then, the data conversion device 5 automatically converts the lens, the pan head, and the pedestal of the photographing unit of one or a plurality of slave cameras 3 that are to be synchronized with each other as they are or according to the application and individual characteristics. Then, the slave camera 3 is controlled by outputting serial data simultaneously.

  In addition, the data conversion device 5 is configured so that the distance between the rotation center and the rotation center of the master camera 2 with respect to the lens and the pan head of the photographing unit of the one or more slave cameras 3 to be synchronized with each other, and the master Output the data simultaneously after converting it appropriately for multi-viewpoint images and stereoscopic image shooting, such as offsetting the head (optical axis) data for the top, bottom, left and right according to the focusing distance (focus position) of the camera 2 Thus, the slave camera 3 is controlled.

  On the other hand, the data conversion device 5 sends the current angle of view and focus information, the current rotation angle and elevation angle to the master camera 2 and the slave camera 3 as necessary for the purpose of obtaining the initial value of the synchronization operation. Outputs an instruction for inquiring information. Details of the initial setting process will be described later.

  The memory 22 includes a control program 31 for controlling the entire data conversion apparatus 5, a data conversion program 32 for converting VR data into appropriate data corresponding to the slave camera 3, and data corresponding to the model of the slave camera 3. A data conversion table 33 to be converted into is stored.

  The data conversion program 32 includes a first parameter that represents the angle of view in the zoom operation of the master camera 2 and the focusing distance in the focus operation, the second parameter related to the rotation angle and elevation angle of the optical axis of the master camera unit 2A, and the master camera 2. From the third parameter regarding the height of the camera platform and the horizontal movement distance, the focusing distance of the lens of the slave camera unit of the slave camera 3, the absolute and relative angles of the rotation angle and elevation angle of the optical axis, the rotation direction, the rotation speed, etc. And a conversion formula for calculating the height of the pan head of the slave camera 3 and the horizontal movement distance.

  Further, the data conversion program 32 is preliminarily input with the distance d between the master camera 2 and the slave camera 3, so that the focusing distance in the focus operation of the master camera 2 and the rotation of the optical axis of the master camera unit 2A of the master camera 2 are rotated. Based on the angle and the elevation angle, the direction and distance of the subject T from the viewpoint from the slave camera 3, that is, the focusing distance in the focus operation of the slave camera 3, the rotation angle and the elevation angle of the optical axis of the slave camera unit of the slave camera 3 Is calculated based on the conversion formula. Detailed processing of the data conversion program 32 will be described later.

  The data conversion table 33 includes, for example, a numerical value conversion table related to the angle of view, a focusing distance, a numerical value conversion table related to the height of the camera platform and the horizontal movement distance, and the like.

  Since the shooting angle of view is determined by the combination of the individual image sensor sizes of the master camera 2 and the slave camera 3 and the lens focal length, the parameters may differ between the master camera 2 and the slave camera 3. For this reason, in the data conversion device 5, a comparison table (numerical conversion table) of the shooting angle of view and the lens focal length parameter between the master camera 2 and the slave camera 3 is used for each model of the different slave camera 3 and the lens used. For each model.

  As for the focusing distance, the parameter may differ depending on the master camera 2 and the slave camera 3 as in the case of the shooting angle of view. For this reason, the data conversion device 5 has a comparison table (numerical value conversion table) of focusing distance parameters between the master camera 2 and the slave camera 3 for each model of the different slave cameras 3.

  Also, the height and horizontal movement distance of the camera platform may be different depending on the master camera 2 and the slave camera 3 as in the case of the shooting angle of view. For this reason, the data conversion device 5 has a parameter comparison table (numerical conversion table) regarding the height of the pan head and the horizontal movement distance between the master camera 2 and the slave camera 3 for each model of the different slave cameras 3. .

  The operation unit 23 is configured by an information input device such as a keyboard switch or a pointing device, for example. The display unit 24 is configured by an information output device such as a monitor display, for example. The first input / output unit 25 is connected to the data aggregation device 4 and performs reception of VR data transmitted from the data aggregation device 4, transmission / reception of various commands, and the like. The second input / output unit 26 is connected to the driving device 6 and performs transmission of driving data (described later), transmission / reception of various commands, and the like.

  In this case, when the first input / output unit 25 receives the VR data transmitted from the data aggregation device 4, the CPU 21 stores the VR data in the memory 22 by executing the control program 31, for example. Subsequently, the CPU 21 decomposes the VR data stored in the memory 22 into first to third parameters by executing the data conversion program 32. Subsequently, the CPU 21 uses a predetermined conversion formula (described later) to convert the first and second parameters into an appropriate angle of view corresponding to the slave camera 3, a first drive parameter representing the in-focus distance, and an appropriate It converts into the 2nd drive parameter showing a rotation angle and an elevation angle, and converts the 3rd parameter into the 3rd drive parameter showing the suitable amount of movement corresponding to slave camera 3. Of the first parameters, the angle of view and the third parameter are not converted by a predetermined conversion formula, but are used as they are as the first drive parameter and the third drive parameter.

  Subsequently, when the models of the master camera 2 and the slave camera 3 are different, the CPU 21 uses the data conversion table 33 to correspond to the first drive parameter and the third drive so as to correspond to the slave camera 3 of a different model. Convert parameters. Then, the CPU 21 executes the control program 31 to use the converted first to third driving parameters as driving data, and the driving data to the corresponding driving device of the slave camera 3 via the second input / output unit 26. 6 to send.

  Returning to FIG. 1, the driving device 6 is configured by connecting a CPU, a memory, and a communication interface via an internal bus or the like. The driving device 6 includes a first servo mechanism that drives the lens of the imaging unit in the slave camera unit of the slave camera 3, a second servo mechanism that drives the slave camera unit of the slave camera 3 in the vertical and horizontal directions, and the slave camera. 3 has a third servo mechanism for changing the height of the pan head 3 and driving the pan head in the front-rear and left-right directions.

  The drive device 6 is an interface device for the data output from the data conversion device 5 and the lens, pan head, and pedestal of the slave camera 3, and the received data is sent to the slave camera 3 as appropriate operation commands. To properly operate the lens, pan head and pedestal. Further, the driving device 6 collects the operation status and results of the slave camera 3 from the respective lenses and the pan head as necessary, and transmits the collected data to the data conversion device 5.

  In this case, when the CPU of the drive device 6 receives the drive data transmitted from the data conversion device 5 through the communication interface, for example, the drive data is stored in the memory. Subsequently, the CPU of the drive device 6 decomposes the drive data stored in the memory into first to third drive parameters.

  Then, the CPU of the driving device 6 drives the first servo mechanism based on the first driving parameter. As a result, the slave camera 3 is operated in the master camera 2 and the angle of view corresponding to the zoom operation of the photographing unit of the master camera unit 2A operated in the master camera 2 and the in-focus distance corresponding to the focus operation. The lens of the imaging unit of the slave camera unit is operated by an amount corresponding to the rotation angle and elevation angle corresponding to the movement operation of the optical axis of the master camera unit 2A in the horizontal direction and vertical direction using a predetermined conversion formula (described later). .

  In addition, the CPU of the driving device 6 drives the second servo mechanism based on the second driving parameter. Thereby, the slave camera 3 operates in the master camera 2, and the rotation angle and the elevation angle corresponding to the movement operation in the horizontal direction and the vertical direction of the optical axis of the master camera unit 2A, and the focus of the photographing unit of the master camera unit 2A. The head of the slave camera 3 is operated by the amount corresponding to the in-focus distance corresponding to the operation converted using a predetermined conversion formula (described later).

  Further, the CPU of the driving device 6 drives the third servo mechanism based on the third driving parameter. As a result, the slave camera 3 operates the pedestal of the slave camera 3 by the height of the camera platform operated in the master camera 2 and the horizontal movement distance corresponding to the moving operation in the front-rear and left-right directions.

  FIG. 4 explains the principle of the slave camera 3 that operates based on the operation in the master camera 2. As an example, in the initial setting, the master camera 2 and the slave camera 3 are arranged so that the optical axes of the master camera 2 and the slave camera 3 are parallel to the direction of the subject T. The master camera 2 and the slave camera 3 are arranged on the same horizontal plane so that their optical axes are horizontal and perpendicular to a line connecting the rotation centers of the two cameras. Further, the master camera 2 and the slave camera 3 are arranged so that the master camera 2 and the slave camera 3 are spaced from each other. As for the distance d, in the initial setting, the right direction is set to + and the left direction is set to − with respect to the optical axis forward from the master camera.

  The rotation angle of the master camera 2 and the slave camera 3 at this time is 0 (rad), the right (clockwise) direction is + and the left (counterclockwise) direction is − with respect to the direction of the optical axis. Further, the elevation angle of the master camera 2 and the slave camera 3 at this time is set to 0 (rad), the upward direction with respect to the vertical direction of the paper surface is the + direction, and the downward direction is the − direction. Further, the rotation angle of the master camera 2 in the subject T direction is α (rad), and the rotation angle of the slave camera 3 in the subject T direction is β (rad).

  Further, the elevation angle of the master camera 2 in the subject T direction is γm (rad), and the elevation angle of the slave camera 3 in the subject T direction is γs (rad). Further, when the master camera 2 and the slave camera 3 capture the subject T at the center of the front screen, the distance from the subject T is the same as the in-focus distance, the distance between the master camera 2 and the subject T is Lm, and the slave camera 3 is a distance between the subject T and Ls.

  Here, when the data conversion device 5 is changed to the synchronous operation state and the subject T is captured at the center of the front screen of the master camera 2 by a normal moving image shooting operation (camera work) by a human, the slave camera 3 Operates in synchronization with the master camera 2 in accordance with drive data based on the following conversion formulas (1) to (3) in the data conversion program 32 of the data conversion device 5, and places the subject T at the center of the front screen of the slave camera 3. Can be caught.

  That is, the rotation angle (β (rad)), elevation angle (γs (rad)), and focusing distance (Ls) of the slave camera 3 are set when the distance d between the master camera 2 and the slave camera 3 is set. It can be calculated based on the rotation angle (α (rad)), elevation angle (γm (rad)) and focus distance (Lm) of the master camera 2.

  A specific calculation formula will be described. First, regarding the calculation of the rotation angle β (rad) of the slave camera 3, (4) and (5) can be derived from FIG.

  Further, since the height of the master camera 2 and the slave camera 3 with respect to the subject T is the same, (6) can be derived.

  Furthermore, (7) can be derived based on (4), and (8) can be derived based on (5).

  Therefore, (9) can be derived based on (7) and (8), and (10) can be derived based on (9).

  Moreover, since (11) can be derived from FIG. 3, (11) is substituted into (10). Thereby, the conversion formula of (1) which is the rotation angle β (rad) of the slave camera 3 can be derived.

  Next, regarding the calculation of the elevation angle γs (rad) of the slave camera 3, since (12) and (13) can be derived from FIG. 3, (12) and (13) are substituted into (8). Thus, (14) can be derived.

  Further, since the height of the master camera 2 and the slave camera 3 with respect to the subject T is the same, (15) can be derived based on (6).

  Then, (16) can be derived by substituting (15) into (14) and dividing both sides by Lm. Thereby, the conversion formula of (2) which is the elevation angle γs (rad) of the slave camera 3 can be derived.

  Next, the calculation of the focusing distance (Ls) of the slave camera 3 can be derived based on (6) and (16). Thereby, the conversion formula of (3) which is the focusing distance (Ls) of the slave camera 3 can be derived.

  Thus, in the camera system 1, the first and second parameters based on the rotation angle of the master camera 2, the elevation angle of the master camera 2, the focusing distance between the master camera 2 and the subject T, and the master camera 2 and the slave camera. 3, the rotation angle of the slave camera 3, the elevation angle of the slave camera 3, and the focusing distance between the slave camera 3 and the subject T are calculated, and the rotation angle of the slave camera 3 and the elevation angle of the slave camera 3 are calculated. And it converts into the drive parameter based on the focusing distance of the slave camera 3 and the to-be-photographed object T.

  FIG. 5 is an example of a flowchart showing a specific processing procedure of the CPU 21 of the data conversion device 5 regarding the data conversion processing of the data conversion device 5 in the camera system 1.

  When the power of the data conversion device 5 is turned on, the CPU 21 of the data conversion device 5 executes the control program 31 to initialize the master camera 2 and the slave camera 3 according to the data conversion processing procedure RT1 shown in FIG. (SP1).

  In this case, the CPU 21 of the data conversion apparatus 5 first waits in the standby mode to select the initial setting mode of the master camera 2 and the slave camera 3 by operating the operation unit 23. When the initial setting mode is selected, the CPU 21 of the data conversion device 5 waits in the standby mode for the interval d between the master camera 2 and the slave camera 3 to be input by operating the operation unit 23.

  Then, when the interval d between the master camera 2 and the slave camera 3 is input, the CPU 21 of the data conversion device 5 places the master camera 2 and the slave camera 3 at the initial setting positions as shown in FIG. When the unit 23 is operated, it waits in the standby mode for notification to that effect. That is, the CPU 21 of the data conversion device 5 is arranged such that the master camera 2 and the slave camera 3 are oriented so that the optical axes of the master camera 2 and the slave camera 3 are parallel to the subject T, and on the same horizontal plane. The master camera 2 and the slave camera 3 are arranged so that the optical axes thereof are horizontal and perpendicular to the line connecting the rotation centers of the two cameras, and the operation unit 23 is operated to notify that effect. Wait in the standby mode.

  Subsequently, when the master camera 2 and the slave camera 3 are arranged at the initial setting positions and the operation unit 23 is operated, the CPU 21 of the data conversion device 5 notifies the master camera 2 of that fact. Inquiries about the current rotation angle of the master camera unit 2A and the parameters relating to the position of the camera platform 2B are made, and the slave camera 3 is inquired about the parameters related to the current rotation angle of the slave camera unit and the position of the camera platform.

  Subsequently, when the CPU 21 of the data conversion device 5 receives parameters relating to the rotation angles of the master camera 2 and the slave camera 3 and the position of the camera platform, the CPU 21 sets the parameters to the initial position. Note that the initial position of the elevation angle is 0 (rad).

  Subsequently, the CPU 21 of the data conversion device 5 waits in the standby mode to select the synchronization mode of the master camera 2 and the slave camera 3 by operating the operation unit 23 (SP2). The CPU 21 of the data conversion device 5 receives the VR data from the master camera 2 when the synchronization mode of the master camera 2 and the slave camera 3 is selected by operating the operation unit 23 (SP2: YES). Waiting in the standby mode (SP3).

  When the CPU 21 of the data converter 5 receives the VR data from the master camera 2 (SP3: YES), the data conversion program 32 is executed to obtain the conversion equations (1) to (3) shown in FIG. The VR data is decomposed into first to third parameters, and the first to third parameters are converted into first to third drive parameters corresponding to the slave camera 3 (SP4).

  Subsequently, the CPU 21 of the data conversion device 5 checks whether the models of the master camera 2 and the slave camera 3 are the same (SP5). Then, when the models of the master camera 2 and the slave camera 3 are not the same (SP5: NO), the CPU 21 of the data conversion device 5 uses the data conversion table 33 to cope with the slave cameras 3 of different models. The first drive parameter is converted (SP5). In contrast, if the models of the master camera 2 and the slave camera 3 are the same (SP5: YES), the CPU 21 of the data conversion device 5 proceeds to step SP7.

  Subsequently, the CPU 21 of the data conversion device 5 executes the control program 31 to correspond to the converted drive data via the second input / output unit 26 using the converted first to third drive parameters as drive data. A parameter that is transmitted to the driving device 6 of the slave camera 3 (SP7), and then returns to step SP3, and changes or does not change when the master camera 2 is operated such as pan, tilt, focus, and trimming. After that, the processing of steps SP4 to SP7 is repeated.

  In this manner, in the camera system 1 according to the first embodiment, the master camera 2 captures a moving image and detects the first to third parameters that are the result of an external operation (camera work). The slave camera 3 captures a moving image, and the first to third parameters detected by the master camera 2 in the data aggregation device 4 as VR data in response to an external operation on the master camera 2. In the data converter 5, the VR data aggregated by the data aggregator 4 is converted into first to third driving parameters in an appropriate format for each slave camera 3, and the corresponding driving is performed as driving data. Slave camera based on the drive data transferred to the device 6 and transferred from the data converter 5 in the drive device To drive the.

  Therefore, in the camera system 1 according to the first embodiment, a human does not directly operate the slave camera 3 and is not a mechanical operation of a so-called remote control camera, but a normal camera operation performed by a human in the master camera 2. The slave camera 3 can be operated in synchronization with the master camera 2 based on (camera work), and a natural moving image expressed by the operation of the master camera 2 is represented by a moving image captured by the slave camera 3 and a synthesized moving image. It can be reflected in real time over the entire area of the image.

  Further, in the camera system 1 according to the first embodiment, the positional relationship between the master camera 2 and the slave camera 3 can be freely set, so that the slave camera 3 arranged at a distance by the operation of the master camera 2. At the same time, the subject T can be photographed from different angles, and various expression methods such as a large zooming operation can be performed similarly to the master camera 2.

  The moving images shot in this way should be combined as a normal moving image for the master camera 2 and as a multi-view moving image for the slave camera 3 or used as a material for generating a stereoscopic moving image. Can do.

(2) Second Embodiment FIG. 6 shows an example of the configuration of a camera system 1 according to the second embodiment. The camera system 1 according to the second embodiment drives the master camera 2 to drive, for example, a slave camera 3R that is a slave camera for the right eye, a slave camera 3L that is a slave camera for the left eye, and the slave camera 3R. The configuration is the same as that of the camera system 1 according to the first embodiment, except that the device 6R and the driving device 6L for driving the slave camera 3L are connected.

  In the camera system 1 according to the second embodiment, the master camera 2 is disposed between the slave camera 3R and the slave camera 3L. That is, the slave camera 3R and the slave camera 3L are arranged with a predetermined distance d from the master camera 2, respectively, and each shoots the subject T.

  In the camera system 1 according to the second embodiment, in the moving image synthesizing apparatus, the third moving image signal captured by the slave camera 3R and the fourth moving image signal based on the moving image captured by the slave camera 3L The synthesized moving image signal (stereoscopic moving image signal) is generated and transmitted to the master camera 2. Thereby, in the camera system 1 according to the second embodiment, the master camera 2 can display a synthesized moving image (stereoscopic moving image) and individual moving images based on the synthesized moving image signal.

  Further, in the camera system 1 according to the second embodiment, initial settings of the master camera 2 and the slave camera 3R are performed, and initial settings of the master camera 2 and the slave camera 3L are performed. Thus, when the slave camera 3R and the slave camera 3L capture the subject T in the center of the front screen of the master camera 2 by a normal moving image shooting operation (camera work) by a human, the data conversion program of the data conversion device 5 According to the drive data based on the conversion formulas (1) to (3) in FIG. 32, the subject T operates in synchronization with the master camera 2 and can capture the subject T at the center of the front screen of the slave camera 3R and the slave camera 3L. In this initial setting, by setting the interval d to a value different from the actual camera interval, the position where the subject T is captured on the front screen of the slave camera 3R and the slave camera 3L can be adjusted. A wide stereo expression can be realized.

  In this way, a slight delay may occur when the master camera 2 and the slave camera 3 are operated in synchronization. In the camera system 1 according to the second embodiment, the master camera 2 and the slave camera 3 are operated via the master camera 2. Since the two slave cameras 3R and 3L can be operated in synchronization with each other without any delay between the slave cameras, a natural moving image expression by the master camera 2 can be synthesized by the slave camera 3R and the slave camera 3L. It can be reflected in real time over the entire moving image (stereoscopic moving image).

(3) Third Embodiment FIG. 7 shows an example of the configuration of a camera system 1 according to the third embodiment. The camera system 1 according to the third embodiment is configured by connecting, for example, four slave cameras 3A to 3D and driving devices 6A to 6D for driving the four slave cameras 3A to 3D to the master camera 2. Except for this point, it is configured in the same manner as the camera system 1 according to the first embodiment.

  In the camera system 1 according to the third embodiment, the master camera 2 and the slave cameras 3A to 3D are arranged so as to surround the subject T. That is, the slave cameras 3 </ b> A to 3 </ b> D are arranged with predetermined intervals d <b> 1 to d <b> 4 from the master camera 2, respectively, and shoot the subject T, respectively.

  Further, in the camera system 1 according to the third embodiment, the moving image synthesizing apparatus creates a synthesized moving image signal (stereoscopic moving image signal) of individual moving image signals photographed by the slave cameras 3A to 3D, and performs master processing. Send to the camera 2. Thereby, in the camera system 1 according to the third embodiment, the master camera 2 can display a synthesized moving image (stereoscopic moving image) and individual moving image signals based on the synthesized moving image signal.

  Furthermore, in the camera system 1 according to the third embodiment, initial setting is individually made for the master camera 2 and each of the slave cameras 3A to 3D. As a result, when the slave cameras 3A to 3D capture the subject T in the center of the front screen of the master camera 2 by a normal moving image shooting operation (camera work) by a human, the data conversion program 32 of the data conversion device 5 According to the drive data based on the conversion formulas (1) to (3) above, the subject T operates in synchronization with the master camera 2, and the subject T can be captured at the center of the front screen of the slave cameras 3A to 3D.

  As described above, in the camera system 1 according to the third embodiment, the positional relationship between the master camera 2 and the slave cameras 3A to 3D can be freely set. Various expression methods such as a large zooming operation can be performed.

(4) Fourth Embodiment FIG. 8 shows an example of the configuration of a camera system 1 according to the fourth embodiment. The camera system 1 according to the fourth embodiment is configured in the same manner as the camera system 1 according to the first embodiment, except that the slave camera 2 is disposed at another remote location, for example. Yes.

  In the camera system 1 according to the fourth embodiment, d that is an interval between the master camera 2 and the slave camera 3 is set to “0” (d = 0). As a result, for the above (1) to (16), α = β, γs = γm, and Ls = Lm, and the master camera 2 and the slave camera 3 perform exactly the same operation, that is, the same operation. It becomes. For this reason, in the camera system 1 according to the fourth embodiment, the slave camera 3 can duplicate the operation of the master camera 2 to cause the slave camera 3 to perform a matching operation synchronized with the master camera 2. For example, a moving image can be synthesized in real time.

  Even when the in-focus distance of the master camera 2 is “infinity” (Lm = ∞), α = β, γs = γm, Ls = Lm (= ∞), and the master camera 2 and the slave camera 3 are The same operation will be performed.

  In the camera system 1 according to the fourth embodiment, for example, the master camera 2 captures the subject T1, and the slave camera 2 arranged at another remote location captures the subject T2. In the camera system 1 according to the fourth embodiment, in the moving image synthesizing apparatus, the first moving image signal captured by the master camera 2 and the second moving image signal based on the moving image captured by the slave camera 3 The synthesized moving image signal is generated by a method of inlaying synthesis by electrical processing such as chroma key and transmitted to the master camera 2. Thereby, in the camera system 1 according to the fourth embodiment, the master camera 2 can display a synthesized moving image based on the synthesized moving image signal.

  FIG. 9 illustrates an example of the display of a synthesized moving image based on the synthesized moving image signal and the display of the synthesized moving image when an operation such as panning, tilting, focusing, or trimming is performed on the master camera 2. In this case, in the camera system 1 according to the fourth embodiment, the master camera 2 and the slave cameras 3A to 3C are arranged at four plural points.

  In the camera system 1 according to the fourth embodiment, initial settings are individually made for the master camera 2 and the slave cameras 3A to 3C. Each of the slave cameras 3A to 3D has an interval of “0” with respect to the master camera 2, so that the slave cameras 3A to 3C are mastered with respect to the slave cameras 3A to 3C by a normal moving image shooting operation (camera work) by a human. It is possible to perform a matching operation in synchronization with the camera 2, and for example, it is possible to synthesize a moving image in real time. A wide range of effects can be realized in real time by synthesizing more moving images or by combining synthesis and camera work.

  The cameraman who operates the master camera 2 operates the camera while confirming the synthesized moving image resulting from the chroma key composition. In this way, as if the master side moving image MP1 and the slave side moving image SP1 are in the same place, the pan, tilt, zoom and focus feed operations are synchronized with respect to the entire area of the master camera 2, and the slave camera is synchronized. 3 is applied to obtain a natural and realistic video effect.

  In this case, the master camera 2 photographs the performer A together with the monochrome background A at the point A, and can display a moving image such as the master side moving image MP1 on the display unit of the master camera 2. In addition, the slave camera 3A captures the performer B together with the background B at the point B, and can display a moving image such as the slave-side moving image SP1, for example. Further, the slave camera 3B captures the background C at the point C and can display a moving image such as the slave-side moving image SP2. Further, the slave camera 3C takes a picture of the performer D together with the monochrome background D at the point D, and can display a moving image such as the slave-side moving image SP3, for example.

  Here, if the master camera 2 is operated so as to display the combined moving image CP1 of the moving image MP1 and the moving image SP1 by operating the moving image combining device or the operation unit 13, the moving image combining is performed. A synthesized moving image signal of the synthesized moving image CP1 is received from the apparatus, and a moving image such as the synthesized moving image CP1 which is a result of the chroma key composition on the display unit of the master camera 2 can be displayed.

  Then, the master camera 2 is operated so that, for example, the cameraman zooms in on a skiing woman by operating the operation unit 23 by operating the operation unit while confirming the synthesized moving image CP1. If operated, zoom in on the skiing woman. On the other hand, the slave camera 3A performs the same operation as that of the master camera 2 based on the operation of the master camera 2 zooming in on the skiing woman, that is, zooms in on the vicinity of the cross of the church. Accordingly, the master camera 2 can display a moving image such as the combined moving image CP2 on the display unit of the master camera 2. In this case as well, the slave cameras 3B and 3C are performing the same operation as the master camera 2 based on the operation of the master camera 2 zooming in on the woman who is skiing.

  For example, when the master camera 2 is operated to zoom in on a woman playing tennis, that is, the master camera 2 zooms in to the vicinity of the lower right portion of the moving image MP1. On the other hand, the slave camera 3A performs the same operation as the master camera 2 based on the operation in which the master camera 2 zooms in on the vicinity of the lower right portion of the moving image MP1, that is, zooms in on the woman playing tennis. Accordingly, the master camera 2 can display a moving image such as the combined moving image CP3 on the display unit of the master camera 2.

  Furthermore, the master camera 2 is playing tennis when the operation unit 23 is operated to zoom out from a woman playing tennis and display the entire church, for example. Zoom out from the woman to see the whole church, that is, zoom out to see the woman skiing in the middle left. On the other hand, the slave camera 3A performs the same operation as that of the master camera 2 based on the operation of zooming out so that the master camera 2 displays the woman who is skiing in the left middle part, that is, skiing. Zoom out to view the entire church from the image corresponding to the image of the woman. Accordingly, the master camera 2 can display a moving image such as the combined moving image CP1 on the display unit of the master camera 2.

  On the other hand, for example, when the master camera 2 is operated to zoom in on a woman who is skiing further from the state of the composite moving image CP2, the master camera 2 zooms in on the woman who is skiing further. On the other hand, the slave camera 3A performs the same operation as that of the master camera 2 based on the operation of the master camera 2 zooming in on the woman who is skiing, that is, further zooming in on the vicinity of the cross of the church. Accordingly, the master camera 2 can display a moving image such as the combined moving image CP4 on the display unit of the master camera 2. In the synthesized moving image CP4, since the moving image of the master side moving image MP1 is displayed on the entire screen, the moving image of the slave side moving image SP1 is not displayed.

  Here, the master camera 2 switches the display of the slave-side moving image SP1 of the synthesized moving image CP4, for example, by operating the moving image synthesizing device or the operation unit 13, so that the master-side moving image MP1 and the slave-side moving image are switched. When the operation is performed so as to display the image CP2 on the synthesized moving image CP4 based on the slave side moving image CP3, the synthesized moving image based on the master side moving image MP1, the slave side moving image CP2, and the slave side moving image CP3 from the moving image synthesizing device. A composite moving image signal of the image CP4 is received. Accordingly, the master camera 2 can display a moving image such as the combined moving image CP4 on the display unit of the master camera 2. In the synthesized moving image CP4, since the moving image of the master side moving image MP1 is displayed on the entire screen, the moving images of the slave side moving images SP2 and SP3 are not displayed.

  Then, for example, the master camera 2 is operated to zoom out from a woman skiing from the state of the composite moving image CP4 and to zoom out so that the woman skiing is displayed on the left side of the screen. If so, zoom out to display the skiing woman on the left side of the screen. On the other hand, the slave camera 3B performs the same operation as that of the master camera 2 based on the operation of zooming out so that the woman on which the master camera 2 is skiing is displayed on the left side of the screen, that is, skiing. Zoom out to see the whole city from the image corresponding to the image of the woman who is. On the other hand, the slave camera 3 </ b> C performs the same operation as the master camera 2 based on the operation of zooming out so that the woman on which the master camera 2 is skiing is displayed on the left side, that is, skiing. Zoom out so that a man playing baseball is displayed on the right side of the screen from the video corresponding to the video of the woman. Accordingly, the master camera 2 can display a moving image such as the combined moving image CP5 on the display unit of the master camera 2.

  As described above, in the camera system 1 according to the fourth embodiment, the master camera 2 performs an operation in which the slave camera 3 is synchronized with the master camera 2 based on a normal camera operation (camera work) performed by a human. In general television live broadcasting and the like, it is possible to produce a program that incorporates a synthesized moving image while maintaining a unified sense of overall camera work of the program.

  In the first to fourth embodiments, the data aggregation device 4 aggregates the first to third parameters and converts the first to third parameters into serial data such as VR data. In the above description, the VR data is transmitted to the data converter 5 via the communication interface, and the converted result is transmitted to the drive device 6 as serial data. However, the present invention is not limited to this, and the first to third Other various transmission methods, such as transmitting the parameters to the data conversion device 5 as they are, and simultaneously transmitting the aggregated or converted results as VR data to other virtual drawing systems together with the drive device, can be applied.

  In the first to fourth embodiments, the case where individual moving images, synthesized moving images, and stereoscopic moving images are displayed on the display unit 14 of the master camera 2 has been described. However, the present invention is not limited to this. For example, by broadcasting, transmitting / recording / reproducing, it can be displayed on a large screen to be shown to a large number of people, and can be displayed on various other devices.

  The present invention can be widely applied to camera systems that simultaneously control a plurality of cameras.

DESCRIPTION OF SYMBOLS 1 ... Camera system, 2 ... Master camera, 2A ... Master camera part, 2B, pan head, 3, 3A-3D ... Slave camera, 4 ... Data aggregation device, 5 ... Data conversion device, 6, 6A to 6D, 6R, 6L... Driving device, 11... Photographing unit, 12... Control unit, 13. ... 1st detection sensor, 18 ... 2nd detection sensor, 19 ... 3rd detection sensor, 21 ... CPU, 22 ... Memory, 23 ... Operation part, 24 ... Display part, 25 ... 1st input / output unit, 26... 2nd input / output unit, 31... Control program, 32... Data conversion program, 33.

Claims (14)

A master camera, a conversion device, one or more drive devices, and one or more slave cameras,
The master camera captures a moving image, detects an operation parameter related to an external operation, and transmits the operation parameter to the conversion device.
The conversion device converts the operation parameter transmitted from the master camera into a drive parameter for each slave camera and transmits the drive parameter to the corresponding one or a plurality of slave camera drive devices,
The one or more driving devices drive the corresponding slave cameras based on the driving parameters transmitted from the conversion device,
One or a plurality of the slave cameras operate in accordance with driving by the corresponding driving device. The conversion device converts the operation parameter into the drive parameter using a predetermined conversion formula, and when a model is different between the master camera and the one or more slave cameras, a predetermined conversion table is displayed. The camera system according to claim 1, wherein the drive parameter is converted so as to correspond to one or a plurality of slave cameras of different models. The master camera includes an operation parameter related to an operation from the outside, and a transmission unit that transmits the operation parameter detected by the detection unit to the conversion device,
The detection unit includes, as the operation parameters, an angle of view of the master camera, an in-focus distance of the master camera, a rotation angle of the master camera, an elevation angle of the master camera, and a moving direction and distance of a pan head of the master camera. The camera system according to claim 2, wherein the camera system is detected. The conversion device is configured to convert the slave according to the conversion formula based on the focusing distance of the master camera, the operation angle of the rotation angle of the master camera and the operation angle of the elevation angle of the master camera, and the distance between the master camera and the slave camera. Calculating a focus distance of the camera, a rotation angle of the slave camera, and an elevation angle of the slave camera, and converting them into driving parameters of the focus distance of the slave camera, the rotation angle of the slave camera, and the elevation angle of the slave camera; The camera system according to claim 3. The conversion device uses the conversion table to determine the angle of view between the slave camera and the subject and the cloud of the slave camera based on the angle of view of the master camera and the operation parameters of the panning direction and distance of the master camera. 5. The camera system according to claim 4, wherein a moving direction and a distance of the platform are calculated and converted into a driving parameter of an angle of view of the slave camera and a moving direction and a distance of the platform of the slave camera. The camera according to claim 1, wherein the master camera captures a moving image of a predetermined subject, and the slave camera captures a moving image of the same subject from a position different from the master camera. system. The master camera is disposed on the same plane as the two slave cameras, and the two slave cameras are a first slave camera that captures a moving image for the right eye and a first image that captures a moving image for the left eye. The camera system according to claim 1, comprising two slave cameras. The camera system according to claim 1, wherein the master camera and the plurality of slave cameras are arranged so as to surround a subject. The one or more slave cameras are located in a remote location;
The conversion device converts the operation parameter transmitted from the master camera into a drive parameter for each slave camera so that the master camera and one or a plurality of the slave cameras perform the same operation. The camera system according to claim 1, wherein: A control method of a camera system comprising a master camera, a conversion device, one or more drive devices, and one or more slave cameras,
A first step in which the master camera captures a moving image, detects an operation parameter related to an external operation, and transmits the operation parameter to the conversion device;
A second step in which the conversion device converts the operation parameter transmitted from the master camera into a drive parameter for each slave camera and transmits the drive parameter to a corresponding one or a plurality of slave camera drive devices;
A third step in which one or a plurality of the driving devices drive the corresponding slave cameras based on the driving parameters transmitted from the conversion device;
The camera system control method comprising: a fourth step in which one or a plurality of the slave cameras operate in response to driving by the corresponding driving device. In the second step, the operation parameter is converted into the drive parameter using a predetermined conversion formula, and when the model differs between the master camera and the one or more slave cameras, the predetermined conversion is performed. The method for controlling a camera system according to claim 10, wherein the driving parameter is converted to correspond to one or a plurality of the slave cameras of different models using a table. The master camera includes an operation parameter related to an operation from the outside, and a transmission unit that transmits the operation parameter detected by the detection unit to the conversion device,
In the first step, as the operation parameters, the angle of view of the master camera, the focusing distance of the master camera, the rotation angle of the master camera, the elevation angle of the master camera, the moving direction of the pan head of the master camera, and The method for controlling a camera system according to claim 11, wherein a distance is detected. In the second step, based on the focusing distance of the master camera, the rotation angle of the master camera and the operation parameter of the elevation angle of the master camera, and the distance between the master camera and the slave camera, The in-focus distance of the slave camera, the rotation angle of the slave camera, and the elevation angle of the slave camera are calculated and converted into driving parameters for the in-focus distance of the slave camera, the rotation angle of the slave camera, and the elevation angle of the slave camera. The method of controlling a camera system according to claim 12, wherein: In the second step, the angle of view of the slave camera and the platform of the slave camera are determined by the conversion table on the basis of the angle of view of the master camera and the operating direction and distance of the platform of the master camera. The camera system control method according to claim 13, wherein the moving direction and distance of the camera system are calculated and converted into driving parameters for the angle of view of the slave camera and the moving direction and distance of the pan head of the slave camera. .