JP2018061729A - Image processing system and control method thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow a player to image his or her swing motion more easily.SOLUTION: A camera photographs a club head of a golf club and a golf ball from above when swinging the golf club for hitting the golf ball. A projector projects an image of the club head and the golf ball photographed by the camera, on a floor surface in the actual size. This technology can be applied, for example, to an image processing system, etc. for photographing and displaying the locus of a club head.SELECTED DRAWING: Figure 1

Description

  The present technology relates to an image processing system and a control method thereof, and more particularly, to an image processing system and a control method thereof that allow a player to more easily image his / her swing motion.

  Advancing golf is related to swing performance and golf club performance. For this reason, in a store that sells golf driving ranges, golf clubs, etc., an analysis device is installed that analyzes the swing motion when a user who is a player hits a golf ball, or simulates the flight distance and trajectory of the golf ball. It is.

  For example, a system has been proposed in which the behavior of a club head (golf club head) at impact, which is the moment of hitting a golf ball, can be easily photographed with a mobile terminal such as a smartphone (for example, see Patent Document 1).

JP2013-236660A

  However, many of the conventional analysis devices display the analysis result on a display or the like arranged at a different position, and the player is displayed in a place away from the place where the player actually swings. There was an aspect that it was difficult to imagine the movement.

  The present technology has been made in view of such a situation, and makes it easier for a player to imagine his own swing motion.

  An image processing system according to one aspect of the present technology is photographed by a photographing unit that photographs the club head of the golf club and the golf ball from above when the golf club is swung to hit the golf ball, and the photographing unit. And a projection unit for projecting and displaying an image of the club head and the golf ball on the floor surface in actual size.

  A control method of an image processing system according to an aspect of the present technology is the club of the golf club when the shooting unit of the image processing system including a shooting unit and a projection unit swings the golf club to hit the golf ball. The head and the golf ball are photographed from above, and the projection unit projects and displays the club head and the golf ball image photographed by the photographing unit on the floor surface in actual size.

  In one aspect of the present technology, the club head and the golf ball of the golf club when the golf club is swung to hit the golf ball are photographed from above, and the photographed club head and the golf ball are captured. Is projected on the floor surface in actual size.

  The image processing system may be composed of a plurality of devices, or may be a single integrated device.

  According to one aspect of the present technology, the player can more easily imagine his / her swing motion.

  Note that the effects described here are not necessarily limited, and may be any of the effects described in the present disclosure.

It is a figure showing an example of composition of an embodiment of an image processing system to which this art is applied. It is a figure which shows the example of the picked-up image when a camera image | photographs one still image. It is a control block diagram of the image processing system of FIG. It is a figure explaining the difference between a picked-up image and a processed image. It is a figure which shows the example of the image of several sheets after a process. It is a flowchart explaining a club image display process. It is a figure which shows the example which displays a guide image It is a figure which shows the example of the image after a process by which operation input GUI was added It is a figure which shows the other example of a display in slow reproduction. And FIG. 18 is a block diagram illustrating a configuration example of an embodiment of a computer to which the present technology is applied.

  Hereinafter, modes for carrying out the present technology (hereinafter referred to as embodiments) will be described.

<Configuration example of image processing system>
FIG. 1 shows a configuration example of an embodiment of an image processing system to which the present technology is applied.

  The image processing system 1 shown in FIG. 1 includes an infrared light 10, a camera 11, an image processing device 12, a projector 13, and a mirror 14. The player 21 swings the golf club 22 to hit the golf ball 23. This is a system for photographing and displaying the trajectory of the club head 22A. Between the camera 11 and the image processing apparatus 12, and between the image processing apparatus 12 and the projector 13, for example, a USB (Universal Serial Bus) cable, an HDMI (registered trademark) (High-Definition Multimedia Interface) cable, etc. Connected with a predetermined communication cable.

  The infrared light 10 (illuminating unit) is fixed to a position above the golf ball 23 by the camera stand 15 and illuminates the shooting range 31 of the camera 11 with infrared light. The infrared light 10 is composed of, for example, an LED (Light Emitting Diode) that emits infrared light, and the infrared light is always turned on or blinked (lighted at a constant time interval). In this embodiment, it is not particularly synchronized with the shooting timing of the camera 11, but it may be turned on (flashed) in synchronization.

  The camera 11 (photographing unit) is fixed to the camera stand 15 along with the infrared light 10, and is arranged so that the direction toward the floor is the photographing direction. The camera 11 includes, for example, an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) sensor, and a visible light cut filter disposed in front of the image sensor.

  The camera 11 shoots at the shooting timing instructed from the image processing apparatus 12, and supplies a plurality of captured images obtained as a result to the image processing apparatus 12. The captured image is a monochrome image obtained by imaging a subject (club head 22A or golf ball 23) irradiated with infrared light from the infrared light 10. A shooting range 31 of the camera 11 indicated by a broken line in FIG. 1 includes a club head 22 </ b> A, a golf ball 23, and a mirror 14 when the player 21 swings the golf club 22 to hit the golf ball 23. .

  The image processing device 12 controls the shooting timing of the camera 11 and acquires a plurality of shot images shot by the camera 11. Then, the image processing device 12 performs predetermined image processing on the plurality of photographed images, and supplies the photographed image after the image processing (hereinafter referred to as a processed image) to the projector 13.

  The projector 13 (projection unit) is, for example, a short focus type projector, and is disposed in a front direction facing the player 21 and at a position close to the floor surface. The projector 13 projects and displays the processed image supplied from the image processing device 12 on the floor surface. As shown in FIG. 1, the projection range 32 of the projector 13 is a position where the club head 22 </ b> A and the golf ball 23 are placed just before impact when the player 21 swings the golf club 22 to hit the golf ball 23. including.

  The mirror 14 is a surface when the club head 22A is viewed from the direction facing the player 21, in other words, the face surface (ball striking surface) of the club head 22A is the front surface of the club head 22A, and the side surface of the club head 22A is the camera 11 It is tilted at an angle so that it can be photographed at, and is disposed within the photographing range 31 of the camera 11. For example, the mirror 14 is fixed to the image processing apparatus 12 at a predetermined position 14A and includes an adjustment mechanism that adjusts the angle within a predetermined range.

  FIG. 2 shows an example of one shot image taken by the camera 11 in the situation shown in FIG.

  The camera 11 photographs the club head 22A and the golf ball 23 and the mirror 14 on which the side portions of the club head 22A and the golf ball 23 are reflected from above. Accordingly, the captured image 41 captured by the camera 11 includes the club head 22A and the golf ball 23 capturing the upper surface portion, and the side surface portions of the club head 22A and the golf ball 23 reflected on the mirror 14. The side portion of the club head 22A reflected on the mirror 14 is the portion of the club head 22A that is visible when the club head 22A is viewed from the direction from the projector 13 toward the player 21.

<Control block diagram of image processing system>
FIG. 3 is a control block diagram of the image processing system 1.

  The image processing device 12 includes an image acquisition unit 51, a control unit 52, a loop memory 53, a data storage unit 54, and an image output unit 55.

  The camera 11 starts shooting under the control of the control unit 52 and supplies a plurality of captured images obtained as a result to the image acquisition unit 51. The camera 11 performs shooting at a frame rate of about 30 to 60 frames / second (low frame rate) and a frame rate of about 500 to 1000 frames / second (high frame rate) according to the control of the control unit 52. You may shoot with

  The image acquisition unit 51 acquires a plurality of photographed images supplied from the camera 11 and supplies them to the control unit 52.

  The control unit 52 controls the operation of the entire image processing system 1. The operation mode of the image processing system 1 includes a ball monitoring mode and a high-speed loop shooting mode, and the control unit 52 controls the operation mode of the image processing system 1. The ball monitoring mode is a mode for monitoring whether or not the golf ball 23 is placed in the shooting range 31. The high-speed loop shooting mode is a mode for shooting the club head 22A immediately before impact when the player 21 swings the golf club 22 to hit the golf ball 23.

  In the ball monitoring mode, the control unit 52 controls the camera 11 to perform shooting at a low frame rate. Then, the control unit 52 performs pattern matching with the image of the golf ball 23 stored in advance in the data storage unit 54 on the low-frame-rate captured image acquired via the image acquisition unit 51 to capture the image. It is determined whether or not the golf ball 23 is placed within the range 31. When it is detected that the golf ball 23 is placed, the control unit 52 changes the operation mode of the image processing system 1 from the ball monitoring mode to the high-speed loop shooting mode.

  On the other hand, in the high-speed loop shooting mode, the control unit 52 controls the camera 11 to perform shooting at a high frame rate. Then, the control unit 52 causes the loop memory 53 to store the high frame rate captured image acquired via the image acquisition unit 51.

  The loop memory 53 has a storage capacity for storing a predetermined number of images. When the next image is supplied in a state where the storage capacity is full, the stored time is sequentially overwritten and updated from the oldest image. This is the buffer memory to be used. The loop memory 53 stores a predetermined number (for example, 100) of high frame rate captured images supplied from the control unit 52.

  The image processing system 1 generates a processed image by performing predetermined image processing on each of a plurality of captured images stored in the loop memory 53 at a predetermined timing not related to the operation mode, and the generated processing Slow playback processing for projecting and displaying the rear image on the projection range 32 on the floor is executed.

  The process of storing the shot image shot at the high frame rate in the loop memory 53 ends after a predetermined time from the detection of the golf ball 23 being hit by the club head 22A. When the storage of the captured image in the loop memory 53 is completed, the slow playback process is started.

  In the slow playback process, the control unit 52 acquires a plurality of photographed images stored in the loop memory 53 in chronological order (in order of photographing time). And the control part 52 performs the image processing process which moves the mirror area | region which is the area | region which caught the mirror 14 with respect to the acquired picked-up image to a predetermined position. Accordingly, the control unit 52 also functions as an image processing unit that performs image processing on a captured image. The control unit 52 generates a processed image from the photographed image by image processing, supplies the generated processed image to the image output unit 55 as a display image, and causes the projector 13 to project and display the processed image.

  FIG. 4 is a diagram illustrating a difference between a captured image stored in the loop memory 53 and a processed image that has been subjected to image processing by the control unit 52.

  A post-processing image 62 shown in FIG. 4 is generated from the captured image 41 shown in FIG. The processed image 62 has a shorter image length in the vertical direction (the direction connecting the player 21 and the projector 13 on the floor surface) than the captured image 41, and the side portions of the club head 22A and the golf ball 23 are reflected. The mirror area 63 that captures the embedded mirror 14 is an image that is moved closer to the center of the image than the position of the original captured image 41 (in the direction of the club head 22A and the golf ball 23 capturing the upper surface portion). In other words, the captured image 41 corresponds to an image obtained by extending the processed image 62 upward as indicated by a broken line.

  In the processed image 62, the sizes of the club head 22A and the golf ball 23 when displayed on the floor surface are the same as the actual size (actual size). If the captured image 41 is displayed as it is so that the sizes of the club head 22A and the golf ball 23 become the actual size, the mirror area 63 of the captured image 41 is displayed at the installation position of the mirror 14 on the floor surface. Therefore, in the post-processing image 62, when the post-processing image 62 is projected and displayed on the floor surface, the mirror region 63 is displayed on the floor surface near the image capturing the upper surface portions of the club head 22A and the golf ball 23. As described above, the mirror region 63 is moved. In the present embodiment, the scale adjustment function for making the sizes of the club head 22A and the golf ball 23 when displayed on the floor surface the actual size is the image processing device 12 (for example, the image output unit 55). However, the display magnification can be adjusted by the projector 13.

  FIG. 5 shows an example of a plurality of processed images projected and displayed in the projection range 32 on the floor surface by the slow reproduction process.

  In the slow playback process, as shown in FIG. 5, the generated plurality of processed images are sequentially displayed on the floor in the order in which they were captured. Until the slow reproduction process is completed, slow reproduction of a plurality of processed images (five images in FIG. 5) is repeatedly performed.

  Returning to the description of FIG. 3, the data storage unit 54 stores data and programs necessary for control and processing of the image processing system 1. For example, the data storage unit 54 stores a reference image for pattern matching with a captured image captured at a low frame rate.

  The image output unit 55 sequentially outputs a plurality of processed images supplied as display images from the control unit 52 to the projector 13. The projector 13 projects and displays the processed image supplied from the image output unit 55 in the projection range 32 on the floor surface. The time interval (display interval) between the images of the plurality of processed images projected and displayed by the projector 13 is set by the control unit 52 to be longer than the shooting interval. That is, the projector 13 performs slow reproduction of a plurality of processed images in the projection range 32 on the floor surface.

<Flowchart of club image display processing>
Next, club image display processing by the image processing system 1 will be described with reference to the flowchart of FIG. This process is started, for example, when the power switch of the image processing apparatus 12 that is also the power switch of the entire image processing system 1 is turned on.

  First, in step S1, the control unit 52 of the image processing apparatus 12 sets the operation mode to the ball monitoring mode, controls the camera 11, and starts shooting at a low frame rate. For example, the camera 11 starts shooting at a frame rate of 60 frames / second, and sequentially supplies the captured image 41 obtained as a result to the image acquisition unit 51. The image acquisition unit 51 supplies the captured image 41 supplied from the camera 11 to the control unit 52.

  In step S <b> 2, the control unit 52 performs pattern matching on the captured image 41 supplied from the image acquisition unit 51 using the reference image stored in the data storage unit 54, and whether the golf ball 23 is detected. Determine. The process of step S2 is repeated until it is determined in step S2 that the golf ball 23 has been detected.

  If it is determined in step S2 that the golf ball 23 has been detected in the captured image 41, the process proceeds to step S3, and the control unit 52 determines, based on the position (coordinates) of the golf ball 23 that has been pattern-searched. It is determined whether the detected golf ball 23 is stationary for a certain period.

  If it is determined in step S3 that the golf ball 23 has not been stationary for a certain period of time, the process returns to step S2 and the above-described processes are repeated. Therefore, until the player 21 places the golf ball 23 at a predetermined position and the movement of the golf ball 23 stops, the detection of the golf ball 23 is continuously executed.

  If it is determined in step S3 that the golf ball 23 is stationary for a certain period, the process proceeds to step S4, and the control unit 52 sets the operation mode to the high speed loop shooting mode, and the high speed loop shooting is performed. To start. Specifically, the control unit 52 controls the camera 11 to start shooting at a high frame rate. For example, the camera 11 starts shooting at a frame rate of about 1000 frames / second, and sequentially supplies the captured images 41 obtained as a result to the image acquisition unit 51. The image acquisition unit 51 supplies the captured image 41 supplied from the camera 11 to the control unit 52, and the control unit 52 stores the supplied captured image 41 in the loop memory 53.

  In step S5, the control unit 52 stops the slow playback when the slow playback of the processed image started in the previous processing of step S9 is executed by the repeated processing of steps S1 to S9. In the first process of step S5, since the slow playback is not executed, the process of step S5 is omitted.

  In step S <b> 6, the control unit 52 detects the golf ball 23 of the high frame rate captured image sequentially supplied from the camera 11, and the golf ball 23 moves based on the detected position (coordinates) of the golf ball 23. It is determined whether or not. The process of step S6 is a process of detecting the moment when the golf ball 23 placed at a predetermined position moves by being hit with the club head 22A as the moment of impact. This process is repeatedly executed until it is determined that the golf ball 23 has moved.

  If it is determined in step S6 that the golf ball 23 has moved, the process proceeds to step S7, and the control unit 52 determines whether a certain time has elapsed since the detected moment of impact. For example, the control unit 52 defines a predetermined number of predetermined times from the moment of impact, for example, the time during which 10 captured images 41 can be acquired as a fixed time, and until it is determined that the fixed time has passed, Repeat the process.

  If it is determined in step S7 that a certain time has elapsed from the detected moment of impact, the process proceeds to step S8, and the control unit 52 stops high-speed loop imaging. As a result, assuming that the loop memory 53 has a storage capacity for storing 100 shot images, 10 shot images immediately after impact and 90 shot images immediately before impact are stored in the loop memory 53. Will be.

  In step S <b> 9, the control unit 52 acquires a plurality of photographed images stored in the loop memory 53 in time series to generate a processed image, and the generated processed image is transmitted via the image output unit 55. The image is supplied to the projector 13 and is slowly reproduced. The projector 13 projects and displays the processed image on the floor surface.

  After step S9, the process returns to step S1, and the above-described process is repeated. The slow reproduction of the processed image started in step S9 is continued until the processing for stopping the slow reproduction of the processed image is executed in the next step S5.

  In the image processing system 1, the club image display process is executed as described above.

  According to the club image display process described above, the camera 11 captures the trajectory of the club head 22 </ b> A when the player 21 swings the golf club 22 to hit the golf ball 23. The projector 13 projects and displays the trajectory (trajectory) of the photographed club head 22A on the floor surface at the same position as the club head 22A when the player 21 actually swings.

  In the conventional image processing system that captures and displays the trajectory of the club head 22A, the image is displayed on a display or the like installed at a place away from the place where the player 21 actually swings. It was hard to understand.

  On the other hand, according to the image processing system 1, the track of the club head 22A by the player 21 is displayed on the floor at the same position as the club head 22A when the player 21 actually swings. Therefore, it becomes easy to confirm and grasp the trajectory of the club head 22A. That is, it becomes easier for the player 21 to imagine his own swing motion.

  In the club image display process, whether or not the golf ball 23 for the next hit has been placed on the floor during slow playback in which the trajectory of the golf ball 23 before impact and the club head 22A is projected and displayed on the floor. Need to be detected.

  If the camera 11 is a camera that captures visible light, the control unit 52 includes the golf ball 23 placed on the floor surface for the next hit and the golf ball displayed on the floor surface by slow playback. It may be difficult to distinguish the ball 23 from the ball 23, and the golf ball 23 placed on the floor for the next hit may not be detected correctly.

  On the other hand, according to the image processing system 1, the infrared light 10 irradiates the imaging range 31 with infrared light, and the camera 11 having the visible light cut filter on the front surface of the imaging device is irradiated with infrared light. Shoot the subject. Therefore, since the golf ball 23 displayed on the floor surface by the slow reproduction is not reflected in the photographed image, only the golf ball 23 placed on the floor surface for the next hit can be detected. it can.

  Therefore, according to the image processing system 1, it is possible to achieve both slow reproduction and ball monitoring on the same floor surface by irradiating and photographing infrared light.

  Hereinafter, modifications of the image processing system 1 will be described.

<Modification 1>
FIG. 7 is a view of the imaging range 31 on the floor during high-speed loop imaging as viewed from above.

  In the above-described embodiment, the image processing device 12 does not project and display anything on the floor surface while executing high-speed loop imaging.

  However, for example, a guide image such as a guide line 71 that is horizontal to the player 21 and passes over the golf ball 23 as shown in FIG. Also good.

<Modification 2>
The image processing system 1 shoots and displays the trajectory of the club head 22A when the player 21 swings the golf club 22. For example, the speed and the putter when swinging a driver (No. 1 wood) or an iron are displayed. The speed when swinging is different.

  Therefore, for example, if the swinging motion with a putter is shot at the same shooting speed as the driver, the shot image stored in the loop memory 53 is an image with almost no movement. On the other hand, when the swinging motion by the driver is shot at the same shooting speed as the putter, most of the shot images stored in the loop memory 53 show only the golf ball 23 in the middle of swinging up the golf club 22. The captured image is displayed, and the club head 22A is displayed only for a moment.

  Therefore, the image processing system 1 can be configured to change the shooting speed, the slow playback speed, and the like according to the type of the golf club 22 and the like.

  For example, the image processing system 1 divides the shooting speed into a driver iron mode that matches the driver and iron, and a putter mode that matches the putter, and the speed mode of the driver iron mode and the putter mode according to the operation input of the player 21. To change. In order to accept the speed mode change operation between the driver iron mode and the putter mode, an operation input GUI (Graphical User Interface) is added to the post-processed image 62 displayed on the floor surface during the slow playback.

  FIG. 8 shows an example of the processed image 62 to which an operation input GUI is added.

  During the slow reproduction, the control unit 52 generates the processed image 62 shown in FIG. 8A, supplies the processed image 62 to the projector 13, and displays it on the floor.

  FIG. 8A shows an example of the processed image 62 in which a menu icon 81 as an operation input GUI is arranged at a predetermined position.

  In the ball monitoring mode, the control unit 52 monitors whether or not an operation for selecting the menu icon 81 has been performed as well as whether or not the golf ball 23 has been placed on the floor surface. Specifically, the player 21 performs an operation of placing the club head 22A on the menu icon 81 on the floor as a selection operation of the menu icon 81, and the control unit 52 performs the operation by patterning the position of the club head 22A. Detect by searching.

  When the selection operation of the menu icon 81 is detected, the control unit 52 generates the processed image 62 shown in FIG. 8B and causes the projector 13 to project and display it.

  FIG. 8B shows an example of the processed image 62 in which a driver iron mode icon 82A and a putter mode icon 82B as operation input GUIs are arranged at predetermined positions.

  In the ball monitoring mode, the control unit 52 monitors whether or not the golf ball 23 has been placed on the floor and also whether or not an operation for selecting the driver iron mode icon 82A or the putter mode icon 82B has been performed.

  When it is detected that the club head 22A is placed at the position of the driver iron mode icon 82A, the control unit 52 detects that the driver iron mode is selected. In the driver iron mode, the control unit 52 sets the shooting speed (shooting frame rate) in the high-speed loop shooting mode to, for example, 1000 frames / second.

  On the other hand, when it is detected that the club head 22A is placed at the position of the putter mode icon 82B, the control unit 52 detects that the putter mode is selected. In the putter mode, the control unit 52 sets the shooting speed in the high speed loop shooting mode to, for example, 500 frames / second.

  Further, in the driver iron mode and the putter mode, in addition to the shooting speed in the high-speed loop shooting mode, the playback speed for slow playback (time interval for displaying each processed image) is changed, or the loop memory 53 The number of stored images may be changed.

  Alternatively, either the playback speed or the number of stored images may be changed between the driver iron mode and the putter mode, or one of the shooting speed, the playback speed, and the number of stored images. Two or more may be changed. Furthermore, instead of selecting the driver iron mode or the putter mode, one or more of the shooting speed, the reproduction speed, and the number of stored images may be individually selected and changed.

<Modification 3>
FIG. 9 shows another display example in slow playback.

  In the above-described example, the processed image obtained by moving the mirror area 63 of the club image, which is the photographed image reflected by the club head 22A, to the predetermined position is sequentially displayed in the order of photographing. As described above, a combined image may be generated and displayed so that the image of the club head 22A at a predetermined position corresponding to the passage of time is cumulatively displayed with the previous image of the club head 22A.

  Each composite image shown in FIG. 9 is obtained by obtaining one or more difference images each including a difference between the base image and each of the one or more club images, with the captured image not showing the club head 22A as a base image. The one or more difference images thus obtained and the base image can be synthesized.

  The series of processes described above can be executed by hardware or can be executed by software. When a series of processing is executed by software, a program constituting the software is installed in the computer. Here, the computer includes, for example, a general-purpose personal computer that can execute various functions by installing a microcomputer incorporated in dedicated hardware and various programs.

  FIG. 10 is a block diagram illustrating an example of a hardware configuration of a computer that executes the above-described series of processing by a program.

  In a computer, a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, and a RAM (Random Access Memory) 103 are connected to each other via a bus 104.

  An input / output interface 105 is further connected to the bus 104. An input unit 106, an output unit 107, a storage unit 108, a communication unit 109, and a drive 110 are connected to the input / output interface 105.

  The input unit 106 includes a touch panel, a keyboard, a mouse, a microphone, and the like. The output unit 107 includes a display, a speaker, and the like. The storage unit 108 includes a hard disk, a nonvolatile memory, and the like. The communication unit 109 includes a network interface or the like. The drive 110 drives a removable recording medium 111 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

  In the computer configured as described above, the CPU 101 loads, for example, the program stored in the storage unit 108 to the RAM 103 via the input / output interface 105 and the bus 104 and executes the program. Is performed.

  In the computer, the program can be installed in the storage unit 108 via the input / output interface 105 by attaching the removable recording medium 111 to the drive 110. Further, the program can be received by the communication unit 109 and installed in the storage unit 108 via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting. In addition, the program can be installed in the ROM 102 or the storage unit 108 in advance.

  In this specification, the steps described in the flowchart are not necessarily processed in chronological order, but are performed in parallel or when they are called in chronological order according to the described order. It may be executed at a necessary timing.

  In this specification, the system means a set of a plurality of components (devices, modules (parts), etc.), and it does not matter whether all the components are in the same housing. Accordingly, a plurality of devices housed in separate housings and connected via a network and a single device housing a plurality of modules in one housing are all systems. .

  Embodiments of the present technology are not limited to the above-described embodiments, and various modifications can be made without departing from the gist of the present technology.

  For example, in the above-described embodiment, the projector 13 is described as being a short focus type projector. However, the projector 13 is, for example, a long focus type and may be installed on a ceiling or the like. Good. In this case, the projector 13 may be integrated with at least one of the infrared light 10 or the camera 11. Furthermore, the infrared light 10, the camera 11, the image processing device 12, and the projector 13 may be integrated as one device.

  In the embodiment described above, the image size of the processed image 62 is set to an image size that is shorter in the vertical direction than the captured image 41, but the captured image 41 and the processed image 62 may have the same image size. Good. The post-processing image 62 only needs to be moved so that the mirror area 63 is displayed on the floor surface.

  In the embodiment described above, the club head 22A and the golf ball 23 that have been irradiated with infrared light by the infrared light 10 are photographed. However, a camera that uses visible light instead of infrared light can be used to 11 may photograph a subject illuminated with visible light. In this case, the processed image displayed on the floor can be displayed in color. When photographing with visible light is performed and a sufficient amount of visible light can be obtained without light, the light may be omitted.

  The image processing system 1 can be configured to selectively execute a plurality of functions described above.

  For example, the present technology can take a configuration of cloud computing in which one function is shared by a plurality of devices via a network and is jointly processed.

  In addition, each step described in the above flowchart can be executed by being shared by a plurality of apparatuses in addition to being executed by one apparatus.

  Further, when a plurality of processes are included in one step, the plurality of processes included in the one step can be executed by being shared by a plurality of apparatuses in addition to being executed by one apparatus.

  Note that the effects described in this specification are merely examples and are not limited, and there may be effects other than those described in this specification.

DESCRIPTION OF SYMBOLS 1 Image processing system 10 Infrared light 11 Camera 12 Image processing apparatus 13 Projector 14 Mirror 22 Golf club 22A Club head 23 Golf ball 51 Image acquisition part 52 Control part 53 Loop memory 54 Data storage part 55 Image output part 101 CPU
102 ROM
103 RAM
108 Storage unit

Claims (7)

A shooting section for shooting the club head of the golf club when the golf club is swung to hit the golf ball and the golf ball from above;
An image processing system comprising: a projection unit configured to project and display an image of the club head and the golf ball photographed by the photographing unit on a floor surface in actual size. A mirror disposed on the side facing the player across the golf ball so as to be inclined at an angle such that a side surface of the club head immediately before impact is photographed by the photographing unit;
The photographing unit photographs the upper surface of the club head when the swing is performed, the side surface of the club head reflected on the mirror, and the golf ball from above,
The image processing according to claim 1, wherein the projection unit projects and displays an upper surface of the club head when the swing is performed, a side surface of the club head reflected on the mirror, and the golf ball on a floor surface in actual size. system. An image processing unit that generates, as a display image, a post-processing image obtained by moving a mirror region, which is a region capturing the mirror of the captured image obtained by the imaging unit, to a predetermined position;
The image processing system according to claim 2, wherein the projection unit projects and displays the processed image including an upper surface of the club head of a full size, a side surface of the club head, and the golf ball on a floor surface. The image processing unit generates the processed image including an operation input GUI, and detects whether the golf club is placed at the position of the operation input GUI from the photographed image as a player operation input. The image processing system according to claim 3. The image processing unit generates a plurality of processed images from the plurality of the captured images obtained by the imaging unit,
The image processing system according to claim 3, wherein the projection unit performs slow reproduction of a plurality of the processed images. An illumination unit that illuminates the imaging range of the imaging unit with infrared light;
An image processing unit for detecting that the golf ball is placed on a floor surface based on a photographed image obtained by the photographing unit;
When it is detected that the golf ball is placed on the floor surface, the operation mode is changed from the first operation mode in which the imaging unit captures images at a low frame rate to the second operation mode in which images are captured at a high frame rate. The image processing system according to claim 1, further comprising: a controller that changes to: The image capturing system of the image processing system including the image capturing unit and the projecting unit captures from above the club head of the golf club and the golf ball when the golf club is swung to hit the golf ball.
A control method of an image processing system in which the projection unit projects and displays the club head and the golf ball images photographed by the photographing unit on a floor surface in actual size.

Images