JP2009021914A - IMAGING DISPLAY SYSTEM, IMAGING DISPLAY DEVICE, AND IMAGING DISPLAY DEVICE CONTROL METHOD - Google Patents

Abstract

[PROBLEMS] To easily realize visual exchange.
Captured image data captured by one imaging display device is transmitted to the other imaging display device for display. The captured image data captured by the other imaging display device is displayed or recorded by the one imaging display device. Furthermore, the captured image data captured by one or the other imaging display device and recorded by the one imaging display device is reproduced by the one imaging display device and displayed by the one imaging display device or the other imaging display device. . Here, the picked-up image data picked up by the image pickup means of one or the other image pickup display device is an image in the field of view of the user of the image pickup display device. In one or the other imaging display device, the display screen is positioned in front of the user's eyes. Therefore, the user of the imaging display device not only sees the current or past scene as his / her field of view with the imaging display device attached, but also present or past as the user's view scene of another imaging display device. You can see the scene.
[Selection] Figure 2

Description

  The present invention relates to an image pickup display system, an image pickup display device, and a method for controlling the image pickup display device, and more particularly to a technique for realizing visual exchange of a user who uses a plurality of image pickup display devices.

JP 2005-341604 A JP 2003-244691 A

Patent Document 1 describes an example of a data communication system.
Patent Document 2 discloses a system that uses a time stamp for audiovisual viewing that it sees and uses it after the fact.

However, conventionally, a technique in which a user arbitrarily views a field of view other than his / her own has not been proposed.
Here, from the viewpoint of visual exchange, it is considered that various conveniences are produced by allowing a certain person to easily see a sight that is visible from other persons.

For example, when a sports class such as a golf class is performed, a method in which a student's form is recorded as a video, and the student himself / herself confirms the video to improve a bad place is appropriate.
However, for this purpose, it is very troublesome for others to take a video of the student's form and view it later. Also, depending on the equipment environment, it takes time to play and see the person. In particular, it is not possible for the student to practice the form while looking at the student's own form in real time.
In addition, for example, video staff is often required in addition to the instructor who teaches the students, and this is not easy.
Furthermore, it is difficult to take an image at an imaging angle intended by the instructor (for example, a line of sight checked by the instructor with respect to the student).
Furthermore, when the instructor tries to shoot, the instructor has to care about the photographic equipment and the shooting operation, and can not see the student accurately.

  In addition, classes based on instructional image data are generally performed in a room for viewing, and the fact is that golf swing practice cannot be performed on the spot, and in the end it can only be used for image training.

  Therefore, an object of the present invention is to enable easy visual exchange so that it can be suitably used for sports practice, for example.

  The imaging display system of the present invention includes a plurality of imaging display devices of the present invention. There may be a remote controller that transmits a command signal to one of the imaging display devices in response to a user operation.

The imaging display device of the present invention constituting this imaging display system displays an image on a display screen arranged so as to be positioned in front of the user's eyes and makes the display screen a transparent or translucent through state Display means capable of performing imaging, imaging means for obtaining captured image data by imaging the user's visual field direction as a subject direction, communication means for communicating captured image data with an external imaging display device, and Control for transmitting the captured image data obtained by the imaging means to the external imaging display device by the communication means, and displaying the captured image data transmitted from the external imaging display device and received by the communication means by the display means And control means for performing control.
The image recording apparatus further includes recording means for recording the captured image data, and the control means further performs control for recording the captured image data obtained by the imaging means by the recording means.
Further, the control means further performs control for recording the captured image data transmitted from the other imaging display device and received by the communication means by the recording means.
The image processing apparatus further includes reproduction means for reproducing image data, and the control means further performs control for transmitting the image data reproduced by the reproduction means to an external imaging display device by the communication means.
The control means further controls the display means to display the captured image data reproduced by the reproduction means, and the control means to transmit the image data reproduced by the reproduction means to an external imaging display device by the communication means. And do.

The control means performs its own operation control in accordance with the operation input signal, and performs control for transmitting operation control information to an external imaging display device by the communication means.
Further, the control means executes one or both of the variable control of the transmittance of the display screen and the transmission control of the transmittance control information of the display screen of the external imaging display device in accordance with the operation input signal.
The control means controls the transmission of the captured image data to the external imaging display device by the communication means in response to the operation input signal, and the control information for requesting the transmission of the captured image data to the external imaging display apparatus. One or both of the transmission controls are executed.
The operation input signal is a signal input as a command signal from the remote controller.

  According to the control method of the imaging display device of the present invention, the step of transmitting the captured image data obtained by the imaging unit to the external imaging display device by the communication unit according to the operation input, and the external according to the operation input. Displaying the captured image data transmitted from the imaging display device and received by the communication means on the display means.

In the present invention described above, captured image data captured by one imaging display device can be transmitted to the other imaging display device for display. The captured image data captured by the other imaging display device can be displayed or recorded by the one imaging display device.
Furthermore, the captured image data captured by one or the other imaging display device and recorded by the one imaging display device is reproduced by the one imaging display device and displayed by the one imaging display device or the other imaging display device. be able to.
Here, the picked-up image data picked up by the image pickup means of one or the other image pickup display device is an image in the visual field direction of the user of the image pickup display device.
In one or the other imaging display device, the display screen is positioned in front of the user's eyes.
Therefore, the user of the imaging display device not only sees the current or past scene as his / her field of view with the imaging display device attached, but also present or past as the user's view scene of another imaging display device. You can see the scene. That is, the operation as visual exchange can be realized.

According to the present invention, a plurality of users can easily view the visual sight of the other user from each other by wearing the imaging display device. That is, it becomes a useful imaging display device that can easily experience a display image as visual exchange, and can be effectively used in various training opportunities such as sports training.
In addition, the usability can be improved by controlling both imaging display devices and controlling the visual exchange operation by one operation input means (for example, a remote controller).

Hereinafter, embodiments of an imaging display system, an imaging display device, and a control method thereof according to the present invention will be described. The description will be given in the following order.
[1. System overview]
[2. Configuration example of imaging display device]
[3. Configuration example and operation of remote controller]
[4. Controlled device mode setting process]
[5. Transmission control processing]
[6. Imaging processing (Self-device imaging, own-recording, own-device display)]
[7. Imaging processing (imaging other device, own device recording, own device display)]
[8. Imaging processing (Self-device imaging, own-recording, other-device display)]
[9. Playback processing (Self playback, display)
[10. Playback processing (Self playback, display on other devices)]
[11. Playback processing (Self-machine playback, both-machine display)]
[12. Effect of embodiment, modification and extension example]

[1. System overview]

The imaging display system of the embodiment includes a plurality (for example, two) of imaging display devices.
FIG. 1 shows an example of the appearance of the imaging display device 1. The imaging display device 1 can be worn by a user as a glasses-type display camera.
The imaging display device 1 has a mounting unit having a frame structure that, for example, makes a half turn from both sides of the head to the back of the head, and is mounted on the user by being put on both ear shells as illustrated.
The imaging display device 1 is a pair of display panels 2a for the left eye and the right eye in the wearing state as shown in FIG. 2b is arranged. For example, a liquid crystal panel is used for the display panel portions 2a and 2b. By controlling the transmittance, a through state as shown in the figure, that is, a transparent or translucent state can be obtained. Since the display panel portions 2a and 2b are in the through state, even if the user always wears them like glasses, the user's activities are not hindered.

In addition, the imaging lens 3a is arranged facing forward so that the user's view direction is taken as the subject direction when the user is wearing.
Moreover, the light emission part 4a which illuminates with respect to the imaging direction by the imaging lens 3a is provided by LED (Light Emitting Diode) etc., for example.
Although only the left ear side is shown in the figure, a pair of earphone speakers 5a that can be inserted into the user's right ear hole and left ear hole in the mounted state are provided.
Microphones 6a and 6b for collecting external sound are arranged on the right side of the display unit 2 for the right eye and on the left side of the display unit 2 for the left eye.

FIG. 1 is an example, and various structures for the user to wear the imaging display device 1 can be considered. Generally, it may be formed of a mounting unit that is a spectacle type or a head-mounted type. At least in the present embodiment, the display panel units 2a and 2b are provided close to the front of the user's eyes, and imaging is performed. It is only necessary that the imaging direction by the lens 3a is in the user's field of view direction, that is, in front of the user.
In addition to the configuration in which the display panels 2a and 2b are provided with a pair of display units corresponding to both eyes, a configuration in which one display unit is provided corresponding to one eye is also possible.
Further, the earphone speaker 5a may not be a left and right stereo speaker, but only one earphone speaker 5a may be provided to be worn only on one ear. The microphone may be one of the microphones 6a and 6b. Furthermore, a configuration in which the microphone and the earphone speaker are not provided as the imaging display device 1 is also conceivable.
A configuration in which the light emitting unit 4a is not provided is also conceivable.
An example in which the imaging display device 1 has a spectacle-type or head-mounted type mounting unit has been shown. However, for example, any type of mounting unit such as a headphone type, a neckband type, or an ear-hook type may be worn by the user. May be. Further, for example, a configuration may be adopted in which the user wears the device by attaching the clip to a normal pair of glasses, a visor, headphones, or the like.

An example of the usage state of the imaging display device 1 is shown in FIG.
This FIG. 2 uses two imaging display devices 1A and 1B. For example, in a golf course, an instructor U1 wears the imaging display device 1A as one user and a student as the other user. U2 is also equipped with a similar imaging display device 1B.
The instructor U1 wears the remote controller 30 corresponding to the imaging display device 1A on the finger.
Although the remote controller 30 will be described later, the remote controller 30 is an apparatus that can perform various operation inputs while being put on a finger.

For example, when the instructor U1 performs operations using the remote controller 30 in this way, image data transmission is performed between the imaging display devices 1A and 1B, and various operations including operations as visual exchange are realized. .
For example, the figure of the student U2 viewed from the lecturer U1 (for example, the figure swinging) can be displayed on the imaging display device 1B so that the student U2 can view the figure, or an image of the figure of the student U2 can be displayed. It can be recorded by the imaging display device 1A and can be reproduced and displayed later by one or both of the imaging display devices 1A and 1B.
In addition, the instructor U1 viewed from the student U2 (for example, a swing form sample operation) is recorded or displayed on the imaging display device 1A, and the recorded image is displayed on one or both of the imaging display devices 1A and 1B. Playback display is possible.

[2. Configuration example of imaging display device]

A configuration example of the imaging display device 1 (1A, 1B) will be described with reference to FIG.
The system controller 10 includes, for example, a microcomputer including a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a nonvolatile memory unit, and an interface unit. It is a control unit for controlling. The system controller 10 performs various arithmetic processes and exchanges control signals with each unit via the bus 13 based on a program held in an internal ROM or the like, and causes each unit to execute a required operation.

In the imaging display device 1, an imaging unit 3 is provided as a configuration for imaging a scene in the user's field of view.
The imaging unit 3 includes an imaging optical system, an imaging element unit, and an imaging signal processing unit.
In the imaging optical system in the imaging unit 3, the imaging system 3a shown in FIG. 1, the lens system configured with the aperture, the zoom lens, the focus lens, and the like, and the lens system are caused to perform a focusing operation and a zooming operation. Drive system and the like.
In addition, the imaging device section in the imaging section 3 is provided with a solid-state imaging device array that detects imaging light obtained by the imaging optical system and generates an imaging signal by performing photoelectric conversion. The solid-state imaging device array is, for example, a CCD (Charge Coupled Device) sensor array or a CMOS (Complementary Metal Oxide Semiconductor) sensor array.
The imaging signal processing unit in the imaging unit 3 includes a sample hold / AGC (Automatic Gain Control) circuit that performs gain adjustment and waveform shaping on a signal obtained by the solid-state imaging device, and a video A / D converter. Captured image data is obtained. Also, white balance processing, luminance processing, color signal processing, blur correction processing, and the like are performed on the captured image data.
Imaging is performed by the imaging unit 3 having these imaging optical system, imaging element unit, and imaging signal processing unit, and captured image data is obtained.
The system controller 10 controls the on / off of the imaging operation in the imaging unit 3, the zoom lens and focus lens drive control of the imaging optical system, the sensitivity and frame rate control of the imaging element unit, and the parameters of each process of the imaging signal processing unit. And execution processing settings.

The captured image data obtained by the imaging operation of the imaging unit 3 can be supplied to the display unit 2, the storage unit 17, and the communication unit 18 via the image processing unit 15.
The image processing unit 15 performs processing for converting the captured image data into a predetermined image data format and required signal processing for displaying on the display unit 2 according to the control of the system controller 10. Signal processing for monitor display on the display unit 2 includes, for example, brightness level adjustment, color correction, contrast adjustment, sharpness (outline emphasis) adjustment, screen division processing, character image composition processing, generation of an enlarged or reduced image, mosaic Image effect processing such as image / intensity inverted image / soft focus / highlight display of a part of the image / variation of color atmosphere of the entire image.
The image processing unit 15 also performs image data transfer processing between the imaging unit 3, the display unit 2, the storage unit 17, and the communication unit 18. That is, processing for supplying captured image data from the imaging unit 3 to the display unit 2, the storage unit 17, and the communication unit 18, processing for supplying image data reproduced by the storage unit 17 to the display unit 2, and communication unit 18 A process of supplying the image data received in step S2 to the display unit 2 is also performed.

A display unit 2 is provided as a configuration for displaying to the user in the imaging display device 1. The display unit 2 is provided with display panel units 2a and 2b made of the above-described liquid crystal panel and the like, and a display drive unit for driving the display panel units 2a and 2b.
The display driving unit includes a pixel driving circuit for displaying the image signal supplied from the image processing unit 15 on the display panel units 2a and 2b, which are liquid crystal displays, for example. That is, for each pixel arranged in a matrix in the display panel units 2a and 2b, a drive signal based on the video signal is applied at a predetermined horizontal / vertical drive timing, and display is executed. By this processing, display as an imaging monitor in the imaging unit 3, display of a reproduced image reproduced by the storage unit 17, and display of a received image received by the communication unit 18 are displayed on the display panel units 2a and 2b. Done.
Further, the display driving unit can control the transmittance of each pixel of the display panel units 2a and 2b to be in a through state (transparent or translucent state).
The system controller 10 performs on / off (through) control of the display operation in the display unit 2, instructions for processing parameters for image data to be displayed, screen area setting control, character generation instructions, and the like.

In addition, the imaging display device 1 is provided with an audio input unit 6, an audio processing unit 16, and an audio output unit 5.
The audio input unit 6 includes the microphones 6a and 6b shown in FIG. 1, and a microphone amplifier unit and an A / D converter for amplifying the audio signals obtained by the microphones 6a and 6b, and outputs audio data .

The audio data obtained by the audio input unit 6 is supplied to the audio processing unit 16.
The audio processing unit 16 controls the transfer of audio data according to the control of the system controller 10. That is, the audio data obtained by the audio input unit 6 is supplied to the audio output unit 5, the storage unit 17, and the communication unit 18. Alternatively, audio data reproduced by the storage unit 17 and audio data received by the communication unit 18 are supplied to the audio output unit 5.
The audio processing unit 16 performs processing such as volume adjustment, sound quality adjustment, and acoustic effect based on the control of the system controller 10.

The audio output unit 5 includes a pair of earphone speakers 5a shown in FIG. 1, and an amplifier circuit and a D / A converter for the earphone speakers 5a.
That is, the audio data supplied from the audio processing unit is converted into an analog audio signal by the D / A converter, amplified by the amplifier circuit, and output as audio from the earphone speaker 5a. As a result, the user can listen to the external sound, or the sound based on the sound data reproduced by the storage unit 17 or the sound data received by the communication unit 18.
The audio output unit 5 may be configured using a so-called bone conduction speaker.

The storage unit 17 is a part that records and reproduces image data (and audio data) on a predetermined recording medium. For example, it is realized as an HDD (Hard Disk Drive). Of course, various recording media such as a solid-state memory such as a flash memory, a memory card with a built-in solid-state memory, an optical disk, a magneto-optical disk, a hologram memory, etc. can be considered. What is necessary is just to be set as the structure which can be performed.
The storage unit 17 records image data (and audio data) obtained by imaging on a recording medium based on the control of the system controller 10. That is, the image data supplied via the image processing unit 15 and the audio data supplied via the audio processing unit 16 are encoded for recording on the recording medium and recorded on the recording medium.
The storage unit 17 can reproduce the recorded image data and audio data according to the control of the system controller 10. The reproduced image data is supplied to the display unit 2 through the image processing unit 15, and the audio data is supplied to the audio output unit 5 through the audio processing unit 16. The reproduced image data / audio data can also be supplied to the communication unit 18 as data to be transmitted to an external device (another imaging display device).

The communication unit 18 transmits / receives data to / from another imaging display device that is an external device. That is, the imaging display devices 1A and 1B illustrated in FIG. 2 perform mutual data communication by the communication unit 18 included in each.
The communication unit 18 may be configured to execute communication between short-distance imaging display devices by, for example, Bluetooth communication or optical communication using infrared rays. However, a configuration may be adopted in which communication between predetermined imaging display devices is performed by wireless LAN or other network communication.
Captured image data obtained by the imaging unit 3 is supplied to the communication unit 18 via the image processing unit 15. The voice data obtained by the voice input unit 6 is supplied via the voice processing unit 16. The communication unit 18 can perform communication encoding processing on the image data and audio data, perform modulation for wireless transmission, and transmit the modulated data to an external device. That is, real-time image data / sound data currently being picked up and collected by the image pickup display device 1 can be transmitted to an external device (another image pickup display device).
Further, the image data and audio data reproduced by the storage unit 17 can be encoded for communication, modulated for wireless transmission, and transmitted to another imaging display device.

The communication unit 18 receives image data / audio data transmitted from an external device (another imaging display device), demodulates it, and supplies it to the image processing unit 15 and the audio processing unit 16. In this case, the display unit 2 and the audio output unit 5 output the received image and audio.
Of course, the image data / audio data received by the communication unit 18 can be supplied to the storage unit 17 and recorded on the recording medium.

The imaging display device 1 is provided with an illumination unit 4 and an illumination control unit 18. The illuminating unit 4 includes a light emitting unit 4a illustrated in FIG. 1 and a light emitting circuit that emits light from the light emitting unit 4a (for example, an LED). The illumination control unit 18 causes the illumination unit 4 to perform a light emission operation based on an instruction from the system controller 10.
Since the light emitting unit 4a in the illuminating unit 4 is attached as shown in FIG. 1, the illuminating unit 4 performs an illuminating operation on the subject direction by the imaging lens 3a.

In the imaging display device 1, an operation input unit 11 is provided for a user operation.
As described above, the remote controller 30 is used for operation input by the user. Therefore, the operation input unit 11 is configured as a receiving unit that receives a command signal from the remote controller 30.
When receiving the command signal, the operation input unit 20 demodulates the command signal and supplies the operation input information to the system controller 10. As a result, the system controller 10 detects a user operation and performs a required control process in accordance with the operation.

Note that the operation input unit 11 may have an operation element such as a key and a dial, for example, and may be configured to detect a user operation as a key operation or the like, for example, a touch panel structure on the front side of the display panel units 2a and 2b An operation input may be performed by a user's touch operation, for example, by providing a touch pad at a predetermined portion.
Furthermore, it is good also as a structure which detects a user's conscious behavior.
In the case of a configuration for detecting user behavior, it is conceivable to provide an acceleration sensor, an angular velocity sensor, a vibration sensor, a pressure sensor, and the like.
For example, when the user taps the imaging display device 1 from the side, the acceleration sensor, the vibration sensor, or the like detects, for example, when the lateral acceleration exceeds a certain value, the system controller 10 performs an operation by the user. Can be recognized. Also, if it is possible to detect whether the user has struck the side part (the part corresponding to the eyeglass vine) from the right side or the side part from the left side by using an acceleration sensor or an angular velocity sensor, these can be used as predetermined operations. It can also be determined.
Further, it is possible to detect that the user turns his head or shakes his / her head with an acceleration sensor or an angular velocity sensor, and the system controller 10 can recognize this as a user operation.
Also, pressure sensors are arranged on the left and right side portions (portion corresponding to the eyeglasses) of the imaging display device 1, and when the user presses the right side with a finger, the zoom operation in the telephoto direction is performed. When it is pressed with a finger, it can be a zoom operation in a wide-angle direction.

Furthermore, a configuration as a biosensor may be provided so that user biometric information is detected and recognized as an operation input. Biological information is pulse rate, heart rate, electrocardiogram information, electromyography, respiratory information (eg, respiratory rate, depth, ventilation), sweating, GSR (skin electrical response), blood pressure, blood oxygen saturation level Skin surface temperature, brain waves (for example, information on α wave, β wave, θ wave, and δ wave), blood flow change, eye condition, and the like.
Then, the system controller 10 may recognize the detection information of the biosensor as a user operation input. For example, the user's conscious behavior may be an eye movement (change in line-of-sight direction or blinking), but if it is detected that the user has blinked three times, it is determined as a specific operation input. Furthermore, it is possible to detect that the user has attached or removed the imaging display device 1 or that a specific user has attached by detecting the biological information, and the system controller 10 turns on the power in response to the detection. / Off etc. may be performed.

The configuration of the imaging display device 1 has been described above, but this is only an example. Addition and deletion of various components are naturally conceivable depending on the actual system operation example and functions.

[3. Configuration example and operation of remote controller]

A configuration example of the remote controller 30 will be described with reference to FIGS.
FIG. 4A shows a state where the remote controller 30 is mounted on the user's finger. FIG. 5A shows a perspective view of the remote controller 30.
The remote controller 30 has a cylindrical main body 31 and a cylindrical operating element 32 positioned on the peripheral surface of the main body. The user can insert a forefinger or the like into the main body 31 and wear it in a ring shape.

The operating element 32 is attached to the main body 31 so as to be slidable.
FIGS. 5B, 5C, and 5D show states in which the operating element 32 is slid. That is, the operating element 32 is positioned at a substantially central portion of the main body 31 as shown in FIG. 5B, and is moved to a position above the main body 31 as shown in FIG. As shown in FIG. 5D, the slide movement is possible in the position moved to the lower side of the main body 31.
That is, in the wearing state of FIG. 4A, the user can move the operating element 32 to the fingertip side using the thumb or move it to the base side of the finger.
The operation mode is switched according to each slide position.
For example, a state at the center position as shown in FIG. 5B is a video operation mode in which operations related to video reproduction are performed. Further, the position state of FIG. 5C is a menu operation mode for operations related to the menu operation. The position state shown in FIG. 5D is a sheath operation mode for performing a transmittance variable operation of the display panel unit 2a.
The user can select a desired operation mode by arbitrarily sliding the operation unit 32.

Further, as shown in FIGS. 5E and 5F, the operating element 32 can be rotated (left and right) with respect to the main body 31 and can be pushed in.
For example, the inner diameter of the operating element 32 is made larger than the outer diameter of the main body 31, and the operating element 32 is attached around the main body 31 via a member 33. The member 33 is made of an elastic material or structure.
In this state, the operating element 32 can be arbitrarily rotated as shown in FIG. 5E, and can be pushed in as shown in FIG.
The user can perform an operation of rotating the operation unit 32 in an arbitrary direction using the thumb or pushing it with the thumb in a state where the user is put on the finger as shown in FIG.

Further, the remote controller 30 includes an attitude detection unit 41 (described later in FIG. 6), and can detect the attitude direction of the remote controller 30 itself. For example, it is possible to determine a state where the user stands his / her finger vertically as shown in FIG. 4B and a state where his / her finger is laid down horizontally as shown in FIG.
When the finger is vertical as shown in FIG. 4B, the rotation direction of the operation unit 32 is the horizontal direction. Hereinafter, such a posture is referred to as a “horizontal rotation posture”. Further, when the finger is leveled as shown in FIG. 4C, the rotation direction of the operation element 32 is the vertical direction. Hereinafter, such a posture is referred to as a “vertical rotation posture”.
For example, the rotation operation in the horizontal rotation posture and the rotation operation in the vertical rotation posture can be input with different operation information. As will be described later, the user can selectively use an operation for instructing a horizontal movement of the cursor in a menu operation and an operation for instructing a vertical movement by this posture change.

The internal configuration of the remote controller 30 will be described with reference to FIG.
The command signal control 35 is formed by a microcomputer and controls a command selection / transmission operation according to an operation input or the like.
The ROM 36 stores code values as various command signals transmitted from the remote controller 30 to the imaging display device 1.
The command transmission unit 37 performs modulation processing and transmission processing on the command code supplied from the command generation control unit 35.

The operation mode determination unit 38 detects the slide position state of the operation unit 32 described in FIGS. 5B, 5C, and 5D and notifies the command generation control unit 35 of the current slide position state. The operation mode determination unit 38 can be configured by, for example, a mechanical small switch structure, a position sensor using a photocoupler, or the like.
The rotation detection unit 39 detects the rotation direction and the rotation amount of the operation unit 32 and notifies the command generation control unit 35 of the information. This can also be constituted by a switch mechanism, a photocoupler, or the like.
The press detection unit 40 detects a state in which the operation unit 32 is pressed as shown in FIG. 5F and notifies the command generation control unit 35 of the pressed state. For example, it can be realized by a switch mechanism.
The posture detection unit 41 detects the horizontal rotation posture and the vertical rotation posture as shown in FIGS. For example, a gyro sensor can be used. It should be noted that even if it is not completely horizontal or vertical in practice, for example, it is determined whether it is closer to horizontal or vertical than a tilt of about 45 °, and either a horizontal rotation posture or a vertical rotation posture detection signal To the command generation controller 35.

An example of command transmission processing executed by the command generation control unit 35 in the remote controller 30 will be described with reference to FIG.
The command generation control unit 35 performs command signal transmission control as the processing of FIG. 7 based on information from each of the operation mode determination unit 38, the rotation detection unit 39, the press detection unit 40, and the posture detection unit 41.

The command generation control unit 35 monitors information from the operation mode determination unit 38, the rotation detection unit 39, and the press detection unit 40 as steps F10, F11, F12, and F13.
In step F10, as detection information from the operation mode determination unit 38, it is monitored whether or not the operation unit 32 has been slid. That is, the detected change in the position state of the operating element 32 is monitored.
When the slide movement of the operation section 32 is detected, the command generation control section 35 proceeds to step F14 and sets the mode flag internally according to the position state after the slide movement. That is, when the state shown in FIG. 5A is obtained by the slide movement, the mode flag is set to a value indicating the video operation mode. If the state shown in FIG. 5B is reached by the sliding movement, the mode flag is set to a value indicating the menu operation mode. If the state shown in FIG. 5C is reached by the slide movement, the mode flag is set to a value indicating the see-through operation mode.

When the command generation control unit 35 recognizes the right rotation of the operation unit 32 from the detection information from the rotation detection unit 39, the process proceeds from step F11 to F15, where the current operation mode is confirmed by the mode flag. To do.
If it is the menu operation mode (that is, if the rotation operation is performed at the slide position in FIG. 5C), the process proceeds to step F16. In this case, the current detection information of the posture detection unit 41 is confirmed, and it is determined whether the posture is currently in the horizontal rotation posture or the vertical rotation posture.
If it is currently in the vertical rotation posture, the process proceeds to step F17 to perform output control of the cursor downward movement command. That is, a command code as a cursor downward movement command is selected from the command codes stored in the ROM 36, and this is supplied to the command transmission unit 37 to be transmitted to the imaging display device 1A.
If the current position is the horizontal rotation posture, the process proceeds to step F18 to perform output control of the cursor right movement command. That is, a command code as a cursor right movement command is selected from the command codes stored in the ROM 36, and is supplied to the command transmission unit 37 to be transmitted to the imaging display device 1A.
Note that operations on the menu performed on the imaging display device 1A side in response to commands related to cursor movement transmitted in steps F17 and F18 and steps F23 and F24 described later will be described later with reference to FIG.

When the video operation mode is determined at the time of step F15 (that is, when the rotation operation is performed at the slide position in FIG. 5B), the command generation control unit 35 proceeds to step F19 and performs fast reverse (REW). Controls command output. That is, a command code as a fast reverse command is selected from the command codes stored in the ROM 36, and this is supplied to the command transmission unit 37 to be transmitted to the imaging display device 1A.
For example, the imaging display device 1A performs fast reverse playback in response to the fast reverse command.

When it is determined that the sheath operation mode is selected at the time of step F15 (that is, when the rotation operation is performed at the slide position in FIG. 5D), the command generation control unit 35 proceeds to step F20, and the transmittance reduction command is received. Perform output control. That is, a command code as a transmittance reduction command is selected from the command codes stored in the ROM 36, and this is supplied to the command transmission unit 37 to be transmitted to the imaging display device 1A.
For example, the imaging display device 1A performs a process of reducing the transmittance of the display panel unit 2a in response to the transmittance reduction command.

When the command generation control unit 35 recognizes the left rotation of the operation unit 32 from the detection information from the rotation detection unit 39, the process proceeds from step F12 to F20, where the current operation mode is confirmed by the mode flag. To do.
If it is the menu operation mode, the process proceeds to step F22, where the current detection information of the posture detection unit 41 is confirmed, and it is determined whether the posture is the current horizontal rotation posture or the vertical rotation posture.
If it is currently in the vertical rotation posture, the process proceeds to step F23 to perform output control of the cursor up command. That is, a command code as a cursor up movement command is selected from command codes stored in the ROM 36, and this is supplied to the command transmission unit 37 to be transmitted to the imaging display device 1A.
If the current position is the horizontal rotation posture, the process proceeds to step F24, and the output control of the cursor left movement command is performed. That is, a command code as a cursor left movement command is selected from the command codes stored in the ROM 36, and is supplied to the command transmission unit 37 to be transmitted to the imaging display device 1A.

If the video operation mode is determined at the time of step F21, the command generation control unit 35 proceeds to step F25 and performs output control of a fast forward (FF) command. That is, a command code as a fast-forward command is selected from the command codes stored in the ROM 36, and this is supplied to the command transmission unit 37 to be transmitted to the imaging display device 1A.
For example, the imaging display device 1A performs fast-forward reproduction in response to the fast-forward command.

When it is determined that the sheath operation mode is selected at the time of step F21, the command generation control unit 35 proceeds to step F26 and performs output control of the transmittance increase command. That is, the command code as the transmittance increase command is selected from the command codes stored in the ROM 36, and this is supplied to the command transmission unit 37 to be transmitted to the imaging display device 1A.
For example, in the imaging display device 1A, processing for increasing the transmittance of the display panel unit 2a is performed according to the transmittance increase command.

When the command generation control unit 35 recognizes the pressing operation based on the detection information from the pressing detection unit 40, the command generation control unit 35 advances the process from step F13 to F27, and in this case performs output control of the determination command. That is, a command code as a determination command is selected from the command codes stored in the ROM 36, supplied to the command transmission unit 37, and transmitted to the imaging display device 1A.
For example, in the imaging display device 1A, processing based on the operation state at that time is performed in response to the determination command. For example, if a menu item is being selected, it is recognized as an operation input for selection decision. In this case, processing according to the selected item, or when video content is selected, image reproduction processing of the video content is performed.
If the image is being reproduced, the decision command is recognized as an operation input for stopping reproduction, and if the reproduction is stopped, the decision command is recognized as an operation input for resuming reproduction.
If the captured image data is in recording or transmission standby, the determination command is recognized as an operation input for starting recording or transmission of captured image data. If the recording or transmission operation is in progress, the determination command is recorded or transmitted. Recognized as a stop operation input.

  As described above, the remote controller 30 transmits a command signal to the imaging display device 1A in response to a user operation input. With the processing in FIG. 7, various operation input information required by the user can be supplied as command signals to the imaging display device 1 </ b> A according to the slide, rotation, press, and posture of the operation unit 32.

In the example of FIG. 7, the command generation control unit 35 selects and transmits a command code indicating specific command contents to the imaging display device 1 </ b> A. Information indicating only operation and posture detection contents may be transmitted as a command code.
That is, when the command generation control unit 35 recognizes the slide, rotation, press, etc. of the operation unit 32, the information on the slide position (operation mode by the slide position), the information on the rotation direction, the press information, and the posture information are as follows. These are transmitted as command signals to the imaging display device 1A. In that case, the system controller 10 on the imaging display device 1A side may determine the contents of the operation input by the determination as shown in FIG. 7 from the slide position information, the rotation direction information, the posture information, and the press information. .
For example, if information corresponding to the video operation mode and information about right rotation are transmitted as the slide position information, the system controller 10 of the imaging display device 1A performs the same processing as in FIG. It can be determined that it is a command.
Similarly, for example, if information corresponding to the menu operation mode, information about left rotation, and information about horizontal rotation posture are transmitted as slide position information, the system controller 10 of the imaging display device 1A is equivalent to FIG. By performing the processing, it can be determined that the command is a cursor left movement command.

That is, the remote controller 30 simply transmits, as a command signal, state change information and posture of the operation unit 32 applied to the user's operation, and the actual command signal content is on the system controller 10 side of the imaging display device 1A. It is a method of interpreting.
This eliminates the need for the ROM 36 for storing command codes on the remote controller 30 side, simplifies the transmission control process, and is more suitable for downsizing the remote controller 30.

By the way, in steps F17, F18, F23, and F24 in FIG. 7, a cursor movement command is transmitted and output. An example of control on the menu on the imaging display device 1A side in accordance with the cursor movement command will be described with reference to FIG. .
FIG. 8 shows an example in which main menu items MM (MM1, MM2, MM3, MM4, MM5) are displayed in the horizontal direction as the menu format. The main menu item MM is actually an image or a character indicating the contents of the main menu item. For example, items such as “device setting”, “video”, “audio”, “operation setting”, etc. are prepared.

A sub menu item MS is prepared for each main menu item, and the sub menu item MS is displayed for the main menu item where the cursor K is located.
For example, in FIG. 8A, the cursor K is positioned at the main menu item MM1, but in this case, the sub menu items MS (MS11, MS12, MS13) for the main menu item MM1 are displayed in the vertical direction.
As shown in FIG. 8B, when the cursor K is moved to the main menu item MM3, the sub menu items MS (MS31, MS32) for the main menu item MM3 are displayed in the vertical direction.
For example, when the main menu item MM1 is “device setting”, various device setting items are displayed as the sub menu items MS11, MS12, and MS13.
In the case of the main menu item MM3 “video”, for example, the image content recorded in the storage unit 17 is displayed as the sub menu items MS31 and MS32.

The system controller 10 performs processing according to cursor movement or menu item determination in accordance with a user operation while the menu screen is displayed on the display unit 2.
The user can perform menu operations using the remote controller 30 while looking at the menu screen displayed on the display panel unit 2a.
For example, by rotating the operation unit 32 left and right with the finger rotated horizontally as shown in FIG. 4B, the system controller 10 recognizes the cursor left movement command or the cursor right movement command and performs cursor movement control. Thereby, on the display, for example, as shown in FIG. 8A to FIG. 8B, the cursor K moves on the main menu item MM (the cursor moves left and right).
Further, when the user turns the operating unit 32 left and right with the finger in the vertical rotation posture of FIG. 4C, the system controller 10 recognizes the cursor up command or the cursor down command and performs cursor movement control. . Thereby, on the display, for example, as shown in FIG. 8B to FIG. 8C, the cursor K moves on the submenu item MS (the cursor moves up and down).
That is, the cursor is moved left and right or up and down on the menu screen in accordance with the rotation direction of the operation unit 32 by the user's rotation operation. It is possible to perform the same operation as.

  In addition, the user may press the operation unit 32 when selecting and deciding after moving the cursor K in this way. The system controller 10 recognizes this as a determination command. For example, when the user presses the operation unit 32 in the state of the cursor K in FIG. 8C, the system controller 10 recognizes the determination operation of the submenu item MS32 and executes control processing according to the determination operation. .

As described above, the menu operation (cursor movement operation and determination operation) can be performed using the remote controller 30, and thus various operations can be executed using the remote controller 30 by setting the menu item.

[4. Controlled device mode setting process]

For example, as shown in FIG. 2, in a situation where the instructor U1 is wearing the imaging display device 1A and the remote controller 30, and the student U2 is wearing the imaging display device 1B, the instructor U1 is responsible for each imaging display device 1A. The remote controller 30 can be used to perform the 1B imaging operation and the visual exchange operation by transferring the captured image data.
The remote controller 30 is an operation device corresponding to the imaging display device 1A, and the command signal transmitted from the remote controller 30 is specified by the target device being specified, for example, by including the device ID of the imaging display device 1A. Then, it is received and demodulated by the imaging display device 1A. In this case, the other imaging display device 1B does not directly deal with the command signal from the remote controller 30. That is, on the imaging display device 1B side, even if a command signal from the remote controller 30 is received, if it is determined that the device ID received together with the command signal is not itself, the command signal is invalid.
For example, by doing in this way, the remote controller 30 can be positioned as an operating device corresponding to the imaging display device 1A.

Accordingly, the instructor U1 can basically perform an operation related to the imaging display device 1A worn by the remote controller 30, but in this example, the instructor U1 further operates the student with the remote controller 30. The required operation can be executed by the imaging display device 1B on the U2 side.
In particular, the imaging operation can be executed on the imaging display device 1B side in addition to instructing execution on the imaging display device 1A.
In addition, regarding the display at the time of image capture or playback, in addition to instructing execution on the image capture display device 1A, it can be performed on the image capture display device 1B side or both.
Moreover, the transmittance of the display panel units 2a and 2b of the display units 2 of the imaging display devices 1A and 1B can be designated.

In these cases, specifically, the following operation can be instructed by the remote controller 30.
Imaging is performed by the imaging display device 1A, and the captured image data is recorded (and / or displayed) by the imaging display device 1A.
Imaging is performed by the imaging display device 1B, and the captured image data is recorded (and / or displayed) by the imaging display device 1A.
Imaging is performed by the imaging display device 1A, and the captured image data is displayed on the imaging display device 1B. In this case, the captured image data may be recorded and / or displayed on the imaging display device 1A side.
The captured image data to be reproduced by the imaging display device 1A is displayed on the imaging display device 1A.
The captured image data to be reproduced on the imaging display device 1A is displayed on the imaging display device 1B.
The captured image data to be reproduced by the imaging display device 1A is displayed on both the imaging display devices 1A and 1B.
-Increase or decrease the transmittance of the display unit 2 of the imaging display device 1A.
-Increase or decrease the transmittance of the display unit 2 of the imaging display device 1B.
-Increase or decrease the transmittance of the display units 2 of the imaging display devices 1A and 1B.

In order to execute these various operations, in the imaging display device 1A, the controlled device mode is set in accordance with an operation from the remote controller 30.
For example, in the imaging display device 1 </ b> A, setting items for the controlled device mode are prepared in the menu items as described with reference to FIG. 8. As the device mode, “own device mode”, “other device mode”, and “two-device mode” can be selected.

In this case, the lecturer U1 uses the remote controller 30 to perform the operation in the menu operation mode described above. That is, a cursor movement command and a determination command are transmitted from the remote controller 30 to the imaging display device 1A.
In response to this, the system controller 10 of the imaging display device 1A performs processing such as menu display and cursor movement on the menu display. In particular, as shown in FIG. In step F102, the controlled device mode is set to “own device mode”, “other device mode”, or “both device mode” in response to the operation. To do. As a result, the system controller 10 internally switches the controlled device mode.

In the case of the own device mode, the system controller 10 basically performs the following processing.
When there is an instruction to record a captured image from the remote controller 30, the system controller 10 causes the imaging unit 3 of the own device (imaging display device 1 </ b> A) to capture an image and causes the storage unit 17 to execute recording.
When there is a reproduction instruction, the system controller 10 reproduces the image data in the storage unit 17 of the own device (imaging display device 1A) and causes the display unit 2 of the own device (imaging display device 1A) to execute display.
When there is an instruction for transmittance control, the system controller 10 controls the transmittance of the display unit 2 of the own device (imaging display device 1A).

In the case of the other device mode, the system controller 10 basically performs the following processing.
When there is an instruction to record a captured image from the remote controller 30, the system controller 10 causes the imaging unit 3 of the other device (imaging display device 1B) to perform imaging, and the storage unit 17 of the own device (imaging display device 1A). To execute recording of image data.
When there is a reproduction instruction, the system controller 10 reproduces the image data in the storage unit 17 of the own device (imaging display device 1A) and causes the display unit 2 of the other device (imaging display device 1B) to execute display.
When there is an instruction for transmittance control, the system controller 10 controls the transmittance of the display unit 2 of the other device (imaging display device 1B).

In the case of the both-machine mode, the system controller 10 basically performs the following processing.
When there is a reproduction instruction from the remote controller 30, the system controller 10 reproduces the image data in the storage unit 17 of the own device (imaging display device 1A), and the display unit 2 of the own device (imaging display device 1A). The display is executed and the display on the display unit 2 of the other device (imaging display device 1B) is executed.
When there is an instruction for transmittance control, the system controller 10 controls the transmittance of the display unit 2 of the own device (imaging display device 1A) and the other device (imaging display device 1B).

[5. Transmission control processing]

FIG. 10 shows the processing of the system controller 10 of the imaging display device 1A when the lecturer U1 operates the remote controller 30 in the see-through operation mode described above.
In the following description, the system controller 10 of the imaging display device 1A is referred to as “system controller 10 (A)” and the system controller 10 of the imaging display device 1B is referred to as “system controller 10 (B)” for ease of explanation.
Similarly, with respect to other parts such as the imaging unit 3, the display unit 2, the storage unit 17, and the communication unit 18, in the case of the imaging display device 1A side, the imaging unit 3 (A), the display unit 2 (A), and the storage unit 17 (A), communication unit 18 (A), and in the case of the imaging display device 1B side, imaging unit 3 (B), display unit 2 (B), storage unit 17 (B), communication unit 18 (B), and so on. Describe.

  When a transmittance control command instructing an increase or decrease in transmittance is transmitted from the remote controller 30, the system controller 10 (A) advances the process from steps F201 to F202 in FIG. Here, the process branches according to the currently selected controlled device mode (the controlled device mode selected in the process of FIG. 9).

  If the current mode is the own mode, the system controller 10 (A) proceeds to step F203 and controls the increase or decrease of the transmittance with respect to the display unit 2 (A) of the own unit (imaging display device 1A).

  If the current mode is the other device mode, the system controller 10 (A) proceeds to step F205, and transmits the transmittance control command from the communication unit 18 (A) to the other device (imaging display device 1B). When the system controller 10 (B) on the imaging display device 1B side receives the transmittance control command from the imaging display device 1A side, the system controller 10 (B) proceeds from step F301 to F302, and displays on the display unit 2 (B) on the imaging display device 1B side. On the other hand, the increase or decrease of the transmittance is controlled.

  If the current mode is the dual-device mode, the system controller 10 (A) proceeds to step F204, and first controls the increase or decrease of the transmittance on the display unit 2 (A) of the own device (imaging display device 1A). In step F205, the transmission control command is transmitted from the communication unit 18 (A) to the other device (imaging display device 1B). When the system controller 10 (B) on the imaging display device 1B side receives the transmittance control command from the imaging display device 1A side, the system controller 10 (B) proceeds from step F301 to F302, and displays on the display unit 2 (B) on the imaging display device 1B side. On the other hand, the increase or decrease of the transmittance is controlled.

By performing the above processing, the instructor U1 can arbitrarily change the transmittance of the display unit 2 of the imaging display device 1A worn by the instructor U1 using the remote controller 30, and the student U2 It is also possible to arbitrarily change the transmittance of the display unit 2 of the imaging display device 1A attached to the camera. Furthermore, the transmittances of the display units 2 of the imaging display devices 1A and 1B can be changed simultaneously.

[6. Imaging processing (Self-device imaging, own-recording, own-device display)]

Processing when the lecturer U1 operates the remote controller 30 to execute imaging will be described. First, the case where the imaging display device 1A is set to the own device mode will be described.
For example, in the menu item of the operation menu of the imaging display device 1A, imaging and recording items of the captured image data are prepared, and the instructor U1 operates the remote controller 30 in the menu operation mode, whereby the imaging display device 1A. In addition, an instruction to record a captured image can be given.
The system controller 10 (A) of the imaging display device 1A advances the process from step F401 to F402 in FIG. 11 when there is an instruction to record the captured image data by a menu operation, for example. Is determined.
Here, the process branches depending on whether the own machine mode or the other machine mode. Note that the case of the dual machine mode at this point will be described later.

In the case of the own device mode, the system controller 10 (A) proceeds to the processing of FIG. This is a process in which the imaging display device 1A records captured image data captured by itself.
First, in step F403 in FIG. 12, the system controller 10 (A) controls the display unit 2 (A) to the see-through state or the imaging monitor state.
The imaging monitor state is a state in which captured image data obtained by the imaging unit 3 (A) is displayed on the display unit 2 (A). That is, it is a state in which the user can confirm the currently captured image on the display unit 2 (A). By setting the display unit 2 (A) to the imaging monitor state, the monitor panel display of the captured image data obtained by the imaging unit 3 (A) is displayed on the display panel units 2a and 2b of the display unit 2 (A). Executed.
However, since the imaging unit 3 (A) captures the direction of the user's field of view, the captured image obtained by the imaging unit 3 (A) is displayed by the user via the display unit 2 (A) that is a see-through. It is almost the same as the image you are viewing. For this reason, the display panel portions 2a and 2b of the display portion 2 (A) may be in a see-through state.

  Next, in step F404, the system controller 10 (A) instructs the imaging unit 3 (A) to start imaging and instructs the storage unit 17 (A) to perform recording standby. Thereby, the imaging unit 3 (A) starts imaging.

Thereafter, the system controller 10 (A) waits for a determination command (command by pressing operation of the operation unit 32) from the remote controller 30. If the determination command is received during recording standby, the system controller 10 (A) determines that this is a recording start operation. If the determination command is received during recording, the system controller 10 (A) determines that this is a recording stop operation.
Accordingly, if the determination command is received when the recording standby is set in step F404, the system controller 10 (A) interprets it as a start command and advances the process from step F405 to F406. Then, the storage unit 17 (A) is instructed to start recording captured image data. Thereby, recording of the captured image data obtained by the imaging unit 3 (A) is started.

  When the determination command is received after the recording is started under the control of step F406, the system controller 10 (A) interprets it as a stop command and advances the process from step F407 to F408. In this case, the system controller 10 (A) instructs the storage unit 17 (A) to stop recording the captured image data. Thereby, the recording of the captured image data obtained by the imaging unit 3 (A) is stopped. The storage unit 17 (A) enters a recording standby state.

Thereafter, when a determination command is further received, the system controller 10 (A) interprets it as a start command, proceeds from step F405 to F406, and resumes recording. If a determination command is received thereafter, it is interpreted as a stop command, and the process proceeds from step F407 to F408 to stop the recording operation.
Therefore, the lecturer U1 can execute the recording of the captured image data or stop the recording by pressing the operation unit 32 of the remote controller 30. In particular, the recording of the captured image data is a view scene of the lecturer U1. That is, even if the instructor U1 himself does not care about imaging, an image that accurately captures a portion that the instructor U1 thinks should be noted (for example, a portion to be noted as the swing form of the student U2).

When the system controller 10 (A) detects the end trigger, the process proceeds from step F409 to step F410, the imaging / recording end process is performed, and the series of processes ends.
The end trigger may be such that, for example, the instructor U1 performs a menu operation or the like to instruct the end of captured image recording, or a predetermined operation (for example, two consecutive presses) of the remote controller 30 is set as the end operation. It may be.
Further, when a predetermined time or more has elapsed in the recording standby state in step F408, the end controller and the system controller 10 (A) may determine that.
As the end processing, for example, each unit is returned to the state immediately before the instruction to record the captured image is issued in step F401.

[7. Imaging processing (imaging other device, own device recording, own device display)]

When the system controller 10 (A) of the imaging display device 1A is instructed to record captured image data, the process proceeds from step F401 to F402 in FIG. 11, and the current controlled device mode is the other device mode. The process proceeds to FIG. This is a process in which the imaging display device 1A records and displays captured image data captured by another device (imaging display device 1B).

  First, in step F420 of FIG. 13, the system controller 10 (A) transmits an imaging and transmission standby command from the communication unit 18 (A) to the imaging display device 1B. The storage unit 17 (A) is instructed to perform recording standby.

  When the system controller 10 (B) on the imaging display device 1B side receives the imaging and transmission standby commands from the imaging display device 1A, the process proceeds from step F501 to F502, and the display unit 2 (B ) To the see-through state or the imaging monitor state. Next, in step F503, the system controller 10 (B) of the imaging display device 1B instructs the imaging unit 3 (B) to start imaging and instructs the communication unit 18 (B) to perform transmission standby. Thereby, the imaging unit 3 (B) starts imaging.

The system controller 10 (A) of the imaging display device 1 </ b> A waits for a determination command from the remote controller 30 (command by pressing operation of the operation unit 32). As in the case of FIG. 12 described above, if the determination command is received during recording standby, the system controller 10 (A) determines that this is a recording start operation. If the determination command is received during recording, the system controller 10 (A) determines that this is a recording stop operation.
Therefore, if the determination command is received when the recording standby is set in step F420, the system controller 10 interprets it as a start command and advances the processing from step F421 to F422. Here, first, the system controller 10 (A) transmits a transmission start command from the communication unit 18 (A) to the imaging display device 1B.
When the system controller 10 (B) of the imaging display apparatus 1B recognizes the reception of the transmission start command, the system controller 10 (B) proceeds from step F504 to F505 to start transmission of the captured image data. That is, an operation of transmitting the captured image data obtained by the imaging unit 3 (B) to the imaging display device 1A by the communication unit 18 (B) is started.
In step F423, the system controller 10 (A) on the imaging display device 1A side receives the captured image data transmitted from the imaging display device 1B by the communication unit 18 (A) and records it in the storage unit 17 (A). Start operation.
In step F425, the system controller 10 (A) also starts an operation of displaying the captured image data transmitted from the imaging display device 1B on the display unit 2 (A).
In particular, in this case, it is possible to set so that display on the display unit 2 (A) is not executed. For example, the instructor U1 can be arbitrarily set by a menu operation. If it is set not to be displayed on the display unit 2, the process does not proceed from step F424 to step F425.

Through the processing of steps F422, F423, and F425, the captured image data captured by the imaging display device 1B is recorded and displayed on the imaging display device 1A side.
Accordingly, the instructor U1 wearing the imaging display device 1A can see the view scene of the student U2 wearing the imaging display device 1B on the display unit 2 (A).

When the determination command from the remote controller 30 is received after the recording is started by the control in step F423, the system controller 10 (A) interprets it as a stop command and advances the processing from step F426 to F427. In this case, the system controller 10 (A) transmits a transmission stop command from the communication unit 18 (A) to the imaging display device 1B.
When the system controller 10 (B) of the imaging display apparatus 1B recognizes the reception of the transmission stop command, the system controller 10 (B) proceeds from step F506 to F507 and stops the transmission of the captured image data by the communication unit 18 (B). Then, a transmission standby state is set.
On the imaging display device 1A side, the system controller 10 (A) instructs the storage unit 17 to stop recording the captured image data in step F428. Further, the display of the received captured image data on the display unit 2 is stopped, and for example, the display is returned to the see-through state.
That is, transmission on the imaging display device 1B side is stopped, and recording and display on the imaging display device 1A side are stopped.

Thereafter, when a determination command is further received from the remote controller 30, the system controller 10 (A) is interpreted as a start command, and the process proceeds from step F421 to F422, F423, and F425 to perform the same processing as described above. Then, transmission is resumed on the imaging display device 1B side, and recording and display on the imaging display device 1A side are resumed.
If a determination command is received from the remote controller 30 thereafter, the system controller 10 (A) interprets it as a stop command, proceeds from steps F426 to F427, F428, and performs the same processing as described above, thereby performing the imaging display device 1B. The transmission is stopped on the side, and recording and display on the imaging display device 1A side are stopped.

Therefore, the lecturer U1 can execute or stop the recording and display of the image of the view scene of the student U2 by pressing the operation unit 32 of the remote controller 30.
For example, FIG. 15B shows a captured image of the lecturer U1 as an example of an image captured by the imaging display device 1B worn by the student U2, but the lecturer U1 operates with the remote controller 30. Thus, in the imaging display device 1A worn by the instructor U1, it is possible to arbitrarily record and display such an image of the instructor U1.

When the system controller 10 (A) detects the end trigger, the system controller 10 (A) proceeds from step F429 to F430 and causes the communication unit 18 (A) to transmit an end notification to the imaging display device 1B.
In step F421, end processing is performed to end a series of processing.
The end trigger may be such that, for example, the instructor U1 performs a menu operation or the like to instruct the end of captured image recording, or a predetermined operation (for example, two consecutive presses) of the remote controller 30 is set as the end operation. It may be.
Further, when a predetermined time or more has elapsed in the recording standby state in step F428, the system controller 10 may determine the end trigger.
As the end processing, for example, each unit is returned to the state immediately before the instruction to record the captured image is issued in step F401.
On the other hand, on the imaging display device 1B side, when the end notification is received, the system controller 10 (B) proceeds from step F508 to F509, performs end processing such as the end of the imaging operation of the imaging unit 3 (B), and ends the processing. .

[8. Imaging processing (Self-device imaging, own-recording, other-device display)]

As shown in FIGS. 12 and 13, in the imaging display device 1 </ b> A, the captured image data captured by the imaging unit 3 (A) of the own device is recorded by the storage unit 17 (A) or the imaging unit 3 of the other device. The captured image data captured in (B) can be recorded in the storage unit 17 (A) or displayed on the display unit 2 (A). Further, a processing example as shown in FIG. 14 is also conceivable.
FIG. 14 shows a processing example in which captured image data captured by the imaging display device 1A by the imaging unit 3 (A) is recorded by the storage unit 17 (A) and displayed on the display unit 2 (B) of the imaging display device 1B. It is.

The process of FIG. 14 can be considered as another example of the process when it is determined as the own device mode in step F402 of FIG. In FIG. 14, the same processes as those in FIG. 12 are given the same step numbers.
When the system controller 10 (A) proceeds to the process of FIG. 14, in step F403, the system controller 10 (A) controls the display unit 2 (A) to the see-through state or the imaging monitor state.
In step F440, the system controller 10 (A) instructs the imaging unit 3 (A) to start imaging. Thereby, the imaging unit 3 (A) starts imaging. Further, the system controller 10 (A) instructs the communication unit 18 (A) to perform transmission standby, and instructs the storage unit 17 (A) to perform recording standby.

Thereafter, the system controller 10 (A) waits for a determination command (command by pressing operation of the operation unit 32) from the remote controller 30. When the determination command is received during transmission and recording standby, the system controller 10 (A) determines that it is a transmission and recording start operation. Further, when the determination command is received during transmission and recording, the system controller 10 (A) determines that it is a transmission and recording stop operation.
Accordingly, when the determination command is received when the transmission standby and the recording standby are set in step F440, the system controller 10 (A) interprets the determination command as a start command and advances the processing from step F405 to F441.
In step F441, the system controller 10 (A) transmits a display standby command from the communication unit 18 (A) to the imaging display device 1B.
In step F442, the storage unit 17 (A) is instructed to start recording captured image data, and the communication unit 18 (A) is instructed to start transmission of captured image data. Thereby, recording and transmission of the captured image data obtained by the imaging unit 3 (A) are started.

When the system controller 10 (B) on the imaging display device 1B side receives the display standby command from the imaging display device 1A, the system controller 10 (B) advances the process from step F701 to F702, and displays it on the display unit 2 (B) of the imaging display device 1B. On the other hand, the display of the received image is instructed. For example, the image display state is controlled from the see-through state.
Thereafter, since the captured image data is transmitted in Step F442 on the imaging display device 1A side, the system controller 10 (B) displays the captured image data received by the communication unit 18 (B) in Step F703. Display in part 2 (B) is started.

Through the processing of Steps F441, F442, and Steps F702 and F703, the captured image data captured by the imaging display device 1A is recorded on the imaging display device 1A side and displayed on the imaging display device 1B side.
Therefore, the student U2 wearing the imaging display device 1B can see the view scene viewed by the lecturer U1 wearing the imaging display device 1A on the display unit 2 (B).

When the determination command is received after transmission and recording are started under the control of step F442, the system controller 10 (A) interprets it as a stop command and advances the processing from step F407 to F443. In this case, the system controller 10 (A) instructs the storage unit 17 (A) to stop recording the captured image data, and stops the transmission of the captured image data by the communication unit 18 (A). Thereby, recording and transmission of the captured image data obtained by the imaging unit 3 (A) are stopped. The storage unit 17 (A) enters a recording standby state, and the communication unit 18 (A) enters a transmission standby state.
In step F444, the system controller 10 (A) transmits a stop notification from the communication unit 18 (A) to the imaging display device 1B.

  When the system controller 10 (B) on the imaging display device 1B side receives the stop notification from the imaging display device 1A, the system controller 10 (B) advances the process from step F704 to F705 to stop the reception / display of the captured image data. That is, the operation state of displaying the received image on the display unit 2 (B) is terminated, and for example, the display unit 2 is returned to the see-through state.

Thereafter, when the determination command is further received, the system controller 10 (A) of the imaging display apparatus 1A interprets the determination command as a start command, and proceeds from step F405 to F441 and F442 to execute display standby command transmission. After that, transmission and recording are resumed. On the imaging display device 1B side, processing in steps F702 and F703 is performed correspondingly.
When the determination command is received thereafter, the system controller 10 (A) interprets it as a stop command, proceeds from steps F407 to F443 and F444, stops the transmission and recording operations, and transmits a stop notification. On the imaging display device 1B side, processing of steps F704 and F705 is performed correspondingly.

Therefore, the instructor U1 presses the operation unit 32 of the remote controller 30 to record the captured image data as his / her field of view and allow the student U2 to view or stop them. Can be.
For example, FIG. 15A shows a captured image of the student U2 as an example of an image captured by the imaging display device 1A attached to the instructor U1, and the instructor U1 operates with the remote controller 30. Thus, in the imaging display device 1B worn by the student U2, it is arbitrarily possible to display such an image of the student U2 and to record in the imaging display device 1A worn by the lecturer U1. It becomes possible.

When the system controller 10 (A) detects the end trigger, the process proceeds from step F409 to step F410, the imaging / recording end process is performed, and the series of processes ends.
As a modification of the processing of FIG. 14, an example in which only the captured image data is transmitted and the recording is not performed on the imaging display device 1A side can be considered.

When the instructor U1 performs an operation of instructing the captured image recording by the remote controller 30, the processes as shown in FIGS.
Note that if the mode is the both-device mode at the time of step F402 in FIG. 11, regarding the captured image recording, the processing in FIG. 12 or FIG.
Alternatively, the processing of FIG. 12 may be performed in the case of the own device mode, and the processing of FIG. 14 may be performed in the case of the both devices mode.
Further, in the case of the both-machine mode, imaging may be performed by both the imaging display devices 1A and 1B.
In that case, both captured image data may be recorded and displayed in the storage unit 17 (A) of the imaging display device 1A. Alternatively, regarding the display, both captured images may be simultaneously displayed by screen division on one or both of the display unit 2 (A) and the display unit 2 (B).
In the case of the both-machine mode, imaging is performed by both the imaging display devices 1A and 1B, and the captured image data of the imaging display device 1A is recorded in the storage unit 17 (A) of the imaging display device 1A. The captured image data of 1B is recorded in the storage unit 17 (B) of the imaging display device 1B, and for display, one or both of the display unit 2 (A) and the display unit 2 (B) is divided into screens. Both captured images may be displayed simultaneously.
Further, in the case of the both-device mode, imaging is performed by both the imaging display devices 1A and 1B, and the captured image data of the imaging display device 1A is recorded in the storage unit 17 (B) of the imaging display device 1B and the display unit. 2 (B), and the captured image data of the imaging display device 1B may be recorded in the storage unit 17 (A) of the imaging display device 1A and displayed on the display unit 2 (A). Of course, in this case also, one or both of the display unit 2 (A) and the display unit 2 (B) may display both captured images simultaneously by dividing the screen.

In this example, it is described that an instruction to record a captured image (instruction recognized in step F401 in FIG. 11) is given after setting the own machine mode, the other machine mode, and the both machine mode. As an operation for instructing image recording, a menu item may be prepared so that self-camera imaging, other-camera imaging, or both-camera imaging can be directly specified.

[9. Playback processing (Self playback, display)

Next, processing when the lecturer U1 operates the remote controller 30 to execute image reproduction will be described. First, the case where the imaging display device 1A is set to the own device mode will be described.
For example, the menu item of the operation menu of the imaging display device 1A indicates the image content recorded in the storage unit 17 (A), and the instructor U1 operates the remote controller 30 in the menu operation mode, whereby the imaging display device In 1A, it is possible to instruct reproduction by designating image content.
The image content recorded in the storage unit 17 (A) is captured image data recorded by the processes shown in FIGS. 12, 13, and 14. That is, the image data captured by the imaging display device 1A or 1B. Of course, other image data may be used. For example, it may be image content downloaded by the communication unit 18 (A) through network communication, or if the storage unit 17 (A) has a playback function of a portable recording medium, the image content recorded on the portable recording medium. It may be.

  The system controller 10 (A) of the imaging display apparatus 1A advances the process from step F601 to F602 in FIG. 16 when there is an instruction to specify the image content to be reproduced, for example, by a menu operation. Determine the device mode. Then, the process branches depending on whether the own machine mode, the other machine mode, or the dual machine mode.

In the case of the own device mode, the system controller 10 (A) proceeds to the processing of FIG. This is a process in which the imaging display device 1A displays image data to be reproduced on its own device.
First, in step F603 of FIG. 17, the system controller 10 (A) displays the display unit 2 (A).
Instructs playback image display at. For example, the image display state is controlled from the see-through state.
In step F604, the storage unit 17 (A) is instructed to read the designated image data, and the reproduced image data is transferred to the display unit 2 (A) to start displaying the reproduced image.

  Thereafter, the system controller 10 (A) waits for a determination command (command by pressing operation of the operation unit 32) from the remote controller 30. If the determination command is received while the reproduced image is displayed, the system controller 10 (A) determines that this is a reproduction and display stop operation. Further, when the determination command is received while the reproduction and display are stopped, the system controller 10 (A) determines that the operation is a reproduction and display restart operation.

  Therefore, when the determination command is received after starting the reproduction and display in step F604, the system controller 10 (A) interprets it as a stop command, and advances the process from step F605 to F606. Then, the storage unit 17 (A) is instructed to stop reading image data. Further, the display unit 2 (A) is instructed to stop displaying the reproduced image, and the display panel unit 2 a is returned to the see-through state.

When the determination command is received after the reproduction and display are stopped by the control of step F606, the system controller 10 (A) interprets it as a restart command and returns the processing from steps F607 to F603.
That is, similarly to the above, the system controller 10 (A) instructs the display unit 2 (A) to display the reproduced image in step F603, and in step F604, the storage unit 17 (A) reads the image data (for example, the previous stop point). Read out from the image data), and the reproduced image data is transferred to the display unit 2 (A), and the display of the reproduced image is resumed.

  Therefore, the lecturer U1 can execute or stop the display of the reproduced image by pressing the operation unit 32 of the remote controller 30.

When the system controller 10 (A) detects the end trigger, the process proceeds from step F608 to F609, where the image reproduction / display end processing is performed, and the series of processing ends.
The end trigger may be such that, for example, the instructor U1 performs a menu operation or the like to instruct the end of image reproduction / display, or a predetermined operation (for example, two consecutive presses) of the remote controller 30 is an end operation. You may do it.
Further, when a predetermined time or more has elapsed in the state where the display is stopped in step F606, the end controller and the system controller 10 (A) may determine that.
As an end process, for example, each unit is returned to the state immediately before the image reproduction instruction is issued in step F601.

[10. Playback processing (Self playback, display on other devices)]

The system controller 10 (A) of the imaging display apparatus 1A proceeds with the process from step F601 to F602 in FIG. 16 when there is an operation for specifying the image data to be reproduced. If so, the process proceeds to FIG. This is a process of displaying an image reproduced by the imaging display device 1A on another device (imaging display device 1B).

First, in step F620 of FIG. 18, the system controller 10 (A) transmits a display standby command from the communication unit 18 (A) to the imaging display device 1B.
In step F621, the storage unit 17 (A) is instructed to read the designated image data, the reproduced image data is transferred to the communication unit 18 (A), and the communication unit 18 (A) reproduces the reproduced image. Start sending.

When the system controller 10 (B) on the imaging display device 1B side receives the display standby command from the imaging display device 1A, the system controller 10 (B) advances the process from step F701 to F702, and displays it on the display unit 2 (B) of the imaging display device 1B. On the other hand, the display of the received image is instructed. For example, the image display state is controlled from the see-through state.
Thereafter, since the reproduced captured image data is transmitted in step F621 on the imaging display device 1A side, the system controller 10 (B) receives the captured image data received by the communication unit 18 (B) in step F703. The display on the display unit 2 (B) is started.

By the processing of steps F620 and F621 and steps F702 and F703, the image data reproduced in the storage unit 17 (A) of the imaging display device 1A is displayed on the imaging display device 1B side.
Accordingly, the student U2 wearing the imaging display device 1B can view the image reproduced by the imaging display device 1A on the display unit 2 (B).

Thereafter, the system controller 10 (A) waits for a determination command from the remote controller 30, and interprets the determination command in the same manner as in FIG.
Therefore, when the determination command is received after starting reproduction and transmission in step F621, the system controller 10 (A) interprets it as a stop command, and advances the process from step F622 to F623.
Then, the storage unit 17 (A) is instructed to stop reading image data. Further, the communication unit 18 (A) is instructed to stop transmission of the reproduction image data.
Further, in step F624, the system controller 10 (A) transmits a stop notification from the communication unit 18 (A) to the imaging display device 1B.

  When the system controller 10 (B) on the imaging display device 1B side receives the stop notification from the imaging display device 1A, the system controller 10 (B) advances the process from step F704 to F705 to stop the reception / display of the captured image data. That is, the operation state of displaying the received image on the display unit 2 (B) is terminated, and for example, the display unit 2 is returned to the see-through state.

After the reproduction and transmission are stopped by the control in step F623, when the determination command is received, the system controller 10 (A) interprets it as a restart command and returns the process from steps F625 to F620.
That is, similarly to the above, the system controller 10 (A) causes the communication unit 18 (A) to execute display standby command transmission to the imaging display device 1B in step F620, and in step F621, the storage unit 17 (A) reads image data. (For example, reading from a stop point) is instructed, and transmission of the reproduced image data by the communication unit 18 (A) is resumed.
On the imaging display device 1B side, processing in steps F702 and F703 is performed correspondingly.

  Therefore, the lecturer U1 can execute or stop the display of the reproduced image on the student U2 side by pressing the operation unit 32 of the remote controller 30.

When the system controller 10 (A) detects the end trigger, the system controller 10 proceeds from step F626 to F627, performs image playback / transmission end processing, and ends the series of processing.
The end trigger may be such that, for example, the instructor U1 may perform a menu operation or the like to instruct the end of image reproduction / transmission, or a predetermined operation (for example, two consecutive presses) of the remote controller 30 is an end operation You may do it.
Further, when a predetermined time or more has elapsed with the transmission stopped in step F623, the end controller and the system controller 10 (A) may determine that.
As an end process, for example, each unit is returned to the state immediately before the image reproduction instruction is issued in step F601.

On the imaging display device 1B side, when the stop notification is received in step F704, the reception and display operations are ended in step F705. For example, even if the stop notification is not received, the reproduction image data When reception is interrupted, the display processing may be terminated in step F705 by making a determination in the same manner as the stop notification.

[11. Playback processing (Self-machine playback, both-machine display)]

The system controller 10 (A) of the imaging display apparatus 1A proceeds with the process from step F601 to F602 in FIG. 16 when there is an operation for specifying the image data to be reproduced. If it is, the process proceeds to the process of FIG. This is a process of displaying an image reproduced by the imaging display device 1A on both the own device (imaging display device 1A) and the other device (imaging display device 1B).

First, in step F640 of FIG. 19, the system controller 10 (A) instructs display of a reproduced image on the display unit 2 (A). For example, the image display state is controlled from the see-through state.
In step F641, the system controller 10 (A) transmits a display standby command from the communication unit 18 (A) to the imaging display device 1B.
In step F642, the system controller 10 (A) instructs the storage unit 17 (A) to read the designated image data and transfers the reproduced image data to the display unit 2 (A) for reproduction. Start displaying images. Further, the reproduced image data is transferred to the communication unit 18 (A), and the communication unit 18 (A) is started to transmit the reproduced image.

When the system controller 10 (B) on the imaging display device 1B side receives the display standby command from the imaging display device 1A, the system controller 10 (B) advances the process from step F701 to F702, and displays it on the display unit 2 (B) of the imaging display device 1B. On the other hand, the display of the received image is instructed. For example, the image display state is controlled from the see-through state.
Thereafter, since the reproduced captured image data is transmitted in step F621 on the imaging display device 1A side, the system controller 10 (B) receives the captured image data received by the communication unit 18 (B) in step F703. The display on the display unit 2 (B) is started.

By the processing in steps F640, F641, F642 and steps F702, F703, the image data reproduced in the storage unit 17 (A) of the imaging display device 1A is displayed on both the imaging display device 1A and the imaging display device 1B. Is done.
Accordingly, an image reproduced by the imaging display device 1A is displayed on the display unit 2 (A) and the display unit 2 (B) by the lecturer U1 wearing the imaging display device 1A and the student U2 wearing the imaging display device 1B, respectively. ).

Thereafter, the system controller 10 (A) waits for a determination command from the remote controller 30, and interprets the determination command in the same manner as in FIG.
Therefore, after the reproduction, display, and transmission are started in step F642, when the determination command is received, the system controller 10 (A) interprets it as a stop command and advances the processing from step F643 to F644.
Then, the storage unit 17 (A) is instructed to stop reading image data. Further, the communication unit 18 (A) is instructed to stop transmission of the reproduction image data. Further, the display unit 2 (A) is instructed to stop displaying the reproduced image, and the display panel unit 2 a of the display unit 2 (A) is controlled to the see-through state.
In step F645, the system controller 10 (A) transmits a stop notification from the communication unit 18 (A) to the imaging display device 1B.

  When the system controller 10 (B) on the imaging display device 1B side receives the stop notification from the imaging display device 1A, the system controller 10 (B) advances the process from step F704 to F705 to stop the reception / display of the captured image data. That is, the operation state of displaying the received image on the display unit 2 (B) is terminated, and for example, the display unit 2 is returned to the see-through state.

When the determination command is received after the reproduction, display, and transmission are stopped by the control of step F644, the system controller 10 (A) interprets it as a restart command and returns the processing from step F646 to F640.
That is, similarly to the above, the system controller 10 (A) instructs the display unit 2 (A) to display a reproduced image in step F640, and in step F641 sends a display standby command transmission to the imaging display device 1B to the communication unit 18 (A). In step F642, the storage unit 17 (A) is instructed to read out image data (for example, reading from the stop point), and the reproduced image data is displayed on the display unit 2 (A) and communicated. Transmission by the unit 18 (A) is resumed.
On the imaging display device 1B side, processing in steps F702 and F703 is performed correspondingly.

  Therefore, the instructor U1 can execute or stop the display of the reproduced images on the instructor U1 side and the student U2 side by pressing the operation unit 32 of the remote controller 30.

When the system controller 10 (A) detects the end trigger, the process proceeds from step F647 to F648, performs the end processing of image reproduction / transmission, and ends the series of processing.
The end trigger may be such that, for example, the instructor U1 performs a menu operation or the like to instruct the end of image reproduction / display, or a predetermined operation (for example, two consecutive presses) of the remote controller 30 is an end operation. You may do it.
Further, when a predetermined time or more has elapsed in the state where the display is stopped in step F644, the end controller and the system controller 10 (A) may determine that.
As an end process, for example, each unit is returned to the state immediately before the image reproduction instruction is issued in step F601.

  In this case as well, the imaging display device 1B side receives the stop notification in step F704 and terminates the reception and display operations in step F705. For example, even if the stop notification is not received, playback is performed for a certain time or more. If the reception of the image data is interrupted, the display process may be terminated in step F705 by making the same determination as the stop notification.

  In the processing examples of FIGS. 16, 17, 18, and 19 described above, an instruction for image data to be reproduced (recognized in step F601 in FIG. 16) is set after setting the own device mode, the other device mode, and the both device mode. However, when specifying image content to be played back, for example, a menu item may be prepared that allows direct image capture, image capture from another device, or image capture from both devices to be directly specified.

Although omitted in FIGS. 17, 18, and 19, a fast-forward command or a fast-rewind command may be transmitted from the remote controller 30 during playback or during playback stop. The system controller 10 (A) controls the storage unit 17 (A) so that fast forward playback, fast reverse playback, etc. according to these commands are also executed.

[12. Effect of embodiment, modification and extension example]

As described above, the embodiment has been described. According to the embodiment, for example, the lecturer U1 and the student U2 wear the imaging display devices 1A and 1B, so that each other can easily see the visual scene of the other user. be able to. Further, each other's visual field scene can be recorded on the imaging display device 1A side and reproduced later, and can be viewed by the lecturer U1, the student U2, or both.

For example, assuming use of a golf course, the view scene of the instructor U1 can be recorded by capturing an image with the imaging display device 1A and recording the captured image data with the imaging display device 1A. For example, a student's swing form can be recorded as a scene from the lecturer's viewpoint. In particular, the checkpoints considered by the instructor can be recorded accurately.
Further, by taking an image with the imaging display device 1B and recording the captured image data with the imaging display device 1A, it is possible to record a sample form of a lecturer viewed from the student U2.
In addition, by taking an image with the imaging display device 1A and displaying the captured image data with the imaging display device 1B, the student U2 can see the operation of the student U2 viewed from the instructor U1 in real time. For example, you can practice golf swing while watching your swing form.
Further, by displaying the captured image data to be reproduced by the imaging display device 1A on the imaging display device 1A, the instructor U1 can easily confirm his / her own form, the form of the student U2, and the like.
In addition, by displaying the captured image data to be reproduced on the imaging display device 1A on the imaging display device 1B, the instructor U1 can easily make the student U2 see his / her own form, the form of the student U2, and the like. .
Further, by displaying the captured image data to be reproduced by the imaging display device 1A on both the imaging display devices 1A and 1B, it is possible to advance the course while simultaneously viewing the operations of the lecturer U1 and the student U2.

As a result, the student U2 can effectively practice his or her movements and forms, such as verbal explanation while the student himself / herself visually recognizes their movements and forms on the spot. In addition, there is a great effect that a lesson with less time and place restrictions is possible.
Furthermore, it is also very suitable that the teacher U1 can easily realize these by operating the remote controller 30.

These are examples of the effects described in the example of the golf course, but in addition to this, a usage mode in which the real-time visual exchange, the visual exchange of the reproduced image, and the operation of the system as the visual sharing can be effectively utilized. Are very diverse.
For example, it is not only suitable for sports practice, but can also be used for driving driving lessons, various lessons, games, games, theme park attractions and the like. It can also be used for academic research and research.

The embodiments of the imaging display system, the imaging display device, and the control method for the imaging display device according to the present invention have been described. However, the present invention is not limited to the above-described embodiments, and various modifications and extensions can be made. Conceivable.
Various configuration examples and processing examples as the imaging display device and remote controller of the present invention can be considered.

  In the imaging display device 1 (1A, 1B), not only normal imaging but also various imaging operations may be performed to perform recording and transmission. For example, telephoto imaging, wide-angle imaging, imaging while zooming in or out from telephoto to wide-angle, image magnification imaging, image reduction imaging, variable frame rate imaging (imaging at high frame rate or low frame rate) High-intensity imaging, low-intensity imaging, variable contrast imaging, variable sharpness imaging, imaging with increased imaging sensitivity, imaging with increased infrared imaging sensitivity, imaging with increased ultraviolet imaging sensitivity, specific wavelength band cut Imaging, mosaic processing of captured image data, luminance inversion processing, soft focus processing, partial enhancement processing in an image, imaging with addition of image effects such as variable processing of the color atmosphere of the entire image, still image imaging, etc. .

  In addition to visual exchange using image data, audio data may be transmitted from, for example, the imaging display device 1B to the imaging display device 1A, or vice versa, so that auditory exchange can be performed.

In the above embodiment, the operation is performed using the remote controller 30 corresponding to the imaging display device 1A. In addition to this, the remote controller 30 corresponding to the imaging display device 1B may be used simultaneously. . For example, in the above example, the student U2 can also operate with the remote controller 30. In that case, the system controller 10 (B) of the imaging display device 1B corresponds to the remote controller 30 worn by the student U2, and performs the processing described as the processing on the imaging display device 1A side in FIGS. Just do it. (In that case, the system controller 10 (A) performs the processing described as the processing on the imaging display device 1B side.)
Then, both users can arbitrarily instruct various operations described above.

Further, in the three or more imaging display devices 1, it is also possible to perform the above-described imaging, recording, reproduction, and display as mutual visual exchange.
For example, when three imaging display devices 1A, 1B, and 1C are considered, images captured by the imaging display device 1A can be displayed on the imaging display devices 1B and 1C.
In addition, an image reproduced by the imaging display device 1A can be displayed by the imaging display devices 1A, 1B, and 1C.
In addition, an image captured (or reproduced) by the imaging display device 1A and an image captured (or reproduced) by the imaging display device 1B can be divided into screens and simultaneously displayed by the imaging display device 1C.
In addition, the images captured by the imaging display devices 1A, 1B, and 1C can be divided into screens and simultaneously displayed by the imaging display devices 1A, 1B, and 1C.

It is explanatory drawing of the example of an external appearance of the imaging display apparatus of embodiment of this invention. It is explanatory drawing of the usage type of the imaging display system of embodiment. It is a block diagram of the imaging display device of an embodiment. It is explanatory drawing of the mounting state of the remote controller of embodiment. It is explanatory drawing of the remote controller of embodiment. It is a block diagram of the remote controller of an embodiment. It is a flowchart of the process of the remote controller of an embodiment. It is a block diagram of a display device of an embodiment. It is explanatory drawing of menu operation of embodiment. It is a flowchart of the transmittance | permeability control process of embodiment. It is a flowchart of the process in the case of the captured image recording instruction | indication of embodiment. 4 is a flowchart of processing of own device imaging and own device recording in the embodiment. 6 is a flowchart of another device imaging and own device recording / display processing in the embodiment. 4 is a flowchart of processing of own device imaging / recording and display of other devices in the embodiment. It is explanatory drawing of a self-device captured image and an other-device captured image in an embodiment. 4 is a flowchart of processing when a playback image is specified in the embodiment. 5 is a flowchart of processing of own device reproduction and own device display in the embodiment. 4 is a flowchart of self-device playback and other-device recording processing in the embodiment. 6 is a flowchart of self-device playback and both-device recording processing in the embodiment.

Explanation of symbols

  1, 1A, 1B imaging display device, 2 display unit, 3 imaging unit, 5 audio output unit, 6 audio input unit, 10 system controller, 11 operation input unit, 17 storage unit, 18 communication unit, 30 remote controller, 31 main body Part, 32 operation part

Claims (12)

An imaging display system having a plurality of imaging display devices,
Each of the imaging display devices
Display means capable of displaying an image on a display screen arranged so as to be positioned in front of the eyes of the user, and making the display screen transparent or translucent through state;
Imaging means for obtaining captured image data by capturing the user's visual field direction as the subject direction;
Communication means for communicating captured image data with the other imaging display device;
Control for transmitting the captured image data obtained by the imaging means to the other imaging display device by the communication means, and the captured image data transmitted from the other imaging display device and received by the communication means by the display means Control means for performing display, and
An imaging display system comprising: It also has a remote controller,
The remote controller transmits a command signal to one imaging display device according to a user operation,
The control means of the one imaging display device performs its own operation control according to the command signal, and performs control for transmitting operation control information to the other imaging display device by the communication means. The imaging display system according to claim 1. Display means capable of displaying an image on a display screen arranged so as to be positioned in front of the eyes of the user, and making the display screen transparent or translucent through state;
Imaging means for obtaining captured image data by capturing the user's visual field direction as the subject direction;
A communication means for communicating captured image data with an external imaging display device;
Control for transmitting the captured image data obtained by the imaging means to the external imaging display device by the communication means, and displaying the captured image data transmitted from the external imaging display device and received by the communication means by the display means Control means for performing control, and
An imaging display device comprising: It further comprises recording means for recording captured image data,
4. The imaging display apparatus according to claim 3, wherein the control unit further performs control to record the captured image data obtained by the imaging unit by the recording unit. It further comprises recording means for recording captured image data,
4. The imaging display device according to claim 3, wherein the control unit further performs control to cause the recording unit to record captured image data transmitted from the other imaging display device and received by the communication unit. It further comprises playback means for playing back image data,
4. The imaging display device according to claim 3, wherein the control unit further performs control to transmit the image data reproduced by the reproducing unit to an external imaging display device by the communication unit. It further comprises playback means for playing back image data,
The control means further includes control for displaying the captured image data reproduced by the reproduction means on the display means, and control for transmitting the image data reproduced by the reproduction means to an external imaging display device by the communication means. The imaging display device according to claim 3, wherein:   4. The control unit according to claim 3, wherein the control unit performs its own operation control according to an operation input signal, and performs control for transmitting operation control information to an external imaging display device by the communication unit. The imaging display device described.   The control means executes one or both of variable control of the transmittance of the display screen and transmission control of the transmittance control information of the display screen of an external imaging display device in accordance with the operation input signal. The imaging display device according to claim 8. The control means is responsive to the operation input signal.
One or both of control for transmitting captured image data to an external imaging display device by the communication means and transmission control of control information for requesting transmission of captured image data to the external imaging display device is performed. The imaging display device according to claim 8.   The imaging display apparatus according to claim 8, wherein the operation input signal is a signal input as a command signal from a remote controller. Display means capable of displaying an image on a display screen arranged so as to be positioned in front of the eyes of the user, and making the display screen transparent or translucent through state;
Imaging means for obtaining captured image data by capturing the user's visual field direction as the subject direction;
A communication means for communicating captured image data with an external imaging display device;
As a control method of the imaging display device provided with
In response to an operation input, transmitting the captured image data obtained by the imaging unit to an external imaging display device by the communication unit;
Displaying the captured image data transmitted from an external imaging display device and received by the communication means in response to an operation input, on the display means;
A control method for an imaging display device, comprising:

Images