WO2018173159A1 - Image display device - Google Patents

Abstract

The present invention addresses the problem that, when a user of a non-transmissive head-mounted image display device removes the device from his/her head to obtain external world information, the user's sense of immersion is significantly impaired. The present invention solves this problem by providing a head-mounted image display device that is equipped with: an image display unit for displaying contents; and a request detection unit for detecting a request for acquisition of an external world image, wherein the request detection unit is configured to detect a request for acquisition of an external world image upon detection of a user's movement or upon receipt of an input to the image display device, and then to perform display by superimposing the contents on the external image.

Description

Video display device

The present invention relates to a video display device mounted on a head and an operation method thereof.

Conventionally, a head-mounted display (hereinafter referred to as HMD) that allows an individual to enjoy a large screen image is known. This is a non-transparent head-mounted image display device that is used by being fixed to a user's head with a headband or the like and covering a part of the face including the user's left and right eyeballs. It is. In the housing of the HMD, an image display element such as a liquid crystal display element for converting a supplied video signal into an image, and an optical path for guiding the image converted by the image display element to the left and right eyeballs of the user are formed. Optical components such as a reflecting mirror and a lens are provided.

Since the HMD is configured as described above, it is small and portable, and the user can easily carry it to the desired place and enjoy the video. In addition, the non-transparent HMD can display an image in the 360 ° direction around the user while blocking the external image, so that the user can enjoy the image in various directions and have a high immersive feeling. And gain a realistic experience.

For example, it is expected that more and more passengers will enjoy entertainment in autonomous vehicles that are expected to become popular in the future. From the above, the non-transmissive HMD is a video display device suitable for enjoying entertainment in a moving body or the like, and is expected to be increasingly demanded in the future.

There is JP-A-2015-191124 (Patent Document 1) as background art in this technical field. In Patent Document 1, when an approach of an object is detected while video content is displayed on the display unit, the external video and video content are set so that both the external video captured by the imaging unit and the video content can be visually recognized. A non-transmissive HMD is disclosed that includes a display control unit that displays a superimposed image on the display unit.

JP2015-191124A

Patent Document 1 superimposes an external video and video content when an approach of an object is detected, but does not consider the point of obtaining external information desired by the user.

The non-transmissive HMD is a video display device that blocks the external information around the user and enhances the presence of the content, and can provide a high level of immersion. In other words, the desired outside world information cannot be obtained while viewing the content, and it is necessary to remove the HMD to obtain the outside world information. However, when the HMD is removed, there is a problem that the immersive feeling is greatly impaired.

The present invention has been made in view of the above-described background art and problems, and provides a technique for obtaining desired external information without significantly impairing the immersive feeling of content by the non-transmissive HMD. .

For example, the present invention is a video display device to be worn on the head, and includes an image display unit that displays content, and a request detection unit that detects an acquisition request for an external image, and a request detection unit. Is configured to detect an external image acquisition request triggered by detection of a user's action or input to a video display device, and to superimpose and display the content and the external image.

According to the present invention, it is possible to provide a head-mounted image display device that can obtain external information without impairing the immersive feeling of content by the non-transmissive HMD as much as possible.

It is a figure which shows the state with which the user mounted | wore the non-transmissive head-mounted image display apparatus. 1 is a configuration block diagram of a video display device in Embodiment 1. FIG. 6 is a flowchart of superimposed display in the first embodiment. It is a figure explaining the structure of the video display apparatus in Example 1. FIG. It is a figure explaining another structure of the video display apparatus in Example 1. FIG. It is a figure explaining another structure of the video display apparatus in Example 1. FIG. It is explanatory drawing which shows the effect by the structure of Example 1. FIG. It is a figure which shows the operation | movement which the user in Example 1 transmits the request | requirement signal of a superimposition start. It is a figure which shows the operation | movement in which the user in Example 1 controls a superimposition ratio. It is a figure explaining the operation | movement in which the user in Example 1 transmits the request signal of completion | finish of superimposition. 10 is a flowchart for superimposing and displaying a part of an external image in the second embodiment. It is a figure explaining the structure of the video display apparatus in Example 2. FIG. It is explanatory drawing which shows the effect by the structure of Example 2. FIG. It is a figure which shows the designation | designated method of the specific external field image in Example 2. FIG. It is an example of a guidance screen when the registration area is not settled in the user's view in Example 2. FIG. It is a figure which shows the designation | designated method of the arbitrary external field images in Example 3. FIG. FIG. 10 is a configuration block diagram of a video display device in Example 3. 12 is a flowchart of switching from content screen display to external image display in the third embodiment. It is explanatory drawing which shows the effect by the structure of Example 3. FIG.

Hereinafter, a head-mounted video display device (hereinafter simply referred to as a video display device) according to an embodiment of the present invention will be described with reference to the drawings.

FIG. 1 is a diagram showing a state in which a user 2 wears a non-transmissive image display device 1. Here, the non-transmission type refers to a configuration that blocks an external image when viewing content, and is used in so-called augmented reality (AR) and is a transmissive display that can be worn in front of the eyes. This is different from a system that provides related information by superimposing and displaying characters and images related to the object that the wearer is looking at. The external image refers to direct light and may be a captured image of a camera.

In FIG. 1, a video display device 1 is used by being mounted on a user's 2 head so as to cover a part of the face including the left and right eyeballs of the user 2. Can enjoy content images on a large screen individually. 4 is an earphone.

FIG. 2 is a block diagram showing the configuration of the video display apparatus according to this embodiment. In FIG. 2, the video display device 1 mainly includes a video signal generation unit 5 and a video display unit 6. The video signal generator 5 is, for example, a player for playing back a recording medium such as a DVD (registered trademark) or Blu-ray Disc (registered trademark) on which image information is recorded, or connected to the Internet to display image information. A video signal based on the image information (content) is generated in response to a video playback command and supplied to the video display unit 6.

The video display unit 6 is a goggle type display device in which a headband or the like is attached to a housing, and the housing is mounted so that the housing covers a part of the face including the left and right eyeballs of the user 2 by the headband. .

The video display unit 6 supplies the video signal supplied from the video signal generation unit 5 to an image display unit 7 made of, for example, a liquid crystal display element, and converts the image signal into an image by the image display unit 7 to generate a video based on the image. . In order to guide this image to the eyeball of the user 2, an optical unit 8 composed of a lens or the like may be disposed.

On the other hand, the external image 501 is input to the optical unit 8 by the light control unit 11, and the optical density is adjusted by the light control unit 11 controlled by the control unit 10. The control unit 10 is controlled when the request detection unit 9 detects an acquisition request for the external image 501 from the user 2.

With the above configuration, when the user 2 who is viewing the content desires to obtain the external world information, the external image 501 is obtained by superimposing the content image and the external world image 501 so that the immersive feeling is not impaired as much as possible. be able to.

Next, with reference to FIG. 3, a flowchart of superimposed display in the present embodiment will be described. The user 2 who wants to obtain outside world information during the reproduction of the content (step 100) transmits a superimposition start request signal to the video display device 1 by a method described later. When the request detection unit 9 detects the request signal (step 101), the control unit 10 controls the dimming unit 11 to superimpose and display the content image and the external image 501 (step 102). Thereafter, when the user 2 wants to end the superimposed display and return to the content image, the user 2 transmits a superposition end request signal to the video display device 1 by a method described later. When the request detection unit 9 detects the request signal (step 103), the control unit 10 controls the light control unit 11 to end the superimposition (step 104), and displays only the content image (step 105).

Next, the configuration of the video display device 1 in this embodiment will be described with reference to FIG. FIG. 4 is a cross-sectional view showing the vicinity of one eyeball of the user 2 wearing the video display device 1. A video signal that is a content image is input to the image display unit 7 to generate a video, which is reflected by the light control unit 11 and projected onto the eyeball of the user 2, while an external image is guided to the eyeball of the user 2. The dimming unit 11 controls the overlapping ratio between the content image and the external image. The light control unit 11 is composed of, for example, a variable ND (Neutral Density) filter, or a material whose transmittance can be electrically controlled, such as an electrochromic material or a gas chromic material. According to this configuration, the content image whose brightness is adjusted by the brightness adjustment of the image display unit 7 or the control of the light control unit 11 and the external image 501 whose brightness is adjusted by the control of the light control unit 11 are superimposed and displayed. be able to.

Note that the light control unit 11 is initially set so as to transmit the external image 501 100%. As a result, when the user 2 is wearing the video display device 1, the user 2 can observe the external image 501 through the video display device 1 even if the power supply is dropped or broken. Safety can be ensured.

FIG. 5 is a diagram for explaining another configuration of the video display device 1 in the present embodiment. In FIG. 5, a light control unit 11 is disposed between the transmissive image display unit 7 and the external image. The image display unit 7 is composed of, for example, a transparent organic EL display. According to this configuration, the content image whose brightness is adjusted by adjusting the brightness of the image display unit 7 and the external image 501 whose brightness is adjusted by the control of the light control unit 11 can be displayed in a superimposed manner.

FIG. 6 is a diagram for explaining still another configuration of the video display device 1 in the present embodiment. In FIG. 6, an external image 501 captured by the imaging unit 13 such as a camera included in the video display device 1 is output by the video output unit 14 and then subjected to image processing such as optical density adjustment by the image processing unit 15. The image is input to the image display unit 7 by the video input unit 16. On the other hand, the video signal supplied from the video signal generator 5 is input to the image display unit 7. With the above configuration, the external image 501 acquired by the imaging unit 13 and adjusted in optical density by the image processing unit 15 is superimposed on the content image and guided to the eyeball of the user 2. Although not shown, an optical unit 8 for guiding the user 2 to the eyeball may be provided.

Next, the effect of the configuration of this embodiment will be described with reference to FIG. FIG. 7A shows a content screen 500 that the user 2 is viewing, and FIG. 7B shows an external image 501 spreading in front of the user 2. 4 to 6, the user 2 can view the superimposed screen 502 on which the content screen 500 and the external image 501 are superimposed and displayed, as shown in FIG. 7C. Here, since the optical density of each image is thinned and superimposed, each image is indicated by a broken line for explanation. Note that the user 2 can arbitrarily adjust the overlapping ratio between the content screen 500 and the external image 501. A method for adjusting the superposition ratio will be described later.

Next, an operation in which the user 2 who is viewing the content screen 500 transmits a superimposition start request signal will be described with reference to FIG. FIG. 8A shows an operation in which the user 2 extends his / her arm, and FIG. 8B shows an operation in which the user 2 moves his / her head left and right to search for an arbitrary object or the like. 8C shows an operation in which the user 2 is touching the screen of the video display device 1, FIG. 8D shows an operation in which the user is hitting the video display device 1, and FIG. 8E shows a video display device. The operation | movement which is going to remove 1 is shown.

The request detection unit 9 provided in the video display device 1 is composed of, for example, any one or a combination of a gyro sensor, an acceleration sensor, a piezoelectric sensor, a touch sensor, a pressure sensor, a camera, and a microphone, The request detection unit 9 operates by the user 2 as illustrated in FIGS. 8A and 8B, or the video display device 1 by the user 2 as illustrated in FIGS. 8C to 8E. When an input to the input is detected, it is determined that this is a request signal for starting superimposition from the user 2, and superimposition display of the content screen 500 and the external image 501 is started.

Here, although the user 2 does not intend to do so, the operation that happens to be taken may be erroneously determined by the request detection unit 9 as a request signal for starting superposition. In order to prevent this, various operations of the user 2 are registered in advance at the time of initial setting when using the video display apparatus 1, and if substantially the same operation is detected, it is determined that the signal is a request signal for starting superposition. Also good.

Alternatively, after the superimposition mode is mounted on the video display device 1 and the user 2 sets the superimposition mode, the request detection unit 9 displays the operation when the operation is detected, and the operation is detected in a mode other than the superimposition mode. Even in such a case, it may be configured not to be superimposed and displayed. The superposition mode may be set by an operation on the screen, or may be set by physically arranging a switch.

Alternatively, the video display device 1 is provided with a voice detection unit such as a microphone, the voice of the user 2 is registered at the time of initial setting, and the subsequent operations are performed by the user 2 giving verbal instructions. It is good also as a structure.

The video display device 1 that has detected the request signal from the user 2 by the method as described above controls the dimming unit 11 and displays the content screen 500 and the external image 501 in a superimposed manner.

The superimposition ratio between the content screen 500 and the external image 501 can be arbitrarily adjusted by the user 2. Next, an operation in which the user 2 adjusts the superposition ratio will be described with reference to FIG. It is assumed that the higher the superposition ratio, the darker the optical density of the external image 501 is displayed and the content screen 500 is displayed lighter. Or it is good also as a reverse structure.

9A shows a state where the user 2 is touching the screen of the video display device 1, and FIG. 9B shows a state where the screen is swiped up and down. The superposition ratio can be adjusted by the strength of the touch or the swipe up and down or left and right. FIG. 9C shows a state in which the user 2 is making a gesture of moving his / her finger up and down in front of the screen of the video display device 1. The superimposition ratio can also be adjusted by such gestures.

At this time, when the screen is long-tapped for a specified number of seconds, or when the specified number of seconds is detected by an imaging unit such as a camera provided in the video display device 1, it is superimposed on the screen edge as shown in FIG. By configuring so that the ratio adjustment bar 51 is displayed, malfunction can be prevented.

The superposition ratio may be adjusted as appropriate while looking at the superposition display screen, or may be adjusted in advance at the time of initial setting.

As another adjustment method, as shown in FIG. 9E, a physical knob 17 is arranged on the video display device 1 and the user 2 adjusts the knob 17 to adjust the superposition ratio. good.

Alternatively, the user 2 may give a voice instruction. In this case, the malfunction of the user 2 is prevented by registering the voice of the user 2 when the video display device 1 is initially set.

Alternatively, the speed of the operation of the user 2 when transmitting the superimposition start request signal may be detected, and the higher the operation, the higher the superposition ratio may be set. Specifically, as shown in FIG. 8A, when the user 2 performs an operation of extending his arm to search for something, the faster the arm is extended, the faster the overlapping ratio is. You may make it high and display an external world image deeply. In this case, as described above, the video display device 1 is equipped with the superimposition mode, and the user 2 sets the superimposition mode so that it functions with respect to the detected operation. Prevent operation.

Next, with reference to FIG. 10, an operation in which the user 2 who is viewing the superimposed screen transmits a superimposition end request signal will be described. Assume that the user 2 is looking for an arbitrary object. Specifically, in FIG. 10, it is assumed that the user 2 wants to take the drink 54, and the drink 54 and the finger 52 of the user 2 are captured by an imaging unit such as a camera provided in the video display device 1. If it is detected that the two direction vectors have changed, or if it is detected that both direction vectors have changed, or if both direction vectors match, it is determined that the user 2 has secured the drink 54 and is used. Since the user 2 can return to viewing the content quickly and continue to view the content without significantly losing the immersive feeling of the content, this is determined as a superposition end request signal, the external image 501 is blocked, and the content screen 500 Switch to only display.

Alternatively, when it is detected that the user 2 has ended the various operations described with reference to FIG. 8 or that the user 2 has interrupted the input to the video display device 1, the user 2 requests to end the superposition. It may be determined that the signal is a signal, the external image 501 may be blocked, and the display may be switched to the content screen 500 only.

Alternatively, the voice instruction of the user 2 may be detected by a detection unit such as a microphone provided in the video display device 1, and when the user 2 turns off the physical button, the superimposition is ended and the content screen 500 is detected. May be set to play.

In this case, as a method of preventing a malfunction that may cause the superimposition to end against the intention of the user 2, it is possible to notify the malfunction by hitting the video display device 1 or at the time of initial setting. There are methods such as recognizing the voice of the registered user 2 and giving a voice instruction, or registering the special action of the user 2 at the time of initial setting.

As described above, according to the present invention, it is possible to provide a head-mounted image display device that can obtain desired external information without impairing the immersive feeling of content by the non-transmissive HMD as much as possible.

Whereas the first embodiment is configured to superimpose and display the external image 501 on the entire screen of the video display device 1, in the present exemplary embodiment, a part of the external image 501 is superimposed and displayed on the screen of the video display device 1. An example of the case will be described.

Referring to FIG. 11, a flowchart in the case where a part of the external image 501 is superimposed and displayed on the screen of the video display device 1 in the present embodiment will be described. There are two methods for selecting the area of the external image 501 to be superimposed. When the first is always a specific area or object, the second is when the user 2 indicates an arbitrary area or object at any given time. It is.

First, a flowchart for selecting a specific area or object will be described. In FIG. 11, when the user 2 wears the video display device 1 (step 200), initial setting is started (step 201). In step 201, the initial posture of the user 2 is detected and registered as reference coordinates (step 202). Since this apparatus is a video display apparatus 1 that is used by being mounted on the head, the posture of the user 2 mainly means the direction of the head. If the external image to be superimposed is always fixed, the process proceeds to a step of registering the area or object as a registration requirement (steps 203, 204, 205). The user 2 designates an area and an object by a method to be described later (step 204) and registers it in the video display device (step 205). Hereinafter, the registered area or object is referred to as a registered area. The initial setting is thus completed, and the content image is reproduced (step 206).

The user 2 who wants to obtain outside world information while viewing the content image transmits a superposition start request signal to the video display device 1 (step 207). The video display apparatus 1 that has detected the request signal from the user 2 detects the posture of the user 2 again (step 208), and calculates the coordinates of the registration area from the difference from the reference coordinates registered at the initial setting ( Step 209), it is determined whether or not the registered area is within the current user's field of view (step 210). If not, the guidance described later is displayed on the screen (step 211). If it is within the range, the control unit 10 controls the light control unit 11 corresponding to the corresponding coordinates (step 212), and the content image and the external image 501 are displayed in a superimposed manner (step 213).

Next, the user 2 who wants to block the outside world information transmits a superimposition end request signal to the video display device 1 (step 214). The video display device 1 that has detected the request signal from the user 2 controls the light control unit 11 by the control unit 10 to block the external image 501 and display the content screen 500 (step 215).

Next, a flowchart for selecting an arbitrary area or object will be described. In FIG. 11, when the user 2 wears the video display device 1, it is determined in step 203 that registration is unnecessary, and the process proceeds to step 216 to reproduce the content. While viewing the content image, the user 2 who wants to obtain external world information transmits a superposition start request signal to the video display device 1 (step 217). The video display device 1 that has detected the request signal from the user 2 receives the designation of the area and the object from the user 2 by a method described later (step 218), and the control unit 10 controls the dimming unit according to the location. 11 (step 212), the content image and the external image 501 are superimposed and displayed (step 213). The subsequent flowchart is as described above.

Next, the configuration of the video display device 1 in this embodiment will be described with reference to FIG. FIG. 12 is a cross-sectional view showing the vicinity of one eyeball of the user 2 wearing the video display device 1. A video signal is input to the image display unit 7 to generate a video, which is displayed on the eyeball of the user 2, while an external image is guided to the eyeball of the user 2, and the optical density of the content image and the external image 501 is adjusted. It is controlled by the light unit 11. Here, the light control unit 11 is composed of a plurality of light control units 18 to 24, whereby the optical density can be partially controlled.

In addition, the structure shown in FIG. 6 may be used as another structure of the video display apparatus 1 in the present embodiment. In this case, a part of the captured image is extracted, the optical density is adjusted by image processing, and input to the image display unit 7. Alternatively, the optical density of the captured image is changed depending on the location and input to the image display unit 7.

Next, the effect of the configuration of this embodiment will be described with reference to FIG. FIG. 13A shows a content screen 500 that the user 2 is viewing, and FIG. 13B shows an external image 501 spreading in front of the user 2. 12 and 6, the user 2 can view the superimposed screen 502 in which a part of the external image 501 is superimposed on the content image as shown in FIG. 13C. That is, for example, only the drink 54 of the external image 501 is superimposed and displayed. Here, the external image 501 to be superimposed can be designated by the user 2 by a method described later. Further, the superimposition ratio between the content image and the external image 501 can be arbitrarily adjusted by the user 2 as in the first embodiment.

Next, with reference to FIG. 14, a method for specifying the external image 501 to be superimposed, particularly a method for specifying a specific area or object will be described. As described above, this operation is performed when the video display apparatus 1 is initially set. Since the initial state of the light control unit 11 is set so as to transmit 100% of the external image 501 as described in the first embodiment, when the user 2 wears the video display device 1, An external image 501 in front of the eyes is displayed.

14, FIG. 14 (A) is a view of the user 2 wearing the video display device 1 observed from directly above. The user 2 is trying to touch the external image 501 viewed through the video display device 1 using his / her fingers. FIG. 14B shows an external image 501 that the user 2 is looking through the screen of the video display device 1 and his / her finger 52 trying to touch the specific place. The area or object pointed to by the user 2 is recognized by the imaging unit 13 such as a camera provided in the video display device 1. By detecting the posture of the user 2 at this time and calculating the corresponding area and the coordinates of the object with respect to the user 2 coordinates, the area to be superimposed is designated and registered. Or you may designate and register by the image recognition by the imaging part 13. FIG.

In addition to pointing with the finger of the user 2, as shown in FIG. 14 (C), the window 29 displayed on the screen of the video display device 1 is moved to move the area or object (registered area) 25 to be designated. You may comprise in the window 29 and register them. At this time, a piezoelectric sensor is arranged on the screen of the video display device 1, and the user 2 touches, swipes, or pinches the window 29 displayed on the screen, so that selection, movement, enlargement / reduction can be performed. You may comprise so that operation can be performed.

Alternatively, although not illustrated, when the user 2 uses the video display device 1 in a car, for example, if the car has a detection unit mounted on a drink holder or the like, the information detected by the detection unit is It may be configured to transfer to the video display device 1 and detect that there is a drink and register that area when there is a drink.

By performing the initial settings as described above, a specific area or object is specified and registered. However, depending on the posture of the user 2, the registration area 25 to be designated does not always enter the field of view of the user 2. For this reason, when the request detection unit 9 receives a superposition start request signal from the user 2, the posture of the user 2 is detected, the field of view of the user 2 and the coordinates of the registration area 25 are calculated from the posture, and the field of view is displayed. Check if it fits. If it is within the range, the dimming unit 11 corresponding to the registration area 25 is controlled to start superimposing display. If it is not within the range, the user 2 is guided to indicate the location of the registration area 25. Display on the screen. FIG. 15 shows a screen example of a guidance display 27 that guides the user 2 to turn to the left when the registration area 25 is not within the field of view of the user 2.

In addition, if it is detected that the registration area 25 cannot be easily found, such as the registration area 25 greatly deviating from the field of view of the user 2, the external image 501 may be temporarily displayed over the entire screen so that it can be easily searched. Thereafter, when the registration area 25 is within the field of view of the user 2 such as when the user 2 faces in an appropriate direction, a part of the external image 501 is displayed again.

Next, a method for specifying an arbitrary area or object will be described with reference to FIG. As described above, this operation is performed after the request detection unit 9 receives a superposition start request signal from the user 2.

As shown in FIG. 16A, when the user 2 who is viewing the content screen 500 points to an arbitrary place on the screen of the video display device 1 with his / her finger 52 or the like, a window is displayed on the screen of the video display device 1. 29 is displayed, the optical density of the area is adjusted, and the area or object (registered area) 25 desired to be designated in the external image 501 is superimposed on the content image. The window 29 may be configured so that the user 2 can perform selection, movement, and enlargement / reduction operations by touching, swiping, and pinching.

Alternatively, as shown in FIG. 16B, the overlapping area may be designated by extending the user's arm or finger in the direction in which the user 2 wants to check the external image 501. In this case, when a part of the body of the user 2 (finger 52) is detected by the imaging unit 13 such as a camera provided in the video display device 1, the coordinates of the part are acquired, and the light control unit 11 corresponding thereto is acquired. The optical density is controlled by the control unit 10 so as to be superimposed on the content image. At this time, the window 29 may be displayed or may not be displayed so that the superimposed area can be easily understood. When not displayed, the feeling of immersion can be further enhanced.

In this specification method, when the superimposition end request signal is not detected from the user 2 even after a certain period of time, the range for controlling the optical density of the light control unit 11, that is, the superimposition area is set every time. You can spread it.

As described above, according to the present embodiment, a part of the external image is superimposed and displayed on the screen of the video display device, so that it becomes easy to specify desired external information and the immersive feeling of content by the non-transmissive HMD can be obtained. It is possible to provide a head-mounted image display device that can more easily obtain external information without losing as much as possible.

Embodiments 1 and 2 are examples in which a request from a user is detected and the light control unit is controlled. In this embodiment, an example in which a request is detected from a user other than the user will be described.

For example, when the video display device according to the present embodiment is used by a passenger of a moving body such as an automobile, when the mobile body arrives at the destination, the user either removes the video display device to get out of the vehicle or displays the content screen. Must be switched to an external image. In any case, it is a burden for the user who is immersed in the content screen to suddenly switch the field of view from the content screen to the external image instead of his own will, which may surprise the user. In some cases, it is assumed that the user may make a recognition error, and a dangerous state may occur in which it is not known whether the user is viewing an external image or a content screen.

In order to reduce the user's uncomfortable feeling, when switching from the content screen to the external image when triggered by a request from a user other than the user, the audio is gradually switched before the video, and then the video is gradually superimposed by superimposing the external image. Switch to.

FIG. 17 is a configuration block diagram of the video display device 1 in the present embodiment. In FIG. 17, when the switching request detection unit 30 detects a switching request from a detection unit such as the camera 13 or the microphone 31 provided in the video display device 1 or an in-vehicle sensor such as the GPS 32, the voice control unit 33 and the video control are performed. The unit 40 controls audio and video, respectively. The sound control unit 33 gradually changes the volume ratio between the external sound 38 from the microphone 31 and the content sound from the video signal generation unit 5, and the sound is output by the sound output unit 34 including an earphone or the like to the ear of the user 2. To deliver. On the other hand, the video control unit 40 controls the dimming unit 11 to gradually change the superposition ratio of the content video from the video signal generation unit 5 and the external image and deliver the video to the user 2. Note that the switching request detection unit 30 may detect the request from the user in combination with the switching according to the request from the user in FIG.

FIG. 18 is a flowchart of switching from content screen display to external image display in the present embodiment. In FIG. 18, when a switching request is detected from a user other than the user during the reproduction of the content image (step 300) (step 301), the volume of the content audio and the external audio is gradually changed until the volume of the content audio is minimized. (Step 302). When the volume ratio of the external audio reaches 100% in this way (step 303), the content image and the image of the outside world image are controlled to be dimmed and superimposed (step 304). In this way, the light control unit is controlled until the content image superimposition ratio becomes 0% (305). When the content image is switched to 100%, the processing is terminated (306).

FIG. 19 is a diagram illustrating the effect of the configuration of the present embodiment. As shown in FIG. 19A, it is assumed that the user 2 is input with the content screen 500 and the content audio 35 and is in a so-called immersion state. Here, for example, when a request to switch the content screen 500 to the external image 501 is detected from a sensor such as the vehicle-mounted GPS 37, the volume of the content audio 35 is gradually reduced and the external audio 38 is picked up as shown in FIG. Gradually increase the volume from the microphone. After the sound is switched to the external sound 38, the content image and the external image 501 are superimposed and displayed as shown in FIG. The superposition ratio of the external image 501 is gradually increased, and the switching is completed when the external image 501 is completely displayed as shown in FIG.

Note that after the content screen 500 is switched to the external image 501, when the user 2 views the content image again, it may be configured to easily return to the location where viewing was interrupted. For example, the video signal generator 5 may be controlled so that the content screen 500 is automatically stopped when switching to the external image 501, and the content image remains reproduced after switching, The playback location at the time of switching may be stored in memory so that it can be returned.

As described above, it is possible to reduce the user 2's uncomfortable feeling by switching from the content screen 500 to the external image 501 while minimizing the change in the amount of information input to the user 2.

The present invention is not limited to the above embodiments, and includes various modifications. For example, the above-described embodiments have been described in detail for easy understanding of the present invention, and are not necessarily limited to those having all the configurations described. Further, a part of the configuration of one embodiment can be replaced with the configuration of another embodiment, and the configuration of another embodiment can be added to the configuration of one embodiment. Further, it is possible to add, delete, and replace other configurations for a part of the configuration of each embodiment.

In addition, each of the above-described configurations, functions, processing units, processing means, and the like may be realized by hardware by designing a part or all of them with, for example, an integrated circuit. Each of the above-described configurations, functions, and the like may be realized by software by interpreting and executing a program that realizes each function by the processor.

DESCRIPTION OF SYMBOLS 1 ... Video display apparatus, 2 ... User, 3 ... Headband, 4 ... Earphone, 5 ... Video signal generation part, 6 ... Video display part, 7 ... Image display part, 8 ... Optical part, 9 ... Request detection part, DESCRIPTION OF SYMBOLS 10 ... Control part 11, 18-24 ... Light control part, 13 ... Imaging part (camera), 14 ... Video output part, 15 ... Image processing part, 16 ... Video input part, 17 ... Knob, 25 ... Area to designate Or object (registration area), 27 ... guidance display, 29 ... window, 30 ... switching request detection unit, 31 ... microphone, 32 ... GPS, 33 ... audio control unit, 34 ... audio output unit, 35 ... content audio, 38 ... External audio, 40 ... video control unit, 500 ... content screen, 501 ... external world image, 502 ... superimposed screen

Claims (20)

A video display device to be worn on the head,
An image display unit for displaying content;
A request detection unit for detecting an acquisition request for an external image,
The request detection unit detects an external image acquisition request triggered by detection of a user's operation or input to the video display device, and displays the content and the external image in a superimposed manner. Video display device. The video display device according to claim 1,
The video display device characterized in that the superposition ratio of the content and the external image can be arbitrarily changed. The video display device according to claim 2,
A dimming unit for dimming each video of the content and the external image,
A control unit for controlling the dimming unit,
The video display apparatus, wherein the control unit changes the superposition ratio of the content and the external image by controlling the light control unit. The video display device according to claim 3,
The video display device according to claim 1, wherein an initial state of the light control unit is set so as to transmit 100% of the external image. The video display device according to claim 3,
The external image incident on the light control part is transmitted through the light control part,
An image display device, wherein a content image from the image display unit is reflected by the light control unit. The video display device according to claim 3,
The external image incident on the light control part is transmitted through the light control part,
A video display apparatus, wherein a content image from the image display unit is transmitted through the light control unit. The video display device according to claim 3,
With an imaging unit,
A video display apparatus, wherein video captured by the imaging unit is subjected to image processing and superimposed on a content image from the image display unit. The video display device according to claim 3,
With a touch sensor,
The video display device, wherein the request detection unit detects an acquisition request for the external image based on an input from the touch sensor. The video display device according to claim 3,
The request detection unit detects a request signal for ending the superimposed display of the content and the external image when the user's operation is detected or input to the video display device, and the content and the external image are detected. A video display device characterized in that the superimposed display is terminated. The video display device according to claim 3,
An image display device characterized in that the light control unit can control the transmittance and the reflectance by electrical control. The video display device according to claim 1,
In the superimposed display, a part of the external image is superimposed and displayed on the content. The video display device according to claim 11,
A dimming unit for dimming each video of the content and the external image,
A control unit for controlling the dimming unit,
The dimming unit is composed of a plurality of dimming units, each dimming unit can individually control the transmittance and reflectance,
The video display apparatus, wherein the control unit changes the superposition ratio of the content and the external image by controlling the light control unit. The video display device according to claim 12,
The video display apparatus according to claim 1, wherein the external image to be superimposed and displayed is designated by a user. The video display device according to claim 12,
The image display apparatus, wherein the coordinates of the external image to be superimposed are calculated from a correlation with a user's posture. The video display device according to claim 13,
With an imaging unit,
The video display apparatus, wherein the external image to be superimposed is recognized by the imaging unit. A video display device to be worn on the head,
An image display unit for displaying content;
A switching detection unit for detecting a switching request to an external image,
An image display device, wherein when the switching detection unit detects a switching request, the display of the content is switched to the external image. The video display device according to claim 16, wherein
Switching from the content to the external image is performed by switching audio prior to video. The video display device according to claim 17,
The video display device characterized in that the volume of the audio gradually decreases the volume of the content and gradually increases the volume of the external image. The video display device according to claim 17,
The video display apparatus, wherein the external image is superimposed and displayed on the content, and the superposition ratio is gradually increased. An image display method of an image display device that is worn on the head and displays content,
A video display method, wherein the content and an external image are superimposed and displayed upon detection of an operation of a user of the video display device or input to the video display device.

Images