JP3727961B2 - Head-mounted display device - Google Patents

Description

[0001]
[Industrial application fields]
The present invention relates to a head-mounted display device, and more particularly to display control in a head-mounted display device.
[0002]
[Prior art]
As a conventional system in which the display content of the head-mounted display device changes according to the movement of the head, there has been a system that moves the display screen of the head-mounted display device as shown in FIG. In FIG. 9, a portion surrounded by a broken line is a wide range of image data area prepared in advance on the memory.
[0003]
Then, as indicated by an arrow in FIG. 9, the portion surrounded by the thick frame moves according to the movement of the head. In the case of a conventional head-mounted display device, these thick frame ranges are cut out and displayed on the entire display unit of the head-mounted display device.
[0004]
As another method, the movement of the observer's head is detected, and an image corresponding to the movement is calculated according to the movement of the head. And the method of producing | generating and displaying an image by CG (COMPUTER GRAPHICS) based on the said calculation result may be used.
[0005]
[Problems to be solved by the invention]
As described above, in the case of a system that prepares a wide range of image data in the image memory in advance, when the head movement is small, the image data corresponding to the movement can be cut out from the image memory. However, if the head movement is large, the corresponding data may not exist in the image memory.
[0006]
In order to prevent such inconvenience, it is necessary to increase the capacity of the image data memory and prepare more image data. However, it is desirable that the capacity of the image data memory is as small as possible due to cost and circuit scale limitations.
[0007]
Thus, conventionally, the movement range is limited to the range where the image data stored in the image data memory is present, thereby preventing inconveniences caused by a large head movement.
[0008]
However, if the movement range is limited as described above, natural display corresponding to the movement of the head becomes difficult, and a head-mounted display device configured to limit the movement range is referred to as VR (Virtual Reality, When applied to (virtual reality), there is a problem that the sense of reality is impaired.
[0009]
Further, in the case of a CG (COMPUTER GRAPHICS) generation system in which an image corresponding to the movement of the head is generated by calculation, since the calculation load is heavy, real-time display cannot be performed, resulting in an unnatural frame advance image. There was a problem. In this case, since a special processor or circuit is required, there is a problem that the cost is increased or the size of the apparatus is increased.
[0010]
In view of the above-described problems, the present invention enables a natural display corresponding to the movement of the head and a real-time display even under a limited memory capacity condition. The purpose is to do.
[0011]
[Means for Solving the Problems]
The head-mounted display device of the present invention has display means corresponding to the left and right eyes of the observer, and uses the display means fixed to the observer's head. In a head-mounted display device configured to observe an image displayed on the display unit, a combining unit that combines the first image data and the second image data, and a first image on the display unit of the display unit Display control for controlling a combining operation in the combining means to display a display image related to the first image data in a display range and display a display image related to the second image data in a second image display range. And a motion detection means for detecting displacement of the head when the display means is fixed to the head of the observer, and according to the displacement information of the head obtained by the motion detection means The display control means is a head When displaced in a predetermined direction, it is effective that the positions of the first image display range and the second image display range on the display unit of the display unit change relatively according to the displacement of the head. When displaced in a direction different from the predetermined direction, the positions of the first image display range and the second image display range on the display unit of the display unit are prohibited from changing, and the head is in the predetermined direction If the displacement amount of the head is within a predetermined range, the positions of the first image display range and the second image display range on the display unit of the display unit according to the displacement of the head If the head displacement exceeds the predetermined range, the positions of the first image display range and the second image display range on the display unit of the display means are controlled. It is controlled to be fixed.
[0012]
Another feature of the present invention is that in the head-mounted display device described above, the first display unit of the display unit according to the displacement information of the head obtained by the motion detection unit. The first movement control means for moving the position of the first image display range only in the horizontal direction within the screen for relatively changing the positions of the image display range and the second image display range And a second movement control means for moving the position of the first image display range only in the vertical direction within the screen, and changing the size of the first image display range, A third movement control means for changing the magnification of the display image within the image display range and not changing the center position of the first image display range, and the position of the first image display range on the screen Within horizontal or vertical A fourth movement control means for moving only the first image display range, moving the position of the first image display range in the vertical direction within the screen, changing the size of the first image display range, A fifth movement control means for changing a magnification of a display image in the first image display range; and a position of the first image display range in a horizontal direction on the screen; Sixth movement control means for changing the size of the display range or changing the magnification of the display image in the first image display range, and the position of the first image display range in the screen horizontally And a seventh movement control means for moving in the direction or the vertical direction, changing the size of the first image display range, and changing the magnification of the display image in the first image display range. Any one of them can be used To.
[0013]
Another feature of the present invention is that in the head-mounted display device described above, the first to seventh movement control means are automatically selected according to the type of video to be observed. It is characterized by that.
[0014]
Another feature of the present invention is that it has display means corresponding to the left and right eyes of the observer, the display means is fixedly used on the head of the observer, and the display means In the head-mounted display device configured to observe the image displayed on the display unit, control is performed so that the first image display range and the second image display range are displayed on the display unit of the display unit. Displacement of the head obtained by the movement detection means provided with display range control means and movement detection means for detecting displacement of the head when the display means is fixed to the head of the observer According to the information, when the displacement amount of the head is within a predetermined range, the positions of the first image display range and the second image display range on the display unit of the display unit are relatively set according to the displacement of the head. The amount of displacement of the head is within the predetermined range. If so, the positions of the first image display range and the second image display range in the display unit of the display means are fixed, and the position of the first image display range is set in the horizontal direction within the screen. First movement control means for moving only in the first position, second movement control means for moving the position of the first image display range only in the vertical direction within the screen, and the first image Third movement control means for changing the size of the display range, changing the magnification of the display image in the first image display range, and not changing the center position of the first image display range. A fourth movement control means for moving the position of the first image display range only in the horizontal direction or the vertical direction within the screen; and the position of the first image display range in the vertical direction within the screen. Or move to A fifth movement control means for changing the size of one image display range or changing the magnification of a display image in the first image display range; and the position of the first image display range on a screen. A sixth movement control means for moving in the horizontal direction, changing the size of the first image display range, and changing the magnification of the display image in the first image display range; The position of the first image display range is moved in the horizontal direction or the vertical direction within the screen, the size of the first image display range is changed, or the display image in the first image display range is changed. The position of the first image display range and the second image display range in the display unit of the display unit is relatively changed using any one of the seventh movement control unit that changes the magnification. It is characterized by.
[0016]
[Action]
Since the present invention comprises the technical means, the first image data and the second image data are synthesized by the synthesizing means, and the synthesizing operation of the synthesizing means is controlled by the display control means, whereby the display unit When the display image related to the first image data is displayed in the first image display range and the display image related to the second image data is displayed in the second image display range, A plurality of image display ranges can be relatively changed corresponding to the movement, and a display image that is easy to view can be expressed in a more natural form as compared with the case where the image display range is fixed.
[0017]
According to another aspect of the invention, when the direction and amount of displacement of the head obtained by the motion detection means are within a predetermined range, the display means according to the displacement amount of the head. Since the first image display range and the second image display range in the display unit are relatively changed, it is possible to prevent the display range control means from responding too sensitively when the observer's head moves unnecessarily. Is done.
[0018]
According to another feature of the present invention, since at least two movement control means are provided, the movement control means can be optimally used according to the purpose of use of the head-mounted display device and the user's preference. It becomes possible to obtain a more effective sense of reality.
[0019]
【Example】
Hereinafter, an embodiment of a head-mounted display device of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram illustrating a schematic configuration of a head-mounted display device according to the present embodiment. In FIG. 1, 100L is a left-eye display unit, and 100R is a right-eye display unit. Reference numeral 200 denotes a display range control means, and reference numeral 300 denotes an angular velocity detection means constituting a motion detection means.
[0020]
The left-eye display unit 100L is a display of a later-described liquid crystal monitor 1L, and the right-eye display unit 100R is a display of a later-described liquid crystal monitor 1R.
The display range control means 200 is for displaying the first image display range A (see FIG. 3) and the second image display range B (see FIG. 3) on the display units 100L and 100R. Yes, the positions of the first image display range A and the second image display range B are relatively changed based on the angular velocity displacement when fixed to the head of the observer.
[0021]
The display range control means 200 of the present embodiment includes a first movement control means (1), a second movement control means (2), a third movement control means (3), and a fourth movement control means (4). , Fifth movement control means (5), sixth movement control means (6), seventh movement control means (7), and eighth movement control means (8).
[0022]
The first movement control means {circle around (1)} is for moving the position of the first image display range A only in the horizontal direction within the screens of the display units 100L and 100R.
[0023]
The second movement control means {circle around (2)} is for moving the position of the first image display range A only in the vertical direction within the screens of the display units 100L and 100R.
[0024]
The third movement control means {circle around (3)} changes the size of the first image display range A, changes the magnification of the display image in the first image display range A, and This is to prevent the center position of the first image display range A from being changed.
[0025]
The fourth movement control means (4) is for moving the position of the first image display range A only in the horizontal direction or the vertical direction within the screen.
[0026]
The fifth movement control means {circle around (5)} moves the position of the first image display range A in the vertical direction within the screens of the display units 100L and 100R, and the size of the first image display range A. Or the magnification of the display image in the first image display range A is changed.
[0027]
The sixth movement control means {circle around (6)} moves the position of the first image display range A in the horizontal direction within the screens of the display units 100L and 100R, and the size of the first image display range A. Or the magnification of the display image in the first image display range A is changed.
[0028]
The seventh movement control means (7) moves the position of the first image display range A in the horizontal direction or the vertical direction within the screens of the display units 100L and 100R, or the first image display range A. Or the magnification of the display image in the first image display range A is changed.
[0029]
The eighth movement control means (8) prohibits a change in the position of the first image display range A, prohibits a change in the size of the first image display range A, and further This is for prohibiting a change in the magnification of the display image within the first image display range A.
[0030]
In this embodiment, the above-described movement control means {circle around (1)} to {circle around (8)} are used to set the settings of the pointer means 33, address control section 40, timing signal generation means 26, etc. of FIG. ) It is configured to be programmatically controlled by 21. However, it may be configured to be hardware.
[0031]
In the head-mounted display device of this embodiment configured as described above, each movement control means (1) to (8) operates in accordance with the detection output of the angular velocity detection means 300, and operates in various operation modes. It is supposed to be. Hereinafter, the configuration and operation of the head-mounted display device of this embodiment will be described in detail.
[0032]
FIG. 2 is a block diagram of the display unit showing a specific configuration example of the head-mounted display device of the present embodiment.
In FIG. 2, 1R and 1L are liquid crystal monitors for displaying an image, and 2R and 2L are enlargement optical systems for an observer to enlarge and view the display unit of the liquid crystal monitor.
3R and 3L are backlights that illuminate the liquid crystal monitors 1R and 1L from the back, and 4R and 4L are liquid crystal drivers for causing the liquid crystal monitors 1R and 1L to display an image corresponding to the video signal.
[0033]
Reference numeral 5 denotes an acceleration sensor for detecting the acceleration of the head-mounted display device, and constitutes the angular velocity detection means 300 described above. 6R and 6L are speakers for emitting sound or the like according to the audio signal to the observer U.
Reference numeral 7 denotes a cable for communicating video signals, audio signals, and other control signals with a separate display device shown in FIG. A portion indicated by a broken line constitutes a main body and is a housing for mounting on the head of the observer U.
[0034]
Next, a method for displaying an image on the display unit of the head-mounted display device of this embodiment will be described.
FIG. 3 is an explanatory diagram of display areas of the display units of the liquid crystal monitors 1L and 1R. FIG. 3A is a diagram illustrating the liquid crystal monitor 1L, that is, a display screen for the left eye of the observer.
[0035]
FIG. 3B illustrates the liquid crystal monitor 1R, that is, the display screen for the right eye of the observer.
In FIG. 3, the hatched portion indicates the first image display range A, and the vertical hatched portion indicates the second image display range B.
[0036]
FIG. 4 is a block of the display control portion. In FIG. 4, reference numeral 21 denotes a display control unit, and the relative position relationship and size between the first image display range A and the second image display range B according to the output of the acceleration sensor 5 of FIG. Is for changing the display content of the image in the first image display range A or the second image display range B.
[0037]
22 is a first buffer means for temporarily storing image data for the first image display range A, 23 is a second buffer means for temporarily storing an image to be displayed in the second image display range B, and 24 Is an image synthesizing means for synthesizing the image data read from the first and second buffers 22 and 23, and 25 is a DA converter for converting a digital signal into an analog signal.
[0038]
Reference numeral 26 denotes a composite signal corresponding to the television system in order to display an image on the liquid crystal panel. Reference numeral 28 denotes mixing means for mixing the D / A converted image data and the composite signal 27. Reference numeral 29 denotes a video signal composed of image data and a composite signal 27.
[0039]
A storage unit 30 stores image data to be displayed, and is a recording medium such as a tape, an image memory, a hard disk, or a CD-ROM.
Reference numeral 31 denotes third buffer means for storing several fields of image data read from the recording medium.
[0040]
Reference numeral 32 denotes filter means composed of product-sum operation means for enlarging and reducing the display image and performing filter processing within the screen or in the time axis direction.
Reference numeral 33 denotes pointer means for designating an image to be read out from the third buffer means 31.
[0041]
Reference numeral 34 denotes a motion analysis unit that receives the detection signal 42 from the acceleration sensor 5 and analyzes the motion of the head-mounted display device mounted on the head. 35 is an operation mode setting switch, and 36 is a reset switch.
Reference numeral 40 denotes an address control unit for designating the position and size of the first image display range A. Reference numeral 41 denotes an external input of data to be displayed in the second image display range B, and the display control unit 21. It is an interface means having a function as a data switch and a buffer for setting from the beginning.
[0042]
By the way, a part or all of the configuration shown in the block of FIG. 4 may be built in the head device. Here, in order to reduce the weight of the head and reduce the size, the head device Separately, it is stored in the wearer's pocket or worn on a belt.
[0043]
Next, the operation will be described based on the above configuration. Here, for the sake of simplicity of explanation, it is assumed that the present system operates on the following assumptions.
First, a moving image recorded on the recording medium 30 is displayed in the first image display range A.
[0044]
Accordingly, it is assumed that the display control unit 21 reads out data of contents to be displayed in the first image display range A from the recording medium 30 at a necessary timing and transfers it to the third buffer 31.
[0045]
In addition, necessary processing corresponding to the recording method, such as decoding when the data is compressed and recorded on the recording medium 30 by the MPEG method or the like, is performed by means (not shown). Since there is no direct relationship with respect to the points, detailed description is omitted.
[0046]
The second image display range B is displayed as a background screen of the first image display range A, and may be an appropriate single color display, for example. Or the display control part 21 may display a panel display for a character, operation, etc. by setting via the interface 41. FIG. That is, the display control unit 21 is configured to be able to change the data to be displayed in the second image display range B by rewriting the data in the second buffer 23.
[0047]
Further, in the present embodiment, the image can be stereoscopically viewed on the display units of the two liquid crystal monitors 1R and 1L of the head-mounted display device. In the case of stereoscopic viewing, the left and right display images need to be images having parallax.
[0048]
In this case, in the block shown in FIG. 2, the display control unit 21, the operation mode setting switch 35, the reset switch 36, and the like except for a part are made into two systems, and an image captured with a parallax in advance May be recorded on the recording medium 30, or a parallax image may be generated as a CG image or the like by means (not shown).
[0049]
As described above, the present invention can also be applied to stereoscopic viewing. Here, for the sake of simplicity, it is assumed that the same image is displayed on the display screens of the two liquid crystal monitors 1R and 1L, and the left and right ones are displayed. Only one system will be described. Further, it is assumed that the entire head-mounted display device system is turned on in advance.
[0050]
The operation of the head-mounted display device of this embodiment shown in FIGS. 3 and 4 will be described below with reference to the flowchart of FIG.
First, the state of the reset switch 36 is detected in step S100, and if it is in the reset state, the position and size of the first image display range A are set to the initial state in the next step S101.
[0051]
Here, for example, as shown by the hatched portion in FIG. 6E, the position of the first image display range A is in the middle of the entire display range, and the size is slightly smaller than the whole. Set it to the same size. This initialization is automatically performed even after the power is turned on.
[0052]
This initialization will be described in more detail. The address control unit 40 outputs a V-WINDOW pulse and an H-WINDOW pulse as timing signals to the image composition unit 24 as shown in FIG.
[0053]
At this time, when the H-WINDOW pulse is at a high level (period of h2-h1) and the V-WINDOW pulse is at a high level (period of v2-v1), the image synthesizing unit 24 Data, that is, moving image data read from the recording medium 30 is output to the DA converter 25.
[0054]
When either the H-WINDOW pulse or the V-WINDOW pulse is at a low level, the image data from the second buffer 23, that is, the background screen data to be displayed in the second image display range B is output to the DA converter 25. .
[0055]
As a result, after being synthesized by the image synthesizing means 24, it is converted into an analog signal by the DA converter 25, and a composite signal 27 is added to form a video signal. The image related to the video signal is displayed on the display units of the liquid crystal monitors 1R and 1L as shown in FIG.
[0056]
Therefore, here, in order to output the H-WINDOW pulse and V-WINDOW pulse signals as described above to the address control unit 40, the display control unit 21 uses the periods h1, h2, and V-WINDOW as the H-WINDOW address signal. As address signals, the periods v1 and v2 are output to the address control unit 40.
[0057]
Next, in step S102, the state of the mode switch 35 is checked. That is, it checks which mode is set from among a plurality of modes. As a mode setting method, for example, the mode may be determined by the number of times the mode switch 35 is pressed by displaying on the display unit to select the mode. Alternatively, a mode setting switch may be further provided.
[0058]
In the following description, the first mode controlled by the first movement control means {circle around (1)} is defined as a predetermined mode. That is, the mode is such that the position of the first image display range A moves only in the horizontal direction within the screen.
[0059]
When the operation mode is not the predetermined mode, the change of the position of the first image display range A is prohibited, the change of the size of the first image display range A is also prohibited, and the first image display is further prohibited. It is assumed that a change in the magnification of the display image within the range A is prohibited. That is, it operates in the eighth mode controlled by the eighth movement control means (8) in the claims.
[0060]
Thus, if the operation mode is a predetermined mode (first mode), the process proceeds to step S103 and subsequent steps. If it is not the predetermined mode (in the eighth mode), the process proceeds to step S106.
Therefore, in the case of the predetermined mode (first mode), the process proceeds to step S103 and the acceleration sensor 5 enters the detection state.
[0061]
Accordingly, when the observer rotates the neck or the body, the acceleration sensor 5 detects the displacement amount and the displacement direction of the head-mounted display device and outputs the displacement information to the motion analysis unit 34 as head-mounted display device displacement information. To do.
[0062]
Further, the motion analysis means 34 calculates a movement vector v. The movement vector calculation method may be a known method used in a conventional VR apparatus, and thus a detailed description thereof is omitted here.
[0063]
In step S104, based on the movement vector information from the motion analysis means 34, it is determined whether it is necessary to change the display position, size, etc. of the first screen.
For example, the direction vector is expressed by being decomposed into X, Y, and Z axis components orthogonal to each other. The components of the movement vector in the X-axis, Y-axis, and Z-axis directions are vx, vy, and vz, respectively.
[0064]
Further, a maximum value and a minimum value (vxmax, vxmin), (vymax, vymin), (vzmax, vzmin) are set in advance for each component, and each portion vx, vy, vz is set to a maximum value and a minimum value, respectively. It is determined whether it is within the range (if it is within the range, condition 1 is satisfied).
[0065]
Furthermore, the difference maximum value and the difference minimum value (xymax, xymin), (yzmax, yzmin), (zxmax, zxmin) are also obtained for the difference (vx−vy, vy−vz, vz−vx) between the components. It is determined in advance whether or not the difference between each component is within the range of the maximum difference value and the minimum difference value (if within the range, condition 2 is satisfied).
[0066]
Therefore, in step S104, conditions 1 and 2 are set as described above, and if these are satisfied, the position of the first image display range A is calculated according to the direction and size, and then the process proceeds to step S105. .
[0067]
On the other hand, if the direction does not satisfy the above-described conditions 1 and 2, it is assumed that the observer did not intend to change the field of view and it is determined that the first image display range A need not be changed. The process proceeds to step S106.
[0068]
In step S105, a new address is output to the address control unit 40 in order to change the first image display range A. Therefore, if the observer moves his / her head by a certain amount to the left, the position of the first image display range A is shifted by the corresponding angle of view. For example, an image as shown in FIG.
[0069]
The change of the display position at this time is the same as the setting at the time of initialization described above. That is, the display control unit 21 may output a new H-WINDOW address signal and V-WINDOW address to the address control unit 40.
[0070]
In step S106, the display data in the first image display range A or the display data in the second image display range B is updated if necessary. Then, it returns to step S100 again and repeats the above operation | movement.
[0071]
FIG. 6 shows how the display image changes corresponding to the movement of the head. FIG. 6E shows the screen corresponding to the case where the head of the observer U of the head-mounted display device of the present embodiment moves in the direction of the arrow in the figure, with the initial position as shown in FIG. Here, since the first mode is the predetermined mode, the display range moves in the direction of FIG. 6D or 6F with FIG. 6E as the initial position.
[0072]
FIG. 8 is a diagram illustrating an example when the observer moves his / her head in the front-rear direction. That is, this corresponds to the case where the face is brought close to or away from the monitor screen when an ordinary television monitor not worn on the head is being observed.
[0073]
Therefore, when the head is moved forward with (b) in FIG. 8 as the initial position, as shown in FIG. 8 (c), the first image display range A becomes larger, corresponding to the enlargement ratio, The display image within the first image display range A is also enlarged.
On the other hand, when the head is moved backward, as shown in FIG. 8A, the first image display range A becomes smaller, and the display in the first image display range A corresponds to the reduction ratio. The image is also reduced.
[0074]
The enlargement control or reduction control of the display image in the first image display range A is realized when the display control unit 21 inputs a count corresponding to the enlargement / reduction magnification to the filter unit 32.
[0075]
As another mode, if the change in the display position is restricted only to the vertical direction with respect to the movement of the observer's head, the screen does not respond even if the head moves in the horizontal direction, and the vertical component of the movement vector is The position of the first image display range A is moved under the condition that the difference from the components in other directions is within the predetermined range within the predetermined range.
[0076]
That is, in FIG. 6, when the head is moved upward with FIG. 6 (e) as the initial position, the display is as shown in (b). On the contrary, when the head is moved downward, FIG. h).
[0077]
The regulation of the movement direction may be performed by changing set values such as the maximum value and minimum value of each component and the difference maximum value and difference minimum value of differences between the components described above. Similarly, it is possible to restrict the movement of the observer's head only in other directions.
[0078]
As described above, the position and size of the first image display range A can be changed in accordance with the movement vector based on the movement of the observer's head. In FIG. 6, the eight directions have been described as representatives in order to show the relationship between the movement of the head and the change of the screen. However, in actuality, it is assumed that the head moves more finely according to the moving direction of the head.
[0079]
Further, the movement amount can be moved finely according to the actual movement amount. Similarly, the enlargement / reduction ratios can be finely changed in accordance with the actual movement amount.
In the above embodiment, the first image display range A in the initial state is set to the size and position as shown in FIG. 6E. However, the initial state can be set to an arbitrary size and position. It is. In this case, there is an advantage that an appropriate setting according to the use situation is possible.
[0080]
As another example, each mode may be automatically selected depending on the type of video to be observed.
For this purpose, a control code for mode selection is added to the video, and this is read by the control unit to determine which mode is selected, and the display mode is switched.
[0081]
In this way, the viewer can automatically observe in the display method intended by the creator of the video, so that the shooting effect intended by the creator of the video unique to the video can be fully enjoyed without requiring complicated operations. It becomes possible to do. In the above-described embodiment, the example in which the motion of the observer's head is detected by the angular velocity detection means 300 has been shown. However, in addition to this, for example, by detecting the angle of the observer's head, The motion of the part may be detected.
[0082]
【The invention's effect】
As described above, according to the present invention, the first image data and the second image data are synthesized by the synthesizing unit, and the synthesizing operation of the synthesizing unit is controlled by the display control unit. A display image related to the first image data can be displayed in an image display range, and a display image related to the second image data can be displayed in a second image display range. When the head is displaced in a predetermined direction, the positions of the first image display range and the second image display range in the display unit of the display unit are relatively changed according to the displacement of the head, When the head is displaced in a direction different from the predetermined direction, the positions of the first image display range and the second image display range on the display unit of the display unit are prohibited from changing, and the head is When the head is displaced in a predetermined direction and the displacement amount of the head is within a predetermined range, the first image display range and the second image display on the display unit of the display unit according to the displacement of the head When the position of the range is relatively changed and the displacement of the head exceeds the predetermined range, the positions of the first image display range and the second image display range on the display unit of the display unit are changed. Fixed the image display range because it was fixed It is possible to express a display image in a more natural form compared to the case where the image is displayed. For example, a background image can be displayed in the second image display range. For example, a single color image, a character, a panel, etc. Can be displayed, which can greatly contribute to the improvement of visibility and operability.
[0084]
Further, according to another feature of the present invention, the movement control means that enables the movement of the display by the movement of the user's neck is appropriately used, so that it can be used according to the purpose of use of the head-mounted display device and the user's preference. Thus, the display movement control means can be properly used. Therefore, it is possible to obtain a more effective sense of presence and further reduce the observer's fatigue.
[0086]
According to another feature of the present invention, the positions of the first image display range and the second image display range on the display unit of the display unit are determined according to the displacement information of the head obtained by the detection unit. By being relatively changed, a natural display corresponding to the movement of the head can be performed even under the condition that the movement of the observer's head is large and the memory capacity is limited. As a result, it is not necessary to provide a special processor or circuit, and the apparatus can be configured at low cost, and the advantage that the apparatus is not increased in size can be obtained. In addition, since the movement control means that enables the movement of the display by the user's neck movement is used as appropriate, the display movement control means can be optimally used according to the purpose of use of the head-mounted display device and the user's preference. Can do. Therefore, it is possible to obtain a more effective sense of presence and further reduce the observer's fatigue.
[Brief description of the drawings]
FIG. 1 is a block diagram illustrating a configuration of a main part of a head-mounted display device according to an embodiment of the present invention.
FIG. 2 is a block diagram of a display unit mounted on the head according to an embodiment of the present invention.
FIG. 3 is an explanatory diagram of display areas of the display units 1L and 1R according to the embodiment.
FIG. 4 is a block diagram of a display control portion showing an embodiment of the present invention.
FIG. 5 is a flowchart illustrating the operation of the embodiment of the present invention.
FIG. 6 is a diagram illustrating a relationship between a head movement and a corresponding display image.
FIG. 7 is a diagram for explaining a timing signal of the address control unit 40;
FIG. 8 is a diagram showing the relationship between the front and rear movements of the head and the corresponding display image.
FIG. 9 is a diagram for explaining an example of movement of a conventional display screen.
[Explanation of symbols]
(1) First movement control means
(2) Second movement control means
(3) Third movement control means
(4) Fourth movement control means
(5) Fifth movement control means
(6) Sixth movement control means
(7) Seventh movement control means
(8) Eighth movement control means
1R, 1L LCD monitor
2R, 2L magnification optical system
3R, 3L backlight
4R, 4L LCD driver
5 Accelerometer
6R, 6L speaker
7 Cable
21 Display controller
22 First buffer means
23 Second buffer means
24 Image composition means
25 DA converter
26 Timing signal generating means
27 Composite signal
28 Mixing means
29 Video signal
30 recording media
31 Buffer means
32 Filter means
33 Pointer means
34 Motion analysis means
35 Operation mode setting switch
36 Reset switch
40 Address control unit
41 Interface means
100L Left eye display
100R Right eye display
200 Display range control means
300 Angular velocity detection means

Claims (4)

It has display means corresponding to the left and right eyes of the observer, and the display means is used by being fixed to the observer's head so as to observe an image displayed on the display unit of the display means. In the head mounted display device,
Combining means for combining the first image data and the second image data;
A display image related to the first image data is displayed in a first image display range in the display unit of the display means, and a display image related to the second image data is displayed in a second image display range. Display control means for controlling the composition operation in the composition means;
A motion detection means for detecting displacement of the head when the display means is fixed to the head of the observer;
In accordance with the displacement information of the head obtained by the motion detection means, the display control means, when the head is displaced in a predetermined direction, the first image on the display unit of the display means according to the displacement of the head. When it is effective that the positions of the display range and the second image display range change relatively, and the head is displaced in a direction different from the predetermined direction, the first image display on the display unit of the display means If the position of the range and the second image display range is prohibited from changing, and the head is displaced in a predetermined direction, and the amount of displacement of the head is within the predetermined range, the head When the position of the first image display range and the second image display range in the display unit of the display unit is controlled to change relatively according to the displacement of the head, and the displacement amount of the head exceeds the predetermined range Is the first image in the display section of the display means Shows the range and head-mounted display device and controls so as to fix the position of the second image display range. The head-mounted display device according to claim 1,
In order to relatively change the position of the first image display range and the second image display range in the display unit of the display unit according to the displacement information of the head obtained by the motion detection unit,
First movement control means for moving the position of the first image display range only in the horizontal direction within the screen;
Second movement control means for moving the position of the first image display range only in the vertical direction within the screen;
The first image display range is changed, the magnification of the display image in the first image display range is changed, and the center position of the first image display range is not changed. 3 movement control means;
Fourth movement control means for moving the position of the first image display range only in the horizontal direction or the vertical direction within the screen;
The position of the first image display range is moved in the vertical direction on the screen, the size of the first image display range is changed, or the magnification of the display image within the first image display range is changed. Or a fifth movement control means
The position of the first image display range is moved in the horizontal direction on the screen, the size of the first image display range is changed, or the magnification of the display image within the first image display range is changed. And sixth movement control means for causing
The position of the first image display range is moved in the horizontal direction or the vertical direction within the screen, the size of the first image display range is changed, or the display image in the first image display range is changed. Any of the seventh movement control means for changing the magnification can be used, and the head-mounted display device is characterized in that it can be used. The head-mounted display device according to claim 2,
The head-mounted display device, wherein the first to seventh movement control means are automatically selected according to the type of video to be observed. It has display means corresponding to the left and right eyes of the observer, and the display means is used by being fixed to the observer's head so as to observe an image displayed on the display unit of the display means. In the head mounted display device,
When the display unit is fixed to the viewer's head, the display range control unit controlling the display unit of the display unit to display the first image display range and the second image display range. Motion detection means for detecting the displacement of the head of the head, and when the amount of head displacement is within a predetermined range according to the displacement information of the head obtained by the motion detection means, If the positions of the first image display range and the second image display range in the display unit of the display unit are relatively changed according to the displacement of the display means and the displacement amount of the head exceeds the predetermined range, the display A position of the first image display range and the second image display range in the display unit of the means is fixed,
A first movement control means for moving the position of the first image display range only in the horizontal direction within the screen;
Second movement control means for moving the position of the first image display range only in the vertical direction within the screen;
The first image display range is changed, the magnification of the display image in the first image display range is changed, and the center position of the first image display range is not changed. 3 movement control means;
Fourth movement control means for moving the position of the first image display range only in the horizontal direction or the vertical direction within the screen;
The position of the first image display range is moved in the vertical direction on the screen, the size of the first image display range is changed, or the magnification of the display image within the first image display range is changed. Or a fifth movement control means
The position of the first image display range is moved in the horizontal direction on the screen, the size of the first image display range is changed, or the magnification of the display image within the first image display range is changed. And sixth movement control means for causing
The position of the first image display range is moved in the horizontal direction or the vertical direction within the screen, the size of the first image display range is changed, or the display image in the first image display range is changed. The position of the first image display range and the second image display range in the display unit of the display unit is relatively changed using any one of the seventh movement control unit that changes the magnification. A head-mounted display device characterized by the above.

Images