JP2017010185A - Display device, display device control method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow a battery to be replaced without stopping the operation of a display device driven by the battery.SOLUTION: A display device comprises: an image display unit 20 that lets a user visually recognize an image and lets an outside scene pass through; a first battery 131 and a second battery 132; a communication unit 117; and a control unit 140 that switches a power source between the first battery 131 and the second battery 132. If the power source is switched from the first battery 131 to the second battery 132, the control unit 140 shifts the operation mode of a head-mounted display device 100 from a normal operation mode to a battery replacement mode in which the power consumption of the image display unit 20 and a communication unit 117 is smaller than the normal operation mode. The communication unit 117 maintains a state of being capable of communication in the battery replacement mode.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a display device, a display device control method, and a program.

  2. Description of the Related Art A device including a battery is known that includes a spare battery and supplies power from the spare battery when the battery is replaced (for example, see Patent Document 1). Patent Document 1 describes a portable device that includes a main battery and a sub-battery, and supplies power from the sub-battery when the main battery is replaced, as a countermeasure against a line being disconnected due to power problems when the amount of power stored in the battery is small. Disclose phone.

JP-A-8-9002

However, in a device having a relatively large amount of power consumption such as a display device, it is necessary to stop the device when replacing the battery. For example, even if a battery is prepared separately from the main power source as in the sub-battery described in Patent Document 1, increasing the capacity of this type of battery increases the size, weight, and cost. It is not realistic from the viewpoint of etc. For this reason, it is not practical to cover the power consumption of the display device with the sub-battery or the like while the battery is replaced.
The present invention has been made in view of the above circumstances, and an object of the present invention is to allow a battery to be replaced without stopping the operation of a display device driven by the battery.

In order to achieve the above object, a display device of the present invention is a display device, which allows a user to visually recognize an image and transmits an outside scene, a first battery and a second battery, and a communication unit. And a control unit that controls the display unit and the communication unit, wherein the control unit selects an operation mode of the display device, a normal operation mode, and at least one of the first and second batteries. It is possible to switch between battery exchange modes for exchange, and in the battery exchange mode, either one of the first and second batteries is used as a power source, and a state where communication by the communication unit is possible is maintained. Features.
According to the present invention, a plurality of batteries can be used efficiently, and the batteries can be replaced without stopping the operation of the apparatus.

In the display device, the control unit may maintain power supply to the communication unit by the first and / or second battery in the battery replacement mode.
According to the present invention, the operation can be continued without stopping or interrupting the communication by maintaining the power supply to the communication unit by the battery. For this reason, there is an increased possibility of avoiding communication interruption or disconnection due to a decrease in battery capacity, thereby eliminating the need for re-authentication when communication is resumed, thereby reducing work load and work downtime. be able to.

In the display device, the control unit reduces power consumption of a supply destination that consumes power of the first and / or second battery in the battery replacement mode, and supplies power to the communication unit. It is characterized by maintaining.
According to the present invention, it is possible to continue the operation for a longer time without stopping or interrupting communication by diverting the battery power to the power supply to the communication unit and reducing the power consumption of other supply destinations. .

In order to achieve the above object, a display device according to the present invention includes a display unit that allows a user to visually recognize an image and transmits an outside scene, a first battery and a second battery, a communication unit, and a power source. A control unit that switches between the first battery and the second battery, and the control unit switches an operation mode of the display device when switching power from the first battery to the second battery. The normal operation mode is shifted to a battery replacement mode in which power consumption of the display unit and the communication unit is smaller than that of the normal operation mode, and the communication unit maintains a communicable state in the battery replacement mode. Features.
According to the present invention, a plurality of batteries can be used efficiently, and the batteries can be replaced without stopping the operation of the apparatus.

In the display device, the display unit displays a first display unit that displays an image corresponding to the left eye of the user, and a second display unit displays an image corresponding to the right eye of the user. And a display unit, wherein the control unit stops display of either the first display unit or the second display unit in the battery replacement mode.
According to the present invention, the power consumption of the display unit can be reduced, and the second battery can sufficiently supply power during the replacement of the first battery.

In the display device, the control unit may set a frame rate of an image to be displayed on the display unit in the battery replacement mode to be lower than a frame rate of an image to be displayed on the display unit in the normal operation mode. Features.
According to the present invention, power consumption during replacement of the first battery can be further reduced, and power can be supplied by the second battery.

In the display device, the control unit makes a display area of the display unit in the battery replacement mode smaller than a display area of the display unit in the normal operation mode.
According to the present invention, power consumption during replacement of the first battery can be further reduced, and power can be supplied by the second battery.

In the display device, the control unit may start communication without performing authentication when the operation mode of the display device shifts from the battery replacement mode to the normal operation mode. In the exchange mode, the communicable state is maintained by the communication unit.
According to the present invention, when the operation mode shifts from the battery replacement mode to the normal operation mode, communication can be started without performing authentication.

In the display device, the control unit may switch the operation state of the communication unit to a state where power consumption of the communication unit is lower than that in the normal operation mode in the battery replacement mode. .
According to the present invention, by reducing the power consumption of the communication unit, the operation can be continued for a longer time without stopping or interrupting communication.

Further, the display device includes a non-volatile storage unit, and the control unit stores data related to operation of the control unit in the storage unit when the control unit shifts to the battery replacement mode. Is performed based on the data stored in the storage unit when shifting from the battery replacement mode to the normal operation mode.
According to the present invention, when shifting from the battery replacement mode to the normal operation mode, the control unit can be returned to the state before shifting to the battery replacement mode.

In the display device, when the first battery is replaced, the control unit performs display based on the remaining capacity of the first battery after replacement on the display unit.
According to the present invention, the user can check the remaining capacity of the first battery after the replacement of the first battery.

In the display device, the control unit charges the second battery with electric power of the first battery when a remaining capacity of the first battery is equal to or greater than a threshold value. .
According to the present invention, the remaining capacity of the second battery can be maintained in a good state.

Further, in the display device, the control unit causes the display unit to display a display prompting replacement of the first battery when a remaining capacity of the first battery is equal to or less than a threshold value. To do.
According to the present invention, it is possible to notify that the remaining capacity of the first battery is low, and it is possible to prevent problems due to insufficient remaining capacity of the first battery.

The display device may further include a lid that opens and closes a battery housing that detachably houses the first battery, and an open / close detection unit that detects opening and closing of the lid, and the control unit includes the open / close detection unit. When the opening of the lid is detected by the unit, the power source is switched from the first battery to the second battery.
According to the present invention, the power source can be quickly switched to the second battery in response to the operation of replacing the first battery.

In order to achieve the above object, a display device according to the present invention is a display device that allows a user to visually recognize an image and transmits an outside scene, a first battery and a second battery, and the display. A control unit that switches an operation mode of the apparatus to a normal operation mode in which power is supplied from the first battery and a battery replacement mode in which power is supplied from the second battery, and the control unit includes the After the operation mode is switched from the battery replacement mode to the normal operation mode, the second battery is charged by the power of the first battery.
According to the present invention, the battery can be replaced without stopping the operation of the display device driven by the battery, and the occurrence of a situation in which the battery replacement mode cannot be executed due to insufficient capacity of the second battery is suppressed. it can.

In the display device, when the control unit detects replacement of the first battery, the operation is performed when a remaining capacity of the first battery after replacement is equal to or greater than a preset reference value. The mode is switched to the normal operation mode.
ADVANTAGE OF THE INVENTION According to this invention, the malfunction of the display apparatus by the lack of the remaining capacity of the replaced 1st battery can be prevented.

In the display device, the control unit executes an end sequence when the remaining capacity of the second battery satisfies a preset condition during execution of the battery replacement mode. To do.
According to the present invention, data loss or the like can be prevented by executing an end sequence when the second battery has insufficient capacity, for example.

In the display device, the control unit turns off the power after storing information on the operation state of the display device in the storage unit as the end sequence.
ADVANTAGE OF THE INVENTION According to this invention, it can prevent that the information regarding the operation state of a display apparatus lose | disappears.

In the display device, when the remaining capacity of the second battery falls below a preset first reference value during execution of the battery replacement mode, the control unit After changing the display mode to a mode for reducing the power consumption of the display device, and changing the display mode to a mode for reducing the power consumption of the display device, the remaining capacity of the second battery is the second The end sequence is executed when the value falls below a reference value.
According to the present invention, when the remaining capacity of the second battery decreases, the power consumption of the display device can be reduced by changing the display mode to a mode that reduces power consumption. Further, when the remaining capacity of the second battery is further reduced, the data loss of the display device can be prevented by executing the end sequence.

In the display device, when the remaining capacity of the second battery decreases below the first reference value during execution of the battery replacement mode, the control unit displays the second value on the display unit. The display is based on the remaining capacity of the battery.
According to the present invention, when the remaining capacity of the second battery decreases, the display regarding the remaining capacity of the second battery is performed, and the state of the display device can be notified to the user.

In the display device, the display unit displays a first display unit that displays an image corresponding to the left eye of the user, and a second display unit displays an image corresponding to the right eye of the user. And a display unit, wherein the control unit stops display of either the first display unit or the second display unit in the battery replacement mode.
According to the present invention, the display function of the display device can be maintained, power consumption can be effectively reduced, and the second battery can sufficiently supply power during the replacement of the first battery.

In the display device, the control unit may set a frame rate of an image to be displayed on the display unit in the battery replacement mode to be lower than a frame rate of an image to be displayed on the display unit in the normal operation mode. Features.
According to the present invention, it is possible to further reduce power consumption while supplying power with the second battery.

In the display device, the control unit makes a display area of the display unit in the battery replacement mode smaller than a display area of the display unit in the normal operation mode.
According to the present invention, power consumption during replacement of the first battery can be further reduced, and power can be supplied by the second battery.

Further, in the display device, in the battery replacement mode, the control unit thins out image data to be displayed on the display unit and causes the display unit to display the pixel, or causes the display unit to use pixels for display on the display unit. It is characterized by instructing to thin out.
According to the present invention, it is possible to further reduce power consumption while supplying power with the second battery.

12. The display device according to claim 1, wherein in the battery replacement mode, the control unit displays an image on a peripheral portion in a display area of the display unit. Display device.
According to the present invention, the visibility of the outside scene during the power exchange with the second battery is improved, and the battery exchange work can be performed efficiently.

Further, the display device includes a communication unit, and the control unit supplies power of the second battery to the communication unit in the battery replacement mode, and maintains the communication unit in a communicable state. It is characterized by that.
According to the present invention, when the operation mode is switched from the battery replacement mode to the normal operation mode, it is possible to save the trouble of performing communication setting of the communication unit again.

In the display device, the control unit may start communication without performing authentication when the operation mode of the display device shifts from the battery replacement mode to the normal operation mode. In the exchange mode, the communicable state is maintained by the communication unit.
According to the present invention, when the operation mode shifts from the battery replacement mode to the normal operation mode, communication can be started without performing authentication.

In the display device, the control unit may switch the operation state of the communication unit to a state where power consumption of the communication unit is lower than that in the normal operation mode in the battery replacement mode. .
According to the present invention, by reducing the power consumption of the communication unit, the operation can be continued for a longer time without stopping or interrupting communication.

The display device control method of the present invention is a display device control method including a display unit that allows a user to visually recognize an image and transmits an outside scene, and a communication unit, and the power source of the display device is a first battery. When the battery is changed from the second battery to the second battery, the operation mode of the display device is changed from the normal operation mode to the battery replacement mode in which the power consumption of the display unit and the communication unit is smaller than the normal operation mode. In the battery exchange mode, the communication unit is maintained in a communicable state.
According to the present invention, a plurality of batteries can be used efficiently, and the batteries can be replaced without stopping the operation of the apparatus.

The display device control method according to the present invention is a display device control method including a display unit that allows a user to visually recognize an image and transmits an outside scene, and a first battery and a second battery. Switching the operation mode from a normal operation mode in which power is supplied from the first battery to a battery exchange mode in which power is supplied from the second battery, and changing the operation mode from the battery replacement mode to the normal operation. Charging the second battery with the electric power of the first battery after switching to the mode.
According to the present invention, the battery can be replaced without stopping the operation of the display device driven by the battery, and the occurrence of a situation in which the battery replacement mode cannot be executed due to insufficient capacity of the second battery is suppressed. it can.

A program according to the present invention is a program executable by a computer that controls a display device including a display unit that allows a user to visually recognize an image and transmit an outside scene, and a first battery and a second battery. The operation mode of the display device is switched between a normal operation mode in which power is supplied from the first battery and a battery replacement mode in which power is supplied from the second battery, and the operation mode is switched to the battery replacement mode. Then, after switching to the normal operation mode, the second battery is caused to function as a control unit that is charged by the power of the first battery.
According to the present invention, the battery can be replaced without stopping the operation of the display device driven by the battery, and the occurrence of a situation in which the battery replacement mode cannot be executed due to insufficient capacity of the second battery is suppressed. it can.

Explanatory drawing which shows the external appearance structure of a head mounting | wearing type display apparatus. The functional block diagram of each part which comprises a head mounting | wearing type display apparatus. It is a figure which shows the structure of a battery accommodating part. The circuit diagram which shows the structural example of a power supply part. FIG. The flowchart which shows the process sequence of a control part. The flowchart which shows the detailed procedure of the battery exchange mode of 1st Embodiment. The flowchart which shows the detailed procedure of the battery exchange mode of 1st Embodiment. Explanatory drawing which shows the example of the state transition of a head mounted type display apparatus. Explanatory drawing which shows the example of a display which concerns on replacement | exchange of a battery. The flowchart which shows the detailed procedure of the battery exchange mode of 2nd Embodiment. The flowchart which shows the detailed procedure of the battery exchange mode of 2nd Embodiment. The schematic block diagram which shows the structure of the communication system of 3rd Embodiment. The figure which shows the structural example of a management table. The figure which shows the communication sequence of a head mounting | wearing type display apparatus and a server.

[First Embodiment]
FIG. 1 is an explanatory diagram showing an external configuration of the head-mounted display device 100. The head-mounted display device 100 is a display device that is mounted on the head, and is also referred to as a head mounted display (HMD). The head-mounted display device 100 of the present embodiment is an optically transmissive head-mounted display device that allows a user to visually recognize a virtual image and at the same time directly view an outside scene. In this specification, a virtual image visually recognized by the user with the head-mounted display device 100 is also referred to as a “display image” for convenience. Moreover, emitting image light generated based on image data is also referred to as “displaying an image”.

  The head-mounted display device 100 includes an image display unit 20 that allows a user to visually recognize a virtual image when mounted on the user's head, and a control device 10 that controls the image display unit 20. The control device 10 also functions as a controller for the user to operate the head-mounted display device 100.

  The image display unit 20 is a mounting body that is mounted on the user's head, and has a glasses shape in the present embodiment. The image display unit 20 includes a right holding unit 21, a right display driving unit 22, a left holding unit 23, a left display driving unit 24, a right optical image display unit 26, a left optical image display unit 28, and a camera 61. And a microphone 63. The right optical image display unit 26 and the left optical image display unit 28 are arranged so as to be positioned in front of the right and left eyes of the user when the user wears the image display unit 20, respectively. One end of the right optical image display unit 26 and one end of the left optical image display unit 28 are connected to each other at a position corresponding to the eyebrow of the user when the user wears the image display unit 20.

  The right holding unit 21 extends from the end ER which is the other end of the right optical image display unit 26 to a position corresponding to the user's temporal region when the user wears the image display unit 20. It is a member. Similarly, the left holding unit 23 extends from the end EL which is the other end of the left optical image display unit 28 to a position corresponding to the user's temporal region when the user wears the image display unit 20. It is a member provided. The right holding unit 21 and the left holding unit 23 hold the image display unit 20 on the user's head like a temple of glasses.

  The right display drive unit 22 and the left display drive unit 24 are disposed on the side facing the user's head when the user wears the image display unit 20. The right display drive unit 22 and the left display drive unit 24 are collectively referred to simply as “display drive unit”, and the right optical image display unit 26 and the left optical image display unit 28 are simply referred to as “optical image display unit”. Also called.

The display drive units 22 and 24 include liquid crystal displays 241 and 242 (Liquid Crystal Display, hereinafter also referred to as “LCDs 241 and 242”), projection optical systems 251 and 252 (see FIG. 2). Details of the configuration of the display driving units 22 and 24 will be described later. The optical image display units 26 and 28 as optical members include light guide plates 261 and 262 (see FIG. 2) and a light control plate 20A. The light guide plates 261 and 262 are formed of a light transmissive resin or the like, and guide the image light output from the display driving units 22 and 24 to the user's eyes. The dimming plate 20A is a thin plate-like optical element, and is arranged so as to cover the front side of the image display unit 20 which is the side opposite to the user's eye side. As the light control plate 20A, various ones such as one having almost zero light transmittance, one that is almost transparent, one that attenuates the amount of light and transmits light, and one that attenuates or reflects light of a specific wavelength are used. Can do. By appropriately selecting the optical characteristics (light transmittance, etc.) of the light control plate 20A, the external light amount incident on the right optical image display unit 26 and the left optical image display unit 28 from the outside is adjusted to visually recognize the virtual image. You can adjust the ease. In the present embodiment, a case will be described in which at least a light control plate 20A having such a light transmittance that a user wearing the head-mounted display device 100 can visually recognize an outside scene is used. The light control plate 20A protects the right light guide plate 261 and the left light guide plate 262, and suppresses damage to the right light guide plate 261 and the left light guide plate 262, adhesion of dirt, and the like.
The dimming plate 20A may be detachable from the right optical image display unit 26 and the left optical image display unit 28, or may be mounted by replacing a plurality of types of dimming plates 20A, or may be omitted. .

The camera 61 is disposed at the end ER that is the other end of the right optical image display unit 26. The camera 61 captures an outside scene that is an external scenery in a direction opposite to the user's eye side, and acquires an outside scene image. The camera 61 of this embodiment shown in FIG. 1 is a monocular camera, but may be a stereo camera.
The shooting direction of the camera 61, that is, the angle of view, is taken from the front side direction of the head-mounted display device 100, in other words, at least a part of the outside scene in the user's viewing direction when the head-mounted display device 100 is mounted. Direction. In addition, although the angle of view of the camera 61 can be set as appropriate, the imaging range of the camera 61 is a range including the outside world that the user can visually recognize through the right optical image display unit 26 and the left optical image display unit 28. It is preferable. Furthermore, it is more preferable that the imaging range of the camera 61 is set so that the entire field of view of the user through the light control plate 20A can be photographed.

  The image display unit 20 further includes a connection unit 40 for connecting the image display unit 20 to the control device 10. The connection unit 40 includes a main body cord 48 connected to the control device 10, a right cord 42, a left cord 44, and a connecting member 46. The right cord 42 and the left cord 44 are codes in which the main body cord 48 is branched into two. The right cord 42 is inserted into the casing of the right holding unit 21 from the distal end AP in the extending direction of the right holding unit 21 and connected to the right display driving unit 22. Similarly, the left cord 44 is inserted into the housing of the left holding unit 23 from the distal end AP in the extending direction of the left holding unit 23 and connected to the left display driving unit 24.

  The connecting member 46 is provided at a branch point between the main body cord 48, the right cord 42 and the left cord 44, and has a jack for connecting the earphone plug 30. A right earphone 32 and a left earphone 34 extend from the earphone plug 30. A microphone 63 is provided in the vicinity of the earphone plug 30. The earphone plug 30 to the microphone 63 are combined into one cord, and the cord branches from the microphone 63 and is connected to each of the right earphone 32 and the left earphone 34.

  For example, as shown in FIG. 1, the microphone 63 is arranged such that the sound collection unit of the microphone 63 faces the user's line of sight, collects sound, and outputs a sound signal to the sound processing unit 190. For example, the microphone 63 may be a monaural microphone or a stereo microphone, may be a directional microphone, or may be an omnidirectional microphone.

  It is also possible to combine the right code 42 and the left code 44 into one code. Specifically, the lead wire inside the right cord 42 is drawn into the left holding portion 23 side through the inside of the main body of the image display unit 20, and is covered with a resin together with the lead wire inside the left cord 44 to be combined into one cord. Also good.

  The image display unit 20 and the control device 10 transmit various signals via the connection unit 40. A connector (not shown) that fits each other is provided at each of the end of the main body cord 48 opposite to the connecting member 46 and the control device 10. By fitting / releasing the connector of the main body cord 48 and the connector of the control device 10, the control device 10 and the image display unit 20 are connected or disconnected. For the right cord 42, the left cord 44, and the main body cord 48, for example, a metal cable or an optical fiber can be adopted.

  The control device 10 is a device for controlling the head-mounted display device 100. The control device 10 includes switches including an enter key 11, a lighting unit 12, a display switching key 13, a luminance switching key 15, a direction key 16, a menu key 17, and a power switch 18. In addition, the control device 10 includes a track pad 14 that is touched by a user with a finger.

  The determination key 11 detects a pressing operation and outputs a signal for determining the content operated by the control device 10. The lighting unit 12 notifies the operation state of the head-mounted display device 100 by its light emission state. Examples of the operating state of the head-mounted display device 100 include power ON / OFF. As the lighting unit 12, for example, an LED (Light Emitting Diode) is used. The display switching key 13 detects a pressing operation and outputs a signal for switching the display mode of the content video between 3D and 2D, for example.

  The track pad 14 detects the operation of the user's finger on the operation surface of the track pad 14 and outputs a signal corresponding to the detected content. As the track pad 14, various track pads such as an electrostatic type, a pressure detection type, and an optical type can be adopted. The luminance switching key 15 detects a pressing operation and outputs a signal for increasing or decreasing the luminance of the image display unit 20. The direction key 16 detects a pressing operation on a key corresponding to the up / down / left / right direction, and outputs a signal corresponding to the detected content. The power switch 18 switches the power-on state of the head-mounted display device 100 by detecting a slide operation of the switch.

FIG. 2 is a functional block diagram of each part constituting the head-mounted display device 100.
As shown in FIG. 2, the head-mounted display device 100 is connected to an external device OA via an interface 125. The interface 125 is an interface for connecting various external devices OA that are content supply sources to the control device 10. As the interface 125, for example, an interface corresponding to a wired connection such as a USB interface, a micro USB interface, or a memory card interface can be used.
The external device OA is used as an image supply device that supplies an image to the head-mounted display device 100. For example, a personal computer (PC), a mobile phone terminal, a game terminal, or the like is used.

  The control device 10 of the head-mounted display device 100 includes a control unit 140, an operation unit 111, an input information acquisition unit 110, a storage unit 120, a transmission unit (Tx) 51, and a transmission unit (Tx) 52. Have.

  The operation unit 111 detects an operation by the user. The operation unit 111 includes the determination key 11, the display switching key 13, the track pad 14, the luminance switching key 15, the direction key 16, the menu key 17, and the power switch 18 illustrated in FIG.

  The input information acquisition unit 110 acquires a signal corresponding to an operation input by the user. As a signal corresponding to the operation input, for example, there is an operation input to the track pad 14, the direction key 16, and the power switch 18.

  The storage unit 120 is a nonvolatile storage device, and stores various computer programs. The storage unit 120 may store image data to be displayed on the image display unit 20 of the head-mounted display device 100.

  In addition, a three-axis sensor 113, a GPS 115, a communication unit 117, and a voice recognition unit 114 are connected to the control unit 140. The triaxial sensor 113 is a triaxial acceleration sensor, and the control unit 140 can acquire the detection value of the triaxial sensor 113. The GPS 115 includes an antenna (not shown), receives a GPS (Global Positioning System) signal, and obtains the current position of the control device 10. The GPS 115 outputs the current position and the current time obtained based on the GPS signal to the control unit 140. Further, the GPS 115 may have a function of acquiring the current time based on information included in the GPS signal and correcting the time counted by the control unit 140 of the control device 10.

The communication unit 117 executes wireless data communication conforming to a wireless communication standard such as a wireless LAN (WiFi (registered trademark)) or Miracast (registered trademark). In addition, the communication unit 117 performs wireless data communication in accordance with near field communication standards such as Bluetooth (registered trademark), Bluetooth Low Energy, Bluetooth Smart, iBeacon (registered trademark), RFID, Felica (registered trademark), etc. It is also possible to do. When performing communication using Bluetooth, the communication unit 117 may function as a master device or a slave device.
When the external device OA is wirelessly connected to the communication unit 117, the control unit 140 acquires content data from the communication unit 117 and performs control for displaying an image on the image display unit 20. On the other hand, when the external device OA is wired to the interface 125, the control unit 140 acquires content data from the interface 125 and performs control for displaying an image on the image display unit 20. Therefore, the communication unit 117 and the interface 125 are hereinafter collectively referred to as a data acquisition unit DA.
The data acquisition unit DA acquires content data from the external device OA. The data acquisition unit DA acquires image data (also referred to as “display image data”) displayed by the head-mounted display device 100 from the external device OA.

  In addition, the communication unit 117 may be configured to perform wireless communication by a plurality of types of communication methods among wireless communication and short-range wireless communication in accordance with the various standards described above. For example, the communication unit 117 may be configured to execute communication by WiFi and communication by Bluetooth at the same time or by switching. In this case, the communication unit 117 can switch the communication with the same communication partner device to the communication with the other communication method while executing communication with the communication partner device by any communication method. It is good also as a simple structure. For example, while performing communication with a personal computer (not shown) as the external device OA using WiFi, the communication with the personal computer may be switched to communication using Bluetooth. In this case, it is preferable that the communication with the personal computer is maintained, and authentication using a user ID or password can be omitted when switching from WiFi to Bluetooth. That is, it is preferable that user authentication or the like in an application after establishing communication can be omitted even when a sequence defined by the WiFi and Bluetooth protocols is executed. Further, the output may be changed without switching the communication method. For example, during communication with Bluetooth, the class (output) may be changed to a class with lower power consumption.

  The voice recognition unit 114 extracts features from digital voice data collected by the microphone 63 and converted into digital data by a voice processing unit 190, which will be described later, and models it. The voice recognition unit 114 extracts and models the features of the voice, recognizes the voices of a plurality of people separately, and recognizes the person who speaks for each voice, or converts the voice into text. Perform text conversion to convert. The voice recognition unit 114 may be configured to identify the language type of the voice data in the voice recognition process.

  The control device 10 includes a first battery 131, a second battery 132, a first battery monitoring IC 133, a second battery monitoring IC 134, a battery control unit 135, and a power supply unit 137.

The first battery 131 is a main battery of the head-mounted display device 100. The first battery 131 is configured using, for example, a secondary battery such as a lithium ion battery, a lithium polymer battery, or a nickel metal hydride battery, a power storage unit such as an electric double layer capacitor, or a primary battery.
The second battery 132 is a sub battery of the head-mounted display device 100. The second battery 132 supplies power to the head-mounted display device 100 when the battery of the first battery 131 is replaced. The second battery 132 is a rechargeable battery, and is charged by the first battery 131 when the first battery 131 is replaced.
The second battery 132 may be a primary battery, but can be charged with a secondary battery such as a lithium ion battery, a lithium polymer battery, or a nickel metal hydride battery, a power storage unit such as an electric double layer capacitor, or a fuel cell. A configuration is preferred. Further, the second battery 132 may be configured to be chargeable by non-contact charging (wireless charging) using an electromagnetic induction method, a radio wave reception method, a resonance method, or the like. Further, a solar cell may be used as the second battery 132.

  The battery capacities of the first battery 131 and the second battery 132 are arbitrary. For example, the first battery 131 is a main battery, and the second battery 132 is a sub-battery having a smaller capacity than the first battery 131. can do. In this case, the head-mounted display device 100 operates using the first battery 131 that is the main battery as a power source in a normal operation mode described later. Further, in the battery exchange mode described later, the second battery 132 that is a sub-battery operates as a power source. Switching between the first battery 131 and the second battery 132 is performed by the control unit 140 as described later.

  In addition, the first battery 131 and the second battery 132 may have the same capacity, or the head-mounted display device 100 may be configured to operate with the same capacity regardless of the capacity. . In this case, the head-mounted display device 100 does not perform control to determine one of the first battery 131 and the second battery 132 as a main battery and the other as a sub battery. That is, the first battery 131 and the second battery 132 are not determined as main and sub, and either one of them may be operated as a power source, and both the first battery 131 and the second battery 132 are operated. Power may be supplied. In this case, the head-mounted display device 100 can operate as long as the capacity of either the first battery 131 or the second battery 132 remains.

The first battery monitoring IC 133 is connected to the first battery 131 and the battery control unit 135, and calculates the remaining capacity of the first battery 131. For example, the first battery monitoring IC 133 measures the terminal voltage of the first battery 131 and calculates the remaining capacity of the first battery 131 based on the measured terminal voltage.
The method for calculating the remaining capacity of the first battery 131 by the first battery monitoring IC 133 is to measure and integrate the discharge current of the first battery 131, and based on the accumulated discharge current amount, the remaining capacity of the first battery 131. The capacity may be calculated. Further, the first battery monitoring IC 133 may calculate a remaining capacity of the first battery 131 by measuring a change in impedance of the first battery 131. The first battery monitoring IC 133 outputs the measured terminal voltage of the first battery 131 and the calculated remaining capacity of the first battery 131 to the battery control unit 135.
The first battery monitoring IC 133 may be built in the exterior of the first battery 131 or may be provided integrally with the first battery 131. The first battery 131 includes a battery main body (not shown) in which a secondary battery such as a lithium ion battery, a lithium polymer battery, or a nickel metal hydride battery, or a primary battery is enclosed in a package, and an exterior that houses the battery main body. . Terminals connected to the electrodes inside the package are exposed on the exterior. The first battery monitoring IC 133 may be housed in the exterior together with the battery body. In this case, the first battery monitoring IC 133 is connected to the electrode of the battery body. The terminal on the exterior of the first battery 131 is connected to the output terminal of the first battery monitoring IC 133.

The second battery monitoring IC 134 is connected to the second battery 132 and the battery control unit 135 and calculates the remaining capacity of the second battery 132. Similar to the first battery monitoring IC 133, the second battery monitoring IC 134 measures the terminal voltage of the second battery 132, and calculates the remaining capacity of the second battery 132 based on the measured terminal voltage.
The second battery monitoring IC 134 calculates the remaining capacity of the second battery 132 by measuring and accumulating the discharge current of the second battery 132, and based on the accumulated amount of discharge current. The capacity may be calculated. Further, the second battery monitoring IC 134 may calculate a remaining capacity of the second battery 132 by measuring a change in impedance of the second battery 132. The second battery monitoring IC 134 outputs the measured terminal voltage of the second battery 132 and the calculated remaining capacity of the second battery 132 to the battery control unit 135.
The second battery monitoring IC 134 may be built in the main body of the second battery 132 or may be provided integrally with the second battery 132.

FIG. 3 is a diagram illustrating a configuration of the battery housing part 122. The battery housing part 122 is housed in a housing 145 in which the control device 10 is mounted.
The first battery 131, the second battery 132, the first battery monitoring IC 133, and the second battery monitoring IC 134 are accommodated in the battery accommodating portion 122. The first battery 131 is detachably accommodated in the battery accommodating portion 122. That is, the battery housing part 122 includes a holding part (not shown) that detachably holds the first battery 131.

The battery housing part 122 includes a lid 123. When the lid 123 is opened, the first battery 131 can be taken in and out of the battery housing portion 122.
The battery housing part 122 is provided with an opening / closing detection part 124 that detects opening / closing of the lid 123. Various methods can be adopted for the opening / closing detection unit 124, but in this embodiment, a magnetic detection type opening / closing detection unit 124 is adopted. The open / close detection unit 124 includes a magnet 124A provided on the lid 123 and a Hall element 124B provided on the main body side of the battery housing 122, and detects the magnetic force of the magnet 124A by the Hall element 124B. When the lid 123 is opened and the magnetic force of the magnet 124A cannot be detected by the Hall element 124B, the open / close detection unit 124 outputs a signal indicating that the lid 123 is opened to the control unit 140.
The configuration of the open / close detection unit 124 is not limited to a magnetic detection type configuration including the magnet 124A and the Hall element 124B. For example, you may employ | adopt the switch type structure provided with the toggle switch which switches the conduction | electrical_connection state of a contact, and an open state corresponding to opening and closing of the lid | cover 123, or a lever switch. Alternatively, the open / close detection unit 124 may have a light detection type configuration that detects the opening / closing of the lid 123 using light such as infrared rays or visible light, or detects the insertion / extraction of the convex portion into the concave portion. The lid 123 may be detected by opening / closing.

The battery control unit 135 is connected to the control unit 140, the first battery 131, the second battery 132, and the power supply unit 137.
The battery control unit 135 switches the power supply of the head-mounted display device 100 under the control of the control unit 140. That is, the battery control unit 135 switches the battery that supplies power to the head-mounted display device 100 between the first battery 131 and the second battery 132. In addition, power supplied from the first battery 131 or the second battery 132 is input to the battery control unit 135. The battery control unit 135 outputs the input power to the power supply unit 137. In addition, the battery control unit 135 controls a supply destination to which the power supply unit 137 supplies power in accordance with an instruction from the control unit 140.

  The power supply unit 137 is connected to the battery control unit 135. The power supply unit 137 supplies the power supplied from the first battery 131 or the second battery 132 to the supply destination designated by the battery control unit 135. For example, in the normal operation mode described later, the battery control unit 135 instructs the power supply unit 137 to supply power to each unit of the head-mounted display device 100. For this reason, the power supply unit 137 supplies power to each unit of the head-mounted display device 100. Further, in the battery exchange mode described later, power is supplied from the battery control unit 135 to the power supply unit 137 to the control unit 140, the communication unit 117, the right display drive unit 22 and the left display drive unit 24 of the image display unit 20. Is instructed. That is, the power supply unit 137 supplies power to the control unit 140, the communication unit 117, and the right display drive unit 22 and the left display drive unit 24 of the image display unit 20.

  Here, a configuration example of the power supply unit 300 that functions as a power supply for the head-mounted display device 100 will be described. The power supply unit 300 includes a first battery 131, a second battery 132, and a battery control unit 135.

  FIG. 4 is a circuit diagram illustrating in detail a configuration example of the power supply unit 300. The circuit diagram shown in FIG. 4 is an example of a specific configuration of the power supply unit 300, and it is of course possible to replace part or all of the circuit in FIG. 3 with an equivalent circuit or a circuit having an equivalent function. .

  In the configuration example of FIG. 4, the power supply unit 300 includes a DC connector 139. An external AC adapter (not shown) can be connected to the DC connector 139, the driving power for the head-mounted display device 100 and the charging of the first battery 131 and the second battery 132 from this AC adapter. It can be supplied with power.

The power supply unit 300 includes a first power supply unit 301 including a first battery 131 and a second power supply unit 311 including a second battery 132. The power supply unit 300 includes a DC / DC converter 321, a current detection unit 322, and a sub battery 323.
The battery control unit 135 includes a PMIC (Power Management Integrated Circuit) 332 that detects the state of each unit of the power supply unit 300 and a CPU 331 that controls each unit of the power supply unit 300. The CPU 331 is connected to the DC connector 139 and can detect the voltage of the DC connector 139.

The DC / DC converter 321 performs voltage conversion of direct current supplied from the DC connector 139, the first power supply unit 301, and the second power supply unit 311, and outputs the converted voltage to the power supply unit 137. The power supply lines L1 and L2 are connected to the input terminal 321A of the DC / DC converter 321. The power supply line L1 connects the DC connector 139 and the first power supply unit 301 to the DC / DC converter 321. The power supply line L2 connects the DC connector 139 and the second power supply unit 311 to the DC / DC converter 321.
The current detection unit 322 detects a current flowing through the first power supply unit 301, the second power supply unit 311, and the DC / DC converter 321 as described later. The current detection unit 322 transmits / receives a control signal to / from the PMIC 332 and transmits a detection result to the PMIC 332.

  The PMIC 332 acquires the detection result of the voltage and current by the current detection unit 322. The PMIC 332 detects the temperature of the first battery 131 and the second battery 132, the output voltage of the DC / DC converter 321 and the output voltage of the first battery 131 and the second battery 132. The PMIC 332 is connected to a thermistor T31 of a main board (not shown) on which the control unit 140 of the control device 10 is mounted, and the PMIC 332 detects the temperature of the main board. The PMIC 332 outputs these detection results to the CPU 331. A sub-battery 323 that functions as a backup power source is connected to the PMIC 332. When the remaining amount of the first battery 131 and the second battery 132 is extremely low, the PMIC 332 is operated by the sub battery 323 and supplies the power of the sub battery 323 to the CPU 331.

The CPU 331 is connected to the charging unit 302 included in the first power supply unit 301 and the charging unit 312 included in the second power supply unit 311, and controls each of the charging units 302 and 312.
Further, the CPU 331 calculates the remaining amounts of the first battery 131 and the second battery 132 based on the output voltages of the first battery 131, the second battery 132, and the DC / DC converter 321 detected by the PMIC 332. , Output to the control unit 140.
The CPU 331 outputs the detection result of the temperature of each unit detected by the PMIC 332 or the determination result of whether or not the detected temperature exceeds a preset threshold value to the control unit 140.

The first power supply unit 301 includes FET_T01 and FET_T02, and a charging unit 302 that switches on / off of the FET_T01 and FET_T02.
FET_T01 and FET_T02 are switching elements configured by FETs (Field Effect Transistors). The FET_T02 is provided between the first battery 131 and the node N11 of the power supply line L1, and connects the first battery 131 to the power supply line L1. The FET_T01 is provided between the DC connector 139 and the node N11 of the power supply line L1, and connects the DC connector 139 and the first battery 131.
The charging unit 302 turns on / off each of the FET_T01 and the FET_T02 in accordance with a control signal input from the CPU 331.

  When the FET_T01 is turned on, the DC connector 139 is connected to the input terminal 321A of the DC / DC converter 321. When an AC adapter (not shown) is connected to the DC connector 139, power can be supplied from the AC adapter to the DC connector 139. In addition, since power can be supplied from the AC adapter to the first battery 131, when the FET_T02 is turned on in this state, the first battery 131 can be charged.

  A switching unit 303 is provided between the first battery 131 and the node N11 on the power supply line L1. The switching unit 303 can be configured by a power supply control element generally known as an ORing controller. The switching unit 303 functions as a switch that is turned on / off according to the potential difference between the node N11 and the node N16 on the first battery 131 side. Specifically, it is turned on when the potential of the node N11 is lower than the potential of the node N16, and connects the first battery 131 to the power supply line L1.

  When the CPU 331 controls the charging unit 302 to turn off the FET_T01 and turn on the FET_T02, the switching unit 303 is turned on when the remaining power of the first battery 131 is sufficient. Then, the first battery 131 is connected to the power supply line L <b> 1, and a direct current is input from the first battery 131 to the DC / DC converter 321. As a result, the power supplied by the first battery 131 is supplied to each unit of the head-mounted display device 100 via the power supply unit 137. That is, the first battery 131 is a power source for the head-mounted display device 100.

The second power supply unit 311 includes FET_T03 and FET_T04, and a charging unit 312 that switches on / off of the FET_T03 and FET_T04.
The FET_T03 and the FET_T04 are composed of FETs similarly to the FET_T01 and T02. The FET_T04 is provided between the second battery 132 and the node N21 of the power supply line L2, and connects the second battery 132 to the power supply line L2. The FET_T03 is provided between the DC connector 139 and the node N21 of the power supply line L2, and connects the DC connector 139 and the second battery 132.
The charging unit 312 turns on / off each of the FET_T03 and the FET_T04 in accordance with a control signal input from the CPU 331.

  When the FET_T03 is turned on, the DC connector 139 is connected to the DC / DC converter 321. When an AC adapter (not shown) is connected to the DC connector 139, power can be supplied from the AC adapter to the DC connector 139. In addition, since power can be supplied from the AC adapter to the second battery 132, when the FET_T04 is turned on in this state, the second battery 132 can be charged.

  A switching unit 303 is provided between the second battery 132 and the node N21 on the power supply line L2. Similarly to the switching unit 303, the switching unit 313 can be configured by an ORing controller, and functions as a switch that is turned on / off in accordance with the potential difference between the node N21 and the node N26 on the second battery 132 side. Specifically, it is turned on when the potential of the node N21 is lower than the potential of the node N26, and connects the second battery 132 to the power supply line L2.

  When the CPU 331 controls the charging unit 312 to turn off FET_T03 and turn on FET_T04, the switching unit 303 is turned on when the remaining amount of power of the second battery 132 is sufficient. Then, the second battery 132 is connected to the power supply line L <b> 2, and a direct current is input from the second battery 132 to the DC / DC converter 321. As a result, the power supplied from the second battery 132 is supplied to each unit of the head-mounted display device 100 via the power supply unit 137. That is, the second battery 132 is a power source for the head-mounted display device 100.

The thermistors T11 and T12 are provided in the package of the first battery 131. The thermistor T11 is connected to the charging unit 302, and the charging unit 302 can monitor the temperature of the first battery 131. The thermistor T12 is connected to the PMIC 332, and the PMIC 332 can monitor the temperature of the first battery 131.
The thermistors T21 and T22 are provided in the package of the second battery 132. The thermistor T <b> 21 is connected to the charging unit 312, and the charging unit 312 can monitor the temperature of the second battery 132. The thermistor T22 is connected to the PMIC 332, and the PMIC 332 can monitor the temperature of the second battery 132.

The first power supply unit 301 includes an LED_D11 that emits green light and an LED_D12 that emits red light. LED_D11 and LED_D12 are turned on under the control of the CPU 331, respectively. Under the control of the control unit 140, the CPU 331 turns on, turns off, and blinks the LED_D11 and the LED_D12 according to the state of the remaining amount of the first battery 131.
The second power supply unit 311 includes an LED_D21 that emits green light and an LED_D22 that emits red light. LED_D21 and LED_D22 are turned on under the control of the CPU 331, respectively. Under the control of the control unit 140, the CPU 331 turns on, turns off, and blinks each of the LED_D21 and LED_D22 according to the remaining amount of the second battery 132.

A resistor R1 is connected between the first battery 131 and the FET_T02. Nodes N13 and N14 at both ends of the resistor R1 are connected to the current detection unit 322, respectively. The current detection unit 322 detects the current that is input to and output from the first battery 131 based on the potential difference between the nodes N13 and N14.
A resistor R2 is connected between the second battery 132 and the FET_T04. Nodes N23 and N24 at both ends of the resistor R2 are connected to the current detector 322, respectively. The current detection unit 322 detects a current input to and output from the second battery 132 based on the potential difference between the nodes N23 and N24.
Further, a resistor R3 is connected between the output terminal 321B of the DC / DC converter 321 and the power supply unit 137, and a current detector 322 is connected to nodes N3 and N4 at both ends of the resistor R3. The current detection unit 322 detects the current output from the DC / DC converter 321 based on the potential difference between the nodes N3 and N4.
The current detection result by the current detection unit 322 is output to the PMIC 332 and used for the control of the CPU 331.

  The PMIC 332 is connected to a node N12 at the end of the resistor R1, a node N22 at the end of the resistor R2, and a node N5 at the end of the resistor R3. The PMIC 332 detects the output voltage of the first battery 131 at the node N12, detects the output voltage of the second battery 132 at the node N22, and detects the output voltage of the DC / DC converter 321 at the node N5.

  In this configuration, in the first power supply unit 301 and the charging unit 302, the resistance values of the resistors R1 and R2 may be equal, and the voltage drops of the FET_T02 and FET_T04 may be equal.

  In the power supply unit 300, the CPU 331 controls the charging units 302 and 312 so that the first battery 131 and the second battery 132 can be individually connected to the DC / DC converter 321 to supply power. When both the first battery 131 and the second battery 132 are connected to the DC / DC converter 321, electric power is supplied from the side of the first battery 131 and the second battery 132 that has a large remaining amount.

  That is, in a state where FET_T02 and FET_T04 are on, both the first battery 131 and the second battery 132 are connected to the input terminal 321A of the DC / DC converter 321 through the power supply lines L1 and L2. The potentials of the power supply line L1 and the power supply line L2 are equal, and this potential is determined by the voltage on the higher output voltage side of the first battery 131 and the second battery 132.

  When there is a difference between the remaining amounts of the first battery 131 and the second battery 132, the output voltages of the first battery 131 and the second battery 132 are also different. When the first battery 131 has a larger remaining amount than the second battery 132, the switching unit 313 is turned off because the potential of the node N26 is lower than the potential of the power supply line L2. For this reason, electric power is supplied from the first battery 131 to the DC / DC converter 321. Similarly, when the remaining amount of the second battery 132 is larger than that of the first battery 131, the first battery 131 is disconnected from the power supply line L1 by turning off the switching unit 303, and the second battery 132 is powered. Supply.

  As described above, the power supply unit 300 can supply power from both the first battery 131 and the second battery 132, and can supply power unless the remaining amount of the two batteries 131 and 132 is zero. is there. Further, the control unit 140 connected to the power supply unit 300 can individually acquire the remaining amount of the first battery 131 and the remaining amount of the second battery 132 from the CPU 331. Further, if necessary, control regarding the temperature of the main board of the control device 10, the temperature of the first battery 131, and the temperature of the second battery 132 can be performed.

  Further, the control unit 140 operates the charging units 302 and 312 under the control of the CPU 331 to charge the first battery 131 and the second battery 132 in a state where the AC adapter is connected to the DC connector 139. Can be made.

  FIG. 5 shows a configuration example of the control device 10 and is an external view of the control device main body 101. FIG. 5 particularly shows the accommodation state of the first battery 131 and the second battery 132 in the control device main body 101. FIG. 5A shows a state where the battery cover 102 is attached, and FIG. 5B shows a state where the battery cover 102 is removed.

  The control device main body 101 is a substantially box-shaped case that accommodates each part of the control device 10. On the surface of the control device main body 101, as shown in FIG. 1, a determination key 11, a lighting unit 12, a display switching key 13, a track pad 14, a luminance switching key 15, a direction key 16, a menu key 17, and a power switch 18 is arranged. 5A and 5B show the back side of the control device main body 101. FIG.

The back surface of the control device main body 101 is covered with a battery cover 102. The battery cover 102 corresponds to the lid 123 described above. When the battery cover 102 is removed, as shown in FIG. 5A, the battery housing portion 104 is opened, and access to the first battery 131 and the second battery 132 becomes possible.
As shown in FIGS. 5A and 5B, the first battery 131 and the second battery 132 are housed side by side in the battery housing portion 104. The first battery 131 is locked by the DC connector 139, and the second battery 132 is locked by the locking portion 106. The first battery 131 and the second battery 132 can be taken out from the battery housing portion 104 by an operation such as pushing the locking portions 105 and 106, respectively.

  In addition, an LED display unit 136 is disposed in the vicinity of the locking unit 105. The LED display unit 136 includes the LED_D11 and LED_D12 of the power supply unit 300 (FIG. 4), and transmits light emitted from the LED_D11 and LED_D12. An LED display unit 138 is disposed in the vicinity of the locking unit 106. The LED display unit 138 incorporates the LED_D21 and LED_D22 of the power supply unit 300, and transmits light emitted from the LED_D21 and LED_D22.

  As described above, the LED_D11 and the LED_D12 are turned on and blinked under the control of the CPU 331. LED_D21 and LED_D22 are lit and blinked under the control of the CPU 331. The LED display units 136 and 138 function as a display unit that provides guidance to the user when the first battery 131 and the second battery 132 are replaced, for example.

  Returning to FIG. 1, the control unit 140 includes a CPU, a ROM, a RAM (not shown), and the like as hardware. The control unit 140 reads out and executes a computer program stored in the storage unit 120, thereby operating the operating system (OS) 150, the image processing unit 160, the display control unit 170, the power saving control unit 180, and the sound processing unit 190. Function as.

The head-mounted display device 100 includes a normal operation mode and a battery replacement mode as operation modes. The operation mode of the head-mounted display device 100 is switched by the power saving control unit 180.
The normal operation mode is an operation mode in which power is supplied to each functional block of the head-mounted display device 100. The power of the first battery 131 is at least supplied to the control unit 140, the communication unit 117, and the image display unit 20. This is supplied to the right display drive unit 22 and the left display drive unit 24. In the normal operation mode, power can be supplied to all the functional blocks of the head-mounted display device 100 shown in FIG. However, it is not required that all functional blocks can be energized simultaneously.
For example, when the remaining capacity of the first battery 131 becomes equal to or less than a specified value, or when a lid 123 of the battery housing unit 122 described later is opened, the control unit 140 operates the head-mounted display device 100. The mode is changed from the normal operation mode to the battery replacement mode.

In the normal operation mode, the first battery 131 supplies power to each part of the head-mounted display device 100, and in the battery replacement mode, the second battery 132 supplies power to each part of the head-mounted display device 100. To do. In the battery replacement mode, the power supply destination of the second battery 132 may be limited by the control of the control unit 140, and the power consumption of the head-mounted display device 100 may be lower than that in the normal operation mode. . That is, power may be supplied to limited blocks such as the control unit 140, the communication unit 117, the right display drive unit 22 and the left display drive unit 24 of the image display unit 20 under the control of the control unit 140. .
For example, when the remaining capacity of the first battery 131 becomes equal to or less than a specified value, or when a lid 123 of the battery housing unit 122 described later is opened, the control unit 140 operates the head-mounted display device 100. The mode is changed from the normal operation mode to the battery replacement mode.
Further, when shifting from the normal operation mode to the battery replacement mode, the system information may be stored in the storage unit 120 under the control of the control unit 140. This system information is, for example, data for returning the head-mounted display device 100 to the normal operation mode before the transition to the battery replacement mode, and data relating to the operation of the control unit of the control unit 140. is there. The system information may include, for example, data related to the operation of the head-mounted display device 100 such as the display position and display size of the image displayed on the image display unit 20.

The image processing unit 160 acquires an image signal included in the content. The image processing unit 160 separates synchronization signals such as the vertical synchronization signal VSync and the horizontal synchronization signal HSync from the acquired image signal. Further, the image processing unit 160 generates a clock signal PCLK using a PLL (Phase Locked Loop) circuit or the like (not shown) according to the period of the separated vertical synchronization signal VSync and horizontal synchronization signal HSync. The image processing unit 160 converts the analog image signal from which the synchronization signal is separated into a digital image signal using an A / D conversion circuit or the like (not shown). The image processing unit 160 stores the converted digital image signal in the DRAM in the storage unit 120 frame by frame as image data (Data in the figure) of the target image. This image data is, for example, RGB data.
Note that the image processing unit 160 may perform image processing such as resolution conversion processing, various tone correction processing such as adjustment of luminance and saturation, and keystone correction processing on the image data as necessary. Good.

Further, when an instruction to convert the frame rate of the image signal is input from the power saving control unit 180, the image processing unit 160 performs a conversion process of converting the frame rate of the image signal.
When an instruction to convert the frame rate is input, the image processing unit 160 receives the image signal, the vertical synchronization signal (VSync), and the horizontal so that the frame rate of the image signal is lower than the frame rate in the normal operation mode. The synchronization signal (HSSync) is converted.
Note that the frame rate of the image signal converted by the image processing unit 160 may be a preset frame rate or may be changed according to an instruction from the power saving control unit 180. Good. For example, the power saving control unit 180 may instruct the image processing unit 160 of a frame rate corresponding to the remaining capacity of the second battery 132. Specifically, the frame rate of the conversion destination is preset in a plurality of stages, the remaining capacity of the second battery 132 is divided into a plurality of stages, and the frame rate is associated with the remaining capacity stage of the second battery 132. A configuration is mentioned. In this configuration, the power saving control unit 180 selects a frame rate corresponding to the capacity of the second battery 132 as a conversion destination frame rate.

  The image processing unit 160 transmits the generated clock signal PCLK, vertical synchronization signal VSync, horizontal synchronization signal HSync, and image data Data stored in the DRAM in the storage unit 120 via the transmission units 51 and 52, respectively. . The image data Data transmitted via the transmission unit 51 is also referred to as “right eye image data”, and the image data Data transmitted via the transmission unit 52 is also referred to as “left eye image data”. The transmission units 51 and 52 function as a transceiver for serial transmission between the control device 10 and the image display unit 20.

The display control unit 170 generates control signals for controlling the right display drive unit 22 and the left display drive unit 24. Specifically, the display control unit 170 individually controls driving ON / OFF of the right LCD 241 by the right LCD control unit 211 and driving ON / OFF of the right backlight 221 by the right backlight control unit 201 based on the control signal. . Further, the display control unit 170 individually controls ON / OFF driving of the left LCD 242 by the left LCD control unit 212 and ON / OFF driving of the left backlight 222 by the left backlight control unit 202. Thereby, the display control unit 170 controls the generation and emission of image light by the right display driving unit 22 and the left display driving unit 24, respectively. For example, the display control unit 170 controls the right display drive unit 22 and the left display drive unit 24 with a control signal, and causes both the right display drive unit 22 and the left display drive unit 24 to generate image light. Only the image light is generated. In addition, the display control unit 170 controls the right display drive unit 22 and the left display drive unit 24 according to the control signal so that both the right display drive unit 22 and the left display drive unit 24 do not generate image light. You can also.
Further, the display control unit 170 transmits control signals for the right LCD control unit 211 and the left LCD control unit 212 via the transmission units 51 and 52, respectively. Further, the display control unit 170 transmits the control signal for the right backlight control unit 201 to the right backlight control unit 201, and the display control unit 170 transmits the control signal for the left backlight control unit 202 to the left backlight. Transmitted by the control unit 202.

  Further, the display control unit 170 reduces the luminance of the right backlight 221 and the left backlight 222 when the operation mode is switched to the battery replacement mode by the power saving control unit 180. The display control unit 170 controls the right backlight control unit 201 and the left backlight control unit 202 according to the control signal, and lowers the luminance of the right backlight 221 and the left backlight 222 than in the normal operation mode. In addition, the display control unit 170 may reduce the luminance of either the right backlight 221 or the left backlight 222 as compared with that in the normal operation mode. Since the luminance of at least one of the right backlight 221 and the left backlight 222 is lower than that in the normal operation mode, the power consumption of the head-mounted display device 100 is reduced.

  The display control unit 170 may reduce the display area of the right LCD 241 and the left LCD 242 when the power saving control unit 180 switches the operation mode from the normal operation mode to the battery replacement mode. The display control unit 170 controls the right LCD control unit 211 and the left LCD control unit 212 according to the control signal, and reduces the display area of the right LCD 241 and the left LCD 242 from the display area in the normal operation mode. By reducing the areas of the right LCD 241 and the left LCD 242 where images are displayed, the power consumption of the head-mounted display device 100 is reduced. Further, the display control unit 170 may reduce the display area of at least one of the right LCD 241 and the left LCD 242 more than the display area in the normal operation mode.

  The display control unit 170 may stop the display of the right display driving unit 22 or the left display driving unit 24 when the operation mode is changed to the battery replacement mode. That is, the display control unit 170 stops the generation of the image light of the right display drive unit 22 or the left display drive unit 24 by turning off the output of the control signal to the right display drive unit 22 or the left display drive unit 24. . Further, the display control unit 170 may control the right display driving unit 22 or the left display driving unit 24 according to the control signal to stop the generation of image light of the right display driving unit 22 or the left display driving unit 24. Further, the right display driving unit 22 or the left display driving unit 24 is stopped by stopping the transmission of the clock signal PCLK, the vertical synchronizing signal VSync, the horizontal synchronizing signal HSync, and the image data Data from the image processing unit 160 to the transmitting unit 51 or 52. The generation of the image light may be stopped.

In addition, the display control unit 170 combines the brightness of the backlights 221 and 222, the reduction of the display area of the LCDs 241 and 242 and the stop of the display of the display driving unit 22 or 24 to reduce the power consumption of the image display unit 20. It may be reduced.
The power saving control unit 180 selects a mode number for designating the display mode of the image display unit 20 according to the remaining capacity of the second battery 132 and notifies the display control unit 170 of the selected mode number.
For example, when the remaining capacity of the second battery 132 becomes 80% or less, for example, the power saving control unit 180 notifies the display control unit 170 of the mode number “1”. The display control unit 170 notified of the mode number “1” controls the right backlight control unit 201 and the left backlight control unit 202 in accordance with the control signal, and the brightness of the right backlight 221 and the left backlight 222 is normally set. Lower than in the operation mode.
Further, when the remaining capacity of the second battery 132 becomes 60% or less, the power saving control unit 180 notifies the display control unit 170 of the mode number “2”. The display control unit 170 notified of the mode number “2” controls the right LCD control unit 211 and the left LCD control unit 212 in accordance with the control signal, so that the display areas of the right LCD 241 and the left LCD 242 are displayed in the normal operation mode. Reduce more than.
Further, when the remaining capacity of the second battery 132 becomes 40% or less, the power saving control unit 180 notifies the display control unit 170 of the mode number “3”. The display control unit 170 notified of the mode number “3” turns off the output of the control signal to the right display drive unit 22 or the left display drive unit 24, and displays the display of the right display drive unit 22 or the left display drive unit 24. Stop.
As a result, display of the display image is stopped in either the right display drive unit 22 or the left display drive unit 24. The other of the right display drive unit 22 and the left display drive unit 24 is in a state where the luminance of the backlight 221 (222) is suppressed and the display area of the LCD 241 (242) is reduced.

  The power saving control unit 180 has a function of detecting the remaining amounts of the first battery 131 and the second battery 132 by the function of the battery control unit 135.

The power saving control unit 180 changes the operation mode of the head-mounted display device 100.
The power saving control unit 180 shifts the operation mode of the head-mounted display device 100 from the normal operation mode to the battery replacement mode when a detection signal indicating that the lid 123 is opened by the open / close detection unit 124 is input. Let Further, the power saving control unit 180 normally sets the operation mode of the head-mounted display device 100 when the remaining capacity of the first battery 131 detected by the first battery monitoring IC 133 falls below a threshold value. Transition from the operation mode to the battery replacement mode.

The power saving control unit 180 notifies the display control unit 170 that the lid 123 has been opened when the detection signal indicating that the lid 123 has been opened is input by the open / close detection unit 124 and shifts to the battery replacement mode. To do. The display control unit 170 displays a predetermined message on the image display unit 20. This message is a message notifying the opening of the lid 123 and a message requesting to wait for the removal of the first battery 131 until the preparation is completed.
In addition, when the power saving control unit 180 detects that the remaining capacity of the first battery 131 has dropped below the threshold and shifts to the battery replacement mode, the power saving control unit 180 causes the display control unit 170 to display the first battery 131 of the first battery 131. Notify that the remaining capacity has dropped below the threshold. The display control unit 170 displays a predetermined message on the image display unit 20. This message is a message notifying that the remaining capacity of the first battery 131 has dropped below the threshold value, and a message requesting to wait for the removal of the first battery 131 until preparation is completed.

Further, when the power saving control unit 180 shifts to the battery replacement mode, the power saving control unit 180 stores the system information in the storage unit 120. As described above, the system information is data for returning the head-mounted display device 100 to the normal operation mode before shifting to the battery replacement mode.
Further, when the system information is stored in the storage unit 120, the power saving control unit 180 outputs an instruction to switch the power source from the first battery 131 to the second battery 132 to the battery control unit 135. The battery control unit 135 changes the battery that supplies power from the first battery 131 to the second battery 132 in accordance with an instruction from the power saving control unit 180. Further, when the battery is changed to the second battery 132, the power saving control unit 180 changes the power supply destination to the control unit 140, the communication unit 117, the right display driving unit 22 and the left display of the image display unit 20. An instruction to limit to the drive unit 24 is notified to the battery control unit 135. The battery control unit 135 controls the power supply unit 137 in accordance with an instruction from the power saving control unit 180, and the control unit 140, the communication unit 117, and the image display unit 20 supply destinations to which the power supply unit 137 supplies power. The right display driving unit 22 and the left display driving unit 24 are changed.
Since power is supplied to the communication unit 117 even after the transition to the battery replacement mode, the communication unit 117 maintains the connection with the connected network even after the transition to the battery replacement mode. The communication unit 117 maintains a connection with the network in the battery replacement mode so that communication can be started without performing user authentication when the battery replacement mode is shifted to the normal operation mode. For this reason, after returning from the battery replacement mode to the normal operation mode, it is not necessary to perform an operation such as re-entering authentication information such as a password in order to reconnect to the network. Accordingly, it is possible to reduce the labor of the user due to battery replacement.
Further, when the communication unit 117 is connected to the network by, for example, a wireless LAN, the power saving control unit 180 changes the communication mode of the communication unit 117 to the power save mode when the battery replacement mode is entered. The power consumption of the communication unit 117 is reduced.
Furthermore, when the communication unit 117 performs communication by Bluetooth in the normal operation mode, the power saving control unit 180 may switch the communication unit 117 to communication by Bluetooth Low Energy when the battery replacement mode is entered. Good.
In addition, when the short-range wireless communication conforming to the standards such as RFID and Felica is possible, the power saving control unit 180 changes the communication unit 117 from the communication by the wireless LAN when shifting to the battery replacement mode. You may switch to near field communication.

The power saving control unit 180 detects replacement of the first battery 131 when the power source is switched from the first battery 131 to the second battery 132. That is, the power saving control unit 180 detects that the first battery 131 is removed, and detects that the first battery 131 is attached again.
The power saving control unit 180 determines whether or not the first battery 131 has been replaced based on the terminal voltage of the first battery 131 measured by the first battery monitoring IC 133. When the connection between the first battery 131 and the battery control unit 135 is released, the terminal voltage of the first battery 131 measured by the first battery monitoring IC 133 becomes low level or high impedance. The power saving control unit 180 determines that the first battery 131 is removed from the battery housing unit 122 when the measured terminal voltage of the first battery 131 becomes low level or high impedance. This determination is performed by the power saving control unit 180 comparing the voltage value detected by the battery monitoring IC 133 with a preset reference value of the voltage and determining the magnitude thereof.
Further, when a new first battery 131 is accommodated in the battery accommodating portion 122 and the first battery 131 and the battery control portion 135 are connected, the first battery 131 measured by the first battery monitoring IC 133 is measured. The terminal voltage becomes a voltage within a predetermined range. The power saving control unit 180 determines that the first battery 131 has been replaced when the terminal voltage of the first battery 131 measured by the first battery monitoring IC 133 falls within a predetermined range. Here, the power saving control unit 180 compares the voltage value detected by the battery monitoring IC 133 with a reference value of a preset voltage, and determines its magnitude.

When the power saving control unit 180 detects the replacement of the first battery 131, the capacity of the replaced first battery 131 is determined based on the remaining capacity of the first battery 131 calculated by the first battery monitoring IC 133. It is determined whether or not there is a shortage. If the battery with insufficient capacity is not replaced and connected to the battery control unit 135 again, the head-mounted display device 100 cannot be returned to the normal operation mode. Therefore, the power saving control unit 180 determines whether or not the replaced first battery 131 is in a state of insufficient capacity.
The power saving control unit 180 compares the remaining capacity of the first battery 131 with a threshold value, and determines whether or not the first battery 131 is in a state of insufficient capacity. When it is determined that the first battery 131 is in a state of insufficient capacity, the power saving control unit 180 notifies the display control unit 170 to that effect. The display control unit 170 causes the image display unit 20 to display a display that prompts replacement of the first battery 131. In addition, a display based on the remaining capacity of the first battery 131 after replacement may be displayed on the image display unit 20. The power saving control unit 180 calculates a time during which the head-mounted display device 100 can be driven based on the remaining capacity of the first battery 131 after replacement. The power saving control unit 180 notifies the display control unit 170 of the calculated drivable time and causes the image display unit 20 to display it.

Further, when the power saving control unit 180 determines that the first battery 131 is not in a state of insufficient capacity, the battery that supplies power is changed from the second battery 132 to the first battery 131. The controller 135 is instructed. The battery control unit 135 changes the battery from the second battery 132 to the first battery 131 in accordance with an instruction from the power saving control unit 180. In addition, the power saving control unit 180 instructs the battery control unit 135 to supply power to each unit of the head-mounted display device 100. The battery control unit 135 controls the power supply unit 137 to supply the power of the first battery 131 to each unit of the head-mounted display device 100 in accordance with an instruction from the power saving control unit 180. Thereby, the operation mode of the head-mounted display device 100 is changed from the battery exchange mode to the normal operation mode.
Further, the power saving control unit 180 restores the system information stored in the storage unit 120 by expanding it in a work memory such as a RAM. Thereafter, the control unit 140 executes processing based on the data expanded in the RAM. Thereby, the head-mounted display device 100 is returned to the state before the transition to the battery replacement mode.

  When the power saving control unit 180 determines that the first battery 131 is not in a capacity shortage state, the power saving control unit 180 instructs the battery control unit 135 to calculate the remaining capacity of the second battery 132. The battery control unit 135 causes the second battery monitoring IC 134 to calculate the remaining capacity of the second battery 132, and outputs the calculated remaining capacity information of the second battery 132 to the power saving control unit 180. The power saving control unit 180 determines whether or not the second battery 132 is fully charged based on the input remaining capacity of the second battery 132. When it is determined that the capacity of the second battery 132 is not fully charged but is in a chargeable state, the power saving control unit 180 controls the battery so that the first battery 131 charges the second battery 132. The unit 135 is instructed.

  The audio processing unit 190 acquires an audio signal included in the content, amplifies the acquired audio signal, and a speaker (not shown) in the right earphone 32 and a speaker in the left earphone 34 (not shown) connected to the connecting member 46. (Not shown). For example, when the Dolby (registered trademark) system is adopted, processing on the audio signal is performed, and different sounds with different frequencies or the like are output from the right earphone 32 and the left earphone 34, respectively.

  The image display unit 20 includes an interface 25, a right display drive unit 22, a left display drive unit 24, a right light guide plate 261 as a right optical image display unit 26, and a left light guide plate 262 as a left optical image display unit 28. A camera 61, a vibration sensor 65, and a nine-axis sensor 66.

  The vibration sensor 65 is configured using an acceleration sensor, and is arranged inside the image display unit 20 as shown in FIG. In the example of FIG. 1, the right holding unit 21 is built in the vicinity of the end ER of the right optical image display unit 26. When the user performs an operation of hitting the end ER (knock operation), the vibration sensor 65 detects vibration caused by this operation and outputs the detection result to the control unit 140. Based on the detection result of the vibration sensor 65, the control unit 140 detects a knocking operation by the user.

  The 9-axis sensor 66 is a motion sensor that detects acceleration (3 axes), angular velocity (3 axes), and geomagnetism (3 axes). Since the 9-axis sensor 66 is provided in the image display unit 20, the control unit 140 is used based on the detection value of the 9-axis sensor 66 when the image display unit 20 is worn on the user's head. The movement of the person's head can be detected. Since the orientation of the image display unit 20 is known from the detected movement of the user's head, the control unit 140 can estimate the user's line-of-sight direction.

The interface 25 includes a connector to which the right cord 42 and the left cord 44 are connected. The interface 25 outputs the clock signal PCLK, the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the image data Data transmitted from the transmission unit 51 to the corresponding reception units (Rx) 53 and 54. Further, the interface 25 outputs a control signal transmitted from the display control unit 170 to the corresponding reception units 53 and 54, the right backlight control unit 201, or the left backlight control unit 202.
The interface 25 is an interface of the camera 61, the vibration sensor 65, and the 9-axis sensor 66. The detection result of vibration by the vibration sensor 65 and the detection result of acceleration (three axes), angular velocity (three axes), and geomagnetism (three axes) by the nine-axis sensor 66 are sent to the control unit 140 of the control device 10 via the interface 25. Sent.

  The right display driving unit 22 includes a receiving unit 53, a right backlight (BL) control unit 201 and a right backlight (BL) 221 that function as light sources, a right LCD control unit 211 and a right LCD 241 that function as display elements, A right projection optical system 251. The right backlight control unit 201 and the right backlight 221 function as a light source. The right LCD control unit 211 and the right LCD 241 function as display elements. The right backlight control unit 201, the right LCD control unit 211, the right backlight 221 and the right LCD 241 are also collectively referred to as “image light generation unit”.

  The receiving unit 53 functions as a receiver for serial transmission between the control device 10 and the image display unit 20. The right backlight control unit 201 drives the right backlight 221 based on the input control signal. The right backlight 221 is a light emitter such as an LED or electroluminescence (EL). The right LCD control unit 211 drives the right LCD 241 based on the clock signal PCLK, the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the right eye image data Data input via the reception unit 53. The right LCD 241 is a transmissive liquid crystal panel in which a plurality of pixels are arranged in a matrix.

  The right projection optical system 251 is configured by a collimator lens that converts the image light emitted from the right LCD 241 to light beams in a parallel state. The right light guide plate 261 as the right optical image display unit 26 guides the image light output from the right projection optical system 251 to the right eye RE of the user while reflecting the image light along a predetermined optical path.

  The left display drive unit 24 has the same configuration as the right display drive unit 22. The left display driving unit 24 includes a receiving unit 54, a left backlight (BL) control unit 202 and a left backlight (BL) 222 that function as light sources, a left LCD control unit 212 and a left LCD 242 that function as display elements, A left projection optical system 252. The left backlight control unit 202 and the left backlight 222 function as a light source. The left LCD control unit 212 and the left LCD 242 function as display elements. The left projection optical system 252 is configured by a collimating lens that converts the image light emitted from the left LCD 242 into a light beam in a parallel state. The left light guide plate 262 as the left optical image display unit 28 guides the image light output from the left projection optical system 252 to the left eye LE of the user while reflecting the image light along a predetermined optical path.

FIG. 6 is a flowchart showing a processing procedure of the control unit 140.
The power saving control unit 180 determines whether or not the remaining capacity of the first battery 131 input from the battery control unit 135 is equal to or less than a specified value (reference value) (step S1).
This reference value (specified value) is, for example, the remaining capacity of the first battery 131 obtained by adding a predetermined margin to the remaining capacity of the first battery 131 that can supply the lowest operating voltage of the head-mounted display device 100. You may set to the value equivalent to. The reference value is a value stored in advance in the storage unit 120 of the control unit 140. For example, the reference value may be read from the storage unit 120 by the CPU when the power is turned on and stored in the RAM. In this case, the power saving control unit 180 can determine whether or not to switch the operation mode from the normal operation mode to the battery replacement mode by comparing the remaining capacity of the first battery 131 with the reference value stored in the RAM. . The remaining capacity of the first battery 131 is calculated by the first battery monitoring IC 133 and input to the power saving control unit 180 via the battery control unit 135. When the determination in step S1 is affirmative (step S1 / YES), the power saving control unit 180 executes the battery replacement mode (step S3).

When the determination in step S1 is negative (step S1 / NO), the power saving control unit 180 determines whether or not the lid 123 of the battery housing unit 122 is opened based on a signal output from the open / close detection unit 124. Is determined (step S2). When the opening / closing detection unit 124 detects the opening of the lid 123, the opening / closing detection unit 124 outputs a signal indicating that the lid 123 has been opened to the control unit 140. When the power saving control unit 180 receives a signal from the open / close detection unit 124 and determines that the lid 123 is opened (step S2 / YES), the power saving control unit 180 executes the battery replacement mode (step S3).
If the power saving control unit 180 determines that the signal from the opening / closing detection unit 124 is not input and the lid 123 is closed (step S2 / NO), the process returns to the determination of step S1. The power saving control unit 180 stands by until the measurement result of the remaining capacity of the first battery 131 is input from the battery control unit 135.
In the present embodiment, as shown in step S2 of FIG. 6, the operation of the power saving control unit 180 detecting the signal of the open / close detection unit 124 by flow control will be described, but this is a convenient description. The present invention is not limited to flow control. For example, a signal (voltage value) output when the open / close detection unit 124 detects the opening of the lid 123 may be input to the control unit 140 as an interrupt signal. In this case, the control unit 140 (power saving control unit 180) executes interrupt control for the input of the open / close detection unit 124, and may make an affirmative determination in step S2 even if other processing is being performed.

7 and 8 are flowcharts showing the detailed procedure of the battery replacement mode.
When the power saving control unit 180 shifts to the battery replacement mode (step S11), the power saving control unit 180 notifies the display control unit 170 to that effect. Receiving the notification, the display control unit 170 displays a predetermined message on the image display unit 20 (step S12). This message is a message notifying that the cover 123 of the battery housing part 122 is in an open state. Further, the display control unit 170 may display not only the above message but also other messages. For example, a message instructing to wait for the replacement of the first battery 131 until the battery can be replaced may be displayed on the image display unit 20.

  Next, the power saving control unit 180 stores the system information in the storage unit 120 (step S13). The system information includes, for example, data indicating the processing status of the display image data acquired from the external device OA and displayed on the image display unit 20 or when the display of the display image data on the image display unit 20 is resumed. Contains the necessary data.

  Next, the power saving control unit 180 outputs to the battery control unit 135 an instruction to change the power supply battery, that is, the power source from the first battery 131 to the second battery 132. The battery control unit 135 switches the battery that supplies power from the first battery 131 to the second battery 132 in accordance with an instruction from the power saving control unit 180 (step S14).

  Further, the power saving control unit 180 limits the supply destination of power to the control unit 140, the communication unit 117, and the right display driving unit 22 and the left display driving unit 24 of the image display unit 20. 135 is instructed. The battery control unit 135 controls the power supply unit 137 to supply power to the control device 10. The control unit 140, the communication unit 117, the right display drive unit 22 and the left display drive unit 24 of the image display unit 20. (Step S15). Since power is supplied to the communication unit 117 even after the transition to the battery replacement mode, for example, when the communication unit 117 is connected to the network, the connection with the network can be maintained.

  Next, the power saving control unit 180 instructs the display control unit 170 to change the display mode of the image display unit 20 to a mode for reducing power consumption, and the display control unit 170 controls the display of the image display unit 20. The display mode is changed (step S16). For example, the display control unit 170 stops the display of the right display drive unit 22 or the left display drive unit 24 according to the control signal. Further, the power saving control unit 180 may stop the display by causing the battery control unit 135 to stop power supply to either the right display driving unit 22 or the left display driving unit 24. Thereby, only the right display drive part 22 and the left display drive part 24 will be in the state which displays, The power consumption amount is reduced compared with the case where it displays by both. Further, the display control unit 170 may set the luminance of the right backlight 221 and the left backlight 222 to a lower luminance than that in the normal operation mode by the control signal. Further, when the operation mode is changed to the battery replacement mode, the display control unit 170 may reduce the display area of the right LCD 241 and the left LCD 242 with the control signal as compared with the display area in the normal operation mode.

  Further, the power saving control unit 180 may instruct the image processing unit 160 to lower the frame rate of the image signal than in the normal operation mode when the battery switching mode is entered. Upon receiving an instruction from the power saving control unit 180, the image processing unit 160 receives the image signal, the vertical synchronization signal (VSync), and the horizontal synchronization signal so that the frame rate of the image signal is lower than the frame rate in the normal operation mode. (HSync) conversion is performed. The image signal whose frame rate has been converted by the image processing unit 160 is stored in the DRAM in the storage unit 120 for each frame. The image processing unit 160 transmits the generated clock signal PCLK, vertical synchronization signal VSync, horizontal synchronization signal HSync, and image data Data stored in the DRAM in the storage unit 120 via the transmission units 51 and 52, respectively. . As a result, an image having a lower frame rate than that in the normal operation mode is displayed on the image display unit 20.

  Furthermore, the power saving control unit 180 may instruct the resolution of the image signal to be lower than that in the normal operation mode when the battery replacement mode is entered. Upon receiving an instruction from the power saving control unit 180, the image processing unit 160 receives the image signal, the vertical synchronization signal (VSync), and the horizontal synchronization signal (in order that the resolution of the image signal is lower than the frame rate in the normal operation mode. HSync) conversion. In this case, an image signal having a resolution lower than that in the normal operation mode is input to the right display drive unit 22 and the left display drive unit 24. The right display drive unit 22 and the left display drive unit 24 perform drawing only in a part of the regions that can be drawn on the right LCD 241 and the left LCD 242 and that match the input resolution. In this case, the number of pixels drawn by the right display driving unit 22 and the left display driving unit 24 is smaller than that in the normal operation mode. Furthermore, pixels that are not drawn on the right LCD 241 and the left LCD 242 can be fixed, for example, in black display. For this reason, power saving can be achieved. In this case, the right backlight control unit 201 and the left backlight control unit 202 emit light from the right backlight 221 and the left backlight 222 in accordance with the regions drawn by the right display drive unit 22 and the left display drive unit 24. May be reduced.

  In addition, the power saving control unit 180 controls the image processing unit 160 to perform a process of adjusting the gradation value for the image data of the image to be displayed, and the right display driving unit 22 and the left display driving unit 24. For example, the brightness of the image displayed by the image display unit 20 may be lower than that in the normal operation mode. In this case, for example, even if the luminance is adjusted within a range in which the visibility of the image displayed by the image display unit 20 can be ensured according to the intensity or amount of external light detected by the camera 61 provided in the image display unit 20. Good. In this case, an illuminance sensor (not shown) may be provided in the image display unit 20 and a detection value of the illuminance sensor may be used. Moreover, you may adjust to the preset brightness | luminance. Furthermore, when the luminance of the image display unit 20 is decreased, the color tone of the displayed image may be changed so that the visibility is improved even at low luminance. For example, there are processes such as increasing the contrast of an image to be displayed when the intensity (light quantity) of external light is large, applying sharpness processing and edge processing, and shifting the frequency spectrum of the image to the long wavelength side.

  Thus, even when both the right display drive unit 22 and the left display drive unit 24 are operated by setting the frame rate, display brightness, resolution, color tone, and the like to a state different from the normal operation mode, There is an effect that power consumption can be suppressed.

In addition, the display control unit 170 may change the display mode of the image display unit 20 according to the mode number notified from the power saving control unit 180. The power saving control unit 180 selects a mode number for designating the display mode of the image display unit 20 according to the remaining capacity of the second battery 132 and notifies the display control unit 170 of the selected mode number.
When the display control unit 170 is notified of the mode number “1” indicating that the remaining capacity of the second battery 132 has decreased to 80% or less from the power saving control unit 180, the display control unit 170 and the left backlight 221. The brightness with 222 is lowered as compared with the normal operation mode. Further, when the display control unit 170 is notified by the power saving control unit 180 of the mode number “2” indicating that the remaining capacity of the second battery 132 has decreased to 60% or less, The display area is reduced more than the display area in the normal operation mode. Further, when the display control unit 170 is notified of the mode number “3” indicating that the remaining capacity of the second battery 132 has decreased to 40% or less from the power saving control unit 180, the display control unit 170 or the right display driving unit 22 or The display of the left display drive unit 24 is stopped.

  In this way, the power saving control unit 180 reduces the power consumption of the power supply destinations other than the communication unit 117, for example, the right display driving unit 22 and the left display driving unit 24, thereby reducing the amount of head wearing. The power consumption of the type display device 100 is reduced. As a result, power supply to the communication unit 117 can be maintained in a state where the capacities of the first battery 131 and the second battery 132 are reduced, and a state in which communication by the communication unit 117 is possible can be maintained for a long time. . Accordingly, communication interruption, disconnection, and interruption due to the stop of the communication unit 117 can be avoided. When communication is interrupted, after the power supply capacity is restored by replacing the first battery 131 or the second battery 132, the communication unit 117 is activated and a sequence for establishing communication with the communication partner device is performed. Need to run. In this case, data transmission / reception for establishing communication according to a predetermined communication protocol, selection of a communication partner device, authentication by a user ID or a password, and the like are required with a communication partner device, which takes time. By eliminating the need to execute such a sequence, it is possible to reduce the downtime of the work using the head-mounted display device 100 and to improve the work efficiency.

Further, the power saving control unit 180 may perform control to reduce the power consumption of the communication unit 117 after shifting to the battery replacement mode.
That is, after shifting to the battery replacement mode, the control unit 140 may control the communication unit 117 to reduce the power consumption of the communication unit 117 while power is supplied to the communication unit 117. For example, the control unit 140 intermittently executes a polling operation between the connection destination device to which the communication unit 117 is connected and the communication unit 117 or a scan operation for searching for a device to which the communication unit 117 can be connected. May be. Moreover, the frequency of polling and scanning may be reduced as compared with the normal operation mode. Furthermore, the control unit 140 may notify the other devices that can communicate by transmitting data indicating that the battery replacement mode is being executed. For example, as will be described later, notification may be made to another head-mounted display device 100 or the server 5 (FIG. 13). In this case, the remaining amount of the battery in the head-mounted display device 100 and the shift to the battery replacement mode can be managed by another device.

Further, when the communication unit 117 is connected to a network by, for example, a wireless LAN, the power saving control unit 180 changes the communication mode of the communication unit 117 to the power save mode when the battery replacement mode is entered. Thus, the power consumption of the communication unit 117 may be reduced.
Further, when the communication unit 117 performs communication by Bluetooth in the normal operation mode, the power saving control unit 180 switches the communication unit 117 to communication by Bluetooth Low Energy or Bluetooth Smart when the mode is changed to the battery replacement mode. You may switch. Further, the communication output may be reduced without switching the communication method. For example, the class of the radio wave intensity may be changed during communication using Bluetooth.

  As another example of maintaining the communicable state of the communication unit 117, the power saving control unit 180 temporarily stops communication by the communication unit 117 when the first battery 131 or the second battery 132 is replaced. May be. In this case, when the operation of receiving content data from the external device OA is temporarily stopped, the power saving control unit 180 may temporarily stop display of content by the display control unit 170. At the time of this temporary stop, after exchanging the first battery 131 or the display switching key 13, the communication partner device (for example, the external device OA) It is preferable to maintain a minimum communication establishment. That is, it is preferable that the temporary stop is a state in which data communication such as content data is not executed, and control data or the like for maintaining the connection is intermittently transmitted and received. Further, when the communication is completely stopped, it is preferable that data when authentication or communication setting is performed in the communication before the stop is stored and the communication can be quickly reestablished based on the stored data.

  Next, the power saving control unit 180 instructs the display control unit 170 to display a message for prompting battery replacement on the image display unit 20. When the display of either one of the right display drive unit 22 and the left display drive unit 24 is stopped, the display control unit 170 replaces the battery with the display drive unit 22 (24) that has not stopped displaying images. A message for prompting is displayed (step S17).

  Next, the power saving control unit 180 determines whether or not the first battery 131 has been replaced (step S18). The power saving control unit 180 determines whether or not the first battery 131 has been replaced based on the terminal voltage of the first battery 131 measured by the first battery monitoring IC 133 and input from the battery control unit 135. (Step S18). When determining that the first battery 131 has not been replaced (step S18 / NO), the power saving control unit 180 determines whether or not the remaining capacity of the second battery 132 is equal to or less than a specified value (step S18). S19). The remaining capacity of the second battery 132 is calculated by the second battery monitoring IC 134 and input to the control unit 140 via the battery control unit 135. The power saving control unit 180 compares the remaining capacity of the second battery 132 input from the battery control unit 135 with a preset specified value, and the remaining capacity of the second battery 132 is less than the specified value. It is determined whether or not there is (step S19). When the remaining capacity of the second battery 132 is not less than the specified value (step S19 / NO), the power saving control unit 180 returns to the determination of step S17. When the remaining capacity of the second battery 132 is equal to or less than the specified value (step S19 / YES), the power saving control unit 180 executes an end sequence (step S20). When the end sequence is started, the power saving control unit 180 causes the storage unit 120 to store a log regarding the operation state of the control device 10 such as the remaining battery capacity and the date and time, and causes the OS 150 to shut down.

When determining that the first battery 131 has been replaced (step S18 / YES), the power saving control unit 180 inputs the remaining capacity of the replaced first battery 131 from the battery control unit 135. The remaining capacity of the first battery 131 is calculated by the first battery monitoring IC 133. The power saving control unit 180 compares the input remaining capacity of the first battery 131 with a preset specified value, and determines whether or not the remaining capacity of the first battery 131 is greater than or equal to the specified value. (Step S31 in FIG. 6). When the power saving control unit 180 determines that the remaining capacity of the first battery 131 is greater than or equal to the specified value (step S31 / YES), the battery that supplies power is switched from the second battery 132 to the first battery 131. The battery control unit 135 is instructed as follows. In response to an instruction from the power saving control unit 180, the battery control unit 135 changes the battery that supplies power, that is, the power source from the second battery 132 to the first battery 131 (step S36).
The power saving control unit 180 expands and restores the system information stored in the storage unit 120 in step S13 to a work memory such as a RAM (step S37). Thereafter, the control unit 140 executes processing based on the data expanded in the RAM. As a result, the head-mounted display device 100 returns to the state before the transition to the battery replacement mode.

  When the power saving control unit 180 determines that the remaining capacity of the first battery 131 is less than the specified value (step S31 / NO), the power saving control unit 180 controls the display control unit 170 to display a message on the image display unit 20. (Step S32). This message is a message indicating that the remaining battery capacity of the first battery 131 is insufficient. Here, when the display of either one of the right display drive unit 22 and the left display drive unit 24 is stopped, the display control unit 170 displays a message on the other.

  Next, the power saving control unit 180 determines whether or not the first battery 131 has been replaced (step S33). Here, the power saving control unit 180 determines whether or not the first battery 131 has been replaced based on the terminal voltage of the first battery 131 input from the battery control unit 135, as in step S18. . When it is determined that the first battery 131 has been replaced (step S33 / YES), the power saving control unit 180 returns to step S31 and determines whether or not the remaining capacity of the first battery 131 is greater than or equal to a specified value. (Step S31).

  When determining that the first battery 131 has not been replaced (step S33 / NO), the power saving control unit 180 determines whether or not the remaining capacity of the second battery 132 is equal to or less than a specified value. (Step S34). Here, the power saving control unit 180 compares the remaining capacity of the second battery 132 input from the battery control unit 135 with a predetermined value set in advance, and the remaining capacity of the second battery 132 is defined. It is determined whether or not it is less than or equal to the value. When the remaining capacity of the second battery 132 is not less than the specified value (step S34 / NO), the power saving control unit 180 returns to the determination of step S34. When the remaining capacity of the second battery 132 is equal to or less than the specified value (step S34 / YES), the power saving control unit 180 executes an end sequence (step S35). When the end sequence is started, the power saving control unit 180 causes the storage unit 120 to store a log regarding the operation state of the control device 10 such as the remaining battery capacity and the date and time, and causes the OS 150 to shut down.

  In step S1, when the remaining capacity of the first battery 131 is larger than the specified value and the lid 123 is accidentally opened, the process may proceed to step S31 when the lid 123 is closed. . In this case, the power saving control unit 180 may determine the remaining capacity of the first battery 131.

  Further, the power saving control unit 180 may determine the remaining capacity of the first battery 131 and the second battery 132 in a stepwise manner and determine the type of control to be executed in the battery replacement mode. For example, the normal operation mode is executed when the remaining battery level (details will be described later) is 100% or less and 15% or more, and when it is less than 15% and 5% or more, at least one of the frame rate, resolution, and display brightness is executed. If it is less than 5% and greater than 0%, control is performed to switch to display. Then, the shutdown sequence may be executed when 0% is reached. When power is supplied to the head-mounted display device 100 from both the first battery 131 and the second battery 132, the power saving control unit 180 calculates the sum of the capacities of the first battery 131 and the second battery 132. What is necessary is just to detect as a battery remaining charge. When the first battery 131 is the main battery and the second battery 132 is the sub battery, the power saving control unit 180 uses the remaining capacity of the first battery 131 as the battery of the head-mounted display device 100. The remaining amount may be used.

  In the description of FIGS. 6 to 8, the first battery 131 is the main battery and the second battery 132 is the sub-battery, and power is mainly supplied from the first battery 131 to each part of the head-mounted display device 100. Explained the operation of the case. The present invention is not limited to this. The first battery 131 and the second battery 132 are not distinguished from each other, and both the first battery 131 and the second battery 132 are used as power sources in the normal mode. You may supply a power supply to each part of the display apparatus 100. FIG. In this case, when the total capacity of the first battery 131 and the second battery 132 is equal to or less than the specified value (reference value) in step S1 of FIG. The process proceeds to S3.

  In addition, the power saving control unit 180 determines whether the first battery 131 and the second battery 132 have a low remaining capacity based on the display by the image display unit 20 and the lighting state of the LED display units 136 and 138. The battery 131 and / or the second battery 132 may be guided for replacement. Specifically, the power saving control unit 180 may perform a notification operation according to the remaining amounts of the first battery 131 and the second battery 132. A specific example of the notification operation will be described later with reference to FIGS. In this notification operation, battery replacement is urged in response to a decrease in the remaining amount of either or both of the first battery 131 and the second battery 132.

  The power saving control unit 180 uses two values, for example, a preset alarm value and a threshold value as conditions for executing a notification operation that prompts replacement of the battery. The alarm value is a value of the remaining battery level serving as a reference for warning and notifying the decrease in the remaining amount, and the threshold value is a value of the remaining battery level serving as a reference for starting execution of the shutdown sequence. The alarm value and the threshold value may be values that are compared with the total remaining amount of the first battery 131 and the second battery 132, or the remaining amount of each of the first battery 131 and the second battery 132. It may be a value that defines The alarm value and the threshold value are stored in the storage unit 120 as setting data 121.

  In the notification operation, the power saving control unit 180 reads content data (not shown) stored in the storage unit 120 and controls the image processing unit 160 and the display control unit 170 to display an image for AR display in the image display unit 20. To display. Note that, when the content data includes audio data, the power saving control unit 180 may control the audio processing unit 190 to output the audio of the content from the right earphone 32 and the left earphone 34.

  The AR content displayed by the power saving control unit 180 is a character or an image for notifying a decrease in the remaining battery level and prompting the battery to be replaced. The power saving control unit 180 displays the AR content while the user is looking at the object through the image display unit 20. The power saving control unit 180 provides information about the object by performing an AR display that displays an image, characters, or the like at a position corresponding to the object, or the shape of the object seen through the image display unit 20. Change how it looks. The AR content includes image and character data displayed at a position corresponding to the object. In addition, the AR content may include data for specifying an object and data regarding the display position of an image or a character. The display position of the AR content may be a position overlapping the target object or may be around the target object. The target object may be an object, and in this embodiment, includes the first battery 131 and the second battery 132 to be replaced. Although the method by which the power saving control unit 180 detects the object is arbitrary, in this embodiment, the power saving control unit 180 detects the object located in the user's field of view from the captured image data of the camera 61. Then, the power saving control unit 180 determines the display position of the AR content corresponding to the detected object, and displays the AR content.

  It is desirable to display the AR content so as to overlap the position where the user visually recognizes the target object or according to the position where the user visually recognizes the target object. Therefore, the power saving control unit 180 detects the image of the target object from the captured image data of the camera 61, and the target object in the imaging range of the camera 61 based on the positional relationship between the detected target image and the entire captured image. Specify the position of. The power saving control unit 180 determines the display position of the AR content corresponding to the position of the target object based on the positional relationship between the imaging range of the camera 61 and the display area of the image display unit 20.

Here, the power supply unit 300 (FIG. 4) is configured to supply power from the battery that has a larger remaining amount of the first battery 131 and the second battery 132. For this reason, the power of the first battery 131 and the second battery 132 is consumed almost evenly, and it is difficult for one of the remaining amount to be small and the other to be large.
Therefore, in the following description, a case where the remaining amounts of both the first battery 131 and the second battery 132 are reduced will be described as an example. Since the head mounted display device 100 can individually detect the remaining amounts of the first battery 131 and the second battery 132 by the battery control unit 135, either the first battery 131 or the second battery 132 is used. It is also possible to perform the above guidance when the remaining amount of is reduced.
FIGS. 9 and 10 show display examples of the remaining amount of the first battery 131 and the second battery 132 and display examples of replacement guidance.

  FIG. 9 is an explanatory diagram showing an example of the state transition of the head-mounted display device 100. Changes in the remaining amounts of the first battery 131 and the second battery 132 and the state of the head-mounted display device 100 are described. And changes in operation are shown in association with each other. FIGS. 10A, 10 </ b> B, 10 </ b> C, and 10 </ b> D are diagrams showing display examples of the image display unit 20, and show the user's visual field VR.

  In FIG. 9, an operation performed by the user of the head-mounted display device 100 is referred to as “user operation”, and a display form of the remaining battery level in the image display unit 20 is illustrated as “remaining battery level display”. In the operation of displaying the battery remaining amount, the image display unit 20 functions as a remaining amount display unit. Further, the remaining amount of the first battery 131 is denoted as “Battery (1) remaining amount”, and the remaining amount of the second battery 132 is denoted as “Battery (2) remaining amount”. The lighting state of the LED display unit 136 is “LED (1)”, the lighting state of the LED display unit 138 is “LED (2)”, the operation of the head-mounted display device 100 is “system side operation”, and the image display unit The AR display at 20 is indicated as “AR display”.

  FIG. 9 shows an example of a state transition in which the first battery 131 and the second battery 132 have a remaining amount of 100% (state 1) as a start state. This example shows a process in which the remaining amount of the first battery 131 and the second battery 132 decreases, and further, until the state (state 9) after the first battery 131 and the second battery 132 are replaced. The progress of The vertical direction in FIG. 9 corresponds to the passage of time (change in state).

  State 1 is a state in which the first battery 131 and the second battery 132 are almost fully charged, and the remaining amount is 100%. In state 1, the head-mounted display device 100 performs a normal operation such as displaying an image in response to an operation in the control device 10.

As shown in FIG. 10A, an information display unit 402 is provided in the display area 401 arranged in the visual field VR of the user. The information display unit 402 is an area for displaying a battery remaining amount mark, an icon, a text message, and the like, and is arranged below the display area 401 so as not to disturb the visibility of the visual field VR. A battery mark indicating the remaining amount of the first battery 131 and the second battery 132 is disposed at the left end of the information display unit 402. The battery mark is a display unit that indicates the remaining battery level in a stepwise manner (for example, 10 levels). In state 1, as shown in FIG. The indicator is colored).
Note that a single mark for displaying the sum of the remaining amounts of the first battery 131 and the second battery 132 may be arranged on the information display unit 402. Further, a battery mark that displays the remaining amount of the first battery 131 and a battery mark that displays the remaining amount of the second battery 132 may be arranged on the information display unit 402.

  The battery mark indicates the remaining battery level of the entire head-mounted display device 100, and displays the total remaining capacity of the first battery 131 and the second battery 132. In the present embodiment, it is assumed that the first battery 131 and the second battery 132 have substantially the same capacity.

  In states 2 and 3, the display of the battery mark on the information display unit 402 changes as the remaining amount of the first battery 131 and the second battery 132 decreases, but the head-mounted display device 100 performs normal operation. To do. The battery mark is displayed by the power saving control unit 180 controlling the image processing unit 160, and the power saving control unit 180 controls a change in display of the battery mark.

  In state 4, since the remaining amounts of both the first battery 131 and the second battery 132 are 20%, the power saving control unit 180 performs a notification operation. The power saving control unit 180 displays the battery mark of the information display unit 402 at level 1. Further, the power saving control unit 180 causes the battery mark on the information display unit 402 to blink.

When the remaining battery level further decreases, the state 5 is entered. Even in state 5, the user can perform normal work.
In state 5, since the remaining amounts of the first battery 131 and the second battery 132 are 10%, the power saving control unit 180 performs a notification operation. In this notification operation, the battery mark of the information display unit 402 is set to level 0. In addition, the blinking display of the battery mark is continued, and a guidance display that prompts replacement of the battery is performed on the information display unit 402. Further, the LED display unit 136 is set in a red blinking state, and the LED display unit 138 is set in a red lighting state.

  In state 5, since the remaining amount of both the first battery 131 and the second battery 132 is 10%, it is preferable to replace both batteries. However, if the first battery 131 and the second battery 132 are removed at the same time, the operation of the head-mounted display device 100 may be hindered. Therefore, when the battery replacement is guided, the power saving control unit 180 guides replacement of other batteries except for one or more of the first battery 131 and the second battery 132. For example, the first battery 131 and the second battery 132 guide the replacement of one battery, and the other battery is not guided for replacement, or indicates that the urgency of the side that guided the replacement is high. In state 5, the power saving control unit 180 blinks the LED display unit 136 in red, so that when the user opens the battery cover 102 (FIG. 4A), the first battery 131 is removed from the second battery 132. We can guide you to exchange preferentially.

  FIG. 10B shows a display example in the state 5. In the information display unit 402, the battery mark blinks, and a text message prompting battery replacement is displayed.

In state 5, when the user operates the control device 10 to instruct the transition to the battery replacement mode in which the battery is replaced, the head-mounted display device 100 transitions to state 6.
In state 6, as shown in FIG. 10C, an animation for explaining the replacement operation of the first battery 131 is displayed in the display area 401. This change in the display of the animation can explain the procedure until the first battery 131 is removed and the new first battery 131 is installed, and the operation can be guided in an easy-to-understand manner.
Furthermore, when the power saving control unit 180 detects that the user removes the information display unit 402 and looks at the back surface of the control device main body 101, the power saving control unit 180 performs AR display. In this AR display, the power saving control unit 180 displays a message so as to overlap the first battery 131 and the second battery 132 that are visible in the visual field VR.

  In FIG. 10C, the battery housing portion 104 is visible in the visual field VR, and the blinking state of the LED display portion 136 is visually recognized. The power saving control unit 180 arranges the AR display unit 405 so that the first battery 131 can be seen based on the correspondence between the position of the display area 401 and the position where the battery housing unit 104 is visually recognized. The AR display unit 405 is an area for displaying characters and images in an AR display. In FIG. 10C, a text message for guiding exchange is displayed.

  Here, when the first battery 131 is replaced by the user, the head-mounted display device 100 shifts to the state 7. In the state 7, the remaining amount of the first battery 131 is recovered, so that the remaining amount display of the battery mark and the display of the LED display unit 136 are changed. In particular, the LED display unit 136 lights in green to indicate that the capacity of the first battery 131 after replacement is normal.

In state 7, the power saving control unit 180 sets the LED display unit 138 in a blinking red state as shown in FIG. 10D as a notification operation for urging replacement of the second battery 132, and Displays an animation explaining the exchange operation.
Further, a message prompting replacement of the second battery 132 so as to overlap with the battery housing portion 104 visually recognized in the visual field VR is displayed as AR. In addition, a message indicating that the replacement of the first battery 131 has been completed may be displayed.

  Thereafter, when the second battery 132 is replaced, the head-mounted display device 100 shifts to the state 8, and the power saving control unit 180 turns on the LED display unit 136 and the LED display unit 138 in green. In addition, the power saving control unit 180 displays an AR message indicating that the replaced first battery 131 and second battery 132 have been replaced. Here, the power saving control unit 180 ends the battery replacement mode, returns to normal operation, and the head-mounted display device 100 shifts to the state 10.

  In addition, when the power supply unit 300 consumes the power of the first battery 131 and the second battery 132 unevenly, the power-saving control unit 180, when the remaining amount of one of the batteries decreases, You may perform the operation | movement demonstrated in the states 5-7.

  Thus, the power saving control unit 180 performs guidance display by the image display unit 20 in response to a decrease (decrease) in the remaining amount of either or both of the first battery 131 and the second battery 132. Can be made. This guidance display includes text messages and images, and can be displayed in an AR display that overlaps the outside scene that the user sees through the right optical image display unit 26 and the left optical image display unit 28. Further, the power saving control unit 180 can perform more effective notification by displaying a message or the like by AR display in synchronization with the lighting or blinking of the LED display units 136 and 138.

  According to the information displayed in the states 5 to 8, the control unit 140 can guide the replacement procedure without removing all of the first battery 131 and the second battery 132, for example. In this case, even if all of the plurality of batteries (the first battery 131 and the second battery 132) included in the head-mounted display device 100 are in a state that requires replacement, the power source of the head-mounted display device 100 is used. The user can perform replacement without turning off the display, that is, without stopping the head-mounted display device 100. Thus, even if the user is not familiar with the battery replacement procedure, the head-mounted display device 100 is not stopped.

Further, in accordance with the remaining amount of each of the first battery 131 and the second battery 132, a display for guiding the replacement procedure, the replacement order of the batteries of the first battery 131 and the second battery 132, and the like is performed. Thus, even when the time required for the user to replace the battery becomes long, the replacement can be completed without stopping the head-mounted display device 100.
Moreover, the display mode displayed on the image display unit 20 as the remaining amount display unit may display the remaining amount of at least one of the first battery 131 and the second battery 132, or the first battery. 131 and display based on the average of the remaining amount of the second battery 132 may be performed.

The information to be displayed in the above states 5 to 7 includes the necessity of replacement of the first battery 131 and the second battery 132, the replacement procedure, the replacement operation method, the first battery 131 and the second battery 132, respectively. It can be used as guidance information for guiding the time when the battery can be used continuously. Further, for example, internal information including state information such as the remaining amount of the first battery 131 and / or the second battery 132 may be used.
Prior to displaying such guidance information and internal information, a menu image for display selection is displayed. When an item included in the menu image is selected by an operation of the operation unit 111, the selected information is displayed. May be.

  Further, in state 5, before the replacement mode is selected, the head-mounted display device 100 can operate without replacing both the first battery 131 and the second battery 132 or both. The remaining time may be displayed. The display of the remaining operable time (usable time) is continued until the replacement of the first battery 131 and the second battery 132 is completed, that is, until the state 9 is reached and the replacement mode is terminated. May be displayed.

In this way, the power saving control unit 180 maintains the display state of the head-mounted display device 100 when the remaining amount of any battery reaches a level that requires replacement, and the head-mounted display device The guidance information about 100 is displayed so as to overlap at least a part of the control device 10 visually recognized as an outside scene while maintaining the power supply of the head-mounted display device 100. For this reason, the display of the image display unit 20 allows the user to easily know that the battery needs to be replaced. Therefore, information regarding battery replacement can be promptly provided to the user.
Examples of the guidance information include state information such as the remaining amount regarding at least a part of the batteries of the first battery 131 and the second battery 132. In addition, the necessity of replacement of the first battery 131 and the second battery 132, the replacement procedure, the replacement operation method, the time for which the first battery 131 and / or the second battery 132 can be used continuously, etc. are guided. Although the guidance display to perform is mentioned, other information may be sufficient. Moreover, although the structure which maintains the display state in the head mounted display apparatus 100 also at the time of replacement | exchange of the 1st battery 131 and / or the 2nd battery 132 is included, another structure is also included.

  As described above, the head-mounted display device 100 according to the first embodiment to which the present invention is applied includes the image display unit 20, the first battery 131, the second battery 132, the communication unit 117, And a control unit 140. The image display unit 20 allows the user to visually recognize the image and transmits the outside scene. The control unit 140 switches the power source between the first battery 131 and the second battery 132. Further, when the power source is switched from the first battery 131 to the second battery 132, the control unit 140 changes the operation mode of the head-mounted display device 100 from the normal operation mode to the image display unit 20 and the communication unit 117. The battery is switched to the battery replacement mode in which the power consumption is lower than that in the normal operation mode. The communication unit 117 maintains a communicable state in the battery replacement mode. Therefore, it is possible to efficiently use a plurality of batteries and replace the batteries without stopping the operation of the apparatus.

  The image display unit 20 includes a left display driving unit 24 that displays an image corresponding to the left eye of the user and a right display driving unit 22 that displays an image corresponding to the right eye of the user. The control unit 140 stops the display of either the left display drive unit 24 or the right display drive unit 22 in the battery replacement mode. Therefore, the power consumption of the image display unit 20 can be reduced, and the second battery 132 can sufficiently supply power during the replacement of the first battery 131.

  Further, the control unit 140 sets the frame rate of the image displayed on the image display unit 20 in the battery replacement mode to be lower than the frame rate of the image displayed on the image display unit 20 in the normal operation mode. Accordingly, power consumption during the replacement of the first battery 131 can be further reduced, and power can be supplied by the second battery 132.

Further, the control unit 140 makes the display area of the image display unit 20 in the battery replacement mode smaller than the display area of the image display unit 20 in the normal operation mode. Accordingly, power consumption during the replacement of the first battery 131 can be further reduced, and power can be supplied by the second battery 132. In addition, the guide image including the AR display unit 405 and the like illustrated in FIG. 10D has the center of the visual field VR so as not to hinder the visibility when the first battery 131 and the second battery 132 are replaced. It may be arranged to avoid. For example, you may arrange | position around the display area 401 so that it may become the position brought close to the up-and-down and right-and-left edge part of the visual field VR.
In addition, in the image displayed on the AR display unit 405, when one of the first battery 131 and the second battery 132 needs to be replaced, the battery on the side that needs to be replaced is highlighted and visually recognized. AR images may be displayed. For example, display may be performed so that the battery on the side requiring replacement can be seen in a fluorescent color or the like.

  In addition, the communication unit 117 can communicate in the battery replacement mode so that communication can be started without authentication when the operation mode of the head-mounted display device 100 shifts from the battery replacement mode to the normal operation mode. Maintain a good condition. Therefore, when the operation mode is shifted to the normal operation mode, communication can be started without performing authentication.

  The head-mounted display device 100 includes a nonvolatile storage unit 120. The control unit 140 causes the storage unit 120 to store data related to the operation of the control unit 140 when shifting to the battery replacement mode, and the storage unit when shifting the operation mode from the battery replacement mode to the normal operation mode. The process based on the data stored in 120 is executed. Therefore, when shifting from the battery replacement mode to the normal operation mode, the control unit 140 can be returned to the state before shifting to the battery replacement mode.

  In addition, when the first battery 131 is replaced, the control unit 140 performs display based on the remaining capacity of the first battery 131 after replacement in the image display unit 20. Therefore, after the replacement of the first battery 131, the user can check the remaining capacity of the first battery 131.

  In addition, the control unit 140 charges the second battery 132 with the electric power of the first battery 131 when the remaining capacity of the first battery 131 is equal to or greater than the threshold value. Therefore, the remaining capacity of the second battery 132 can be maintained in a good state.

  In addition, when the remaining capacity of the first battery 131 is equal to or less than the threshold value, the control unit 140 causes the image display unit 20 to display a display prompting the replacement of the first battery 131. Therefore, it is possible to notify that the remaining capacity of the first battery 131 is low, and it is possible to prevent problems due to insufficient remaining capacity of the first battery 131.

  The head-mounted display device 100 includes a lid 123 that opens and closes a battery housing portion 122 that detachably houses the first battery 131 and an open / close detection portion 124 that detects opening and closing of the lid 123. The control unit 140 switches the power source from the first battery 131 to the second battery 132 when the opening / closing detection unit 124 detects the opening of the lid 123. Therefore, the power supply can be quickly switched to the second battery 132 in response to the operation of replacing the first battery 131.

Further, the power saving control unit 180 may display the remaining capacity of the battery of the external device connected to the head-mounted display device 100 in the display area 401.
For example, the control unit 140 performs wireless communication with an external device such as a printer (printing apparatus), a mobile phone including a smartphone, and a scanner via the communication unit 117. When the external device is equipped with a battery, the control unit 140 receives data regarding the remaining battery level and charge / discharge state of the external device via the communication unit 117. The control unit 140 may display the external battery information related to the remaining battery level and the charge / discharge state received from the external device in the display area 401. For example, the remaining battery level of the external device may be displayed in a form that can be distinguished from the remaining battery level of the head-mounted display device 100 in the information display unit 402. Further, it may be notified by displaying the display area 401 that the remaining battery level of the external device has become equal to or less than a preset specified value. At this time, the voice processing unit 190 may output the voice and notify the user. In addition, the start and end of charging of the battery of the external device may be notified by displaying the display area 401, and at this time, a sound may be output.

[Second Embodiment]
Next, a second embodiment to which the present invention is applied will be described.
The configuration of the head-mounted display device 100 according to the second embodiment is as described in the first embodiment, and illustration and description of common components are omitted.

In the second embodiment, the power saving control unit 180 changes the operation mode of the head-mounted display device 100 to the normal operation mode based on the remaining capacity of the first battery 131 or a signal input from the open / close detection unit 124. Switch to battery replacement mode.
Further, when the power saving control unit 180 detects the replacement of the first battery 131, the power saving control unit 180 changes the operation mode of the head-mounted display device 100 from the battery replacement mode to the normal mode based on the remaining capacity of the first battery 131. Switch to operating mode.

In addition, the power saving control unit 180 monitors the remaining capacity of the second battery 132 after switching the operation mode to the battery replacement mode. The remaining capacity of the second battery 132 is calculated by the second battery monitoring IC 134 and input from the battery control unit 135 to the power saving control unit 180.
The power saving control unit 180 compares the remaining capacity of the second battery 132 with the first reference value, and when the remaining capacity of the second battery 132 falls below the first reference value, the image display unit The 20 display modes are changed to a mode for reducing the power consumption of the head-mounted display device 100. The power saving control unit 180 changes the display mode of the image display unit 20 by controlling at least one of the image processing unit 160 and the display control unit 170. The first reference value is set to a value corresponding to a fully charged or less capacity of the second battery 132. For example, if the first reference value is set to a value corresponding to the full charge of the second battery 132, and the second battery 132 is fully charged at the time of switching the power supply, the power saving control unit 180 turns on the power supply. When switching to the second battery 132, the display mode of the image display unit 20 is changed. For example, when the first reference value is set to a value corresponding to 80% of the second battery 132, the power saving control unit 180 reduces the remaining capacity of the second battery 132 to 80%. Until then, the display mode of the image display unit 20 is not changed. The power saving control unit 180 detects that the remaining capacity of the second battery 132 has decreased to 80%, and changes the display mode of the image display unit 20.

  The display mode of the image display unit 20 is a display setting of the image display unit 20, and the power saving control unit 180 instructs to change to a display mode that can reduce power consumption of the head-mounted display device 100. . For example, the brightness of the image display unit 20 and the size of the display area of the image display unit 20 are changed by the power saving control unit 180 controlling the display control unit 170 and changing the display mode of the image display unit 20. The In addition, the power saving control unit 180 controls the image processing unit 160 to change the display mode of the image display unit 20, whereby the frame rate of the image displayed on the image display unit 20 is changed. In addition, the power saving control unit 180 controls the display control unit 170 to change the display mode of the image display unit 20, thereby changing the display driving units 22 and 24 responsible for image display. For example, the display control unit 170 displays an image on one of the right display drive unit 22 and the left display drive unit 24 in accordance with an instruction from the power saving control unit 180.

  In addition, when the remaining capacity of the second battery 132 falls below the first reference value, the power saving control unit 180 performs display based on the remaining capacity of the second battery 132 on the image display unit 20. The display based on the remaining capacity of the second battery 132 is, for example, a display related to the remaining capacity of the second battery 132 or the head-mounted display device 100 calculated based on the remaining capacity of the second battery 132. Is an indication of the operating time during which operation is possible.

In addition, the power saving control unit 180 executes the end sequence when the remaining capacity of the second battery 132 to be monitored meets a preset condition. The power saving control unit 180 determines whether or not a preset condition is satisfied by comparing the remaining capacity of the second battery 132 with a preset second reference value. The second reference value is smaller than the first reference value. For example, the second reference value is set to a value corresponding to the remaining capacity of the second battery 132 obtained by adding a predetermined margin to the remaining capacity of the second battery 132 necessary for executing the end sequence. The second reference value is a value stored in advance in the storage unit 120. For example, when the head-mounted display device 100 is turned on, the second reference value is read from the storage unit 120 by the CPU and stored in the RAM. The power saving control unit 180 determines that the end sequence is to be executed when the remaining capacity of the second battery 132 falls below the second reference value.
Further, the power saving control unit 180 can determine whether or not to execute the end sequence based on a signal input from the battery control unit 135. The battery control unit 135 detects the lowest operating voltage of the head-mounted display device 100 based on the terminal voltage of the second battery 132 measured by the second battery monitoring IC 134. The battery control unit 135 that has detected the minimum operating voltage outputs a signal indicating that the minimum operating voltage has been detected to the power saving control unit 180. The power saving control unit 180 that has received a signal from the battery control unit 135 executes an end sequence.
When starting the end sequence, the power saving control unit 180 disconnects the network connection of the communication unit 117 when the communication unit 117 is connected to the network, and logs related to the operation state of the control device 10 (information about the operation state). Is stored in the storage unit 120. Thereafter, the power saving control unit 180 turns off the power supply from the second battery 132 and shuts down the OS. The log relating to the operation state includes information such as ESSID necessary for connection with the access point and connection setting information such as information necessary for authentication with the connected server device. In addition, in the log relating to the operation state, the remaining capacity of the second battery 132 and the work input by the user of the head-mounted display device 100 by operating the direction key 16 or the track pad 14 of the operation unit 111 are input. Information indicating progress is included.

11 and 12 are flowcharts showing the operation of the head-mounted display device 100 according to the second embodiment, and in particular, are flowcharts showing detailed procedures in the battery exchange mode.
The power saving control unit 180 switches the operation mode to the battery replacement mode (step S51). When the operation mode is switched to the battery replacement mode, the power saving control unit 180 outputs a signal notifying the switching to the battery replacement mode to the display control unit 170. The display control unit 170 that has received the signal from the power saving control unit 180 causes the image display unit 20 to display a message (step S52). This message is a message notifying that the operation mode of the head-mounted display device 100 has been switched to the battery replacement mode. In addition to this, the display control unit 170 waits for replacement of the first battery 131 until a message notifying that the lid 123 of the battery housing unit 122 is opened or until the battery can be replaced. Thus, a message requesting the user may be displayed.

Next, the power saving control unit 180 stores the system information in the storage unit 120 (step S53). The system information is data for returning the head-mounted display device 100 switched to the battery replacement mode to the normal operation mode, and is data related to the operation of the control unit 140. The system information includes, for example, data related to the operation of the head-mounted display device 100, such as the display position and display size of an image displayed on the image display unit 20. The system information stored in the storage unit 120 can be selected according to the remaining capacity of the second battery 132. For example, the importance is set in advance in the system information. The power saving control unit 180 selects system information to be stored in the storage unit 120 based on the importance set in the system information and the remaining capacity of the second battery 132. For example, when the remaining capacity of the second battery 132 after switching the power source from the first battery 131 to the second battery 132 is small, system information with high importance is stored in the storage unit 120.
Next, the power saving control unit 180 outputs a signal for instructing battery switching to the battery control unit 135 to instruct switching to the second battery 132 (step S54). When the signal is input, the battery control unit 135 switches the battery that supplies power, that is, the power source from the first battery 131 to the second battery 132.

  Next, the power saving control unit 180 outputs a signal for limiting the power supply destination to the battery control unit 135 (step S55). The battery control unit 135 that has received the signal from the power saving control unit 180 determines the power supply destination as the control unit 140, the communication unit 117, the right display drive unit 22 and the left display drive unit 24 of the image display unit 20. Limit to. Since power is supplied to the communication unit 117 even after switching to the battery replacement mode, for example, when the communication unit 117 is connected to the network, the connection with the network can be maintained. Therefore, after the operation mode of the head-mounted display device 100 returns to the normal operation mode, the user does not need to perform an operation for connecting the communication unit 117 to the network.

  In addition, since power is supplied to the communication unit 117 even after the transition to the battery replacement mode, the communication unit 117 maintains the connection with the network in the connected state even after the transition to the battery replacement mode. The communication unit 117 maintains a connection with the network in the battery replacement mode so that communication can be started without performing user authentication when the battery replacement mode is shifted to the normal operation mode. For this reason, after returning from the battery replacement mode to the normal operation mode, it is not necessary to perform an operation such as re-entering authentication information such as a password in order to reconnect to the network. Accordingly, it is possible to reduce the labor of the user due to battery replacement.

  In this way, the power saving control unit 180 reduces the power consumption of the power supply destinations other than the communication unit 117, for example, the right display driving unit 22 and the left display driving unit 24, thereby reducing the amount of head wearing. The power consumption of the type display device 100 is reduced. As a result, power supply to the communication unit 117 can be maintained in a state where the capacities of the first battery 131 and the second battery 132 are reduced, and a state in which communication by the communication unit 117 is possible can be maintained for a long time. . Accordingly, communication interruption, disconnection, and interruption due to the stop of the communication unit 117 can be avoided. When communication is interrupted, after the power supply capacity is restored by replacing the first battery 131 or the second battery 132, the communication unit 117 is activated and a sequence for establishing communication with the communication partner device is performed. Need to run. In this case, data transmission / reception for establishing communication according to a predetermined communication protocol, selection of a communication partner device, authentication by a user ID or a password, and the like are required with a communication partner device, which takes time. By eliminating the need to execute such a sequence, it is possible to reduce the downtime of the work using the head-mounted display device 100 and to improve the work efficiency.

  After shifting to the battery replacement mode, the control unit 140 may control the communication unit 117 to suppress the power consumption of the communication unit 117 while power is being supplied to the communication unit 117. For example, the control unit 140 intermittently executes a polling operation between the connection destination device to which the communication unit 117 is connected and the communication unit 117 or a scan operation for searching for a device to which the communication unit 117 can be connected. May be. Moreover, the frequency of polling and scanning may be reduced as compared with the normal operation mode. Furthermore, the control unit 140 may notify the other devices that can communicate by transmitting data indicating that the battery replacement mode is being executed. For example, as will be described later, notification may be made to another head-mounted display device 100 or the server 5 (FIG. 13). In this case, the remaining amount of the battery in the head-mounted display device 100 and the shift to the battery replacement mode can be managed by another device.

Further, when the communication unit 117 is connected to a network by, for example, a wireless LAN, the power saving control unit 180 changes the communication mode of the communication unit 117 to the power save mode when the battery replacement mode is entered. Thus, the power consumption of the communication unit 117 may be reduced.
Further, when the communication unit 117 performs communication by Bluetooth in the normal operation mode, the power saving control unit 180 switches the communication unit 117 to communication by Bluetooth Low Energy or Bluetooth Smart when the mode is changed to the battery replacement mode. You may switch. Further, the communication output may be reduced without switching the communication method. For example, the class of the radio wave intensity may be changed during communication using Bluetooth.

In addition, when the short-range wireless communication conforming to the standards such as RFID and Felica is possible, the power saving control unit 180 changes the communication unit 117 from the communication by the wireless LAN when shifting to the battery replacement mode. You may switch to near field communication.
Note that the power saving control unit 180 may control the battery control unit 135 based on the remaining capacity of the second battery 132 to control a functional block that supplies power. For example, when the remaining capacity of the second battery 132 is reduced to 70% or less, the power saving control unit 180 outputs a signal for stopping the power supply to the right display driving unit 22 to the battery control unit 135. In addition, when the remaining capacity of the second battery 132 is reduced to 50% or less, the power saving control unit 180 outputs a signal for stopping the power supply to the left display driving unit 24 to the battery control unit 135. Further, when the remaining capacity of the second battery 132 decreases to 40% or less, the power saving control unit 180 outputs a signal for stopping the power supply to the communication unit 117 to the battery control unit 135.

  As another example of maintaining the communicable state of the communication unit 117, the power saving control unit 180 temporarily stops communication by the communication unit 117 when the first battery 131 or the second battery 132 is replaced. May be. In this case, when the operation of receiving content data from the external device OA is temporarily stopped, the power saving control unit 180 may temporarily stop display of content by the display control unit 170. At the time of this temporary stop, after exchanging the first battery 131 or the display switching key 13, the communication partner device (for example, the external device OA) It is preferable to maintain a minimum communication establishment. That is, it is preferable that the temporary stop is a state in which data communication such as content data is not executed, and control data or the like for maintaining the connection is intermittently transmitted and received. Further, when the communication is completely stopped, it is preferable that data when authentication or communication setting is performed in the communication before the stop is stored and the communication can be quickly reestablished based on the stored data.

Next, the power saving control unit 180 determines whether or not the first battery 131 has been replaced (step S56). The power saving control unit 180 detects that the first battery 131 is removed, and detects that the first battery 131 is attached again.
The power saving control unit 180 determines whether or not the first battery 131 has been replaced based on the terminal voltage of the first battery 131 measured by the first battery monitoring IC 133. When the connection between the first battery 131 and the battery control unit 135 is released, the terminal voltage of the first battery 131 measured by the first battery monitoring IC 133 becomes low level or high impedance. The power saving control unit 180 determines that the first battery 131 is removed from the battery housing unit 122 when the terminal voltage of the first battery 131 input by the first battery monitoring IC 133 becomes low level or high impedance. judge. This determination is performed by the power saving control unit 180 comparing the voltage value detected by the battery monitoring IC 133 with a preset reference value of the voltage and determining the magnitude thereof.
Further, when a new first battery 131 is accommodated in the battery accommodating portion 122 and the first battery 131 and the battery control portion 135 are connected, the first battery 131 measured by the first battery monitoring IC 133 is measured. The terminal voltage becomes a voltage within a predetermined range. The power saving control unit 180 determines that the first battery 131 has been replaced when the terminal voltage of the first battery 131 measured by the first battery monitoring IC 133 falls within a predetermined range. Here, the power saving control unit 180 compares the voltage value detected by the battery monitoring IC 133 with a reference value of a preset voltage, and determines its magnitude.

When the determination in step S56 is negative (step S56 / NO), the power saving control unit 180 determines whether or not the remaining capacity of the second battery 132 is equal to or less than the first reference value (step S57). . When the first reference value is set to a value for detecting the full charge of the second battery 132, the power saving control unit 180 performs steps S58 and S59 when the power source is switched to the second battery 132. Start processing.
When the determination in step S57 is negative (step S57 / NO), the power saving control unit 180 returns to step S56 and determines whether or not the first battery 131 has been replaced (step S56). When the determination in step S57 is affirmative (step S57 / YES), the power saving control unit 180 causes the display control unit 170 to indicate that the remaining capacity of the second battery 132 has decreased below the first reference value. A signal indicating is output. The display control unit 170 that has received the signal of the power saving control unit 180 performs display based on the remaining capacity of the second battery 132 on the image display unit 20 (step S58). This display is a display related to the remaining capacity of the second battery 132 or a display of the remaining time during which the head-mounted display device 100 is operable, which is calculated based on the remaining capacity of the second battery 132.

  Next, the power saving control unit 180 outputs a signal instructing the display control unit 170 to change the display mode (step S59). The display control unit 170 that has received a signal instructing to change the display mode adjusts the luminance of the image display unit 20, for example. The display control unit 170 controls at least one of the right backlight control unit 201 and the left backlight control unit 202 by a control signal, and sets the luminance of at least one of the right backlight 221 and the left backlight 222 in the normal operation mode. Lower than. In other words, the display control unit 170 may lower the luminance of the right backlight 221 and the left backlight 222 than in the normal operation mode, or may decrease the luminance of the right backlight 221 or the left backlight 222 in the normal operation mode. It may be lowered than sometimes. Since the luminance of at least one of the right backlight 221 and the left backlight 222 is lower than that in the normal operation mode, the power consumption of the head-mounted display device 100 can be reduced.

Further, the display control unit 170 that has input a signal instructing to change the display mode may change the display area of the image display unit 20. The display area of the image display unit 20 is the display area of the right LCD 241 and the left LCD 242.
The display control unit 170 controls at least one of the right LCD control unit 211 and the left LCD control unit 212 by a control signal, and reduces at least one display region of the right LCD 241 and the left LCD 242 as compared with the display region in the normal operation mode. That is, the display control unit 170 may reduce the display area of the right LCD 241 and the left LCD 242 than in the normal operation mode, or reduce the display area of the right LCD 241 or the left LCD 242 than in the normal operation mode. Also good. Since at least one display area of the right LCD 241 and the left LCD 242 is reduced as compared with the normal operation mode, the power consumption of the head-mounted display device 100 can be reduced.

Further, the display control unit 170 that has input a signal instructing to change the display mode may stop the display of either the right display drive unit 22 or the left display drive unit 24 of the image display unit 20.
For example, the display control unit 170 turns off one of the right display drive unit 22 and the left display drive unit 24 by turning off the output of the control signal to either the right display drive unit 22 or the left display drive unit 24. The generation of image light may be stopped. In addition, the display control unit 170 controls either the right display drive unit 22 or the left display drive unit 24 according to the control signal, and the image light of either the right display drive unit 22 or the left display drive unit 24 is controlled. Generation may be stopped. Furthermore, transmission of the clock signal PCLK, the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the image data Data output from the image processing unit 160 to the transmission unit 51 or 52 may be stopped under the control of the power saving control unit 180. . Further, the display may be stopped by the power saving control unit 180 controlling the battery control unit 135 to stop the power supply to one of the right display driving unit 22 and the left display driving unit 24. As a result, only one of the right display drive unit 22 and the left display drive unit 24 performs display, and power consumption is greater than when an image is displayed on both the right display drive unit 22 and the left display drive unit 24. The amount is reduced.

In addition, the display control unit 170 combines the adjustment of the luminance of the backlights 221 and 222, the reduction of the display area of the LCDs 241 and 242 and the display stop of the display driving unit 22 or 24 to combine the power consumption of the image display unit 20. May be reduced.
The power saving control unit 180 selects a mode number for designating the display mode of the image display unit 20 according to the remaining capacity of the second battery 132 and notifies the display control unit 170 of the selected mode number.
For example, when the remaining capacity of the second battery 132 becomes 80% or less, for example, the power saving control unit 180 notifies the display control unit 170 of the mode number “1”. The display control unit 170 notified of the mode number “1” controls the right backlight control unit 201 and the left backlight control unit 202 according to the control signal, and operates the brightness of the right backlight 221 and the left backlight 222 in a normal operation. Lower than in mode.
Further, when the remaining capacity of the second battery 132 becomes 60% or less, the power saving control unit 180 notifies the display control unit 170 of the mode number “2”. The display control unit 170 notified of the mode number “2” controls the right LCD control unit 211 and the left LCD control unit 212 by the control signal, and displays the display areas of the right LCD 241 and the left LCD 242 in the normal operation mode. Make it smaller than the area.
Further, when the remaining capacity of the second battery 132 becomes 40% or less, the power saving control unit 180 notifies the display control unit 170 of the mode number “3”. The display control unit 170 notified of the mode number “3” turns off the output of the control signal to either the right display drive unit 22 or the left display drive unit 24, and the right display drive unit 22 or the left display drive unit 24. The display of is stopped.
As a result, display of the display image is stopped in one of the right display drive unit 22 and the left display drive unit 24. The other of the right display drive unit 22 and the left display drive unit 24 is in a state where the luminance of the backlight 221 (222) is suppressed and the display area of the LCD 241 (242) is reduced.

  The power saving control unit 180 may output a signal that instructs the image processing unit 160 to lower the frame rate of the image signal than in the normal operation mode. The image processing unit 160 to which the signal from the power saving control unit 180 is input has the image signal, the vertical synchronization signal (VSync), and the horizontal synchronization so that the frame rate of the image signal is lower than that in the normal operation mode. The signal (HSSync) is converted. The frame rate of the image signal converted by the image processing unit 160 may be a preset frame rate or may be changed according to an instruction from the power saving control unit 180. For example, the remaining capacity of the second battery 132 and the converted frame rate are set in a plurality of stages in advance, and the power saving control unit 180 converts the frame rate corresponding to the capacity of the second battery 132. The previous frame rate may be selected.

Further, the power saving control unit 180 may output a signal instructing the image processing unit 160 to perform thinning processing of the image signal. The image processing unit 160 that receives the signal from the power saving control unit 180 thins out the digitally converted digital image signal at a preset thinning rate, and uses the thinned image signal as image data in the storage unit 120. Store in RAM.
Further, when the image signal stored in the RAM in the storage unit 120 is transmitted to the image display unit 20 via the transmission units 51 and 52, the image signal read out from the RAM is read out at a preset thinning rate. Processing may be realized.
Further, the right LCD control unit 211 thins out the pixels of the right LCD 241 used for displaying the right eye image data, and the left LCD control unit 212 thins out the pixels of the left LCD 242 used for displaying the left eye image data. Thus, the power consumption of the image display unit 20 may be reduced.

  In the battery replacement mode, the display control unit 170 may display an image on the periphery of the display area of the right LCD 241 and the left LCD 242. For example, in the image battery exchange mode, the image processing unit 160 reduces the size of the image data displayed on the right LCD 241 and the left LCD 242 as compared with the normal operation mode. Then, under the control of the display control unit 170, the reduced image is displayed on the peripheral portion in the display area of the right LCD 241 and the left LCD 242. That is, since the center of the field of view is avoided and the image is displayed in the periphery of the display area, the visibility of the outside scene can be improved while the power is exchanged by the second battery 132. For this reason, battery replacement work can be performed efficiently.

Next, the power saving control unit 180 determines whether or not the first battery 131 has been replaced (step S60). As in step S55, the power saving control unit 180 removes the first battery 131 and reconnects the first battery 131 based on the terminal voltage of the first battery 131 measured by the first battery monitoring IC 133. Detecting the installation. The power saving control unit 180 detects the removal of the first battery 131 and the reattachment of the first battery 131 and determines whether or not the first battery 131 is replaced.
When the determination in step S60 is negative (step S60 / NO), the power saving control unit 180 determines whether or not the remaining capacity of the second battery 132 is equal to or less than the second reference value (step S61). .
When the determination in step S61 is negative (step S61 / NO), the power saving control unit 180 returns to the determination in step S60 and determines whether or not the first battery 131 has been replaced (step S60). When the determination in step S61 is affirmative (step S61 / YES), the power saving control unit 180 executes an end sequence (step S62). The power saving control unit 180 causes the storage unit 120 to store a log related to the operation state of the control device 10 such as the remaining battery capacity and date and time stored in the RAM of the control unit 140, and shuts down the OS.

When it is determined that the first battery 131 has been replaced by the determination in step S55 or step S60 (step S55 or S60 / YES), the power saving control unit 180 has the remaining capacity of the first battery 131 equal to or greater than the reference value. Is determined (step S71). This reference value is different from the reference value in step S51 used for determining whether or not to switch the operation mode from the normal operation mode to the battery replacement mode. The reference value of the first battery 131 that allows the head-mounted display device 100 to continue operation for a preset time even when the head-mounted display device 100 is operated in the normal operation mode. It is set to a value corresponding to the remaining capacity.
When the determination in step S71 is negative (step S71 / NO), the power saving control unit 180 outputs a signal indicating that the remaining capacity of the first battery 131 is insufficient to the display control unit 170. The display control unit 170 that has received the signal from the power saving control unit 180 causes the image display unit 20 to display a message indicating that the remaining capacity of the first battery 131 is insufficient (step S72). When the first battery 131 having insufficient remaining capacity is not replaced or charged and is connected to the battery control unit 135 again, the head-mounted display device 100 cannot be returned to the normal operation mode. When the first battery 131 having insufficient remaining capacity is connected to the battery control unit 135, the head-mounted display device 100 cannot obtain an operating voltage, and the operation of the head-mounted display device 100 is abnormal. State or unstable state. In order to prevent such a state from occurring, in step S71, the power saving control unit 180 determines whether or not the remaining capacity of the first battery 131 is greater than or equal to a reference value.

If the determination in step S71 is affirmative (step S71 / YES), the power saving control unit 180 outputs an instruction signal to the battery control unit 135 to instruct switching to the first battery 131 (step S71). S73). The battery control unit 135 that has received the instruction signal switches the battery that supplies power, that is, the power source from the second battery 132 to the first battery 131.
Further, the power saving control unit 180 expands and restores the system information stored in the storage unit 120 to a work memory such as a RAM (step S74). Thereafter, the control unit 140 executes processing based on the data expanded in the RAM. As a result, the head-mounted display device 100 is returned to the normal operation mode before switching to the battery replacement mode.

Next, the power saving control unit 180 outputs an instruction signal to the battery control unit 135, and causes the battery control unit 135 to charge the second battery 132 with the power of the first battery 131 (step S75). When the power saving control unit 180 determines in step S71 that the remaining capacity of the first battery 131 is greater than or equal to the reference value, the power saving control unit 180 outputs an instruction signal to the battery control unit 135 to instruct charging of the second battery 132. To do.
The battery control unit 135 inputs the remaining capacity of the second battery 132 calculated by the second battery monitoring IC 134, and the second battery 132 is fully charged based on the input remaining capacity of the second battery 132. It is determined whether it is in the state. When the battery control unit 135 determines that the remaining capacity of the second battery 132 is not fully charged and is in a chargeable state, the battery control unit 135 outputs the power of the first battery 131 to the second battery 132. The second battery 132 is charged. That is, the condition for charging the second battery 132 is that the remaining capacity of the replaced first battery 131 is equal to or higher than the reference value and the remaining capacity of the second battery 132 is not fully charged. is there. When these conditions are satisfied, the battery control unit 135 outputs a signal instructing the battery control unit 135 to charge the second battery 132 with the power of the first battery 131.

  In step S51, when the remaining capacity of the first battery 131 is larger than the reference value and the lid 123 is accidentally opened, the process may proceed to step S71 when the lid 123 is closed. . In this case, the power saving control unit 180 may determine the remaining capacity of the first battery 131.

In addition, the remaining capacity of the first battery 131 and the second battery 132 can be determined by the battery control unit 135. For example, when the remaining capacity of the first battery 131 falls below a specified value, the battery control unit 135 outputs a signal indicating that to the control unit 140. When a battery switching permission signal is input from the control unit 140, the power source is changed from the first battery 131 to the second battery 132.
Further, the battery control unit 135 detects the removal of the first battery 131 and the reattachment of the first battery 131 based on the terminal voltage of the first battery 131 measured by the first battery monitoring IC 133. May be. The detection method of the removal of the first battery 131 by the battery control unit 135 and the reattachment of the first battery 131 is the same as the detection method by the power saving control unit 180.

Further, in the change of the display mode in step S59, the display control unit 170 may stop the display of the right display driving unit 22 and the left display driving unit 24 of the image display unit 20.
For example, the display control unit 170 stops the display of either the right display drive unit 22 or the left display drive unit 24 when the remaining capacity of the second battery 132 decreases below the first reference value. Further, the display control unit 170 stops the display of the right display driving unit 22 and the left display driving unit 24 when the remaining capacity of the second battery 132 is reduced to be equal to or less than the third reference value. The third reference value is set to a value between the first reference value and the second reference value.

  Further, the power saving control unit 180 outputs a signal instructing switching to the second battery 132 to the battery control unit 135 and then controls the display control unit 170 to explain a method of replacing the first battery 131. The content video to be displayed may be displayed on the image display unit 20. In the case of a user who is unfamiliar with the replacement method of the first battery 131, the replacement work of the first battery 131 can be performed efficiently by performing the work while viewing the content video. If the user is accustomed to the replacement work of the first battery 131, the content moving image can be prevented from being reproduced for the purpose of reducing the power consumption of the second battery 132. . For example, the number of times that the replacement operation of the first battery 131 is performed may be recorded, and the content moving image may not be reproduced when the predetermined number of times is reached.

  As described above, the head-mounted display device 100 according to the second embodiment to which the present invention is applied includes the image display unit 20, the first battery 131, the second battery 132, and the control unit 140. Prepare. The image display unit 20 allows the user to visually recognize the image and transmits the outside scene. The control unit 140 switches the operation mode of the head-mounted display device 100 between a normal operation mode in which power is supplied from the first battery 131 and a battery exchange mode in which power is supplied from the second battery 132. In addition, the control unit 140 charges the second battery 132 with the power of the first battery 131 after switching the operation mode from the battery replacement mode to the normal operation mode. Therefore, the battery can be replaced without stopping the operation of the head-mounted display device 100 driven by the battery, and the occurrence of a situation in which the battery replacement mode cannot be executed due to insufficient capacity of the second battery 132 is suppressed. be able to.

  Further, when the control unit 140 detects the replacement of the first battery 131, the control unit 140 changes the operation mode to the normal operation mode when the remaining capacity of the first battery 131 after the replacement is equal to or higher than a preset reference value. Switch. Therefore, it is possible to prevent the head-mounted display device 100 from being defective due to the shortage of the remaining capacity of the replaced first battery 131.

  In addition, when the remaining capacity of the second battery 132 satisfies a preset condition during execution of the battery replacement mode, the control unit 140 executes an end sequence. Therefore, according to the present invention, data loss or the like can be prevented by executing the end sequence when the second battery 132 has insufficient capacity, for example.

  In addition, the control unit 140 stores information on the operation state of the head-mounted display device 100 in the storage unit 120 as an end sequence, and then turns off the power. Therefore, it is possible to prevent the information regarding the operation state of the head-mounted display device 100 from being lost.

  Further, the control unit 140 changes the display mode of the image display unit 20 to the top when the remaining capacity of the second battery 132 decreases to a preset first reference value or less during execution of the battery replacement mode. The mode is changed to a mode for reducing the power consumption of the part-mounted display device 100. In addition, the control unit 140 changes the display mode to a mode that reduces the power consumption of the head-mounted display device 100, and then the remaining capacity of the second battery 132 decreases to a second reference value or less. Execute the end sequence. Therefore, when the remaining capacity of the second battery 132 decreases, the power consumption of the head-mounted display device 100 can be reduced by changing the display mode. Further, when the remaining capacity of the second battery 132 further decreases, the data loss of the head-mounted display device 100 can be prevented by executing the end sequence.

  In addition, when the remaining capacity of the second battery 132 falls below the first reference value during execution of the battery replacement mode, the control unit 140 sets the remaining capacity of the second battery 132 in the image display unit 20. Display based on. Therefore, when the remaining capacity of the second battery 132 decreases, the user can be displayed on the remaining capacity of the second battery 132 and the user can be notified of the state of the head-mounted display device 100. it can.

  The image display unit 20 includes a left display driving unit 24 that displays an image corresponding to the left eye of the user and a right display driving unit 22 that displays an image corresponding to the right eye of the user. In the battery replacement mode, the control unit 140 stops display of either the left display driving unit 24 or the right display driving unit 22. Therefore, the power consumption of the image display unit 20 can be reduced, and the second battery 132 can sufficiently supply power during the replacement of the first battery 131.

  Further, the control unit 140 sets the frame rate of the image displayed on the image display unit 20 in the battery replacement mode to be lower than the frame rate of the image displayed on the image display unit 20 in the normal operation mode. Accordingly, power consumption during the replacement of the first battery 131 can be further reduced, and power can be supplied by the second battery 132.

  Further, the control unit 140 makes the display area of the image display unit 20 in the battery replacement mode smaller than the display area of the image display unit 20 in the normal operation mode. Accordingly, power consumption during the replacement of the first battery 131 can be further reduced, and power can be supplied by the second battery 132.

  Further, in the battery replacement mode, the control unit 140 thins out image data to be displayed on the image display unit 20 and displays the thinned image data on the image display unit 20 or thins out pixels used for display on the image display unit 20 in the image display unit 20. To instruct. Therefore, the power consumption while supplying power with the second battery 132 can be further reduced.

  In addition, the control unit 140 displays an image on the periphery of the display area of the image display unit 20 in the battery replacement mode. Therefore, the visibility of the outside scene while the power is exchanged with the second battery 132 is improved, and the battery exchange operation can be performed efficiently.

  The head-mounted display device 100 includes a communication unit 117. In the battery replacement mode, the control unit 140 supplies the power of the second battery 132 to the communication unit 117 and maintains the communication unit 117 in a communicable state. Therefore, when the operation mode is switched from the battery replacement mode to the normal operation mode, it is possible to save the trouble of performing communication setting of the communication unit 117 again.

  In addition, the communication unit 117 can communicate in the battery replacement mode so that communication can be started without authentication when the operation mode of the head-mounted display device 100 shifts from the battery replacement mode to the normal operation mode. Maintain a good condition. Therefore, when the operation mode shifts from the battery exchange mode to the normal operation mode, communication can be started without performing authentication.

[Third Embodiment]
FIG. 13 is a schematic configuration diagram illustrating a system configuration of the communication system 1 according to the third embodiment. The communication system 1 is a system in which a display system 2 including a plurality of head-mounted display devices 100 is connected to a server 5 via a communication network 4. In the third embodiment, the plurality of head-mounted display devices 100 included in the display system 2 are referred to as head-mounted display devices 100A and 100B, respectively. Hereinafter, when it is not necessary to distinguish between the head-mounted display devices 100 </ b> A and 100 </ b> B, they are referred to as a head-mounted display device 100.

  The communication network 4 is realized by various communication lines such as a public line network, a dedicated line, a wireless communication line including a mobile phone line, and a backbone communication line of these lines, or a combination thereof, and its specific configuration is not limited. The communication network 4 may be a wide area communication line network that can connect remote locations, or may be a LAN (Local Area Network) laid in a specific facility or building. The communication network 4 may include network devices such as a server device, a gateway device, and a router device that connect the various communication lines. Further, the communication network 4 may be composed of a plurality of communication lines.

  The display system 2 is configured using a LAN or the like installed in a building or the like. The display system 2 includes a wireless access point 3 that performs wireless communication, and a plurality of head-mounted display devices 100A and 100B. The wireless access point 3 is a communication device such as an access point or a router, and performs data communication between the head-mounted display device 100A and the head-mounted display device 100B, and the head-mounted display devices 100A and 100B. Relay data communication with the communication network 4.

  The head-mounted display device 100 </ b> A can execute data communication with another head-mounted display device 100 </ b> B via the wireless access point 3. The head-mounted display devices 100 </ b> A and 100 </ b> B execute data communication with the server 5 through the wireless access point 3. Each head-mounted display device 100A may directly perform wireless communication with another head-mounted display device 100B, for example, in an ad hoc mode. The head-mounted display devices 100A and 100B may be connected by a wired communication line. That is, the configuration of the display system 2 is not particularly limited as long as the head-mounted display device 100A can communicate with the head-mounted display device 100B. In addition, the communication system 1 may be configured to be able to communicate with the head-mounted display devices 100 </ b> A and 100 </ b> B included in the display system 2 and the server 5.

The third embodiment is an embodiment in which the head-mounted display device 100 described in the first and second embodiments is applied for industrial use. That is, the head-mounted display devices 100A and 100B can use the head-mounted display device 100 described in the first embodiment and / or the second embodiment, respectively.
In a factory where a plurality of devices are installed, a user wears the head-mounted display device 100 and works using the devices. At this time, the image display unit 20 of the head-mounted display device 100 displays work support information such as a manual for the device used by the user and precautions for using the device as display data. The display data may be provided by the server 5 to the head-mounted display device 100 or may be stored in the storage unit 120 of the head-mounted display device 100. Since the user can operate the device while visually recognizing work support information, the user can operate the device safely and reliably.
In addition, as work support information, an image in which another user is operating the device (hereinafter referred to as an operation image) can be used. A user who provides an operation image, for example, wears the head-mounted display device 100A and shoots the state of operating the device with the camera 61 of the head-mounted display device 100A. The head-mounted display device 100A transmits the operation image photographed by the camera 61 to the head-mounted display device 100B worn by the user who receives the operation image. A user of the head-mounted display device 100B can operate the device while visually recognizing an operation image displayed by the image display unit 20 of the head-mounted display device 100B. Accordingly, the device can be operated safely and reliably.
The operation image may be transmitted directly from the head-mounted display device 100A to the head-mounted display device 100B. Alternatively, the head-mounted display device 100A may upload to the server 5 and download an operation image registered in the server 5 to the head-mounted display device 100B.

The server 5 includes a control unit 6 including a CPU, ROM, RAM, and the like as hardware, and a storage unit 7. The storage unit 7 is a nonvolatile storage device, for example, a semiconductor memory such as a flash memory or an EEPROM, or a portable medium such as a flexible disk, a magnetic disk, a magneto-optical disk, a semiconductor storage device, a ROM, or a CD-ROM. Etc. can be used.
The storage unit 7 stores manuals, precautions, repair book data, operation images, and the like as display data to be displayed on the head-mounted display device 100. The repair document records check items for identifying the cause of the failure when the device has failed, a coping method according to the cause of the failure, and the like.
Further, the storage unit 7 stores system information transmitted from the head-mounted display device 100. The head-mounted display device 100 transmits system information to the server 5 and stores it in the server 5 when the remaining capacity of the first battery 131 decreases to a predetermined value or less.

FIG. 14 shows a management table stored in the storage unit 7.
In the management table, the device ID, account name, authentication information, progress information, and remaining battery capacity are registered. The device ID is information for identifying each head-mounted display device 100A, 100B. The account name is an account name set by a user who is permitted to use the head-mounted display device 100 indicated by the device ID. The authentication information is information such as a password for authenticating the user of the account name. The progress information is information indicating the progress of the work of the account name user. When a plurality of users use one head-mounted display device 100, a plurality of account names, authentication information, and progress information are registered in the same device ID.
The remaining battery capacity is the remaining capacity of the first battery 131 of the head-mounted display device 100 indicated by the device ID. The head-mounted display device 100 notifies the server 5 of the remaining capacity of the first battery 131 at a preset time interval. The server 5 registers the remaining capacity of the first battery 131 notified from the head-mounted display device 100 in the management table in association with the device ID.

FIG. 15 is a diagram illustrating a communication sequence between the head-mounted display device 100 and the server 5.
When the control unit 140 of the head-mounted display device 100 is activated when the power is turned on (step S101), the control unit 140 transmits a connection request (step S102) to the server 5 by wireless communication of the communication unit 117. When receiving the connection request from the head-mounted display device 100, the control unit 6 of the server 5 requests the head-mounted display device 100 to transmit authentication information, and authenticates the head-mounted display device 100 (step). S121). The head-mounted display device 100 transmits the account name, password, and device ID to the server 5 in response to a request from the server 5. The control unit 6 authenticates the user with the account name and password received from the head-mounted display device 100. When the user authentication is successful, the control unit 6 connects to the head-mounted display device 100 (steps S103 and S122).

Next, the power saving control unit 180 inputs the remaining capacity of the first battery 131 from the battery control unit 135 (step S104). When the remaining capacity of the first battery 131 input from the battery control unit 135 is larger than the specified value, the power saving control unit 180 transmits the remaining capacity of the first battery 131 to the server 5 (step S105). The control unit 6 stores the remaining capacity of the first battery 131 notified from the head-mounted display device 100 in the storage unit 7 in association with the device ID (step S123). If the remaining capacity of the first battery 131 input from the battery control unit 135 is equal to or less than the specified value, the power saving control unit 180 proceeds to the process of S111 described later.
The power saving control unit 180 transmits the input remaining capacity of the first battery 131 to the server 5 each time the remaining capacity of the first battery 131 is input from the battery control unit 135, and the first The remaining capacity of the battery 131 is updated.
Further, the power saving control unit 180 may transmit the remaining capacity of the first battery 131 to the server 5 even when the remaining capacity of the first battery 131 falls below a specified value.

  Next, the control unit 140 causes the camera 61 to perform shooting and performs marker detection from the captured image of the camera 61 (step S106). The marker is, for example, a one-dimensional code such as a barcode, a two-dimensional code such as a QR code (registered trademark), or any other marker that can be machine-recognized as an image. For example, the marker is attached to a work place such as a work desk or the vicinity thereof. Since the user needs to cause the camera 61 to photograph the marker or the like, the user is conscious of directing the image display unit 20 in the direction of the marker.

  The control unit 140 analyzes the captured image output from the camera 61 and executes marker detection. When detecting the marker, the control unit 140 transmits the data recorded in the detected marker to the server 5 by the communication unit 117 (step S107). The data recorded on the marker is, for example, information for identifying a device. When receiving data transmitted from the head-mounted display device 100 (step S124), the control unit 6 transmits display data corresponding to the received data to the head-mounted display device 100 (step S125).

  The control unit 140 receives the display data transmitted from the server 5 by the communication unit 117 (step S108) and causes the image display unit 20 to display the data (step S109). The user of the head-mounted display device 100 performs the work while visually recognizing the manual of the device that is the work target displayed on the image display unit 20, the precautions when operating the device, and the like. Thereby, errors in work can be reduced.

  When the user completes the work, the user of the head-mounted display device 100 inputs the work content of the finished work by operating the direction key 16 or the track pad 14 of the operation unit 111. The control unit 140 transmits the work content input by the operation unit 111 to the server 5 together with the user's account name. The control unit 6 receives the work content and the account name transmitted from the head-mounted display device 100, and stores them in the storage unit 7 in association with the account name (step S126).

  In addition, when the power saving control unit 180 detects that the remaining capacity of the first battery 131 input from the battery control unit 135 has decreased below a specified value (step S111), the power saving control unit 180 transmits system information to the server 5. Send a request. When the power saving control unit 180 receives information permitting transmission of system information from the server 5, the power saving control unit 180 transmits the system information to the server 5 (step S112). The control unit 6 stores the system information received from the head-mounted display device 100 in the storage unit 7 in association with the device ID (step S126). When the transmission of the system information to the server 5 is completed, the power saving control unit 180 shows steps S14 to S20 shown in FIG. 7 or steps S51 to S62 shown in FIG. 11, steps S31 to S36 shown in FIG. Processing similar to that in steps S71 to S75 is performed.

  When the power saving control unit 180 detects the replacement of the first battery 131 (step S113), the power saving control unit 180 determines whether or not the remaining capacity of the replaced first battery 131 is equal to or greater than a specified value. The power saving control unit 180 switches the battery that supplies power from the second battery 132 to the first battery 131 when the remaining capacity of the replaced first battery 131 is greater than or equal to a specified value. 135 is instructed. When the power source is switched from the second battery 132 to the first battery 131, the power saving control unit 180 transmits a system information acquisition request to the server 5 (step S114). When receiving the acquisition request (step S128), the control unit 6 transmits the system information of the corresponding device ID to the head-mounted display device 100 (step S129). Upon receiving the system information from the server 5 (step S115), the head-mounted display device 100 expands the received system information on a work memory such as a RAM and restores it (step S116). Thereafter, the control unit 140 executes processing based on the data expanded in the RAM. As a result, the head-mounted display device 100 returns to the state before the transition to the battery replacement mode. Thereafter, the head-mounted display device 100 and the server 5 end the processing of FIG. 15 and shift to a normal operation, that is, an operation for displaying work support information by the head-mounted display device 100.

In the process shown in FIG. 15, the configuration in which the system information is transmitted from the head-mounted display device 100 to the server 5 is exemplified. For example, the head-mounted display device 100A and the head-mounted display device 100B System information or the like may be transmitted / received between them. For example, when the head-mounted display device 100A transmits system information to the server 5 in step S112, the system information may also be transmitted to the head-mounted display device 100B.
In addition to the processing shown in FIG. 15, the head-mounted display devices 100A and 100B perform the shutdown sequence when the capacity of the first battery 131 and the second battery 132 decreases as described above. Information may be transmitted to another head-mounted display device 100. For example, when the head-mounted display device 100A executes a shutdown sequence, the control content performed by the control unit 140 before execution of the shutdown sequence, the content data that was output, information indicating the output portion of the content data, etc. May be transmitted to the head-mounted display device 100B. Here, the content data itself may be transmitted, or information indicating the content data may be transmitted. In this case, when one head-mounted display device 100 shuts down due to a decrease in the remaining battery level, the content data can be continuously output from the other head-mounted display devices 100. That is, another process can take over the process performed by the head-mounted display device 100. For example, it is assumed that the head-mounted display device 100 performs display and / or audio output based on content data for work instructions or work support in a factory. In this case, when the head-mounted display device 100 is shut down due to a decrease in the remaining battery level, the content data can be continuously output from the other head-mounted display devices 100. For this reason, when the remaining battery level of the head-mounted display device 100 is low, the worker can continue the work by replacing the head-mounted display device 100.

  Note that a work table for replacing the first battery 131 may be installed in the factory, and a device for supplying power to the second battery 132 may be provided on the work table. For example, the workbench is provided with a coil and a device for passing a current through the coil, and the second battery 132 is connected by coupling the magnetic flux generated in the coil to the coil provided in the head-mounted display device 100. Charge. In addition, a device that outputs radio waves used for charging the second battery 132 may be provided on the work table. Further, a resonance (resonance) circuit using a coil or a capacitor may be formed on the work table, and the second battery 132 may be charged by resonating an electric field or a magnetic field. When a solar cell is used as the second battery 132, the second battery 132 may be charged by factory lighting during the replacement operation of the first battery 131.

In addition, this invention is not restricted to the structure of said each embodiment, In the range which does not deviate from the summary, it can be implemented in a various aspect.
For example, in the above embodiment, the second battery 132 has been described as being configured to be accommodated in the battery accommodating portion 122 together with the first battery 131, but the present invention is not limited to this, and the second battery 132 is controlled. You may accommodate in the other position inside the apparatus 10. FIG. Further, the second battery 132 may be provided in the image display unit 20 or may be externally connected to the control device 10. In addition, the second battery 132 may be configured to be detachably connected by a connector, or may be configured to be fixedly connected to the battery control unit 135 and not easily detachable. In addition, the specific mounting form of the second battery 132 is arbitrary.

  In addition, for example, in each of the above embodiments, the power supply unit 300 has been described as a configuration including the first battery 131 and the second battery 132, but the present invention is not limited thereto, and includes three or more batteries. Also good. In addition, in the configuration in which the power supply unit 300 includes a plurality of batteries, a primary battery and a secondary battery may be mixed. In this case, a guidance display that prompts replacement according to the remaining amount of the primary battery is performed, and the secondary battery is displayed. A guidance display that prompts charging may be performed according to the remaining battery level. Moreover, it is good also as a structure which a user can set whether the display of AR display or an animation is required. In addition, the position where the first battery 131 and the second battery 132 are accommodated is not limited to the example of FIGS. For example, the power supply unit 300 may be configured separately from the control device 10. Further, the remaining amount display unit of the present invention is not limited to the LED display units 136 and 138, and for example, a liquid crystal display panel may be provided in the control device 10 to display the remaining amount, or the information display unit 402 of the image display unit 20. Alternatively, the remaining amount may be displayed in a form corresponding to the remaining amount display unit.

  Further, for example, instead of the image display unit 20, another type of image display unit such as an image display unit worn like a hat may be adopted, and an image is displayed corresponding to the left eye of the user. And a display unit that displays an image corresponding to the right eye of the user. The display device of the present invention may be configured as a head mounted display mounted on a vehicle such as an automobile or an airplane. Moreover, for example, it may be configured as a head-mounted display built in a body protective device such as a helmet, or may be a head-up display (HUD) used for a windshield of an automobile.

Furthermore, in the above embodiment, the image display unit 20 and the control device 10 are separated and connected by way of the connection unit 40, but the control device 10 and the image display unit 20 are integrated. It is also possible to be configured to be mounted on the user's head.
Further, when the control device 10 and the image display unit 20 are connected by a longer cable, a notebook computer, a tablet computer, or a desktop computer may be used as the control device 10. The control device 10 may be a game machine, a portable phone, a portable electronic device including a smartphone or a portable media player, other dedicated devices, or the like. Here, when the control device 10 has a display screen, the display screen included in the control device 10 may be stopped in the battery replacement mode. Further, in the battery replacement mode, any one or more of the display screens of the right display drive unit 22, the left display drive unit 24, and the control device 10 can be displayed and other displays can be stopped. Good.

  For example, as a configuration for generating image light in the image display unit 20, a configuration including an organic EL (Organic Electro-Luminescence) display and an organic EL control unit may be used. Further, as a configuration for generating image light, LCOS (Liquid crystal on silicon, LCoS is a registered trademark), a digital micromirror device, or the like can be used. Further, for example, the present invention can be applied to a laser retinal projection type head mounted display. That is, the image generation unit includes a laser light source and an optical system that guides the laser light source to the user's eye, makes the laser light enter the user's eye, scans the retina, and forms an image on the retina. A configuration that allows the user to visually recognize an image may be employed. When a laser retina projection type head-mounted display is employed, the “image light emitting area in the image light generation unit” can be defined as an image area recognized by the user's eyes.

  As an optical system that guides image light to the user's eyes, an optical member that transmits external light that is incident from the outside toward the apparatus and that enters the user's eyes together with the image light can be employed. Moreover, you may use the optical member which is located ahead of a user's eyes and overlaps a part or all of a user's visual field. Further, a scanning optical system that scans a laser beam or the like to obtain image light may be employed. Further, the optical member is not limited to guiding the image light inside the optical member, and may have only a function of guiding the image light by refracting and / or reflecting it toward the user's eyes.

  Further, the present invention can be applied to a display device that employs a scanning optical system using a MEMS mirror and uses MEMS display technology. That is, as an image display element, a signal light forming unit, a scanning optical system having a MEMS mirror that scans light emitted from the signal light forming unit, and an optical member on which a virtual image is formed by light scanned by the scanning optical system May be provided. In this configuration, the light emitted from the signal light forming unit is reflected by the MEMS mirror, enters the optical member, is guided through the optical member, and reaches the virtual image forming surface. When the MEMS mirror scans the light, a virtual image is formed on the virtual image forming surface, and the user recognizes the virtual image with the eyes, thereby recognizing the image. The optical component in this case may be one that guides light through a plurality of reflections, such as the right light guide plate 261 and the left light guide plate 262 of the above embodiment, and may use a half mirror surface. .

  The display device of the present invention is not limited to a head-mounted display device, and can be applied to various display devices such as a flat panel display and a projector. The display device of the present invention may be any device that allows an image to be visually recognized by external light and image light. For example, a configuration in which an image by image light is visually recognized by an optical member that transmits external light is exemplified. Specifically, the above-described head-mounted display includes an optical member that transmits external light, and a light-transmitting plane or curved surface that is fixedly or movably installed at a position away from the user ( The present invention can also be applied to a display device that projects image light onto glass, transparent plastic, or the like. As an example, a configuration of a display device that projects image light onto a window glass of a vehicle and allows a user who is on board or a user outside the vehicle to visually recognize the scenery inside and outside the vehicle together with an image by the image light. It is done. In addition, for example, image light is projected onto a transparent, semi-transparent, or colored transparent display surface that is fixedly installed such as a window glass of a building, and is displayed together with an image by the image light to a user around the display surface. A configuration of a display device that visually recognizes a scene through the surface can be given.

In addition, at least a part of each functional block shown in FIG. 2 may be realized by hardware, or may be realized by cooperation of hardware and software, as shown in FIG. It is not limited to a configuration in which independent hardware resources are arranged. The program executed by the control unit 140 may be stored in the storage unit 120 or the storage device in the control device 10, or the program stored in an external device is acquired via the communication unit 117 or the interface 125. It is good also as a structure to execute.
Further, the function of the program executed by the control unit 140, that is, each processing unit (for example, the image processing unit 160, the display control unit 170, the power saving control unit 180, the sound processing unit 190, or other generation unit provided in the control unit 140) , A determination unit, a specific unit, and the like) may be configured using an ASIC (Application Specific Integrated Circuit) or SoC (System on a Chip) designed to realize the function. Moreover, you may implement | achieve by programmable devices, such as FPGA (Field-Programmable Gate Array).
Moreover, only the operation part 111 among the structures formed in the control apparatus 10 may be formed as a single user interface (UI). Further, the configuration formed in the control device 10 may be formed in the image display unit 20 in an overlapping manner. For example, the control unit 140 illustrated in FIG. 2 may be formed in both the control device 10 and the image display unit 20, or the control unit 140 formed in the control device 10 and the CPU formed in the image display unit 20. The functions performed by and may be configured separately.

  DESCRIPTION OF SYMBOLS 1 ... Communication system, 2 ... Display system, 3 ... Wireless access point, 4 ... Communication network, 5 ... Server, 6 ... Control part, 7 ... Memory | storage part, 10 ... Control apparatus, 20 ... Image display part (display part), 21 ... Right holding unit, 22 ... Right display driving unit (second display unit), 23 ... Left holding unit, 24 ... Left display driving unit (first display unit), 25 ... Interface, 26 ... Right optical image display , 28 ... Left optical image display unit, 61 ... Camera, 63 ... Microphone, 100 ... Head-mounted display device (display device), 117 ... Communication unit, 120 ... Storage unit, 125 ... Interface, 131 ... First Battery (battery) 132 ... Second battery (battery) 133 ... First battery monitoring IC 134 ... Second battery monitoring IC 135 ... Battery control unit 136 ... LED display unit (remaining amount table) Part), 137 ... power supply part, 138 ... LED display part (remaining amount display part), 139 ... DC connector, 140 ... control part, 145 ... housing, 150 ... operating system, 160 ... image processing part, 170 ... display Control unit, 180 ... Power saving control unit (control unit), 190 ... Audio processing unit, 201 ... Right backlight control unit, 202 ... Left backlight control unit, 211 ... Right LCD control unit, 212 ... Left LCD control unit, 221 ... Right backlight, 222 ... Left backlight, 241 ... Right LCD, 242 ... Left LCD, 251 ... Right projection optical system, 252 ... Left projection optical system, 261 ... Right light guide plate, 262 ... Left light guide plate, 300 ... Power supply unit, 301 ... first power supply unit, 302 ... charging unit, 303 ... switching unit, 311 ... second power supply unit, 312 ... charging unit, 313 ... switching unit, 321 ... DC / DC converter -, 321A ... input terminal, 321B ... output terminal, 322 ... current detection unit, 323 ... sub-battery, 330 ... battery control unit, 331 ... CPU, 332 ... PMIC, 401 ... display area, 402 ... information display unit, 405 ... AR display section.

Claims (30)

A display device,
A display unit that allows the user to visually recognize the image and transmit the outside scene;
A first battery and a second battery;
A communication department;
A control unit for controlling the display unit and the communication unit,
The control unit can switch an operation mode of the display device between a normal operation mode and a battery replacement mode for replacing at least one of the first and second batteries. One of the first and second batteries is used as a power source, and the display device maintains a state where communication by the communication unit is possible.   The display device according to claim 1, wherein the control unit maintains power supply to the communication unit by the first and / or second battery in the battery replacement mode.   The control unit reduces power consumption of a supply destination that consumes power of the first and / or second battery in the battery replacement mode, and maintains power supply to the communication unit. The display device according to claim 2.   The control unit can perform control to switch a power source between the first battery and the second battery. When the power source is switched from the first battery to the second battery, an operation of the display device is performed. 4. The display device according to claim 2, wherein the mode is shifted from a normal operation mode to a battery replacement mode in which power consumption of the display unit and the communication unit is smaller than that of the normal operation mode. The display unit includes a first display unit that displays an image corresponding to the left eye of the user, and a second display unit that displays an image corresponding to the right eye of the user,
The display device according to claim 4, wherein the control unit stops display of either the first display unit or the second display unit in the battery replacement mode.   5. The control unit according to claim 4, wherein a frame rate of an image displayed on the display unit in the battery replacement mode is lower than a frame rate of an image displayed on the display unit in the normal operation mode. The display device described.   The display device according to claim 4, wherein the control unit makes a display area of the display unit in the battery replacement mode smaller than a display area of the display unit in the normal operation mode.   When the operation mode of the display device shifts from the battery replacement mode to the normal operation mode, the control unit allows the communication unit to start communication without performing authentication in the battery replacement mode. The display device according to any one of claims 4 to 7, wherein a communicable state is maintained.   9. The display device according to claim 8, wherein the control unit switches the operation state of the communication unit to a state in which power consumption of the communication unit is lower than that in the normal operation mode in the battery replacement mode. . A non-volatile storage unit;
When the control unit shifts to the battery replacement mode, the control unit stores data related to the operation of the control unit in the storage unit, and when the operation mode shifts from the battery replacement mode to the normal operation mode. 10. The display device according to claim 4, wherein processing based on the data stored in the storage unit is executed.   The said control part performs the display based on the remaining capacity of the said 1st battery after replacement | exchange at the said display part, when the said 1st battery is replaced | exchanged, The any one of Claim 4 to 10 characterized by the above-mentioned. The display device according to one item.   12. The control unit according to claim 4, wherein the control unit charges the second battery with electric power of the first battery when a remaining capacity of the first battery is equal to or greater than a threshold value. The display device according to any one of the above.   The control unit causes the display unit to display a display for prompting replacement of the first battery when a remaining capacity of the first battery is equal to or less than a threshold value. The display device according to any one of the above. A lid that opens and closes a battery accommodating portion that detachably accommodates the first battery;
An opening / closing detection unit for detecting opening / closing of the lid,
14. The control unit according to claim 4, wherein the control unit switches the power source from the first battery to the second battery when the opening / closing detection unit detects the opening of the lid. 15. The display device according to one item.   The said control part charges the said 2nd battery with the electric power of a said 1st battery after switching the said operation mode from the said battery exchange mode to the said normal operation mode, The said 2nd battery is characterized by the above-mentioned. The display device described.   When the control unit detects replacement of the first battery, when the remaining capacity of the first battery after replacement is equal to or higher than a preset reference value, the operation mode is changed to the normal operation mode. The display device according to claim 15, wherein the display device is switched.   The control unit executes an end sequence when the remaining capacity of the second battery satisfies a preset condition during execution of the battery replacement mode. The display device described.   18. The display device according to claim 17, wherein the control unit turns off the power after storing information related to the operation of the display device in the storage unit as the end sequence. The control unit changes the display mode of the display unit when the remaining capacity of the second battery falls below a preset first reference value during execution of the battery replacement mode. Change to a mode that reduces power consumption,
Executing the termination sequence when the remaining capacity of the second battery drops below a second reference value after changing the display mode to a mode for reducing power consumption of the display device; 19. A display device according to claim 17 or 18, characterized in that:   When the remaining capacity of the second battery drops below the first reference value during execution of the battery replacement mode, the control unit is based on the remaining capacity of the second battery on the display unit. The display device according to claim 19, wherein display is performed. The display unit includes a first display unit that displays an image corresponding to the left eye of the user, and a second display unit that displays an image corresponding to the right eye of the user,
21. The control unit according to claim 15, wherein the control unit stops display of either the first display unit or the second display unit in the battery replacement mode. Display device.   16. The control unit, wherein a frame rate of an image displayed on the display unit in the battery replacement mode is lower than a frame rate of an image displayed on the display unit in the normal operation mode. The display device according to any one of 21 to 21.   The control unit according to any one of claims 15 to 22, wherein the display area of the display unit in the battery replacement mode is smaller than the display area of the display unit in the normal operation mode. The display device described.   In the battery replacement mode, the control unit thins out image data to be displayed on the display unit and displays the data on the display unit, or instructs the display unit to thin out pixels used for display on the display unit. The display device according to any one of claims 15 to 23, wherein:   The display device according to any one of claims 15 to 24, wherein the control unit displays an image on a peripheral portion in a display area of the display unit in the battery replacement mode.   When the operation mode of the display device shifts from the battery replacement mode to the normal operation mode, the control unit allows the communication unit to start communication without performing authentication in the battery replacement mode. The display device according to any one of claims 15 to 25, wherein the communicable state is maintained.   27. The display device according to claim 26, wherein the control unit switches the operation state of the communication unit to a state in which power consumption of the communication unit is lower than the normal operation mode in the battery replacement mode. . A control method for a display device comprising a display unit that allows a user to visually recognize an image and transmit an outside scene, and a communication unit,
When the power supply of the display device is changed from the first battery to the second battery, the operation mode of the display device is changed from the normal operation mode, and the power consumption of the display unit and the communication unit is changed to the normal operation mode. To a smaller battery replacement mode,
A control method for a display device, wherein the communication unit is maintained in a communicable state in the battery replacement mode. A control method for a display device, comprising: a display unit that allows a user to visually recognize an image and transmits an outside scene; and a first battery and a second battery,
Switching the operation mode of the display device from a normal operation mode in which power is supplied by the first battery to a battery exchange mode in which power is supplied by the second battery;
Charging the second battery with the power of the first battery after switching the operation mode from the battery replacement mode to the normal operation mode;
A control method for a display device, comprising: A program that can be executed by a computer that controls a display device that includes a display unit that allows a user to visually recognize an image and transmits an outside scene, and a first battery and a second battery,
Computer
The operation mode of the display device is switched between a normal operation mode in which power is supplied from the first battery and a battery exchange mode in which power is supplied from the second battery.
A controller that charges the second battery with electric power of the first battery after switching the operation mode from the battery replacement mode to the normal operation mode;
Program to function as.

Images