KR101702373B1 - Head mounted display apparatus with high data rate wireless interface - Google Patents

Abstract

The present invention relates to an HMD that receives data from a data source device through a high-speed wireless communication interface and reproduces a stereoscopic image. The HMD includes an image control signal detector of an output or input port and a recognizer, Data is controlled by data, and is received and reproduced in real time in an uncompressed no-transfer protocol.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to an HMD (HMD)

The present invention relates to an HMD (head mounted display) device including a wireless interface having a high-speed wireless transmission function, and more particularly to an HMD (head mounted display) The present invention relates to an HMD that receives data through a high-speed wireless channel without using a complicated wireless transmission protocol regardless of an output port standard of a data source device using a wireless interface device having a function.

HMDs have been released, which allow users to enjoy visual contents of smart devices by stereoscopic images or virtual reality by attaching them to their heads through connection with smart devices. It is necessary to have a technology that makes it easier and easier to use interworking with smart devices .

As a conventional technique, Patent Document 1 relates to a video system composed of a mobile terminal capable of communicating with an HMD, and a method of implementing a stereoscopic image using orientation direction information of the HMD is proposed. The wireless communication between the HMD and the mobile terminal uses a short distance communication technology such as Bluetooth, RFID, infrared communication, UWB, and ZigBee. However, due to the limitation of the transmission bandwidth, the short-range communication channel has a limitation in transmitting large-capacity contents such as a high-quality image in the mobile terminal to the HMD in real time.

Patent Document 2 aims to improve the ease of detachment and comfort by improving the structure of the HMD. However, there is a limitation of the transmission bandwidth using the short-range communication channel.

Since the use of HMD is intended to enjoy or execute stereoscopic images with high-definition images, virtual exercises using virtual reality techniques, and games, techniques for real-time transmission and playback of large-volume contents are indispensable. Also, at the same time, the wireless communication should be smooth so as not to limit the user's activity, and the HMD which is continuously attached to the head during the content reproduction time needs to be implemented light and small.

When using short-range wireless communication technology such as WiFi, a data signal must be processed according to a protocol. For this purpose, data must be compressed, packetized and transmitted. In the HMD, a codec process for storing a data packet in a memory and extracting a signal is required. In order to speed up the codec, a high-speed coder and a decoder are required, and a high-speed mobile processor such as an ARM processor must be applied. Such a high-speed circuit consumes a large amount of power, .

Wireless technologies that transmit gigabit include MIMO technology using the 2GHz / 5GHz band and beamforming technology using the 60GHz band, all of which consume a few tens of watts of power and require a large battery for long-term use.

In addition, the process of data buffering applied for decompressing due to compression transmission of data has a disadvantage that the image is cut off. When receiving high-quality image data, the received signal is buffered in the memory and the original image frames are reconstructed. If the amount of buffered data exceeds the memory capacity during the process, image deterioration and image quality deteriorate. In the process of compressing and decompressing, there is a delay of more than 0.3 second, which limits the realization of real time image using HMD.

When the HMD receives the content through WiFi or WiGig, it takes more than 10 seconds to pair the data source device transmitting the content with the HMD, which is inconvenient for each connection.

Devices such as smart phones, tablet PCs, notebooks, cameras and camcorders have wired output ports that output signals to the outside, so they can be wired to the HMD. Data transmission through wireless connection is required to avoid activity limitation due to wired connection. There is restriction on free usage of HMD because device has different interface specification or wireless connection function.

1. Korean Patent Publication No. 2011-0080915 (published on July 13, 2011) 2. Korean Patent Publication No. 2014-0105319 (published on September 01, 2014)

SUMMARY OF THE INVENTION In order to solve the above problems, the present invention provides an HMD including a wireless interface device for transmitting high-quality large-capacity data in a non-compressed manner without using a complicated wireless transmission protocol.

Also, a technique for transmitting a large amount of content data to an HMD through high-speed wireless communication regardless of an interface standard between all the data source devices and the HMD is provided.

According to an aspect of the present invention, there is provided a head-mounted display device including a wireless interface having a high-speed wireless transmission function, including a first broadband wireless adapter connected to a video data output port of a data source device, And an embedded second broadband wireless adapter,

The first broadband wireless adapter includes a first image control signal detecting unit for detecting an image control signal at a video data output port of the data source device and generating video signal control data, a multiplexer for mixing and multiplexing the video data and the control data, And a first wireless communication unit wirelessly transmitting the neutralized data signal to a single channel,

The second broadband wireless adapter includes a second wireless communication unit for receiving a data signal from the first wireless communication unit, a demultiplexer for separating the received data signal from the video data and the control data, And a video control signal recognizing unit for wirelessly transmitting and receiving the data signal in a single channel in an uncompressed manner without using a transmission protocol regardless of the interface specification of the data source device.

Another embodiment of the present invention includes a third broadband wireless adapter coupled to the video data output port of the data source device and a fourth broadband wireless adapter embedded in the HMD,

The third broadband wireless adapter includes a second video control signal detecting unit for detecting an image control signal at a video data output port of the data source device and generating video signal control data, a first high-speed wireless communication unit for wirelessly transmitting video data, And a first low-speed wireless communication unit wirelessly transmitting data,

The fourth broadband wireless adapter comprises:

A second high-speed wireless communication unit for wirelessly receiving the image data through the first high-speed wireless communication unit; a second low-speed wireless communication unit for wirelessly receiving the control data; And data signals are wirelessly transmitted and received in two channels in an uncompressed manner without using a transmission protocol regardless of the interface specification of the data source device,

And the first wireless communication unit or the first low-speed wireless communication unit switches transmission and reception with a switch.

And the image control signal is an MHL or MyDP interface signal.

Wherein the HDMI-to-MHL converter or the HDMI-to-MyDP converter is further used when the video data output port of the data source device or the input port of the HMD is an HDMI port.

The HDMI-to-MHL converter or the HDMI-to-MyDP converter may be built in any one of the first to fourth broadband wireless adapters or a combination thereof and can be selected by a switch.

When the video data output port of the data source device or the input port of the HMD is a DP port, the DP data is defined as 1-lane of MyDP.

The HMD having the wireless interface of the high-speed wireless transmission function according to the present invention supports high-speed wireless communication regardless of the interface specification of the data source device such as a smart phone, a smart pad, a tablet, a digital camera, You can enjoy the stereoscopic feeling by immersing the high quality image in real time.

In addition, the high-speed wireless channel connection using the millimeter wave frequency such as the 60 GHz band simplifies the connection between the data source device and the HMD, and frees the user from restriction on the distance and position between the devices.

In addition, a wireless communication method that does not use a protocol does not require troublesome setting for wireless transmission and reception, and can be conveniently used without requiring a pairing time of several tens of seconds.

In addition, low-power operation can increase battery life, reduce the weight of the HMD itself, and be free to operate.

1 is a conceptual diagram of an HMD including a wireless interface having a high-speed wireless transmission function according to the present invention.
FIG. 2 shows an embodiment using a single high-speed wireless channel according to the present invention.
3 is an embodiment using two channels according to the present invention.
4 is a block diagram of a wireless communication unit for a smart device output port using two channels according to the present invention.
5 is a block diagram of a wireless communication unit for HMD input using two channels according to the present invention.
6 is an internal block diagram of an HMD main body and a smart device according to the present invention.
7 is a software stack of a smart device for controlling an HMD according to the present invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. The drawings illustrate only the essential features for the sake of clarity of the invention and are not to be construed as limiting the drawings.

In the present invention, expressions such as the first and second expressions are used for expressing elements differently and do not have numerical or special meaning.

In the present invention, a data source device refers to a device that provides video or audio information, and a smart device refers to a device such as a smart phone that can communicate among data source devices and executes various applications.

FIG. 1 is a conceptual diagram of an HMD including a wireless interface having a high-speed wireless transmission function according to the present invention. In order to transmit a data signal from the smart device to the HMD at a high speed, a first broadband wireless adapter And a second broadband wireless adapter connected to a wired connection terminal of the HMD or embedded in the HMD.

The wired connection terminal of the smart device may be a USB port, a mobile high-definition link (MHL) port, a mobility display port (MyDP), a high-definition multimedia interface (HDMI), a display port (DP) And the connection terminal of the HMD may be a USB port, MHL / MyDP, SDI (serial data output), HDMI, or DP.

In the present invention, the connection terminal of the HMD may be a built-in MHL / MyDP port or a second broadband wireless adapter connected to the HMD / MyDP port by wire.

The first and second broadband wireless adapters may be in the form of a dongle utilizing a gigabit high speed wireless transmission technology using a sub-terahertz wave having a frequency band of 30 to 300 GHz or a millimeter wave of 100 GHz to 1 THz And a module type in which an RF module is integrated.

The broadband wireless adapter converts the image data output from the output port of the smart device into a wireless signal without packetizing without compression, and transmits the wireless signal to the HMD main body through a high-speed wireless channel. The wireless signal of the transmitted video data does not use the protocol. The HMD main body receives and displays video and audio data (hereinafter referred to as " video data ") through a wireless communication unit. At this time, since the HMD does not need to perform a complicated restoration process such as depacketizing or decompressing the received image data, it is possible to reproduce the image data with low power consumption.

FIG. 2 illustrates an embodiment of displaying image data of a smart device over a single high-speed wireless channel using the HMD according to the present invention. In a single channel wireless transmission, a first broadband wireless adapter connected to an output port of a smart device includes a connector, a controller, an image control signal detector, a high-speed multiplexer, and a first wireless communication unit. The second broadband wireless adapter on the HMD input port side may include a second wireless communication unit, a high-speed demultiplexer, a first clock signal recognition unit, a signal conversion unit, and a control unit.

The connector is a physical connection terminal that connects to the output port of the smart device.

The first image control signal detecting unit detects whether the interface of the smart device is the MHL or the MyDP, and transmits the control data to the HMD. There is a common mode clock in MHL and there is no common mode clock in MyDP.

The high-speed multiplexer mixes and multiplexes image data and control data for transmission over a single wireless channel. The multiplexing method can be multiplexed by time division (TDM) or frequency division (FDM).

The first wireless communication unit wirelessly transmits data multiplexed on a single channel through an antenna. The first wireless communication unit is composed of a transmitter / receiver and a switch, and the video data is transmitted to the HMD in one direction and the control data is transmitted / received in both directions.

When transmitting the image data of the smart mobile device through the high speed multiplexer, the transmitter is enabled. When receiving the control data from the HMD, the control data is switched to the receiver side and the received control data is transmitted to the CBUS C-wire) to control the smart device.

The second wireless communication unit wirelessly receives multiplexed data through a single channel through an antenna. The second wireless communication unit is composed of a transmitter / receiver and a switch. The video data is received by the receiver, and the control data transmitted from the control unit of the HMD is transmitted to the first broadband wireless adapter through the transmitter.

The first clock signal recognizer recognizes whether the signal received from the control data transmitted by the first broadband wireless adapter is an MHL signal or a MyDP signal, and automatically converts the received signal into a signal converted by the HMD signal converter, and transmits the converted signal to the display.

The demultiplexer separates the video data and the control data. The separated image data is transmitted to the signal converting unit, and the control data is connected to CBUS and used as a control signal.

As described above, since the present invention does not use a transmission protocol, there is no need to packetize data, and there is an advantage that a data signal can be wirelessly transmitted in a non-compressed manner irrespective of an interface standard of a smart device.

FIG. 3 shows an embodiment of two-channel transmission in which video data according to the present invention is transmitted on a high-speed wireless channel and control data is transmitted on a low-rate wireless channel. The second wireless broadband adapter connected to the output port of the smart device in the two-channel transmission includes a connector, a control unit, a second image control signal detection unit, a first high-speed wireless communication unit, and a first low-speed wireless communication unit. The input port of the HMD includes a second high-speed wireless communication unit, a second low-speed wireless communication unit, a second clock signal recognition unit, and a signal conversion unit built in the HMD.

The connector is a physical connection terminal that connects to the output port of the smart device.

The second image control signal detecting unit detects whether the interface of the smart device is MHL or MyDP, and transmits the control data to the HMD. There is a common mode clock in MHL and there is no common mode clock in MyDP.

4 is a block diagram of a wireless communication unit of a second wireless broadband adapter using two channels, in which the first high-speed wireless communication unit only transmits video data to a transmitter and the first low-speed wireless communication unit comprises a transmitter, It transmits / receives control data of CBL of MHL or C-wire of My DP. The control data includes an image control signal, a user event signal, sensor information, and communication control information.

The first low-speed communication unit may be Bluetooth, Zigbee, WiFi, IrDA, or the like.

The second clock signal recognizing unit recognizes whether the signal received from the control data transmitted by the second broadband wireless adapter is an MHL signal or a MyDP signal, and automatically converts the received signal into a signal converted by the HMD signal converter, and transmits the converted signal to the display.

FIG. 5 is a block diagram of a wireless communication unit on the HMD input side using two channels. The second high-speed wireless communication unit only has a function of receiving image data by a receiver, and the second low-speed wireless communication unit includes a transmitter, a receiver, and a switch. Among the control data, the image control signal detected from the clock detecting unit is recognized by the clock recognizing unit and input to the C-wire of the CBUS or My DP of the MHL. Among the control data, the user event signal, sensor information, and communication control information are inputted to the control unit of the HMD and controlled.

Among the control data, the user event signal is a user input signal such as a touch signal by placing an input device of the HMD, and the user event signal can be sent to the smart device to control the function of the smart phone.

Among the control data, the sensor information signal is a signal for recognizing movement of a person by putting a sensor in the HMD body or recognizing the surrounding environment, so that the HMD display can display the image in the best state. The sensor information signal is a signal for automatically recognizing the user's surroundings by incorporating various sensors in the HMD body, and the sensor information signal can be sent to the smart device to control the smart device.

Among the control data, the communication control information signal is a control signal that supports the data source device and the wireless interface of the HMD to optimize the wireless channel to send the image to the HMD body.

The signal conversion unit converts the image data into RGB video and audio signals, and transmits the converted image to display and audio.

2-channel wireless transmission has a disadvantage in that a low-speed channel is required in addition to a high-speed channel, but there is an advantage that a clock data recovery circuit (CDR) of a receiver requiring a single-channel high-speed wireless transmission is unnecessary. In high-speed wireless transmission, the CDR needs to operate at high speed, which consumes a lot of power. Therefore, it is possible to implement the same function without using a high-speed circuit to implement in a single channel while using a low-speed channel, thereby reducing power consumption and realizing low-cost implementation.

The HMD may include an event input unit such as a joystick, a touch board, and a keyboard for user's operation and control convenience. Also, it includes a sensor for acceleration, a magnetic field, an iris recognition, a face recognition, and a controller for processing sensor information, event information, and control signals or generating a control signal.

The connector of the first or second wireless broadband adapter may be coupled to a connection jack or a bridge gable that matches the standard of the output port of the data source device and the level of the output signal.

The HMD of the present invention is advantageous in that it can be applied to various data source devices by using the first or second wireless broadband adapter in a data source device having no wireless communication function.

In the case of a data source device conforming to the DP or HDMI standard, a method of applying the HMD of the present invention is as follows.

When the output port of the data source device is DP, the data of DP is defined as 1 lane of MyDP and outputted. The following procedure is the same as the transmission of image data according to the MyDP standard.

When the output port of the data source device is HDMI, a bridge having an HDMI-to-MHL converter or an HDMI-to-MyDP converter function is connected between the data source device and the first or second wireless broadband adapter, Converts the image data into image data conforming to the MHL or MyDP standard, and wirelessly transmits the image data.

In another embodiment of the present invention, an HDMI-to-MHL converter or an HDMI-to-MyDP converter is embedded in the first or second wireless broadband adapter, It can be selected by the converter. To-MHD converter or an HDMI-to-MyDP converter when the video data output port of the data source device is an HDMI port, and otherwise switches off the HDMI-to-MHL converter or the HDMI- (off).

7 is a software block diagram of a smart device for controlling an HMD. Control data such as image control information, user event information, sensor information, and communication control information can be appropriately processed in a smart device, which is a kind of data source device. The structure of the software to be executed for the control data processing in the smart device includes a communication control information processing device driver, a sensor information processing device driver, a user input event processing device driver, a video signal control information processing device driver , The smart device middleware is connected to the middleware except for the communication control information processing device driver and supports the optimal image transmission through the HMD application.

Claims (8)

An HMD (head mounted display) device having a single channel wireless communication function including a first broadband wireless adapter connected to a video data output port of a data source device and a second broadband wireless adapter embedded in the HMD,
Wherein the first broadband wireless adapter comprises:
A first image control signal detecting unit for recognizing an image control signal based on a common mode clock signal at a video data output port of a data source device to generate image signal control data;
A multiplexer for multiplexing and multiplexing image data and control data, and
And a first wireless communication unit for wirelessly transmitting the multiplexed data signal on a single channel,
Wherein the second broadband wireless adapter comprises:
A second wireless communication unit for receiving a data signal from the first wireless communication unit;
A demultiplexer for separating the received data signal from the video data and the control data,
And a video control signal recognizing unit for recognizing a video control signal among the control data,
And wirelessly transmits and receives the data signal in a single channel in an uncompressed manner without using a transmission protocol regardless of the interface specification of the data source device. An HMD device having a two-channel wireless communication function including a third broadband wireless adapter connected to a video data output port of a data source device and a fourth broadband wireless adapter embedded in the HMD,
The third broadband wireless adapter includes:
A second image control signal detector for generating image signal control data by recognizing an image control signal based on a common mode clock signal at a video data output port of a data source device;
A first high-speed wireless communication unit wirelessly transmitting image data;
And a first low-speed wireless communication unit for wirelessly transmitting the control data,
The fourth broadband wireless adapter comprises:
A second high-speed wireless communication unit wirelessly receiving the image data through the first high-speed wireless communication unit;
A second low-speed wireless communication unit for wirelessly receiving the control data;
And a video control signal recognizing unit for recognizing a video control signal among the received control data,
And transmits and receives the data signal in two channels in an uncompressed manner without using a transmission protocol regardless of the interface specification of the data source device. The method according to claim 1,
Wherein the first wireless communication unit switches transmission and reception with a switch. 3. The method of claim 2,
Wherein the first low-speed wireless communication unit switches transmission and reception with a switch. 3. The method according to claim 1 or 2,
Wherein the image control signal is an MHL or MyDP interface signal. 3. The method according to claim 1 or 2,
Wherein the HDMI-to-MHL converter or the HDMI-to-MyDP converter is additionally used when the video data output port of the data source device or the input port of the HMD is an HDMI port. The method according to claim 6,
Wherein the HDMI-to-MHL converter or the HDMI-to-MyDP converter is built in any one or combination of the first to fourth broadband wireless adapters and can be selected as a switch. 3. The method according to claim 1 or 2,
Wherein the DP data is defined as 1-lane of MyDP when the image data output port of the data source device or the input port of the HMD is a DP port.

Images