US20170309233A1 - Display including liquid crystal layer with organic light emitting diode backlight - Google Patents
Display including liquid crystal layer with organic light emitting diode backlight Download PDFInfo
- Publication number
- US20170309233A1 US20170309233A1 US15/492,959 US201715492959A US2017309233A1 US 20170309233 A1 US20170309233 A1 US 20170309233A1 US 201715492959 A US201715492959 A US 201715492959A US 2017309233 A1 US2017309233 A1 US 2017309233A1
- Authority
- US
- United States
- Prior art keywords
- liquid crystal
- display device
- oled backlight
- oled
- backlight
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
- G09G3/3406—Control of illumination source
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
- G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells
- G02F1/133—Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
- G02F1/1333—Constructional arrangements; Manufacturing methods
- G02F1/1335—Structural association of cells with optical devices, e.g. polarisers or reflectors
- G02F1/1336—Illuminating devices
- G02F1/133602—Direct backlight
- G02F1/133603—Direct backlight with LEDs
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
- G09G3/003—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to produce spatial visual effects
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
- G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells
- G02F1/133—Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
- G02F1/1333—Constructional arrangements; Manufacturing methods
- G02F1/1335—Structural association of cells with optical devices, e.g. polarisers or reflectors
- G02F1/1336—Illuminating devices
- G02F1/133601—Illuminating devices for spatial active dimming
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F2202/00—Materials and properties
- G02F2202/02—Materials and properties organic material
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2310/00—Command of the display device
- G09G2310/08—Details of timing specific for flat panels, other than clock recovery
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/02—Improving the quality of display appearance
- G09G2320/0233—Improving the luminance or brightness uniformity across the screen
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/06—Adjustment of display parameters
- G09G2320/0693—Calibration of display systems
Definitions
- the present disclosure generally relates to a display device including a liquid crystal (LC) layer with an organic light emitting diode (OLED) display as a backlight.
- LC liquid crystal
- OLED organic light emitting diode
- An LCD includes a backlight and a liquid crystal (LC) layer disposed on the backlight.
- the backlight constantly projects light towards the LC layer, and the LC layer including a plurality of LCs controls an amount of the light passing through according to states of the plurality of LCs.
- a simple architecture of the LCD allows a flat screen to be implemented in low cost.
- the LCD suffers from a few drawbacks.
- changing states of the LCs may take several milliseconds (ms), thereby limiting a response time of the LCD or preventing an increase in the frame rate (e.g., 90 Hz or higher).
- ms milliseconds
- images are generated according to a user's movement, and a slow response time may be noticed as latency or a lag.
- continuously projected light from the backlight may cause a motion blur or image streaking, when images are displayed with a fast frame rate.
- Example embodiments of disclosed configurations include a display device with a liquid crystal layer and an OLED backlight.
- the liquid crystal display includes a liquid crystal layer including a plurality of liquid crystals grouped into a plurality of liquid crystal portions, and the OLED backlight coupled to the liquid crystal layer.
- the OLED backlight includes a plurality of OLED backlight portions, where each OLED backlight portion faces a corresponding liquid crystal portion and is configured to project light towards the corresponding liquid crystal portion.
- the OLED backlight includes passive matrix OLEDs.
- the OLED backlight includes white color OLEDs.
- a resolution of the OLED is lower than a resolution of the liquid crystal layer.
- each OLED backlight portion projects the light towards the corresponding liquid crystal portion during a corresponding time period.
- the liquid crystal display device disclosed herein may be implemented in a head mounted display device.
- the head mounted display device includes a body, a position sensor and a liquid crystal display device.
- the position sensor is coupled to the body and detects an orientation of the head mounted display device.
- the liquid crystal display device is coupled to the body and displays an image according to the orientation of the head mounted display device.
- the head mounted display device may display an image of a virtual reality, an augmented reality, or both, according to the user's movement.
- FIG. 1 is a block diagram of a system environment including a virtual reality (VR)/augmented reality (AR) system, in accordance with an embodiment.
- VR virtual reality
- AR augmented reality
- FIG. 2A is a diagram of a VR/AR headset, in accordance with an embodiment.
- FIG. 2B is a cross section of a front rigid body of the VR/AR headset in FIG. 2A , in accordance with an embodiment.
- FIG. 3 is an exploded view of an example electronic display including a LC layer with an OLED backlight, in accordance with an embodiment.
- FIG. 4 is a timing diagram of operation of the example electronic display of FIG. 3 , in accordance with an embodiment.
- Example embodiments of disclosed configurations include a display device with a LC layer and an OLED backlight.
- the OLED backlight is an OLED display that can be controlled to selectively illuminate a portion of the OLED display.
- the LC layer is segmented into a plurality of liquid crystal portions, and a portion of the OLED backlight corresponding to a liquid crystal portion can be selectively controlled to illuminate light. While a portion of the OLED backlight is on, the remaining portion of the OLED backlight may be turned off.
- (i) programming and transitioning of a state of a liquid crystal in a liquid crystal portion and (ii) illuminating a portion of the OLED backlight corresponding to the liquid crystal portion can occur in an alternating sequence.
- a first liquid crystal portion can be programmed and a state of a liquid crystal in the first liquid crystal portion can be transitioned according to the programming during a first time period.
- a second time period after the first time period a first portion of the OLED backlight corresponding to the first liquid crystal portion can be illuminated, while a second liquid crystal portion can be programmed and a state of a liquid crystal in the second liquid crystal portion can be transitioned according to the programming.
- latency involved for programming a portion of the liquid crystal layer, and illuminating light can be reduced.
- Programming a liquid crystal herein refers to applying electric signals (e.g., voltage or current) to cause the liquid crystal to be placed in a desired state.
- electric signals e.g., voltage or current
- a display including a LC layer and an OLED backlight disclosed herein can be implemented in a VR/AR system.
- a user wears a head mounted display that presents an image of a VR/AR to the user, according to a physical movement of the user. For example, if a user turns his/her head to the left, a corresponding image of the virtual image is presented to the user, according to the user motion.
- generating the image according to the user movement involves a complex processing that accompanies with a delay between the user movement and the image presented.
- the user may perceive a feeling of “lag” or a noticeable delay between the user movement and the image presented.
- high quality images e.g., 1080 by 720 pixels or higher
- the VR/AR can be presented to the user without a noticeable lag.
- FIG. 1 is a block diagram of a VR/AR system 100 in which a VR/AR console 110 operates.
- the system 100 shown by FIG. 1 comprises a VR/AR headset 105 , an imaging device 135 , and a VR/AR input interface 140 that are each coupled to the VR/AR console 110 .
- FIG. 1 shows an example system 100 including one VR/AR headset 105 , one imaging device 135 , and one VR/AR input interface 140 , in other embodiments any number of these components may be included in the system 100 .
- VR/AR headsets 105 each having an associated VR/AR input interface 140 and being monitored by one or more imaging devices 135 , with each VR/AR headset 105 , VR/AR input interface 140 , and imaging devices 135 communicating with the VR/AR console 110 .
- imaging devices 135 may be included in the system 100 .
- the VR/AR headset 105 is a head-mounted display that presents media to a user. Examples of media presented by the VR/AR head set include one or more images, video, audio, or some combination thereof. In some embodiments, audio is presented via an external device (e.g., speakers and/or headphones) that receives audio information from the VR/AR headset 105 , the VR/AR console 110 , or both, and presents audio data based on the audio information.
- An embodiment of the VR/AR headset 105 is further described below in conjunction with FIGS. 2A and 2B .
- the VR/AR headset 105 may comprise one or more rigid bodies, which may be rigidly or non-rigidly coupled to each other together. A rigid coupling between rigid bodies causes the coupled rigid bodies to act as a single rigid entity. In contrast, a non-rigid coupling between rigid bodies allows the rigid bodies to move relative to each other.
- the VR/AR headset 105 includes an electronic display 115 , an optics block 118 , one or more locators 120 , one or more position sensors 125 , and an inertial measurement unit (IMU) 130 .
- the electronic display 115 displays images to the user in accordance with data received from the VR/AR console 110 .
- the electronic display 115 may comprise a single electronic display or multiple electronic displays (e.g., an electronic display for each eye of a user).
- the electronic display 115 may be a combination of a liquid crystal display (LCD), and an organic light emitting diode (OLED) display as described in detail with respect to FIG. 3 below.
- the optics block 118 magnifies received light from the electronic display 115 , corrects optical errors associated with the image light, and the corrected image light is presented to a user of the VR/AR headset 105 .
- An optical element may be an aperture, a Fresnel lens, a convex lens, a concave lens, a filter, or any other suitable optical element that affects the image light emitted from the electronic display 115 .
- the optics block 118 may include combinations of different optical elements.
- one or more of the optical elements in the optics block 118 may have one or more coatings, such as anti-reflective coatings.
- Magnification of the image light by the optics block 118 allows the electronic display 115 to be physically smaller, weigh less, and consume less power than larger displays. Additionally, magnification may increase a field of view of the displayed media. For example, the field of view of the displayed media is such that the displayed media is presented using almost all (e.g., 110 degrees diagonal), and in some cases all, of the user's field of view.
- the optics block 118 is designed so its effective focal length is larger than the spacing to the electronic display 115 , which magnifies the image light projected by the electronic display 115 . Additionally, in some embodiments, the amount of magnification may be adjusted by adding or removing optical elements.
- the optics block 118 may be designed to correct one or more types of optical error.
- optical error include: two dimensional optical errors, three dimensional optical errors, or some combination thereof.
- Two dimensional errors are optical aberrations that occur in two dimensions.
- Example types of two dimensional errors include: barrel distortion, pincushion distortion, longitudinal chromatic aberration, transverse chromatic aberration, or any other type of two-dimensional optical error.
- Three dimensional errors are optical errors that occur in three dimensions.
- Example types of three dimensional errors include spherical aberration, comatic aberration, field curvature, astigmatism, or any other type of three-dimensional optical error.
- content provided to the electronic display 115 for display is pre-distorted, and the optics block 118 corrects the distortion when it receives image light from the electronic display 115 generated based on the content.
- the locators 120 are objects located in specific positions on the VR/AR headset 105 relative to one another and relative to a specific reference point on the VR/AR headset 105 .
- a locator 120 may be a light emitting diode (LED), a corner cube reflector, a reflective marker, a type of light source that contrasts with an environment in which the VR/AR headset 105 operates, or some combination thereof.
- LED light emitting diode
- corner cube reflector a corner cube reflector
- a reflective marker a type of light source that contrasts with an environment in which the VR/AR headset 105 operates, or some combination thereof.
- the locators 120 may emit light in the visible band ( ⁇ 380 nm to 750 nm), in the infrared (IR) band ( ⁇ 750 nm to 1 mm), in the ultraviolet band (10 nm to 380 nm), some other portion of the electromagnetic spectrum, or some combination thereof.
- the visible band ⁇ 380 nm to 750 nm
- the infrared (IR) band ⁇ 750 nm to 1 mm
- the ultraviolet band 10 nm to 380 nm
- the locators 120 are located beneath an outer surface of the VR/AR headset 105 , which is transparent to the wavelengths of light emitted or reflected by the locators 120 or is thin enough not to substantially attenuate the wavelengths of light emitted or reflected by the locators 120 . Additionally, in some embodiments, the outer surface or other portions of the VR/AR headset 105 are opaque in the visible band of wavelengths of light. Thus, the locators 120 may emit light in the IR band under an outer surface that is transparent in the IR band but opaque in the visible band.
- the IMU 130 is an electronic device that generates fast calibration data based on measurement signals received from one or more of the position sensors 125 .
- a position sensor 125 generates one or more measurement signals in response to motion of the VR/AR headset 105 .
- Examples of position sensors 125 include: one or more accelerometers, one or more gyroscopes, one or more magnetometers, another suitable type of sensor that detects motion, a type of sensor used for error correction of the IMU 130 , or some combination thereof.
- the position sensors 125 may be located external to the IMU 130 , internal to the IMU 130 , or some combination thereof.
- the IMU 130 Based on the one or more measurement signals from one or more position sensors 125 , the IMU 130 generates fast calibration data indicating an estimated position of the VR/AR headset 105 relative to an initial position of the VR/AR headset 105 .
- the position sensors 125 include multiple accelerometers to measure translational motion (forward/back, up/down, left/right) and multiple gyroscopes to measure rotational motion (e.g., pitch, yaw, roll).
- the IMU 130 rapidly samples the measurement signals and calculates the estimated position of the VR/AR headset 105 from the sampled data.
- the IMU 130 integrates the measurement signals received from the accelerometers over time to estimate a velocity vector and integrates the velocity vector over time to determine an estimated position of a reference point on the VR/AR headset 105 .
- the IMU 130 provides the sampled measurement signals to the VR/AR console 110 , which determines the fast calibration data.
- the reference point is a point that may be used to describe the position of the VR/AR headset 105 . While the reference point may generally be defined as a point in space; however, in practice the reference point is defined as a point within the VR/AR headset 105 (e.g., a center of the IMU 130 ).
- the IMU 130 receives one or more calibration parameters from the VR/AR console 110 . As further discussed below, the one or more calibration parameters are used to maintain tracking of the VR/AR headset 105 . Based on a received calibration parameter, the IMU 130 may adjust one or more IMU parameters (e.g., sample rate). In some embodiments, certain calibration parameters cause the IMU 130 to update an initial position of the reference point so it corresponds to a next calibrated position of the reference point. Updating the initial position of the reference point as the next calibrated position of the reference point helps reduce accumulated error associated with the determined estimated position. The accumulated error, also referred to as drift error, causes the estimated position of the reference point to “drift” away from the actual position of the reference point over time.
- drift error causes the estimated position of the reference point to “drift” away from the actual position of the reference point over time.
- the imaging device 135 generates slow calibration data in accordance with calibration parameters received from the VR/AR console 110 .
- Slow calibration data includes one or more images showing observed positions of the locators 120 that are detectable by the imaging device 135 .
- the imaging device 135 may include one or more cameras, one or more video cameras, any other device capable of capturing images including one or more of the locators 120 , or some combination thereof. Additionally, the imaging device 135 may include one or more filters (e.g., used to increase signal to noise ratio).
- the imaging device 135 is configured to detect light emitted or reflected from locators 120 in a field of view of the imaging device 135 .
- the imaging device 135 may include a light source that illuminates some or all of the locators 120 , which retro-reflect the light towards the light source in the imaging device 135 .
- Slow calibration data is communicated from the imaging device 135 to the VR/AR console 110 , and the imaging device 135 receives one or more calibration parameters from the VR/AR console 110 to adjust one or more imaging parameters (e.g., focal length, focus, frame rate, ISO, sensor temperature, shutter speed, aperture, etc.).
- the VR/AR input interface 140 is a device that allows a user to send action requests to the VR/AR console 110 .
- An action request is a request to perform a particular action.
- an action request may be to start or end an application or to perform a particular action within the application.
- the VR/AR input interface 140 may include one or more input devices.
- Example input devices include: a keyboard, a mouse, a game controller, or any other suitable device for receiving action requests and communicating the received action requests to the VR/AR console 110 .
- An action request received by the VR/AR input interface 140 is communicated to the VR/AR console 110 , which performs an action corresponding to the action request.
- the VR/AR input interface 140 may provide haptic feedback to the user in accordance with instructions received from the VR/AR console 110 .
- haptic feedback is provided when an action request is received, or the VR/AR console 110 communicates instructions to the VR/AR input interface 140 causing the VR/AR input interface 140 to generate haptic feedback when the VR/AR console 110 performs an action.
- the VR/AR console 110 provides media to the VR/AR headset 105 for presentation to the user in accordance with information received from one or more of: the imaging device 135 , the VR/AR headset 105 , and the VR/AR input interface 140 .
- the VR/AR console 110 includes an application store 145 , a tracking module 150 , and a VR/AR engine 155 .
- Some embodiments of the VR/AR console 110 have different modules than those described in conjunction with FIG. 1 .
- the functions further described below may be distributed among components of the VR/AR console 110 in a different manner than is described here.
- the application store 145 stores one or more applications for execution by the VR/AR console 110 .
- An application is a group of instructions, that when executed by a processor, generates content for presentation to the user. Content generated by an application may be in response to inputs received from the user via movement of the VR/AR headset 105 or the VR/AR input interface 140 . Examples of applications include: gaming applications, conferencing applications, video playback application, or other suitable applications.
- the tracking module 150 calibrates the VR/AR system 100 using one or more calibration parameters and may adjust one or more calibration parameters to reduce error in determination of the position of the VR/AR headset 105 . For example, the tracking module 150 adjusts the focus of the imaging device 135 to obtain a more accurate position for observed locators on the VR/AR headset 105 . Moreover, calibration performed by the tracking module 150 also accounts for information received from the IMU 130 . Additionally, if tracking of the VR/AR headset 105 is lost (e.g., the imaging device 135 loses line of sight of at least a threshold number of the locators 120 ), the tracking module 150 re-calibrates some or all of the system 100 .
- the tracking module 150 re-calibrates some or all of the system 100 .
- the tracking module 150 tracks movements of the VR/AR headset 105 using slow calibration information from the imaging device 135 .
- the tracking module 150 determines positions of a reference point of the VR/AR headset 105 using observed locators from the slow calibration information and a model of the VR/AR headset 105 .
- the tracking module 150 also determines positions of a reference point of the VR/AR headset 105 using position information from the fast calibration information. Additionally, in some embodiments, the tracking module 150 may use portions of the fast calibration information, the slow calibration information, or some combination thereof, to predict a future location of the headset 105 .
- the tracking module 150 provides the estimated or predicted future position of the VR/AR headset 105 to the VR/AR engine 155 .
- the VR/AR engine 155 executes applications within the system 100 and receives position information, acceleration information, velocity information, predicted future positions, or some combination thereof of the VR/AR headset 105 from the tracking module 150 . Based on the received information, the VR/AR engine 155 determines content to provide to the VR/AR headset 105 for presentation to the user. For example, if the received information indicates that the user has looked to the left, the VR/AR engine 155 generates content for the VR/AR headset 105 that mirrors the user's movement in a virtual environment. Additionally, the VR/AR engine 155 performs an action within an application executing on the VR/AR console 110 in response to an action request received from the VR/AR input interface 140 and provides feedback to the user that the action was performed. The provided feedback may be visual or audible feedback via the VR/AR headset 105 or haptic feedback via the VR/AR input interface 140 .
- FIG. 2A is a diagram of a VR/AR headset, in accordance with an embodiment.
- the VR/AR headset 200 is an embodiment of the VR/AR headset 105 , and includes a front rigid body 205 and a band 210 .
- the front rigid body 205 includes an electronic display 115 , the IMU 130 , the one or more position sensors 125 , and the locators 120 .
- the position sensors 125 are located within the IMU 130 , and neither the IMU 130 nor the position sensors 125 are visible to the user.
- the locators 120 are located in fixed positions on the front rigid body 205 relative to one another and relative to a reference point 215 .
- the reference point 215 is located at the center of the IMU 130 .
- Each of the locators 120 emit light that is detectable by the imaging device 135 .
- Locators 120 or portions of locators 120 , are located on a front side 220 A, a top side 220 B, a bottom side 220 C, a right side 220 D, and a left side 220 E of the front rigid body 205 in the example of FIG. 2A .
- FIG. 2B is a cross section 225 of the front rigid body 205 of the embodiment of a VR/AR headset 200 shown in FIG. 2A .
- the front rigid body 205 includes an optical block 230 that provides altered image light to an exit pupil 250 .
- the exit pupil 250 is the location of the front rigid body 205 where a user's eye 245 is positioned.
- FIG. 2B shows a cross section 225 associated with a single eye 245 , but another optical block, separate from the optical block 230 , provides altered image light to another eye of the user.
- the optical block 230 includes an electronic display 115 , and the optics block 118 .
- the electronic display 115 emits image light toward the optics block 118 .
- the optics block 118 magnifies the image light, and in some embodiments, also corrects for one or more additional optical errors (e.g., distortion, astigmatism, etc.).
- the optics block 118 directs the image light to the exit pupil 250 for presentation to the user.
- FIG. 3 is an exploded view of an example electronic display 115 including a LC layer 300 , an OLED backlight 350 , and a data driver 370 , in accordance with an embodiment.
- the data driver 370 generates a backlight control signal and a liquid crystal control signal for displaying an image.
- the OLED backlight 350 illuminates light towards the liquid crystal layer 300 according to the backlight control signal, and the liquid crystal layer 300 controls an amount and location of light passing through the liquid crystal layer 300 towards the exit pupil 250 in a direction 310 according to the liquid crystal control signal.
- a boundary of the liquid crystal layer 300 and a boundary of the OLED backlight 350 may be mechanically coupled to each other through a spacer (not shown).
- a space between the liquid crystal layer 300 and the OLED backlight 350 may be vacuum or filled with transparent material.
- the electronic display 115 includes different, more or fewer components than shown in FIG. 3 .
- the OLED backlight 350 is an OLED display that is programmable to emit light in a selected portion of the OLED display. In one embodiment, the OLED backlight 350 is controlled in a binary manner to emit or not emit light in a selected portion.
- the OLED backlight 350 can be implemented as a passive matrix OLED (PMOLED) display having a simple control scheme without storage capacitors for a low cost implementation.
- the OLED backlight 350 can be implemented as an active matrix OLED (AMOLED) display, or other types of light emitting components, in which a selected portion can be controlled for emitting or not emitting light.
- the OLED backlight 350 is segmented into backlight portions BL 1 , BL 2 . . . BL 6 .
- the OLED backlight portions BL 1 , BL 2 . . . BL 6 are arranged in a row direction in a manner that a bottom side of an OLED backlight portion BL is coupled to a top side of its adjacent backlight portion BL (e.g., a bottom side of the OLED backlight portion BL 1 is coupled to a top side of the OLED backlight portion BL 2 ).
- each backlight portion of the OLED backlight 350 may not have a rectangular bar shape that stretches along a width of the display. Instead, each backlight portion may have one or more rectangular shapes or other shapes smaller than the width of the display that form a regular or irregular tiled pattern behind the LC layer 300 . This enables local dimming (improved LCD contrast) in addition to the fast, flexible addressing in a thin package compared to conventional LED backlights.
- a selected backlight portion illuminates light toward the liquid crystal layer 300 in the direction 310 , while remaining portions do not.
- brightness of an OLED is much lower than a traditional backlight of a LC display (e.g., a light guide with LED light source).
- pixel size of the OLED backlight 350 can be larger than pixels of the LC layer 300 (i.e., a resolution of the OLED backlight 350 is lower than a resolution of the LC layer 300 ), where light from a single pixel of the OLED backlight 350 may be projected to two or more pixels of the LC layer 300 .
- a brightness enhanced film (BEF) may be disposed on the OLED backlight 350 or on the LC layer 300 to further improve brightness.
- the OLED backlight 350 may include only white OLEDs, with a color filter on the LC layer 300 .
- RGB OLEDs can be implemented in the OLED backlight 350 without the color filter to improve color gamut or spatially homogenize colors.
- the liquid crystal layer 300 receives a liquid crystal control signal from the data driver 370 , and passes light from the OLED backlight 350 towards the exit pupil in the direction 310 , according to the liquid crystal control signal.
- the liquid crystal control signal is a signal indicative of an amount of light passing through the liquid crystal layer 300 for different pixels of the liquid crystal layer 300 .
- the liquid crystal layer 300 includes a plurality of liquid crystals corresponding to a plurality of pixels, and configurations of the liquid crystals can be changed according to the liquid crystal control signal applied across electrodes of the liquid crystal layer 300 .
- the liquid crystal layer 300 is programmed in units of a plurality of segmented liquid crystal portions LC 1 , LC 2 . . . LC 6 .
- each of the liquid crystal portions LC 1 , LC 2 . . . LC 6 corresponds to a respective one of the OLED backlight portions BL 1 , BL 2 . . . BL 6 , and faces a corresponding OLED backlight portion.
- Each liquid crystal portion may encompass multiple rows of pixels.
- the liquid crystal layer 300 in FIG. 3 is segmented into six liquid crystal portions, in other examples, the liquid crystal layer 300 can include a different number of segmented liquid crystal portions. In other examples, two or more of the liquid crystal portions may correspond to and overlap with a single OLED backlight portion.
- the data driver 370 is a circuit component that receives an input image data, and generates control signals for driving the liquid crystal layer 300 and the OLED backlight 350 .
- the input image data may correspond to an image or a frame of a video in a virtual reality and/or augmented reality application transmitted from the VR/AR console 110 .
- the data driver 370 generates the backlight control signal for controlling intensity of light output by the OLED backlight 350 , according to the input image data.
- the data driver 370 generates the liquid crystal control signal for controlling an amount of light from the OLED backlight 350 traveling towards the exit pupil 250 through the liquid crystal layer 300 .
- the data driver 370 provides the backlight control signal to the OLED backlight 350 , and the liquid crystal control signal to the liquid crystal layer 300 at a proper timing to display a single image.
- the OLED backlight 350 operates as a programmable backlight of a conventional LC display device.
- the OLED display e.g., PMOLED or AMOLED display
- a selected portion of the OLED backlight 350 can be controlled to emit light in a flexible sequence (e.g., from top to bottom or from center to edges).
- FIG. 4 is a timing diagram of operation of the example electronic display of FIG. 3 , in accordance with an embodiment.
- the data driver 370 applies a liquid crystal control signal to cause programming of liquid crystals during programming time periods 410 A, 420 A . . . 460 A, and liquid crystal state transitioning during liquid crystal transition time periods 410 B, 420 B . . . 460 B.
- the data driver 370 applies a backlight control signal to the OLED backlight 350 to illuminate light during backlight illumination time periods 410 C, 420 C . . . 426 C for displaying an image for a frame time 400 (e.g., 11 ms).
- (i) programming and transitioning of states of liquid crystals in a liquid crystal portion LC and (ii) illuminating a corresponding backlight portion BL can occur in an alternating sequence.
- the liquid crystal portion LC 1 is programmed during a programming time period 410 A at T 1 .
- states of liquid crystals in the liquid crystal portion LC 1 are transitioned during a liquid crystal transition time period 410 B at T 2 .
- the backlight portion BL 1 illuminates light during a backlight illumination time period 410 C at T 3 .
- the liquid crystal portion LC 2 While the states of the liquid crystals in the liquid crystal portion LC 1 are in transition, the liquid crystal portion LC 2 is programmed during a programming time period 420 A at T 2 . In addition, states of liquid crystals in the liquid crystal portion LC 2 are transitioned during the liquid crystal transition time period 420 B at T 3 , while the backlight portion BL 1 illuminates light. After the states of the liquid crystals in the liquid crystal portion LC 2 are transitioned, the backlight portion BL 2 illuminates light during a backlight illumination time period 420 C at T 4 .
- the last liquid crystal portion (e.g., LC 6 ) is programmed during a programming time period 460 A at TN of the frame time 400 .
- a frame time 400 herein refers to time duration between starting times of two image frames (i.e., starting times of programming LC 1 of two image frames). States of liquid crystals in the last liquid crystal portion LC 6 are transitioned during a liquid crystal transition time period 460 B, while the liquid crystal portion LC 1 is programmed during the programming time period 410 A′ at T 1 of the next frame time 400 ′.
- the last backlight portion (e.g., BL 6 ) illuminates light during a backlight illumination time period 460 C, while states of liquid crystals in the liquid crystal portion LC 1 are in transition during the liquid crystal transition time period 410 B′ at T 2 of the next frame time 400 ′. Accordingly, a portion of an image corresponding to the last liquid crystal portion and the last backlight portion (e.g., LC 6 and BL 6 ) is displayed, while states of liquid crystals in the first liquid crystal portion LC 1 are in transition for displaying a subsequent image.
- state transitions occur automatically after programming, thus time periods 410 B, 420 B . . . 460 B for transitioning states of liquid crystals may be omitted.
- time periods for programming liquid crystals and transitioning states of the liquid crystals can be combined into a single time period.
- the liquid crystal layer 300 by segmenting the liquid crystal layer 300 and selectively illuminating a portion of the OLED backlight 350 as shown in FIG. 3 , and displaying an image as shown in FIG. 4 , latency involved for programming a portion of the liquid crystal layer and illuminating light can be reduced.
- additional time can be allocated for programming and transitioning states of liquid crystals for a given frame time by segmenting the liquid crystal layer, and sequentially programming and illuminating light according to one or more embodiments disclosed herein.
- a portion (e.g., last crystal portion) of a display projects a portion of an image frame, while another portion of the display is being programmed or is being configured for displaying another portion of a subsequent image frame, causing a delay of the portion of the image frame displayed.
- a user experiencing a virtual reality or an augmented reality is less likely to focus on the last crystal portion, and such delay of the portion of the image frame displayed may be unnoticeable.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Nonlinear Science (AREA)
- Computer Hardware Design (AREA)
- Mathematical Physics (AREA)
- Chemical & Material Sciences (AREA)
- Crystallography & Structural Chemistry (AREA)
- Optics & Photonics (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
Abstract
Description
- This application claims priority to and the benefit of U.S. Provisional Patent Application No. 62/325,864 filed on Apr. 21, 2016, which is incorporated herein by reference in its entirety.
- The present disclosure generally relates to a display device including a liquid crystal (LC) layer with an organic light emitting diode (OLED) display as a backlight.
- Developments in a flat screen display technology have prompted proliferation of various electronic devices. Among various types of flat screen displays, an LCD is widely used in different electronic devices. An LCD includes a backlight and a liquid crystal (LC) layer disposed on the backlight. Typically, the backlight constantly projects light towards the LC layer, and the LC layer including a plurality of LCs controls an amount of the light passing through according to states of the plurality of LCs. A simple architecture of the LCD allows a flat screen to be implemented in low cost.
- However, the LCD suffers from a few drawbacks. In one example, changing states of the LCs may take several milliseconds (ms), thereby limiting a response time of the LCD or preventing an increase in the frame rate (e.g., 90 Hz or higher). For virtual reality (VR) or augmented reality (AR) applications, images are generated according to a user's movement, and a slow response time may be noticed as latency or a lag. Moreover, continuously projected light from the backlight may cause a motion blur or image streaking, when images are displayed with a fast frame rate.
- Example embodiments of disclosed configurations include a display device with a liquid crystal layer and an OLED backlight. In one or more embodiments, the liquid crystal display includes a liquid crystal layer including a plurality of liquid crystals grouped into a plurality of liquid crystal portions, and the OLED backlight coupled to the liquid crystal layer. The OLED backlight includes a plurality of OLED backlight portions, where each OLED backlight portion faces a corresponding liquid crystal portion and is configured to project light towards the corresponding liquid crystal portion.
- In one or more embodiments, the OLED backlight includes passive matrix OLEDs.
- In one or more embodiments, the OLED backlight includes white color OLEDs.
- In one or more embodiments, a resolution of the OLED is lower than a resolution of the liquid crystal layer.
- In one or more embodiments, each OLED backlight portion projects the light towards the corresponding liquid crystal portion during a corresponding time period.
- In one or more embodiments, the liquid crystal display device disclosed herein may be implemented in a head mounted display device. The head mounted display device includes a body, a position sensor and a liquid crystal display device. The position sensor is coupled to the body and detects an orientation of the head mounted display device. The liquid crystal display device is coupled to the body and displays an image according to the orientation of the head mounted display device. The head mounted display device may display an image of a virtual reality, an augmented reality, or both, according to the user's movement.
-
FIG. 1 is a block diagram of a system environment including a virtual reality (VR)/augmented reality (AR) system, in accordance with an embodiment. -
FIG. 2A is a diagram of a VR/AR headset, in accordance with an embodiment. -
FIG. 2B is a cross section of a front rigid body of the VR/AR headset inFIG. 2A , in accordance with an embodiment. -
FIG. 3 is an exploded view of an example electronic display including a LC layer with an OLED backlight, in accordance with an embodiment. -
FIG. 4 is a timing diagram of operation of the example electronic display ofFIG. 3 , in accordance with an embodiment. - The figures depict embodiments of the present disclosure for purposes of illustration only. One skilled in the art will readily recognize from the following description that alternative embodiments of the structures and methods illustrated herein may be employed without departing from the principles, or benefits touted, of the disclosure described herein.
- Example embodiments of disclosed configurations include a display device with a LC layer and an OLED backlight. The OLED backlight is an OLED display that can be controlled to selectively illuminate a portion of the OLED display. The LC layer is segmented into a plurality of liquid crystal portions, and a portion of the OLED backlight corresponding to a liquid crystal portion can be selectively controlled to illuminate light. While a portion of the OLED backlight is on, the remaining portion of the OLED backlight may be turned off.
- In one or more embodiments, (i) programming and transitioning of a state of a liquid crystal in a liquid crystal portion and (ii) illuminating a portion of the OLED backlight corresponding to the liquid crystal portion can occur in an alternating sequence. Specifically, a first liquid crystal portion can be programmed and a state of a liquid crystal in the first liquid crystal portion can be transitioned according to the programming during a first time period. During a second time period after the first time period, a first portion of the OLED backlight corresponding to the first liquid crystal portion can be illuminated, while a second liquid crystal portion can be programmed and a state of a liquid crystal in the second liquid crystal portion can be transitioned according to the programming. As a result, latency involved for programming a portion of the liquid crystal layer, and illuminating light can be reduced.
- Programming a liquid crystal herein refers to applying electric signals (e.g., voltage or current) to cause the liquid crystal to be placed in a desired state.
- In one application, a display including a LC layer and an OLED backlight disclosed herein can be implemented in a VR/AR system. In a VR/AR system, a user wears a head mounted display that presents an image of a VR/AR to the user, according to a physical movement of the user. For example, if a user turns his/her head to the left, a corresponding image of the virtual image is presented to the user, according to the user motion. However, generating the image according to the user movement involves a complex processing that accompanies with a delay between the user movement and the image presented. In case the user moves faster than the delay associated with presenting the image according to the user movement, the user may perceive a feeling of “lag” or a noticeable delay between the user movement and the image presented. By implementing the disclosed display with a liquid crystal layer and the OLED backlight, high quality images (e.g., 1080 by 720 pixels or higher) of the VR/AR can be presented to the user without a noticeable lag.
-
FIG. 1 is a block diagram of a VR/AR system 100 in which a VR/AR console 110 operates. Thesystem 100 shown byFIG. 1 comprises a VR/AR headset 105, an imaging device 135, and a VR/AR input interface 140 that are each coupled to the VR/AR console 110. WhileFIG. 1 shows anexample system 100 including one VR/AR headset 105, one imaging device 135, and one VR/AR input interface 140, in other embodiments any number of these components may be included in thesystem 100. For example, there may be multiple VR/AR headsets 105 each having an associated VR/AR input interface 140 and being monitored by one or more imaging devices 135, with each VR/AR headset 105, VR/AR input interface 140, and imaging devices 135 communicating with the VR/AR console 110. In alternative configurations, different and/or additional components may be included in thesystem 100. - The VR/
AR headset 105 is a head-mounted display that presents media to a user. Examples of media presented by the VR/AR head set include one or more images, video, audio, or some combination thereof. In some embodiments, audio is presented via an external device (e.g., speakers and/or headphones) that receives audio information from the VR/AR headset 105, the VR/AR console 110, or both, and presents audio data based on the audio information. An embodiment of the VR/AR headset 105 is further described below in conjunction withFIGS. 2A and 2B . The VR/AR headset 105 may comprise one or more rigid bodies, which may be rigidly or non-rigidly coupled to each other together. A rigid coupling between rigid bodies causes the coupled rigid bodies to act as a single rigid entity. In contrast, a non-rigid coupling between rigid bodies allows the rigid bodies to move relative to each other. - The VR/
AR headset 105 includes anelectronic display 115, anoptics block 118, one ormore locators 120, one ormore position sensors 125, and an inertial measurement unit (IMU) 130. Theelectronic display 115 displays images to the user in accordance with data received from the VR/AR console 110. In various embodiments, theelectronic display 115 may comprise a single electronic display or multiple electronic displays (e.g., an electronic display for each eye of a user). Theelectronic display 115 may be a combination of a liquid crystal display (LCD), and an organic light emitting diode (OLED) display as described in detail with respect toFIG. 3 below. - The optics block 118 magnifies received light from the
electronic display 115, corrects optical errors associated with the image light, and the corrected image light is presented to a user of the VR/AR headset 105. An optical element may be an aperture, a Fresnel lens, a convex lens, a concave lens, a filter, or any other suitable optical element that affects the image light emitted from theelectronic display 115. Moreover, the optics block 118 may include combinations of different optical elements. In some embodiments, one or more of the optical elements in the optics block 118 may have one or more coatings, such as anti-reflective coatings. - Magnification of the image light by the optics block 118 allows the
electronic display 115 to be physically smaller, weigh less, and consume less power than larger displays. Additionally, magnification may increase a field of view of the displayed media. For example, the field of view of the displayed media is such that the displayed media is presented using almost all (e.g., 110 degrees diagonal), and in some cases all, of the user's field of view. In some embodiments, the optics block 118 is designed so its effective focal length is larger than the spacing to theelectronic display 115, which magnifies the image light projected by theelectronic display 115. Additionally, in some embodiments, the amount of magnification may be adjusted by adding or removing optical elements. - The optics block 118 may be designed to correct one or more types of optical error. Examples of optical error include: two dimensional optical errors, three dimensional optical errors, or some combination thereof. Two dimensional errors are optical aberrations that occur in two dimensions. Example types of two dimensional errors include: barrel distortion, pincushion distortion, longitudinal chromatic aberration, transverse chromatic aberration, or any other type of two-dimensional optical error. Three dimensional errors are optical errors that occur in three dimensions. Example types of three dimensional errors include spherical aberration, comatic aberration, field curvature, astigmatism, or any other type of three-dimensional optical error. In some embodiments, content provided to the
electronic display 115 for display is pre-distorted, and the optics block 118 corrects the distortion when it receives image light from theelectronic display 115 generated based on the content. - The
locators 120 are objects located in specific positions on the VR/AR headset 105 relative to one another and relative to a specific reference point on the VR/AR headset 105. Alocator 120 may be a light emitting diode (LED), a corner cube reflector, a reflective marker, a type of light source that contrasts with an environment in which the VR/AR headset 105 operates, or some combination thereof. In embodiments where thelocators 120 are active (i.e., an LED or other type of light emitting device), thelocators 120 may emit light in the visible band (˜380 nm to 750 nm), in the infrared (IR) band (˜750 nm to 1 mm), in the ultraviolet band (10 nm to 380 nm), some other portion of the electromagnetic spectrum, or some combination thereof. - In some embodiments, the
locators 120 are located beneath an outer surface of the VR/AR headset 105, which is transparent to the wavelengths of light emitted or reflected by thelocators 120 or is thin enough not to substantially attenuate the wavelengths of light emitted or reflected by thelocators 120. Additionally, in some embodiments, the outer surface or other portions of the VR/AR headset 105 are opaque in the visible band of wavelengths of light. Thus, thelocators 120 may emit light in the IR band under an outer surface that is transparent in the IR band but opaque in the visible band. - The
IMU 130 is an electronic device that generates fast calibration data based on measurement signals received from one or more of theposition sensors 125. Aposition sensor 125 generates one or more measurement signals in response to motion of the VR/AR headset 105. Examples ofposition sensors 125 include: one or more accelerometers, one or more gyroscopes, one or more magnetometers, another suitable type of sensor that detects motion, a type of sensor used for error correction of theIMU 130, or some combination thereof. Theposition sensors 125 may be located external to theIMU 130, internal to theIMU 130, or some combination thereof. - Based on the one or more measurement signals from one or
more position sensors 125, theIMU 130 generates fast calibration data indicating an estimated position of the VR/AR headset 105 relative to an initial position of the VR/AR headset 105. For example, theposition sensors 125 include multiple accelerometers to measure translational motion (forward/back, up/down, left/right) and multiple gyroscopes to measure rotational motion (e.g., pitch, yaw, roll). In some embodiments, theIMU 130 rapidly samples the measurement signals and calculates the estimated position of the VR/AR headset 105 from the sampled data. For example, theIMU 130 integrates the measurement signals received from the accelerometers over time to estimate a velocity vector and integrates the velocity vector over time to determine an estimated position of a reference point on the VR/AR headset 105. Alternatively, theIMU 130 provides the sampled measurement signals to the VR/AR console 110, which determines the fast calibration data. The reference point is a point that may be used to describe the position of the VR/AR headset 105. While the reference point may generally be defined as a point in space; however, in practice the reference point is defined as a point within the VR/AR headset 105 (e.g., a center of the IMU 130). - The
IMU 130 receives one or more calibration parameters from the VR/AR console 110. As further discussed below, the one or more calibration parameters are used to maintain tracking of the VR/AR headset 105. Based on a received calibration parameter, theIMU 130 may adjust one or more IMU parameters (e.g., sample rate). In some embodiments, certain calibration parameters cause theIMU 130 to update an initial position of the reference point so it corresponds to a next calibrated position of the reference point. Updating the initial position of the reference point as the next calibrated position of the reference point helps reduce accumulated error associated with the determined estimated position. The accumulated error, also referred to as drift error, causes the estimated position of the reference point to “drift” away from the actual position of the reference point over time. - The imaging device 135 generates slow calibration data in accordance with calibration parameters received from the VR/
AR console 110. Slow calibration data includes one or more images showing observed positions of thelocators 120 that are detectable by the imaging device 135. The imaging device 135 may include one or more cameras, one or more video cameras, any other device capable of capturing images including one or more of thelocators 120, or some combination thereof. Additionally, the imaging device 135 may include one or more filters (e.g., used to increase signal to noise ratio). The imaging device 135 is configured to detect light emitted or reflected fromlocators 120 in a field of view of the imaging device 135. In embodiments where thelocators 120 include passive elements (e.g., a retroreflector), the imaging device 135 may include a light source that illuminates some or all of thelocators 120, which retro-reflect the light towards the light source in the imaging device 135. Slow calibration data is communicated from the imaging device 135 to the VR/AR console 110, and the imaging device 135 receives one or more calibration parameters from the VR/AR console 110 to adjust one or more imaging parameters (e.g., focal length, focus, frame rate, ISO, sensor temperature, shutter speed, aperture, etc.). - The VR/
AR input interface 140 is a device that allows a user to send action requests to the VR/AR console 110. An action request is a request to perform a particular action. For example, an action request may be to start or end an application or to perform a particular action within the application. The VR/AR input interface 140 may include one or more input devices. Example input devices include: a keyboard, a mouse, a game controller, or any other suitable device for receiving action requests and communicating the received action requests to the VR/AR console 110. An action request received by the VR/AR input interface 140 is communicated to the VR/AR console 110, which performs an action corresponding to the action request. In some embodiments, the VR/AR input interface 140 may provide haptic feedback to the user in accordance with instructions received from the VR/AR console 110. For example, haptic feedback is provided when an action request is received, or the VR/AR console 110 communicates instructions to the VR/AR input interface 140 causing the VR/AR input interface 140 to generate haptic feedback when the VR/AR console 110 performs an action. - The VR/
AR console 110 provides media to the VR/AR headset 105 for presentation to the user in accordance with information received from one or more of: the imaging device 135, the VR/AR headset 105, and the VR/AR input interface 140. In the example shown inFIG. 1 , the VR/AR console 110 includes anapplication store 145, atracking module 150, and a VR/AR engine 155. Some embodiments of the VR/AR console 110 have different modules than those described in conjunction withFIG. 1 . Similarly, the functions further described below may be distributed among components of the VR/AR console 110 in a different manner than is described here. - The
application store 145 stores one or more applications for execution by the VR/AR console 110. An application is a group of instructions, that when executed by a processor, generates content for presentation to the user. Content generated by an application may be in response to inputs received from the user via movement of the VR/AR headset 105 or the VR/AR input interface 140. Examples of applications include: gaming applications, conferencing applications, video playback application, or other suitable applications. - The
tracking module 150 calibrates the VR/AR system 100 using one or more calibration parameters and may adjust one or more calibration parameters to reduce error in determination of the position of the VR/AR headset 105. For example, thetracking module 150 adjusts the focus of the imaging device 135 to obtain a more accurate position for observed locators on the VR/AR headset 105. Moreover, calibration performed by thetracking module 150 also accounts for information received from theIMU 130. Additionally, if tracking of the VR/AR headset 105 is lost (e.g., the imaging device 135 loses line of sight of at least a threshold number of the locators 120), thetracking module 150 re-calibrates some or all of thesystem 100. - The
tracking module 150 tracks movements of the VR/AR headset 105 using slow calibration information from the imaging device 135. Thetracking module 150 determines positions of a reference point of the VR/AR headset 105 using observed locators from the slow calibration information and a model of the VR/AR headset 105. Thetracking module 150 also determines positions of a reference point of the VR/AR headset 105 using position information from the fast calibration information. Additionally, in some embodiments, thetracking module 150 may use portions of the fast calibration information, the slow calibration information, or some combination thereof, to predict a future location of theheadset 105. Thetracking module 150 provides the estimated or predicted future position of the VR/AR headset 105 to the VR/AR engine 155. - The VR/
AR engine 155 executes applications within thesystem 100 and receives position information, acceleration information, velocity information, predicted future positions, or some combination thereof of the VR/AR headset 105 from thetracking module 150. Based on the received information, the VR/AR engine 155 determines content to provide to the VR/AR headset 105 for presentation to the user. For example, if the received information indicates that the user has looked to the left, the VR/AR engine 155 generates content for the VR/AR headset 105 that mirrors the user's movement in a virtual environment. Additionally, the VR/AR engine 155 performs an action within an application executing on the VR/AR console 110 in response to an action request received from the VR/AR input interface 140 and provides feedback to the user that the action was performed. The provided feedback may be visual or audible feedback via the VR/AR headset 105 or haptic feedback via the VR/AR input interface 140. -
FIG. 2A is a diagram of a VR/AR headset, in accordance with an embodiment. The VR/AR headset 200 is an embodiment of the VR/AR headset 105, and includes a frontrigid body 205 and aband 210. The frontrigid body 205 includes anelectronic display 115, theIMU 130, the one ormore position sensors 125, and thelocators 120. In the embodiment shown byFIG. 2A , theposition sensors 125 are located within theIMU 130, and neither theIMU 130 nor theposition sensors 125 are visible to the user. - The
locators 120 are located in fixed positions on the frontrigid body 205 relative to one another and relative to areference point 215. In the example ofFIG. 2A , thereference point 215 is located at the center of theIMU 130. Each of thelocators 120 emit light that is detectable by the imaging device 135.Locators 120, or portions oflocators 120, are located on afront side 220A, a top side 220B, abottom side 220C, aright side 220D, and aleft side 220E of the frontrigid body 205 in the example ofFIG. 2A . -
FIG. 2B is across section 225 of the frontrigid body 205 of the embodiment of a VR/AR headset 200 shown inFIG. 2A . As shown inFIG. 2B , the frontrigid body 205 includes anoptical block 230 that provides altered image light to anexit pupil 250. Theexit pupil 250 is the location of the frontrigid body 205 where a user'seye 245 is positioned. For purposes of illustration,FIG. 2B shows across section 225 associated with asingle eye 245, but another optical block, separate from theoptical block 230, provides altered image light to another eye of the user. - The
optical block 230 includes anelectronic display 115, and the optics block 118. Theelectronic display 115 emits image light toward the optics block 118. The optics block 118 magnifies the image light, and in some embodiments, also corrects for one or more additional optical errors (e.g., distortion, astigmatism, etc.). The optics block 118 directs the image light to theexit pupil 250 for presentation to the user. -
FIG. 3 is an exploded view of an exampleelectronic display 115 including aLC layer 300, anOLED backlight 350, and adata driver 370, in accordance with an embodiment. Thedata driver 370 generates a backlight control signal and a liquid crystal control signal for displaying an image. TheOLED backlight 350 illuminates light towards theliquid crystal layer 300 according to the backlight control signal, and theliquid crystal layer 300 controls an amount and location of light passing through theliquid crystal layer 300 towards theexit pupil 250 in adirection 310 according to the liquid crystal control signal. A boundary of theliquid crystal layer 300 and a boundary of theOLED backlight 350 may be mechanically coupled to each other through a spacer (not shown). A space between theliquid crystal layer 300 and theOLED backlight 350 may be vacuum or filled with transparent material. In other embodiments, theelectronic display 115 includes different, more or fewer components than shown inFIG. 3 . - The
OLED backlight 350 is an OLED display that is programmable to emit light in a selected portion of the OLED display. In one embodiment, theOLED backlight 350 is controlled in a binary manner to emit or not emit light in a selected portion. Hence, theOLED backlight 350 can be implemented as a passive matrix OLED (PMOLED) display having a simple control scheme without storage capacitors for a low cost implementation. Alternatively, theOLED backlight 350 can be implemented as an active matrix OLED (AMOLED) display, or other types of light emitting components, in which a selected portion can be controlled for emitting or not emitting light. - In the example shown in
FIG. 3 , theOLED backlight 350 is segmented into backlight portions BL1, BL2 . . . BL6. In this example, the OLED backlight portions BL1, BL2 . . . BL6 are arranged in a row direction in a manner that a bottom side of an OLED backlight portion BL is coupled to a top side of its adjacent backlight portion BL (e.g., a bottom side of the OLED backlight portion BL1 is coupled to a top side of the OLED backlight portion BL2). Although theOLED backlight 350 inFIG. 3 is segmented into six backlight portions, in other examples, theOLED backlight 350 can include a different number of segmented backlight portions or segmented into different spatial portions than shown inFIG. 3 . In some embodiments, each backlight portion of theOLED backlight 350 may not have a rectangular bar shape that stretches along a width of the display. Instead, each backlight portion may have one or more rectangular shapes or other shapes smaller than the width of the display that form a regular or irregular tiled pattern behind theLC layer 300. This enables local dimming (improved LCD contrast) in addition to the fast, flexible addressing in a thin package compared to conventional LED backlights. According to the backlight control signal, a selected backlight portion illuminates light toward theliquid crystal layer 300 in thedirection 310, while remaining portions do not. - Generally, brightness of an OLED is much lower than a traditional backlight of a LC display (e.g., a light guide with LED light source). To improve brightness of the
OLED backlight 350, pixel size of theOLED backlight 350 can be larger than pixels of the LC layer 300 (i.e., a resolution of theOLED backlight 350 is lower than a resolution of the LC layer 300), where light from a single pixel of theOLED backlight 350 may be projected to two or more pixels of theLC layer 300. By implementing theOLED backlight 350 with larger size pixels, brightness of theOLED backlight 350 can be improved. Additionally, a brightness enhanced film (BEF) may be disposed on theOLED backlight 350 or on theLC layer 300 to further improve brightness. - Implementing the
OLED backlight 350 with larger pixel sizes than the pixel sizes of theLC layer 300 is also beneficial in terms of implementation costs, because a high resolution LC layer is inexpensive than a comparable resolution OLED display. To further reduce the implementation costs, theOLED backlight 350 may include only white OLEDs, with a color filter on theLC layer 300. Alternatively, RGB OLEDs can be implemented in theOLED backlight 350 without the color filter to improve color gamut or spatially homogenize colors. - The
liquid crystal layer 300 receives a liquid crystal control signal from thedata driver 370, and passes light from theOLED backlight 350 towards the exit pupil in thedirection 310, according to the liquid crystal control signal. The liquid crystal control signal is a signal indicative of an amount of light passing through theliquid crystal layer 300 for different pixels of theliquid crystal layer 300. Theliquid crystal layer 300 includes a plurality of liquid crystals corresponding to a plurality of pixels, and configurations of the liquid crystals can be changed according to the liquid crystal control signal applied across electrodes of theliquid crystal layer 300. In the example shown inFIG. 3 , theliquid crystal layer 300 is programmed in units of a plurality of segmented liquid crystal portions LC1, LC2 . . . LC6. In this example, each of the liquid crystal portions LC1, LC2 . . . LC6 corresponds to a respective one of the OLED backlight portions BL1, BL2 . . . BL6, and faces a corresponding OLED backlight portion. Each liquid crystal portion may encompass multiple rows of pixels. Although theliquid crystal layer 300 inFIG. 3 is segmented into six liquid crystal portions, in other examples, theliquid crystal layer 300 can include a different number of segmented liquid crystal portions. In other examples, two or more of the liquid crystal portions may correspond to and overlap with a single OLED backlight portion. - The
data driver 370 is a circuit component that receives an input image data, and generates control signals for driving theliquid crystal layer 300 and theOLED backlight 350. The input image data may correspond to an image or a frame of a video in a virtual reality and/or augmented reality application transmitted from the VR/AR console 110. Thedata driver 370 generates the backlight control signal for controlling intensity of light output by theOLED backlight 350, according to the input image data. In addition, thedata driver 370 generates the liquid crystal control signal for controlling an amount of light from theOLED backlight 350 traveling towards theexit pupil 250 through theliquid crystal layer 300. Thedata driver 370 provides the backlight control signal to theOLED backlight 350, and the liquid crystal control signal to theliquid crystal layer 300 at a proper timing to display a single image. - Rather than displaying an image only through an OLED display without the
LC layer 300, theOLED backlight 350 operates as a programmable backlight of a conventional LC display device. By employing the OLED display (e.g., PMOLED or AMOLED display) as theOLED backlight 350, a selected portion of theOLED backlight 350 can be controlled to emit light in a flexible sequence (e.g., from top to bottom or from center to edges). -
FIG. 4 is a timing diagram of operation of the example electronic display ofFIG. 3 , in accordance with an embodiment. Thedata driver 370 applies a liquid crystal control signal to cause programming of liquid crystals during 410A, 420A . . . 460A, and liquid crystal state transitioning during liquid crystalprogramming time periods 410B, 420B . . . 460B. In addition, thetransition time periods data driver 370 applies a backlight control signal to theOLED backlight 350 to illuminate light during backlight 410C, 420C . . . 426C for displaying an image for a frame time 400 (e.g., 11 ms).illumination time periods - In one embodiment, (i) programming and transitioning of states of liquid crystals in a liquid crystal portion LC and (ii) illuminating a corresponding backlight portion BL can occur in an alternating sequence. Specifically, the liquid crystal portion LC1 is programmed during a
programming time period 410A at T1. After the liquid crystal portion LC1 is programmed, states of liquid crystals in the liquid crystal portion LC1 are transitioned during a liquid crystaltransition time period 410B at T2. After transitioning states of the liquid crystals in the liquid crystal portion LC1, the backlight portion BL1 illuminates light during a backlightillumination time period 410C at T3. - While the states of the liquid crystals in the liquid crystal portion LC1 are in transition, the liquid crystal portion LC2 is programmed during a
programming time period 420A at T2. In addition, states of liquid crystals in the liquid crystal portion LC2 are transitioned during the liquid crystaltransition time period 420B at T3, while the backlight portion BL1 illuminates light. After the states of the liquid crystals in the liquid crystal portion LC2 are transitioned, the backlight portion BL2 illuminates light during a backlightillumination time period 420C at T4. - For a last liquid crystal portion and a backlight portion (e.g., LC6 and BL6), the last liquid crystal portion (e.g., LC6) is programmed during a
programming time period 460A at TN of theframe time 400. Aframe time 400 herein refers to time duration between starting times of two image frames (i.e., starting times of programming LC1 of two image frames). States of liquid crystals in the last liquid crystal portion LC6 are transitioned during a liquid crystaltransition time period 460B, while the liquid crystal portion LC1 is programmed during theprogramming time period 410A′ at T1 of thenext frame time 400′. In addition, the last backlight portion (e.g., BL6) illuminates light during a backlightillumination time period 460C, while states of liquid crystals in the liquid crystal portion LC1 are in transition during the liquid crystaltransition time period 410B′ at T2 of thenext frame time 400′. Accordingly, a portion of an image corresponding to the last liquid crystal portion and the last backlight portion (e.g., LC6 and BL6) is displayed, while states of liquid crystals in the first liquid crystal portion LC1 are in transition for displaying a subsequent image. - In another embodiment, state transitions occur automatically after programming, thus
410B, 420B . . . 460B for transitioning states of liquid crystals may be omitted. In this embodiment, time periods for programming liquid crystals and transitioning states of the liquid crystals can be combined into a single time period.time periods - Advantageously, by segmenting the
liquid crystal layer 300 and selectively illuminating a portion of theOLED backlight 350 as shown inFIG. 3 , and displaying an image as shown inFIG. 4 , latency involved for programming a portion of the liquid crystal layer and illuminating light can be reduced. In particular, compared to a conventional display panel in which the backlight portion illuminates light after completing programming and transitioning states of all liquid crystals, additional time can be allocated for programming and transitioning states of liquid crystals for a given frame time by segmenting the liquid crystal layer, and sequentially programming and illuminating light according to one or more embodiments disclosed herein. Accordingly, additional time for programming and transitioning states of liquid crystals allows high quality images (e.g., 1080 by 720 pixels or higher) to be presented to the user in response to the user motion without a noticeable lag to provide a seamless VR/AR experience to the user. In one aspect, a portion (e.g., last crystal portion) of a display projects a portion of an image frame, while another portion of the display is being programmed or is being configured for displaying another portion of a subsequent image frame, causing a delay of the portion of the image frame displayed. However, a user experiencing a virtual reality or an augmented reality is less likely to focus on the last crystal portion, and such delay of the portion of the image frame displayed may be unnoticeable. - The foregoing description of the embodiments has been presented for the purpose of illustration; it is not intended to be exhaustive or to limit the patent rights to the precise forms disclosed. Persons skilled in the relevant art can appreciate that many modifications and variations are possible in light of the above disclosure.
- The language used in the specification has been principally selected for readability and instructional purposes, and it may not have been selected to delineate or circumscribe the inventive subject matter. It is therefore intended that the scope of the patent rights be limited not by this detailed description, but rather by any claims that issue on an application based hereon. Accordingly, the disclosure of the embodiments is intended to be illustrative, but not limiting, of the scope of the patent rights, which is set forth in the following claims.
Claims (20)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US15/492,959 US10714023B2 (en) | 2016-04-21 | 2017-04-20 | Display including liquid crystal layer with organic light emitting diode backlight |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201662325864P | 2016-04-21 | 2016-04-21 | |
| US15/492,959 US10714023B2 (en) | 2016-04-21 | 2017-04-20 | Display including liquid crystal layer with organic light emitting diode backlight |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| US20170309233A1 true US20170309233A1 (en) | 2017-10-26 |
| US10714023B2 US10714023B2 (en) | 2020-07-14 |
Family
ID=60089633
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US15/492,959 Active 2038-02-19 US10714023B2 (en) | 2016-04-21 | 2017-04-20 | Display including liquid crystal layer with organic light emitting diode backlight |
Country Status (1)
| Country | Link |
|---|---|
| US (1) | US10714023B2 (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109166545A (en) * | 2018-09-27 | 2019-01-08 | 京东方科技集团股份有限公司 | AR/VR shows driving method, driving device and the display equipment of equipment |
| US20190050619A1 (en) * | 2017-08-09 | 2019-02-14 | Synaptics Incorporated | Providing test patterns for sensor calibration |
| US11615740B1 (en) | 2019-12-13 | 2023-03-28 | Meta Platforms Technologies, Llc | Content-adaptive duty ratio control |
| US11922892B2 (en) | 2021-01-20 | 2024-03-05 | Meta Platforms Technologies, Llc | High-efficiency backlight driver |
| US20240185813A1 (en) * | 2022-12-06 | 2024-06-06 | Japan Display Inc. | Display device and display system |
| US12293496B2 (en) | 2020-10-29 | 2025-05-06 | Beijing Boe Optoelectronics Technology Co., Ltd. | Virtual reality display method, device and storage medium |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7916104B2 (en) * | 2005-05-27 | 2011-03-29 | Texas Instruments Incorporated | Increased intensity resolution for pulse-width modulation-based displays with light emitting diode illumination |
| US9035975B2 (en) * | 2009-10-14 | 2015-05-19 | Dolby Laboratories Licensing Corporation | Variable flower display backlight system |
| KR20140108653A (en) * | 2011-11-30 | 2014-09-12 | 티피 비전 홀딩 비.브이. | Apparatus and method for driving a display |
| TWI455100B (en) * | 2012-04-13 | 2014-10-01 | Wistron Corp | Backlight control method and backlight system |
| US20150371605A1 (en) * | 2014-06-23 | 2015-12-24 | Apple Inc. | Pixel Mapping and Rendering Methods for Displays with White Subpixels |
| KR102255892B1 (en) * | 2014-07-08 | 2021-05-25 | 삼성전자주식회사 | User terminal apparatus and control method thereof |
| US9606364B2 (en) * | 2014-09-12 | 2017-03-28 | Microsoft Technology Licensing, Llc | Stabilizing motion of an interaction ray |
| US20170059151A1 (en) * | 2015-08-25 | 2017-03-02 | Abl Ip Holding Llc | Luminaire utilizing display device and associated illumination component(s) |
-
2017
- 2017-04-20 US US15/492,959 patent/US10714023B2/en active Active
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20190050619A1 (en) * | 2017-08-09 | 2019-02-14 | Synaptics Incorporated | Providing test patterns for sensor calibration |
| US10726233B2 (en) * | 2017-08-09 | 2020-07-28 | Fingerprint Cards Ab | Providing test patterns for sensor calibration |
| CN109166545A (en) * | 2018-09-27 | 2019-01-08 | 京东方科技集团股份有限公司 | AR/VR shows driving method, driving device and the display equipment of equipment |
| US20200105062A1 (en) * | 2018-09-27 | 2020-04-02 | Beijing Boe Optoelectronics Technology Co., Ltd. | Driving method and driving apparatus for ar/vr display device, and display device |
| US11132844B2 (en) * | 2018-09-27 | 2021-09-28 | Beijing Boe Optoelectronics Technology Co., Ltd. | Driving method and driving apparatus for AR/VR display device, and display device |
| US11615740B1 (en) | 2019-12-13 | 2023-03-28 | Meta Platforms Technologies, Llc | Content-adaptive duty ratio control |
| US12293496B2 (en) | 2020-10-29 | 2025-05-06 | Beijing Boe Optoelectronics Technology Co., Ltd. | Virtual reality display method, device and storage medium |
| US12537932B2 (en) | 2020-10-29 | 2026-01-27 | Beijing Boe Optoelectronics Technology Co., Ltd. | Virtual reality display method, device and storage medium |
| US11922892B2 (en) | 2021-01-20 | 2024-03-05 | Meta Platforms Technologies, Llc | High-efficiency backlight driver |
| US20240185813A1 (en) * | 2022-12-06 | 2024-06-06 | Japan Display Inc. | Display device and display system |
| US12236910B2 (en) * | 2022-12-06 | 2025-02-25 | Japan Display Inc. | Display device and display system with lighting control based on movement |
Also Published As
| Publication number | Publication date |
|---|---|
| US10714023B2 (en) | 2020-07-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10678330B1 (en) | Backlight modulation for liquid crystal display with eyetracking for virtual reality | |
| US10401627B1 (en) | Stacked display panels for image enhancement | |
| US10714023B2 (en) | Display including liquid crystal layer with organic light emitting diode backlight | |
| US10670929B2 (en) | Enhanced spatial resolution using a segmented electrode array | |
| US10522094B1 (en) | Global illumination mode liquid crystal display for virtual reality | |
| CN113748401B (en) | A display system with dynamic light output adjustment to maintain constant brightness | |
| US10170060B2 (en) | Interlaced liquid crystal display panel and backlight used in a head mounted display | |
| US9989801B2 (en) | Inverted LCD structure for VR | |
| US10542596B1 (en) | Low power pulse width modulation by controlling bits order | |
| US10585479B2 (en) | Control for a virtual reality system including opposing portions for interacting with virtual objects and providing tactile feedback to a user | |
| US11604356B1 (en) | Near-eye display assembly with enhanced display resolution | |
| US20170287408A1 (en) | Black duty insertion mode liquid crystal display for virtual reality | |
| US10643528B2 (en) | Rolling burst illumination for a display | |
| US10558036B2 (en) | Using oscillation of optical components to reduce fixed pattern noise in a virtual reality headset | |
| US10311824B2 (en) | Multiple driver IC back light unit and liquid crystal response timing for LCD for virtual reality | |
| US9859527B2 (en) | Reflective layer for increasing fill factor in an electronic display | |
| US10436975B2 (en) | Segmented backlight for liquid crystal display | |
| US10679416B1 (en) | Crosstalk mitigation for virtual reality | |
| US20160267877A1 (en) | Dynamic illumination persistence for organic light emitting diode display device | |
| US10359845B1 (en) | Display assembly using dynamic liquid crystal array | |
| US10511832B1 (en) | Calibration of virtual image system with extended nasal field of view | |
| US10175414B2 (en) | Channel cut backlight for liquid crystal display | |
| US10678054B1 (en) | Segmented backlight for liquid crystal display | |
| US11783789B1 (en) | Dynamic brightness compensation in display assembly | |
| US20180120497A1 (en) | Thick backlight for rgb led of a liquid crystal display used in a virtual reality head mounted display |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: OCULUS VR, LLC, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:PATEL, NIRAV RAJENDRA;RICHARDS, EVAN M.;SIGNING DATES FROM 20170505 TO 20170508;REEL/FRAME:042385/0820 |
|
| AS | Assignment |
Owner name: FACEBOOK TECHNOLOGIES, LLC, CALIFORNIA Free format text: CHANGE OF NAME;ASSIGNOR:OCULUS VR, LLC;REEL/FRAME:047178/0616 Effective date: 20180903 |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
| STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
| AS | Assignment |
Owner name: META PLATFORMS TECHNOLOGIES, LLC, CALIFORNIA Free format text: CHANGE OF NAME;ASSIGNOR:FACEBOOK TECHNOLOGIES, LLC;REEL/FRAME:060315/0224 Effective date: 20220318 |
|
| MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |