CN109558001A - Image processing system and method - Google Patents
Image processing system and method Download PDFInfo
- Publication number
- CN109558001A CN109558001A CN201710889679.8A CN201710889679A CN109558001A CN 109558001 A CN109558001 A CN 109558001A CN 201710889679 A CN201710889679 A CN 201710889679A CN 109558001 A CN109558001 A CN 109558001A
- Authority
- CN
- China
- Prior art keywords
- mentioned
- picture
- image processing
- eye picture
- head
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Processing Or Creating Images (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention provides an image processing system and a method, wherein the image processing system comprises a head-mounted display device and an image processing device. The image processing device comprises a processor. The processor transmits the setting information of the head-mounted display device to a picture driving program. The frame driver obtains 3D data from a user mode driver, and generates a left-eye frame and a right-eye frame according to the setting information and the 3D data. The processor transmits the left-eye picture and the right-eye picture to the head-mounted display device, and the head-mounted display device displays a display picture according to the left-eye picture and the right-eye picture. The virtual reality helmet can directly display the display content generated by the Direct3D and OpenGL technologies, thereby increasing the compatibility of the display content of the virtual reality helmet.
Description
Technical field
Description of the invention is mainly related to an image processing techniques, particularly with regard to pass through virtual reality (virtual
Reality, VR) head-mounted display apparatus directly display Direct3D and OpenGL content image processing techniques, especially relate to
And a kind of image processing system and method.
Background technique
With the development of science and technology the also day also evolution of the display technology of image.Virtual reality (Virtual Reality, referred to as
It VR) is a kind of display technology that virtual three-dimensional space is simulated using computer technology.User can be filled by dedicated wearing
Set (such as: the helmet, glasses), allow user to have feeling on the spot in person by vision.
However, display content shown by current virtual implementing helmet, is all the independently developed exploitation of exploitation quotient
Platform is developed.Therefore, it current virtual implementing helmet and can not support to directly display the interior of Direct3D and OpenGL
The picture of appearance.However, since current most 3D software and 3D game are all based on Direct3D and OpenGL, both draw
It holds up to be developed.Therefore, if virtual implementing helmet can not be supported to directly display the picture of the content of Direct3D and OpenGL,
Display content shown by virtual implementing helmet will be restricted.
Summary of the invention
In view of above-mentioned problem of the prior art, the present invention provides straight by virtual reality (VR) head-mounted display apparatus
Connect the image processing system and method for the content of display Direct3D and OpenGL.
An embodiment according to the present invention provides a kind of image processing system, and above-mentioned image processing system is worn including one
Formula display device and an image processing apparatus.Image processing apparatus includes a processor, and processor can show above-mentioned wear-type
The set information of showing device sends a picture driver to, and above-mentioned picture driver takes from user's mode driver
A 3D data are obtained, and according to above-mentioned set information and above-mentioned 3D data, generate a left eye picture and a right eye picture；It is above-mentioned
Processor sends above-mentioned left eye picture and above-mentioned right eye picture to above-mentioned head-mounted display apparatus, and above-mentioned wear-type is shown
Device shows picture according to above-mentioned left eye picture and above-mentioned right eye picture.
In some embodiments, above-mentioned set information includes an interpupillary distance information, a Viewing-angle information and a field of view information.
In some embodiments, above-mentioned 3D data are as produced by Direct 3D and OpenGL technology.
In some embodiments, above-mentioned picture driver includes a program library, and above-mentioned picture driver is loaded into
The file that program library is included is stated, above-mentioned 3D data and above-mentioned set information are converted into corresponding to above-mentioned head-mounted display apparatus
Left eye picture and right eye picture.
An embodiment according to the present invention provides a kind of image processing method.Above-mentioned image processing method includes: by one
The set information of head-mounted display apparatus sends a picture driver to；A 3D number is obtained from user's mode driver
According to；According to above-mentioned set information and above-mentioned 3D data, a left eye picture and a right eye picture are generated；By above-mentioned left eye picture
And above-mentioned right eye picture sends above-mentioned head-mounted display apparatus to；And it is drawn according to above-mentioned left eye picture and above-mentioned right eye
Face shows picture on above-mentioned head-mounted display apparatus.
The image processing system and method provided through the above embodiments of the present invention, virtual implementing helmet can directly be shown
Show and show content caused by Direct3D and OpenGL technology, thus increases the compatible of virtual implementing helmet displayable content
Property.The left eye picture and right eye picture of corresponding head-mounted display apparatus can be directly generated, so that user is from wear-type
The picture that display device is seen can be more true.Directly pass through picture driver in the process from user's mode driver
3D data are obtained, the picture caused by can reducing because of instruction or the transmission of signal is postponed.
About other additional features and advantages of the invention, those skilled in the art are not departing from spirit and model of the invention
In enclosing, when can do a little variation according to the device and method disclosed in this case implementation method and obtain with retouching.
Detailed description of the invention
Fig. 1 is the block diagram of image processing system 100 described in a display embodiment according to the present invention.
Fig. 2 is the schematic diagram that driving operation is shown according to shown in one embodiment of the invention.
Fig. 3 is the schematic diagram that driving operation is shown according to shown in another embodiment of the present invention.
Fig. 4 is the flow chart 400 of the image processing method according to one embodiment of the invention.
Description of symbols:
100 image processing systems；
110 image processing apparatus；
111 processors；
112 display devices；
120 head-mounted display apparatus；
210 Direct3D execute program library；
220 OpenGL execute program library；
230 DirectX graphical interfaces frames；
240 user's mode drivers；
250 picture drivers；
260 DirectX cores；
270 Kernel-mode drivers；
400 flow charts；
A1 3D application software；
A2, A3 application software；
L1 helmet program library
Specific embodiment
What this section was described is preferred embodiment of the present invention, it is therefore intended that illustrate spirit of the invention rather than to
It limits the scope of protection of the present invention, protection scope of the present invention is subject to view appended claims institute defender.
Fig. 1 is the block diagram of image processing system 100 described in a display embodiment according to the present invention.As shown in Figure 1,
Image processing system 100 may include an image processing apparatus 110 and a head-mounted display apparatus (head-mounted
Display, HMD) 120.An embodiment according to the present invention, image processing apparatus 110 may include that a processor 111 and one is aobvious
Showing device 112.It is noted that, the block diagram in Fig. 1, illustrates the embodiment of the present invention only for facilitating, but the present invention is not
As limit.Image processing apparatus 110 may also comprise other elements.
According to one embodiment of the invention, image processing apparatus 110 can be laptop, a smart phone or a lithographic plate
Computer, but invention is not limited thereto.According to one embodiment of the invention, display device 112 can be general display device, such as:
The screen of laptop screen, smart phone screen or desktop computer, but invention is not limited thereto.It is real according to of the invention one
Example is applied, head-mounted display apparatus 120 can be a virtual reality (virtual reality, VR) helmet.When user will watch
When the picture of virtual reality, head-mounted display apparatus 120 can be coupled to image processing apparatus 110, be filled with being shown from wear-type
Set the picture of 120 viewing virtual realities.
Fig. 2 is the schematic diagram that driving operation is shown according to shown in one embodiment of the invention.In implementation benefit of the invention
In, processor 111 can be used to execute the relevant operation and operation of display driving shown in Fig. 2.As shown in Fig. 2, display driving behaviour
It can be divided into application program (applications) layer, user's mode (User Mode) layer and core schema (Kernel
Mode) layer.Be noted that, the schematic diagram in Fig. 2, illustrate the embodiment of the present invention only for facilitating, but the present invention not with
This is limited.
An embodiment according to the present invention contains the application program to be executed in application layer, such as: 3D is answered
With program A1 and application program A2.
An embodiment according to the present invention may include that a Direct3D (D3D) executes program library in user's mode layer
(Runtime Library) 210, one OpenGL executes program library 220, a DirectX graphical interfaces frame (DirectX
Graphics Infrastructure (DXGI) Framework) 230, one user's mode driver (User Mode
Driver) 240 and a picture driver 250.
An embodiment according to the present invention, user's mode driver 240 may include user's mode display driving
Program (User-mode display driver), the mountable Client Driver of an OpenGL (installable client
driver)。
An embodiment according to the present invention, core schema layer may include a DirectX core (DXG Kernel) 260 and
One Kernel-mode driver (Kernel Mode Driver) 270.
After processor 111 executes a 3D application program A1 (such as: a 3D game), D3D and OpenGL technology can be passed through
Generate 3D data.When 3D data, which are, to be shown in general display device, processor 111 can show according to traditional image and drive
Dynamic technology, 3D rendering is projected in display device 112.
An embodiment according to the present invention is to be shown in head when passing through 3D data caused by D3D and OpenGL technology
When wearing formula display device 120, processor 111 can execute an application program A2, to generate a left side for corresponding head-mounted display apparatus 120
Eye picture and right eye picture.After 111 application program A2 of processor, application program A2 can be by corresponding head-mounted display apparatus 120
Set information send picture driver 250 to.Then, user's mode driver 240 can provide the execution of processor 111
After 3D application program A1, by 3D data caused by D3D and OpenGL technology to picture driver 250.
An embodiment according to the present invention, 3D data may include that the parameter of 3D picture is generated using D3D and OpenGL technology
Setting, the position and direction of projection camera and information of projection matrix etc..
An embodiment according to the present invention, set information may include a set interpupillary distance for head-mounted display apparatus 120
Information, a Viewing-angle information and a field of view information, but the present invention is not limited thereto.
An embodiment according to the present invention, after picture driver 250 obtains 3D data and set information, picture driving
Program 250 can directly generate a left eye picture and one for corresponding head-mounted display apparatus 120 according to 3D data and set information
Right eye picture.After the left eye picture and right eye picture of correspondence head-mounted display apparatus 120 generate, picture driver 250 can be incited somebody to action
The left eye picture and right eye picture of corresponding head-mounted display apparatus 120 send application program A2 to.Then, application program A2 meeting
Send left eye picture and right eye picture to head-mounted display apparatus 120, user can directly pass through head-mounted display apparatus
120, it is seen that pass through 3D display picture caused by D3D and OpenGL technology.
In traditional display driving operation, user's mode driver 240 needs to first pass through DirectX core 250
Screenshot (bufferframe) shown by display device 112 is obtained with Kernel-mode driver 270, it could be by display device
Screenshot shown by 112 is converted into the image that head-mounted display apparatus 120 is suitble to display.However, in the embodiment of the present invention
In, 3D data directly can be obtained from user's mode driver 240 by picture driver 250.Therefore, because instruction or
The time of the delay of picture caused by the transmission of signal will be reduced.
An embodiment according to the present invention, picture driver 250 further include a program library (libary).When picture drives
When program 250 will generate the left eye picture and right eye picture of corresponding head-mounted display apparatus 120, can be loaded into program library is included
File, by acquired by it 3D data and set information be converted into the left eye picture and right eye of corresponding head-mounted display apparatus 120
Picture.
Fig. 3 is the schematic diagram that driving operation is shown according to shown in another embodiment of the present invention.In implementation of the invention
In benefit, processor 111 can be used to execute the relevant operation and operation of display driving shown in Fig. 3.It is noted that, in Fig. 3
Schematic diagram illustrates the embodiment of the present invention only for facilitating, but the present invention is not limited thereto.In addition, framework shown in Fig. 3 and
Fig. 2 is similar, therefore part identical with Fig. 2 just no longer repeats in Fig. 3.
As shown in figure 3, an embodiment according to the present invention, application program A3 may include a helmet program library L1.Using journey
Sequence A3 and helmet program library L1 can support picture format or the display technology of display to set according to head-mounted display apparatus 120
Meter.After application program A3 obtains left eye picture and right eye picture from picture driver 250, application program A3 can first be loaded into head
The left eye picture acquired by the picture driver 250 and right eye picture are converted into head-mounted display apparatus by helmet program library L1
120 applicable picture formats.Then, application program A3 again by after conversion left eye picture and right eye picture be supplied to wear-type and show
Showing device 120.
Fig. 4 is the flow chart 400 of the image processing method according to one embodiment of the invention.This image processing method is suitable
With image processing apparatus 110.In step S410, the set information of head-mounted display apparatus 120 is sent to picture driving journey
Sequence.In step S420, a 3D data are obtained from user's mode driver.In step S430, according to set information and
3D data generate a left eye picture and a right eye picture.In step S440, by above-mentioned left eye picture and above-mentioned right eye picture
Send head-mounted display apparatus to.It is shown according to above-mentioned left eye picture and above-mentioned right eye picture in wear-type in step S450
Picture is shown on device.
Image processing method through the invention, virtual implementing helmet can directly display Direct3D and OpenGL technology
Generated display content, thus increase the compatibility of virtual implementing helmet displayable content.In addition, by image of the invention
Processing method can directly generate the left eye picture and right eye picture of corresponding head-mounted display apparatus so that user from
The picture that head-mounted display apparatus is seen can be more true.In addition, image processing method through the invention, can directly pass through
Picture driver obtains 3D data from user's mode driver, therefore, will can reduce the transmission institute because of instruction or signal
Caused by picture postpone.
The step of method disclosed in specification of the invention and algorithm, directly can directly be answered by executing a processor
With in the combination of hardware, software module or both.One software module (including execute instruction and related data) and other data
It can be stored in data storage, seem random access memory (RAM), flash memory (flash memory), read-only deposit
Reservoir (ROM), electronics erasable programmable read-only memory (EEPROM), is kept at erasable programmable read-only memory (EPROM)
Device, hard disk, portable hard disk, compact disc read-only memory (CD-ROM), DVD or any other computer in the technology that this field is practised
The storage media format that can be read.One storage media may be coupled to an installations, for example, seem computer/processor (for
It is described conveniently, is indicated in this specification with processor), above-mentioned processor can be by (seeming to read information
Procedure code), and write information to storage media.One storage media can integrate a processor.One special application integrated circuit
It (ASIC) include processor and storage media.One user equipment then includes a special application integrated circuit.In other words, processor
With storage media in a manner of the user equipment that is not directly connected, it is contained in user equipment.In addition, in some embodiments, appointing
What is suitble to the product of computer program to include the storage media that can be read, wherein the storage media that can be read includes and one or more institutes
The relevant procedure code of disclosure embodiment.In some embodiments, the product of computer program may include encapsulating material.
" embodiment " that is previously mentioned in this specification or " embodiment " indicate the specific spy related with embodiment
Sign, structure or characteristic are to include in an at least embodiment according to the present invention, it is not intended that they are present in each implementation
In example.Therefore, in the present specification different places occur " in one embodiment " or " in embodiment " phrase not necessarily
Indicate identical embodiment of the invention.
The above paragraph is described using a variety of levels.Obvious, the teaching of this paper may be implemented in a variety of ways, and in example
Disclosed any certain architectures or function are only a representative situation.According to the teaching of this paper, anyone skilled in the art
It should be understood that each level disclosed herein can independent implementation or two or more levels can merge implementation.
Although the present invention has been described by way of example and in terms of the preferred embodiments, however, it is not to limit the invention, any this field skill
Art personnel without departing from the spirit and scope of the present invention, when can make a little variation and retouching, therefore protection model of the invention
It encloses when being subject to the protection scope that claim defined.
Claims (8)
1. a kind of image processing system characterized by comprising
One head-mounted display apparatus；And
One image processing apparatus, comprising:
One processor sends the set information of above-mentioned head-mounted display apparatus to a picture driver；
Wherein above-mentioned picture driver obtains a 3D data from user's mode driver, and according to above-mentioned set information
And above-mentioned 3D data, generate a left eye picture and a right eye picture；
Wherein above-mentioned processor sends above-mentioned left eye picture and above-mentioned right eye picture to above-mentioned head-mounted display apparatus, and on
It states head-mounted display apparatus and picture is shown according to above-mentioned left eye picture and above-mentioned right eye picture.
2. image processing system as described in claim 1, wherein above-mentioned set information includes an interpupillary distance information, a Viewing-angle information
An and field of view information.
3. image processing system as described in claim 1, wherein above-mentioned 3D data are produced by Direct 3D and OpenGL technology
It is raw.
4. image processing system as described in claim 1, wherein above-mentioned picture driver includes a program library, and above-mentioned picture
Face driver is loaded into the file that above procedure library is included, and above-mentioned 3D data and above-mentioned set information is converted into corresponding to above-mentioned
The left eye picture and right eye picture of head-mounted display apparatus.
5. a kind of image processing method characterized by comprising
Send the set information of a head-mounted display apparatus to a picture driver；
A 3D data are obtained from user's mode driver；
According to above-mentioned set information and above-mentioned 3D data, a left eye picture and a right eye picture are generated；
Send above-mentioned left eye picture and above-mentioned right eye picture to above-mentioned head-mounted display apparatus；And
According to above-mentioned left eye picture and above-mentioned right eye picture, picture is shown on above-mentioned head-mounted display apparatus.
6. image processing method as claimed in claim 5, wherein above-mentioned set information includes an interpupillary distance information, a Viewing-angle information
An and field of view information.
7. image processing method as claimed in claim 5, wherein above-mentioned 3D data are produced by Direct 3D and OpenGL technology
It is raw.
8. image processing method as claimed in claim 5, further includes:
It is loaded into the file that a program library of above-mentioned picture driver is included, above-mentioned 3D data and above-mentioned set information are converted
At the left eye picture and right eye picture of the above-mentioned head-mounted display apparatus of correspondence.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710889679.8A CN109558001A (en) | 2017-09-27 | 2017-09-27 | Image processing system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710889679.8A CN109558001A (en) | 2017-09-27 | 2017-09-27 | Image processing system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109558001A true CN109558001A (en) | 2019-04-02 |
Family
ID=65863758
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710889679.8A Withdrawn CN109558001A (en) | 2017-09-27 | 2017-09-27 | Image processing system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109558001A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114095720A (en) * | 2020-08-24 | 2022-02-25 | 宏碁股份有限公司 | Display system and method for playing naked stereoscopic images |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200537851A (en) * | 2004-02-27 | 2005-11-16 | Newnham Res Ltd | Computer network architecture and method of providing display data |
| CN101175218A (en) * | 2006-10-31 | 2008-05-07 | 凌阳科技股份有限公司 | Method and system for executing image processing in computer device |
| CN104915979A (en) * | 2014-03-10 | 2015-09-16 | 苏州天魂网络科技有限公司 | System capable of realizing immersive virtual reality across mobile platforms |
| US20170213314A1 (en) * | 2016-01-22 | 2017-07-27 | Intel Corporation | Smart optimization of unused graphics buffer memory in computing environments |
-
2017
- 2017-09-27 CN CN201710889679.8A patent/CN109558001A/en not_active Withdrawn
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200537851A (en) * | 2004-02-27 | 2005-11-16 | Newnham Res Ltd | Computer network architecture and method of providing display data |
| CN101175218A (en) * | 2006-10-31 | 2008-05-07 | 凌阳科技股份有限公司 | Method and system for executing image processing in computer device |
| CN104915979A (en) * | 2014-03-10 | 2015-09-16 | 苏州天魂网络科技有限公司 | System capable of realizing immersive virtual reality across mobile platforms |
| US20170213314A1 (en) * | 2016-01-22 | 2017-07-27 | Intel Corporation | Smart optimization of unused graphics buffer memory in computing environments |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114095720A (en) * | 2020-08-24 | 2022-02-25 | 宏碁股份有限公司 | Display system and method for playing naked stereoscopic images |
| CN114095720B (en) * | 2020-08-24 | 2023-10-13 | 宏碁股份有限公司 | Display system and playback method of naked-eye stereoscopic images |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10740966B2 (en) | Fake thickness on a two-dimensional object | |
| KR20150091474A (en) | Low latency image display on multi-display device | |
| CN110419061B (en) | Mixed reality system and method of using the system to generate virtual content | |
| US9424767B2 (en) | Local rendering of text in image | |
| JP7201869B1 (en) | Generate new frames with rendered and unrendered content from the previous eye | |
| JP2016212859A (en) | Rendering method and apparatus for binocular parallax image | |
| US20140375663A1 (en) | Interleaved tiled rendering of stereoscopic scenes | |
| CN111066081A (en) | Techniques for Compensating for Variable Display Device Latency in Image Displays for Virtual Reality | |
| EP2449772A1 (en) | Attracting viewer attention to advertisements embedded in media | |
| US20230052104A1 (en) | Virtual content experience system and control method for same | |
| CN109558001A (en) | Image processing system and method | |
| WO2007129476A1 (en) | Image processing program and image processor | |
| EP4328657B1 (en) | Method and computer device for 3d scene generation | |
| WO2019112813A1 (en) | Lens contribution-based virtual reality display rendering | |
| CN109561298A (en) | Image processing system and method | |
| TWI653081B (en) | Image processing system and method | |
| TW201915938A (en) | Image processing system and method | |
| US12033266B2 (en) | Method and computer device for generating a side-by-side 3D image | |
| US20130033511A1 (en) | Composing stereo 3d windowed content | |
| TW202422476A (en) | Method and computer device for generating a side-by-side 3d image | |
| CN118939164A (en) | Control method, device, head mounted display device and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20190402 |
|
| WW01 | Invention patent application withdrawn after publication |