CN106887036A - A kind of synchronous method for head mounted display, device and head mounted display - Google Patents
A kind of synchronous method for head mounted display, device and head mounted display Download PDFInfo
- Publication number
- CN106887036A CN106887036A CN201710031900.6A CN201710031900A CN106887036A CN 106887036 A CN106887036 A CN 106887036A CN 201710031900 A CN201710031900 A CN 201710031900A CN 106887036 A CN106887036 A CN 106887036A
- Authority
- CN
- China
- Prior art keywords
- real world
- world devices
- picture
- stereo
- head mounted
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Optics & Photonics (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of synchronous method for head mounted display, device and head mounted display, the synchronous method includes：Obtain the environment initial pictures of actual environment and the equipment initial pictures of real world devices；Environment initial pictures are carried out with three-dimensional modeling treatment and obtains environmental perspective image, equipment initial pictures carried out with three-dimensional modeling treatment and obtains original equipment stereo-picture, and display environment stereo-picture and original equipment stereo-picture；Receive the current state information that real world devices send；According to current state information, the current state stereo-picture that original equipment stereo-picture is real world devices, and display environment stereo-picture and current state stereo-picture are changed.By synchronous method of the invention, when real world devices generating state changes, head mounted display is notified that, head mounted display will real-time update reality environment, it is possible to ensures that user's finding is synchronous with actual environment all the time, lifts Consumer's Experience.
Description
Technical field
The present invention relates to head mounted display technical field, more particularly, to a kind of for the same of head mounted display
One step process, device and head mounted display.
Background technology
Virtual reality (Virtual Reality, abbreviation VR) is the new and high technology for occurring in recent years.Virtual reality technology will
It is that support one is qualitative and be quantitatively combined, the pass of the comprehensive integration Multi information space that perceptual knowledge and rational knowledge are combined
Key technology.With the lifting of the speed of network, an Internet era based on virtual reality technology just quietly comes up, and it is by pole
The earth changes production and the life style of people.
Head mounted display can show that the image of the actual environment for prestoring, and be that user builds and actual environment phase
With reality environment, but, when the state of the real world devices in actual environment changes, the state of real world devices without
In method real-time update to head mounted display, the reality environment and actual environment built which results in head mounted display
Cannot synchronously, the problem that disconnects of reality environment and actual environment.
The content of the invention
It is an object of the present invention to provide a kind of new solution that can solve the problem that one of above mentioned problem.
According to the first aspect of the invention, there is provided a kind of synchronous method for head mounted display, including：
Obtain the environment initial pictures of actual environment and the equipment initial pictures of real world devices；
The environment initial pictures are carried out with three-dimensional modeling treatment and obtains environmental perspective image, to the equipment initial pictures
Carry out three-dimensional modeling treatment and obtain original equipment stereo-picture, and show that the environmental perspective image and the original equipment are three-dimensional
Image；
Receive the current state information that the real world devices send；
According to the current state information, the current state that the original equipment stereo-picture is the real world devices is changed
Stereo-picture, and show the environmental perspective image and the current state stereo-picture.
Optionally, also include after the display environmental perspective image and the original equipment stereo-picture：
The link order of user input is performed, the link order is used to for the head mounted display to be connected to the reality
Communication network belonging to equipment；
Receive the certification request for being connected to the head mounted display that the real world devices send；
The certification request is verified；
If be proved to be successful, set up with the real world devices and communicated to connect.
Optionally, include after the current state information for receiving the real world devices transmission：
Detect whether that the event for requiring the control real world devices change state occurs, in this way, then set to the reality
Preparation send the control instruction for controlling the real world devices to change state.
Optionally, described according to the current state information, it is the reality to change the original equipment stereo-picture
The current state stereo-picture of equipment includes：
It is determined that the component models in the original equipment stereo-picture corresponding with the current state information；
Attribute information to the component models is modified, and obtains the current state stereo-picture of the real world devices,
Wherein, the attribute information includes at least one of：Color, state and position.
According to the second aspect of the invention, there is provided a kind of sychronisation for head mounted display, including：
Image collection module, for obtaining the environment initial pictures of actual environment and the equipment initial pictures of real world devices；
MBM, obtains environmental perspective image, to institute for the environment initial pictures to be carried out with three-dimensional modeling treatment
The equipment initial pictures of stating carry out three-dimensional modeling treatment and obtain original equipment stereo-picture；
First display module, for showing the environmental perspective image and the original equipment stereo-picture；
Receiver module, for receiving the current state information that the real world devices send；
Change module, is the reality for according to the current state information, changing the original equipment stereo-picture
The current state stereo-picture of equipment；
Second display module, for showing the environmental perspective image and the current state stereo-picture.
Optionally, the sychronisation also includes：
Performing module, the link order for performing user input, link order is used for the head mounted display
It is connected to the communication network belonging to the real world devices；
Request receiving module, for receiving that the real world devices send for being connected to recognizing for the head mounted display
Card request；
Authentication module, for being verified to the certification request；
The link block is used in the case of the result of the authentication module is successful, with the real world devices
Set up communication connection.
Optionally, the sychronisation also includes：
Detection module, for detecting whether the event for requiring the control real world devices change state occurs；
Instruction sending module, for being in the case of being, to the real world devices in the testing result of the detection module
Send the control instruction for controlling the real world devices to change state.
Optionally, the change module includes：
Part determining unit, for determining the original equipment stereo-picture corresponding with the current state information in
Component models；
Changing unit, is modified for the attribute information to the component models, obtains the current of the real world devices
State stereogram picture, wherein, the attribute information includes at least one of：Color, state and position.
According to the third aspect of the invention we, there is provided a kind of head mounted display, including according to a second aspect of the present invention institute
The sychronisation stated.
According to the fourth aspect of the invention, there is provided a kind of head mounted display, including memory and processor, it is described to deposit
Reservoir is used for store instruction, and the instruction is used to control the processor to be operated to perform institute according to a first aspect of the present invention
The synchronous method stated.
A beneficial effect of the invention is, by synchronous method of the invention, to be received in head mounted display existing
After the current state information of real equipment, the status information of the real world devices is updated in its reality environment for building so that
User can obtain the status information consistent with actual environment in reality environment.So ensure that seen by user
Reality environment is synchronous all the time with actual environment all the time, lifts Consumer's Experience.
By referring to the drawings to the detailed description of exemplary embodiment of the invention, further feature of the invention and its
Advantage will be made apparent from.
Brief description of the drawings
The accompanying drawing for being combined in the description and constituting a part for specification shows embodiments of the invention, and even
It is used to explain principle of the invention together with its explanation.
Fig. 1 is the flow chart for a kind of implementation method of the synchronous method of head mounted display according to the present invention；
Fig. 2 is the flow chart for the another embodiment of the synchronous method of head mounted display according to the present invention；
Fig. 3 is the frame principle figure for a kind of implementation structure of the sychronisation of head mounted display according to the present invention；
Fig. 4 is another square frame principle for implementing structure for the sychronisation of head mounted display according to the present invention
Figure；
Fig. 5 is a kind of frame principle figure of the implementation structure according to head mounted display of the present invention.
Specific embodiment
Describe various exemplary embodiments of the invention in detail now with reference to accompanying drawing.It should be noted that：Unless had in addition
Body illustrates that the part and the positioned opposite of step, numerical expression and numerical value for otherwise illustrating in these embodiments do not limit this
The scope of invention.
The description only actually at least one exemplary embodiment is illustrative below, never as to the present invention
And its any limitation applied or use.
May be not discussed in detail for technology, method and apparatus known to person of ordinary skill in the relevant, but suitable
In the case of, the technology, method and apparatus should be considered as a part for specification.
In all examples shown here and discussion, any occurrence should be construed as merely exemplary, without
It is as limitation.Therefore, other examples of exemplary embodiment can have different values.
It should be noted that：Similar label and letter represents similar terms in following accompanying drawing, therefore, once a certain Xiang Yi
It is defined in individual accompanying drawing, then it need not be further discussed in subsequent accompanying drawing.
The reality environment built to solve head mounted display present in prior art cannot with actual environment
A kind of problem that synchronous, reality environment and actual environment disconnect, there is provided synchronous method for head mounted display.
Fig. 1 is the flow chart for a kind of implementation method of the synchronous method of head mounted display according to the present invention.
According to Fig. 1, the synchronous method is comprised the following steps：
Step S101, obtains the environment initial pictures of actual environment and the equipment initial pictures of real world devices.
Real world devices are specifically as follows the electronic equipment being present in the actual environment, or be likely to be present in this and show
Electronic equipment in real environment.The real world devices for example can be washing machine, air-conditioning, refrigerator, TV or notebook computer etc..
Specifically, can be the environment initial pictures that panorama is collected by the full-view camera of head mounted display；
Can also be that comprehensive collection is carried out to actual environment by the common camera of head mounted display, obtain multiple images and
Multiple images are carried out with the environment initial pictures that splicing obtains panorama.
Equipment initial pictures are specially the high-definition image of the real world devices of independent collection.
Environment initial pictures are carried out three-dimensional modeling treatment and obtain environmental perspective image, to equipment initial graph by step S102
Original equipment stereo-picture is obtained as carrying out three-dimensional modeling treatment.
The method of three-dimensional modeling treatment for example can be polygon modeling, non-homogeneous B spline curve modeling
(NURBS), subdivision curved surface skill modeling, mesh modeling or dough sheet modeling.
Specifically, in environmental perspective image, the real world devices are one of component models, and the component models can be with
The original equipment stereo-picture of the real world devices is replaced with, so, is easy in subsequent step found the original equipment of real world devices
Indicator lamp or position in body image are changed accordingly.
It is possible to further environmental perspective image and original equipment stereo-picture are stored in advance in into head mounted display
In, for it is synchronous with actual environment when directly invoke.
Step S103, display environment stereo-picture and original equipment stereo-picture.
The environmental perspective image and original equipment stereo-picture that head mounted display shows can be combined as initial volumetric figure
Picture, wherein, initial volumetric image is specially：This shows during the original equipment stereo-picture of the real world devices replaces environmental perspective image
The stereo-picture obtained after the component models of real equipment.
Head mounted display includes on its display screen initial volumetric image, is that user builds initial virtual reality ring
Border.
Step S104, receives the current state information of real world devices.
The current state information of real world devices can include current location, current operating conditions, parameter current at least
It is a kind of.If the real world devices are air-conditionings, its status information for example can including on off state, standard, temperature, wind speed etc. information
In at least one.If the real world devices are washing machines, its status information can for example include on off state, pattern, residue
At least one in the information such as time and water level.If the real world devices are TVs, its status information can for example include switch
State and/or current location.
When state it is possible to further be real world devices changes, by the current state information after change send to
Head mounted display, or real world devices timing send its status information to head mounted display so that wear-type shows
Device can upgrade in time reality environment.
On this basis, if the real world devices can be communicated with head mounted display, current state information can be with
It is itself to be gathered and sent to head mounted display by the real world devices.If the real world devices can not be aobvious with wear-type
Show that device is communicated, current state information can be the data collecting module collected by being arranged in the real world devices.Should
Data acquisition module can be also used for specifically for the status information of the real world devices that communicated with head mounted display, gathered
Control real world devices change its state.
Step S105, according to current state information, change original equipment stereo-picture stands for the current state of real world devices
Body image.
In one particular embodiment of the present invention, step S105 includes：
It is determined that the component models in original equipment stereo-picture corresponding with current state information；
Attribute information to the component models is modified, and obtains the current state stereo-picture of real world devices, wherein, category
Property information include at least one of：Color, state and position.
For example, when the state that the real world devices are air-conditioning in air-conditioning and original equipment stereo-picture is to close, if its
Current state information is start, then, component models in original equipment stereo-picture corresponding with current state information can be with
It is power on light part and flabellum part；Attribute information to the component models is modified specially：Change original equipment
In image the color of power on light part and by the state of original equipment image middle fan leaf portion part by close be changed to open,
Obtain the current state stereo-picture of real world devices.When air-conditioning in original equipment stereo-picture state for start and standard be
When heating, if its current state information is refrigeration, the part in original equipment stereo-picture corresponding with current state information
Module can be to heat display unit and refrigeration display unit, and the attribute information to the component models is modified specially：More
Change the color for heating display unit and refrigeration display unit in original equipment image, for example, can be that will heat display unit
Color is changed to grey, the color of the display unit that freezes is changed into green, obtains the current state stereo-picture of real world devices.
For example, when the real world devices be notebook computer, and original equipment stereo-picture in notebook computer position be A,
When upper cover plate closes, if its current state information is upper cover plate to be opened, position is B, then, the current shape opened with upper cover plate
Component models in the corresponding original equipment stereo-picture of state information can be upper cover plate component, the current state information with position
Component models in corresponding original equipment stereo-picture are all parts of notebook computer, to the attribute letter of the component models
Breath is modified specially：The state of the upper cover plate component in change original equipment image, and change original equipment stereo-picture
Position of all parts in environmental perspective image.
Specifically, current state information of the notebook computer position for B, can be the shooting according to notebook computer itself
Position detecting module analysis that the current environment graphical analysis of head collection is obtained, or in environment is obtained and sent to head
Head mounted displays.Position detecting module can include camera, processing unit and communication unit, and processing unit is according to camera
The current environment image of collection, obtains position of the notebook computer in current environment for B, and is the current shape of B by the position
State information is sent to head mounted display through communication unit.
Step S106, display environment stereo-picture and current state stereo-picture.
The environmental perspective image and current state stereo-picture that head mounted display shows can be combined as current stereogram
Picture, wherein, current stereo-picture is specially：This shows during the current state stereo-picture of the real world devices replaces environmental perspective image
The stereo-picture obtained after the component models of real equipment.If the positional information of real world devices changes, current state is stood
Body image is replaced position of the component models of the real world devices in environmental perspective image in environmental perspective image and is also changed simultaneously.
Head mounted display includes on its display screen current stereo-picture, is that user's structure is synchronous with actual environment
Current virtual actual environment, that is, update initial virtual actual environment.
So, after the current state information that head mounted display receives real world devices, in the virtual reality that it builds
The status information of the real world devices is updated in environment so that user can obtain consistent with actual environment in reality environment
Status information.So ensure that reality environment is synchronous all the time with actual environment all the time seen by user, lifting is used
Experience at family.
In one particular embodiment of the present invention, the synchronous method also includes：
Detect whether that the event for requiring control real world devices change state occurs, in this way, then sent to real world devices and used
In the control instruction for controlling the real world devices to change state.
It is required that the event of control real world devices change state can be occurred by Voice command, or logical
Cross the modes such as gesture, eyeball tracking and control what is occurred, can also be the sky mouse or hand used cooperatively by head mounted display
The modes such as handle control what is occurred.
The control instruction can for example include instruction, the finger for improving air-conditioner temperature for controlling real world devices to open
Instruction for make, reducing television for play volume etc..
For example, when user sends the voice of " unlatching air-conditioning ", head mounted display will send to real world devices air-conditioning and control
The instruction that air-conditioning processed is opened；When user makes upward sliding gesture, head mounted display will send to real world devices air-conditioning
Improve the instruction of temperature；When user presses the down button on lower handle or sky mouse, head mounted display will set to reality
Standby television set sends the instruction for reducing broadcast sound volume.
After real world devices receive the control instruction of head mounted display transmission, the control instruction will be performed, it is right to realize
Should control instruction function.
Further, after real world devices have performed control instruction, its current state information can be again sent to head
Head mounted displays so that the real world devices state synchronized in reality environment changes, to ensure reality environment with reality
The synchronization of environment.
In one particular embodiment of the present invention, if the user in being in actual environment is right in reality environment
Real world devices in actual environment are operated, and such as user wants to open air-conditioning when using head mounted display, and user can be with
A breakdown action is carried out to virtual air-conditioning in reality environment, now head mounted display receives the operation of user
After request, can be communicated with the real world devices air-conditioning being connected, be sent open command to air-conditioning, it is empty to open correspondence real world devices
Adjust corresponding open function, meanwhile, real world devices air-conditioning can perform open command after real world devices current state information
Head mounted display is sent to again, and head mounted display change initial virtual actual environment is opened air-conditioning, due to reality
Air-conditioning in environment be also open, therefore user can both see in reality environment, can also be in actual environment
Experience the unlatching of air-conditioning.Other feature operations can also easily be carried out by the method, for example, adjust temperature etc., completely
Do not influenceed by reality environment, without returning to actual environment, further improved Consumer's Experience.
Meanwhile, in the state of user is not in present reality environment, such as user comes back house when company
In air-conditioning forget to close, or the computer the inside of family also has the part work to process, or the shape in the monitoring for wanting look at family
State, can take in advance with own home to the head mounted display for connecting at any time, recall the initial pictures of family, it is also possible to family
In real world devices be controlled, which achieves the effect by head mounted display remote control real world devices.
Fig. 2 is the flow chart for the another embodiment of the synchronous method of head mounted display according to the present invention.
Before step S103 is performed, the synchronous method also includes the following steps according to Fig. 2：
Step S201, performs the link order of user input, and the link order is used to be connected to the head mounted display
Communication network belonging to real world devices.
Step S202, receives the certification request for being connected to head mounted display that real world devices send.
Step S203, verifies to the certification request.
Step S204, if be proved to be successful, sets up with real world devices and communicates to connect.
Specifically, real world devices and head mounted display need to be connected in same communication network, the communication network for example may be used
Be connected to a router structure LAN；It can also be internet.Head mounted display is connected in communication network
Concrete mode for example can be Wi-Fi, GPRS, CDMA2000, WCDMA, TD-SCDMA, TD-LTE or FDD-LTE.
Real world devices and head mounted display start and are connected to after same communication network, and head mounted display can be logical
As server end in news network, real world devices can be in communication network as client, and real world devices can be in communication network
Find required head mounted display and initiate certification request, head mounted display is verified to the certification request, is verified into
To be set up after work(, between real world devices and head mounted display and communicated to connect.
In order to ensure that real world devices are connected to required head mounted display, each head mounted display has one only
One ID, the ID for example can be the sequence numbers of head mounted display, and all real world devices for sending certification requests are carried out
Checking, only holds the connection that the real world devices of head mounted display ID can just set up network with the head mounted display,
Real world devices are this ensures that thered to be merely able to be connected with the foundation of required head mounted display.
In another embodiment of the present invention, can be that multiple real world devices set up communication link with head mounted display
Connect.
In the case, head mounted display need in advance obtain the equipment initial pictures of each real world devices, and to each
Equipment initial pictures carry out three-dimensional modeling treatment, obtain the original equipment stereo-picture of each real world devices of correspondence.
Head mounted display is set up after being connected with each real world devices, can generate the identification code of correspondence real world devices, and
The identification code of each real world devices is different, and head mounted display can store the identification code of all real world devices and by each knowledge
Other code is corresponded with the original equipment stereo-picture of corresponding real world devices, is easy to search corresponding original equipment according to identification code
Stereo-picture.So, in transmission current state information and the process of control instruction, head mounted display can distinguish each reality
The original equipment stereo-picture of equipment is simultaneously controlled each real world devices accordingly.
Further, real world devices to head mounted display send current state information when, can simultaneously by itself
Identification code is sent to head mounted display, and head mounted display first judges the real world devices corresponding with the identification code, then changes
The original equipment stereo-picture of correspondence real world devices.
When head mounted display detects the event generation for requiring control real world devices change state, then need to judge to want
The corresponding identification code of real world devices of control is sought, control instruction is sent to corresponding real world devices, with only according to the identification code
Control instruction is sent to the real world devices for requiring control.So, head mounted display can just send to specific real world devices
Control instruction, realizes the function of individually control particular real-world equipment.
It is used for the real world devices for communicating when real world devices can not be communicated with head mounted display, in said process
Can be replaced with the third party's hardware for receiving control instruction by meeting the current state information for sending, wherein, third party is hard
Part changes it specifically for the status information and control real world devices of the real world devices that communicated with head mounted display, gathered
State.So, the compatible extensions of head mounted display had both been ensure that, its security and stability had been also ensure that.
Real world devices in synchronous method of the invention, can also be setting for some high-risk, fine, many places operation simultaneously
It is standby, if user operates some high-risk experiments, by synchronous method of the invention, synchronous with actual environment and away from reality
Operated in the virtual environment of environment, during user can be made to participate directly in real high-risk experiment, and peace will not be produced
Full problem.If user carries out some fine processings, in actual environment, it is necessary to various instruments do not stop switching coordinate, and with
Under the synchronous reality environment of actual environment, can fast and accurately switch, and can maximum excavating equipment
Performance.For needing many people in the operation for carrying out more simultaneously, can exist in practical operation communication not in time, information sharing is stranded
Various problems such as difficulty, but based on synchronous method of the invention, can allow many people are shared synchronous with same actual environment virtually to be showed
Real environment and the real-time update synchronization identical current state information in reality environment, it is possible to complete many people in time
In the operation for carrying out more simultaneously.
It is corresponding with the above method, present invention also offers a kind of sychronisation for head mounted display.Fig. 3 is
It is used for a kind of frame principle figure of implementation structure of the sychronisation of head mounted display according to the present invention.
According to Fig. 3, the sychronisation 300 includes image collection module 310, MBM 320, the first display module
330th, receiver module 340, the change display module 360 of module 350 and second.
Above-mentioned image collection module 310 be used for obtain actual environment environment initial pictures and real world devices equipment it is initial
Image.
Above-mentioned MBM 320 obtains environmental perspective image for environment initial pictures to be carried out with three-dimensional modeling treatment, right
Equipment initial pictures carry out three-dimensional modeling treatment and obtain original equipment stereo-picture.
Above-mentioned first display module 330 is used for display environment stereo-picture and original equipment stereo-picture.
Above-mentioned receiver module 340 is used to receive the current state information of real world devices transmission.
Above-mentioned change module 350 is used for according to current state information, and change original equipment stereo-picture is real world devices
Current state stereo-picture.
Above-mentioned second display module 360 is used for display environment stereo-picture and current state stereo-picture.
Fig. 4 is another square frame principle for implementing structure of the sychronisation according to user's head mounted display of the present invention
Figure.
According to Fig. 4, the sychronisation 300 can also include performing module 411, request receiving module 412, checking mould
Block 413 and link block 414.
Above-mentioned performing module 411 is used to perform the link order of user input, and the link order is used to show wear-type
Device is connected to the communication network belonging to real world devices.
Above-mentioned request receiving module 412 is used to receive the certification for being connected to head mounted display of real world devices transmission
Request.
Above-mentioned authentication module 413 is used to verify certification request.
Above-mentioned link block 414 is used in the case of the result of authentication module 413 is successful, is built with real world devices
Vertical communication connection.
Further, the sychronisation 300 can also include detection module 421 and instruction sending module 422, the detection mould
Block 421 is for detecting whether the event for requiring control real world devices change state occurs；The instruction sending module 422 is used for
The testing result of detection module is in the case of being, to be sent to real world devices and referred to for the control for controlling real world devices to change state
Order.
On this basis, above-mentioned change module 350 can include part determining unit 351 and changing unit 352, the part
Determining unit 351 is used to determine the component models in original equipment stereo-picture corresponding with current state information；The modified application
Unit 352 is used to be modified the attribute information of component models, obtains the current state stereo-picture of real world devices, wherein, category
Property information include at least one of：Color, state and position.
Present invention also offers a kind of head mounted display, according to one side, the head mounted display includes foregoing use
In the sychronisation 300 of head mounted display.
Fig. 5 is the frame principle figure of the implementation structure of the head mounted display according to another aspect of the present invention.
According to Fig. 5, the head mounted display 500 includes memory 501 and processor 502, and the memory 501 is used for
Store instruction, the instruction is operated to perform the above-mentioned synchronous method for head mounted display for control process device 502.
The processor 502 for example can be central processor CPU, Micro-processor MCV etc..The memory 501 for example includes
ROM (read-only storage), RAM (random access memory), nonvolatile memory of hard disk etc..
In addition, according to Fig. 5, the head mounted display 500 can also include interface arrangement 503, input unit
504th, display device 505, communicator 506, loudspeaker 507, microphone 508 etc..Although figure 5 illustrates multiple dress
Put, but, head mounted display of the present invention can only relate to partial devices therein, for example, processor 501, memory 502,
Display device 505, communicator 506 etc..
Above-mentioned communicator 506 can for example carry out wired or wireless communication.
Above-mentioned interface arrangement 503 is for example including USB interface, earphone interface etc..
Above-mentioned input unit 504 for example can be including touch-screen, button etc..
Above-mentioned display device 505 is, for example, LCDs, touch display screen etc..
The various embodiments described above primary focus describe the difference with other embodiment, but those skilled in the art should be clear
Chu, the various embodiments described above can as needed be used alone or be combined with each other.
Each embodiment in this specification is described by the way of progressive, identical similar portion between each embodiment
Point cross-reference, what each embodiment was stressed is the difference with other embodiment, but people in the art
Member is it should be understood that the various embodiments described above can as needed be used alone or be combined with each other.In addition, for device
For embodiment, because it is corresponding with embodiment of the method, so describing fairly simple, related part is implemented referring to method
The explanation of the corresponding part of example.System embodiment described above is only schematical, wherein as separating component
The module of explanation can be or may not be physically separate.
The present invention can be device, method and/or computer program product.Computer program product can include computer
Readable storage medium storing program for executing, containing for making processor realize the computer-readable program instructions of various aspects of the invention.
Computer-readable recording medium can be the tangible of the instruction that holding and storage are used by instruction execution equipment
Equipment.Computer-readable recording medium for example can be-- but be not limited to-- storage device electric, magnetic storage apparatus, optical storage
Equipment, electromagnetism storage device, semiconductor memory apparatus or above-mentioned any appropriate combination.Computer-readable recording medium
More specifically example (non exhaustive list) includes：Portable computer diskette, hard disk, random access memory (RAM), read-only deposit
It is reservoir (ROM), erasable programmable read only memory (EPROM or flash memory), static RAM (SRAM), portable
Compact disk read-only storage (CD-ROM), digital versatile disc (DVD), memory stick, floppy disk, mechanical coding equipment, for example thereon
Be stored with instruction punch card or groove internal projection structure and above-mentioned any appropriate combination.Calculating used herein above
Machine readable storage medium storing program for executing is not construed as instantaneous signal in itself, the electromagnetic wave of such as radio wave or other Free propagations, logical
Cross electromagnetic wave (for example, the light pulse for passing through fiber optic cables) that waveguide or other transmission mediums propagate or by wire transfer
Electric signal.
Computer-readable program instructions as described herein can from computer-readable recording medium download to each calculate/
Processing equipment, or outer computer or outer is downloaded to by network, such as internet, LAN, wide area network and/or wireless network
Portion's storage device.Network can include copper transmission cable, Optical Fiber Transmission, be wirelessly transferred, router, fire wall, interchanger, gateway
Computer and/or Edge Server.Adapter or network interface in each calculating/processing equipment are received from network to be counted
Calculation machine readable program instructions, and the computer-readable program instructions are forwarded, for storing the meter in each calculating/processing equipment
In calculation machine readable storage medium storing program for executing.
For perform the present invention operation computer program instructions can be assembly instruction, instruction set architecture (ISA) instruction,
Machine instruction, machine-dependent instructions, microcode, firmware instructions, condition setup data or with one or more programming language
Source code or object code that any combination is write, programming language of the programming language including object-oriented-such as
Smalltalk, C++ etc., and routine procedural programming languages-such as " C " language or similar programming language.Computer
Readable program instructions can perform fully on the user computer, partly perform on the user computer, as one solely
Vertical software kit is performed, part performs or completely in remote computer on the remote computer on the user computer for part
Or performed on server.In the situation for being related to remote computer, remote computer can be by the network-bag of any kind
LAN (LAN) or wide area network (WAN)-be connected to subscriber computer are included, or, it may be connected to outer computer (such as profit
With ISP come by Internet connection).In certain embodiments, by using computer-readable program instructions
Status information carry out personalized customization electronic circuit, such as PLD, field programmable gate array (FPGA) or can
Programmed logic array (PLA) (PLA), the electronic circuit can perform computer-readable program instructions, so as to realize each side of the invention
Face.
Referring herein to method according to embodiments of the present invention, device (system) and computer program product flow chart and/
Or block diagram describes various aspects of the invention.It should be appreciated that each square frame and flow chart of flow chart and/or block diagram and/
Or in block diagram each square frame combination, can be realized by computer-readable program instructions.
These computer-readable program instructions can be supplied to all-purpose computer, special-purpose computer or other programmable datas
The processor of processing unit, so as to produce a kind of machine so that these instructions are by computer or other programmable datas
During the computing device of processing unit, work(specified in one or more square frames realized in flow chart and/or block diagram is generated
The device of energy/action.Can also be the storage of these computer-readable program instructions in a computer-readable storage medium, these refer to
Order causes that computer, programmable data processing unit and/or other equipment work in a specific way, so that, be stored with instruction
Computer-readable medium then includes a manufacture, and it includes realizing in one or more square frames in flow chart and/or block diagram
The instruction of the various aspects of the function/action of regulation.
Can also computer-readable program instructions be loaded into computer, other programmable data processing units or other
In equipment so that perform series of operation steps on computer, other programmable data processing units or miscellaneous equipment, to produce
The computer implemented process of life, so that performed on computer, other programmable data processing units or miscellaneous equipment
Instruct function/action specified in one or more square frames realized in flow chart and/or block diagram.
Flow chart and block diagram in accompanying drawing show system, method and the computer journey of multiple embodiments of the invention
The architectural framework in the cards of sequence product, function and operation.At this point, each square frame in flow chart or block diagram can generation
One part for module, program segment or instruction of table a, part for the module, program segment or instruction is used comprising one or more
In the executable instruction of the logic function for realizing regulation.In some realizations as replacement, the function of being marked in square frame
Can occur with different from the order marked in accompanying drawing.For example, two continuous square frames can essentially be held substantially in parallel
OK, they can also be performed in the opposite order sometimes, and this is depending on involved function.It is also noted that block diagram and/or
The combination of the square frame in each square frame and block diagram and/or flow chart in flow chart, can use the function of performing regulation or dynamic
The special hardware based system made is realized, or can be realized with the combination of computer instruction with specialized hardware.It is right
For those skilled in the art it is well known that, realized by hardware mode, realized by software mode and by software and
The mode of combination of hardware realizes it being all of equal value.
It is described above various embodiments of the present invention, described above is exemplary, and non-exclusive, and
It is not limited to disclosed each embodiment.In the case of without departing from the scope and spirit of illustrated each embodiment, for this skill
Many modifications and changes will be apparent from for the those of ordinary skill in art field.The selection of term used herein, purport
Best explaining principle, practical application or the technological improvement to the technology in market of each embodiment, or lead this technology
Other those of ordinary skill in domain are understood that each embodiment disclosed herein.The scope of the present invention is limited by appended claims
It is fixed.
Claims (10)
1. a kind of synchronous method for head mounted display, it is characterised in that including：
Obtain the environment initial pictures of actual environment and the equipment initial pictures of real world devices；
The environment initial pictures are carried out with three-dimensional modeling treatment and obtains environmental perspective image, the equipment initial pictures are carried out
Three-dimensional modeling treatment obtains original equipment stereo-picture, and shows the environmental perspective image and the original equipment stereogram
Picture；
Receive the current state information that the real world devices send；
According to the current state information, the current state that the original equipment stereo-picture is the real world devices is changed three-dimensional
Image, and show the environmental perspective image and the current state stereo-picture.
2. synchronous method according to claim 1, it is characterised in that the display environmental perspective image and it is described just
Also include after beginning equipment stereo-picture：
The link order of user input is performed, the link order is used to for the head mounted display to be connected to the real world devices
Affiliated communication network；
Receive the certification request for being connected to the head mounted display that the real world devices send；
The certification request is verified；
If be proved to be successful, set up with the real world devices and communicated to connect.
3. synchronous method according to claim 1, it is characterised in that the current shape that the reception real world devices send
Include after state information：
Detect whether that the event for requiring the control real world devices change state occurs, in this way, then sent out to the real world devices
Send the control instruction for controlling the real world devices to change state.
4. synchronous method according to claim 1, it is characterised in that described according to the current state information, changes institute
Stating the current state stereo-picture that original equipment stereo-picture is the real world devices includes：
It is determined that the component models in the original equipment stereo-picture corresponding with the current state information；
Attribute information to the component models is modified, and obtains the current state stereo-picture of the real world devices, wherein,
The attribute information includes at least one of：Color, state and position.
5. a kind of sychronisation for head mounted display, it is characterised in that including：
Image collection module, for obtaining the environment initial pictures of actual environment and the equipment initial pictures of real world devices；
MBM, environmental perspective image is obtained for the environment initial pictures to be carried out with three-dimensional modeling treatment, is set to described
Standby initial pictures carry out three-dimensional modeling treatment and obtain original equipment stereo-picture；
First display module, for showing the environmental perspective image and the original equipment stereo-picture；
Receiver module, for receiving the current state information that the real world devices send；
Change module, is the real world devices for according to the current state information, changing the original equipment stereo-picture
Current state stereo-picture；
Second display module, for showing the environmental perspective image and the current state stereo-picture.
6. sychronisation according to claim 5, it is characterised in that the sychronisation also includes：
Performing module, the link order for performing user input, link order is used for head mounted display connection
To the communication network belonging to the real world devices；
Request receiving module, please for receiving the certification for being connected to the head mounted display that the real world devices send
Ask；
Authentication module, for being verified to the certification request；
The link block is used in the case of the result of the authentication module is successful, is set up with the real world devices
Communication connection.
7. sychronisation according to claim 5, it is characterised in that the sychronisation also includes：
Detection module, for detecting whether the event for requiring the control real world devices change state occurs；
Instruction sending module, for being in the case of being, to be sent to the real world devices in the testing result of the detection module
For controlling the real world devices to change the control instruction of state.
8. sychronisation according to claim 5, it is characterised in that the change module includes：
Part determining unit, for determining the part in the original equipment stereo-picture corresponding with the current state information
Module；
Changing unit, is modified for the attribute information to the component models, obtains the current state of the real world devices
Stereo-picture, wherein, the attribute information includes at least one of：Color, state and position.
9. a kind of head mounted display, it is characterised in that including the sychronisation any one of claim 5-8.
10. a kind of head mounted display, it is characterised in that including memory and processor, the memory is used for store instruction,
It is described to instruct for controlling the processor to be operated to perform the synchronization side according to any one of claim 1-4
Method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710031900.6A CN106887036A (en) | 2017-01-17 | 2017-01-17 | A kind of synchronous method for head mounted display, device and head mounted display |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710031900.6A CN106887036A (en) | 2017-01-17 | 2017-01-17 | A kind of synchronous method for head mounted display, device and head mounted display |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106887036A true CN106887036A (en) | 2017-06-23 |
Family
ID=59176530
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710031900.6A Pending CN106887036A (en) | 2017-01-17 | 2017-01-17 | A kind of synchronous method for head mounted display, device and head mounted display |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106887036A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107390875A (en) * | 2017-07-28 | 2017-11-24 | 腾讯科技（上海）有限公司 | Information processing method, device, terminal device and computer-readable recording medium |
| CN111164531A (en) * | 2017-08-07 | 2020-05-15 | 欧姆尼消费品有限责任公司 | System, method and apparatus for surveillance drone |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080055305A1 (en) * | 2006-08-31 | 2008-03-06 | Kent State University | System and methods for multi-dimensional rendering and display of full volumetric data sets |
| CN102193550A (en) * | 2011-05-31 | 2011-09-21 | 北京许继电气有限公司 | Networked intelligent household electricity optimizing control method |
| CN105676961A (en) * | 2016-01-05 | 2016-06-15 | 何军 | Head-mounted display and display control method thereof |
| CN105955042A (en) * | 2016-05-27 | 2016-09-21 | 浙江大学 | Virtuality reality type visible and controllable intelligent household control system and method |
| CN106325511A (en) * | 2016-08-25 | 2017-01-11 | 安徽协创物联网技术有限公司 | Virtual reality realizing system |
-
2017
- 2017-01-17 CN CN201710031900.6A patent/CN106887036A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080055305A1 (en) * | 2006-08-31 | 2008-03-06 | Kent State University | System and methods for multi-dimensional rendering and display of full volumetric data sets |
| CN102193550A (en) * | 2011-05-31 | 2011-09-21 | 北京许继电气有限公司 | Networked intelligent household electricity optimizing control method |
| CN105676961A (en) * | 2016-01-05 | 2016-06-15 | 何军 | Head-mounted display and display control method thereof |
| CN105955042A (en) * | 2016-05-27 | 2016-09-21 | 浙江大学 | Virtuality reality type visible and controllable intelligent household control system and method |
| CN106325511A (en) * | 2016-08-25 | 2017-01-11 | 安徽协创物联网技术有限公司 | Virtual reality realizing system |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107390875A (en) * | 2017-07-28 | 2017-11-24 | 腾讯科技（上海）有限公司 | Information processing method, device, terminal device and computer-readable recording medium |
| CN107390875B (en) * | 2017-07-28 | 2020-01-31 | 腾讯科技（上海）有限公司 | Information processing method, apparatus, terminal device and computer-readable storage medium |
| CN111164531A (en) * | 2017-08-07 | 2020-05-15 | 欧姆尼消费品有限责任公司 | System, method and apparatus for surveillance drone |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109672830B (en) | Image processing method, device, electronic device and storage medium | |
| CN110689621B (en) | Method, device and system for displaying three-dimensional models of houses on the same screen before and after decoration | |
| CN106897688A (en) | Interactive projection device, the method for control interactive projection and readable storage medium storing program for executing | |
| CN109583385A (en) | Face image processing process, device, electronic equipment and computer storage medium | |
| CN110610546B (en) | Video picture display method, device, terminal and storage medium | |
| WO2017215308A1 (en) | Method, device and system for controlling electrical appliance | |
| CN105893989A (en) | Dynamic calibration method for ultrasonic fingerprint identification, device and electronic device | |
| CN107631750B (en) | Method, device, terminal and storage medium for testing terminal under test | |
| CN109189295A (en) | display control method, device and terminal device | |
| CN110262886A (en) | Task executing method and device, electronic equipment and storage medium | |
| CN113014960B (en) | Method, device and storage medium for online video production | |
| US12348575B2 (en) | Dynamically assigning participant video feeds within virtual conferencing system | |
| CN106887036A (en) | A kind of synchronous method for head mounted display, device and head mounted display | |
| CN107230179A (en) | Storage method, methods of exhibiting and the equipment of panoramic picture | |
| CN103873943B (en) | A kind of OSD interactive interface display methods, terminal and system | |
| CN109613349A (en) | Fault visualization method and terminal equipment | |
| CN102612205B (en) | Method for controlling visual light sources, terminals and video conference system | |
| CN118918239A (en) | Hand three-dimensional reconstruction method and device and electronic equipment | |
| CN107959845A (en) | The method, apparatus of view data transmission, client terminal device and wear display device | |
| CN114816197A (en) | Control method, device, storage medium and terminal device for smart home equipment | |
| CN107548083A (en) | WAP function test method and equipment | |
| CN113436346A (en) | Distance measuring method and device in three-dimensional space and storage medium | |
| Devi et al. | Design and development of a touch free smart home controlling system based on Virtual Reality (VR) technology | |
| CN115134233B (en) | Scene upgrading method and device, medium and terminal | |
| CN107102726A (en) | A kind of preschool education system based on AR |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170623 |
|
| RJ01 | Rejection of invention patent application after publication |