[go: up one dir, main page]

CN107977834A - Data object exchange method and device in a kind of virtual reality/augmented reality space environment - Google Patents

Data object exchange method and device in a kind of virtual reality/augmented reality space environment Download PDF

Info

Publication number
CN107977834A
CN107977834A CN201610921190.XA CN201610921190A CN107977834A CN 107977834 A CN107977834 A CN 107977834A CN 201610921190 A CN201610921190 A CN 201610921190A CN 107977834 A CN107977834 A CN 107977834A
Authority
CN
China
Prior art keywords
user
data object
voice
information
shop
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610921190.XA
Other languages
Chinese (zh)
Other versions
CN107977834B (en
Inventor
张洁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201610921190.XA priority Critical patent/CN107977834B/en
Priority to PCT/CN2017/105359 priority patent/WO2018072617A1/en
Publication of CN107977834A publication Critical patent/CN107977834A/en
Application granted granted Critical
Publication of CN107977834B publication Critical patent/CN107977834B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/08—Payment architectures
    • G06Q20/12—Payment architectures specially adapted for electronic shopping systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/38—Payment protocols; Details thereof
    • G06Q20/40—Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/38—Payment protocols; Details thereof
    • G06Q20/40—Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
    • G06Q20/401—Transaction verification
    • G06Q20/4014—Identity check for transactions
    • G06Q20/40145—Biometric identity checks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0603—Catalogue creation or management
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Finance (AREA)
  • General Business, Economics & Management (AREA)
  • Strategic Management (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Human Computer Interaction (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The present invention provides the data object exchange method and device in a kind of virtual reality/augmented reality space environment, wherein, the data object exchange method of virtual reality can provide virtual reality shop object internal measurements, so, user can obtain the experience placed oneself in the midst of in three-dimensional space environment, and, specific interaction flow can be realized by voice, for a user, only need to speak that interaction can be achieved, without in manual input devices such as external handles, above all, paying link, without paying manually, but the legitimacy of delivery operation is judged by the vocal print feature of user, and then decide whether that triggering is paid, it ensure that user does shopping the security of payment under virtual reality scenario.The technical solution realized based on augmented reality uses similar technical thought, can reach identical technique effect.

Description

A kind of data object exchange method in virtual reality/augmented reality space environment and Device
Technical field
This application involves virtual reality/augmented reality field, more particularly to a kind of virtual reality/augmented reality space Data object exchange method and device in environment.
Background technology
Virtual reality (Virtual Reality, abbreviation VR) is a kind of computer that can be created with the experiencing virtual world Analogue system.The various virtual environments of this system generation, act on vision, the sense of hearing, the tactile of user, user is produced body and face The sensation in its border, immerses wherein.And so-called virtual world is then virtual environment or the set of given simulation object.It is virtual existing It is the new technology that developed recently gets up in fact.
Augmented reality (Augmented Reality, abbreviation AR) is a kind of by real world information and virtual world information " seamless " integrated new technology, it is difficult the entity information experienced in the certain time spatial dimension of real world script to be (visual information, sound, taste, tactile etc.), by science and technology such as computers, is superimposed again after analog simulation, by virtual information Real world is applied to, is perceived by the user, so as to reach the sensory experience of exceeding reality.
At present, VR/AR technologies are also in the development phase, there is no get through whole network shopping pay the virtual reality of link/ The mutually acting systems of augmented reality.
The content of the invention
The technical problems to be solved by the invention are to provide the data pair in a kind of virtual reality/augmented reality space environment As exchange method, this method can discharge operation by human hand of the user when showing equipment using head completely, and having provided to the user need not Operation by human hand completes the scheme that shopping is paid, and enables to the shopping experience of virtual reality/augmented reality space environment closer The solid shop under line, provides an a kind of station immersion shopping experience to the user.
In addition, present invention also offers the data object interactive device in a kind of virtual reality/augmented reality space environment, To ensure application and realization of the above method in reality.
A kind of data object exchange method in first aspect present invention provides virtual reality space environment, its feature It is, the described method includes：
Client provides virtual reality shop object internal measurements, and the shop object internal measurements include It is at least one can interaction data object；
Determine user's target data objects interested；
Offer and the relevant information content of acknowledgement of orders, it is described to include with the relevant information content of acknowledgement of orders：The mesh Mark the associated attribute information of data object and resource information to be paid；
The voice of user and sound-groove model trained in advance are matched, in successful match, triggers delivery operation.
A kind of data object exchange method in second aspect of the present invention provides virtual reality space environment, the side Method includes：
Server preserves virtual reality shop object internal measurements data, the shop object internal measurements number According to include it is at least one can interaction data object, it is described can interaction data object be corresponding with interaction area scope, and be associated with The preset information content；
The virtual reality shop object internal measurements data are supplied to client, so that the client provides Virtual reality shop object internal measurements data, determine user's target data objects interested；Offer and acknowledgement of orders The relevant information content, it is described to include with the relevant information content of acknowledgement of orders：The associated attribute letter of target data objects Breath and resource information to be paid；The voice of user and sound-groove model trained in advance are matched, in successful match, triggering pays behaviour Make.
A kind of data object exchange method in third aspect present invention provides augmented reality space environment, the side Method includes：
Client obtains the three-dimensional space model of solid shop internal measurements；Include more than one piece inside the solid shop Kinds of goods；
The three-dimensional space model and the solid shop are being carried out by space by preset augmented reality AR equipment After matching somebody with somebody, provide the kinds of goods corresponding interaction area range information in user's scope of sight of the AR equipment；
Determine user's target kinds of goods interested；
Offer and the relevant information content of acknowledgement of orders, it is described to include with the relevant information content of acknowledgement of orders：The mesh Mark the associated attribute information of kinds of goods and resource information to be paid；Match the voice of user and sound-groove model trained in advance, During with success, delivery operation is triggered.
A kind of data object exchange method in fourth aspect present invention provides augmented reality space environment, the side Method includes：
Server preserves the three-dimensional space model of solid shop internal measurements, includes more than one piece inside the solid shop Kinds of goods, corresponding interaction area range information, and the interaction response with each associated data object of interaction area scope Information；
The three-dimensional space model is supplied to client, so that the client is set by preset augmented reality AR After the three-dimensional space model and the solid shop are carried out spatial match, in user's scope of sight of the AR equipment There is provided the kinds of goods corresponding interaction area range information, determine user's target kinds of goods interested；There is provided and acknowledgement of orders phase The information content of pass, it is described to include with the relevant information content of acknowledgement of orders：The associated attribute information of target kinds of goods and treat Pay resource information；The voice of user and sound-groove model trained in advance are matched, in successful match, triggers delivery operation.
A kind of data object interactive device in fifth aspect present invention provides virtual reality space environment, the dress Put including：
Reality environment provides module, for providing virtual reality shop object internal measurements, the shop pair As internal measurements include it is at least one can interaction data object；
Target data objects determining module, the target data objects interested for determining user；
Sequence information provides module, described related to acknowledgement of orders for offer and the relevant information content of acknowledgement of orders The information content include：The associated attribute information of target data objects and resource information to be paid；
Matching module, for the voice for matching user and sound-groove model trained in advance, in successful match, triggering is paid Operation.
A kind of data object interactive device in sixth aspect present invention provides virtual reality space environment, the dress Put including：
Environmental data memory module, for preserving virtual reality shop object internal measurements data, the shop pair As internal measurements data include it is at least one can interaction data object, it is described can interaction data object be corresponding with interactive areas Domain scope, and it is associated with the preset information content；
Environmental data provides module, for the virtual reality shop object internal measurements data to be supplied to client End, so that the client provides virtual reality shop object internal measurements data, determines user's number of targets interested According to object；Offer and the relevant information content of acknowledgement of orders, it is described to include with the relevant information content of acknowledgement of orders：The target The associated attribute information of data object and resource information to be paid；The voice of user and sound-groove model trained in advance are matched, During successful match, delivery operation is triggered.
A kind of data object interactive device in seventh aspect present invention provides augmented reality space environment, the dress Put including：
Spatial model acquisition module, for obtaining the three-dimensional space model of solid shop internal measurements；The entity Include more than one piece kinds of goods inside shop；
Spatial model matching module, for by preset augmented reality AR equipment by the three-dimensional space model and institute After stating solid shop progress spatial match, provide the kinds of goods corresponding interactive areas in user's scope of sight of the AR equipment Domain range information；
Target kinds of goods determining module, the target kinds of goods interested for determining user；
Sequence information provides module, described related to acknowledgement of orders for offer and the relevant information content of acknowledgement of orders The information content include：The associated attribute information of target kinds of goods and resource information to be paid；
Matching module, for the voice for matching user and sound-groove model trained in advance, in successful match, triggering is paid Operation.
A kind of data object interactive device in eighth aspect present invention provides augmented reality space environment, the dress Put including：
Memory module, for preserving the three-dimensional space model of solid shop internal measurements, inside the solid shop Including more than one piece kinds of goods, corresponding interaction area range information, and with each associated data object of interaction area scope Interaction response information；
Spatial model provides module, for the three-dimensional space model to be supplied to client, so that the client exists After the three-dimensional space model and the solid shop are carried out spatial match by preset augmented reality AR equipment, described There is provided the kinds of goods corresponding interaction area range information in user's scope of sight of AR equipment, determine user's target interested Kinds of goods；Offer and the relevant information content of acknowledgement of orders, it is described to include with the relevant information content of acknowledgement of orders：The target goods The associated attribute information of product and resource information to be paid；Match the voice of user and sound-groove model trained in advance, matching into During work(, delivery operation is triggered.
Above-mentioned technical proposal provided by the invention compared with prior art, has the following advantages that：
Using technical solution provided by the invention, virtual reality shop object internal measurements can be provided, in this way, with Family can obtain the experience placed oneself in the midst of in three-dimensional space environment, also, specific interaction flow can be realized by voice, right For user, it is only necessary to speak and interaction can be achieved, it is most important without in manual input devices such as external handles It is to pay link, without paying manually, but the legitimacy of delivery operation is judged by the vocal print feature of user, and then Decide whether that triggering is paid, ensure that user does shopping the security of payment under virtual reality scenario.
In addition, technical solution provided by the invention, is also based on augmented reality to realize, have above-mentioned identical Advantage.
Brief description of the drawings
In order to illustrate more clearly of the technical solution in the embodiment of the present application, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present application, for For those of ordinary skill in the art, without having to pay creative labor, it can also be obtained according to these attached drawings His attached drawing.
Fig. 1 is a kind of structure diagram of virtual reality device provided by the embodiments of the present application；
Fig. 2 is the data object interaction side in a kind of virtual reality space environment of client provided by the embodiments of the present application The flow example figure of method；
Fig. 3-1 is the display structure figure of the relevant information of data object provided by the embodiments of the present application；
Fig. 3-2 is the displaying exemplary plot of the details of data object provided by the embodiments of the present application；
Fig. 4 is the displaying schematic diagram of " with the relevant information content of acknowledgement of orders information " provided by the embodiments of the present application；
Fig. 5-1 is the exemplary plot of the main navigation space of virtual reality provided by the embodiments of the present application；
Fig. 5-2 is that structure chart is presented in figure provided by the embodiments of the present application；
Fig. 6 is the data object interaction in a kind of virtual reality space environment of server end provided by the embodiments of the present application The flow example figure of method；
Fig. 7 is the data object interaction side in a kind of augmented reality space environment of client provided by the embodiments of the present application The flow diagram of method；
Fig. 8 is the data object interaction in a kind of augmented reality space environment of server end provided by the embodiments of the present application The flow diagram of method；
Fig. 9 is the data object interaction dress in a kind of virtual reality space environment of client provided by the embodiments of the present application The topology example figure put；
Figure 10 is that the data object in a kind of virtual reality space environment of server end provided by the embodiments of the present application is handed over The topology example figure of mutual device；
Figure 11 is the data object interaction in a kind of augmented reality space environment of client provided by the embodiments of the present application The topology example figure of device；
Figure 12 is that the data object in a kind of augmented reality space environment of server end provided by the embodiments of the present application is handed over The topology example figure of mutual device.
Embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, the technical solution in the embodiment of the present application is carried out clear, complete Site preparation describes, it is clear that described embodiments are only a part of embodiments of the present application, instead of all the embodiments.It is based on Embodiment in the application, those of ordinary skill in the art are obtained every other without making creative work Embodiment, shall fall in the protection scope of this application.
In the embodiment of the present application, in order to enable the online shopping flow of user is more approached in actual solid shop lower online Shopping experience, it is proposed that shop object internal measurements are provided by way of virtual reality, wherein can include multiple The data object (for example, merchandise items etc.) that can be interacted, user can carry out data pair in this virtual reality space environment Elephant browses, and interacts.Since virtual reality space environment has the effect of 3 D stereo, the number that user sees No longer it is simple data object list according to object, but as in the solid shop under line, it can be seen that 3 D stereo Space, wherein with shelf etc., data object can be placed on shelf, and user can remove specific data pair from shelf As carrying out checking its details, etc., therefore, the experience that can be done shopping closer to reality under online in solid shop.
In addition, in the embodiment of the present application, in order to further lift user experience, in the mistake that user and system interact Cheng Zhong, it may not be necessary to using external input devices such as handles, but the shopping meaning of user can be judged in a manner of speech recognition Figure, and and then realize the interaction between user, know further via vocal print feature and complete delivery operation otherwise, In this way, in the case where the external input devices such as no handle aid in, user is only obtained with closer to line by interactive voice The experience done shopping in lower solid shop, strengthens the feeling of immersion of user.
In order to realize above-mentioned technical proposal, in software aspects, can be realized by the framework of client-server, its In, server is mainly used for providing data support, such as, it is possible to achieve the virtual reality internal measurements of multiple shop objects Data, and it is supplied to client.Client is mainly used for the front end displaying of data, and interaction is carried out between user.Wherein, The client can be independent application program, alternatively, can also be function module in some complex utility routines etc., example Such as, can be function module in the mobile terminal App such as " mobile phone Taobao ", " Taobao ", etc..
In hardware aspect, a kind of virtual reality device can be used first, this virtual reality device can be collection storage, " integral type " virtual reality device that the functions such as calculating, screen display are integrated, alternatively, can also be only has the function of the " outer of screen display Connect formula " or " movable type " virtual reality device.Wherein, for integral type virtual reality device, since itself is carried The functions such as storage, calculating, therefore, directly can install or be built in this virtual reality device by foregoing client-side program In.And for " circumscribed " virtual reality device, due to when realizing dependent on external PC (personal computer) machine etc. Equipment, therefore, can install client-side program with this PC machine, then circumscribed virtual reality device being connected to the PC machine On, realize virtual reality space environment and interaction.In addition, for " movable type " virtual reality device, needed when realizing It is used cooperatively with intelligent mobile terminal equipments such as mobile phones, for example, " VR glasses box " etc., when in use, can be by intelligence such as mobile phones Energy mobile terminal device is put into glasses box, and the function such as specific storage, calculating is completed by intelligent mobile terminal equipment, " VR Glasses box " is only used for realizing the correlation function of screen display.Therefore,, can be by visitor for this virtual reality device referring to Fig. 1 In the program installation of family end or built-in and intelligent mobile terminal equipment, then this intelligent mobile terminal equipment and movable type is virtual Real world devices are attached, and the function in the embodiment of the present application is realized in both mutual cooperations.
First below from the angle of foregoing client, it is situated between in detail to specific implementation provided by the embodiments of the present application Continue.
Embodiment one
In the embodiment of the present application one, the data object interaction side in a kind of virtual reality space environment provide firstly Method, referring to Fig. 2, this method may comprise steps of 201 to step 205:
Step 201：Client provides virtual reality shop object internal measurements, the shop object inner space ring Border include it is at least one can interaction data object；
Wherein, so-called shop object can refer to " shop " that businessman etc. opens up in online sales platform, in this Shen Solid shop please can also be associated with this shop object is online, for example, supermarket, clothes brand shop etc. in embodiment.Tool , can be by way of modeling when body is realized, layout, commodity display mode under artificial line in shop etc., generate the shop of simulation Internal measurements are spread, alternatively, in order to further lift the authenticity experience of environment, can also be by into solid shop under line The mode of recorded video is carried out, to establish shop object internal measurements, shop is provided a user in virtual reality device During internal measurements, it can be carried out by way of playing this video, so that user can be obtained closer to existing Real shopping experience.
Specifically, due to being supplied to the virtual reality space environment that user watches provided by the video of recording, and In the video of recording, picture has globality, that is, each frame picture is all an entirety, therefore, in order to enable user can Carried out with the data object in picture it is interactive, with realize it is follow-up check the flows such as details, purchase, can also be regarded to what is recorded Frequency is handled.Specific processing procedure, that is, the data object to occurring in video are marked, for example, being drawn in video Occur the position of commodity in certain in face, the identification informations such as the ID of the commodity can be inputted by modes such as mouse clicks, in this way, Subsequently during interaction is carried out with user, it can determine that commodity ID is corresponding in detail by the database of backstage preservation The contents such as feelings information.In this way, being handled by this marking operation, the data object that can to occur in video pictures has can Interactivity.
After the space environment inside the object of shop is entered, realization interacts user with data object, can view number According to the associated information content of object, such as the detail information of data object.
For example, under a kind of specific implementation, the details of data object can include the stereogram of data object As information, and the description information of word property.As shown in figure 3-1, detail information can also be shown from the data object Mark point position is in the process that " divergent shape " changes from small to big.Also, these detail informations can be with the stereo image information Centered on, the description information of the word property is shown in around the stereo-picture.That is, can be by stereo-picture Information is separately shown with text information, also, can be provided for carrying out the stereo-picture rotating operation control Part, in this way, when the regional extent where user's sight focus enters the operational controls, can carry out the stereo-picture Rotation process, can show the stereo-picture at the multiple visual angles of the data object.Also, this operational controls can include being used for To the rotating multiple operational controls of different directions, for example, it may be two direction of rotation, etc. clockwise and anticlockwise.
For example, as shown in figure 3-2, after it is directed at certain alarm clock for user's sight focus, the details letter of the alarm clock showed Breath (is divided into two width pictures of left and right, the binocular vision of corresponding human eye), it is seen then that and detail information includes the stereo-picture of the alarm clock, It can show the multinomial detail information such as title, the price of data object at centrally located 301 at surrounding 302.And And below the stereo-picture in center, two pivot controls 303 are additionally provided, it is respectively used to clockwise and counterclockwise Direction rotary stereo image.It should be noted that the detail information content on specific reality in the Fig. 3-2, the application are implemented It is not defined in example, therefore, in figure shows that the readability of text or pictorial information does not interfere with the embodiment of the present application Protection domain.
Wherein, the stereo-picture of data object can be generated by the photo for the acquisition that to actual kinds of goods take pictures, The photo of real scene shooting can be from the multiple pictures of multiple viewing angles, and synthesis obtains the bandwagon effect of 3 D stereo, and can be with Change visual angle by rotating the stereo-picture, the details of the understanding data object comprehensive from multiple angles.
In the embodiment of the present application, in order to provide 360 degree of the stereo-picture on data object, and cause vertical Body image has the bandwagon effect of authenticity, and the data processing operation of early period can also include：Specific data object is corresponded to Kinds of goods take pictures from multiple shooting angle, and the photo of multiple shooting angle shooting is preserved, in this way, subsequently having in user When checking the demand of the stereo-picture of multiple angles, it can be provided according to the multiple pictures of preservation.
Step 202：Determine user's target data objects interested；
After the space environment inside the object of shop is entered, user can interact between data object, so that really The fixed shopping target of oneself, for system, the shopping that can identify user according to the interaction scenario of user is intended to.
Specifically when identifying user view, the embodiment of the present application may not necessarily be by external input devices such as handles, also not Need to launch the modes such as certain ray by VR equipment to determine, but can determine use by way of user's interactive voice The shopping at family is intended to, alternatively, can identify that the shopping of user is intended to by identifying user's sight focal position.
In the embodiment of the present application, during specific implementation, step 202 can be realized as follows：
Identify the voice of user whether comprising in the associated information of a certain data object that can be in interaction data object Hold, if so, then using the data object target data objects interested as user.
During specific implementation, user can pass through the recording of VR equipment after checking and having understood the details of data object Component such as microphone, typing voice, points out oneself target data objects interested by way of interactive voice.Client terminates The voice is received, which is identified, whether is identified in the voice comprising in the virtual reality shop object currently provided Some in portion's space environment or it is multiple can interaction data object related information content, wherein, one can interaction data pair The related information content of elephant be can clearly correspond to this can interaction data object content.In practical applications, can also be into one Whether comprising the content that can characterize buying intention implication in the voice of step identification user, wherein, buying intention can be characterized and contained The content of justice can include：Characterize the word of buying intention, such as " addition shopping cart ", " buying immediately ", etc..
In the embodiment of the present application, during specific implementation, step 202 can be realized as follows：
Determine user's sight focal position；And
When the sight focal position enters in the range of the interaction area of a certain data object, and residence time reaches pre- When putting time threshold, which is determined as user's target data objects interested.
If user is after the details of data object are checked, it is believed that the needs of data object meets oneself, then can The intention for buying the data object is produced, at this time, sight focus can be directed at the interaction area where the data object by user Scope, and stopped after a certain period of time in sight focus, system is that the shopping that may recognize that user is intended to.
In addition, when providing data object information details, can be provided for performing the data object purchase operation Operational controls, " immediately buy " button as shown in Fig. 3-2 304 etc.." purchased immediately when user's sight focus enters Buy " in regional extent where button, and when residence time reaches preset time threshold value, then can determine that the data object is User's target data objects interested.That is, if user is after the details of target data objects are checked, it is believed that the number The needs of meeting oneself according to object, then can produce the intention for buying the data object, at this time, sight focus can be aligned by user Regional extent where " being used for the operational controls that purchase operation is performed to the data object ", and stop a timing in sight focus Between after, system is that may recognize that the buying intention of user.
During specific implementation, user's sight focal position and user speech are can be combined with to determine user's target interested Data object；User's data object interested is first determined according to user's sight focal position, then, then identifies the voice of user In whether comprising the content of buying intention implication can be characterized, wherein, can characterize the content of buying intention implication can include： Characterize the word of buying intention, such as " addition shopping cart ", " buying immediately ", etc..In practical applications, energy can be collected in advance The word of buying intention is enough characterized, then, when identifying user speech, user speech content is parsed, voice content is changed into text This content, carries out word segmentation processing to content of text, is then identified by morphology, the matched mode of the meaning of a word.
Step 203：There is provided and the relevant information content of acknowledgement of orders, the described and relevant information content bag of acknowledgement of orders Include：The associated attribute information of target data objects and resource information to be paid；
After step 202 identifies that the shopping of user is intended to, the relevant information for carrying out acknowledgement of orders is provided with, such as " with the relevant information content of acknowledgement of orders " in Fig. 4 shown in 401, during specific implementation, in the relevant information of acknowledgement of orders Hold, can include many information, specifically can include determining that ship-to, purchase data object title, buy Whether data object quantity, use virtual resources such as certain " reward vouchers ", etc..
During specific implementation, first information panel can be provided, described and acknowledgement of orders is provided on the first information panel The relevant information content.When user's sight focal position is removed from the first information panel, by the first information panel Close.The area of the first information panel can be less than the area of user's scope of sight, currently true with order for the ease of exiting Recognize the displaying of the relevant information content, corresponding implementation is additionally provided in the embodiment of the present application.
Specifically, can be to the sight focus of user into line trace, when user's sight focal position is from the first information face When plate is removed, then the first information panel can be closed, correspondingly, currently no longer being opened up with the relevant information content of acknowledgement of orders Show, user can continue to browse other data objects.That is, in this manner, it may not be necessary in first information face Operational controls, users such as " X buttons " is set only to need to move in the region where sight focus from the information panel in plate Open, you can the closing of the first information panel is triggered, so as to the operation of more aspect user.
On the page with the relevant information content of acknowledgement of orders is shown, it can also be respectively provide for confirming every letter The operational controls of breath.
It is described to include with the relevant information content of acknowledgement of orders during specific implementation：For to order relevant information The first operational controls modified；
When in the regional extent where user's sight focus enters first operational controls, and residence time reaches During preset time threshold value, there is provided the second information panel, and provided in second information panel and be used to change the order phase Close the content of information.
For example, it is assumed that user needs to modify to the ship-to of current default, then can be controlled by first operation Part is triggered.Specifically, in the embodiment of the present application, the mode of sight fusing is again may be by be triggered.Also It is to say, when in the regional extent where user's sight focus enters first operational controls, and residence time reaches pre- When putting time threshold, there is provided the second information panel, and provided in second information panel and be used to change the order correlation The content of information.Wherein, if user have selected other ship-to, the second information panel is automatically closed, if user After each ship-to has been browsed, it is not necessary to change, then can be operated by X button in second information panel etc. empty Between, to close second information panel, alternatively, being closed by voice control.At this time, the exhibition of first information panel is continued Show.
It is described to include with the relevant information content of acknowledgement of orders during specific implementation：For to target data objects Quantity increase/reduce the second operational controls of operation；
When user's sight focal position enters second operational controls, and residence time reaches preset time threshold value When, the quantity of the target data objects is performed on the basis of initial value to plus one/the operation that subtracts one.
If the sight focal position enters second operational controls, and residence time reaches preset time threshold value Do not leave yet afterwards, then continue to perform the quantity of the target data objects plus one/the operation that subtracts one, and continue to execute plus one/subtract During one operation, the time interval of execution is less than the preset time threshold value.
In practical applications, there may be the demand of purchase more than one piece, at this time, user needs to connect this second operational controls Continuous operation is multiple, if not doing specially treated, user needs that sight focus first is directed at second operational controls, stops 3S Afterwards, data object quantity adds 1, and then sight focus is removed from the control, then enters back into the control, and so on, it is necessary to Repeat repeatedly, it is clear that this can take the more time, and can also make user feel not enough to facilitate.
For this reason, in the embodiment of the present application, following specially treated can also be carried out：If the sight focal position enters Second operational controls, and residence time reach preset time threshold value after do not leave yet, then continue to the target data The quantity of object performs plus one/operation that subtracts one, and continue to execute plus one/operation that subtracts one when, the time interval of execution is less than described Preset time threshold value.That is, user's focus vision this second operational controls (for example, perform " increase " operate control Part) on when, trigger first time fusing process, after undergoing preset time threshold, by data object quantity on original basis Upper to add 1, afterwards, if sight is not left, second of fusing of triggering, after fusing every time, data object quantity is all in original base Add 1 on plinth again, also, the time of the follow-up experience of fusing process every time can shorten, for example, being for the first time 3S, for the second time It can be 2S, can be 1S for the third time, and so on.It is, of course, also possible to shortest fusing time is limited, for example, most It is short to be shorter than 1S, then mean the 4th time and follow-up each secondary fusing process can be the time for undergoing 1S.
After the confirmation operation of every terms of information is completed, it is possible to submit order, enter follow-up delivery operation flow.Visitor Family end is after offer with the relevant information content of acknowledgement of orders, it is believed that, can be direct after user has known order relevant information Step 204 is performed, can also first determine that user completes the confirmation of sequence information, Ran Houzai in the following manner with user mutual Perform step 204.
A kind of mode when providing the information content relevant with acknowledgement of orders, is also provided and verifies content, in the verification Hold and generated according at least part attribute information of target data objects；Then, identify in the voice of user and whether include the school Content is tested, if, it is determined that user has completed the confirmation of sequence information.
Wherein, the attribute information of target data objects refers to and target data objects are relevant can characterize target data pair As the information of characteristic, can include：Commodity title, commodity color, commercial size, model, material, brand, configuration, grade, bag Dressing amount, date of manufacture, shelf-life, purposes, price, the place of production etc., then verification content above is exactly according to target data One or more attribute information of object and generate.
Such as：User's target data objects interested are golden ihpone7 mobile phones, then in the manner described above, can be with The attribute information of the target data objects is obtained, " verification content " is then generated according at least part attribute information, for example, the school It is " golden iphone7Plus 256GB crudely-made articles " to test content, in the embodiment of the present application, it is main to provide the verification content to the user It is to facilitate user quickly to confirm the commodity oneself to be bought, and this buying behavior is confirmed by interactive voice mode.In addition, also Order can be determined by reading the verification content by text prompt user.User views the verification content, and reading should Content is verified, system will identify the voice of user, judge whether include " golden iphone7Plus 256GB rows in the voice The content of goods ", if comprising, it is determined that user speech confirms sequence information.In subsequent match, it is only necessary to which user is exported The voice comprising the verification content matched with sound-groove model trained in advance, so both can guarantee that the reliable of matching result Property, it can also accelerate matching efficiency, additionally it is possible to simplify the interactive operation of user.
Another way is that, when providing the information content relevant with acknowledgement of orders, client also provides a check code； Then, identify in the voice of user and whether include the check code, if, it is determined that user has completed the confirmation of sequence information.Its In, the check code can be generated at random by client.
In practical applications, it is possible that since user misunderstands check code or cacoepy, recognition failures are caused Situation, then for such case, in specific implementation, can also retransmit another string random number, so that user is according to described another A string of random numbers re-execute the operation for the information that confirms an order.As can be seen that by way of repeatedly sending check code, to user The chance for the information that repeatedly confirms an order is provided, there is certain fault-tolerance；Such as：User can be allowed to do n times trial, N can be with Set according to the actual requirements, such as could be provided as 3.
Since in addition to user oneself, other people are hardly visible the check code, therefore, can effectively prevent by this way Other people illegally trigger the operation to confirm an order, the security that order that can be under effective guarantee virtual reality scenario is paid.
Another way is to determine user's sight focal position；When the sight focal position enters this and acknowledgement of orders In the range of the interaction area of the relevant information content, and when residence time reaches preset time threshold value, determine that user has completed The confirmation of sequence information.
During specific implementation, client is being provided with after the relevant information content of acknowledgement of orders, finding the sight of user When focus is entered in the range of the interaction area of " with the relevant information content of acknowledgement of orders ", it is possible to trigger " fusing " machine System, that is, timing can be proceeded by by a timer, if the residence time in the range of the interaction area reaches certain Time threshold (for example, 3S), then can determine that user confirms the order contents, then client is carried out step 204.
Also a kind of mode is whether to include the word that can characterize the implication that confirms an order in the voice for identify user, if It is, it is determined that user has completed the confirmation of sequence information.
During specific implementation, client is provided checks this with after the relevant information content of acknowledgement of orders, obtaining user Whether the voice sent after the information content, then, client are identified in the voice comprising the word that can characterize the implication that confirms an order Language, wherein, can characterize the word for the implication that confirms an order can include：The word such as " placing an order ", " confirmation ", " payment ", " ok ".
Step 204：The voice of user and sound-groove model trained in advance are matched, in successful match, triggers delivery operation.
Since delivery operation is related to the property and privacy of user, and in real world, user provides bank card and oneself hand Dynamic input password, or user oneself carry out network payment face to face using intelligent terminal, and this payment behavior can ensure to use The legitimacy of family delivery operation, but under virtual reality scenario, user can not implement this payment behavior, therefore, the application In embodiment, it is also necessary to user identity legitimacy is verified, to confirm the legitimacy and security that this time pay, with effective Avoid the malice delivery operation of illegal person.
In the embodiment of the present application, it is proposed that the legitimacy of user identity is verified using the vocal print feature of user, Since everyone vocal print feature is unique, there is uniqueness, it is difficult to be imitated by other people to be under normal circumstances, therefore, is led to The reliability of verification can be ensured by crossing the verification for the legitimacy that vocal print feature carries out user identity.
In the embodiment of the present application, on the voice for how matching user in step 204 and vocal print mould trained in advance Type additionally provides several optional modes, and these types of mode is explained below.
A kind of mode is to collect the voice of user, then matches the voice being collected into and sound-groove model trained in advance, such as Fruit, all voices being collected into and a certain sound-groove model of training in advance match, then show successful match, at this time, triggering branch Pay operation.When paying successfully, payment successful information can also be provided, if cause to pay failure for some reason, also may be used Failure information is paid to provide, to prompt user this time to pay failure, for example, Sorry, your ticket has not enough value for prompting user account, can not be completed Pay etc..
Another way is, according to the device identification of client or user identifier, from multiple vocal print moulds of training in advance Sound-groove model corresponding with the device identification is selected in type or selectes sound-groove model corresponding with the user identifier；Then again Match the voice of user and selected sound-groove model.
In this fashion, the voice of user can be understood as all voices that user is sent when using VR equipment, this Sample, it is ensured that the reliability of matching result.The voice of the user can also be that user is checked " with the relevant letter of acknowledgement of orders The voice sent after breath content ", can so reduce matched operand.
Ergodic Model Matching is compared by means of which, and matching efficiency can be greatly improved.Wherein, device identification refers to The unique mark of client, such as client id, user identifier are to refer to the unique mark of identification user, and such as user name, use The marks such as family numbering.
In the embodiment of the present application, on triggering delivery operation it is to be understood that client can trigger what is be locally configured For completing the APP of payment transaction, the APP is set to complete to pay according to the pre-registered related payment account information of user, for example, The fund of user account is transferred to merchant account.The triggering delivery operation is it is also understood that client triggering is used to complete The server of payment transaction, the server are completed to pay according to the pre-registered related payment account information of user.The phase of user Closing payment account information can include：User's bank account and password, user's virtual resource account and password etc..Complete to pay Afterwards, client can also provide payment result information, to notify user's this time delivery operation success or failure.
In order to support the verification to user identity legitimacy, in the embodiment of the present application, it is necessary to which training in advance obtains user Sound-groove model, when realizing, the training of sound-groove model can be previously-completed by following training method, the training method bag Include：
Gather a plurality of voice of user；
Extract the respective MFCC cepstrum coefficients of every voice in a plurality of voice；
Trained to obtain the corresponding sound-groove model of the user according to the MFCC cepstrum coefficients.
In hands-on, a plurality of voice of offline mode collection user can be used, voice number is more, trained mould Type is more reliable.When realizing, user can record the voice of oneself by mobile phone or other-end, by the voice recorded Pass to speech collecting system；Certainly, the recording access that user can also provide in the speech collecting system, direct recording oneself Voice；The speech collecting system first docks received voice and is pre-processed, and pretreatment is primarily to remove non-speech audio With silent voice signal, and sub-frame processing is carried out to voice signal, data basis is provided with follow-up model training.In training Preceding (Mel Frequency Cepstrum Coefficient, MFCC) parameter for first extracting each frame voice signal, MFCC, The abbreviation of Mel frequency cepstral coefficients, Mel frequencies are put forward based on human hearing characteristic, it is with Hz frequencies into non-linear right It should be related to.MFCC is then the Hz spectrum signatures being calculated using this relation between them.Everyone sound spectrum is only Special, then MFCC is capable of the sound characteristic of unique mark user.When sound-groove model is trained, the present invention can use Gaussian Mixture Model, the voice uploaded using user and the corresponding MFCC parameters of voice, training gauss hybrid models, obtain being specific to the use The sound-groove model at family.
Explanation is needed exist for, in order to enable trained sound-groove model is capable of the sound of real surface requisition family reality in advance Line feature, the embodiment of the present application additionally provide the method on being optimized to sound-groove model.
During specific implementation, voice of the user under virtual reality scenario is collected, using the voice being collected into the user's Sound-groove model optimizes.Voice of this optimal way without gathering user by special channel, merely with user in void The voice intended under reality scene optimizes sound-groove model, which simple possible, and the reliability of effect of optimization is more By force.
In the embodiment of the present application, the sound-groove model of some specific user can be only trained in advance, then is only this use Family provides service, certainly, in order to provide service to multi-user, can also be trained in advance for each user in multi-user exclusive In the sound-groove model of isolated user.
As it can be seen that by the embodiment of the present application, shop object internal measurements can be provided by way of virtual reality, Multiple data objects interacted can wherein be included, and it is possible to determine that the shopping of user is intended to by user speech, into And it is intended to by the vocal print feature of user to determine the payment of user, it is ensured that the security of delivery operation, whole process need not By means of external input devices such as handles, simplify user's operation, so that the shopping for improving user pays experience.
It should be noted that in practical applications, before abovementioned steps S201, the preparation of some early periods can also be carried out Work.For example, by taking " movable type " virtual reality device (for example, VR glasses box) as an example, can be set in mobile terminals such as mobile phones Standby middle installation client provided by the embodiments of the present application, then, mobile phone is put into VR glasses boxes.In addition, in practical application In, it is also possible to the configuration operation of the early periods such as ship-to is logged in, inputted there are some, in the embodiment of the present application, in order to ensure User on tape after VR glasses box, can swimmingly do shopping, and can take eye in user by complicated configuration operation is preposition Before mirror, it can include：Log in, add ship-to, payment account information etc..For example, user by mobile phone " mobile phone is washed in a pan When treasured " client checks " double 11 meeting-place " page, find that including relevant virtual reality entrance, then the entrance can be passed through Into at this point it is possible to judge whether user logs in, if added ship-to etc., if it is not, user can be guided Perform login, add the operation of ship-to.Furthermore it is also possible to remind user that mobile phone is laterally disposed, also, can also show Preset small animation.It should be noted that in practical applications, except judging whether user logs in, it can also judge user Whether the type of the mobile terminal devices such as the mobile phone used is supported, if it does not, can then be prompted.Furthermore it is also possible to Judge whether current client release is supported, if it does not, the upgrading of user's progress client release can be guided, etc. Deng.In the final step of the flow, mobile phone can be put into VR glasses boxes.
It is multiple due to that may have with the shop object being shown in a manner of virtual reality, mobile phone inserts VR After mirror case, main navigation space can also be initially entered, that is, the space environment for selecting shop object.It equivalent to The homepage of website, but unlike, main navigation space is a three dimensions in the system, and user can be by rotating up and down Explore it in head.Wherein, under a kind of concrete implementation mode, as shown in fig. 5-1, in the main navigation space, sight is initial Position can be a stifled photo wall, each dynamic photo represents some some national city the street in the world on wall One shop, content shown in an action shot equally can be the StoreFront videos truly recorded, it may for example comprise outside shop front Streetscape etc..
In order to enable user can from main navigation space selection target shop object, can be in this main navigation space Operation layer is added between environment layer and screen layer.Wherein, environment layer can be understood as virtual reality scenario, and operation layer can be managed Solve and can be understood as client control for GUI, screen layer.As shown in Fig. 5-2, in the operation layer, can be set with respectively with The position of the dynamic picture of each shop object and size are corresponding " bounding box ", and using this " bounding box " as corresponding shop Spread object interaction area scope, in this way, user can by by focus vision in some corresponding interaction area of shop object In the range of and the mode such as stay for some time, to trigger the internal measurements into the shop object.
After triggering enters target shop object, client can be to the virtual of the server acquisition request target shop object Realistic space environmental data, and carry out parsing and the operation such as render, therefore, enters target shop from triggering, to actually showing this Target shop internal measurements interface, may undergo a period of time.In the embodiment of the present application, within the time, may be used also Using main navigation space environment changing as with the associated interlude video of selected shop object, wherein, it is described interlude video use The scenery that can be watched in solid shop way under the selected corresponding line of shop object is gone in displaying.For example, it can open up " space-time shuttle " effect is shown, user, which can be felt from current navigation room, to come on the vehicles, and comes specific shop The street outside paving, finally enters shop door, etc..Wherein, for different shop objects, by solid shop institute under corresponding line Geographical location have nothing in common with each other, therefore, can each correspond to different interlude videos so that user can obtain truer Experience.
Embodiment two
The embodiment two is corresponding with embodiment one, from the angle of server, to tool provided by the embodiments of the present application Body scheme is introduced.
Specifically, referring to Fig. 6, which provides the data object interaction side in a kind of virtual reality space environment Method, this method may comprise steps of：
Step 601：Server preserves virtual reality shop object internal measurements data, and the shop object inside is empty Between environmental data include it is at least one can interaction data object, it is described can interaction data object be corresponding with interaction area scope, And it is associated with the preset information content；
During specific implementation, server can gather associated video data in solid shop etc., and the processing such as be labeled Operation, generation virtual reality shop object internal measurements data, and preserved.
Step 602：The virtual reality shop object internal measurements data are supplied to client, so as to the visitor Family end provides virtual reality shop object internal measurements data, determines user's target data objects interested；There is provided with The relevant information content of acknowledgement of orders, it is described to include with the relevant information content of acknowledgement of orders：The target data objects association Attribute information and resource information to be paid；The voice of user and sound-groove model trained in advance are matched, in successful match, is touched Send out delivery operation.
The virtual reality shop object internal measurements data of generation can be supplied directly to client by server, or Person, can also be supplied to client, client is obtaining accordingly when receiving the request of client, then by relevant data After data, virtual reality space environment can be provided, and realize and interacting between user based on the environment, it is possible to achieve complete Whole shopping process.
It may refer to the introduction in previous embodiment one on other specific implementations in the embodiment two, it is no longer superfluous here State.
Embodiment three
Foregoing embodiments are all based on virtual reality technology and provide various specific solutions, and are implementing When, augmented reality is also based on to realize.Wherein, can on the difference between virtual reality and augmented reality To be simply interpreted as：In reality environment, the content of " environment layer " display is by simulation or in advance to entity space Virtual environment that the shooting mode such as video provides, the information of " operation layer ", including pair can interactive object opereating specification mark, be right Displaying of interaction response information etc., is realized based on content shown in this virtual environment layer；And augmented reality is empty Between in environment, the content of " environment layer " display is content actual in entity space, the information in " operation layer ", including to kinds of goods Markup information of operating area scope etc., can be labeled based on the three-dimensional space model pre-established, in actual displayed When, entity space and three-dimensional space model are subjected to spatial match first, then pass through the computer vision ability of AR equipment again Positioned, markup information preserved in three-dimensional space model etc. is illustrated in the scope of sight of AR equipment, user is actually saturating Crossing the content that AR equipment is seen includes the environment in entity space, and is superimposed upon the information of " enhancing " on the environment.
Therefore, in the embodiment of the present application, if providing corresponding technical solution based on augmented reality, then may be used Establishment three-dimensional space model is carried out with the solid shop being directed in advance under line, then, is realized and used based on the three-dimensional space model The information exchange at family.
Wherein, in order to establish three-dimensional space model, concrete implementation mode can have it is a variety of, for example, one kind side wherein Under formula, the AR equipment such as AR glasses can be worn by staff and entered in the shop inner space of entity, and in shop expert Walk.Since AR equipment carries the sensing equipments such as camera, this sensing equipment pair can be utilized during walking Shop and its interior layout are scanned.After scanning result is obtained, it can imported into development environment.This development environment leads to It can often support to be labeled scanning result, therefore, scanning result can be labeled by staff.If for example, Shop includes multiple shelf, is used to place specific storage object (for example, " kinds of goods " etc.) on each shelf, then can be to goods The corresponding data object tag of the numbering of frame, kinds of goods (such as commodity ID etc.) information etc. is labeled.After mark is completed, system The information such as the numbering of each shelf, corresponding inventory information can be preserved, meanwhile, on each shelf, the position coordinates of kinds of goods Etc. information, system can be automatically generated and preserved, and the corresponding three-dimensional space model in the shop is generated with this.In addition, on specific During being interacted with user, it is desirable to provide the information such as data object details gone out, can pre-establish data object Detail information database, when being labeled, ID that can also be according to the corresponding data object of specific kinds of goods in the database It is labeled etc. mark, in this manner it is possible to by the detailed of the data object preserved in the kinds of goods and database in augmented reality space Association is set up between feelings information.
,, can be advance on software view in order to realize the interactive function provided in the embodiment of the present application during specific implementation Realize relevant client (including application program, or relevant function module etc.).Client can by diversified forms with AR equipment is used cooperatively.Specifically, for integral type AR equipment (that is, by AR equipment independently undertake screen display, calculating, The tasks such as storage) for, directly the client can be installed in AR equipment so that AR equipment has in the embodiment of the present application Interactive function.Alternatively, for portable AR equipment, since portable AR equipment usually only undertakes screen display task, , therefore, in this case, can also will in use, it is generally necessary to the mobile terminal devices such as mobile phone are connected with the AR equipment Client is installed in the mobile terminal devices such as mobile phone, in this way, being mounted with that the mobile terminal device of the client is placed on AR After in equipment, it is possible to so that AR equipment has the interactive function described in the embodiment of the present application.In addition, three-dimensional space model is given birth to Cheng Hou, can be saved directly in the terminal device where client, alternatively, can also store in server, client exists When needing to interact, then the corresponding three-dimensional space model in current shop is downloaded from server.In short, client no matter It is that directly client is installed in AR equipment, is also mounted in mobile terminal device, AR equipment can be caused to be based on this Kind client, with reference to the three-dimensional space model of foregoing generation, realizes specific interaction.
Specifically, referring to Fig. 7, which provides the data object interaction side in a kind of augmented reality space environment Method, this method may comprise steps of：
Step 701：Client obtains the three-dimensional space model of solid shop internal measurements；Inside the solid shop Including more than one piece kinds of goods；
Step 702：By preset augmented reality AR equipment by the three-dimensional space model and the solid shop into After row spatial match, provide the kinds of goods corresponding interaction area range information in user's scope of sight of the AR equipment；
When consumer needs to be done shopping into solid shop as user, relevant AR equipment (including one can be worn The AR equipment of body formula, or be connected to the portable AR equipment of mobile terminal device), enter in solid shop, afterwards, can be with Start relevant client.After client is activated, initialization process can be carried out first, can specifically be included, by described three Dimension space model carries out spatial match with the solid shop.So-called spatial match, that is to say, that can be by three dimensions mould Type is matched with actual solid shop so that position in position and solid shop, direction in three dimensions etc. are opposite Should, the information that can so " to strengthen " is accurately shown in the position corresponded in scope of sight where kinds of goods.
Specifically the method for progress spatial match can have a variety of, can be in advance in three-dimensional space for example, under a kind of mode Between preserve some characteristic points in model, for example, four in space corner position etc., consumer-user wears the AR such as AR glasses After equipment enters solid shop, start application program first, afterwards, can be empty in storage in the state of AR glasses are adorned oneself with Between look about one week, the sensor device of AR glasses can be scanned parking space, afterwards, can utilize characteristic point and Scanning result, characteristic point is matched with the point of physical location in parking space, to determine the position of three-dimensional space model Put, direction etc., so as to complete spatial match, it is final so that in three-dimensional space model each point position, with corresponding to solid shop/brick and mortar store Physical location, direction in paving is consistent.Certainly, in specific implementation, spatial match, example can also be realized by other means Such as, it is possible to achieve automatically matching, etc., is no longer described in detail one by one here.
After spatial match is completed, it is possible to which it is corresponding in user's scope of sight of the AR equipment to provide the kinds of goods Interaction area information, for example, shipment can be shown in scope of sight by increasing modes such as " operation layers " in scope of sight The operable area of product, for example, in position display one " blue round dot " where each kinds of goods, etc..
Step 703：Determine user's target kinds of goods interested；
Step 704：There is provided and the relevant information content of acknowledgement of orders, the described and relevant information content bag of acknowledgement of orders Include：The associated attribute information of target kinds of goods and resource information to be paid；
Step 705：The voice of user and sound-groove model trained in advance are matched, in successful match, triggers delivery operation.
After the corresponding interaction area information of kinds of goods is provided, in follow-up specific interaction, feel emerging on user Definite, the offer of various interaction response information of the target kinds of goods of interest, and offer and its interaction side of all types of operational controls Formula, can be similar with the implementation in virtual reality space relative to improvement of the prior art, etc., no longer superfluous here State.
Example IV
The example IV is introduction corresponding with embodiment three, being carried out from server side, specifically, referring to Fig. 8, This embodiment offers the data object exchange method in a kind of augmented reality space environment, this method can include：
Step 801：Server preserves the three-dimensional space model of solid shop internal measurements, inside the solid shop Including more than one piece kinds of goods, corresponding interaction area range information, and with each associated data object of interaction area scope Interaction response information；
Step 802：The three-dimensional space model is supplied to client, so that the client is passing through preset enhancing After the three-dimensional space model and the solid shop are carried out spatial match by real AR equipment, regarded in the user of the AR equipment There is provided the kinds of goods corresponding interaction area range information in the range of domain, determine user's target kinds of goods interested；There is provided and order Single relevant information content of confirmation, it is described to include with the relevant information content of acknowledgement of orders：The associated attribute of target kinds of goods Information and resource information to be paid；The voice of user and sound-groove model trained in advance are matched, in successful match, triggering is paid Operation.
The three-dimensional space model for the solid shop internal measurements that server can preserve is supplied directly to client, or Person, can also be supplied to client, client is obtaining accordingly when receiving the request of client, then by relevant data After data, augmented reality space environment can be provided, and realize and interacting between user based on the environment, it is possible to achieve complete Whole shopping process.
On above-described embodiment three and four, involved in specific information interactive process to realize details, including relative to Improvement of the prior art etc., may refer to the record in foregoing individual embodiments, which is not described herein again.
Embodiment five
The embodiment five be with a kind of corresponding device of one client approach of embodiment, referring to Fig. 9, which provides A kind of data object interactive device in virtual reality space environment, the device are applied to client, and described device includes：
Reality environment provides module 901, for providing virtual reality shop object internal measurements, the shop Object internal measurements include it is at least one can interaction data object；
Target data objects determining module 902, the target data objects interested for determining user；
Sequence information provides module 903, for provide with the relevant information content of acknowledgement of orders, it is described with acknowledgement of orders phase The information content of pass includes：The associated attribute information of target data objects and resource information to be paid；
Matching module 904, for matching the voice and sound-groove model trained in advance, in successful match, triggering of user Delivery operation.
In the embodiment of the present application, optionally, described device can also include：
Order determining module, for determining that user has completed the confirmation of sequence information.
Further, optionally, the order determining module, can include：
Verify content and submodule is provided, for when providing the information content relevant with acknowledgement of orders, also providing in verification Hold, the verification content is generated according at least part attribute information of target data objects；
Content recognition submodule is verified, whether the verification content is included in the voice for identifying user, if so, then true Determine the confirmation that user has completed sequence information.
Optionally, the matching module, including：Matched sub-block, for matching that user sends comprising verification content Voice and sound-groove model trained in advance.
Further, optionally, the order determining module, can include：
Identifying code provides submodule, for when providing the information content relevant with acknowledgement of orders, there is provided a check code；
Check code identifies submodule, and whether the check code is included in the voice for identifying user, if, it is determined that user The confirmation of sequence information is completed.
Optionally, the check code is generated at random by client.
Optionally, the matching module, including：Matched sub-block, the language for including check code sent for matching user Sound and sound-groove model trained in advance.
Optionally, the check code identification submodule, can be also used for not including the verification in the voice of identification user During code, triggering identifying code provides submodule, so that the identifying code provides module and provides another check code, then the check code is known Small pin for the case module identifies in the voice of user whether include another check code again, if, it is determined that user has completed sequence information Confirmation.
Optionally, the order determining module, can include：
Sight focal position determination sub-module, for determining user's sight focal position；
Order determination sub-module, for entering this and the relevant information content of acknowledgement of orders when the sight focal position In the range of interaction area, and when residence time reaches preset time threshold value, determine that user has completed the confirmation of sequence information.
Optionally, the order determining module, can include：
Whether speech recognition submodule, confirm an order in implication comprising can characterize in the voice for identifying user Hold, if, it is determined that user has completed the confirmation of sequence information.
Optionally, the target data objects determining module, can include：
Sight focal position determination sub-module, for determining user's sight focal position；
Target data objects determination sub-module, for entering the interactive areas of a certain data object when the sight focal position In the range of domain, and when residence time reaches preset time threshold value, which is determined as user's number of targets interested According to object.
Optionally, the target data objects determining module, can include：
Speech recognition submodule, for identifying the voice of user whether comprising a certain number that can be in interaction data object According to the associated information content of object, if so, then using the data object target data objects interested as user.
Optionally, described device further includes：
Reminding module, for not including a certain data object that can be in interaction data object in the voice of identification user During the associated information content, there is provided for prompting user to select the invalid information content.
Optionally, the matching module, can include：
Sound-groove model selectes submodule, for the device identification according to client or user identifier, from training in advance Sound-groove model corresponding with the device identification is selected in multiple sound-groove models or selectes vocal print corresponding with the user identifier Model；
Matched sub-block, for the voice for matching user and selected sound-groove model.
Optionally, described device further includes：Sound-groove model training module,
The sound-groove model training module, including：
Voice collecting submodule, for gathering a plurality of voice of user；
Extracting sub-module, for extracting the respective MFCC cepstrum coefficients of every voice in a plurality of voice；
Training submodule, for being trained to obtain the corresponding sound-groove model of the user according to the MFCC cepstrum coefficients.
Optionally, described device further includes：Sound-groove model optimization module, for the voice that is sent using the user to pre- First the sound-groove model of the user optimizes in trained sound-groove model.
Operation principle and modules, the specific implementation of submodule on the device in the embodiment five may refer to Introduction in previous embodiment one, which is not described herein again.
Embodiment six
The embodiment six be with a kind of corresponding device of two server end method of embodiment, referring to Figure 10, the embodiment The data object interactive device in a kind of virtual reality space environment is provided, which is applied to server end, described device Including：
Environmental data memory module 1001, for preserving virtual reality shop object internal measurements data, the shop Paving object internal measurements data include it is at least one can interaction data object, it is described can interaction data object be corresponding with friendship Mutual regional extent, and it is associated with the preset information content；
Environmental data provides module 1002, for the virtual reality shop object internal measurements data to be supplied to Client, so that the client provides virtual reality shop object internal measurements data, determines user's mesh interested Mark data object；Offer and the relevant information content of acknowledgement of orders, it is described to include with the relevant information content of acknowledgement of orders：It is described The associated attribute information of target data objects and resource information to be paid；Match the voice of user and vocal print mould trained in advance Type, in successful match, triggers delivery operation.
Foregoing reality is may refer on the operation principle of the device in the embodiment six and the specific implementation of modules The introduction in example one, two is applied, which is not described herein again.
Embodiment seven
The embodiment seven be with a kind of corresponding device of three client approach of embodiment, referring to Figure 11, which carries The data object interactive device in a kind of augmented reality space environment is supplied, which is applied to client, and described device includes：
Spatial model acquisition module 1101, for obtaining the three-dimensional space model of solid shop internal measurements；It is described Include more than one piece kinds of goods inside solid shop；
Spatial model matching module 1102, for by preset augmented reality AR equipment by the three-dimensional space model After carrying out spatial match with the solid shop, provide the kinds of goods corresponding friendship in user's scope of sight of the AR equipment Mutual regional extent information；
Target kinds of goods determining module 1103, the target kinds of goods interested for determining user；
Sequence information provides module 1104, for providing and the relevant information content of acknowledgement of orders, described and acknowledgement of orders The relevant information content includes：The associated attribute information of target kinds of goods and resource information to be paid；
Matching module 1105, for matching the voice and sound-groove model trained in advance, in successful match, triggering of user Delivery operation.
Foregoing reality is may refer on the operation principle of the device in the embodiment seven and the specific implementation of modules The introduction in example three is applied, which is not described herein again.
Embodiment eight
The embodiment eight be with a kind of corresponding device of example IV server end method, referring to Figure 12, the embodiment The data object interactive device in a kind of augmented reality space environment is provided, which is applied to server end, described device Including：
Memory module 1201, for preserving the three-dimensional space model of solid shop internal measurements, the solid shop Inside includes more than one piece kinds of goods, corresponding interaction area range information, and with each associated data pair of interaction area scope The interaction response information of elephant；
Spatial model provides module 1202, for the three-dimensional space model to be supplied to client, so as to the client Hold after the three-dimensional space model and the solid shop are carried out spatial match by preset augmented reality AR equipment, There is provided the kinds of goods corresponding interaction area range information in user's scope of sight of the AR equipment, determine that user is interested Target kinds of goods；Offer and the relevant information content of acknowledgement of orders, it is described to include with the relevant information content of acknowledgement of orders：The mesh Mark the associated attribute information of kinds of goods and resource information to be paid；Match the voice of user and sound-groove model trained in advance, During with success, delivery operation is triggered.
Foregoing reality is may refer on the operation principle of the device in the embodiment eight and the specific implementation of modules The introduction in example four is applied, which is not described herein again.
The foregoing various specific solutions based on augmented reality offer are each with being provided based on virtual reality technology Kind specific its major technique thought of solution be it is identical, can be cross-referenced.
It should be noted that each embodiment in this specification is described by the way of progressive, each embodiment weight Point explanation is all difference with other embodiment, between each embodiment identical similar part mutually referring to. For device class embodiment, since it is substantially similar to embodiment of the method, so description is fairly simple, related part ginseng See the part explanation of embodiment of the method.
Finally, it is to be noted that, herein, such as first, second, third, fourth or the like relational terms It is used merely to distinguish one entity or operation from another entity or operation, without necessarily requiring or implying these There are any actual relationship or order between entity or operation.Moreover, term " comprising ", "comprising" or its is any Other variations are intended to non-exclusive inclusion, so that process, method, article or equipment including a series of elements Not only include those key elements, but also including other elements that are not explicitly listed, or further include as this process, side Method, article or the intrinsic key element of equipment.In the absence of more restrictions, limited by sentence "including a ..." Key element, it is not excluded that also there are other identical element in the process, method, article or apparatus that includes the element.
Above to the data object exchange method in a kind of virtual reality space environment provided herein, device, with It is used herein and data object exchange method, the device in a kind of augmented reality space environment are described in detail respectively Specific case is set forth the principle and embodiment of the application, to understand the explanation of above example is only intended to helping The present processes and its core concept；Meanwhile for those of ordinary skill in the art, according to the thought of the application, having There will be changes in body embodiment and application range, in conclusion this specification content should not be construed as to the application Limitation.

Claims (22)

  1. A kind of 1. data object exchange method in virtual reality space environment, it is characterised in that the described method includes：
    Client provides virtual reality shop object internal measurements, and the shop object internal measurements are included at least One can interaction data object；
    Determine user's target data objects interested；
    Offer and the relevant information content of acknowledgement of orders, it is described to include with the relevant information content of acknowledgement of orders：The number of targets According to the associated attribute information of object and resource information to be paid；
    The voice of user and sound-groove model trained in advance are matched, in successful match, triggers delivery operation.
  2. 2. data object exchange method according to claim 1, it is characterised in that in the voice for matching user and in advance First before trained sound-groove model, the method further includes：
    Determine that user has completed the confirmation of sequence information.
  3. 3. data object exchange method according to claim 2, it is characterised in that the definite user has completed order letter The confirmation of breath, including：
    When providing the information content relevant with acknowledgement of orders, verification content is also provided, the verification content is according to target data At least part attribute information generation of object；
    Identify in the voice of user and whether include the verification content, if, it is determined that user has completed the confirmation of sequence information.
  4. 4. data object exchange method according to claim 2, it is characterised in that the definite user has completed order letter The confirmation of breath, including：
    When providing the information content relevant with acknowledgement of orders, a check code is also provided；
    Identify in the voice of user and whether include the check code, if, it is determined that user has completed the confirmation of sequence information.
  5. 5. data object exchange method according to claim 4, it is characterised in that the check code is random by client Generation.
  6. 6. data object exchange method according to claim 4, it is characterised in that it is described matching user voice with advance Trained sound-groove model, including：
    The voice comprising check code that matching user sends and sound-groove model trained in advance.
  7. 7. data object exchange method according to claim 2, it is characterised in that do not include when in the voice of identification user During the check code, the method further includes：
    Another check code is provided, identifies in the voice of user whether include another check code, if, it is determined that user is complete Into the confirmation of sequence information.
  8. 8. data object exchange method according to claim 2, it is characterised in that the definite user has completed order letter The confirmation of breath, including：
    Determine user's sight focal position；
    When the sight focal position enters in the range of the interaction area with the relevant information content of acknowledgement of orders, and stop When time reaches preset time threshold value, determine that user has completed the confirmation of sequence information.
  9. 9. data object exchange method according to claim 2, it is characterised in that the definite user has completed order letter The confirmation of breath, including：
    Identify whether comprising the content that can characterize the implication that confirms an order in the voice of user, if, it is determined that user has completed The confirmation of sequence information.
  10. 10. data object exchange method according to claim 1, it is characterised in that definite user mesh interested Data object is marked, including：
    Determine user's sight focal position；
    When the sight focal position enters in the range of the interaction area of a certain data object, and residence time reaches preset Between threshold value when, which is determined as user's target data objects interested.
  11. 11. data object exchange method according to claim 1, it is characterised in that definite user mesh interested Data object is marked, including：
    The voice of user is identified whether comprising the associated information content of a certain data object that can be in interaction data object, if It is, then using the data object target data objects interested as user.
  12. 12. data object exchange method according to claim 11, it is characterised in that the method further includes：
    When the voice for identifying user does not include the associated information content of a certain data object that can be in interaction data object, There is provided and be used to prompt user to select the invalid information content.
  13. 13. data object exchange method according to claim 1, it is characterised in that the voice of the matching user with it is pre- First trained sound-groove model, including：
    According to the device identification of client or user identifier, selected and the equipment from multiple sound-groove models of training in advance Identify corresponding sound-groove model or select sound-groove model corresponding with the user identifier；
    Match the voice of user and selected sound-groove model.
  14. 14. data object exchange method according to claim 1, it is characterised in that the method further includes：By following Training obtains sound-groove model to mode in advance：
    Gather a plurality of voice of user；
    Extract the respective MFCC cepstrum coefficients of every voice in a plurality of voice；
    Trained to obtain the corresponding sound-groove model of the user according to the MFCC cepstrum coefficients.
  15. 15. data object exchange method according to claim 1, it is characterised in that the method further includes：
    The sound-groove model of the user in sound-groove model trained in advance is optimized using the voice that the user sends.
  16. A kind of 16. data object exchange method in virtual reality space environment, it is characterised in that the described method includes：
    Server preserves virtual reality shop object internal measurements data, in the shop object internal measurements data Including it is at least one can interaction data object, it is described can interaction data object be corresponding with interaction area scope, and be associated with preset The information content；
    The virtual reality shop object internal measurements data are supplied to client, so that the client provides virtually Real shop object internal measurements data, determine user's target data objects interested；There is provided related to acknowledgement of orders The information content, it is described to include with the relevant information content of acknowledgement of orders：The associated attribute information of target data objects and Resource information to be paid；The voice of user and sound-groove model trained in advance are matched, in successful match, triggers delivery operation.
  17. A kind of 17. data object exchange method in augmented reality space environment, it is characterised in that the described method includes：
    Client obtains the three-dimensional space model of solid shop internal measurements；Include more than one piece goods inside the solid shop Product；
    After the three-dimensional space model and the solid shop are carried out spatial match by preset augmented reality AR equipment, There is provided the kinds of goods corresponding interaction area range information in user's scope of sight of the AR equipment；
    Determine user's target kinds of goods interested；
    Offer and the relevant information content of acknowledgement of orders, it is described to include with the relevant information content of acknowledgement of orders：The target goods The associated attribute information of product and resource information to be paid；Match the voice of user and sound-groove model trained in advance, matching into During work(, delivery operation is triggered.
  18. A kind of 18. data object exchange method in augmented reality space environment, it is characterised in that the described method includes：
    Server preserves the three-dimensional space model of solid shop internal measurements, includes more than one piece goods inside the solid shop Product, corresponding interaction area range information, and believe with the interaction response of each associated data object of interaction area scope Breath；
    The three-dimensional space model is supplied to client, so that the client is incited somebody to action by preset augmented reality AR equipment After the three-dimensional space model carries out spatial match with the solid shop, provided in user's scope of sight of the AR equipment The corresponding interaction area range information of the kinds of goods, determines user's target kinds of goods interested；There is provided relevant with acknowledgement of orders The information content, it is described to include with the relevant information content of acknowledgement of orders：The associated attribute information of the target kinds of goods and to be paid Resource information；The voice of user and sound-groove model trained in advance are matched, in successful match, triggers delivery operation.
  19. 19. the data object interactive device in a kind of virtual reality space environment, it is characterised in that described device includes：
    Reality environment provides module, for providing virtual reality shop object internal measurements, in the shop object Portion's space environment include it is at least one can interaction data object；
    Target data objects determining module, the target data objects interested for determining user；
    Sequence information provides module, for providing and the relevant information content of acknowledgement of orders, the described and relevant letter of acknowledgement of orders Breath content includes：The associated attribute information of target data objects and resource information to be paid；
    Matching module, for the voice for matching user and sound-groove model trained in advance, in successful match, triggering pays behaviour Make.
  20. 20. the data object interactive device in a kind of virtual reality space environment, it is characterised in that described device includes：
    Environmental data memory module, for preserving virtual reality shop object internal measurements data, in the shop object Portion's space environment data include it is at least one can interaction data object, it is described can interaction data object be corresponding with interaction area model Enclose, and be associated with the preset information content；
    Environmental data provides module, for the virtual reality shop object internal measurements data to be supplied to client, So that the client provides virtual reality shop object internal measurements data, user's target data pair interested is determined As；Offer and the relevant information content of acknowledgement of orders, it is described to include with the relevant information content of acknowledgement of orders：The target data The associated attribute information of object and resource information to be paid；The voice of user and sound-groove model trained in advance are matched, is being matched During success, delivery operation is triggered.
  21. 21. the data object interactive device in a kind of augmented reality space environment, it is characterised in that described device includes：
    Spatial model acquisition module, for obtaining the three-dimensional space model of solid shop internal measurements；The solid shop Inside includes more than one piece kinds of goods；
    Spatial model matching module, for by preset augmented reality AR equipment by the three-dimensional space model and the reality After body shop carries out spatial match, provide the kinds of goods corresponding interaction area model in user's scope of sight of the AR equipment Enclose information；
    Target kinds of goods determining module, the target kinds of goods interested for determining user；
    Sequence information provides module, for providing and the relevant information content of acknowledgement of orders, the described and relevant letter of acknowledgement of orders Breath content includes：The associated attribute information of target kinds of goods and resource information to be paid；
    Matching module, for the voice for matching user and sound-groove model trained in advance, in successful match, triggering pays behaviour Make.
  22. 22. the data object interactive device in a kind of augmented reality space environment, it is characterised in that described device includes：
    Memory module, for preserving the three-dimensional space model of solid shop internal measurements, includes inside the solid shop More than one piece kinds of goods, corresponding interaction area range information, and interacted with each associated data object of interaction area scope Response message；
    Spatial model provides module, for the three-dimensional space model to be supplied to client, so that the client is passing through After the three-dimensional space model and the solid shop are carried out spatial match by preset augmented reality AR equipment, set in the AR There is provided the kinds of goods corresponding interaction area range information in standby user's scope of sight, determine user's target goods interested Product；Offer and the relevant information content of acknowledgement of orders, it is described to include with the relevant information content of acknowledgement of orders：The target kinds of goods Associated attribute information and resource information to be paid；The voice of user and sound-groove model trained in advance are matched, in successful match When, trigger delivery operation.
CN201610921190.XA 2016-10-21 2016-10-21 Data object interaction method and device in virtual reality/augmented reality space environment Active CN107977834B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201610921190.XA CN107977834B (en) 2016-10-21 2016-10-21 Data object interaction method and device in virtual reality/augmented reality space environment
PCT/CN2017/105359 WO2018072617A1 (en) 2016-10-21 2017-10-09 Method and device for interaction of data objects in virtual reality/augmented reality spatial environment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610921190.XA CN107977834B (en) 2016-10-21 2016-10-21 Data object interaction method and device in virtual reality/augmented reality space environment

Publications (2)

Publication Number Publication Date
CN107977834A true CN107977834A (en) 2018-05-01
CN107977834B CN107977834B (en) 2022-03-18

Family

ID=62003814

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610921190.XA Active CN107977834B (en) 2016-10-21 2016-10-21 Data object interaction method and device in virtual reality/augmented reality space environment

Country Status (2)

Country Link
CN (1) CN107977834B (en)
WO (1) WO2018072617A1 (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108563395A (en) * 2018-05-07 2018-09-21 北京知道创宇信息技术有限公司 The visual angles 3D exchange method and device
CN109583187A (en) * 2018-11-16 2019-04-05 中共中央办公厅电子科技学院 A kind of augmented reality identifying code method and application
CN109684490A (en) * 2018-12-26 2019-04-26 成都明图通科技有限公司 Indoor navigation and shopping guide method, device
CN109726954A (en) * 2018-12-11 2019-05-07 维沃移动通信有限公司 A kind of information processing method, device and mobile terminal
CN110176097A (en) * 2019-04-29 2019-08-27 美佳亚太投资有限公司 A kind of vending system
CN110310175A (en) * 2018-06-27 2019-10-08 北京京东尚科信息技术有限公司 System and method for mobile augmented reality
WO2020001039A1 (en) * 2018-06-27 2020-01-02 Beijing Jingdong Shangke Information Technology Co., Ltd. System and method for multi-user augmented reality shopping
CN111243200A (en) * 2019-12-31 2020-06-05 维沃移动通信有限公司 Shopping method, wearable device and medium
CN111340598A (en) * 2020-03-20 2020-06-26 北京爱笔科技有限公司 Method and device for adding interactive label
WO2020253800A1 (en) * 2019-06-21 2020-12-24 华为技术有限公司 Simulation object identity recognition method, and related apparatus and system
CN113298598A (en) * 2020-09-15 2021-08-24 阿里巴巴集团控股有限公司 Method and device for providing shop object information and electronic equipment
CN116168181A (en) * 2022-12-12 2023-05-26 福建神旅文化产业集团有限公司 AR shop construction system and method

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111179001B (en) * 2018-11-09 2023-07-04 阿里巴巴(深圳)技术有限公司 Content processing method, device and system
CN111178847B (en) * 2019-12-31 2023-08-22 中国银行股份有限公司 Virtual banking site equipment, control device and working method based on VR technology
CN112162638B (en) * 2020-10-09 2023-09-19 咪咕视讯科技有限公司 Information processing method and server in Virtual Reality (VR) viewing
CN113298613A (en) * 2021-04-23 2021-08-24 阿里巴巴新加坡控股有限公司 Information interaction method and device
CN114779935B (en) * 2022-04-14 2025-08-05 广州方硅信息技术有限公司 Hot search term interaction method and its device, equipment, and medium
CN114898749B (en) * 2022-05-30 2024-05-14 中国第一汽车股份有限公司 Automobile electronic manual interaction method and device and automobile
CN114925234B (en) * 2022-05-30 2024-09-20 北京达佳互联信息技术有限公司 Data processing method, device, electronic equipment and storage medium
US20240007464A1 (en) * 2022-06-30 2024-01-04 Bank Of America Corporation Integration of real-world and virtual-world systems
CN115578520A (en) * 2022-11-10 2023-01-06 一站发展(北京)云计算科技有限公司 Information processing method and system for immersive scene
GB2627934A (en) * 2023-03-07 2024-09-11 Sphere Res Ltd Dynamic control of digital assets
CN117079651B (en) * 2023-10-08 2024-02-23 中国科学技术大学 Speech cross real-time enhancement implementation method based on large-scale language model

Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070192203A1 (en) * 2006-02-16 2007-08-16 Di Stefano Michael V Virtual reality shopping system
US20100149093A1 (en) * 2006-12-30 2010-06-17 Red Dot Square Solutions Limited Virtual reality system including viewer responsiveness to smart objects
CN102054247A (en) * 2009-11-04 2011-05-11 沈阳隆惠科技有限公司 Method for building three-dimensional (3D) panoramic live-action network business platform
CN103679452A (en) * 2013-06-20 2014-03-26 腾讯科技（深圳）有限公司 Payment authentication method, device thereof and system thereof
CN103761667A (en) * 2014-01-09 2014-04-30 贵州宝森科技有限公司 Virtual reality e-commerce platform system and application method thereof
CN103942696A (en) * 2013-11-20 2014-07-23 中网一号电子商务有限公司 3D virtual shop and physical store correlation method
CN104217336A (en) * 2014-08-25 2014-12-17 四川敬天爱人科技有限公司 A smart life circle e-commerce system based on cloud services
US20150012394A1 (en) * 2013-07-02 2015-01-08 Avenue Imperial UK Limited Virtual Shopping System
CN104599184A (en) * 2014-12-09 2015-05-06 北京奇虎科技有限公司 Stock information pushing system
CN104616190A (en) * 2015-03-05 2015-05-13 广州新节奏智能科技有限公司 Multi-terminal 3D somatosensory shopping method and system based on internet and mobile internet
CN104820921A (en) * 2015-03-24 2015-08-05 百度在线网络技术（北京）有限公司 Method and device for transaction in user equipment
CN105093526A (en) * 2014-05-22 2015-11-25 Lg电子株式会社 Glass-type terminal and method of controlling the same
US20160019717A1 (en) * 2014-07-18 2016-01-21 Oracle International Corporation Retail space planning system
US20160140553A1 (en) * 2014-11-17 2016-05-19 Visa International Service Association Authentication and transactions in a three-dimensional image enhancing display device
CN105824409A (en) * 2016-02-16 2016-08-03 乐视致新电子科技（天津）有限公司 Interactive control method and device for virtual reality
US20160253745A1 (en) * 2015-02-26 2016-09-01 Staging Design Inc. Virtual shopping system and method utilizing virtual reality and augmented reality technology
CN105955471A (en) * 2016-04-26 2016-09-21 乐视控股（北京）有限公司 Virtual reality interaction method and device
CN106034063A (en) * 2015-03-13 2016-10-19 阿里巴巴集团控股有限公司 Method and device for starting service in communication software through voice

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008081411A1 (en) * 2006-12-30 2008-07-10 Kimberly-Clark Worldwide, Inc. Virtual reality system including smart objects
KR101746838B1 (en) * 2010-06-14 2017-06-27 주식회사 비즈모델라인 Method for Operating Augmented Reality by using Display Stand
US9330413B2 (en) * 2013-03-14 2016-05-03 Sears Brands, L.L.C. Checkout and/or ordering systems and methods
CN103325037A (en) * 2013-06-06 2013-09-25 上海讯联数据服务有限公司 Mobile payment safety verification method based on voice recognition
KR101613287B1 (en) * 2015-06-15 2016-04-19 김영덕 Travel destination one stop shopping system based on 3D panoramic image and control method thereof
KR101613278B1 (en) * 2015-08-18 2016-04-19 김영덕 System for providing shopping information based on augmented reality and control method thereof

Patent Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070192203A1 (en) * 2006-02-16 2007-08-16 Di Stefano Michael V Virtual reality shopping system
US20100149093A1 (en) * 2006-12-30 2010-06-17 Red Dot Square Solutions Limited Virtual reality system including viewer responsiveness to smart objects
CN102054247A (en) * 2009-11-04 2011-05-11 沈阳隆惠科技有限公司 Method for building three-dimensional (3D) panoramic live-action network business platform
CN103679452A (en) * 2013-06-20 2014-03-26 腾讯科技（深圳）有限公司 Payment authentication method, device thereof and system thereof
US20150012394A1 (en) * 2013-07-02 2015-01-08 Avenue Imperial UK Limited Virtual Shopping System
CN103942696A (en) * 2013-11-20 2014-07-23 中网一号电子商务有限公司 3D virtual shop and physical store correlation method
CN103761667A (en) * 2014-01-09 2014-04-30 贵州宝森科技有限公司 Virtual reality e-commerce platform system and application method thereof
CN105093526A (en) * 2014-05-22 2015-11-25 Lg电子株式会社 Glass-type terminal and method of controlling the same
US20160019717A1 (en) * 2014-07-18 2016-01-21 Oracle International Corporation Retail space planning system
CN104217336A (en) * 2014-08-25 2014-12-17 四川敬天爱人科技有限公司 A smart life circle e-commerce system based on cloud services
US20160140553A1 (en) * 2014-11-17 2016-05-19 Visa International Service Association Authentication and transactions in a three-dimensional image enhancing display device
CN104599184A (en) * 2014-12-09 2015-05-06 北京奇虎科技有限公司 Stock information pushing system
US20160253745A1 (en) * 2015-02-26 2016-09-01 Staging Design Inc. Virtual shopping system and method utilizing virtual reality and augmented reality technology
CN104616190A (en) * 2015-03-05 2015-05-13 广州新节奏智能科技有限公司 Multi-terminal 3D somatosensory shopping method and system based on internet and mobile internet
CN106034063A (en) * 2015-03-13 2016-10-19 阿里巴巴集团控股有限公司 Method and device for starting service in communication software through voice
CN104820921A (en) * 2015-03-24 2015-08-05 百度在线网络技术（北京）有限公司 Method and device for transaction in user equipment
CN105824409A (en) * 2016-02-16 2016-08-03 乐视致新电子科技（天津）有限公司 Interactive control method and device for virtual reality
CN105955471A (en) * 2016-04-26 2016-09-21 乐视控股（北京）有限公司 Virtual reality interaction method and device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
张曙等: "《机床产品创新与设计》", 30 September 2014, 东南大学出版社 *
沈朝魁等: ""虚拟现实技术（VR）在网上购物中的应用研究"", 《科技视界》 *

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108563395A (en) * 2018-05-07 2018-09-21 北京知道创宇信息技术有限公司 The visual angles 3D exchange method and device
CN110310175A (en) * 2018-06-27 2019-10-08 北京京东尚科信息技术有限公司 System and method for mobile augmented reality
WO2020001039A1 (en) * 2018-06-27 2020-01-02 Beijing Jingdong Shangke Information Technology Co., Ltd. System and method for multi-user augmented reality shopping
CN110310175B (en) * 2018-06-27 2020-12-22 北京京东尚科信息技术有限公司 System and method for mobile augmented reality
CN109583187A (en) * 2018-11-16 2019-04-05 中共中央办公厅电子科技学院 A kind of augmented reality identifying code method and application
CN109726954A (en) * 2018-12-11 2019-05-07 维沃移动通信有限公司 A kind of information processing method, device and mobile terminal
CN109726954B (en) * 2018-12-11 2021-01-08 维沃移动通信有限公司 An information processing method, device and mobile terminal
CN109684490A (en) * 2018-12-26 2019-04-26 成都明图通科技有限公司 Indoor navigation and shopping guide method, device
CN110176097A (en) * 2019-04-29 2019-08-27 美佳亚太投资有限公司 A kind of vending system
US11887261B2 (en) 2019-06-21 2024-01-30 Huawei Technologies Co., Ltd. Simulation object identity recognition method, related apparatus, and system
WO2020253800A1 (en) * 2019-06-21 2020-12-24 华为技术有限公司 Simulation object identity recognition method, and related apparatus and system
CN111243200A (en) * 2019-12-31 2020-06-05 维沃移动通信有限公司 Shopping method, wearable device and medium
CN111340598A (en) * 2020-03-20 2020-06-26 北京爱笔科技有限公司 Method and device for adding interactive label
CN111340598B (en) * 2020-03-20 2024-01-16 北京爱笔科技有限公司 Method and device for adding interactive labels
CN113298598A (en) * 2020-09-15 2021-08-24 阿里巴巴集团控股有限公司 Method and device for providing shop object information and electronic equipment
CN116168181A (en) * 2022-12-12 2023-05-26 福建神旅文化产业集团有限公司 AR shop construction system and method

Also Published As

Publication number Publication date
CN107977834B (en) 2022-03-18
WO2018072617A1 (en) 2018-04-26

Similar Documents

Publication Publication Date Title
CN107977834A (en) Data object exchange method and device in a kind of virtual reality/augmented reality space environment
US12278709B2 (en) Methods and systems for connecting physical objects to digital communications
US11887054B2 (en) Virtual planogram management systems and methods
US20210279695A1 (en) Systems and methods for item acquisition by selection of a virtual object placed in a digital environment
EP2775456A2 (en) Interactive cubicle and method for determining a body shape
CN107122642A (en) Identity identifying method and device based on reality environment
CN110096155A (en) A kind of service implementation method and device based on virtual reality
CN109643527A (en) Virtual Reality Platform for retail environment emulation
US12243101B2 (en) Systems and methods for digital or cryptographic media, assets, or tokens linked to physical objects, services, or privileges in the real-world
CN107957775A (en) Data object exchange method and device in virtual reality space environment
KR101623495B1 (en) Apparatus for selling item
WO2016183629A1 (en) Augmented reality system and method
CN107092435A (en) Recognized based on brand logo and interactive method and system
CN113722619A (en) Content display method, device, equipment and computer readable storage medium
Okur et al. Modern Tools in Fashion Retailing and Consumer Perspective
Bali et al. Emerging world of the metaverse: an indian perspective
Pothumani et al. Extended VEOT framework-Implemented in a smart boutique
CN114902293A (en) Computer-implemented method and virtual reality device for providing behavior-based authentication in a virtual environment
KR102666849B1 (en) Method of generating contents and calculating service fee of contents using blockchain and device supporting thereof
HK1254561B (en) Data object interaction method and device in virtual reality/augmented reality space environment
HK1254561A1 (en) Data object interaction method and device in virtual reality/augmented reality space environment
HK40057921A (en) Content display method, device, equipment and computer readable storage medium
WO2013138112A1 (en) Presentation-indifferent commerce
CN114049129A (en) Virtual resource generation and acquisition method and device, electronic equipment and storage medium
CN105069667A (en) Video-based 3D service method for freely controlling voice communication between virtual real people

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1254561

Country of ref document: HK

GR01 Patent grant
GR01 Patent grant