CN106446857A - Information processing method and device of panorama area - Google Patents
Information processing method and device of panorama area Download PDFInfo
- Publication number
- CN106446857A CN106446857A CN201610875597.3A CN201610875597A CN106446857A CN 106446857 A CN106446857 A CN 106446857A CN 201610875597 A CN201610875597 A CN 201610875597A CN 106446857 A CN106446857 A CN 106446857A
- Authority
- CN
- China
- Prior art keywords
- information
- entrance
- panoramic
- shows
- show
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/10—Geometric effects
- G06T15/20—Perspective computation
- G06T15/205—Image-based rendering
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/05—Geographic models
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
- G06V10/752—Contour matching
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04802—3D-info-object: information is displayed on the internal or external surface of a three dimensional manipulable object, e.g. on the faces of a cube that can be rotated by the user
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/04—Indexing scheme for image data processing or generation, in general involving 3D image data
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Geometry (AREA)
- Multimedia (AREA)
- Computing Systems (AREA)
- Computer Graphics (AREA)
- Medical Informatics (AREA)
- General Health & Medical Sciences (AREA)
- Evolutionary Computation (AREA)
- Databases & Information Systems (AREA)
- Artificial Intelligence (AREA)
- Health & Medical Sciences (AREA)
- Remote Sensing (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses an information processing method and device of a panorama area. The method comprises that an object is identified from a panorama image according to a pre-trained image machine-learning model, and edge parameter information of the object in the panorama image is obtained; an information display inlet of the object is rendered in the panorama area according to the edge parameter information; and correspondence between a coordinate area of the information display inlet and the display information is established. According to the method, the object can be identified from the panorama image automatically, more abundant information can be displayed via the object itself, and display is natural and low-cost.
Description
Technical field
The present invention relates to panoramic picture display technology field, more particularly, to a kind of information processing method of panoramic field and dress
Put.
Background technology
Panoramic table is made up of the photomosaic of real world, can truly, objectively reflect a certain position periphery
Image information, and there is in panoramic table really three-dimensional experience sense, also can be freely rotatable the complete of scaling displaying
Scape picture etc..Thus, panoramic table is widely used in the daily production of user and life.
However, panoramic table provide picture although can objective reality reaction periphery image information, but provide
Information be based only on panoramic picture itself, when user triggers the corresponding picture of the objects such as door and window in panoramic picture it is impossible to
Simulation real world carries out the switching of scene, the Limited information providing.
Content of the invention
The purpose of the present invention is intended at least solve to a certain extent one of above-mentioned technical problem.
For this reason, the first of the present invention purpose is to propose a kind of information processing method of panoramic field, the method is automatic
Identify the object in panoramic pictures, and more rich scene information is represented in itself by object, represent nature and cost relatively
Low.
Second object of the present invention is to propose a kind of information processor of panoramic field.
Third object of the present invention is to propose the information processor of another kind of panoramic field.
Fourth object of the present invention is to propose a kind of non-transitorycomputer readable storage medium.
5th purpose of the present invention is to propose a kind of computer program.
For reaching above-mentioned purpose, the information processing method of the panoramic field of first aspect present invention embodiment, including：According to pre-
The image machine learning model first trained identifies the object in panoramic pictures, obtains side in described panoramic pictures for the described object
Edge parameter information；
Entrance is shown according to the information that described edge parameters information renders described object in panoramic field；
Set up described information and show the coordinates regional of entrance and the corresponding relation of exhibition information.
The information processing method of the panoramic field of the embodiment of the present invention, the image machine learning model according to training in advance is known
Object in other panoramic pictures, and obtain edge parameters information in panoramic pictures for the object, and then according to edge parameters information
The information rendering object in panoramic field shows entrance, and information of setting up shows the coordinates regional of entrance and the right of exhibition information
Should be related to.Thus, the object in panoramic pictures can be automatically identified, and more rich scenery letter is represented in itself by object
Breath, represents nature and cost is relatively low.
In addition, the information processing method of the panoramic field of the embodiment of the present invention, also there is the technical characteristic adding as follows：
In one embodiment of the invention, the described image machine learning model identification panoramic pictures according to training in advance
In object, including：
Described panoramic pictures are carried out with edge detection process, obtains the first parameter of object to be identified；
Mated with described first parameter according to the second parameter in described image machine learning model, identification is described complete
Object in scape picture.
In one embodiment of the invention, described described thing is rendered in panoramic field according to described edge parameters information
The information of body shows entrance, including：
According to default conversion coordinate with according to described edge parameters information, described object is thrown from described panoramic pictures
Shadow is shown in described panoramic field；
Show entrance according to the information that default image processing algorithm renders described object.
In one embodiment of the invention, set up, described, coordinates regional and the exhibition information that described information shows entrance
Corresponding relation after, also include：
Obtain the click coordinate that user carries out touch control operation to described panoramic field；
Determine that the information of object corresponding with described click coordinate shows entrance；
Shown to described user according to described corresponding relation and show the corresponding exhibition information of entrance with described information.
In one embodiment of the invention, according to described corresponding relation to described user show with described information show into
The corresponding exhibition information of mouth, including：
If described information shows that entrance is door, show indoor panorama to described user；Or,
If described information shows that entrance is television set, show default video information to described user；Or,
If described information shows that entrance is furniture, show default advertising message to described user.
For reaching above-mentioned purpose, the information processor of the panoramic field of second aspect present invention embodiment, including：Identification mould
Block, identifies the object in panoramic pictures for the image machine learning model according to training in advance；
First acquisition module, for obtaining edge parameters information in described panoramic pictures for the described object；
Rendering module, for according to the information that described edge parameters information renders described object in panoramic field show into
Mouthful；
Set up module, show the coordinates regional of entrance and the corresponding relation of exhibition information for setting up described information.
The information processor of the panoramic field of the embodiment of the present invention, the image machine learning model according to training in advance is known
Object in other panoramic pictures, and obtain edge parameters information in panoramic pictures for the object, and then according to edge parameters information
The information rendering object in panoramic field shows entrance, and information of setting up shows the coordinates regional of entrance and the right of exhibition information
Should be related to.Thus, the object in panoramic pictures can be automatically identified, and more rich scenery letter is represented in itself by object
Breath, represents nature and cost is relatively low.
In addition, the information processor of the panoramic field of the embodiment of the present invention, also there is the technical characteristic adding as follows：
In one embodiment of the invention, described identification module includes：
Acquiring unit, for described panoramic pictures are carried out with edge detection process, obtains the first parameter of object to be identified；
Recognition unit, for carrying out according to the second parameter in described image machine learning model and described first parameter
Join, identify the object in described panoramic pictures.
In one embodiment of the invention, described rendering module includes：
Projecting cell, for according to default conversion coordinate and according to described edge parameters information by described object from described
In panoramic pictures, Projection Display is in described panoramic field；
Rendering unit, the information for rendering described object according to default image processing algorithm shows entrance.
In one embodiment of the invention, also include：
Second acquisition module, carries out the click coordinate of touch control operation for obtaining user to described panoramic field；
Determining module, the information for determining object corresponding with described click coordinate shows entrance；
Display module, shows the corresponding exhibition of entrance for showing to described user according to described corresponding relation with described information
Show information.
In one embodiment of the invention, described display module is used for：If described information shows that entrance is door, to
Described user's display interior panorama；Or,
If described information shows that entrance is television set, show default video information to described user；Or,
If described information shows that entrance is furniture, show default advertising message to described user.
In order to realize above-described embodiment, third aspect present invention embodiment proposes the information processing of another kind of panoramic field
Device, including：
Processor；
For storing the memorizer of processor executable；
Wherein, described processor is configured to：
Image machine learning model according to training in advance identifies the object in panoramic pictures, obtains described object described
Edge parameters information in panoramic pictures；
Entrance is shown according to the information that described edge parameters information renders described object in panoramic field；
Set up described information and show the coordinates regional of entrance and the corresponding relation of exhibition information.
In order to realize above-described embodiment, fourth aspect present invention embodiment proposes a kind of non-transitory computer-readable and deposits
Storage media, when the instruction in described storage medium is performed by the processor of mobile terminal so that mobile terminal is able to carry out
A kind of information processing method of panoramic field, methods described includes：
Image machine learning model according to training in advance identifies the object in panoramic pictures, obtains described object described
Edge parameters information in panoramic pictures；
Entrance is shown according to the information that described edge parameters information renders described object in panoramic field；
Set up described information and show the coordinates regional of entrance and the corresponding relation of exhibition information.
In order to realize above-described embodiment, fifth aspect present invention embodiment proposes a kind of computer program, works as institute
When stating the instruction processing unit execution in computer program, execute a kind of information processing method of panoramic field, methods described
Including：
Image machine learning model according to training in advance identifies the object in panoramic pictures, obtains described object described
Edge parameters information in panoramic pictures；
Entrance is shown according to the information that described edge parameters information renders described object in panoramic field；
Set up described information and show the coordinates regional of entrance and the corresponding relation of exhibition information.
The aspect that the present invention adds and advantage will be set forth in part in the description, and partly will become from the following description
Obtain substantially, or recognized by the practice of the present invention.
Brief description
The above-mentioned and/or additional aspect of the present invention and advantage will become from reference to the description to embodiment for the accompanying drawings below
Substantially and easy to understand, wherein：
Fig. 1 is the flow chart of the information processing method of panoramic field according to an embodiment of the invention；
Fig. 2 is the flow chart of the information processing method of panoramic field in accordance with another embodiment of the present invention；
Fig. 3 is that coordinates regional according to an embodiment of the invention shows entrance corresponding interface schematic diagram with information；
Fig. 4 is the structural representation of the information processor of panoramic field according to an embodiment of the invention；
Fig. 5 is the structural representation of the information processor of panoramic field in accordance with another embodiment of the present invention；
Fig. 6 is the structural representation of the information processor of the panoramic field according to another embodiment of the present invention；And
Fig. 7 is the structural representation of the information processor of the panoramic field according to a still further embodiment of the present invention.
Specific embodiment
Embodiments of the invention are described below in detail, the example of described embodiment is shown in the drawings, wherein from start to finish
The element that same or similar label represents same or similar element or has same or like function.Below with reference to attached
The embodiment of figure description is exemplary it is intended to be used for explaining the present invention, and is not considered as limiting the invention.
At present, increasingly it is widely applied with panoramic table, that is, how the experience of panorama immersion increasingly receives publicity,
Based on the picture of object correlation in panoramic table, provide the user more abundant information, become the pass improving whole experience sense
Key.
In correlation technique, by adding tagged mode in panoramic table, this region of user is reminded to have corresponding information,
Thus user can know relevant information by clicking on this labelling.
However, adding labelling in panoramic table to affect the attractive in appearance of panoramic table it is impossible to perfectly carry out with panoramic table
Merge, and currently in panoramic table, be based substantially on manual work and determine mark position, relatively costly, complex operation.
In order to solve the above problems, the present invention proposes a kind of information processing method of panoramic field, can automatically identify
Object in panoramic pictures, and more rich scene information is represented in itself by object, cost relatively low and realize convenient.Specifically
As follows：
Fig. 1 is the flow chart of the information processing method of panoramic field according to an embodiment of the invention, as shown in figure 1,
The method includes：
S110, the image machine learning model according to training in advance identifies the object in panoramic pictures, obtains object complete
Edge parameters information in scape picture.
Specifically, the object of relevant information, the door and window in such as identification panoramic pictures, electricity can be connected in identification panoramic pictures
Depending on mechanical, electrical brain, furniture etc..
It should be noted that according to the difference of concrete application scene, different modes of can sampling determine in panoramic pictures
Object, is exemplified below：
The first example, can be by the way of image recognition, by identifying pixel of image of object etc. in panoramic field
Parameter, identifies the object in panoramic pictures, the ratio parameters such as the image pixel such as by door in identification panorama object, identifies
Door in panoramic field etc..
Second example, can pre-build image machine learning model, and then the machine learning model according to training in advance
Object in identification panoramic pictures.
It should be appreciated that in this example, the machine learning model according to training in advance identifies the thing in panoramic pictures
The process of body, relevant with the content that image machine model comprises, if image machine model includes the edge of voluminous object
The parameters such as length, shape, then can identify object by identifying the edge parameters of the object in panoramic pictures.
Specifically, panoramic pictures can be carried out with edge detection process, obtain the first parameter of object to be identified, Jin Ergen
Mated with the first parameter according to the second parameter in image machine learning model, if the mating of the second parameter and the first parameter
Degree exceedes certain value, then the object in identification panoramic pictures.
Such as, if during to panoramic pictures edge detection process, certain object edge length to be identified, shape, Yi Jiwei
The edge length of the door in the parameters such as the size around area, with image machine learning model, shape and the size around area
It is 99% etc. the similarity of ginseng, then identify the door in panoramic pictures.
Further, after the object in identifying panoramic pictures, in order to realize that letter is shown based on this object region
Breath, obtains edge parameters information in panoramic pictures for the object, wherein, edge parameters information may include the coordinate at edge, length
Etc. parameter.
S120, shows entrance according to the information that edge parameters information renders object in panoramic field.
Specifically, it is based on this object region for convenience, know relevant information, according to edge parameters information in panorama
The information rendering object in region shows entrance, thus user can intuitively see on the object, clicks on which position to obtain
Take relevant information.
It should be noted that in actual applications, the information of an object shows that entrance can be one or many
Individual, different information shows that entrance may correspond to different information.Such as, for object door, if three information exhibitions are had on door
It is shown into mouth, then entrance A may correspond to the advertising message of door, entrance B may correspond to landscape information behind the door, entrance C may correspond to
Corridor information behind the door etc..
Wherein, so that user intuitively awareness information shows the particular location of entrance, can be using different process sides
To this information, formula shows that entrance renders, such as this information entry can be highlighted, solid highlights, here
Do not enumerate.
It should be noted that under different application scenarios, object is determined in panoramic field according to edge parameters information
Information show that the mode of entrance is different, be exemplified below：
As a kind of example, the mapping relations of edge parameters information and panoramic field can be pre-set, such as pre-set
Edge coordinate and the mapping relations of panoramic field coordinate, thus according to default conversion coordinate, and according to edge parameters information
Obtain position in panoramic field for the object, and by object from panoramic field Projection Display in panoramic field.
And then, show entrance according to the information that default image processing algorithm renders object, such as, according to default height
Bright Processing Algorithm, the information being highlighted object shows entrance, and such as, according to default animation process algorithm, three-dimensional protrusion
The information of display object shows entrance etc..
S130, information of setting up shows the coordinates regional of entrance and the corresponding relation of exhibition information.
Specifically, the corresponding relation with exhibition information that information of setting up shows the coordinates regional of entrance, thus can be in detection
Trigger after the coordinates regional that this information shows entrance to user, inquire about above-mentioned corresponding relation, obtain and show corresponding information.
The number of entrance wherein it should be appreciated that information shows the size of the coordinates regional of entrance, can be shown according to information
The size in the region of amount and object is configured, in order to the triggering of user is convenient, the corresponding size and shape of coordinates regional
All adjustable.
For example, if showing entrance corresponding to an information on door, coordinate and the door of whole door region are set up
Landscape information afterwards corresponds to.
In sum, the information processing method of the panoramic field of the embodiment of the present invention, according to the image machine of training in advance
Learning model identifies the object in panoramic pictures, and obtains edge parameters information in panoramic pictures for the object, and then according to side
The information that edge parameter information renders object in panoramic field shows entrance, and information of setting up shows coordinates regional and the exhibition of entrance
Show the corresponding relation of information.Thus, the object in panoramic pictures can be automatically identified, and to be represented by object more rich in itself
Scene information, represent nature and cost be relatively low.
Based on above example, in order to more clearly describe the information processing side of the panoramic field of the embodiment of the present invention
Method, with reference in panoramic field obtain the corresponding information of object in, the concrete implementation procedure that front end represents, illustrate：
Fig. 2 is the flow chart of the information processing method of panoramic field in accordance with another embodiment of the present invention, as Fig. 2 institute
Show, after above-mentioned steps S130, the method also includes：
S210, obtains the click coordinate that user carries out touch control operation to panoramic field.
Specifically, in order to relevant information is provided a user with according to user view picture, obtain user and touched in panoramic field
The click coordinate of control operation.
Wherein, above-mentioned touch control operation can be the operation such as to click, double-click, and it obtains click coordinate according to touch control operation can be by
Existing algorithm calculates and obtains, and will not be described here.
S220, determines that the information of object corresponding with click coordinate shows entrance.
Specifically, because the coordinates regional on object and information show that entrance is corresponding, thus information is shown entrance and is somebody's turn to do
In coordinates regional, the coordinate pair of any point is answered, thus entrance can be shown by the information that click coordinate determine corresponding object.
For example, as shown in figure 3, with advertising message, the coordinates regional A on door shows that entrance is corresponding, thus using when obtaining
Family is after the corresponding click coordinate of a point that panoramic field is clicked on, if a point is located in coordinates regional A it is determined that being sat with this click
Mark corresponding information and show that entrance is door.
S230, displays to the user that according to corresponding relation and shows the corresponding exhibition information of entrance with information.
Specifically, information shows the corresponding relation of entrance and exhibition information, displays to the user that and shows that entrance is corresponding with information
Exhibition information.
In one embodiment of the invention, if information shows that entrance is door, display to the user that indoor panorama.
In one embodiment of the invention, if information shows that entrance is television set, display to the user that default video
Information.
In one embodiment of the invention, if information shows that entrance is furniture；Then display to the user that default advertisement letter
Breath.
In sum, the information processing method of the panoramic field of the embodiment of the present invention, obtains user and panoramic field is carried out
The click coordinate of touch control operation, determine object corresponding with click coordinate information displaying entrance, with according to corresponding relation to user
Display shows the corresponding exhibition information of entrance with information.Thus, the click to object correlation according to user, is come by object itself
Represent more rich scene information to user, represent nature and cost is relatively low, improve Consumer's Experience.
In order to realize above-described embodiment, the invention allows for a kind of information processor of panoramic field, Fig. 4 is basis
The structural representation of the information processor of the panoramic field of one embodiment of the invention, as shown in figure 4, the letter of this panoramic field
Breath processing meanss may include identification module 10, the first acquisition module 20, rendering module 30 and set up module 40.
Wherein, identification module 10, identify the thing in panoramic pictures for the image machine learning model according to training in advance
Body.
In one embodiment of the invention, Fig. 5 is at the information of panoramic field in accordance with another embodiment of the present invention
The structural representation of reason device, as shown in figure 5, on the basis of as shown in Figure 4, identification module 10 includes acquiring unit 11 and knows
Other unit 12.
Wherein, acquiring unit 11, for panoramic pictures are carried out with edge detection process, obtain the first ginseng of object to be identified
Number.
Recognition unit 12, for being mated with the first parameter according to the second parameter in image machine learning model, is known
Object in other panoramic pictures.
First acquisition module 20, for obtaining edge parameters information in panoramic pictures for the object.
Rendering module 30, the information for rendering object in panoramic field according to edge parameters information shows entrance.
In one embodiment of the invention, Fig. 6 is at the information of the panoramic field according to another embodiment of the present invention
The structural representation of reason device, as shown in fig. 6, on the basis of as shown in Figure 4, rendering module 30 includes projecting cell 31 and wash with watercolours
Dye unit 32.
Wherein, projecting cell 31, for according to default conversion coordinate and according to edge parameters information by object from panorama
In picture, Projection Display is in panoramic field.
Rendering unit 32, the information for rendering object according to default image processing algorithm shows entrance.
Set up module 40, show the coordinates regional of entrance and the corresponding relation of exhibition information for setting up information.
It should be noted that the explanation of the aforementioned information processing method to panoramic field, it is also applied for the present invention real
Apply the information processor of the panoramic field of example, for do not disclose in the information processor embodiment of panoramic field of the present invention
Details, will not be described here.
In sum, the information processor of the panoramic field of the embodiment of the present invention, according to the image machine of training in advance
Learning model identifies the object in panoramic pictures, and obtains edge parameters information in panoramic pictures for the object, and then according to side
The information that edge parameter information renders object in panoramic field shows entrance, and information of setting up shows coordinates regional and the exhibition of entrance
Show the corresponding relation of information.Thus, the object in panoramic pictures can be automatically identified, and to be represented by object more rich in itself
Scene information, represent nature and cost be relatively low.
Based on above example, in order to more clearly describe the information processing apparatus of the panoramic field of the embodiment of the present invention
Put, with reference in panoramic field obtain the corresponding information of object in, the concrete implementation procedure that front end represents, illustrate：
Fig. 7 is the structural representation of the information processor of the panoramic field according to a still further embodiment of the present invention, such as Fig. 7
Shown, on the basis of as shown in Figure 4, the information processor of this panoramic field also includes the second acquisition module 50, determines mould
Block 60 and display module 70.
Wherein, the second acquisition module 50, carries out the click coordinate of touch control operation for obtaining user to panoramic field.
Determining module 60, the information for determining object corresponding with click coordinate shows entrance.
Display module 70, shows the corresponding exhibition information of entrance for displaying to the user that according to corresponding relation with information.
In one embodiment of the invention, if information shows that entrance is door, display module 70 displays to the user that room
Interior panorama.
In one embodiment of the invention, if information shows that entrance is television set, display module 70 displays to the user that
Default video information.
In one embodiment of the invention, if information shows that entrance is furniture, display module 70 displays to the user that pre-
If advertising message.
It should be noted that the explanation of the aforementioned information processing method to panoramic field, it is also applied for the present invention real
Apply the information processor of the panoramic field of example, for do not disclose in the information processor embodiment of panoramic field of the present invention
Details, will not be described here.
In sum, the information processor of the panoramic field of the embodiment of the present invention, obtains user and panoramic field is carried out
The click coordinate of touch control operation, determine object corresponding with click coordinate information displaying entrance, with according to corresponding relation to user
Display shows the corresponding exhibition information of entrance with information.Thus, the click to object correlation according to user, is come by object itself
Represent more rich scene information to user, represent nature and cost is relatively low, improve Consumer's Experience.
Additionally, term " first ", " second " are only used for describing purpose, and it is not intended that indicating or hint relative importance
Or the implicit quantity indicating indicated technical characteristic.Thus, define " first ", the feature of " second " can express or
Implicitly include at least one this feature.In describing the invention, " multiple " are meant that at least two, such as two, three
Individual etc., unless otherwise expressly limited specifically.
In the description of this specification, reference term " embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or the spy describing with reference to this embodiment or example
Point is contained at least one embodiment or the example of the present invention.In this manual, to the schematic representation of above-mentioned term not
Identical embodiment or example must be directed to.And, the specific features of description, structure, material or feature can be in office
Combine in an appropriate manner in one or more embodiments or example.Additionally, in the case of not conflicting, the skill of this area
The feature of the different embodiments described in this specification or example and different embodiment or example can be tied by art personnel
Close and combine.
Although embodiments of the invention have been shown and described above it is to be understood that above-described embodiment is example
Property it is impossible to be interpreted as limitation of the present invention, those of ordinary skill in the art within the scope of the invention can be to above-mentioned
Embodiment is changed, changes, replacing and modification.
Claims (10)
1. a kind of information processing method of panoramic field is it is characterised in that include：
Image machine learning model according to training in advance identifies the object in panoramic pictures, obtains described object in described panorama
Edge parameters information in picture；
Entrance is shown according to the information that described edge parameters information renders described object in panoramic field；
Set up described information and show the coordinates regional of entrance and the corresponding relation of exhibition information.
2. the method for claim 1 is it is characterised in that the described image machine learning model according to training in advance identifies
Object in panoramic pictures, including：
Described panoramic pictures are carried out with edge detection process, obtains the first parameter of object to be identified；
Mated with described first parameter according to the second parameter in described image machine learning model, identified described panorama sketch
Object in piece.
3. the method for claim 1 it is characterised in that described according to described edge parameters information wash with watercolours in panoramic field
The information contaminating described object shows entrance, including：
Change coordinate and according to described edge parameters information, described object is projected from described panoramic pictures aobvious according to default
Show in described panoramic field；
Show entrance according to the information that default image processing algorithm renders described object.
4. the method for claim 1 it is characterised in that described set up described information show entrance coordinates regional with
After the corresponding relation of exhibition information, also include：
Obtain the click coordinate that user carries out touch control operation to described panoramic field；
Determine that the information of object corresponding with described click coordinate shows entrance；
Shown to described user according to described corresponding relation and show the corresponding exhibition information of entrance with described information.
5. method as claimed in claim 4 is it is characterised in that show and described letter to described user according to described corresponding relation
Breath shows the corresponding exhibition information of entrance, including：
If described information shows that entrance is door, show indoor panorama to described user；Or,
If described information shows that entrance is television set, show default video information to described user；Or,
If described information shows that entrance is furniture, show default advertising message to described user.
6. a kind of information processor of panoramic field is it is characterised in that include：
Identification module, identifies the object in panoramic pictures for the image machine learning model according to training in advance；
First acquisition module, for obtaining edge parameters information in described panoramic pictures for the described object；
Rendering module, the information for rendering described object in panoramic field according to described edge parameters information shows entrance；
Set up module, show the coordinates regional of entrance and the corresponding relation of exhibition information for setting up described information.
7. device as claimed in claim 6 is it is characterised in that described identification module includes：
Acquiring unit, for described panoramic pictures are carried out with edge detection process, obtains the first parameter of object to be identified；
Recognition unit, for being mated with described first parameter according to the second parameter in described image machine learning model,
Identify the object in described panoramic pictures.
8. device as claimed in claim 6 is it is characterised in that described rendering module includes：
Projecting cell, for according to default conversion coordinate and according to described edge parameters information by described object from described panorama
In picture, Projection Display is in described panoramic field；
Rendering unit, the information for rendering described object according to default image processing algorithm shows entrance.
9. device as claimed in claim 6 is it is characterised in that also include：
Second acquisition module, carries out the click coordinate of touch control operation for obtaining user to described panoramic field；
Determining module, the information for determining object corresponding with described click coordinate shows entrance；
According to described corresponding relation, display module, for showing that to described user showing that entrance is corresponding with described information shows letter
Breath.
10. device as claimed in claim 9 is it is characterised in that described display module is used for：
If described information shows that entrance is door, show indoor panorama to described user；Or,
If described information shows that entrance is television set, show default video information to described user；Or,
If described information shows that entrance is furniture, show default advertising message to described user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610875597.3A CN106446857A (en) | 2016-09-30 | 2016-09-30 | Information processing method and device of panorama area |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610875597.3A CN106446857A (en) | 2016-09-30 | 2016-09-30 | Information processing method and device of panorama area |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106446857A true CN106446857A (en) | 2017-02-22 |
Family
ID=58172898
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610875597.3A Pending CN106446857A (en) | 2016-09-30 | 2016-09-30 | Information processing method and device of panorama area |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106446857A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107832036A (en) * | 2017-11-22 | 2018-03-23 | 北京小米移动软件有限公司 | Sound control method, device and computer-readable recording medium |
| CN108061359A (en) * | 2017-11-08 | 2018-05-22 | 珠海格力电器股份有限公司 | Air conditioner control method and device |
| CN108520263A (en) * | 2018-03-29 | 2018-09-11 | 优酷网络技术（北京）有限公司 | A kind of recognition methods of panoramic picture, system and computer storage media |
| CN112632181A (en) * | 2020-12-21 | 2021-04-09 | 北京百度网讯科技有限公司 | Map display method, map display device, map display equipment, map display storage medium and terminal equipment |
| CN113361306A (en) * | 2020-03-06 | 2021-09-07 | 顺丰科技有限公司 | Scene data display method, device, equipment and storage medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101231786A (en) * | 2007-12-28 | 2008-07-30 | 北京航空航天大学 | A Vehicle Detection Method Based on Video Image Features |
| CN101506764A (en) * | 2006-08-25 | 2009-08-12 | 微软公司 | Panoramic annular user interface |
| CN101655979A (en) * | 2009-08-20 | 2010-02-24 | 长宽高（北京）科技有限公司 | Method for expanding panoramic application in three-dimensional scene |
| CN102457678A (en) * | 2010-10-21 | 2012-05-16 | 佳能株式会社 | Display control apparatus and display control method |
| CN103426100A (en) * | 2012-05-25 | 2013-12-04 | 高炬 | 3D virtual exhibition hall display method for internet product displaying |
| US8761498B1 (en) * | 2012-01-26 | 2014-06-24 | Google Inc. | Face and license plate detection in street level images with 3-D road width features estimated from laser data |
| CN104700185A (en) * | 2013-12-06 | 2015-06-10 | 大连灵动科技发展有限公司 | Major Hazard Source Management Method for Command and Training Drill System |
| CN104859538A (en) * | 2013-10-22 | 2015-08-26 | 通用汽车环球科技运作有限责任公司 | Vision-based object sensing and highlighting in vehicle image display systems |
| CN105426170A (en) * | 2015-10-29 | 2016-03-23 | 深圳市尊豪网络科技有限公司 | Information pushing method and information pushing apparatus |
-
2016
- 2016-09-30 CN CN201610875597.3A patent/CN106446857A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101506764A (en) * | 2006-08-25 | 2009-08-12 | 微软公司 | Panoramic annular user interface |
| CN101231786A (en) * | 2007-12-28 | 2008-07-30 | 北京航空航天大学 | A Vehicle Detection Method Based on Video Image Features |
| CN101655979A (en) * | 2009-08-20 | 2010-02-24 | 长宽高（北京）科技有限公司 | Method for expanding panoramic application in three-dimensional scene |
| CN102457678A (en) * | 2010-10-21 | 2012-05-16 | 佳能株式会社 | Display control apparatus and display control method |
| US8761498B1 (en) * | 2012-01-26 | 2014-06-24 | Google Inc. | Face and license plate detection in street level images with 3-D road width features estimated from laser data |
| CN103426100A (en) * | 2012-05-25 | 2013-12-04 | 高炬 | 3D virtual exhibition hall display method for internet product displaying |
| CN104859538A (en) * | 2013-10-22 | 2015-08-26 | 通用汽车环球科技运作有限责任公司 | Vision-based object sensing and highlighting in vehicle image display systems |
| CN104700185A (en) * | 2013-12-06 | 2015-06-10 | 大连灵动科技发展有限公司 | Major Hazard Source Management Method for Command and Training Drill System |
| CN105426170A (en) * | 2015-10-29 | 2016-03-23 | 深圳市尊豪网络科技有限公司 | Information pushing method and information pushing apparatus |
Non-Patent Citations (2)
| Title |
|---|
| 栾悉道: "《多媒体情报处理技术》", 31 May 2016 * |
| 赵婕: "《图像特征提取与语义分析》", 31 July 2015 * |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108061359A (en) * | 2017-11-08 | 2018-05-22 | 珠海格力电器股份有限公司 | Air conditioner control method and device |
| CN107832036A (en) * | 2017-11-22 | 2018-03-23 | 北京小米移动软件有限公司 | Sound control method, device and computer-readable recording medium |
| CN107832036B (en) * | 2017-11-22 | 2022-01-18 | 北京小米移动软件有限公司 | Voice control method, device and computer-readable storage medium |
| CN108520263A (en) * | 2018-03-29 | 2018-09-11 | 优酷网络技术（北京）有限公司 | A kind of recognition methods of panoramic picture, system and computer storage media |
| CN108520263B (en) * | 2018-03-29 | 2020-08-25 | 阿里巴巴（中国）有限公司 | Panoramic image identification method and system and computer storage medium |
| CN113361306A (en) * | 2020-03-06 | 2021-09-07 | 顺丰科技有限公司 | Scene data display method, device, equipment and storage medium |
| CN113361306B (en) * | 2020-03-06 | 2025-02-07 | 顺丰科技有限公司 | Scene data display method, device, equipment and storage medium |
| CN112632181A (en) * | 2020-12-21 | 2021-04-09 | 北京百度网讯科技有限公司 | Map display method, map display device, map display equipment, map display storage medium and terminal equipment |
| CN112632181B (en) * | 2020-12-21 | 2024-02-06 | 北京百度网讯科技有限公司 | Map display method, device, equipment, storage medium and terminal equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Oufqir et al. | ARKit and ARCore in serve to augmented reality | |
| US20220382379A1 (en) | Touch Free User Interface | |
| CN108876934B (en) | Key point marking method, device and system and storage medium | |
| CN106446857A (en) | Information processing method and device of panorama area | |
| CN103377487B (en) | Message processing device, display control method and program | |
| CN103777757B (en) | A kind of place virtual objects in augmented reality the system of combination significance detection | |
| CN106325521B (en) | Test virtual reality head shows the method and device of device software | |
| CN112684894A (en) | Interaction method and device for augmented reality scene, electronic equipment and storage medium | |
| CN108668050B (en) | Video shooting method and device based on virtual reality | |
| TW201710646A (en) | A method and apparatus for determining navigation information and a large field of view content depictor when depicting a portion of a large field of view content | |
| CN106447788B (en) | Method and device for indicating viewing angle | |
| CN106204746B (en) | A kind of augmented reality system of achievable 3D models live paint | |
| CN108765270B (en) | Virtual three-dimensional space tag binding method and device | |
| CN109582122A (en) | Augmented reality information providing method, device and electronic equipment | |
| CN110909439A (en) | AR-based assembly method and device and terminal | |
| US20110069869A1 (en) | System and method for defining an activation area within a representation scenery of a viewer interface | |
| CN114387445A (en) | Object key point identification method and device, electronic equipment and storage medium | |
| CN119536607A (en) | Personalized scene image processing method and device | |
| CN104680532A (en) | Object labeling method and device | |
| CN103279942A (en) | Control method for realizing virtual 3D (3-dimension) display on 2D (2-dimension) screen on basis of environment sensor | |
| CN111598996B (en) | Article 3D model display method and system based on AR technology | |
| CN108510433B (en) | Space display method and device and terminal | |
| CN104821135B (en) | It is a kind of to realize the method and device that paper map is combined display with electronic map | |
| CN105224570B (en) | A kind of display methods and system of point of interest | |
| CN110248235A (en) | Software teaching method, apparatus, terminal device and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170222 |