KR20210148074A - AR scenario content creation method, display method, device and storage medium - Google Patents

Abstract

The present invention provides a method, display method, apparatus and storage medium for generating AR scenario content, wherein the generating method includes, in response to a first trigger action, an initial related to a target reality scenario indicated by the first trigger action. obtaining an AR data packet; obtaining update data of at least one virtual object related to the initial AR data packet, wherein the update data includes first pose data corresponding to the at least one virtual object; and updating the initial AR data packet based on the updated data of the at least one virtual object to generate an updated AR data packet.

Description

AR scenario content creation method, display method, device and storage medium

The present invention is based on a Chinese patent application filed on May 26, 2020, with an application number of 202010456842.3, and an application title of "Method for generating AR scenario content, display method, display system and apparatus" and May 26, 2020 Claims the priority of the Chinese patent application filed based on the Chinese patent application, the application number is 202010456843.8, the application title is "Method for generating, display method, apparatus and storage medium of AR scenario content", all contents of which are for reference is incorporated herein by reference.

The present invention relates to the field of augmented reality technology, and more particularly, to a method for generating AR scenario content, a method for displaying, an apparatus, and a storage medium.

Augmented Reality (AR) technology is a technology that cleverly fuses virtual objects with the real world. By applying, present an augmented reality scenario.

Before presenting the augmented reality scenario, the displayed AR content such as the virtual object and the display information of the virtual object in the augmented reality scenario may be determined in advance, but when a change occurs in the internal environment of the current reality scenario, the pre-made virtual Since the object and the current reality scenario are no longer matched, the display effect of the augmented reality scenario is poor when the virtual object is overlapped in the real scenario.

An embodiment of the present invention provides a method for generating at least AR scenario content.

In a first aspect, an embodiment of the present invention provides a method of generating augmented reality (AR) scenario content, the method comprising:

in response to a first trigger action, acquiring an initial AR data packet related to a target reality scenario indicated by the first trigger action;

obtaining update data of at least one virtual object related to the initial AR data packet, wherein the update data includes first pose data corresponding to the at least one virtual object; and

and generating an updated AR data packet by updating the initial AR data packet based on the updated data of the at least one virtual object.

In an embodiment of the present invention, upon detecting the first trigger operation, an initial AR data packet related to the target reality scenario may be acquired, and update data including at least one virtual target related to the initial AR data may be additionally added. may include, for example, first pose data corresponding to the at least one virtual object, and update the initial AR data packet based on the next updated data to select a virtual object that more matches the target reality scenario By obtaining, enhance the authenticity effect of the augmented reality scenario.

In a second aspect, an embodiment of the present invention provides a method for displaying augmented reality (AR) scenario content, the method comprising:

in response to a second trigger action, obtaining an AR data packet related to a target reality scenario indicated by the second trigger action, wherein the AR data packet includes first pose data corresponding to at least one virtual object - ;

Based on second pose data in which the AR device currently captures the target reality scenario, and the first pose data corresponding to at least one virtual object among the AR data packets, the presentation special effect of the at least one virtual object determining information; and

and displaying the at least one virtual object through the AR device based on the presentation special effect information.

In an embodiment of the present invention, in response to the second trigger operation, an AR data packet related to the second trigger operation may be acquired, and further, the second pause data corresponding to the AR device, and the AR data packet The set virtual object determines the presentation special effect information in the target reality scenario based on the first pose data in the target reality scenario, and finally displays the true augmented reality scenario effect in the AR device.

In a third aspect, an embodiment of the present invention provides an apparatus for generating augmented reality (AR) scenario content, the apparatus comprising:

a first acquiring module, in response to a first trigger operation, for acquiring an initial AR data packet related to a target reality scenario indicated by the first trigger operation;

a second acquiring module, configured to acquire update data of at least one virtual object related to the initial AR data packet, wherein the update data includes first pose data corresponding to the at least one virtual object; and

and an update module configured to update the initial AR data packet based on the update data of the at least one virtual object to generate an updated AR data packet.

In a fourth aspect, an embodiment of the present invention provides an apparatus for displaying augmented reality (AR) scenario content, the apparatus comprising:

In response to a second trigger operation, an acquiring module for acquiring an AR data packet related to a target reality scenario indicated by the second trigger operation, wherein the AR data packet includes first pose data corresponding to at least one virtual object. Included - ;

Based on second pose data in which the AR device currently captures the target reality scenario, and the first pose data corresponding to at least one virtual object among the AR data packets, the presentation special effect of the at least one virtual object a determining module for determining information; and

and a display module configured to display the at least one virtual object through the AR device based on the presentation special effect information.

According to a fifth aspect, an embodiment of the present invention provides an electronic device, the electronic device comprising a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the electronic device when activated, the processor communicates between the memories and via a bus, and when the machine readable instructions are executed by the processor, executes the steps of the generating method according to the first aspect, or a display method according to the second aspect execute the steps of

According to a sixth aspect, an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is operated by a processor, the generation according to the first aspect performing the steps of the method, or executing the steps of the display method according to the second aspect.

In order to more clearly explain the technical solutions of the embodiments of the present invention, the drawings to be used in the embodiments are briefly described below, and the drawings are a part of the specification and constitute the entire specification, and these drawings represent the present invention. It shows an embodiment consistent with the above, and is for explaining the technical solution of the present invention together with the specification. It is to be understood that the drawings below only show some embodiments of the present invention, and therefore should not be regarded as limiting in scope, and those skilled in the art may use other Associated drawings can be obtained.
1 is a flowchart of a method for generating a first AR scenario content provided in an embodiment of the present invention.
2A is an exemplary diagram of an AR data packet download interface provided in an embodiment of the present invention.
2B is a diagram illustrating an interface of AR data packet download and upload provided in an embodiment of the present invention.
3 is an exemplary page diagram of a location determination prompt provided in an embodiment of the present invention.
4 is an exemplary diagram of a pose data display page of a virtual object provided in an embodiment of the present invention.
5 is an exemplary diagram of a pose data editing page of a virtual object provided in an embodiment of the present invention.
6 is an exemplary diagram of an interface generated by interaction data provided in an embodiment of the present invention.
7 is an exemplary diagram of an AR data packet storage page provided in an embodiment of the present invention.
8 is an interface flow diagram of an uploaded updated AR data packet provided in an embodiment of the present invention.
9 is a flowchart of a method for displaying AR scenario content provided in an embodiment of the present invention.
10 is an exemplary diagram of a positioning prompt performed by an AR device when AR scenario content provided in an embodiment of the present invention is displayed.
11 is a diagram illustrating an augmented reality scenario provided in an embodiment of the present invention.
12 is a flowchart of a method for generating a second AR scenario content provided in an embodiment of the present invention.
13 is an exemplary structural diagram of an AR scenario content display system provided in an embodiment of the present invention.
14 is a flowchart of a method for generating a third AR scenario content provided in an embodiment of the present invention.
15 is an exemplary structural diagram of an apparatus for generating the first AR scenario content provided in an embodiment of the present invention.
16 is an exemplary structural diagram of an apparatus for displaying the first AR scenario content provided in an embodiment of the present invention.
17 is an exemplary structural diagram of an electronic device provided in an embodiment of the present invention.

In order to make the objects, technical solutions and advantages of the present invention more clear, below, in combination with the drawings in the embodiments of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described, , it is obvious that the described embodiments are only some of the embodiments rather than all of the embodiments of the present invention. In general, the components of the embodiments of the invention described and illustrated in the drawings herein can be arranged and designed in a variety of different configurations. Accordingly, the detailed description of the embodiments of the present invention provided in the drawings below is not intended to limit the protection scope of the present invention, but to represent selected embodiments of the present invention. Based on the embodiment of the present invention, all other embodiments obtained by those skilled in the art without creative labor should fall within the protection scope of the present invention.

It should be noted that, since similar symbols and characters indicate similar items in the drawings below, if one item is defined in one drawing, it does not need to be further defined and interpreted in subsequent drawings.

As used herein, the term “and/or” is only used to describe a correlation, and indicates that three relationships exist, for example, A and/or B means that A exists alone, A and B There are three situations in which B exists simultaneously and B exists alone. In addition, as used herein, the term “at least one” means any one of a plurality or a combination of any one of a plurality of two, for example, including at least one of A, B, and C, as A, B and C. It may represent any one or a plurality of elements selected from the configured combination.

Augmented reality (AR) technology may be applied to an AR device, and the AR device may be any electronic device capable of supporting an AR function, and includes, but is not limited to, AR glasses, a tablet computer, a smart phone, and the like. When the AR device is operated in a real scenario, a virtual object overlapping the real scenario can be viewed through the AR device. For example, when passing some buildings or tourist attractions, the AR device can be used in the vicinity of the buildings or tourist attractions. An overlapping virtual graphic introduction may be viewed, wherein the virtual graphic may be referred to as a virtual object, and a building or tourist attraction may be a real scenario, under this scenario, the virtual graphic introduction seen through the AR glasses is the direction of the AR glasses It changes with the change of angle, where the introduction of virtual graphics is associated with AR glasses position relationship, but in some other scenarios, we want to see virtual flowerpots placed on real desks, or virtual trees overlapping on real school yards. Want to see a more realistic augmented reality scenario where virtual and reality are combined, and in this way, how to make the virtual flowerpot and virtual tree better able to fuse with the real scenario should be considered in the augmented reality scenario. A presentation effect for a virtual object is implemented, and a method for implementing the presentation effect is content to be discussed in an embodiment of the present invention, and will be described repeatedly by combining specific embodiments below.

In order to facilitate understanding of the present embodiment, first, the method for generating AR scenario content disclosed in the embodiment of the present invention is introduced in detail, and the execution entity of the method for generating AR scenario content provided in the embodiment of the present invention is The AR device may be, for example, AR glasses, a tablet computer, a smart phone, a smart wearable device, etc. may include a device having a display function and a data processing function, and is not limited in the embodiment of the present invention, and some In a possible implementation form, the method of generating the AR scenario content may be implemented through a method of calling a computer readable instruction stored in a memory through a processor.

Referring to FIG. 1 , this is a flowchart of a method for generating AR scenario content provided in an embodiment of the present invention, and the method includes the following steps S101 to S103.

In step S101, in response to the first trigger action, an initial AR data packet related to the target reality scenario indicated by the first trigger action is acquired.

Illustratively, the first trigger action may be a trigger action for an edit option corresponding to any one initial AR data packet related to the target reality scenario, and the trigger action may be, for example, an action of selecting an edit option, or direct voice or an operation triggered through a method such as a gesture, etc., the present invention is not limited thereto.

As shown in Fig. 2A, this is an example diagram of AR data packets respectively related to "XXX Building - 15th floor" and other real scenarios, and the editing option of the initial AR data packets in the "[Example] Science Fiction" category was triggered As such, when it is detected that the editing option of any AR data packet corresponding to "XXX Building - 15th floor" is triggered, the "[Example] Science Fiction" category related to the target reality scenario "XXX Building - 15th floor" in the server may request to obtain an initial AR data packet of

Here, the number of initial AR data packets related to the target reality scenario may be at least one, and different initial AR data packets may correspond to categories of different AR scenarios. Illustratively, each initial AR data packet may include label information, wherein the label information is for indicating a category of the initial AR data packet, for example, "Science Fiction Category", "Cartoon Category" and " history category", the various categories are for representing the style of the virtual object to be displayed in the AR scenario; Here, each initial AR data packet may include a preset virtual target, or may not include a virtual target.

Exemplarily, the target reality scenario may be an indoor scenario of a building or a street scenario, and may also be any target reality scenario capable of overlapping a virtual object.

In step S102, update data of at least one virtual object related to the initial AR data packet is obtained; The update data includes first pose data corresponding to at least one virtual object.

Here, the at least one virtual object related to the initial AR data packet may include a locally included virtual object among the initial AR data packet, and may also include a virtual object downloaded through a network, and may also include a virtual object downloaded through a network. A virtual object obtained from a material library may be included, wherein the material library may be set locally as well as set on a cloud server, and the present invention is not limited thereto.

Illustratively, the virtual object may be a static virtual model, such as the above-mentioned virtual flowerpot, virtual tree, or a dynamic virtual object such as some virtual videos and virtual moving images, and the first pose data of the virtual object is a virtual object presentation Data may include, but are not limited to, data that may indicate at least one of a position and a posture in the case of a position, and may include, for example, position coordinates, deflection angle, and size information in a coordinate system corresponding to the target reality scenario of the virtual object. .

In step S103, the initial AR data packet is updated according to the update data of the at least one virtual object to generate an updated AR data packet.

In some embodiments, based on the obtained update data, the content of the related virtual object in the initial AR data packet may be updated to obtain an updated AR data packet, wherein the update method is to directly update the update data to the initial AR data packet. It may be adding to the data packet, or replacing some existing data in the initial AR data packet, to obtain an updated AR data packet, wherein the updated AR data packet is a virtual data packet related to the above-mentioned initial AR data packet. an object, and update data of the at least one virtual object.

When the obtained updated AR data packet is available for the AR device to shoot the target reality scenario, it displays the virtual object fused to the target reality scenario according to the updated AR data packet.

In an embodiment of the present invention, upon detecting the first trigger operation, an initial AR data packet related to the target reality scenario may be acquired, and update data including at least one virtual target related to the initial AR data may be additionally added. may include, for example, first pose data corresponding to the at least one virtual object, and perform an initial AR data packet update based on the next update data, so that the virtual object further matches the target reality scenario By obtaining , enhance the authenticity effect of the augmented reality scenario.

The steps S101 to S103 will be described repeatedly in detail by combining specific examples below.

In one embodiment, the generating method provided in the embodiment of the present invention may be applied to an AR generating end, wherein the generating method comprises:

The method further includes acquiring a three-dimensional scenario model of the target reality scenario indicated by the first trigger action.

Illustratively, the AR generating end may be a device such as a computer, laptop, tablet, etc., and these devices may be equipped with an application program for creating and editing AR scenario content, or use a WEB page for creating and editing AR scenario content. can be accessed, the user can remotely edit the AR scenario content in the application program or WEB page, for example, by simulating the target reality scenario through a three-dimensional scenario model representing the target reality scenario, in the target reality scenario Without the need for configuration, it is possible to directly compose the related data of the virtual object to be displayed in the 3D scenario model, thereby realizing the creation of AR scenario content.

In some embodiments, editing options corresponding to a plurality of reality scenarios may be displayed on the display interface of the AR generating end, and after detecting that any one editing option is triggered, a real scenario corresponding to the triggered editing option may be displayed. It can be used as a target reality scenario, and when the editing option of the target reality scenario is triggered, a three-dimensional scenario model of the target reality scenario can be obtained, so that a virtual object to be displayed in the three-dimensional scenario model of the subsequent target reality scenario model is displayed. easy to add Alternatively, a map may be displayed on the display interface of the AR generating end, and a plurality of Point Of Interest (POI) are set on the map, and each POI point corresponds to one reality scenario, and the user When clicking on a POI of a reality scenario, the AR generating end may likewise detect that an edit option for the target reality scenario has been triggered, whereby a three-dimensional scenario model representing the target reality scenario, and an initial augmentation related to the target reality scenario It is easy to acquire a reality (AR) data packet, and then add a virtual object to be displayed in the three-dimensional scenario model of the target reality scenario model.

Exemplarily, the three-dimensional scenario model representing the target reality scenario and the target reality scenario are presented in equal proportion under the same coordinate system. For example, if the target reality scenario includes a street and a building on both sides of the street, the target reality scenario Similarly, the three-dimensional scenario model of the street represents including the model of the street and the buildings on both sides of the street, and the three-dimensional scenario model and the target reality scenario can be presented in the same coordinate system, for example, according to a 1:1 ratio, It may be presented in an isoproportion.

As shown in Fig. 2B, the edit page displaying AR scenario content, when detecting that the "Update Experience Package List" option is triggered in the editing interface, acquires various reality scenarios such as "XXX Building - 15th Floor" and, upon detecting that the "download scenario" is triggered in the editing interface, it may be considered that a first trigger action for the target reality scenario has been detected, whereby a three-dimensional scenario model representing the target reality scenario, and a label It is possible to obtain an initial AR data packet related to the target reality scenario, such as two initial AR experience packages with information "Christmas" and "disconnection".

It can be seen that the category tagging in which the initial AR experience package (initial AR data packet) related to the target reality scenario is “Christmas” further includes the tagging of “science fiction” and “nature”, which indicates that the created virtual object is It is explained that it may be a virtual object belonging to a science fiction category, and a virtual object belonging to a natural category, and of course, in case of later editing, the category of the AR data packet may be changed based on the category of the uploaded virtual object.

Furthermore, in the case of the step S102, when the update data of at least one virtual object related to the initial AR data packet is obtained, the step S102 includes the following steps.

In step S1021, the loaded 3D scenario model is displayed.

In step S1022, update data when the at least one virtual object is located in the 3D scenario model is obtained, and the update data includes first pose data when the at least one virtual object is located in the 3D scenario model do.

Exemplarily, the first pose data when the virtual object is located in the 3D scenario model includes position coordinates, deflection angle, and size information when the virtual object is located in the coordinate system of the 3D scenario model, wherein , the deflection angle can be expressed through the narrow angle between the specified forward direction of the virtual object and the coordinate axis of the three-dimensional scenario model coordinate system.

Illustratively, the three-dimensional scenario model and the target reality scenario may be presented in a 1:1 ratio in the same coordinate system, and may be presented in an equal proportion in different coordinate systems, so that the virtual object is presented in the three-dimensional scenario model When the first pose data is obtained, and presented in a later AR device, the virtual object may indicate presentation special effect information in the target reality scenario.

Here, by detecting the editing operation input by the user to the displayed editing page at the AR generating end, the content edited by the editing operation can be obtained, and the content edited by the editing operation can be used as update data have. For example, on the edit page, an example diagram of a three-dimensional scenario model and a pose data edit bar related to the virtual object may be displayed, and the user may display the virtual object's first pose data in the three-dimensional scenario model in the pose data edit bar of the virtual object can be edited, and after the editing is completed, the AR generating end can acquire the first pose data of the virtual object in the three-dimensional scenario model.

Furthermore, the virtual object may determine, based on the first pose data in the three-dimensional scenario model, first pose data when the virtual object is displayed in the target reality scenario, wherein the first pose data is determined in the target reality scenario. Depending on the case of the display, it can enable the virtual object to be better fused with the target reality scenario, so that the AR device can display the effect of a more realistic augmented reality scenario.

In an embodiment of the present invention, it is possible to provide a user with a three-dimensional scenario model and an initial AR data packet related to the target reality scenario, so that the user can intuitively access the initial AR data packet through the three-dimensional scenario model according to their own needs. It is easy to perform an edit update on at least one related virtual object, and through the above method, an updated AR data packet is obtained, and when the augmented reality experiencer performs the augmented reality experience in the target reality scenario, the directly updated AR data packet You can perform an augmented reality experience by calling AR materials are provided.

In addition, since it is possible to provide a three-dimensional scenario model for editing the first pose data of the virtual object, it is easy for the user to intuitively edit the first pose data in the three-dimensional scenario of the virtual object, so that, based on user demand, It is possible to personally set the first pose data of the virtual object.

In another embodiment, the generating method provided in the embodiment of the present invention may also be generated in the process of experiencing in an AR scenario, for example, applied to an AR device performing an AR scenario display, the method comprising: ,

The method further includes displaying, by the AR device, at least one virtual object related to the initial AR data packet based on the second pose data and the initial AR data packet when the AR device currently captures the target reality scenario.

For example, the AR device may be equipped with an application program for displaying and editing AR scenario content, and the user may edit the AR scenario content in the augmented reality scenario by opening the application program on the AR device, and the application After opening the program, the display interface of the AR device may display an editing option corresponding to at least one reality scenario, each reality scenario being associated with a plurality of initial AR data packets, and each initial AR data packet being associated with a corresponding It has an editing option, and online editing of these initial AR data packets can be performed.

In some embodiments, the display interface of the AR device may display initial AR data packets respectively corresponding to a plurality of reality scenarios, and after detecting that an editing option of any one initial AR data packet has been triggered, the triggered editing An initial AR data packet corresponding to the option may be used as an AR data packet related to the target reality scenario.

Before displaying the virtual object, second pose data when the AR device captures the current target reality scenario may be acquired, and then, based on the second pose data when the next AR device captures the current target reality scenario, the AR device A virtual object to be displayed on the device is determined, and as is known from this, an embodiment of the present invention provides a method of editing AR scenario contents during the process of experiencing an augmented reality scenario.

For example, when the AR device captures the current target reality scenario, the second pose data may include at least one of a position and a display angle at which a display member for displaying a virtual target is located, and the second pose data corresponding to the AR device 2 In order to facilitate interpretation of the pose data, the concept of a coordinate system is introduced here, for example, taking the world coordinate system in which the target reality scenario is located. For example, the second pose data corresponding to the AR device is the AR device. the display member of the coordinate position in the world coordinate system; The narrow angle of the display member of the AR device and each coordinate axis in the world; And the display member of the AR device may include at least one of a coordinate position in the world coordinate system and a narrow angle of each coordinate axis among the world coordinates, but is not limited thereto.

Here, the display member of the AR device specifically refers to a member for displaying a virtual object among the AR devices. For example, when the AR device is a mobile phone or a tablet, the corresponding display member may be a screen, and the AR device In the case of AR glasses, the corresponding display member may be a lens for displaying a virtual object.

The second pose data corresponding to the AR device may be obtained through various methods. For example, when a pose sensor is configured in the AR device, the second pose data of the AR device may be determined through the pose sensor on the AR device. can; When an image collecting member such as a camera is configured in the AR device, the second pose data may be determined through the target reality scenario image collected by the camera.

Illustratively, the pose sensor may include an angular velocity sensor for determining a shooting angle of an AR device, such as a gyroscope, an inertial measurement unit (IMU), or the like; Global Positioning System (GPS), Global Navigation Satellite System (GLONASS), Wi-Fi (Wireless Fidelity, WiFi) positioning to determine the location of AR devices such as positioning members based on positioning technology may include members; At the same time, it may include an angular velocity sensor for determining a photographing angle of the AR device and a positioning member for determining a photographing position.

Specifically, when the second pose data corresponding to the AR device is determined through the target reality scenario image captured by the AR device, the AR device uses the target reality scenario image and the first neural network to determine the pre-stored location. Second pose data corresponding to the device may be determined.

Illustratively, the first neural network may be obtained by training based on a plurality of sample photos obtained by photographing a target reality scenario in advance, and second pose data corresponding to each sample photograph taken.

When the second pose data corresponding to the AR device is determined with the target reality scenario image captured by the AR device, the AR device prompts the user to enter the editing state and starts to determine the location, as shown in FIG. 3 . display information for doing so, for example, displaying information for prompting the user to shoot a target reality scenario image for positioning.

When the AR device acquires second pose data when capturing the current target reality scenario, the second pose data corresponding to the AR device and at least one virtual object related to the initial AR data packet are displayed in the target reality scenario. Based on the initial first pose data, the at least one virtual object may be displayed, and at the same time the virtual object may be displayed, a pose data display interface of the at least one virtual object may also be displayed, as shown in FIG. As shown, this is an example of an exhibition of Tang Tri-Color Glazed Ceramics, which is a virtual object, and a pose data display interface for a virtual object in the exhibition area. The initial first pose data in is displayed, and mainly includes coordinate information in the target reality scenario.

For example, the pose data display interface shown in the left side of FIG. 4 includes "my map coordinates", and the display member of the AR device may indicate coordinate information in the coordinate system in which the target reality scenario is located; In the model list, a plurality of virtual objects includes coordinate information in the target reality scenario, for example, virtual objects "Dang Samchaemal" and "Stone Lion" each include coordinate information in the target reality scenario, and further, Also, other virtual objects and other virtual objects may add coordinate information in the target reality scenario.

Furthermore, in the case of step S102, when obtaining update data of at least one virtual object related to the initial AR data packet,

obtaining update data of the displayed at least one virtual object; The update data includes first pose data in which the at least one virtual object is a target reality scenario.

Here, by detecting the editing operation input to the pose data editing page displayed by the user in the AR device, the content edited by the editing operation can be obtained, and the content edited by the editing operation can be used as update data. For example, on the pose data editing page, the AR device may display a pose data editing bar related to the virtual object, and as shown in FIG. 5 , the user may select the virtual object from the virtual object’s pose data editing bar in the target reality. The first pose data in the scenario may be edited. For example, since editing of the pose data of the virtual object is completed in the world coordinate system in which the target reality scenario is located, after the editing is completed, the AR device displays the virtual object in the target reality. The first pose data in the scenario may be obtained.

Exemplarily, on the left side of FIG. 5 , the currently displayed virtual object “Dang Samchaemal” displays coordinate information in the target reality scenario, and the virtual object displays interaction data in the target reality scenario, and the interaction data is interpreted from the back door do. The right side in FIG. 5 displays an interface in which the currently displayed virtual object edits first pose data in the target reality scenario, and in the interface, coordinate information in the coordinate system in which the virtual object is located in the target reality scenario is edited. In addition, the size proportion of the virtual object may be edited, and the angle of the virtual object and the three coordinate axes in each coordinate system may be edited.

In an embodiment of the present invention, after acquiring the second pose data corresponding to the AR device, at least one virtual object related to the initial AR data packet is displayed based on the second pose data corresponding to the AR device. Thus, by allowing the user to intuitively edit and adjust the first pose data in the target reality scenario of the virtual object according to the demand in the AR device, the process of generating AR scenario content can be simplified, and the process is the augmented reality scenario Since it is possible to perform intuitive adjustments to AR data packets during the experience of

In one embodiment, the step of obtaining update data of the at least one displayed virtual object mentioned above comprises:

displaying the pose data editing interface, and acquiring first pose data of the at least one virtual object received through the pose data editing interface;

Here, the first pose data includes at least one of location coordinates, deflection angle, and size information in a coordinate system in which the target reality scenario is located.

Illustratively, through the pose data editing page displayed by the AR device, the displayed at least one virtual object may acquire an editing operation of position coordinates, deflection angle and size information in a target reality scenario, whereby the at least one One virtual object obtains first pose data in the target reality scenario.

Illustratively, referring to FIG. 5 , it is a pose data editing interface for the virtual object “Dang Samchaemal”, and specifically, the pose data editing interface includes “Dangsamchaemal” for the position coordinates in the target reality scenario. Editing may be included, and "Dang Samchaemal" may include editing of size information in the target reality scenario, and "Dangsamchaemal" may include editing of the angle of deflection from the world coordinate system in which the target reality scenario is located to the coordinate axis. may include

In an embodiment of the present invention, in an augmented reality scenario, a pose data editing interface for editing the first pose data of the virtual object may be provided, so that the user can intuitively select the virtual object with the first pose data in the target reality scenario. By adjusting , it is possible to personally set the first pose data of the virtual object based on user demand.

In another embodiment, the above-mentioned update data includes, in addition to the at least one virtual object including the first pose data in the target reality scenario, also the at least one virtual object interaction data in the target reality scenario; Alternatively, the at least one virtual object may include interaction data in a three-dimensional scenario model representing the target reality scenario, and the update data provided in an embodiment of the present invention further includes interaction data corresponding to the at least one virtual object. Including, in the case of step S102, when obtaining update data of at least one virtual object related to the initial AR data packet, the step S102,

displaying an interaction data editing interface, and acquiring interaction data of each virtual object respectively received through the interaction data editing interface;

Here, the interaction data includes at least one of at least one state trigger condition, a presentation state corresponding to each state trigger condition, and the number of cycles of display after the virtual object is triggered to be displayed.

Illustratively, in the interaction data editing interface displayed by the AR device, or the interaction data editing interface displayed by the AR generating end, an editing operation for the interaction data of at least one virtual object may be obtained, that is, the target reality. On-site editing of the interaction data in a scenario may be performed, and remote editing of the interaction data may be performed in a three-dimensional scenario model representing a target reality scenario, whereby at least one state trigger condition for at least one virtual target , a presentation state corresponding to each state trigger condition, and at least one of the number of cycles of exhibition after the virtual object is triggered to be displayed.

Illustratively, based on the obtained interaction data for any one virtual object, based on a state trigger condition of a subsequent virtual object, the virtual object presents according to a presentation state corresponding to the state trigger condition; and displaying according to the number of cycles of exhibition after being triggered to be displayed by the state trigger condition.

As shown in Fig. 6, after triggering the creation trigger condition button shown in Fig. 6 (a), the interaction data editing interface shown in Fig. 6 (b) is displayed, specifically, the interaction with the virtual moving image Points to an interface for editing data, wherein the interaction data editing interface edits a state trigger condition for at least one virtual object, a presentation state corresponding to the state trigger condition, and the number of cycles of display after the virtual object is triggered to be displayed It may contain areas.

Exemplarily, an edit operation for a state trigger condition of a virtual object may be obtained through an edit area corresponding to the state trigger condition, thereby obtaining a state trigger condition corresponding to the virtual object, and the subsequent AR device triggers the state trigger After obtaining the condition, the virtual object may be triggered to be exhibited in a target reality scenario.

Exemplarily, it is possible to edit whether or not the virtual object is displayed after being triggered through the editing area of the presentation state, and as shown in FIG. 6B , a button corresponding to “model display” is selected , indicates that the current virtual video is displayed after trigger condition 1 corresponding to the current virtual video is triggered, and when the button corresponding to “display model” is not selected, trigger condition 1 corresponding to the current virtual video After this is triggered, it indicates that the current virtual moving image is not displayed.

For example, an editing operation for the number of cycles of exhibition after the virtual object is displayed through the editing area corresponding to the number of cycles may be acquired. After 1 is triggered, it may indicate performing the cycle display n times.

In particular, when the interaction data includes various state trigger conditions, the interaction data further includes the priority of each state trigger condition.

Illustratively, when the interaction data editing interface displayed by the AR device edits the interaction data, it may be displayed on the page shown in FIG. 5, for example, on the left side of FIG. Interaction data corresponding to the virtual target "Dang Samchaemal" including coordinate information under the coordinate system in which the target real scenario is located, and trigger conditions, display status, circular display status, priority, etc. (not shown in FIG. 5) not) can be displayed.

Illustratively, if the interaction data includes various state trigger conditions, it specifically indicates that a plurality of virtual objects related to the initial AR data packet are included, and when each virtual object corresponds to one state trigger condition, each virtual object A priority can be set for a state trigger condition corresponding to a target, and when a subsequent AR device simultaneously acquires a plurality of status trigger conditions, the virtual target corresponding to the state trigger condition with the highest priority is assigned to the virtual target trigger to display according to at least one of a presentation state corresponding to a corresponding state trigger condition, and a cycle display number after the virtual object is triggered to be displayed.

The state trigger conditions mentioned here are:

It may include, but is not limited to, at least one of a click model trigger condition, a sliding model trigger condition, a distance identification trigger condition, a specified area trigger condition, a gesture identification trigger condition, a trigger condition toward the current model, and a trigger condition toward the specified model. .

We will combine virtual target A below to explain the meaning of these state trigger conditions.

Here, (1) the click model trigger condition refers to triggering a state trigger condition for displaying the virtual object A in the AR device after clicking the three-dimensional model of the virtual object A displayed on the AR device. the device may display a 3D model of the virtual object to be displayed, and after detecting a click operation on the 3D model, display the virtual object corresponding to the 3D model;

(2) The sliding model trigger condition refers to a state trigger condition for the virtual object A triggered by sliding the three-dimensional model of the virtual object A according to a method set in the AR device, and exemplarily, the virtual object in the AR device Performing a right sliding action on the 3D model for A to trigger the virtual object A to be displayed, and performing a left sliding action on the 3D model for the virtual object A in the AR device to trigger the virtual object A to disappear. can be set to;

(3) the distance trigger condition indicates a state trigger condition for the virtual object A that is triggered when the distance between the location coordinates where the AR device is located and the set location point satisfies the set distance;

(4) the designated area trigger condition indicates a state trigger condition for the virtual object A triggered after the AR device enters the designated area;

(5) the gesture identification trigger condition indicates a state trigger condition for the virtual object A triggered through the set gesture movement;

(6) the trigger condition toward the current model indicates a state trigger condition for the virtual object A that is triggered when the shooting angle of the AR device is toward the location where the virtual object A is located;

(7) The trigger condition toward the specified model indicates a state trigger condition for the triggered virtual object A when the AR device is directed toward the location where the specified virtual object is located.

When an AR data packet includes a plurality of virtual objects, and when each virtual object corresponds to one state trigger condition, a trigger logic chain for these state trigger conditions can be formed, for example, 3 virtual objects in the AR data packet The virtual targets are included, and state trigger conditions corresponding to the first virtual target, the second virtual target, and the third virtual target are recorded as state trigger condition 1, state trigger condition 2 and state trigger condition 3, respectively, and state trigger After condition 1, condition trigger condition 2 and condition trigger condition 3 form a trigger logic chain, for example, if the order of the formed trigger logic chain is condition trigger condition 1, condition trigger condition 2, and condition trigger condition 3, the user When trigger condition 1, condition trigger condition 2, and condition trigger condition 3 are sequentially triggered, virtual object 1, virtual object 2, and virtual object 3 may be sequentially displayed.

In an embodiment of the present invention, by providing an interaction data editing interface for editing interaction data for a virtual object, a trigger method for editing a virtual object and a display type may be supported.

In one embodiment, the production method provided in the Examples of the present invention comprises:

obtaining third pose data corresponding to the at least one virtual object model related to the initial AR data packet, the at least one virtual object model representing the target object in the target reality scenario;

The step of generating an updated AR data packet by updating the initial AR data packet based on the update data of the at least one virtual object includes:

and generating an updated AR data packet by updating the initial AR data packet based on the updated data of the at least one virtual object and third pose data corresponding to the virtual object model.

Illustratively, the third pose data corresponding to the virtual object model may include, but is not limited to, data that may indicate at least one of a position and an attitude when the virtual object model is presented in a target reality scenario, Alternatively, the virtual object model may include data that may represent at least one of a position and an attitude in the three-dimensional scenario model, for example, the virtual object model may include a target reality scenario or a three-dimensional scenario model in which the model is located. Position coordinates in the coordinate system, deflection angle, and size information may be included.

Specifically, the third pose data in the virtual object model in the target reality scenario or in the three-dimensional scenario model may indicate the third pose data in the target reality scenario of the target real object corresponding to the virtual object model, and , you can edit the display form when the virtual object model is displayed on an AR device. and the virtual object model can be used to shield the virtual object to be shielded. For example, when the virtual object is displayed, rendering is not performed on a partial area where the virtual object is to be shielded, and the virtual object model is generated. By being able to perform a transparent treatment on a portion of the shielded area, it is possible to achieve a shielding effect.

In an embodiment of the present invention, it is possible to edit the virtual object model for presenting the shielding effect, and through editing the third pose data corresponding to the virtual object model, the virtual object model is the actual model in the target reality scenario. Restoring the third pose data can be implemented, so it is easy to provide a more authentic display effect when a virtual object is displayed in a subsequent AR device.

In one embodiment, the at least one virtual object includes at least one first virtual object, and in the case of step S102, when obtaining update data of the at least one virtual object related to the initial AR data packet, the Step S102,

and acquiring update data of at least one first virtual object included in the initial AR data packet.

When the initial AR data packet includes a virtual object, wherein obtaining update data of at least one virtual object related to the initial AR data packet includes obtaining update data of at least one first virtual object included in the initial AR data packet may be doing

In another embodiment, the at least one virtual object includes at least one second virtual object, and in the case of step S102, when obtaining update data of the at least one virtual object related to the initial AR data packet, The step S102,

obtaining at least one second virtual object related to the AR data packet from the pre-built material library, and obtaining update data of the at least one second virtual object.

When the initial AR data packet includes a virtual object or does not include a virtual object, update data of at least one virtual object related to the initial AR data packet is acquired, and at least one AR data packet related to the pre-built material library is obtained. may obtain a second virtual object of , and update data of at least one second virtual object may be obtained.

In another embodiment, when obtaining update data of at least one virtual object related to the initial AR data packet, the update data of at least one first virtual object included in the initial AR data packet, and the previously built Update data of at least one second virtual object related to the initial AR data packet may be simultaneously acquired from the material library.

Illustratively, the pre-built material library may include virtual objects such as various virtual static models, moving images and videos, and the user selects the virtual objects to be uploaded to the initial AR data packet from the pre-built material library. You can choose.

For example, the second virtual object and the first virtual object may be the same or different, and the initial AR data packet may be updated through update data of at least one of the first virtual object and the second virtual object. .

In an embodiment of the present invention, the virtual object related to the initial AR data packet and update data of the virtual object may be obtained through various methods, so that the update data of the virtual object may be flexibly obtained.

Correspondingly, when displaying at least one virtual object related to the initial AR data packet,

presenting at least one of at least one first virtual object in the initial AR data packet and at least one second virtual object related to the initial AR data packet obtained from a pre-built material library.

As described above, the initial AR data packet may or may not include a virtual object, and when the initial AR data packet includes a virtual object, at least one virtual object related to the displayed initial AR data packet. may indicate that at least one first virtual object included in the initial AR data packet is displayed, and is displayed after at least one second virtual object related to the initial AR data packet is obtained from a pre-built material library. Alternatively, at least one first virtual object included in the initial AR data packet and at least one second virtual object related to the initial AR data packet obtained from a pre-built material library are displayed at the same time can

Further, after generating the updated AR data packet, the generating method provided in the embodiment of the present invention comprises:

sending the updated AR data packet to the server; Alternatively, the method further includes transmitting the updated AR data packet and status information indicating whether the updated AR data packet is activated to the server.

For example, as shown in FIG. 7 , after editing the initial AR data packet to obtain an updated AR data packet, it can be clicked to save, for example, the AR device triggers a storage trigger operation triggered by the user. After successful detection and storage, the updated AR data packet may be transmitted to the server.

Illustratively, the state information indicating whether the updated AR data packet is activated may be set through the interface shown in Fig. 2A, and an “Activate” button (not shown in Fig. 2A) below each AR data packet ) can be set, and when the "Activate" button under the AR data packet is triggered, the updated AR data packet corresponding to the AR data packet is uploaded to the server, and then downloaded and experienced by the AR device indicates

In an embodiment of the present invention, the generated updated AR data packet can be posted to the server, so that other users can download and use it. It can be provided for AR devices to download and experience AR data packets.

In another embodiment, after generating the updated AR data packet, the generating method provided in the embodiment of the present invention comprises:

The method further includes: in response to an upload trigger operation for the updated AR data packet, obtaining label information of the updated AR data packet, and sending the updated AR data packet and label information to the server.

Exemplarily, the initial AR data packet may be edited to obtain the updated AR data packet, and then the updated data packet may be sent to the server, as shown in FIG. 8 , the AR data packet related to the obtained target reality scenario may include a plurality, and after the user triggers the upload experience package operation of the page shown in (a) of FIG. 8, to determine the target updated AR data packet to be uploaded by the user, ( The page shown in b) can be displayed, and the user can write label information corresponding to the target updated AR data packet to be uploaded on the page.

Illustratively, the label information may include information such as the name of the target reality scenario, the building name, the experience package name, themes, remarks, and the like, and the creation of the label information is, in one aspect, easy to determine the updated AR data packet to be uploaded And, on the other hand, since it is easy for the server to store the updated AR data packet uploaded based on the label information, it is easy for the user of the AR device end to download and experience the AR data packet from the AR device.

In an embodiment of the present invention, the generated updated AR data packet can be posted to the server, so that other users can download and use it, and illustratively, another AR generating end downloads and edits it at the same time , it can be provided for AR devices to download and experience AR data packets.

Illustratively, transmitting the updated AR data packet and label information to the server includes:

sending the updated AR data packet, label information, and status information indicating whether the updated AR data packet is activated to the server;

Here, the AR data packet in the active state may be used.

Exemplarily, state information indicating whether the updated AR data packet is activated may be set through (a) of FIG. 8 , and an “Activate” button is set under each AR data packet, and the AR data When the "Activate" button under the packet is triggered, it indicates that the updated AR data packet corresponding to the AR data packet is uploaded to the server, and then downloaded and experienced by the AR device.

An exhibition process for AR scenario content is introduced below, and the display process may be applied to an AR device, wherein the AR device may be the same as or different from the AR device for generating the AR data packet, where It is not limited any more, and as shown in FIG. 9 , the following steps S201 to S203 are included.

In step S201, in response to the second trigger action, obtain an AR data packet related to the target reality scenario indicated by the second trigger action; The AR data packet includes first pose data corresponding to the at least one virtual object.

Illustratively, the AR device may include, but is not limited to, a device having a display function and a data processing function, such as AR glasses, a tablet computer, a smartphone, a smart wearable device, etc. An application program may be installed for this purpose, and the user may experience AR scenario content in the application program.

After opening an application program for displaying AR scenario content in the AR device, the AR device may display at least one reality scenario and an AR data packet related to each reality scenario, for example, a second trigger operation may be a trigger action for an AR data packet related to the target reality scenario, and in one embodiment, as shown in FIG. 2A , the user may select a target reality in the AR data packet related to the reality scenario exhibited by the AR device. You can click the AR data packet related to the scenario "XXX Building - 15th floor", for example, if you click the AR data packet that is "[Example] Science Fiction", the AR device triggers the second trigger for the AR data packet By being able to detect the presence of the action, it is possible to request the server to obtain an AR data packet related to the target reality scenario "XXX Building - 15th floor".

Here, the first pose data corresponding to the at least one virtual target included in the AR data packet may be first pose data in the target reality scenario, or the first pose data corresponding to the at least one virtual target included in the AR data packet. The first pose data may be the first pose data in the three-dimensional scenario model of the target reality scenario, and for specific details, reference may be made to the above description, which will not be repeated any longer.

In step S202, based on the second pose data in which the AR device captures the current target reality scenario, and the first pose data corresponding to the at least one virtual object among the AR data packets, the presentation of the at least one virtual object is special. Determine the effect information.

Here, the method of acquiring the second pose data when the AR device captures the current target reality scenario and the second pose data corresponding to the AR device may refer to the above description, and will not be repeated herein.

Before the AR device acquires the second pose data for shooting the current target reality scenario, as shown in FIG. 10 , the AR device may display information for prompting the user to shoot using the AR device.

When the first pose data corresponding to the virtual object is the first pose data in the target reality scenario, the second pose data corresponding to the AR device and the first pose data corresponding to the virtual object are pose data in the same coordinate system, The virtual object may determine presentation special effect information in the AR device based on the second pose data corresponding to the AR device and the first pose data corresponding to the at least one virtual object.

When the first pose data corresponding to the virtual object is the first pose data in the three-dimensional scenario model of the target reality scenario, the three-dimensional scenario model and the real scenario are presented in a 1:1 ratio in the same coordinate system, and in different coordinate systems Since the presentation is in equal proportion, the virtual object is presented in the AR device through the first pose data and the second pose data corresponding to the AR device when the preset virtual object is presented in the 3D scenario model. It is possible to determine the presentation special effect information.

In step S203, based on the presentation special effect information, at least one virtual object is displayed through an AR device.

After the virtual object obtains the presentation special effect information in the target reality scenario, the at least one virtual object may be displayed according to the presentation special effect information through the AR device, as shown in FIG. 11 , the target This is an example diagram showing the virtual object "Dang Samchaemal" in a real scenario.

In an embodiment of the present invention, in response to the second trigger action, an AR data packet related to the second trigger action may be acquired, and furthermore, second pose data corresponding to the AR device, and preset AR data Based on the first pose data corresponding to the virtual object in the packet, the virtual object may determine presentation special effect information in the target reality scenario, and finally display the true augmented reality scenario effect in the AR device.

Furthermore, the AR data packet further includes third pose data corresponding to the at least one virtual object model; The virtual object model represents the target object in the target reality scenario;

To determine the presentation special effect information of the at least one virtual object based on the second pose data when the AR device captures the current target reality scenario, and the first pose data corresponding to the at least one virtual object among the AR data packets case,

Based on the second pose data when the AR device captures the current target reality scenario, the first pose data corresponding to at least one virtual object among the AR data packets, and the third pose data corresponding to the virtual object model, at least one and determining the presentation special effect information of the virtual object.

Exemplarily, according to the third pose data of the virtual object model in the target reality scenario, the second pose data corresponding to the AR device, and the first pose data corresponding to the virtual object, the virtual object is attached to the virtual object model. It may be determined whether or not to be covered by the corresponding real object, and if it is determined that some or all areas of the virtual object are to be covered by the real object corresponding to the virtual object model, the shielded partial area is not rendered, and the The virtual object model may be processed in a shielding form, and transparent processing may be performed on the shielded virtual object model. It is possible to display the effect of a presentation that is shielded by the real object in the scenario.

In an embodiment of the present invention, through the third pose data of the virtual object model, it may be implemented that the virtual object model returns the actual third pose data in the target reality scenario, and the virtual object corresponds to the virtual object model When it is determined that it is blocked by a real object, the effect of a more true augmented reality scenario is displayed in the AR device by realizing the shielding effect on the virtual object through the virtual object model.

In one embodiment, the AR data packet further includes interaction data corresponding to at least one virtual object, wherein the interaction data includes at least one state trigger condition, a presentation state corresponding to each state trigger condition, and a virtual object at least one of the number of cycles of exhibits since it was triggered to be exhibited.

Illustratively, the interpretation of the state trigger condition included in the interaction data, the presentation state corresponding to each state trigger condition, and the number of cycles of display after the virtual object is triggered to be displayed may refer to the above sentence, where it is repeated do not explain

The state trigger condition based on the above may include several, for example, a click model trigger condition, a sliding model trigger condition, a distance identification trigger condition, a designated area trigger condition, a gesture identification trigger condition, a trigger condition toward the current model. and at least one or a plurality of trigger conditions toward a specified model, the interpretation of each trigger condition may refer to the above content, which will not be repeated here any longer, and the state trigger condition may include two types It can be seen that one type is a state trigger condition related to the second pose data corresponding to the AR device, for example, a distance identification trigger condition, a designated area trigger condition, a trigger condition toward the current model, and a trigger toward a designated model. at least one or a plurality of conditions, and another type is a state trigger condition independent of the second pose data corresponding to the AR device, for example, at least one of a click model trigger condition, a sliding model trigger condition, and a gesture identification trigger condition; There are multiple, and in the case of these two types below, each interaction with the virtual object is considered.

In one possible embodiment, the display method provided in the embodiment of the present invention comprises:

(1) detecting an interaction operation applied to at least one virtual object; and

(2) when an interaction operation applied to at least one virtual object satisfies a first type of state trigger condition, a presentation state corresponding to at least one virtual object under the first type of state trigger condition, and at least one Based on at least one of the number of cyclic displays after the virtual object of the virtual object is triggered to exhibit the first type of state trigger condition, the presentation special effect information of the at least one virtual object is updated, so that the updated presentation special effect information further comprising the step of obtaining;

Further, based on the presentation special effect information, the step of displaying at least one virtual object through the AR device includes:

and displaying at least one virtual object through an AR device based on the updated presentation special effect information.

Illustratively, the interaction operation may be an operation for triggering to update presentation special effect information of the virtual object, wherein the first type of state trigger condition is independent of the second pose data corresponding to the aforementioned AR device. It may be one state trigger condition, for example, at least one or a plurality of click model trigger conditions, sliding model trigger conditions, and gesture identification trigger conditions.

Illustratively, if the AR device detects that the interaction action exists, for example, if the user detects that the user has acted a sliding action triggered by the virtual object A in the AR device, the virtual object A is moved under the sliding action. At least one of a corresponding presentation state and the number of cycles of display after the virtual object A is triggered to be displayed under the sliding operation may be acquired, and then updated based on the presentation special effect information of the virtual object A.

Exemplarily, the method of updating the presentation special effect information of the virtual object may be divided into three cases. In the first case, the presentation in which at least one virtual object independently corresponds to the first type of state trigger condition and update the presentation special effect information of the at least one virtual object based on a state, wherein the second case is independently a cycle after the at least one virtual object is triggered to exhibit the state trigger condition of the first type Based on the number of exhibitions, the presentation special effect information of at least one virtual object may be updated, and in three cases, the presentation state corresponding to the at least one virtual object under the state trigger condition of the first type, and at least The presentation special effect information of at least one virtual object may be jointly updated by simultaneously combining the number of cycles of display after one virtual object is triggered so that the first type of state trigger condition is displayed.

Below, the above three cases are introduced by combining specific examples, respectively.

In the first case, exemplarily, if the initial presentation special effect information of the virtual object A is a virtual vase displayed on the desk, and the interaction operation is a sliding operation applied to the virtual object, the virtual object A corresponds to the sliding operation The presented presentation state is non-display, and after detecting that there is a sliding motion acting on the virtual vase, the presentation special effect information of the virtual vase is changed from the original display to disappear.

In the second case, illustratively, if the virtual object A walks from the location A to the location B on the wall is a presented virtual cat, and the interaction action is a click action applied to a three-dimensional model corresponding to the virtual cat, The number of cycles of exhibition after the virtual object is triggered to be displayed under a click action is 5 times, and when it detects that the user acts a click action on the virtual cat, the virtual cat is displayed from position A to position B can be triggered to cycle 5 times according to

In the third case, illustratively, the virtual object A is a virtual light that blinks once in the lantern, the interaction operation is a gesture identification operation, and the virtual light is a display of a corresponding presentation state under the gesture identification operation, The number of cycles of display after the virtual object is triggered to be displayed under the gesture identification operation is 5 times, and when the gesture identification operation is detected, the presentation special effect information of the virtual light may be updated to blink 5 times.

In an embodiment of the present invention, when it is detected that an interaction action for the virtual object exists, when it is determined that the interaction action meets a set state trigger condition, the virtual object is displayed under the set state trigger condition according to a display method , displaying the virtual object, for example, the augmented reality experiencer may display a gesture set on the AR device, thereby triggering the virtual object to be displayed according to a presentation special effect corresponding to the gesture, the method being augmented The real experiencer enhances the interaction with the virtual object in the target reality scenario, and improves the user experience.

In another possible embodiment, the display method provided in the embodiment of the present invention comprises:

When the second pose data meets the state trigger condition of the second type, at least one virtual object is in a corresponding presentation state under the state trigger condition of the second type, and at least one virtual object is the second type of state trigger condition. updating the presentation special effect information of the at least one virtual object to obtain updated presentation special effect information based on at least one of the number of times of cyclic display after the state trigger condition is triggered to be displayed;

Based on the presentation special effect information, the step of displaying at least one virtual object through the AR device includes:

and displaying at least one virtual object through an AR device based on the updated presentation special effect information.

Illustratively, the second type of state trigger condition may be a state trigger condition related to the second pose data corresponding to the aforementioned AR device, for example, a distance identification trigger condition, a designated area trigger condition, and a direction toward the current model. It is at least one or a plurality of trigger conditions and trigger conditions toward a specified model.

Exemplarily, the case that the second pose data corresponding to the AR device meets the second type of state trigger condition includes various cases, and specifically, at least one of a position and a display angle at which a display member of the AR device is located. It is possible to determine whether the second pose data corresponding to the AR device meets the second type of state trigger condition through the It can be determined whether the second type of state trigger condition is met, and whether the second pose data corresponding to the AR device meets the second type of state trigger condition can be independently determined through the display angle of the AR device. , or by combining the position where the display member of the AR device is positioned and the display angle, it may be determined whether the second pose data corresponding to the AR device meets the second type of state trigger condition.

For example, when the distance between the position coordinates at which the display member of the AR device is located and the set position point satisfies the set distance, it is determined that the second pose data corresponding to the AR device meets the second type of state trigger condition. can decide; Alternatively, when it is determined that the display angle of the AR device faces the location where the virtual object A is located, it may be similarly determined that the second pose data corresponding to the AR device meets a second type of state trigger condition; Alternatively, if the distance between the location coordinates at which the display member of the AR device is located and the set location point satisfies the set distance, and the display angle of the AR device faces the displayed location of the virtual object A, it corresponds to the AR device It is determined that the second pause data to be used satisfies the second type of state trigger condition, and since there are many such cases, it will not be repeated here.

Furthermore, when the second pose data corresponding to the AR device satisfies the second type of state trigger condition, at least one virtual object has a presentation state corresponding to the second type of state trigger condition, and at least one The presentation special effect information of at least one virtual object may be updated according to at least one of the number of cycles of display after the virtual object is triggered to display the second type of state trigger condition, and the specific update method is the above-mentioned interaction It is similar to the method of updating based on an action, and will not be repeated here any longer.

In an embodiment of the present invention, when detecting that the second pose data corresponding to the AR device meets the set state trigger condition, the virtual object displays the virtual object according to the display method under the set state trigger condition, Exemplarily, when the AR device is close to the set position and the display angle of the AR device is toward the location where the virtual object A is located, the virtual object A according to the presentation special effect corresponding to the second pose data of the AR device trigger to be displayed, and the process can make the augmented reality scenario effect more real, thereby improving the user experience.

A process of remotely generating AR scenario content based on the AR generating end will be described below, and as shown in FIG. 12 , it includes the following steps.

In step S301, in response to the first trigger action, a three-dimensional scenario model of the target reality scenario indicated by the first trigger action and an initial AR data packet related to the target reality scenario are obtained.

In step S302, update data of at least one virtual object related to the initial AR data packet is obtained; The update data includes first pose data of the at least one virtual object in the three-dimensional scenario model.

In step S303, the initial AR data packet is updated according to the update data of the at least one virtual object to generate an updated AR data packet.

In an embodiment of the present invention, in response to the first trigger operation, a three-dimensional scenario model and an initial AR data packet related to the target reality scenario may be provided to the user, so that the user can intuitively respond to a three-dimensional scenario according to his or her own demand. It is easy to perform an edit update on at least one virtual object related to the initial AR data packet through the model, obtain the updated AR data packet through the above method, and the augmented reality experiencer can perform the augmented reality experience in the target reality scenario. In this case, the augmented reality experience can be performed by directly calling the updated AR data packet, and through the method of remotely editing the AR data packet provided in the present invention, the method of generating the AR data packet can be simplified, so that the subsequent Convenient AR materials are provided for the display of augmented reality scenarios.

Referring to FIG. 13 , an embodiment of the present invention further provides an AR scenario content display system 400 , including an AR generating end 401 , a server 402 and an AR device 403 , the AR generating end 401 is communicatively connected with the server 402 , and the AR device 403 is communicatively connected with the server 402 ;

The AR generating end 401, in response to the first trigger action, acquires a three-dimensional scenario model of the target reality scenario indicated by the first trigger action, and an initial augmented reality (AR) data packet related to the target reality scenario, ; obtain update data of at least one virtual object related to the initial AR data packet, wherein the update data includes first pose data of the at least one virtual object in the three-dimensional scenario model; update the initial AR data packet according to the update data of the at least one virtual object, and send the updated AR data packet to the server;

The server 402 is configured to receive the updated AR data packet, and forward the updated AR data packet to the AR device;

AR device 403, in response to the second trigger action, obtain an updated AR data packet related to the target reality scenario indicated by the second trigger action stored in the server; When the AR device captures the current target reality scenario, at least one virtual object among the second pose data and the updated AR data packet is based on the first pose data in the 3D scenario model, and presents the at least one virtual object. determine presentation special effects information; Based on the presentation special effect information, at least one virtual object is displayed through an AR device.

The exhibition system provided in the embodiment of the present invention can remotely edit the generated AR data packet and publish the generated AR data packet to the server, so that the AR device end provides an augmented reality experience, specifically can provide a simple creation method for AR data packets at the AR generating end, which is easy for users to edit, and the server end can store AR data packets, making it easy for AR devices to download and experience AR data packets.

A process of generating AR scenario content as a scene in an augmented reality scenario based on an AR device will be described below, which is applied to an AR device, and includes the following steps as shown in FIG. 14 .

In step S501, in response to the first trigger action, an initial AR data packet related to the target reality scenario indicated by the first trigger action is acquired.

In step S502, the AR device displays at least one virtual object related to the initial AR data packet based on the second pose data when the current target reality scenario is captured and the initial AR data packet.

In step S503, update data of the displayed at least one virtual object is obtained; The update data includes first pose data in which the at least one virtual object is a target reality scenario.

In step S505, the initial AR data packet is updated based on the update data to generate an updated AR data packet.

In an embodiment of the present invention, in response to the first trigger operation, the AR data packet editing state may be entered, and after acquiring the second pause data corresponding to the AR device, the second pause corresponding to the AR device Based on the data, it is possible to display at least one virtual object related to the initial AR data packet, so that the user can intuitively make edit adjustments to the second pose data in the target reality scenario according to the demand in the AR device. By doing so, the process of generating AR scenario content can be simplified, and the accuracy of the adjusted AR data packet can be higher.

Based on the same technical idea, an embodiment of the present invention further provides a generating device corresponding to the AR scenario content generating method shown in FIG. Since it is similar to the generating method according to the embodiment of the present invention, the implementation of the apparatus may refer to the implementation of the method, and overlapping places will not be repeated any longer.

Referring to FIG. 15 , an apparatus 600 for generating AR scenario content provided in an embodiment of the present invention includes:

a first acquiring module 601 for acquiring, in response to the first trigger action, an initial AR data packet related to the target reality scenario indicated by the first trigger action;

a second acquiring module 602, configured to acquire update data of at least one virtual object related to the initial AR data packet, wherein the update data includes first pose data corresponding to the at least one virtual object; and

and an update module 603 configured to update the initial AR data packet based on the update data of the at least one virtual object to generate an updated AR data packet.

In one possible embodiment, the first obtaining module 601 also comprises:

to obtain a three-dimensional scenario model of the target reality scenario indicated by the first trigger action;

When the second acquiring module 602 is for acquiring update data of at least one virtual object related to the initial AR data packet, also

display the loaded three-dimensional scenario model;

The update data is obtained when the at least one virtual object is located in the 3D scenario model, and the update data includes first pose data when the at least one virtual object is located in the 3D scenario model.

In one possible embodiment, the generating device further comprises a display module 604 , the display module 604 comprising:

Based on the second pose data when the AR device captures the current target reality scenario, and the initial AR data packet, display at least one virtual object related to the initial AR data packet.

When the second acquiring module 602 is for acquiring update data of at least one virtual object related to the initial AR data packet, also

to obtain update data of the displayed at least one virtual object; The update data includes first pose data in which the at least one virtual object is a target reality scenario.

In one possible embodiment, when the second acquiring module is for acquiring updated data of the displayed at least one virtual object, also

display the pose data editing interface, and obtain first pose data of the at least one virtual object received through the pose data editing interface;

Here, the first pose data includes at least one of location coordinates, deflection angle, and size information in a coordinate system in which the target reality scenario is located.

In one possible embodiment, the update data further comprises interaction data corresponding to the at least one virtual object;

When the second acquiring module is for acquiring update data of at least one virtual object related to the initial AR data packet, also

to display the interaction data editing interface, and to obtain the interaction data of each virtual object respectively received through the interaction data editing interface;

Here, the interaction data includes at least one of at least one state trigger condition, a presentation state corresponding to each state trigger condition, and the number of cycles of display after the virtual object is triggered to be displayed.

In one possible embodiment, when the interaction data includes several state trigger conditions, the interaction data further includes a priority of each state trigger condition.

In one possible embodiment, the second acquiring module 602 is also

obtain third pose data corresponding to at least one virtual object model related to the initial AR data packet, wherein the at least one virtual object model represents a target object in a target reality scenario;

When the update module 603 is to update the initial AR data packet to generate an updated AR data packet based on the update data of the at least one virtual object, also

An updated AR data packet is generated by updating an initial AR data packet based on the update data of the at least one virtual object and the third pose data corresponding to the virtual object model.

In one possible embodiment, the at least one virtual object comprises at least one first virtual object, and the second obtaining module 602 is configured to obtain update data of the at least one virtual object related to the initial AR data packet. if it is for, also

To obtain update data of at least one first virtual object included in the initial AR data packet.

In one possible embodiment, the at least one virtual object comprises at least one second virtual object, wherein the second acquiring module is for acquiring update data of the at least one virtual object related to the initial AR data packet. , In addition

Obtaining at least one second virtual object related to the AR data packet from a pre-built material library, and obtaining update data of the at least one second virtual object.

In one possible embodiment, the generating device further comprises a sending module 605, wherein after generating the updated AR data packet, the sending module 605:

sending the updated AR data packet to the server; Alternatively, the updated AR data packet and status information indicating whether the updated AR data packet is activated is to be transmitted to the server.

In one possible embodiment, after generating the updated AR data packet, the sending module 605 further comprises:

In response to an upload trigger operation for the updated AR data packet, obtain label information of the updated AR data packet, and transmit the label information to the server.

Based on the same technical idea, an embodiment of the present invention further provides a display device corresponding to the display method of AR scenario content shown in FIG. 9, and the principle and the present invention of the device in the embodiment of the present invention Since it is similar to the display method according to the embodiment of the invention, the implementation of the device may refer to the implementation of the method, and overlapping places will not be repeated any longer.

Referring to FIG. 16 , it is an exemplary diagram of an AR scenario content display device 700 provided in an embodiment of the present invention, the device comprising:

an acquiring module for acquiring, in response to the second trigger action, an AR data packet related to the target reality scenario indicated by the second trigger action, wherein the AR data packet includes first pose data corresponding to the at least one virtual object - ;

Determining presentation special effect information of at least one virtual object based on second pose data in which the AR device captures the current target reality scenario, and first pose data corresponding to at least one virtual object among AR data packets a decision module 702 for; and

and a display module 703 configured to display at least one virtual object through the AR device based on the presentation special effect information.

In one possible embodiment, the AR data packet further comprises third pose data corresponding to the at least one virtual object model; The virtual object model represents the target object in the target reality scenario;

The determining module 702 is configured to present the at least one virtual object based on the second pose data when the AR device captures the current target reality scenario, and the first pose data corresponding to the at least one virtual object among the AR data packets. In the case of determining the special effect information,

Based on the second pose data when the AR device captures the current target reality scenario, the first pose data corresponding to at least one virtual object among the AR data packets, and the third pose data corresponding to the virtual object model, at least one To determine the presentation special effect information of the virtual object of

In one possible embodiment, the AR data packet further comprises interaction data corresponding to at least one virtual object, wherein the interaction data includes at least one state trigger condition, a presentation state corresponding to each state trigger condition, and a virtual and at least one of a number of cycles of display since the object was triggered to be displayed.

In one possible embodiment, the display device further comprises an interaction module 704, wherein the interaction module 704 comprises:

detecting an interaction action acting on the at least one virtual object;

When the interaction operation applied to the at least one virtual object meets the first type of state trigger condition, the at least one virtual object has a corresponding presentation state under the first type of state trigger condition, and the at least one virtual object update presentation special effect information of at least one virtual object to obtain updated presentation special effect information based on at least one of the number of cycles of display after the first type of state trigger condition is triggered to be exhibited; will;

When the display module 704 is to display at least one virtual object through an AR device based on the presentation special effect information, further,

Based on the updated presentation special effect information, the at least one virtual object is displayed through the AR device.

In one possible embodiment, the display device further comprises an interaction module 704, wherein the interaction module 704 comprises:

When the second pose data meets the state trigger condition of the second type, at least one virtual object has a corresponding presentation state under the state trigger condition of the second type, and at least one virtual object is selected from the second type of state trigger condition. update the presentation special effect information of the at least one virtual object based on at least one of the number of cyclic display after the state trigger condition is triggered to be displayed, so as to obtain updated presentation special effect information;

When the exhibition module displays at least one virtual object through the AR device, based on the presentation special effect information,

Based on the updated presentation special effect information, the at least one virtual object is displayed through the AR device.

For the description of the processing flow of each module in the apparatus, and the interaction flow between each module, reference may be made to the related description in the above method embodiment, which will not be described in detail herein any further.

Corresponding to the method of generating AR scenario content in FIG. 1 , the embodiment of the present invention further provides an electronic device 800 , and as shown in FIG. 17 , the electronic device 800 provided in the embodiment of the present invention ) is a structural example, and the electronic device is

a processor 81 , a memory 82 , and a bus 83 ; The memory 82 is for storing execution instructions, and includes an internal memory 821 and an external memory 822 ; Here, the built-in memory 821 is also referred to as an internal memory, and is for temporarily storing arithmetic data in the processor 81 and data exchanged with the external memory 822 such as a hardware disk, and the processor 81 has the built-in memory Data is exchanged through the 821 and the external memory 822, and when the electronic device 800 is operated, the processor 81 and the memory 82 communicate through the bus 83, so that the processor 81 is , in response to the first trigger action, obtaining an initial AR data packet related to the target reality scenario indicated by the first trigger action; obtaining update data of at least one virtual object related to the initial AR data packet, wherein the update data includes first pose data corresponding to the at least one virtual object; and updating the initial AR data packet based on the update data of the at least one virtual object to generate an updated AR data packet.

or, the processor 81 acquiring, in response to the second triggering operation, an AR data packet related to the target reality scenario indicated by the second triggering operation, wherein the AR data packet is a first corresponding to the at least one virtual object. 1 Contains pose data - ; Determining presentation special effect information of at least one virtual object based on second pose data for which the AR device captures the current target reality scenario, and first pose data corresponding to at least one virtual object among AR data packets step; and displaying the at least one virtual object through the AR device based on the presentation special effect information.

An embodiment of the present invention further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer computer is operated by a processor, the generating method or displaying method in the method embodiment execute the steps of Here, the storage medium may be a volatile or non-volatile computer-readable storage medium.

An embodiment of the present invention further provides a computer program product, wherein the computer program product carries a program code, and the instructions included in the program code are used to execute the steps of the generating method or the displaying method according to the method embodiment. , and for specific details, reference may be made to the above method embodiments, which will not be repeatedly described herein.

Here, the computer program product may be specifically implemented through hardware, software, or a combination thereof. In an optional embodiment, the computer program product is specifically embodied as a computer storage medium, and in another optional embodiment, the computer program product is specifically implemented as a software product such as a Software Development Kit (SDK) or the like. is implemented

A person skilled in the art may understand that for the convenience and conciseness of the description, specific operation procedures of the above-described systems and apparatuses may refer to corresponding processes in the above-described method embodiments, where repeatedly do not explain In the several embodiments provided herein, it should be understood that the disclosed systems, apparatuses, and methods may be implemented in other ways. The above-described device embodiment is merely exemplary, for example, the division for the unit is merely logical function division, and when actually implemented, there may be other division methods, and for example, a plurality of units or components may be It may be combined or integrated into other systems, or some features may be ignored or not implemented. Further, any coupling or direct coupling or communication connection between each other, shown or discussed, is implemented through some communication interface, and the indirect coupling or communication connection through the device or unit may be electrical, mechanical, or other form.

The unit described as the separation member may or may not be physically separated, and the member shown as a unit may or may not be a physical unit, that is, it may be located in one place or may be distributed in a plurality of network units. According to actual needs, some or all of the units may be selected to implement the purpose of the present embodiment method.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may be an independent physical entity, and two or two or more units may be integrated into one unit. .

When the above functions are implemented in the form of a software function unit and sold or used as a standalone product, one processor may be stored in an executable nonvolatile computer readable storage medium. Based on this understanding, the technical solution of the present invention, that is, a part contributing to the prior art or a part of the technical solution may be implemented in the form of a software product, the computer software product being stored in one storage medium, one It includes a plurality of instructions used to cause a computer device (which may be a personal computer, a server or a network device, etc.) of The above-mentioned storage medium includes a variety of media capable of storing a program code, such as a U disk, a mobile disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk. include

The last thing to be described is that the above embodiment is merely a specific embodiment of the present invention, and is not intended to limit the technical solution of the present invention, but is intended to explain, and the claims of the present invention are not limited thereto, although Although the present invention has been described in detail with reference to the above-described embodiments, those skilled in the art will still be able to provide technical solutions described in the above-described embodiments within the scope of the present invention. It should be understood that changes can be easily devised, or some technical features thereof can be substituted equally; It should be understood that such modifications, changes or replacements should not depart from the spirit and scope of the technical solutions of the present invention, and should all fall within the protection scope of the present invention. Accordingly, the protection scope of the present invention should be based on the protection scope of the above claims.

Claims (20)

A method of generating augmented reality (AR) scenario content, comprising:
in response to a first trigger action, acquiring an initial AR data packet related to a target reality scenario indicated by the first trigger action;
obtaining update data of at least one virtual object related to the initial AR data packet, wherein the update data includes first pose data corresponding to the at least one virtual object; and
and generating an updated AR data packet by updating the initial AR data packet based on the updated data of the at least one virtual object. According to claim 1,
The production method is
The method further comprises acquiring a three-dimensional scenario model of the target reality scenario indicated by the first trigger action;
Obtaining update data of at least one virtual object related to the initial AR data packet includes:
displaying the loaded 3D scenario model; and
obtaining update data when the at least one virtual object is located in the 3D scenario model - The updated data includes first pose data when the at least one virtual object is located in the 3D scenario model Including - A method of generating augmented reality scenario content, comprising: According to claim 1,
The production method is
The method further comprising: displaying, by the AR device, at least one virtual object related to the initial AR data packet based on second pose data when the current target reality scenario is captured, and the initial AR data packet;
Obtaining update data of at least one virtual object related to the initial AR data packet includes:
Augmented reality scenario comprising: obtaining update data of the displayed at least one virtual object, wherein the at least one virtual object includes first pose data in the target reality scenario. How to create content. 4. The method of claim 3,
The step of obtaining update data of the displayed at least one virtual object includes:
displaying a pose data editing interface, and acquiring first pose data of the at least one virtual object received through the pose data editing interface;
The method for generating augmented reality scenario content, wherein the first pose data includes at least one of location coordinates, deflection angle, and size information in a coordinate system located in the target reality scenario. 5. The method according to any one of claims 1 to 4,
the update data further includes interaction data corresponding to the at least one virtual object;
Obtaining update data of at least one virtual object related to the initial AR data packet includes:
displaying an interaction data editing interface, and acquiring interaction data of each virtual object respectively received through the interaction data editing interface;
The interaction data includes at least one of at least one state trigger condition, a presentation state corresponding to each state trigger condition, and the number of cycles of display after the virtual object is triggered to be displayed. How to create. 6. The method of claim 5,
When the interaction data includes various state trigger conditions, the interaction data further includes a priority of each state trigger condition. 7. The method according to any one of claims 1 to 6,
The production method is
obtaining third pose data corresponding to at least one virtual object model related to the initial AR data packet, wherein the at least one virtual object model represents a target object in the target reality scenario;
generating an updated AR data packet by updating the initial AR data packet based on the updated data of the at least one virtual object;
generating an updated AR data packet by updating the initial AR data packet based on the updated data of the at least one virtual object and the third pose data corresponding to the virtual object model A method of generating augmented reality scenario content, characterized in that it is 8. The method according to any one of claims 1 to 7,
The at least one virtual object includes at least one first virtual object, and obtaining update data of the at least one virtual object related to the initial AR data packet includes:
and acquiring update data of at least one first virtual object included in the initial AR data packet. 9. The method according to any one of claims 1 to 8,
The at least one virtual object includes at least one second virtual object, and obtaining update data of the at least one virtual object related to the initial AR data packet includes:
Augmented reality scenario comprising the steps of: obtaining at least one second virtual object related to the initial AR data packet from a pre-built material library, and obtaining update data of the at least one second virtual object How to create content. 10. The method according to any one of claims 1 to 9,
After generating the updated AR data packet, the generating method comprises:
transmitting the updated AR data packet to a server; or, transmitting the updated AR data packet and status information indicating whether the updated AR data packet is activated to a server. 11. The method of claim 10,
After generating the updated AR data packet, the generating method comprises:
Augmented reality scenario content, further comprising: in response to an upload trigger operation for the updated AR data packet, obtaining label information of the updated AR data packet, and transmitting the label information to the server method of creation. A method of displaying augmented reality (AR) scenario content, comprising:
in response to a second trigger action, obtaining an AR data packet related to a target reality scenario indicated by the second trigger action, wherein the AR data packet includes first pose data corresponding to at least one virtual object - ;
Based on second pose data in which the AR device currently captures the target reality scenario, and the first pose data corresponding to at least one virtual object among the AR data packets, the presentation special effect of the at least one virtual object determining information; and
and displaying the at least one virtual object through the AR device based on the presentation special effect information. 13. The method of claim 12,
the AR data packet further includes third pose data corresponding to the at least one virtual object model; the virtual object model represents a target object in the target reality scenario;
Presentation of the at least one virtual target based on second pose data when the AR device currently captures the target reality scenario, and the first pose data corresponding to at least one virtual target among the AR data packets The steps to determine the special effects information are:
When the AR device currently captures the target reality scenario, the second pose data, the first pose data corresponding to at least one virtual target among the AR data packets, and the third pose corresponding to the virtual object model and determining, based on data, presentation special effect information of the at least one virtual object. 14. The method of claim 12 or 13,
The AR data packet further includes interaction data corresponding to at least one virtual object, wherein the interaction data is triggered to display at least one state trigger condition, a presentation state corresponding to each state trigger condition, and a virtual object. The display method of augmented reality scenario content, characterized in that it includes at least one of the number of cycles of later display. 15. The method of claim 14,
The display method is
detecting an interaction operation applied to the at least one virtual object; and
When the interaction operation applied to the at least one virtual object satisfies a first type of state trigger condition, the at least one virtual object corresponds to a presentation state under the first type of state trigger condition, and the at least one based on at least one of the number of cyclic displays after the virtual object of the virtual object is triggered to exhibit the first type of state trigger condition, by updating the presentation special effect information of the at least one virtual object, the updated presentation special effect further comprising obtaining information;
The step of displaying the at least one virtual object through the AR device based on the presentation special effect information includes:
and displaying the at least one virtual object through the AR device based on the updated presentation special effect information. 16. The method of claim 14 or 15,
The display method is
When the second pose data satisfies the second type of state trigger condition, the at least one virtual object has a corresponding presentation state under the second type of state trigger condition, and the at least one virtual object is the second type of state trigger condition. updating the presentation special effect information of the at least one virtual object to obtain updated presentation special effect information based on at least one of the number of cyclic display after the two types of state trigger conditions are triggered to be exhibited; including;
The step of displaying the at least one virtual object through the AR device based on the presentation special effect information includes:
and displaying the at least one virtual object through the AR device based on the updated presentation special effect information. An apparatus for generating augmented reality (AR) scenario content, comprising:
a first acquiring module, in response to a first trigger operation, for acquiring an initial AR data packet related to a target reality scenario indicated by the first trigger operation;
a second acquiring module, configured to acquire update data of at least one virtual object related to the initial AR data packet, wherein the update data includes first pose data corresponding to the at least one virtual object; and
and an update module configured to generate an updated AR data packet by updating the initial AR data packet based on the update data of the at least one virtual object. A display device for augmented reality (AR) scenario content, comprising:
In response to a second trigger operation, an acquiring module for acquiring an AR data packet related to a target reality scenario indicated by the second trigger operation, wherein the AR data packet includes first pose data corresponding to at least one virtual object. Included - ;
Based on second pose data in which the AR device currently captures the target reality scenario, and the first pose data corresponding to at least one virtual object among the AR data packets, the presentation special effect of the at least one virtual object a determining module for determining information; and
and a display module configured to display the at least one virtual object through the AR device based on the presentation special effect information. As an electronic device,
a processor, a memory and a bus, wherein the memory stores machine readable instructions executable by the processor, and when an electronic device is operated, the processor and the memory communicate via a bus, the machine readable instructions to execute the step of the generating method according to any one of claims 1 to 11 or the step of the display method according to any one of claims 12 to 16 when is executed by the processor Electronics. A computer readable storage medium comprising:
A computer program is stored in the computer readable storage medium, and when the computer program is operated by a processor, the step of the generating method according to any one of claims 1 to 11, or any of claims 12 to 16 A computer-readable storage medium for carrying out the steps of the display method according to any one of the preceding claims.

Images