CN114602167A - Interaction method and device based on augmented reality - Google Patents

Abstract

The disclosure provides an interaction method and device based on augmented reality, wherein the method comprises the following steps: acquiring a real scene picture; acquiring a real scene picture; determining and displaying an Augmented Reality (AR) picture containing a first virtual object to be thrown and at least one second virtual object to be selected based on the real scene picture; determining a throwing result of the first virtual object for the second virtual object in response to a target triggering operation for the first virtual object; the throwing result is shown in the AR picture. The augmented reality picture provided by the embodiment of the disclosure can realize an interactive process closer to the traditional ferrule activity under the condition of breaking the constraint and limitation of a real space.

Description

Augmented reality-based interaction method and device

technical field

The present disclosure relates to the technical field of augmented reality, and in particular, to an interaction method and device based on augmented reality.

Background technique

Traditional hooping activities usually require placing ferrule objects in a real environment, and skillfully throwing a throwing ring to start the activity. This kind of activity requires a certain amount of real activity space.

Augmented Reality (AR) technology is a technology that skillfully integrates virtual information with the real world. How to use AR technology reasonably to realize an interactive process that can break the constraints and limitations of real space on the one hand, and have a real experience on the other hand, is a problem worth solving.

SUMMARY OF THE INVENTION

Embodiments of the present disclosure provide at least an augmented reality-based interaction method and apparatus.

In a first aspect, an embodiment of the present disclosure provides an augmented reality-based interaction method, including:

Get real scene images;

determining and displaying an augmented reality AR image containing the first virtual object to be thrown and at least one second virtual object to be selected based on the real scene image;

In response to a target triggering operation for the first virtual object, determining a throwing result of the first virtual object for the second virtual object;

The throwing result is displayed in the AR screen.

The embodiment of the present disclosure integrates the first virtual object to be thrown and at least one second virtual object into the real scene to generate an AR image, and interacts with the AR image, that is, executes the target triggering operation in the AR image, and the AR image The result of the throwing of the first virtual object to the second virtual object can be displayed in the game, and the interaction process that is closer to the traditional hooping activity can be realized under the condition of breaking the constraints and restrictions of the real space.

In an optional implementation manner, the determining a throwing result of the first virtual object for the second virtual object in response to a target triggering operation for the first virtual object includes:

In response to a target triggering operation for the first virtual object, determining a throwing distance and throwing direction corresponding to the first virtual object;

Based on the throwing distance and the throwing direction, a throwing result of the first virtual object with respect to the second virtual object is determined.

In the embodiment of the present disclosure, by determining the throwing distance and throwing direction corresponding to the first virtual object, the throwing result under the joint action of the throwing distance and the throwing direction can be displayed, so as to be closer to the real experience of the looping process in the real scene.

In an optional implementation manner, the determining the throwing distance corresponding to the first virtual object in response to the target triggering operation for the first virtual object includes:

In response to the target triggering operation for the first virtual object, the throwing distance corresponding to the first virtual object is determined according to the triggering duration of the target triggering operation.

In the embodiment of the present disclosure, the user can accumulate power through the target triggering operation, and the triggering duration of the target triggering operation determines the throwing distance of the first virtual object, and then the throwing result matching the throwing distance can be displayed, so as to be closer to the traditional hoop Interactive process of activities.

In an optional embodiment, in response to the target triggering operation for the first virtual object, determining the throwing distance corresponding to the first virtual object according to the triggering duration of the target triggering operation, including:

In response to the target trigger operation acting on the target operation area or the target operation object in the AR screen, determining the throwing distance corresponding to the first virtual object according to the trigger duration of the target trigger operation;

The target operation object includes the first virtual object and/or a preset operation control for controlling the first virtual object.

The target triggering operation in this embodiment of the present disclosure may act on a target operation area in the AR screen (for example, a set operation area surrounding the first virtual object, or a certain fixed position area in the AR screen), or may act on a specific On the target operation object (such as the first virtual object and/or the preset operation control used to control the first virtual object), based on the above-mentioned various action objects corresponding to the target trigger operation, operations in the AR interaction process can be increased flexibility.

In an optional embodiment, the method further includes:

In response to the target triggering operation, update the charging progress value of the charging progress bar displayed in the AR screen according to the triggering duration of the target triggering operation; The larger the progress value is; there is a preset corresponding relationship between the charging progress value and the throwing distance.

In the embodiment of the present disclosure, the charging progress value of the charging progress bar is displayed by updating the triggering duration, so that the user can more accurately know the triggering duration and charging progress of the target triggering operation, and then can better grasp the throwing timing .

In an optional implementation manner, the determining a throwing direction corresponding to the first virtual object in response to a target triggering operation for the first virtual object includes:

In response to the target triggering operation for the first virtual object, the throwing direction corresponding to the first virtual object is determined according to the shooting angle of the camera corresponding to the AR image at the triggering moment corresponding to the target triggering operation.

Here, the shooting angle of the camera corresponding to the AR image reflects the current orientation of the shooting user, so that the shooting angle of the camera can be used to determine the throwing direction of the user's intention. Furthermore, by displaying the throwing result matching the above throwing direction, the ring can be realized. Interact and display the corresponding ferrule results, enhancing the real experience of the ferrule interaction process.

In an optional embodiment, the method further includes:

In response to the target triggering operation, a direction guide mark is displayed in the AR screen; the direction guide mark is used to indicate the current throwing direction, and the direction guide mark can be under the control of the target trigger operation Make pointing adjustments.

In the embodiment of the present disclosure, by displaying the direction guidance mark on the AR screen, the user can be prompted with the currently selected throwing direction, and when the direction guidance mark does not point to the throwing direction intended by the user, it can be adjusted in time according to the real-time pointing of the direction guidance mark , thereby improving the accuracy of the circle.

In an optional implementation manner, determining and displaying an augmented reality AR image containing a first virtual object to be thrown and at least one second virtual object to be selected based on the real scene image, including:

Based on the real scene picture, determine the initial position information of the first virtual object to be thrown and the at least one second virtual object to be selected into the real scene respectively; based on the first virtual object and the at least one second virtual object The initial position information of the object in the real scene, showing the initial AR picture;

In response to the change of the camera shooting pose, determine the changed position information of the first virtual object in the real scene; wherein, the position of the first virtual object in the real scene follows the camera shooting pose The position of the at least one second virtual object in the real scene remains unchanged;

Based on the changed position information of the first virtual object in the real scene and the initial position information of the at least one second virtual object in the real scene, the changed AR picture is displayed.

In this embodiment of the present disclosure, the position of the first virtual object in the real scene may change with the change of the camera's shooting pose, through the changed position information of the first virtual object in the real scene, and at least one second virtual object The initial position information in the real scene, showing the changed AR picture, can present an effect that the first virtual object moves with the user in the real scene, so that it can be closer to the real experience of the looping process in the real scene.

In an optional implementation manner, before determining the throwing distance and throwing direction corresponding to the first virtual object in response to the target triggering operation, the method further includes:

judging whether the distance between the first virtual object and the at least one second virtual object is less than a set distance threshold;

If it is less than, the user is prompted to stay away from the at least one second virtual object.

In this embodiment of the present disclosure, when it is determined that the distance between the first virtual object and the at least one second virtual object is smaller than the set distance threshold, the user is prompted to stay away from the at least one second virtual object, so that the first virtual object and the second virtual object can be separated from each other. The object is thrown at a certain distance, and the above interaction process matches the ring rules in the real scene, which enhances the real experience of the interaction process of the ring.

In an optional implementation manner, determining and displaying an augmented reality AR image containing a first virtual object to be thrown and at least one second virtual object to be selected based on the real scene image, including:

Based on the real scene image, it is judged whether the real scene image matches the target scene type, and if so, it is determined and displayed based on the real scene image that includes the first virtual object and the at least one second virtual object. Augmented reality AR footage of objects.

This embodiment of the present disclosure determines and displays an augmented reality AR image including a first virtual object and at least one second virtual object when it is determined that the real scene image matches the target scene type, and the above process defines the scene type for generating the AR image , so that the interaction process of the ferrule is limited to the matching scene type, so that the ferrule activity can be integrated into a more reasonable real scene and improve the realistic experience.

In an optional implementation manner, the at least one second virtual object includes a plurality of second virtual objects;

The displaying and the throwing result in the AR screen include:

The selected target second virtual object among the plurality of second virtual objects is displayed on the AR screen, and the reward information corresponding to the target second virtual object is displayed.

The reward information corresponding to the target second virtual object displayed in the embodiment of the present disclosure can be separated from the limitation of the actual object, and the interaction result can be presented in a more timely and convenient manner compared with the traditional looping process.

In a second aspect, an embodiment of the present disclosure further provides an augmented reality-based interaction device, including:

The acquisition module is used to acquire the real scene picture;

a first determining module, configured to determine and display an augmented reality AR image containing the first virtual object to be thrown and at least one second virtual object to be selected based on the real scene image;

a second determining module, configured to determine a throwing result of the first virtual object for the second virtual object in response to a target triggering operation for the first virtual object;

The first display module is configured to display the throwing result in the AR picture.

In a third aspect, embodiments of the present disclosure further provide a computer device, including: a processor, a memory, and a bus, where the memory stores machine-readable instructions executable by the processor, and when the computer device runs, the processing A bus communicates between the processor and the memory, and when the machine-readable instructions are executed by the processor, the first aspect or the steps in any possible implementation manner of the first aspect are performed.

In a fourth aspect, embodiments of the present disclosure further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and the computer program is executed by a processor to execute the first aspect, or any one of the first aspect. steps in one possible implementation.

For a description of the effects of the above-mentioned augmented reality-based interaction apparatus, computer equipment, and computer-readable storage medium, reference may be made to the foregoing description of the augmented reality-based interaction method, which will not be repeated here.

In order to make the above-mentioned objects, features and advantages of the present disclosure more obvious and easy to understand, the preferred embodiments are exemplified below, and are described in detail as follows in conjunction with the accompanying drawings.

Description of drawings

In order to explain the technical solutions of the embodiments of the present disclosure more clearly, the following briefly introduces the accompanying drawings required in the embodiments, which are incorporated into the specification and constitute a part of the specification. The drawings illustrate embodiments consistent with the present disclosure, and together with the description serve to explain the technical solutions of the present disclosure. It should be understood that the following drawings only show some embodiments of the present disclosure, and therefore should not be regarded as limiting the scope. Other related figures are obtained from these figures.

FIG. 1 shows a flowchart of an augmented reality-based interaction method provided by an embodiment of the present disclosure;

FIG. 2 shows a schematic diagram of the effect of an AR screen provided by an embodiment of the present disclosure;

FIG. 3 shows a schematic diagram of another AR image effect provided by an embodiment of the present disclosure;

Fig. 4a shows a schematic diagram of the effect of the throwing distance corresponding to the first virtual object provided by the embodiment of the present disclosure when the charging progress value is small;

Fig. 4b shows a schematic diagram of the effect of the throwing distance corresponding to the first virtual object provided by the embodiment of the present disclosure when the charging progress value is relatively large;

FIG. 5 shows a schematic diagram of another AR image effect provided by an embodiment of the present disclosure;

FIG. 6 shows a schematic diagram of an augmented reality-based interaction device provided by an embodiment of the present disclosure;

FIG. 7 shows a schematic diagram of a computer device provided by an embodiment of the present disclosure.

Detailed ways

In order to make the purposes, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only These are some, but not all, embodiments of the present disclosure. The components of the disclosed embodiments generally described and illustrated in the drawings herein may be arranged and designed in a variety of different configurations. Therefore, the following detailed description of the embodiments of the disclosure provided in the accompanying drawings is not intended to limit the scope of the disclosure as claimed, but is merely representative of selected embodiments of the disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without creative work fall within the protection scope of the present disclosure.

In traditional hooping activities, hooping objects are usually placed in a real environment, and people participating in hooping activities experience the game process by skillfully throwing throwing rings. However, traditional hoop activities are easily bound and restricted by real space. How to use AR technology reasonably to realize an interactive process that can break the constraints and restrictions of real space on the one hand, and have real experience on the other hand, is a problem worth solving. .

Based on this, the present disclosure provides an augmented reality-based interaction method, which integrates a virtual throwing circle and at least one virtual circle selection object into a real scene to generate an AR screen. The duration determines the throwing distance corresponding to the virtual throwing circle, and then displays the throwing results that match the throwing distance. Based on the above AR interaction process, it is possible to break the constraints and limitations of the real space and achieve a more similar traditional throwing circle activity. interactive process.

The defects of the above solutions and the proposed solutions are the results obtained by the inventor after practice and careful research. Therefore, the discovery process of the above problems and the solutions proposed by the present disclosure for the above problems hereinafter are the results obtained by the inventor. , should be the contributions made by the inventor to the present disclosure in the course of the present disclosure.

It should be noted that like numerals and letters refer to like items in the following figures, so once an item is defined in one figure, it does not require further definition and explanation in subsequent figures.

The augmented reality-based interaction method disclosed in the embodiments of the present disclosure can be applied to scenarios in which AR technology is used to simulate real-life hooping activities, for example, can be applied to cultural tourism scenarios, such as scenic spots, streets, parks, etc. Provide leisure experience; can also be used in shopping malls, supermarkets and other related activities.

In order to facilitate the understanding of this embodiment, an augmented reality-based interaction method disclosed in the embodiment of the present disclosure is first introduced in detail. The execution subject of the augmented reality-based interaction method provided by the embodiment of the present disclosure generally has a certain computing capability. computer equipment.

The augmented reality-based interaction method provided by the embodiments of the present disclosure will be described below by taking the execution subject as a terminal device as an example.

Referring to FIG. 1, which is a flowchart of an augmented reality-based interaction method provided by an embodiment of the present disclosure, the method includes S101-S104, wherein:

S101: Acquire a real scene picture.

In this embodiment of the present disclosure, a terminal device may be used to collect a real scene picture in real time, for example, a real scene picture may be collected by a camera on the terminal device.

In one embodiment, the real scene picture may include a real scene picture obtained after collecting any real scene. In another embodiment, the real scene picture may include a real scene picture that matches the target scene type, that is, the real scene picture is a real scene picture collected for the target scene type, for example, the target scene type may include parks, streets and other scene types , the real scene picture may be a real scene picture collected in a park, a street, etc. scene. The AR image generated based on the real scene image can limit the interaction process of the ferrule to the matching scene type, so that it can better match the real scene.

S102: Based on the real scene picture, determine and display an augmented reality AR picture including the first virtual object to be thrown and at least one second virtual object to be selected.

The augmented reality AR picture includes a real scene picture, and a first virtual object to be thrown and at least one second virtual object to be selected displayed on the real scene picture. The second virtual object can be used as the object selected by the first virtual object, that is, by throwing the first virtual object, one second virtual object can be selected from the second virtual objects. Wherein, the first virtual object to be thrown and at least one second virtual object to be selected may be rendered in a real scene picture by a game development engine (eg, Unity/UE4, etc.).

In a specific implementation, the first virtual object may be a virtual object to be thrown in any form, for example, the first virtual object may be a ring-shaped object (it may be called a virtual throwing circle at this time), which is convenient to fit on the second virtual object above, to indicate selection, the ring here may be a square ring, a circular ring, etc., which is not limited in the embodiments of the present disclosure. The second virtual object may be a virtual object to be selected in any form, for example, the second virtual object may be a virtual score bar. After the first virtual object is thrown multiple times and the virtual score column is in the set at least once, a corresponding total score may be generated based on the score values corresponding to each virtual score column in the set.

In one manner, the at least one first virtual object may be individually displayed on the real scene picture. In another way, the at least one first virtual object can also be uniformly deployed on the deployment object, for example, the at least one first virtual object is uniformly fixed on a suspended board, and then the at least one first virtual object and the deployment object are displayed together on the on the real scene. As shown in Figure 2, a schematic diagram of the effect of an AR screen includes a real scene image collected in a park, in which a virtual throwing circle is displayed, and a board with three rows of virtual score columns is deployed. Contains three virtual score bars, each corresponding to a different score value. Wherein, the virtual throwing circle is the first virtual object, and these virtual score columns are the second virtual object.

In order to present an AR picture in which the first virtual object and the at least one second virtual object can be more integrated with the real scene, in one embodiment, the AR picture can be The three-dimensional pose information, as well as the real scene picture, determine and display the AR picture.

Here, the three-dimensional pose information may include position information and attitude information corresponding to the first virtual object and the at least one second virtual object in the real scene picture. Based on the corresponding position information and posture information of the first virtual object and the at least one second virtual object in the real scene picture, the stereoscopic effect of the first virtual object and the at least one second virtual object can be presented in the AR picture.

Considering that the corresponding positions of the first virtual object and the at least one second virtual object in the real scene picture are related to the positions of the objects contained in the real scene picture, therefore, in one way, the first virtual object can also be preset and stored. The relative pose information between the virtual object and the at least one second virtual object can be based on the relative pose information between the first virtual object and the at least one second virtual object after the real scene picture is obtained, and the real scene picture The position of each object contained in the image is determined, and the corresponding three-dimensional pose information of the first virtual object and the at least one second virtual object in the real scene picture is determined. For example, the real scene picture contains a plurality of trees, and an open space area is surrounded by the plurality of trees. At this time, it can be determined based on the positions of the plurality of trees that the first virtual object and at least one second virtual object are in the real scene picture. corresponding location information.

As mentioned above, the real scene picture may include any real scene picture, and may also include the real scene picture matching the target scene type. For the above two situations, the process of generating and displaying AR images based on real scene images is different.

Specifically, when the real scene image includes any real scene image, that is, after the real scene image is collected, it is possible to determine and display whether the collected real scene image matches the target scene type without judging whether the collected real scene image matches the target scene type. AR screen of at least one second virtual object.

When the real scene image includes the real scene image matching the target scene type, it is necessary to judge whether the collected real scene image matches the target scene type. The AR image can be determined and displayed only when the real scene image is a real scene image that matches the target scene type; and when the real scene image is a real scene image that does not match the target scene type, it cannot be Determine and display the AR screen.

Specifically, in one embodiment, it can be determined whether the real scene image matches the target scene type based on the real scene image, and if it matches, it is determined and displayed based on the real scene image that contains the first virtual object and at least one second virtual object. Augmented reality AR footage of virtual objects.

Here, the collected real scene image can be compared with the target real scene image under the pre-collected target scene type, so as to determine whether the real scene image matches the target scene type.

Specifically, the target real scene picture under the target scene type may be collected and stored in advance. After the real scene image is collected, the collected real scene image can be compared with the stored target real scene image. In one way, the image characteristics of the real scene image and the image characteristics of the target real scene image can be extracted. , and then compare the image characteristics of the real scene image with the image characteristics of the target real scene image. When the similarity between the image features of the collected real scene image and the image features of the target real scene image meets the preset conditions, for example, when the similarity is greater than the set threshold, it can be considered that the real scene image matches the target scene type; When the similarity between the collected real scene image and the target real scene image does not meet the preset condition, for example, when the similarity is less than or equal to the set threshold, it can be considered that the real scene image does not match the target scene type.

In other manners, it can also be judged whether the collected real scene picture contains a target object under the target scene type, and then it can be judged whether the real scene picture matches the target scene type. For example, the target scene type may be an amusement park, and the target object under the target scene type may be amusement facilities such as roller coasters and Ferris wheels. The scene picture matches the target scene type; when the collected real scene picture does not contain any of the above amusement facilities, it can be considered that the real scene picture does not match the target scene type.

According to the judgment result, in the case where the real scene image matches the target scene type, the augmented reality AR image including the first virtual object and at least one second virtual object can be determined and displayed based on the real scene image; In the case that the type of the target scene does not match, for example, the prompt information that the current scene cannot be recognized may be displayed, or the prompt information of re-acquiring the real scene picture may be displayed.

S103: In response to the target triggering operation for the first virtual object, determine a throwing result of the first virtual object for the second virtual object.

The target triggering operation may refer to a triggering operation performed on the first virtual object for controlling the throwing of the first virtual object. The target trigger operation may be any form of trigger operation, such as a click operation, a sliding operation, a pressing operation, and the like.

In a specific implementation, the action object corresponding to the target-triggered operation may include any possible action object such as the target operation area or the target operation object acting on the AR screen. The target operation area may be any area in the AR screen, for example, a set operation area surrounding the first virtual object, or a certain fixed position area in the AR screen, and the like. The target operation object may be the first virtual object, or may be a preset operation control for controlling the first virtual object, for example, it may be a progress bar for accumulating power. In an implementation manner, any one of the above-mentioned action objects may be selected as the action objects of the target-triggered operation. In another implementation manner, the above-mentioned multiple action objects may also be selected as action objects of the target-triggered operation. By selecting a variety of action objects corresponding to the target-triggered operation, the operational flexibility in the AR interaction process can be increased.

In a real-world hooping activity, the throwing results of the hoops can be related to the strength and direction of the throwing by the activity participants. In order to simulate the hooping activity in a real scene, in one embodiment, the throwing distance and throwing direction corresponding to the first virtual object may be determined in response to the target triggering operation; and then the first virtual object may be determined based on the throwing distance and throwing direction The throw result for the second virtual object.

In the above embodiment, the throwing result of the at least one second virtual object may be jointly determined by the throwing distance and the throwing direction. Wherein, the throwing distance can affect the distance of the selected second virtual object, and the throwing direction can affect the orientation information of the selected second virtual object. The throwing result may include a selected result, an unselected result, an unsuccessful throwing result, and the like. For example, if the first virtual object selects at least one second virtual object, a selection result can be obtained; if the first virtual object does not select any second virtual object, an unselected result can be obtained; if the first virtual object is not thrown, it can be obtained A result that was not thrown successfully.

In a specific implementation, the throwing distance and throwing direction corresponding to the first virtual object may be determined by triggering attribute information of the target triggering operation. The trigger attribute information may include attribute information such as trigger duration, trigger strength, trigger times, trigger angle, and trigger position. Here, the trigger attribute information for determining the throwing distance and throwing direction corresponding to the first virtual object may be the same or different.

Exemplarily, in one embodiment, the throwing distance corresponding to the first virtual object may be determined according to the triggering duration of the target triggering operation in response to the target triggering operation for the first virtual object. That is, the throwing distance corresponding to the first virtual object is determined by the trigger duration in the trigger attribute information of the target trigger operation. Here, the trigger duration can be used to represent the throwing strength. The longer the trigger duration of the target triggering operation, the greater the throwing strength, and the longer the throwing distance corresponding to the first virtual object. Therefore, in one method, the corresponding relationship between the trigger duration and the throwing distance can be preset, and then the throwing distance is determined according to the trigger duration of the target trigger operation and the corresponding relationship between the trigger duration and the throwing distance.

In one embodiment, the throwing distance corresponding to the first virtual object may be determined according to the triggering duration of the target triggering operation in response to the target triggering operation acting on the target operation area or the target operation object in the AR screen.

That is, the target trigger operation may include a trigger operation acting on a target operation area or a target operation object in the AR screen. When the target triggering operation starts to act, the triggering duration of the target triggering operation can be counted, and as the triggering duration prolongs, the throwing distance corresponding to the first virtual object increases.

In order to know more accurately the triggering duration of the target triggering operation, in one way, a charging progress bar corresponding to the triggering duration may be displayed on the AR screen. The charging progress bar can display the charging progress value. The longer the trigger duration, the greater the charging progress value. In a specific implementation, the charging progress value of the charging progress bar displayed in the AR screen may be updated according to the triggering duration of the target triggering operation in response to the target triggering operation for the first virtual object.

When the target operation object is the first virtual object or the target operation object is other preset operation controls except the charging progress bar, the charging progress bar may be displayed in the AR screen only when responding to the target triggering operation. That is, when the target triggering operation is not performed, the charging progress bar may not be displayed; the charging progress bar may also be displayed on the AR screen all the time. When the target operation object is the charging progress bar, the charging progress bar can always be displayed in the AR screen.

By updating the charging progress value of the charging progress bar by the trigger duration update, the user can accurately know the trigger duration and charging progress of the target trigger operation, and then can better grasp the throwing timing.

In the schematic diagram of another AR screen effect shown in FIG. 3 , when the target triggering operation is performed on the charging progress bar, the charging progress value can be displayed in the charging progress bar. The charging progress value in the charging progress bar may increase with the extension of the triggering duration, and the throwing distance of the virtual throwing circle (the first virtual object) increases with the increase of the charging progress value. Figure 4a shows a schematic diagram of the effect of the throwing distance corresponding to the virtual throwing circle when the charging progress value is small, and Figure 4b shows the throwing distance corresponding to the virtual throwing circle when the charging progress value is large Schematic diagram of the effect. The virtual throwing circle in Fig. 4a circles the virtual score columns (the second virtual object) in the first row (viewed from near to far), and the virtual throwing circle in Fig. 4a circles the third row (viewed from near to far). Look at the score column of ), it can be seen that the charging progress value is smaller, the throwing distance corresponding to the virtual throwing circle is shorter, the charging value is larger, and the throwing distance corresponding to the virtual throwing circle is longer. Among them, after the throwing result is displayed in the AR screen, the virtual throwing circle to be thrown can continue to be displayed.

As mentioned above, in the hooping activity in the real scene, the throwing result of the throwing circle is not only related to the throwing distance, but also to the throwing direction. In order to simulate the hooping activity in the real scene, in one embodiment, in response to the target triggering operation for the first virtual object, according to the shooting angle of the camera corresponding to the AR picture at the triggering moment corresponding to the target triggering operation, determine the first virtual object. A throwing direction corresponding to a virtual object.

That is, the throwing direction corresponding to the first virtual object can be determined by determining the shooting angle of the camera corresponding to the AR picture. In a specific implementation, the shooting angle of the camera may be determined by the internal parameter information of the camera, and then the throwing object corresponding to the first virtual object may be determined.

In one manner, the throwing direction corresponding to the first virtual object may be the same as the shooting angle of the camera corresponding to the AR picture. For example, if the camera shooting angle is upward, the throwing direction corresponding to the first virtual object is also upward; the camera shooting angle is leftward, and the throwing direction corresponding to the first virtual object is also leftward.

In order to improve the accuracy of selection and enhance the user's interactive experience, in one embodiment, a direction guidance sign may be displayed on the AR screen in response to a target triggering operation for the first virtual object. The direction guide mark is used to indicate the current throwing direction, and the direction guide mark can be adjusted under the control of the target triggering operation.

Here, as described above, the target triggering operation may include a target triggering operation acting on a target operation area or a target operation object in the AR screen.

When the target triggering operation includes a target triggering operation acting on the target operation area in the AR screen, in one method, a direction guide mark may be displayed at the trigger position of the target operation area; The direction guidance mark is displayed on the first virtual object; in another manner, the direction guidance mark may also be displayed at a preset position of the target operation area.

When the target triggering operation includes the target triggering operation acting on the target operation object in the AR screen, in one way, it can be displayed on the first virtual object or a preset operation control for controlling the first virtual object Direction guidance signs; in another way, the direction guidance signs can also be displayed at the preset positions of the target operation area.

Exemplarily, the direction indication mark may be a direction indication arrow, and the direction of the direction indication arrow may correspond to the current throwing direction. In the schematic diagram of another AR screen as shown in FIG. 5 , a direction guide control is displayed (the direction guide control is a preset operation control). When the direction guide control is pressed, a direction indicating arrow can be displayed. The guide arrows point to the virtual score columns deployed in the first row (looking from near to far) on the board.

In one approach, the triggering direction of the target triggering operation or the degree of pressing in each triggering direction can be changed. Therefore, by changing the triggering direction of the target triggering operation or the pressing degree in each triggering direction, the direction of the direction guide mark can be adjusted, and then the throwing direction of the first virtual object can be adjusted.

Finally, based on the determined throwing distance and throwing direction, a throwing result of the at least one second virtual object after the first virtual object is thrown is determined.

In a specific implementation, when the throwing distance and/or throwing direction of the first virtual object are different, the corresponding throwing results may also be different. For example, when the throwing distance of the first virtual object is the same, when the throwing direction is to the left, the corresponding throwing result may include the second virtual object on the left; when the throwing direction is to the right, the corresponding throwing result may include the right side of the second virtual object. For another example, when the throwing direction of the first virtual object is the same, and the throwing distance is too small, the corresponding throwing result may include the second virtual object that is closer in the throwing direction; when the throwing distance is too large, the corresponding throwing The result may include a second virtual object farther away in the throwing direction. For another example, when the throwing direction is to the left and the throwing distance is large, the corresponding throwing result may include a second virtual object that is far away in the left direction.

S104: Display the throwing result on the AR screen.

Here, the throwing result matching the at least one second virtual object may be a virtual result, for example, may be a score, a virtual object, identification information of an actual object, and the like.

In one embodiment, the at least one second virtual object in the generated AR picture may include a plurality of second virtual objects. The plurality of second virtual objects may be the same or different.

In the case where at least one second virtual object in the generated AR picture includes multiple second virtual objects, the target second virtual object selected from the multiple second virtual objects may be displayed in the AR picture, and the target second virtual object may be displayed in the AR picture. 2. Reward information corresponding to the virtual object.

The target second virtual object may be the second virtual object selected after one throw, or the second virtual object selected after multiple throws. The target second virtual object may include at least one second virtual object.

The reward information corresponding to the target second virtual object may be the target second virtual object itself, for example, the target second virtual object may be a preferential resource in an electronic form. The reward information corresponding to the target second virtual object may also be the actual object corresponding to the target second virtual object. In this case, the target second virtual object may be the identification information of the actual object, such as the image of the actual object, the name of the actual object etc.; the target second virtual object may also be exchange value information corresponding to the actual object, such as a score value.

In the case where the target second virtual object includes multiple second virtual objects, each time a target second virtual object is selected, the reward information corresponding to the target second virtual object may be displayed, or multiple targets may be selected. After the second virtual object, the reward information of the respective objects of the multiple target second virtual objects is displayed.

In real-world hooping events, there is usually a launch line, and event participants must stand outside the launch line to start the game. In order to simulate the hooping activity in a real scene, a throwing boundary line can be set between the first virtual object and at least one second virtual object, for example, a throwing boundary line can be set between the first virtual object and at least one second virtual object that is closest to the distance Throw borderline. The distance between the first virtual object and the at least one second virtual object may be the distance between the throwing boundary line and the at least one second virtual object. Here, a distance threshold between the throwing boundary line and the at least one second virtual object may be set. In one way, the size of the set distance threshold may be related to the difficulty of the game, and when the difficulty of the game increases, the set distance threshold is larger. The first virtual object needs to be kept outside the throwing boundary line to be able to throw normally, that is, the distance between the first virtual object and the at least one second virtual object cannot be smaller than the set distance threshold. In one approach, the throw boundary line may be an invisible boundary line or an invisible boundary line.

In the embodiment of the present disclosure, before starting the ferrule activity on the terminal device, the initial position information of the first virtual object to be thrown and the at least one second virtual object to be selected can be respectively integrated into the real scene can be determined based on the real scene picture. ; based on the initial position information of the first virtual object and the at least one second virtual object in the real scene, displaying an initial AR picture.

According to the initial position information of the first virtual object and the initial position information of the first virtual object, the initial relative distance between the first virtual object and the at least one second virtual object can be determined. In one manner, the initial position information of the first virtual object integrated into the real scene may be determined according to the position of the throwing boundary line, and the initial position information of the at least one second virtual object integrated into the real scene may be preset position information . At this time, the initial relative distance between the first virtual object and the at least one second virtual object may be a distance threshold between the throwing boundary line and the at least one second virtual object. That is, in the initial AR screen, the first virtual object is located outside the throwing boundary line.

In order to be closer to the real experience of the looping process in the real scene, in one embodiment, the post-change position information of the first virtual object in the real scene may be determined according to the change information of the camera's shooting pose.

In one way, the change information of the camera's shooting pose can be obtained through a device such as a gyroscope in the camera. In a specific implementation, the position of the first virtual object in the real scene may change following the change of the camera's shooting pose, while the position of the second virtual object in the real scene does not change.

Finally, based on the changed position information of the first virtual object in the real scene and the initial position information of at least one second virtual object in the real scene, the changed AR picture is displayed.

In the above method, the changed AR picture can be presented by using the changed position information of the first virtual object in the real scene and the initial position information of at least one second virtual object in the real scene to display the changed AR image, which can present a first virtual object. The effect of the object following the user's movement in the real scene can be closer to the real experience of the looping process in the real scene.

Since the distance between the first virtual object and the at least one second virtual object in the AR picture may change after the change, in one implementation manner, in response to a target triggering operation for the first virtual object, determine the first virtual object. Before the throwing distance and throwing direction corresponding to a virtual object, it can be judged whether the distance between the first virtual object and the at least one second virtual object is less than the set distance threshold; if it is less than, the user can be prompted to stay away from the at least one second virtual object .

The augmented reality-based interaction method provided by the embodiments of the present disclosure can be applied to a single-person entertainment activity scenario, and can also be applied to a team entertainment activity scenario, that is, a multi-person entertainment activity scenario. Wherein, the process of applying to the multi-player entertainment activity scenario is similar to the process of applying to the single-player entertainment event scenario, and the present disclosure will not separately describe the single-player entertainment event scenario and the multi-player entertainment event scenario.

Those skilled in the art can understand that in the above method of the specific implementation, the writing order of each step does not mean a strict execution order but constitutes any limitation on the implementation process, and the specific execution order of each step should be based on its function and possible Internal logic is determined.

Based on the same inventive concept, the embodiments of the present disclosure also provide an augmented reality-based interaction device corresponding to the augmented reality-based interaction method. The interaction methods of the two methods are similar, so the implementation of the apparatus can refer to the implementation of the method, and the repeated places will not be repeated.

Referring to FIG. 6 , which is a schematic diagram of the architecture of an augmented reality-based interaction device according to an embodiment of the present disclosure, the device includes: an acquisition module 601 , a first determination module 602 , a second determination module 603 , and a first display module 604; of which,

an acquisition module 601, configured to acquire a real scene picture;

a first determining module 602, configured to determine and display an augmented reality AR image containing a first virtual object to be thrown and at least one second virtual object to be selected based on the real scene image;

A second determining module 603, configured to determine a throwing result of the first virtual object for the second virtual object in response to a target triggering operation for the first virtual object;

The first display module 604 is configured to display the throwing result in the AR picture.

In an optional implementation manner, the second determining module 603 is specifically configured to:

In response to a target triggering operation for the first virtual object, determining a throwing distance and throwing direction corresponding to the first virtual object;

Based on the throwing distance and the throwing direction, a throwing result of the first virtual object with respect to the second virtual object is determined.

In an optional implementation manner, the second determining module 603 is specifically configured to:

In response to the target triggering operation for the first virtual object, the throwing distance corresponding to the first virtual object is determined according to the triggering duration of the target triggering operation.

In an optional implementation manner, the second determining module 603 is specifically configured to:

In response to the target trigger operation acting on the target operation area or the target operation object in the AR screen, determining the throwing distance corresponding to the first virtual object according to the trigger duration of the target trigger operation;

The target operation object includes the first virtual object and/or a preset operation control for controlling the first virtual object.

In an optional embodiment, the device further includes:

an update module, configured to update the charging progress value of the charging progress bar displayed in the AR screen according to the triggering duration of the target triggering operation in response to the target triggering operation; the longer the triggering duration is , the greater the power accumulation progress value; there is a preset corresponding relationship between the power accumulation progress value and the throwing distance.

In an optional implementation manner, the second determining module 603 is specifically configured to:

In response to the target triggering operation for the first virtual object, the throwing direction corresponding to the first virtual object is determined according to the shooting angle of the camera corresponding to the AR image at the triggering moment corresponding to the target triggering operation.

In an optional embodiment, the device further includes:

The second display module is configured to display a direction guide mark in the AR screen in response to the target triggering operation; the direction guide mark is used to indicate the current throwing direction, and the direction guide mark can be displayed in any Pointing adjustment is performed under the control of the target triggering operation described above.

In an optional implementation manner, the first determining module 602 is specifically configured to:

Based on the real scene picture, determine the initial position information of the first virtual object to be thrown and the at least one second virtual object to be selected into the real scene respectively; based on the first virtual object and the at least one second virtual object The initial position information of the object in the real scene, showing the initial AR picture;

In response to the change of the camera shooting pose, determine the changed position information of the first virtual object in the real scene; wherein, the position of the first virtual object in the real scene follows the camera shooting pose The position of the at least one second virtual object in the real scene remains unchanged;

Based on the changed position information of the first virtual object in the real scene and the initial position information of the at least one second virtual object in the real scene, the changed AR picture is displayed.

In an optional implementation manner, before performing a target triggering operation in response to the first virtual object and determining the throwing distance and throwing direction corresponding to the first virtual object, the device further includes:

a judgment module for judging whether the distance between the first virtual object and the at least one second virtual object is less than a set distance threshold;

A prompting module, configured to prompt the user to stay away from the at least one second virtual object if the value is smaller than the value.

In an optional implementation manner, the first determining module 602 is specifically configured to:

Based on the real scene image, it is judged whether the real scene image matches the target scene type, and if so, it is determined and displayed based on the real scene image that includes the first virtual object and the at least one second virtual object. Augmented reality AR footage of objects.

In an optional implementation manner, the at least one second virtual object includes a plurality of second virtual objects;

The first display module 604 is specifically configured to: display the selected target second virtual object among the plurality of second virtual objects in the AR screen, and display the reward information corresponding to the target second virtual object.

For the description of the processing flow of each module in the apparatus and the interaction flow between the modules, reference may be made to the relevant descriptions in the foregoing method embodiments, which will not be described in detail here.

Based on the same technical concept, an embodiment of the present disclosure also provides a computer device. Referring to FIG. 7 , a schematic structural diagram of a computer device 700 provided by an embodiment of the present disclosure includes a processor 701 , a memory 702 , and a bus 703 . Among them, the memory 702 is used to store the execution instructions, including the memory 7021 and the external memory 7022; the memory 7021 here is also called the internal memory, which is used to temporarily store the operation data in the processor 701 and the data exchanged with the external memory 7022 such as the hard disk, The processor 701 exchanges data with the external memory 7022 through the memory 7021. When the computer device 700 is running, the processor 701 communicates with the memory 702 through the bus 703, so that the processor 701 executes the following instructions:

Get real scene images;

determining and displaying an augmented reality AR image containing the first virtual object to be thrown and at least one second virtual object to be selected based on the real scene image;

In response to a target triggering operation for the first virtual object, determining a throwing result of the first virtual object for the second virtual object;

The throwing result is displayed in the AR screen.

Embodiments of the present disclosure further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the augmented reality-based interaction method described in the foregoing method embodiment is executed. step. Wherein, the storage medium may be a volatile or non-volatile computer-readable storage medium.

Embodiments of the present disclosure further provide a computer program product, where the computer product carries program codes, and the instructions included in the program codes can be used to execute the steps of the augmented reality-based interaction method described in the foregoing method embodiments. For details, please refer to The foregoing method embodiments are not repeated here.

Wherein, the above-mentioned computer program product can be specifically implemented by means of hardware, software or a combination thereof. In an optional embodiment, the computer program product is embodied as a computer storage medium, and in another optional embodiment, the computer program product is embodied as a software product, such as a software development kit (Software Development Kit, SDK), etc. Wait.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, for the specific working process of the device described above, reference may be made to the corresponding process in the foregoing method embodiments, which will not be repeated here. In the several embodiments provided in the present disclosure, it should be understood that the disclosed apparatus and method may be implemented in other manners. The apparatus embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some communication interfaces, indirect coupling or communication connection of devices or units, which may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.

The functions, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a processor-executable non-volatile computer-readable storage medium. Based on such understanding, the technical solutions of the present disclosure can be embodied in the form of software products in essence, or the parts that contribute to the prior art or the parts of the technical solutions. The computer software products are stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present disclosure. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes.

Finally, it should be noted that the above-mentioned embodiments are only specific implementations of the present disclosure, and are used to illustrate the technical solutions of the present disclosure rather than limit them. The protection scope of the present disclosure is not limited thereto, although referring to the foregoing The embodiments describe the present disclosure in detail, and those skilled in the art should understand that: any person skilled in the art can still modify the technical solutions described in the foregoing embodiments within the technical scope disclosed by the present disclosure. Changes can be easily thought of, or equivalent replacements are made to some of the technical features; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and should be covered in the present disclosure. within the scope of protection. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.

Claims (14)

1. an interactive method based on augmented reality, is characterized in that, comprises: Get real scene images; determining and displaying an augmented reality AR image containing the first virtual object to be thrown and at least one second virtual object to be selected based on the real scene image; In response to a target triggering operation for the first virtual object, determining a throwing result of the first virtual object for the second virtual object; The throwing result is displayed in the AR screen. 2 . The method according to claim 1 , wherein, in response to a target triggering operation for the first virtual object, determining a throwing result of the first virtual object for the second virtual object comprises: 2 . : In response to a target triggering operation for the first virtual object, determining a throwing distance and throwing direction corresponding to the first virtual object; Based on the throwing distance and the throwing direction, a throwing result of the first virtual object with respect to the second virtual object is determined. 3 . The method according to claim 2 , wherein the determining a throwing distance corresponding to the first virtual object in response to a target triggering operation for the first virtual object comprises: 3 . In response to the target triggering operation for the first virtual object, the throwing distance corresponding to the first virtual object is determined according to the triggering duration of the target triggering operation. 4 . The method according to claim 3 , wherein, in response to a target triggering operation for the first virtual object, according to a triggering duration of the target triggering operation, it is determined that the first virtual object corresponds to the first virtual object. 5 . throwing distances, including: In response to the target trigger operation acting on the target operation area or the target operation object in the AR screen, determining the throwing distance corresponding to the first virtual object according to the trigger duration of the target trigger operation; The target operation object includes the first virtual object and/or a preset operation control for controlling the first virtual object. 5. The method according to claim 3 or 4, wherein the method further comprises: In response to the target triggering operation, update the charging progress value of the charging progress bar displayed in the AR screen according to the triggering duration of the target triggering operation; The larger the progress value is; there is a preset corresponding relationship between the charging progress value and the throwing distance. 6 . The method according to claim 2 , wherein the determining a throwing direction corresponding to the first virtual object in response to a target triggering operation for the first virtual object comprises: 6 . In response to the target triggering operation for the first virtual object, the throwing direction corresponding to the first virtual object is determined according to the shooting angle of the camera corresponding to the AR image at the triggering moment corresponding to the target triggering operation. 7. The method according to claim 2, wherein the method further comprises: In response to the target triggering operation, a direction guide mark is displayed in the AR screen; the direction guide mark is used to indicate the current throwing direction, and the direction guide mark can be under the control of the target trigger operation Make pointing adjustments. 8 . The method according to claim 1 , wherein, based on the real scene image, determining and displaying an augmented reality AR image including a first virtual object to be thrown and at least one second virtual object to be selected. 9 . ,include: Based on the real scene picture, determine the initial position information of the first virtual object to be thrown and the at least one second virtual object to be selected into the real scene respectively; based on the first virtual object and the at least one second virtual object The initial position information of the object in the real scene, showing the initial AR picture; In response to the change of the camera shooting pose, determine the changed position information of the first virtual object in the real scene; wherein, the position of the first virtual object in the real scene follows the camera shooting pose The position of the at least one second virtual object in the real scene remains unchanged; Based on the changed position information of the first virtual object in the real scene and the initial position information of the at least one second virtual object in the real scene, the changed AR picture is displayed. 9 . The method according to claim 2 , wherein, in response to a target triggering operation for the first virtual object, before determining the throwing distance and throwing direction corresponding to the first virtual object, the method further comprises: 10 . : judging whether the distance between the first virtual object and the at least one second virtual object is less than a set distance threshold; If it is less than, the user is prompted to stay away from the at least one second virtual object. 10 . The method according to claim 1 , wherein, based on the real scene picture, determining and displaying an augmented reality AR picture including a first virtual object to be thrown and at least one second virtual object to be selected. 11 . ,include: Based on the real scene image, it is judged whether the real scene image matches the target scene type, and if so, it is determined and displayed based on the real scene image that includes the first virtual object and the at least one second virtual object. Augmented reality AR footage of objects. 11. The method of claim 1, wherein the at least one second virtual object comprises a plurality of second virtual objects; The displaying and the throwing result in the AR screen include: The selected target second virtual object among the plurality of second virtual objects is displayed on the AR screen, and the reward information corresponding to the target second virtual object is displayed. 12. An augmented reality-based interactive device, comprising: The acquisition module is used to acquire the real scene picture; a first determining module, configured to determine and display an augmented reality AR image containing the first virtual object to be thrown and at least one second virtual object to be selected based on the real scene image; a second determining module, configured to determine a throwing result of the first virtual object for the second virtual object in response to a target triggering operation for the first virtual object; a first display module, configured to display the throwing result in the AR picture. 13. A computer device, comprising: a processor, a memory, and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the computer device runs, the processor and the The memories communicate with each other through a bus, and when the machine-readable instructions are executed by the processor, the steps of the augmented reality-based interaction method according to any one of claims 1 to 11 are performed. 14. A computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the augmented reality-based augmented reality according to any one of claims 1 to 11 is executed. steps of the interactive method.

Images