CN117170504B - Method, system and storage medium for viewing with person in virtual character interaction scene - Google Patents

Abstract

The invention discloses a method, a system and a storage medium for viewing with a person in a virtual character interaction scene, belonging to the technical field of virtual and reality, wherein the method comprises the following steps: s1, a first client side obtains a following instruction of a user A, sends a following message to a second client side, and a user B enters a following state; step S2, the client sends the position coordinates of the user A to the client II in real time, and the user B automatically moves towards the position coordinates; s3, calculating the distance between the user B and the user A in real time, and enabling the user B to be separated from a following state when the distance is smaller than a preset shortest distance; step S4, the first client receives the tape-looking instruction of the user A, sends a tape-looking message to the second client, and the user B enters a tape-looking state; and S5, calculating coordinates of a visual angle target of the user A, wherein a camera of the user B faces the visual angle target. The invention uses the synchronous movement and the synchronous visual angle between the user A and the user B to make the interaction between the users more real.

Description

Method, system and storage medium for leading people to watch in virtual character interaction scenes

Technical field

The present invention relates to the field of virtual and reality technologies, and in particular to methods, systems and storage media for leading people to watch in virtual character interaction scenes.

Background technique

Virtual and reality is a new practical technology developed in the 20th century. VR virtual digital human: VR virtual digital human is a technology built based on the above technology to truly display VR character models in the computer. It is a series of virtual images created using artificial intelligence, virtual reality technology and advanced technology. It consists of one or more A comprehensive representation of human activity processes and information generated by a computer and incorporating the data and characteristics of a real person. Virtual digital people allow people to communicate equally with real people through digital images; they can also complete the interaction between virtual images and the real world through their interactive forms; they are more humane.

At present, virtual and reality technologies are used in various fields. In different scenarios, the interaction needs between users are also different. For example, in some scenes that require guided tours, the tour guide often needs to constantly move to various booths when explaining the exhibits. Location, the traditional form of interaction is for the user to freely follow the tour guide to view the exhibits. However, it may happen that the user is unable to follow the tour guide in time, resulting in the user only hearing the voice and not being able to see the exhibits, or when there are many exhibits, the user being led will not be able to see the exhibits. The perspective cannot accurately locate the situation of the currently introduced exhibit, so the traditional interaction method that relies on users to actively follow has poor interaction effects and is not realistic enough.

Contents of the invention

The purpose of the present invention is to solve the above-mentioned problem of poor interaction effect between other users and the tour guide in the virtual scene where the tour guide moves to explain the exhibits, and proposes a method, system and storage medium for leading people to watch in the virtual character interaction scene, with manageable In the scene, the person being watched accurately moves to the position of the person watching and the perspective of the person being watched is synchronized, making the interaction more realistic.

In the first aspect, the present invention achieves the above object through the following technical solution, a method of leading people to watch in a virtual character interaction scene, defining user A of client one as the person to be followed, and user B of client two as the person to follow. , the method includes the following steps:

Step S1: Client 1 obtains the follow instruction of user A and sends a follow message to client 2. The follow message is used by client 2 to control user B to enter the follow state;

Step S2: Client 1 sends the location coordinates of user A to client 2 in real time, and client 2 controls user B to automatically move toward the location coordinates;

Step S3: Client 2 calculates the distance between user B and user A in real time. When the distance is less than the preset shortest distance, client 2 controls user B to leave the following state. When the distance is greater than the preset minimum distance, When the set minimum distance is reached, repeat steps S2 and S3;

Step S4: Client 1 receives the watch instruction from user A and sends a watch message to client 2. The watch message is used by client 2 to control user B to enter the watch state;

Step S5: Calculate the coordinates of the user A's perspective target, and send the coordinates to the client 2. The coordinates are used by the client 2 to control the camera of user B to face the perspective target.

Preferably, the method for client 2 to control user B to automatically move toward the location coordinates includes:

Client 2 receives the follow message and bakes a NavMesh grid on the ground of the current virtual scene. The NavMesh grid is used to control user B to automatically move along the shortest path to the target point. The input of the target point is set to User A’s location coordinates.

Preferably, the length range of the preset shortest distance is 0.1-1m, and the length unit of the shortest distance is the length unit set in the virtual scene.

Preferably, the method of calculating the coordinates of the user A's perspective target includes:

Calculate the coordinates of the diagonal intersection of the virtual scene display interface;

Send a ray to this coordinate using user A's camera as the starting point;

Obtain the objects colliding on the ray through collision detection as the perspective target;

Obtain the coordinates of the point where the camera collides with the surface of the object as the coordinates of the perspective target.

Preferably, the method further includes turning off the operation function for user B to receive movement instructions when user B enters the following state.

Preferably, the method further includes, when user B enters the viewing state, turning off the operation function for user B to receive rotation angle instructions.

In the second aspect, the present invention achieves the above object through the following technical solution, a system for leading people to watch in a virtual character interaction scene, the system includes:

The follow start unit is used for client one to obtain the follow instruction of user A and send a follow message to client two. The follow message is used for client two to control user B to enter the follow state;

A movement control unit configured for client one to send the location coordinates of user A to client two in real time, and client two controls user B to automatically move toward the location coordinates;

The following end unit is used for client 2 to calculate the distance between user B and user A in real time. When the distance is less than the preset shortest distance, client 2 controls user B to leave the following state. When When the distance is greater than the preset shortest distance, the movement control unit and the follow-up end unit are repeatedly executed;

The watch start unit is used for client one to receive the watch instruction from user A and send a watch message to client two. The watch message is used by client two to control user B to enter the watch state;

A field of view synchronization unit, used to calculate the coordinates of the user A's view target, and send the coordinates to the client 2. The coordinates are used by the client 2 to control the camera of user B in a disengaged following state. Towards said perspective target.

Preferably, the method for client 2 in the mobile control unit to control user B to automatically move toward the location coordinates includes:

Client 2 receives the follow message and bakes a NavMesh grid on the ground of the current virtual scene. The NavMesh grid is used to control user B to automatically move along the shortest path to the target point. The input of the target point is set to User A’s location coordinates.

Preferably, the method for calculating the coordinates of the user A's perspective target in the visual field synchronization unit includes:

Calculate the coordinates of the diagonal intersection of the virtual scene display interface;

Send a ray to this coordinate using user A's camera as the starting point;

Obtain the objects colliding on the ray through collision detection as the perspective target;

Obtain the coordinates of the point where the camera collides with the surface of the object as the coordinates of the perspective target.

In a third aspect, the present invention achieves the above object through the following technical solution: a storage medium on which a computer program is stored. When the computer program is executed by a processor, the virtual character interaction as described in the first aspect is realized. Ways to take people to watch in a scene.

Compared with the existing technology, the beneficial effects of the present invention are: the present invention uses user B to move with user A when entering the following state, and when it is closer to user A, user B can enter the watching state. In this state, user B can synchronize the perspective of user A, which ensures that the target seen by user B is consistent with that of user A. This method can ensure that the leader can accurately introduce the target to the person being taken in some sightseeing scenarios. , making user interaction more real, and also convenient for managing the people being led to avoid falling behind.

Description of the drawings

Figure 1 is a flow chart of the method of leading people to watch in a virtual character interaction scene according to the present invention.

Figure 2 is a schematic diagram of the system composition of the present invention for leading people to watch in a virtual character interaction scene.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of the present invention.

Example 1

As shown in Figure 1, a method of leading people to watch in a virtual character interaction scene defines user A of client one as the person to be followed, and user B of client two as the person to follow. The method includes the following steps:

Step S1: Client 1 obtains the follow instruction of user A and sends a follow message to client 2. The follow message is used by client 2 to control user B to enter the follow state. The follow instruction is given by user A by clicking on the scene display interface. The follow button is turned on, as shown in Figure 2. The name of user B, the following status, and several buttons to control following are displayed on the display interface. During the interaction, user A clicks the follow button, and user B receives the invitation to follow. message, user B enters the following state, and after user A clicks the end control button, user B receives the end message and leaves the following state. This control method is for user A to manually control user B's following and leaving. User B's departure from the following state mentioned below is triggered by user B, and the specific details are described below. As mentioned in step S2, user B automatically follows user A in the following state.

Step S2: Client 1 sends the location coordinates of user A to client 2 in real time, and client 2 controls user B to automatically move toward the location coordinates; in step S1, we know user B When entering the following state, it will move with user A. Specifically, user A synchronizes the position coordinates to user B in real time, so that user B moves toward the position coordinates of user A in real time. From a visual point of view, user B follows user A. Effect, the method for the client 2 to control the user B to automatically move toward the location coordinates includes:

Client 2 receives the follow message and bakes a NavMesh grid on the ground of the current virtual scene. The NavMesh grid is used to control user B to automatically move along the shortest path to the target point. The input of the target point is set to User A’s location coordinates. NavMesh is an automatic path-finding algorithm in 3Dunity. It can automatically calculate the optimal path for path-finding. This program uses the automatic path-finding function to use the position coordinates of user A as the target point for automatic path-finding. Achieve the effect of user B following user A’s movement.

Step S3: Client 2 calculates the distance between user B and user A in real time. When the distance is less than the preset shortest distance, client 2 controls user B to leave the following state. When the distance is greater than the preset minimum distance, When the shortest distance is set, repeat steps S2 and S3; in order to avoid the overlap of the role models of user B and user A, causing a sense of inconsistency in the user's perspective, the shortest distance is set to limit the distance for user B to follow user A. When When user B is relatively close to user A, user B breaks away from the following state. At this time, user A moves, and user B will not follow. User B can automatically rotate the viewing angle and move in a small range, but once user B's movement range becomes larger, As a result, the distance between the two exceeds the shortest distance again, and user B's client 2 will perform steps S2 and S3 again, and continue to return to the following state to follow user A.

Step S4: Client 1 receives the watch command from user A and sends a watch message to client 2. The watch message is used by client 2 to control user B to enter the watch state. When the distance between user B and user A is When the distance is less than the shortest distance, the client can receive the viewing instruction from user A and send the viewing message to user B. After user B receives the message and enters the viewing state, the perspective of user B in the viewing state cannot be User B controls the movement, and the content seen from user B's perspective is the picture or scene seen by user A.

Step S5: Calculate the coordinates of the user A's perspective target, and send the coordinates to the client 2. The coordinates are used by the client 2 to control the camera of user B to face the perspective target. In step S4 It can be seen that user B enters the viewing state, and user A's perspective is synchronized to user B. This step is a detailed description of how user A synchronizes. The method used by user A to synchronize the perspective target is to synchronize coordinates and send the coordinates to user B. , so that after user B's camera inputs the coordinates, it can rotate to the position of these coordinates, so that the picture seen by user B is consistent with the picture seen by user A. This synchronization method has many options. For example, another method is to synchronize the rotation angle of user A's camera to user B, so that user B can directly rotate according to the same rotation angle. However, this method does not affect the position where user B is standing. The location requirements are too high, because once user B is too far away from user A, even if the rotation angles of the two cameras are the same, the content seen will be deviated. As mentioned in step S3, user B and user A If A is too close, he will be out of the following state and can move freely, which makes it difficult to grasp the position of user B. Therefore, although this method can also achieve the effect of synchronizing the perspective, the accuracy is not as good as step S5, so this method is generally not used.

The shortest distance is preset, and this distance range can be set according to needs. The length range of the preset shortest distance is 0.1-1m. The length unit of the shortest distance is the length unit set in the virtual scene. Since The virtual scene pursues a one-to-one restoration of the real scene, so 0.1-1m here is the length unit of the virtual scene. If the area of the booth is relatively large, it can accommodate multiple users at one time. Since there are many character models, in order to avoid character models Overlay, the shortest distance can be set to the maximum value of 1m. On the contrary, if the booth area is small, in order to avoid the deviation of the synchronized perspective target caused by the excessive distance between users, the shortest distance can be set to the minimum value of 0.1m. .

In step S5, we know that synchronizing the viewing angle coordinates can ensure that the deviation between the viewing angle of user B and the viewing angle of user A is small. In order to ensure the minimum error, the method of calculating the coordinates of the viewing angle target of user A includes:

Calculate the coordinates of the diagonal intersection of the virtual scene display interface. This step is to calculate the center point of the screen from user A's perspective;

Taking user A's camera as the starting point, send a ray to the coordinate, and the ray is used for collision detection;

The object that collides with the ray is obtained through collision detection. As a perspective target, the object that the ray can collide with represents the object currently seen by the user;

Obtain the coordinates of the collision point between the camera and the object surface as the coordinates of the perspective target, and the center point of the object as the perspective target. Even if there is a distance between the position of user B and user A, the center of the object seen by both is the same. If the viewing angles are the same size, the content you see will also be the same, and the viewing angle target error obtained by this method will be the smallest.

In step S3, it can be seen that when user B follows user A, in order to prevent user B from affecting the effect of automatic movement, user B cannot manually control the movement. Therefore, the method also includes turning off user B to receive movement when user B enters the following state. Regarding the operation function of command instructions, user B has turned off the operation function of receiving instructions. Even if a user operates through the move button on the screen, user B will still move according to the automatic movement path, which will not destroy the effect of automatic movement. In step S4, it can be seen that the viewing angle seen by user B who enters the viewing state is the perspective of user A. In order to prevent the user from actively shaking the mouse and affecting the synchronization of the viewing angles, the method also includes the user B entering the viewing state. , turn off the operation function for user B to receive rotation angle instructions. Even if a user operates through the angle rotation button on the screen, the picture that user B sees is still the picture from user A's perspective, and the effect of synchronized perspective will not be destroyed.

Example 2

As shown in Figure 2, a system for leading people to watch in a virtual character interaction scene, the system includes:

The follow start unit is used for client one to obtain the follow instruction of user A and send a follow message to client two. The follow message is used for client two to control user B to enter the follow state. When user B enters the follow state, , close the operation function for user B to receive movement instructions.

A movement control unit, configured for client one to send the location coordinates of user A to client two in real time, and client two controls user B to automatically move toward the location coordinates.

The following end unit is used for client 2 to calculate the distance between user B and user A in real time. When the distance is less than the preset shortest distance, client 2 controls user B to leave the following state. When When the distance is greater than the preset shortest distance, the movement control unit and the follow end unit are repeatedly executed. The method for client 2 in the movement control unit to control the user B to automatically move toward the position coordinates includes:

Client 2 receives the follow message and bakes a NavMesh grid on the ground of the current virtual scene. The NavMesh grid is used to control user B to automatically move along the shortest path to the target point. The input of the target point is set to User A’s location coordinates.

The watch start unit is used for client one to receive the watch instruction from user A and send a watch message to client two. The watch message is used for the client two to control user B to enter the watch state, and user B enters the watch state. When in the viewing state, turn off the operation function for user B to receive rotation angle instructions;

A field of view synchronization unit, used to calculate the coordinates of the user A's view target, and send the coordinates to the client 2. The coordinates are used by the client 2 to control the camera of user B in a disengaged following state. Towards said perspective target. The method of calculating the coordinates of the user A's perspective target in the visual field synchronization unit includes:

Calculate the coordinates of the diagonal intersection of the virtual scene display interface;

Send a ray to this coordinate using user A's camera as the starting point;

Obtain the objects colliding on the ray through collision detection as the perspective target;

Obtain the coordinates of the point where the camera collides with the surface of the object as the coordinates of the perspective target.

Embodiment 2 is essentially the same as Embodiment 1, so the operating principles between each unit module will not be described in detail.

Example 3

This embodiment proposes a storage medium. The storage medium includes a storage program area and a storage data area. The storage program area can store operating systems and programs required to run instant messaging functions. The storage data area can store various instant messaging areas. Information and operating instruction sets, etc. The computer program is stored in the stored program area. When the computer program is executed by the processor, the method of leading people to watch in a virtual character interaction scene as described in Embodiment 1 is implemented. The processor may include one or more central processing units (CPUs) or a digital processing unit or the like.

It is obvious to those skilled in the art that the present invention is not limited to the details of the above-described exemplary embodiments, and that the present invention can be implemented in other specific forms without departing from the spirit or essential characteristics of the present invention. Therefore, the embodiments should be regarded as illustrative and non-restrictive from any point of view, and the scope of the present invention is defined by the appended claims rather than the above description, and it is therefore intended that all claims falling within the claims All changes within the meaning and scope of equivalent elements are included in the present invention.

In addition, it should be understood that although this specification is described in terms of implementations, not each implementation only contains an independent technical solution. This description of the specification is only for the sake of clarity, and those skilled in the art should take the specification as a whole. , the technical solutions in each embodiment can also be appropriately combined to form other implementations that can be understood by those skilled in the art.

Claims (8)

1. A method for viewing with a person in a virtual character interaction scene, defining a user a of a first client as a followed person and a user B of a second client as a followed person, the method comprising the steps of:

step S1, a first client obtains a following instruction of a user A and sends a following message to a second client, wherein the following message is used for the second client to control the user B to enter a following state;

step S2, a client sends the position coordinates of the user A to the client II in real time, and the client II controls the user B to automatically move towards the position coordinates;

step S3, a second client calculates the distance between the user B and the user A in real time, when the distance is smaller than the preset shortest distance, the second client controls the user B to be separated from a following state, and when the distance is larger than the preset shortest distance, the step S2 and the step S3 are repeatedly executed;

step S4, the first client receives a tape-looking instruction of the user A and sends a tape-looking message to the second client, wherein the tape-looking message is used for the second client to control the user B to enter a tape-looking state;

step S5, calculating coordinates of the view angle target of the user a, and sending the coordinates to the client B, where the coordinates are used by the client B to control the camera of the user B to face the view angle target, and the method for calculating the coordinates of the view angle target of the user a includes:

calculating coordinates of diagonal crossing points of a virtual scene display interface;

transmitting a ray to the coordinate by taking a camera of the user A as a starting point;

obtaining an object collided on the rays through collision detection as a visual angle target;

and acquiring coordinates of a collision part of the image pick-up and the surface of the object as coordinates of a visual angle target.

2. The method of mannequin viewing in a virtual character interaction scene of claim 1, wherein the method of controlling the user B to automatically move toward the location coordinates by the second client comprises:

and the second client receives the following message and bakes out a Navmesh grid on the ground of the current virtual scene, wherein the Navmesh grid is used for controlling the user B to automatically move according to the shortest path between the user B and the target point, and the input of the target point is set as the position coordinate of the user A.

3. The method for mannequin viewing in a virtual character interaction scene according to claim 1, wherein the preset shortest distance has a length ranging from 0.1 to 1m, and the shortest distance has a length unit set in the virtual scene.

4. The method of claim 1, further comprising turning off an operation function of receiving a movement instruction by the user B when the user B enters a following state.

5. The method of claim 1, further comprising turning off an operation function of receiving a rotation angle of view instruction from the user B when the user B enters the viewing state.

6. A system for viewing with a person in a virtual character interaction scene, the system comprising:

the following starting unit is used for the first client to acquire the following instruction of the user A and send a following message to the second client, wherein the following message is used for the second client to control the user B to enter a following state;

the mobile control unit is used for sending the position coordinates of the user A to the client II in real time by the client II, and the client II controls the user B to automatically move towards the position coordinates;

the following ending unit is used for calculating the distance between the user B and the user A in real time by the second client, controlling the user B to be separated from a following state by the second client when the distance is smaller than the preset shortest distance, and repeatedly executing the mobile control unit and the following ending unit when the distance is larger than the preset shortest distance;

the system comprises a tape-watching starting unit, a first client and a second client, wherein the tape-watching starting unit is used for receiving a tape-watching instruction of a user A and sending a tape-watching message to the second client, and the tape-watching message is used for controlling the second client to control the user B to enter a tape-watching state;

a view synchronization unit, configured to calculate coordinates of a view target of the user a, send the coordinates to the client B, where the coordinates are used for the client B to control a camera of the user B in a state of being separated from and following toward the view target, and a method for calculating the coordinates of the view target of the user a in the view synchronization unit includes:

calculating coordinates of diagonal crossing points of a virtual scene display interface;

transmitting a ray to the coordinate by taking a camera of the user A as a starting point;

obtaining an object collided on the rays through collision detection as a visual angle target;

and acquiring coordinates of a collision part of the image pick-up and the surface of the object as coordinates of a visual angle target.

7. The system for mannequin viewing in a virtual character interaction scene according to claim 6, wherein the method for controlling the user B to automatically move toward the location coordinates by the second client in the movement control unit comprises:

and the second client receives the following message and bakes out a Navmesh grid on the ground of the current virtual scene, wherein the Navmesh grid is used for controlling the user B to automatically move according to the shortest path between the user B and the target point, and the input of the target point is set as the position coordinate of the user A.

8. A storage medium having stored thereon a computer program which, when executed by a processor, implements the method of mannequin viewing in a virtual character interaction scene as claimed in any one of claims 1 to 5.