CN114697755A - Virtual scene information interaction method, apparatus, device and storage medium - Google Patents

Abstract

The present disclosure provides a virtual scene information interaction method, apparatus, device, storage medium, and program product, which relate to the field of artificial intelligence, and in particular, to the technical fields of computer vision, speech recognition, and virtual reality, and can be used in cloud computing, metasma, and media cloud scenes. The specific implementation scheme is as follows: responding to a virtual scene access request instruction aiming at a first object, and acquiring basic data of the first object; according to the basic data, creating an avatar of a first object in the virtual scene to obtain a target participation object corresponding to the first object; and playing the target content in the virtual scene in response to the target content playing instruction from the first object.

Description

Virtual scene information interaction method, apparatus, device and storage medium

technical field

The present disclosure relates to the field of artificial intelligence, in particular to the technical fields of computer vision, speech recognition, and virtual reality, and can be applied in cloud computing, metaverse, and media cloud scenarios, and specifically relates to a virtual scene information interaction method, device, equipment, and storage medium and program products.

Background technique

With the development of computer technology and Internet technology, many smart products provide the function of data interaction through a virtual environment to improve user experience.

SUMMARY OF THE INVENTION

The present disclosure provides a virtual scene information interaction method, apparatus, device, storage medium and program product.

According to an aspect of the present disclosure, there is provided a virtual scene information interaction method, including: in response to a virtual scene access request instruction for a first object, acquiring basic data of a first object; creating a virtual scene according to the basic data The virtual image of the first object obtains the target participating object corresponding to the first object; and in response to the target content playback instruction from the first object, the target content is played in the virtual scene.

According to another aspect of the present disclosure, a virtual scene information interaction device is provided, comprising: a basic data acquisition module, a target participant object determination module, and a target content playback module. The basic data acquisition module is used for acquiring the basic data of the first object in response to the virtual scene access request instruction for the first object; the target participating object determination module is used for creating the first object in the virtual scene according to the basic data The virtual image obtains the target participating object corresponding to the first object; the target content playing module is used for playing the target content in the virtual scene in response to the target content playing instruction from the first object.

According to another aspect of the present disclosure, there is provided an electronic device comprising: at least one processor and a memory communicatively coupled to the at least one processor. Wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method of the embodiments of the present disclosure.

According to another aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing the computer to perform a method of an embodiment of the present disclosure.

According to another aspect of the present disclosure, there is provided a computer program product comprising a computer program that, when executed by a processor, implements the method of an embodiment of the present disclosure.

The virtual scene information interaction method of the present disclosure can achieve at least one of the following technical effects.

1) By creating the virtual image of the first object in the virtual scene, the target participating object corresponding to the first object can be obtained, and the virtual image can be used as the existence form of the first object in the virtual environment, so as to improve the user's participation in the virtual environment. , so that users can immersely interact with data through the virtual environment.

2) By playing the target content in the virtual scene, it can meet the needs of playing the target content in the virtual scene for data interaction, expand the application coverage of data interaction based on the virtual scene, and improve the user's sense of presence and immersion based on the virtual scene. Higher information exchange efficiency.

It should be understood that what is described in this section is not intended to identify key or critical features of embodiments of the disclosure, nor is it intended to limit the scope of the disclosure. Other features of the present disclosure will become readily understood from the following description.

Description of drawings

The accompanying drawings are used for better understanding of the present solution, and do not constitute a limitation to the present disclosure. in:

FIG. 1A schematically shows a system architecture diagram of a method and apparatus for exchanging virtual scene information according to an embodiment of the present disclosure;

FIG. 1B schematically shows a system architecture diagram of a method and apparatus for interacting with virtual scene information according to another embodiment of the present disclosure;

FIG. 2 schematically shows a flowchart of a virtual scene information interaction method according to an embodiment of the present disclosure;

FIG. 3 schematically shows a schematic diagram of a virtual scene information interaction method according to an embodiment of the present disclosure;

FIG. 4 schematically shows a schematic diagram of playing target content in a virtual scene according to an embodiment of the present disclosure;

FIG. 5 schematically shows a schematic diagram of a virtual scene information interaction method according to another embodiment of the present disclosure;

FIG. 6 schematically shows a schematic diagram of a system architecture corresponding to a virtual meeting scene applied to a method for exchanging information in a virtual scene according to an embodiment of the present disclosure;

FIG. 7 schematically shows a block diagram of a virtual scene information interaction apparatus according to an embodiment of the present disclosure; and

FIG. 8 schematically shows a block diagram of an electronic device that can implement the virtual scene information interaction method according to an embodiment of the present disclosure.

Detailed ways

Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding and should be considered as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted from the following description for clarity and conciseness.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the present disclosure. The terms "comprising", "comprising" and the like as used herein indicate the presence of stated features, steps, operations and/or components, but do not preclude the presence or addition of one or more other features, steps, operations or components.

All terms (including technical and scientific terms) used herein have the meaning as commonly understood by one of ordinary skill in the art, unless otherwise defined. It should be noted that terms used herein should be construed to have meanings consistent with the context of the present specification and should not be construed in an idealized or overly rigid manner.

Where expressions like "at least one of A, B, and C, etc.," are used, they should generally be interpreted in accordance with the meaning of the expression as commonly understood by those skilled in the art (eg, "has A, B, and C") At least one of the "systems" shall include, but not be limited to, systems with A alone, B alone, C alone, A and B, A and C, B and C, and/or A, B, C, etc. ).

With the development of computer technology and Internet technology, many smart products provide the function of data interaction through a virtual environment to improve user experience.

It can be understood that data interaction based on a virtual environment can break through the limitations of physical space, and is suitable for the situation where users are limited by physical space and still have data interaction requirements.

For example, data interaction can be performed through a virtual meeting application, which in some embodiments supports both voice interaction and video interaction.

FIG. 1A schematically shows the system architecture of a method and apparatus for interacting with virtual scene information according to an embodiment of the present disclosure, and FIG. 1B schematically shows the system architecture of a method and apparatus for interacting with virtual scene information according to another embodiment of the present disclosure. . It should be noted that FIG. 1A and FIG. 1B are only examples of the system architecture to which the embodiments of the present disclosure can be applied, so as to help those skilled in the art to understand the technical content of the present disclosure, but it does not mean that the embodiments of the present disclosure cannot For use with other devices, systems, environments or scenarios.

As shown in FIG. 1A, a system architecture 100A according to this embodiment may include clients 101A, 102A, 103A, a network 104A, and a server 105A. Network 104A is the medium used to provide communication links between clients 101A, 102A, 103A and server 105A. Network 104A may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.

Users can use clients 101A, 102A, 103A to interact with server 105A over network 104A to receive or send messages and the like. Various communication client applications can be installed on the clients 101A, 102A, and 103A, such as applications for data interaction based on a virtual environment, shopping applications, web browser applications, search applications, instant messaging tools, email clients, social media Platform software, etc. (example only).

Clients 101A, 102A, 103A may be various electronic devices having a display screen and supporting web browsing, including but not limited to smartphones, tablets, laptops, desktops, and the like. The clients 101A, 102A, and 103A of the embodiments of the present disclosure may, for example, run application programs.

Server 105A may be a server that provides various services, such as a background management server (just an example) that provides support for websites browsed by users using clients 101A, 102A, 103A. The background management server can analyze and process the received user request and other data, and feed back the processing result (for example, web pages, information, or data obtained or generated according to the user request) to the client. In addition, the server 105A may also be a cloud server, that is, the server 105A has a cloud computing function.

It should be noted that, the virtual scene information interaction method provided by the embodiment of the present disclosure may be executed by the server 105A. Correspondingly, the virtual scene information interaction apparatus provided by the embodiment of the present disclosure may be provided in the server 105A. The virtual scene information interaction method provided by the embodiment of the present disclosure may also be executed by a server or server cluster different from the server 105A and capable of communicating with the clients 101A, 102A, 103A and/or the server 105A. Correspondingly, the virtual scene information interaction apparatus provided by the embodiments of the present disclosure may also be set in a server or server cluster that is different from the server 105A and can communicate with the clients 101A, 102A, 103A and/or the server 105A.

In one example, the server 105A may obtain at least one of virtual scene access request instructions, target content playback instructions, position adjustment instructions, and image adjustment operation instructions from clients 101A, 102A, and 103A through the network 104A.

As shown in FIG. 1B , a system architecture 100B of another embodiment of the present disclosure may include clients 101B, 102B, and 103B, a network 104B, a signaling server 105B, a first media server 106B, a second media server 107B, and a user management server 108B .

Different from the system architecture 100A, the signaling server 105B of the system architecture 100B in the embodiment of the present disclosure is used for coordinating communication among various clients, the first media server 106B is used for processing the media streams of the users of each client, the second media The server 107B can store and process media files for playback, and the user management server 108B is used to manage user data of each client.

It should be understood that the numbers of clients, networks and servers in FIGS. 1A and 1B are merely illustrative. There can be any number of clients, networks, and servers depending on the implementation needs.

It should be noted that in the technical solutions of the present disclosure, the collection, storage, use, processing, transmission, provision, and disclosure of the user's personal information involved are in compliance with relevant laws and regulations, and do not violate public order and good customs.

In the technical solution of the present disclosure, the authorization or consent of the user is obtained before the user's personal information is obtained or collected.

An embodiment of the present disclosure provides a virtual scene information interaction method. The following describes a virtual scene information interaction method according to an exemplary embodiment of the present disclosure with reference to FIGS. 2 to 6 in conjunction with the system architecture of FIGS. 1A and 1B . The virtual scene information interaction method according to the embodiment of the present disclosure may be executed by, for example, the server 105A shown in FIG. 1A .

FIG. 2 schematically shows a flowchart of a virtual scene information interaction method according to an embodiment of the present disclosure.

As shown in FIG. 2 , the virtual scene information interaction method 200 in this embodiment of the present disclosure may include, for example, operations S210 to S230.

In operation S210, in response to the virtual scene access request instruction for the first object, basic data of the first object is acquired.

A virtual scene can be understood as a virtual reality of a scene. Virtual reality is the use of computer to generate simulated virtual scenes, which can bring users a sense of immersion in the scene.

The basic data may include data required to access the virtual scene and other data related to the functionality of the virtual scene. For example, the data required for accessing the virtual scene may include identification data of the virtual scene and identification data of the first object. When the virtual scene has the function of displaying an avatar, the basic data may include avatar data, and the avatar data may be used to create an avatar in the virtual environment.

In operation S220, an avatar of the first object is created in the virtual scene according to the basic data, and a target participating object corresponding to the first object is obtained.

The target participating object can be understood as the first object that participates in the virtual environment and is mapped with an avatar.

In operation S230, in response to the target content playback instruction from the first object, the target content is played in the virtual scene.

There is a situation as follows: when data interaction is performed based on a virtual scene, some target content is also involved. For example, the virtual scene is the scene of a virtual meeting. The purpose of a virtual meeting is to show a certain product to the participants participating in the virtual meeting. The specific display method is to play the promotional video of the product, and the promotional video here is the target content. .

In the virtual scene information interaction method according to the embodiment of the present disclosure, the virtual image of the first object is created in the virtual scene to obtain the target participating object corresponding to the first object, and the virtual image can be used as the existence form of the first object in the virtual environment , to enhance the user's experience of participating in the virtual environment, so that users can immersely interact with data through the virtual environment. The virtual scene information interaction method according to the embodiment of the present disclosure can also meet the demand for data interaction by playing the target content in the virtual scene by playing the target content in the virtual scene, expand the application coverage of data interaction based on the virtual scene, and improve the user's ability to interact with data based on the virtual scene. The sense of presence and immersion of virtual scenes has higher information interaction efficiency.

FIG. 3 schematically shows a schematic diagram of a virtual scene information interaction method 300 according to another embodiment of the present disclosure.

As shown in FIG. 3 , the virtual scene information interaction method 300 according to an embodiment of the present disclosure may include operations S310 to S330.

In operation S310, in response to the virtual scene access request instruction for the first object, basic data of the first object is acquired. For example, the virtual scene access request instruction of the first object may be generated at the client C3.

In operation S320, an avatar of the first object is created in the virtual scene according to the basic data, and a target participating object corresponding to the first object is obtained.

In operation S330, in response to the target content playback instruction from the first object, the target content is played in the virtual scene. For example, the target content playback instruction of the first object may be generated at the client terminal C3.

FIG. 3 schematically shows an example in which the execution subject of operations S310 to S330 is the server side S3 .

FIG. 4 schematically shows a schematic diagram of playing target content in a virtual scene in a virtual scene information interaction method according to yet another embodiment of the present disclosure.

According to yet another embodiment of the present disclosure, the following embodiments can be used to implement a specific example of playing the target content in the virtual scene in response to the target content playing instruction from the first object in the virtual scene information interaction method. The virtual scene may be generated according to the virtual scene data. The virtual scene data may include virtual playback device data.

As shown in FIG. 4, in operation S431, in response to a target content play instruction from the first object, target content data is acquired. For example, the target content playback instruction of the first object may be generated at the client terminal C4.

The target content data may be located at the server side S42, and the server side S42 may include, for example, the above-mentioned second media server 107B.

As shown in FIG. 4 , in response to the target content playback instruction from the first object, before acquiring the target content, target content data may be determined at the server side S42 .

In operation S432, the target content is played through the virtual playback device.

The virtual playback device is generated according to the virtual playback device data, and the target content is generated according to the target content data.

Exemplarily, the virtual playback device may include at least one of the following: a video playback device, a voice playback device, and a text playback device. For example, the virtual playback device may be a virtual projection device, a virtual display screen, or the like.

According to the virtual scene information interaction method according to the embodiment of the present disclosure, by acquiring the target content data and using the virtual playback device to play the target content, the situation of using the playback device to play the target content in the actual scene can be simulated, and the data can be played in the virtual scene by playing the target content. To meet the needs of interaction, improve the user's sense of presence and immersion based on virtual scenes, and improve the efficiency of information interaction. For example, the target content can include the live video of a product's press conference. You can access the virtual conference and use the virtual display screen to play the live video of the press conference in the virtual conference. Participants in the virtual conference can watch the live broadcast of the press conference in a centralized and synchronous manner. Video, for example, you can discuss the live video of the conference to improve the efficiency of the meeting.

Exemplarily, the virtual scene information interaction method according to still another embodiment of the present disclosure may further include the following operations. The virtual scene may include at least one participating object, and the basic data may also include location data.

According to the position data, the position coordinates of the participating objects in the virtual scene are determined.

The virtual scene map data is determined according to the virtual scene data and the position coordinates of the participating objects in the virtual scene.

Send virtual scene map data to participating objects.

According to the virtual scene information interaction method according to the embodiment of the present disclosure, the virtual scene map data can be determined through the position coordinates of the participating objects in the virtual scene, so that the participating objects can locate their own positions in the virtual environment, and can also be determined through the virtual scene map data. The location of other participating objects improves the user experience.

FIG. 5 schematically shows a schematic diagram of data interaction according to an embodiment of the present disclosure.

FIG. 5 schematically shows six participating objects, including participating object User_A, participating object User_B, participating object User_C, participating object User_D, participating object User_E, and participating object User_F. Among them, the position coordinates Pos (Xa, Ya, Za) of the participating object User_A, the position coordinates Pos (Xb, Yb, Zb) of the participating object User_B, the position coordinates Pos (Xc, Yc, Zc) of the participating object User_C, the participating object User_D The position coordinates Pos (Xd, Yd, Zd) of the participating object User_E, the position coordinates Pos (Xe, Ye, Ze) of the participating object User_E, and the position coordinates Pos (Xf, Yf, Zf) of the participating object User_F.

FIG. 5 also schematically shows a virtual playing device B, a conference table D and a virtual scene map Ma.

In the example of FIG. 5 , the interface of the live streaming media service can be invoked, and the live video can be played through the virtual playback device B. In this case, the target content is the live video. The live streaming media service may be provided by the above-mentioned second media server 107B, for example.

In the example of FIG. 5 , for example, taking the participant object User_F as the target participant object, the target participant object can publish the voice stream through the real-time streaming media service, and can also subscribe to the voice stream of the voice interaction object through the real-time streaming media service. The real-time streaming media service may be provided by, for example, the above-mentioned first media server 106B.

In the example of FIG. 5, communication between participating objects may be supported through a real-time communication signaling service. The real-time communication information service can be provided, for example, by the above-mentioned signaling server 105B.

In the example of FIG. 5, the user's related data can be managed through the user management service. The user management service may be provided, for example, by the user management server 108B described above.

Exemplarily, the virtual scene information interaction method according to still another embodiment of the present disclosure may further include the following operations.

In response to the position adjustment instruction for the first object, the position coordinates of the target participating object are adjusted according to the position adjustment data of the first object to obtain the adjusted position coordinates of the target participating object.

Exemplarily, a position adjustment trigger window may be set on the display screen of the client, for example, a position adjustment instruction for the first object may be triggered by clicking.

The position adjustment data may include an adjustment direction and the number of adjustment units based on the adjustment direction.

The virtual scene map data is updated according to at least one of the location update frequency and the adjusted location coordinates.

The location update frequency can be understood as a preset frequency of updating the location coordinates, and the location update frequency can be determined according to the sensitivity requirements of the virtual scene. For example, when the virtual scene requires high sensitivity, the location update frequency may be 0.2 seconds/time; when the virtual scene requires low sensitivity, the location update frequency may be 1 second/time.

Updating the virtual scene map data according to the adjusted position coordinates can be understood as: after the position of the target participating object is adjusted, the position coordinates of the target participating object in the virtual scene map data are adjusted to the adjusted position coordinates.

According to the virtual scene information interaction method according to the embodiment of the present disclosure, the target participant object is supported to adjust the position coordinates, and the virtual scene map data can be adapted to the position adjustment of the target participant object by updating the virtual scene map data. The target participating object can accurately determine its own position and the relative position with other participating objects, and improve the use experience.

Exemplarily, according to yet another embodiment of the present disclosure, the participating objects may include a target participating object and at least one reference participating object. The virtual scene information interaction method may further include the following operations.

According to the voice interaction range threshold and the position coordinates of the participating objects, the voice interaction participating objects of the target participating objects are determined.

Exemplarily, for the target participant object, when the location coordinates of the participant object are within the voice interaction range threshold, the participant object may be determined to be a voice interaction participant object of the target participant object.

Subscribe the voice interaction participant's voice stream to the target participant.

After the target participant subscribes to the voice stream of the voice interaction participant, the target participant can receive the voice stream sent by the voice interaction participant.

It can be understood that, in an actual scene, if the distance between multiple participating objects participating in the actual scene is within a certain range threshold, the participating objects can receive each other's voices.

According to the data interaction method of the embodiment of the present disclosure, the voice interaction participant object of the target participant object can be determined through the voice interaction range threshold and the position coordinates of the participant object, and the voice interaction participant object of the target participant object can be subscribed to the voice stream, which can simulate the actual situation. The sound effects in the scene enhance the user's immersion based on the virtual scene.

Exemplarily, the virtual scene information interaction method according to the embodiment of the present disclosure may further include the following operations.

In response to the location coordinates of the voice interaction participant object exceeding the voice interaction range threshold, an invalid voice interaction participant object is determined.

Unsubscribes the voice stream of an invalid voice interaction participant from the target participant.

The voice interaction participant is the participant whose position coordinates are within the voice interaction range threshold. For example, the participant adjusts the position coordinates, and the adjusted position coordinates exceed the voice interaction range threshold. At this time, the voice interaction participant no longer satisfies the target participant subscription. The condition of its voice flow, the voice interaction participant object becomes an invalid voice interaction participant object. Thereby, the target participant can be unsubscribed from the voice stream of the invalid voice interaction object. After the target participant unsubscribes from the voice stream of the invalid voice interaction participant, the target participant will no longer receive the voice stream sent by the invalid voice interaction participant.

The data interaction method of the embodiment of the present disclosure can dynamically determine the invalid voice interaction participant of the target participant by using the voice interaction range threshold and the position coordinates of the voice interaction participant, and adaptively unsubscribe its voice stream, simulating the actual scene. The sound effects enhance the user's immersion based on the virtual scene.

Exemplarily, the virtual scene information interaction method according to the embodiment of the present disclosure may further include the following operations.

According to the position coordinates of the target participant object and the position coordinates of the voice interaction participant object, the relative position data of the voice interaction participant object relative to the target participant object is determined.

According to the relative position data, at least one of mixing processing and binaural processing is performed on the voice stream of the voice interaction participant to obtain the target voice stream of the voice interaction participant.

Mixing processing can combine multiple audio channels into one audio channel. For example, the virtual environment includes a target participant object and a plurality of voice interaction participant objects, and for the target participant object, the voice streams of each voice interaction participant object are simultaneously received. In addition, the relative position between each voice interaction participant object and the target participant object also causes differences in the voice streams of the target participant object receiving the voice interaction participant object. For example, if the relative position between the target participant and the voice interaction participant User_G is close, and the relative position between the target participant and the voice interaction participant User_H is farther, the attenuation of the voice stream of the voice interaction participant User_G received by the target participant is small. , the speech stream of the voice interaction participant User_H received by the target participant object has a greater attenuation.

The virtual scene information interaction method of the embodiment of the present disclosure can make the voice flow of the voice interaction participant more three-dimensional and improve the voice interaction participation by performing at least one of mixing processing and binaural processing on the voice stream of the voice interaction participant. The sound effect of the voice stream of the object enhances the immersive experience of the user's virtual scene.

Exemplarily, the virtual scene information interaction method according to the embodiment of the present disclosure may further include: adjusting the virtual image of the first object in response to the image adjustment operation instruction for the first object. The image adjustment operation instruction includes at least one of the following: a gender adjustment operation instruction, a clothing adjustment operation instruction, an expression adjustment operation instruction, and a body movement adjustment operation instruction.

Exemplarily, an image adjustment trigger window may be set on the display screen of the client, for example, an image adjustment operation instruction for the first object may be generated by triggering by clicking.

According to the virtual scene information interaction method according to the embodiment of the present disclosure, the virtual image of the first object can be adjusted to meet the image adjustment requirements, and a novel and interesting use experience can be provided.

Exemplarily, according to the virtual scene information interaction method according to the embodiment of the present disclosure, the virtual scene data may include at least one of the following: virtual conference scene data, virtual exhibition hall scene data, and virtual venue scene data. The target content data may include at least one of the following: voice data, text data, and live video data.

Exemplarily, a virtual meeting scene may be generated according to the virtual meeting scene data, and the virtual meeting scene may include, for example, a conference table and the like. A virtual exhibition hall scene may be generated according to the virtual exhibition hall scene data, and the virtual exhibition hall scene may include, for example, a display platform. A virtual stadium scene may be generated according to the virtual stadium scene data, and the virtual stadium scene may include, for example, a stadium venue and the like.

The virtual scene information interaction method of the embodiment of the present disclosure generates virtual scenes of corresponding categories by using virtual scene data of corresponding categories, and can cover various categories of virtual scenes. Also, through the target content data of the corresponding category, the needs of playing various categories of target content can be covered, and the user's sense of presence and immersion based on the virtual scene can be improved.

FIG. 6 schematically shows a schematic diagram of a corresponding system architecture when the virtual scene information interaction method according to an embodiment of the present disclosure is applied to a virtual conference scene. The following describes the virtual scene information interaction method according to the embodiment of the present disclosure from the system architecture level with reference to FIG. 6 .

As shown in FIG. 6 , the system architecture of the virtual scene information interaction method according to the embodiment of the present disclosure includes a virtual conference scene business logic layer L1 and a virtual engine layer L2.

The virtual engine layer L2 may include a basic framework Fr, a virtual kernel Co, a real-time voice communication module M1 and a media playing module M2.

The virtual kernel can provide functions such as virtual image production, virtual scene generation, virtual image expression management, and virtual image body motion management. The virtual kernel may include: special effects module, rendering module, graphics module, input system, management system, audio system, etc.

For example, by providing the virtual image making function, the virtual kernel can create the virtual image of the first object in the virtual scene, and obtain the target participating object corresponding to the first object. The virtual kernel can also adjust the virtual image of the first object by providing the virtual image expression management function and the virtual image body motion management function.

The real-time voice communication module can provide multi-person voice calls and spatial sound effects. The real-time voice communication module may include: a session management unit, a voice acquisition unit, a pulse code modulation unit, a voice transmission unit, a spatial audio mixing unit, and the like.

For example, the real-time voice communication module can subscribe the target participant to the voice stream of the voice interaction participant, and can also unsubscribe the target participant from the voice stream of the invalid voice interaction participant.

The media playback module can provide multimedia live broadcast and on-demand media streaming playback functions in the virtual scene.

For example, the media playing module can play the target content in the virtual scene.

The basic framework can provide the business layer development interface of the virtual engine layer. The basic framework layer encapsulates the virtual kernel, real-time voice communication module, media playback interface and provides several basic functions for virtual scene development. Basic functions include, for example, resource management functions, message management functions, user interface frameworks, network frameworks, and hot update functions.

In the example of FIG. 6 , the virtual scene is a virtual conference scene, and the service logic layer of the system architecture is realized based on the virtual conference function realized by the virtual engine interface. It mainly includes a scene map function unit U1, a virtual character image function unit U2, a virtual conference scene function unit U3, a conference control function unit U4 and a media playback function unit U5.

The scene map function unit provides the function of generating thumbnails according to the virtual conference scene model and the positions of the participating objects. For example, the participating objects can search for the designated conference venue or other participating objects through the scene map.

The avatar function unit provides the function of realizing avatar based on the virtual engine, such as customizable hairstyle, clothing, gender, style, etc.

The virtual conference scene functional unit provides the function of generating a virtual conference scene based on the virtual engine. The virtual meeting scene may include, for example, a round table meeting and a coffee table, and a multimedia conference room may also be generated.

The conference control function unit is the control and management unit of the conference. For example, the conference control unit can provide normal conference communication and management functions such as room creation, participant entry/exit management, media publication/subscription, live/on-demand media subscription, and room dissolution.

The media play function unit can provide the live broadcast and on-demand streaming media play functions of the multimedia conference site, and can receive calls from the conference control function unit.

FIG. 7 schematically shows a block diagram of a virtual scene information interaction apparatus according to an embodiment of the present disclosure.

As shown in FIG. 7 , the virtual scene information interaction apparatus 700 according to the embodiment of the present disclosure includes, for example, a basic data acquisition module 710 , a target participant object determination module 720 , and a target content playback module 730 .

The basic data acquisition module 710 is configured to acquire basic data of the first object in response to the virtual scene access request instruction for the first object.

The target participating object determination module 720 is configured to create a virtual image of the first object in the virtual scene according to the basic data, and obtain the target participating object corresponding to the first object.

The target content playing module 730 is configured to play the target content in the virtual scene in response to the target content playing instruction from the first object.

According to the virtual scene information interaction device according to an embodiment of the present disclosure, the virtual scene is generated according to virtual scene data; the virtual scene data includes virtual playback device data, and the target content playback module may include: a target content acquisition submodule and a target content playback submodule module.

The target content acquisition sub-module may be configured to acquire target content data in response to a target content playback instruction from the first object.

The target content playing sub-module can be used to play the target content through a virtual playing device, the virtual playing device is generated according to the virtual playing device data, and the target content is generated according to the target content data.

According to an embodiment of the present disclosure, the virtual scene includes at least one participating object, and the basic data also includes location data; the virtual scene information interaction device may further include: a location coordinate determination module, a virtual scene map data determination module, and a virtual scene map data sending module.

The position coordinate determination module can be used to determine the position coordinates of the participating objects in the virtual scene according to the position data.

The virtual scene map data determination module can be used to determine the virtual scene map data according to the virtual scene data and the position coordinates of the participating objects in the virtual scene.

The virtual scene map data sending module is used for sending virtual scene map data to the participating objects.

The virtual scene information interaction device according to the embodiment of the present disclosure may further include: a module for determining the coordinates of an adjusted position and a module for updating virtual scene map data.

The adjustment position coordinate determination module can be used to adjust the position coordinates of the target participating object according to the position adjustment data of the first object in response to the position adjustment instruction for the first object, and obtain the adjusted position coordinates of the target participating object.

The virtual scene map data update module can be configured to update the virtual scene map data according to at least one of the position update frequency and the adjusted position coordinates.

According to the embodiment of the present disclosure, the participating objects may include a target participating object and at least one reference participating object; the virtual scene information interaction apparatus may further include: a voice interaction participating object determination module and a voice stream subscription module.

The voice interaction participant object determination module can be used to determine the voice interaction participant object of the target participant object according to the voice interaction range threshold and the position coordinates of the participant object.

The voice stream subscription module can be used to subscribe the target participant object to the voice stream of the voice interaction participant object.

The virtual scene information interaction apparatus according to the embodiment of the present disclosure may further include: a module for determining an invalid voice interaction participating object and a module for canceling subscription of a voice stream.

The invalid voice interaction participant object determination module may be configured to determine the invalid voice interaction participant object in response to the position coordinates of the voice interaction participant object exceeding the threshold value of the voice interaction range.

The voice stream unsubscription module can be used to unsubscribe the voice stream of the invalid voice interaction participant from the target participant.

The virtual scene information interaction apparatus according to the embodiment of the present disclosure may further include: a relative position data determination module and a target voice stream determination module.

The relative position data determination module can be used for determining the relative position data of the voice interaction participant object relative to the target participant object according to the position coordinates of the target participant object and the position coordinates of the voice interaction participant object.

The target voice stream determination module can be configured to perform at least one of mixing processing and binaural processing on the voice stream of the voice interaction participant according to the relative position data, so as to obtain the target voice stream of the voice interaction participant.

The virtual scene information interaction device according to an embodiment of the present disclosure may further include: an avatar adjustment module, configured to adjust the avatar of the first object in response to an image adjustment operation instruction for the first object, wherein the image adjustment operation The instruction includes at least one of the following: a gender adjustment operation instruction, a clothing adjustment operation instruction, an expression adjustment operation instruction, and a body movement adjustment operation instruction.

According to the virtual scene information interaction device according to the embodiment of the present disclosure, the virtual scene data includes at least one of the following: virtual conference scene data, virtual exhibition hall scene data, and virtual venue scene data; and the target content data includes at least one of the following: voice data, Text data as well as live video data.

It should be understood that the embodiments of the apparatus part of the present disclosure are corresponding to the same or similar to the embodiments of the method part of the present disclosure, and the technical problems solved and the technical effects achieved are also the same or similar.

According to embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.

FIG. 8 shows a schematic block diagram of an example electronic device 800 that may be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. Electronic devices may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are by way of example only, and are not intended to limit implementations of the disclosure described and/or claimed herein.

As shown in FIG. 8 , the device 800 includes a computing unit 801 that can be executed according to a computer program stored in a read only memory (ROM) 802 or a computer program loaded from a storage unit 808 into a random access memory (RAM) 803 Various appropriate actions and handling. In the RAM 803, various programs and data necessary for the operation of the device 800 can also be stored. The computing unit 801 , the ROM 802 , and the RAM 803 are connected to each other through a bus 804 . An input/output (I/O) interface 805 is also connected to bus 804 .

Various components in the device 800 are connected to the I/O interface 805, including: an input unit 806, such as a keyboard, mouse, etc.; an output unit 807, such as various types of displays, speakers, etc.; a storage unit 808, such as a magnetic disk, an optical disk, etc. ; and a communication unit 809, such as a network card, a modem, a wireless communication transceiver, and the like. The communication unit 809 allows the device 800 to exchange information/data with other devices through a computer network such as the Internet and/or various telecommunication networks.

Computing unit 801 may be various general-purpose and/or special-purpose processing components with processing and computing capabilities. Some examples of computing units 801 include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), various specialized artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processing processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 801 executes the various methods and processes described above, such as the virtual scene information interaction method. For example, in some embodiments, the virtual scene information interaction method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 808 . In some embodiments, part or all of the computer program may be loaded and/or installed on device 800 via ROM 802 and/or communication unit 809 . When the computer program is loaded into the RAM 803 and executed by the computing unit 801, one or more steps of the virtual scene information interaction method described above may be performed. Alternatively, in other embodiments, the computing unit 801 may be configured to perform the virtual scene information interaction method in any other suitable manner (eg, by means of firmware).

Various implementations of the systems and techniques described herein above may be implemented in digital electronic circuitry, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips system (SOC), complex programmable logic device (CPLD), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include being implemented in one or more computer programs executable and/or interpretable on a programmable system including at least one programmable processor that The processor, which may be a special purpose or general-purpose programmable processor, may receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device an output device.

Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer or other programmable data processing apparatus, such that the program code, when executed by the processor or controller, performs the functions/functions specified in the flowcharts and/or block diagrams. Action is implemented. The program code may execute entirely on the machine, partly on the machine, partly on the machine and partly on a remote machine as a stand-alone software package or entirely on the remote machine or server.

In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in connection with the instruction execution system, apparatus or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), fiber optics, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.

To provide interaction with a user, the systems and techniques described herein may be implemented on a computer having a display device (eg, a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user ); and a keyboard and pointing device (eg, a mouse or trackball) through which a user can provide input to the computer. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (eg, visual feedback, auditory feedback, or tactile feedback); and can be in any form (including acoustic input, voice input, or tactile input) to receive input from the user.

The systems and techniques described herein may be implemented on a computing system that includes back-end components (eg, as a data server), or a computing system that includes middleware components (eg, an application server), or a computing system that includes front-end components (eg, a user's computer having a graphical user interface or web browser through which a user may interact with implementations of the systems and techniques described herein), or including such backend components, middleware components, Or any combination of front-end components in a computing system. The components of the system may be interconnected by any form or medium of digital data communication (eg, a communication network). Examples of communication networks include: Local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.

A computer system can include clients and servers. Clients and servers are generally remote from each other and usually interact through a communication network. The relationship of client and server arises by computer programs running on the respective computers and having a client-server relationship to each other.

It should be understood that steps may be reordered, added or deleted using the various forms of flow shown above. For example, the steps described in the present disclosure can be executed in parallel, sequentially, or in different orders. As long as the desired results of the technical solutions disclosed in the present disclosure can be achieved, there is no limitation herein.

The above-mentioned specific embodiments do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modifications, equivalent replacements, and improvements made within the spirit and principles of the present disclosure should be included within the protection scope of the present disclosure.

Claims (21)

1. A virtual scene information interaction method comprises the following steps:

responding to a virtual scene access request instruction aiming at a first object, and acquiring basic data of the first object;

according to the basic data, creating an avatar of the first object in a virtual scene to obtain a target participation object corresponding to the first object; and

and responding to a target content playing instruction from the first object, and playing target content in the virtual scene.

2. The method of claim 1, wherein the virtual scene is generated from virtual scene data; the virtual scene data includes virtual playback device data, and the playing back target content in the virtual scene in response to a target content playback instruction from the first object includes:

responding to a target content playing instruction from the first object, and acquiring target content data; and

and playing the target content through virtual playing equipment, wherein the virtual playing equipment is generated according to the virtual playing equipment data, and the target content is generated according to the target content data.

3. The method of claim 1, wherein the virtual scene includes at least one participant object, the base data further including location data; the virtual scene information interaction method further comprises the following steps:

determining the position coordinates of the participating object in the virtual scene according to the position data;

determining virtual scene map data according to the virtual scene data and the position coordinates of the participating objects in the virtual scene; and

sending the virtual scene map data to the participant object.

4. The method of claim 3, further comprising:

responding to a position adjusting instruction for the first object, and adjusting the position coordinate of the target participation object according to position adjusting data of the first object to obtain an adjusted position coordinate of the target participation object; and

and updating the virtual scene map data according to at least one of the position updating frequency and the adjusted position coordinates.

5. The method of claim 4, wherein the participant objects include the target participant object and at least one reference participant object; the virtual scene information interaction method further comprises the following steps:

determining a voice interaction participating object of the target participating object according to a voice interaction range threshold and the position coordinates of the participating object; and

and subscribing the voice stream of the voice interaction participant to the target participant.

6. The method of claim 5, further comprising:

determining an invalid voice interaction engagement object in response to the position coordinates of the voice interaction engagement object exceeding the voice interaction range threshold; and

unsubscribing voice streams of the invalid voice interaction participant from the target participant.

7. The method of claim 3, further comprising:

determining relative position data of the voice interaction participation object relative to the target participation object according to the position coordinates of the target participation object and the position coordinates of the voice interaction participation object; and

and according to the relative position data, performing at least one of sound mixing processing and two-channel processing on the voice stream of the voice interaction participating object to obtain a target voice stream of the voice interaction participating object.

8. The method of any of claims 1-7, further comprising:

adjusting an avatar of the first object in response to an avatar adjustment operation instruction for the first object, wherein the avatar adjustment operation instruction includes at least one of: a sex adjustment operation instruction, a clothing adjustment operation instruction, an expression adjustment operation instruction and a limb action adjustment operation instruction.

9. The method of claim 2, the virtual scene data comprising at least one of: virtual meeting scene data, virtual exhibition hall scene data and virtual venue scene data; the target content data includes at least one of: voice data, text data, and live video data.

10. A virtual scene information interaction device comprises:

the basic data acquisition module is used for responding to a virtual scene access request instruction aiming at a first object and acquiring basic data of the first object;

the target participating object determining module is used for creating an avatar of the first object in a virtual scene according to the basic data to obtain a target participating object corresponding to the first object; and

and the target content playing module is used for responding to a target content playing instruction from the first object and playing the target content in the virtual scene.

11. The apparatus of claim 10, wherein the virtual scene is generated from virtual scene data; the virtual scene data includes virtual playing device data, and the target content playing module includes:

the target content acquisition sub-module is used for responding to a target content playing instruction from the first object and acquiring target content data; and

and the target content playing submodule is used for playing the target content through virtual playing equipment, the virtual playing equipment is generated according to the virtual playing equipment data, and the target content is generated according to the target content data.

12. The apparatus of claim 10, wherein the virtual scene includes at least one participant object, the base data further including location data; the virtual scene information interaction device further comprises:

the position coordinate determination module is used for determining the position coordinates of the participated object in the virtual scene according to the position data;

the virtual scene map data determining module is used for determining virtual scene map data according to the virtual scene data and the position coordinates of the participated object in the virtual scene; and

and the virtual scene map data sending module is used for sending the virtual scene map data to the participating object.

13. The apparatus of claim 12, further comprising:

an adjustment position coordinate determination module, configured to adjust the position coordinate of the target participating object according to position adjustment data of the first object in response to a position adjustment instruction for the first object, to obtain an adjusted position coordinate of the target participating object; and

and the virtual scene map data updating module is used for updating the virtual scene map data according to at least one of the position updating frequency and the adjusted position coordinate.

14. The apparatus of claim 13, wherein the participant objects comprise the target participant object and at least one reference participant object; the virtual scene information interaction device further comprises:

the voice interaction participating object determining module is used for determining a voice interaction participating object of the target participating object according to a voice interaction range threshold and the position coordinates of the participating object; and

and the voice stream subscription module is used for subscribing the voice stream of the voice interaction participating object to the target participating object.

15. The apparatus of claim 14, further comprising:

an invalid voice interaction engagement object determination module for determining an invalid voice interaction engagement object in response to the position coordinates of the voice interaction engagement object exceeding the voice interaction range threshold; and

and the voice stream unsubscribing module is used for unsubscribing the voice stream of the invalid voice interaction participating object from the target participating object.

16. The apparatus of claim 12, further comprising:

a relative position data determination module, configured to determine, according to the position coordinates of the target participating object and the position coordinates of the voice interaction participating object, relative position data of the voice interaction participating object with respect to the target participating object; and

and the target voice stream determining module is used for performing at least one of sound mixing processing and two-channel processing on the voice stream of the voice interaction participating object according to the relative position data to obtain the target voice stream of the voice interaction participating object.

17. The apparatus of any of claims 10-16, further comprising:

an avatar adjustment module, configured to adjust an avatar of the first object in response to an avatar adjustment operation instruction for the first object, wherein the avatar adjustment operation instruction includes at least one of: a gender adjusting operation instruction, a clothing adjusting operation instruction, an expression adjusting operation instruction and a limb action adjusting operation instruction.

18. The apparatus of claim 11, the virtual scene data comprising at least one of: virtual meeting scene data, virtual exhibition hall scene data and virtual venue scene data; the target content data includes at least one of: voice data, text data, and live video data.

19. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-9.

20. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-9.

21. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-9.

Images