CN116484031A - A multimedia interaction method, device, storage medium and equipment - Google Patents

Abstract

The embodiment of the invention discloses a multimedia interaction method, a device, a storage medium and equipment, and can be applied to vehicle-mounted scenes. The method comprises the following steps: displaying target multimedia in a presentation area of a multimedia display interface; generating and publishing associated multimedia in response to the participation operation for the target multimedia; and displaying the associated multimedia associated with the target multimedia in a presentation area of the multimedia display interface, wherein the associated multimedia and the target multimedia form a first associated multimedia group. By the method and the device, the interactivity between the watching object and the release object of the target multimedia can be enhanced.

Description

A multimedia interaction method, device, storage medium and equipment

technical field

The present application relates to the field of video technology, and in particular to a multimedia interaction method, device, storage medium and equipment.

Background technique

With the continuous development of the network, watching multimedia (such as video, image, text) through the network has gradually become an indispensable way for people to obtain information or entertainment in life. At present, it is necessary to generate a template corresponding to the multimedia to realize the interaction with the publishing object of the multimedia. The interaction method is fixed and the interactivity is relatively poor. For example, when the publishing object publishes an original video, a template of the original video needs to be generated, and the viewing object needs to generate an updated video based on the template of the original video, and the attribute information (such as background music, playback length) of the updated video must be the same as that of the original video, and the interaction flexibility is relatively low, which in turn leads to relatively poor interactivity.

Contents of the invention

The technical problem to be solved by the embodiments of the present application is to provide a data processing method, device, storage medium and equipment to enhance the interactivity between viewing objects and publishing objects of target multimedia.

On the one hand, an embodiment of the present application provides a multimedia interaction method, including:

displaying the target multimedia in the presentation area of the multimedia display interface;

In response to the participating operation for the target multimedia, generate and publish associated multimedia;

In the presentation area of the multimedia display interface, associated multimedia associated with the target multimedia is displayed, and the associated multimedia and the target multimedia form a first associated multimedia group.

On the one hand, an embodiment of the present application provides a multimedia interaction device, including:

The first display module is configured to display target multimedia in the presentation area of the multimedia display interface;

A generating module, configured to generate and publish associated multimedia in response to the participation operation for the target multimedia;

The second display module is configured to display associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface, where the associated multimedia and the target multimedia form a first associated multimedia group.

An embodiment of the present application provides a computer device, including: a processor and a memory;

The processor is connected to the memory, wherein the memory is used to store a computer program, and when the computer program is executed by the processor, the computer device executes the method provided by the embodiment of the present application.

An embodiment of the present application provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and the computer program is adapted to be loaded and executed by a processor, so that a computer device having the processor executes the method provided in the embodiment of the present application.

An embodiment of the present application provides a computer program product or computer program, where the computer program product or computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the method provided by the embodiment of the present application.

In the embodiment of the present application, by displaying the target multimedia in the presentation area of the multimedia display interface, when the participating object (that is, the viewing object) interacts with the target multimedia, the computer device can generate and publish associated multimedia in response to the participation operation on the target multimedia. The associated multimedia can include one or more of video, text, image data, voice data, and special effects. Further, the associated multimedia associated with the target multimedia can be displayed in the presentation area of the multimedia display interface, the associated multimedia and the target multimedia form a first associated multimedia group, and the interaction between objects corresponding to the multimedia in the associated multimedia group can be realized. The format and content of the associated multimedia are not limited, and the flexibility of interaction can be improved, and the interaction and interest between the viewing object and the publishing object of the target multimedia can be enhanced.

Description of drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following will briefly introduce the accompanying drawings required in the description of the embodiments or prior art. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other accompanying drawings can also be obtained according to these drawings without creative work.

FIG. 1 is a schematic diagram of the architecture of a multimedia interactive system provided by an embodiment of the present application;

FIG. 2 is a schematic diagram of an application scenario of multimedia interaction provided by an embodiment of the present application;

FIG. 3 is a schematic flowchart of a multimedia interaction method provided by an embodiment of the present application;

FIG. 4 is a schematic diagram of displaying target multimedia in a multimedia display interface provided by an embodiment of the present application;

FIG. 5 is a schematic diagram of a media interaction interface provided by an embodiment of the present application;

FIG. 6 is a schematic diagram of generating associated multimedia provided by an embodiment of the present application;

FIG. 7 is a schematic diagram of displaying associated multimedia provided by an embodiment of the present application;

FIG. 8 is a schematic diagram of displaying associated multimedia provided by an embodiment of the present application;

FIG. 9 is a schematic diagram of displaying associated multimedia provided by an embodiment of the present application;

FIG. 10 is a schematic flowchart of a multimedia interaction method provided by an embodiment of the present application;

Fig. 11 is a schematic diagram of a comment detail information interface provided by the embodiment of the present application;

FIG. 12 is a schematic diagram of a multimedia interaction provided by an embodiment of the present application;

FIG. 13 is a schematic structural diagram of a multimedia interaction device provided by an embodiment of the present application;

Fig. 14 is a schematic structural diagram of a computer device provided by an embodiment of the present application.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

See FIG. 1, which is a schematic structural diagram of a multimedia interactive system provided by an embodiment of the present application. As shown in FIG. 1 , the multimedia interactive system may include a server 10 and a cluster of user terminals. The user terminal cluster may include one or more user terminals, and the number of user terminals will not be limited here. As shown in FIG. 1 , it may specifically include a user terminal 100a, a user terminal 100b, a user terminal 100c, ..., a user terminal 100n. As shown in Fig. 1, user terminal 100a, user terminal 100b, user terminal 100c, ..., user terminal 100n can respectively carry out network connection with above-mentioned server 10, so that each user terminal can carry out data interaction with server 10 through this network connection.

Wherein, each user terminal in the user terminal cluster may include: a smart phone, a tablet computer, a notebook computer, a desktop computer, a wearable device, a smart home, a head-mounted device, a vehicle terminal, and other intelligent terminals with multimedia interaction. It should be understood that each user terminal in the user terminal cluster shown in FIG. 1 can be installed with a target application (ie, an application client), and when the application client runs in each user terminal, it can interact with the server 10 shown in FIG. 1 above.

Wherein, as shown in FIG. 1, the server 10 can be an independent physical server, or a server cluster or a distributed system composed of a plurality of physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.

For ease of understanding, in the embodiment of the present application, one user terminal may be selected as the target user terminal among the multiple user terminals shown in FIG. For example, for ease of understanding, the embodiment of the present application may use the user terminal 100a shown in FIG. 1 as the target user terminal, and the user terminal 100a may obtain the target multimedia pulled from the server 10. The target multimedia may refer to multimedia such as text, images, audio, and video uploaded by any participating object about life, hobbies, and publicity. The user terminal 100a may display (for example, play) the target multimedia in the presentation area of the multimedia display interface of the user terminal 100a, so that the object held by the user terminal 100a or other participating objects can watch it. Furthermore, during the process of watching the target multimedia, the participating objects can perform participating operations on the target multimedia, publish interactive data on the target multimedia, and then interact with the publishing objects of the target multimedia.

Further, the user terminal 100a may respond to the participating object's participating operation with the target multimedia, acquire the interaction data obtained by the participating object's participating operation, and create associated multimedia according to the interactive data. Wherein, the participation operation may refer to a comment operation, a content modification operation, an addition content operation, an update content operation, and the like. After the user terminal 100 a produces associated multimedia associated with the target multimedia, it may publish the associated multimedia and send the associated multimedia to the server 10 . The server 10 may review and store the associated multimedia, generate an access interface corresponding to the associated multimedia, and send the access interface to the user terminal 100a. The user terminal 100a may display the associated multimedia associated with the target multimedia on the multimedia display interface through the associated multimedia access interface, and the associated multimedia and the target multimedia form a first associated multimedia group. In this way, the publishing object of the target multimedia and other participating objects watch and consume (such as watching) the multimedia in the first associated multimedia, that is, when the participating object consumes the target multimedia, it can also consume the associated multimedia associated with the target multimedia in the first associated multimedia group, changing from traditional single multimedia consumption to multiple multimedia consumption. In this way, the display effect of the multimedia can be increased, and the interaction effect between the target multimedia and the associated multimedia can be enhanced, thereby improving the interaction between the participating objects and the publishing objects of the target multimedia.

For ease of understanding, further refer to FIG. 2 , which is a schematic diagram of an application scenario of multimedia interaction provided by an embodiment of the present application. Wherein, the target multimedia may be a target video sent by a participating user, the associated multimedia may be a comment video for commenting on the target video, and the participating operation may refer to a comment operation. The server 20c shown in FIG. 2 may be the server 10 mentioned above. As shown in FIG. 2 , participating object A can watch the target video released by object 1 (the object nickname of object 1 is "*****") in the multimedia display interface 20a displayed by the target user terminal held by it. Wherein, the target user terminal held by participating object A may be any user terminal in the user terminal cluster shown in FIG. 1 above, for example, the target user terminal held by participating object A may be the above-mentioned user terminal 100b. As shown in Figure 2, there is a comment control displayed in the multimedia display interface. When participant A wants to interact with the target video released by object 1, he can click the comment control in the multimedia display interface to trigger the participation operation for the target video. The target user terminal may display the media interaction interface 20b in response to the participating object A's participation operation on the target video in the multimedia display interface. The media interaction interface 20b may include one or at least two comment data acquisition controls, and the comment data acquisition controls refer to controls for acquiring comment data. The comment data acquisition control may be displayed in the media interaction interface in the form of buttons, icons, etc., and the comment data acquisition control may include one or more of voice control, text control, shooting control, and local media data selection control. For example, when participant A needs to input comment data of the video type, it may perform a selection operation on the shooting control in the media interaction interface. Correspondingly, the target user terminal may respond to participant A's selection operation on the shooting control, obtain the shooting video collected based on the shooting control, and determine the captured video as the comment data obtained by participant A's clicking operation on the comment control in the multimedia display interface. The target user terminal can send the comment data to the server 20c, and the server 20c can perform video conversion on the comment data to obtain a comment video (ie associated multimedia) associated with the target video (ie target multimedia), and return the associated multimedia to the target user terminal. The target user terminal may display the object information of the participating object A on the multimedia display interface 20d, such as displaying the avatar icon 20e of the participating object A. Wherein, when the avatar icon 20e of the participating object A is clicked, the comment video posted by the participating object A is displayed. It can be seen that the associated multimedia (ie comment video) is generated in response to the participation operation on the target multimedia, and the associated multimedia associated with the target multimedia is displayed on the multimedia display interface. In this way, in order to comment on the target video by means of video, the video display has a stronger sense of picture and can display more information, which can improve the display effect of the comment data for the target multimedia, and then improve the interactivity of the participating objects with respect to the target multimedia, that is, enhance the interactivity and interest between the viewing object and the publishing object of the target multimedia.

Please refer to FIG. 3 . FIG. 3 is a schematic flowchart of a multimedia interaction method provided by an embodiment of the present application. The multimedia interaction method can be executed by any user terminal in FIG. 1, can also be executed by the server in FIG. 1, and can also be executed jointly by any user terminal and server in FIG. 1, and the devices used to execute the method in this application can be collectively referred to as computer devices. As shown in Figure 3, the multimedia interaction method may include but not limited to the following steps:

S101. Display target multimedia in a presentation area of a multimedia display interface.

Specifically, the computer device can display the target multimedia in the presentation area of the multimedia display interface of the multimedia application program; the multimedia application program can refer to an audio multimedia playback application program, a multimedia live broadcast application program, a short multimedia application program, a social networking application program, a content sharing application program, and the like. The target multimedia may be obtained by editing the video data by the release object, or the target multimedia may be downloaded from the network by the release object; or, the target multimedia may be obtained by shooting by the release object, such as the target multimedia is multimedia data used to record information such as the release object's daily life, travel trajectory, food tutorials, and daily outfits. By displaying the target multimedia on the multimedia display interface, the participating objects corresponding to the computer equipment can watch the target multimedia and comment on the target multimedia. Wherein, the multimedia display interface includes a presentation area, a participating object area, an editing control area associated with the target multimedia, and the like.

Optionally, the computer device may carry the original multimedia and the associated multimedia related to the original multimedia in the form of an associated multimedia group, that is, carry multimedia located in the same associated multimedia group in the first direction of the page view, and carry multimedia located in different associated multimedia groups in the second direction of the page view. An associated multimedia group includes an original multimedia and associated multimedia with the original multimedia. The original multimedia can refer to the multimedia data uploaded by the publishing object to the multimedia application program. The associated multimedia associated with the original multimedia refers to the multimedia data obtained by the participating object for the participation operation of the original multimedia. The target multimedia belongs to the original multimedia in any associated multimedia group. The first direction may be horizontal or vertical, and the second direction is perpendicular to the first direction. For example, when the first direction is horizontal, the second direction is vertical; when the first direction is vertical, the second direction is horizontal. The computer device can display the target multimedia in the presentation area of the multimedia display interface in the manner of associating the multimedia group; specifically, the target multimedia belongs to the first multimedia group, and the computer device can display the target multimedia in any one of the following three ways or a combination of at least two ways:

Display mode 1: The computer device displays the target multimedia in the first associated multimedia group in the presentation area of the multimedia display interface, plays the target multimedia, and plays the target multimedia in a loop when the target multimedia is played.

In the second display mode, the computer device displays the target multimedia in the first associated multimedia group in the presentation area of the multimedia display interface, and plays the target multimedia. When the target multimedia is played, it can display and play the associated multimedia in the first associated multimedia group in sequence according to the multimedia attribute information of the associated multimedia.

In the third display mode, the computer device displays the multimedia in the second associated multimedia group in the page view on the presentation area of the multimedia display interface, and displays the target multimedia in the first associated multimedia group on the multimedia display interface in response to a trigger operation in the second direction for the multimedia in the second associated multimedia group. The first associated multimedia group refers to the associated multimedia group whose display order is located after the display order of the second associated multimedia group in the page view, and the display order of the associated multimedia group may be determined according to one or more of the generation time of the original multimedia in the associated multimedia group, the generation time of the associated multimedia, and the degree of association of the participating objects corresponding to the computer equipment.

The computer device can also display the object information of the publishing object of the target multimedia and the multimedia attribute information of the target multimedia on the presentation area of the multimedia display interface. The object information of the publishing object includes the avatar, name, etc. of the publishing object, and the multimedia attribute information of the target multimedia includes the release time of the target multimedia, and the operation controls of the target multimedia. The operation controls include comment controls, collection controls, like controls, etc. When the target multimedia has associated multimedia, the computer device can also display object information of the target participating object on the multimedia display interface. The target participating object refers to an associated multimedia object that triggers a participation operation for the target multimedia and is associated with the target multimedia. The object information of the target participating object includes the avatar of the target participating object and the name of the target participating object.

As shown in Figure 4, Figure 4 is a schematic diagram of displaying target multimedia in a multimedia display interface provided by the embodiment of the present application. As shown in Figure 4, the target multimedia can refer to the target video released by object 1, and the associated multimedia associated with the target multimedia can refer to the comment video used to comment on the target video. When the participating object triggers the target multimedia playback operation, the computer device can display the target video 40a in the presentation area of the multimedia display interface. The target video 40a is a video in which the object 1 releases information about life and publicity. The computer device can display the object information corresponding to the object 1 in the multimedia display interface. As shown in FIG. 4 , the object avatar and the object nickname 40b of the object 1 are displayed in the multimedia display interface. As shown in FIG. 4 , a participating object area 40c is also displayed in the multimedia display interface, which includes the publishing object 1 publishing the target video 40a, and the target participating objects that have implemented the participating operation for the target video 40a, i.e. object 2 and object 3. The display order of the object information of the target participating objects can be determined by the publishing time of the corresponding comment video. As shown in Figure 4, for the participation operation of target video can refer to comment operation, can also display comment control 40d in the multimedia display interface, when participating object can by implementing the trigger operation for this comment control 40d (as when clicking this comment control), publish the comment video that is used for commenting on target video. As shown in Figure 4, the "dislike" control can also be displayed in the multimedia display interface. When the participant clicks the "dislike" control, the computer device will not recommend the target video to the participant, and will not recommend the same type of video to the participant. As shown in Figure 4, there is also a "heartbeat" control displayed in the multimedia display interface. When the participant clicks on the "heartbeat" control, the computer device can add the corresponding target video to the participant's heartbeat video collection, and recommend the same type of video to the participant. Wherein, a "favorite control" is also displayed in the multimedia display interface, and when the participant clicks the "favorite" control, the computer device can add the corresponding target video to the video collection collection of the participant. The "Home" control should be displayed in the multimedia display interface. When the participant clicks the "Home" control, the computer device can jump to the "Home" interface. The "My" control is also displayed on the multimedia display interface, and when the participant clicks the "My" control, the computer device can switch to the "My" interface.

S102. In response to the participating operation on the target multimedia, generate and publish associated multimedia.

Specifically, when the participating object browses the target multimedia on the multimedia display interface, it can implement a participating operation for the target multimedia, input multimedia data, and interact with the publishing object of the target multimedia. The computer device may respond to the participating object's participating operation on the target multimedia, acquire multimedia data input by the participating object, and generate associated multimedia according to the multimedia data. In addition, the publishing object of the target multimedia can also implement the participating operation for the target multimedia, and generate associated multimedia associated with the target multimedia. When the publishing object implements the participating operation for the target multimedia, the publishing object can be used as the target participating object.

Wherein, the target multimedia may refer to the target voice data, and the generated associated multimedia may refer to the associated voice data. In this way, the computer device obtains the participating operation of the target participant for the target multimedia, and after the input multimedia data, the multimedia data may be converted into associated voice data. The first voice association group is formed according to the target voice data and the associated voice data, so that a single voice consumption becomes multiple voice consumptions, which facilitates the information interaction between the participating objects and the publishing objects, thereby improving the interaction between the participating objects and the publishing objects. Wherein, the associated multimedia generated may refer to an associated video, so that the computer device obtains the participation operation of the target participant for the target multimedia, and after the input multimedia data, the multimedia data can be converted into associated video, forming a new interactive method of replying to the video using the video, which can improve the display effect of the associated multimedia of the target multimedia, facilitate the information interaction between the participating object and the publishing object, and then improve the interaction between the participating object and the publishing object.

Optionally, the above-mentioned participation operation for the target multimedia may refer to: a participation operation directly for the target multimedia, or a participation operation for the historical associated multimedia of the target multimedia, where the historical associated multimedia may refer to the associated multimedia before the computer device displays the target multimedia. For example, the publishing object of the target multimedia is object A, the target participation object corresponding to the history-related multimedia of the target multimedia is object B, and the participation object corresponding to the computer device is object C. When object C can perform a participation operation on the history-related multimedia, the participation operation performed by object C on the history-related multimedia can be called a participation operation for the target multimedia. Further, the comment data obtained by object C's participation operation on the history-related multimedia can be called comment data for the target multimedia.

Optionally, the participation operation for the target multimedia may refer to a comment operation, and the multimedia display interface may include a comment control. When the participant needs to comment on the target multimedia, the participant may trigger the comment control in the multimedia display interface to implement the participation operation for the target multimedia. Optionally, when the participating object needs to comment on the target multimedia, the participating object can also perform a participating operation on the target multimedia by evoking a specific sentence. Certainly, the participating object also triggers the participating operation for the target multimedia in other ways, which is not limited in this embodiment of the present application.

Optionally, after the target participant triggers a participation operation for the target multimedia, comment data associated with the multimedia may be generated in the form of video, local media data, voice, and text. Wherein, when a participating object triggers a participating operation for the target multimedia, the participating object that triggers the participating operation may be used as the target participating object.

Optionally, the target participant can generate associated multimedia in the form of shooting video. The computer device responds to the participation operation for the target multimedia, and the specific method for producing and publishing the associated multimedia may include: in response to the participation operation for the target multimedia, displaying the shooting control on the media interaction interface; in response to the selection operation for the shooting control, acquiring the shooting multimedia obtained by shooting based on the shooting control. Generate associated multimedia including the captured video, and publish the associated multimedia including the captured video.

Specifically, when the participating object triggers the participating operation for the target multimedia, the computer device can respond to the participating operation for the target multimedia operation, and display shooting controls on the media interaction interface, and the computer device can also display other acquisition controls (such as voice controls, text controls, etc.) in the media interaction interface. The target participant can implement the selection operation for the shooting control. For example, the participant can click the shooting control on the media interaction interface to trigger the shooting operation for the comment data. The computer device can respond to the selection operation of the shooting control by the target participant, display the data collection interface corresponding to the shooting control, obtain the shooting video captured by the shooting control, and display the shooting video on the data collection interface corresponding to the shooting control. When the computer device detects that the shooting is finished, it generates associated multimedia including the captured video, for example, determines the captured video obtained by shooting as associated multimedia, and publishes the associated multimedia including the captured video. Wherein, when the target participant selects the shooting control, the computer device turns on the front camera by default, and displays the face-kini covering props to protect the privacy of the target participant. Certainly, the target participating object can trigger the operation of closing the face-kini covering prop to turn off the face-kini covering prop. In addition, when the target participants are shooting, they can choose to turn on functions such as beauty, focus and brightness adjustment, which can improve the convenience and experience of users recording comment data.

Optionally, the specific manner for the computer device to generate associated multimedia including the captured video may include: acquiring video description information matching the captured video, adding the video description information to the captured video, and obtaining associated multimedia including the captured video.

Specifically, the computer device may obtain video description information matching the shot video, where the video description information refers to multimedia theme text, background music, and the like. Wherein, the computer device can perform image recognition on the captured video to obtain the video theme corresponding to the captured video. Further, the computer device can obtain the target video theme text corresponding to the shooting video from the theme text library according to the video theme, and obtain the target time background music corresponding to the spliced image data from the background music library. Further, add video description information (namely target video subject text and target background music) to the captured video to obtain associated multimedia including the captured video.

Optionally, when the computer device detects that the target participating object continues to press the shooting control, it starts shooting, and displays the captured video in the data collection area corresponding to the shooting control. When the computer device detects that the target participating object releases the shooting control, it stops shooting, and determines the shooting video obtained by shooting as associated multimedia.

Optionally, the shooting control may include a shooting start control and a shooting end control. When the target participant implements a trigger operation on the start shooting control, the computer device may respond to the target participant's opening operation on the start shooting control, and display the shooting video obtained by shooting in the data collection interface corresponding to the shooting control. When the target participating object implements the trigger operation on the end shooting control, the computer device may respond to the target participant's trigger operation on the end shooting control, acquire the shooting video obtained based on the shooting control, and determine the shooting video obtained based on the shooting control as associated multimedia.

Optionally, the target participant can generate associated multimedia in the form of speech. The computer device responds to the participation operation for the target multimedia, and the specific method for producing and publishing the associated multimedia may include: in response to the participation operation for the target multimedia, displaying the voice control on the media interaction interface; in response to the selection operation for the voice control, acquiring the input voice data obtained based on the input of the voice control, generating the associated multimedia including the input voice data, and releasing the associated multimedia including the input voice data.

Specifically, the computer device can respond to the participation operation for the target multimedia, display voice controls on the media interaction interface, and can also display other collection controls (such as shooting controls), and the target participant can choose to use the voice control to collect comment data for the target multimedia. The computer device can respond to the selection operation for the voice control, display the data collection interface corresponding to the voice control, and enable the recording function, collect the input voice data input by the target participant, and generate associated multimedia including the input voice data, such as determining the input voice data based on the voice control as associated multimedia, and publishing the associated multimedia including the input voice data.

Optionally, when the computer device detects the continuous pressing operation of the target participant on the voice control, the input voice data input by the target participant is continuously collected. When the computer device detects that the target participant object ends pressing on the voice control, it stops collecting the input voice data input by the target participant object, and determines the input voice data obtained based on the voice control input as associated multimedia.

Optionally, the voice control may also include a voice start control and a voice end control. When the target participant triggers the voice start control, the input voice data input by the target participant starts to be collected. When the target participant triggers the voice end control, the collection of the input voice data input by the target participant is stopped, and the collected input voice data is determined as associated multimedia.

Optionally, the specific manner in which the computer device generates the associated multimedia including the input voice data may include: performing text conversion processing on the input voice data to obtain converted text data; generating a first text background image according to the converted text data; synthesizing the input voice data and the first text background image to obtain associated multimedia for commenting on the target multimedia.

Specifically, after the computer device acquires the input speech data input by the target participant, it may perform text conversion processing on the input speech data to obtain corresponding converted text data in the input speech data. Further, the computer device may add the converted text data to the initial image to obtain the first text background image corresponding to the converted text data, and the initial image may refer to a blank image or an image with background color or pattern added. Further, the computer device may use the first text background image as the background image to synthesize the input voice data to obtain initial associated multimedia, and generate associated multimedia including the input voice data according to the initial associated multimedia.

Optionally, the target participant may generate associated multimedia in the form of local media data selection. The computer device responds to the participation operation for the target multimedia, and the specific method for producing and publishing the associated multimedia may include: in response to the participation operation for the target multimedia, displaying the local media data selection control on the media interaction interface; in response to the selection operation for the local media data selection control, acquiring the local media data selected based on the local media data selection control, generating the associated multimedia including the local media data, and publishing the associated multimedia including the local media data.

Specifically, the computer device may display local media data selection controls on the media interaction interface in response to the participating operation for the target multimedia, and may also display other collection controls (such as shooting controls, voice controls, etc.). Further, the target participant can select any collection control displayed in the media interaction interface to collect comment data. When the target participant selects the local media data selection control, the computer device may output the local media data stored in the user terminal held by the target participant object in response to the target participant's selection operation on the local media data selection control. The target participating object can select local media data for interacting with the target multimedia from among the local media data stored in the user terminal held by it. The computer device may respond to the selection operation of the local media data by the target participating object, acquire the local media data obtained by multiple selection based on the local media data selection control, generate associated multimedia including the local media data according to the local media data, such as determining the local media data obtained based on the local media data selection control as the associated multimedia including the local media data, and publish the associated multimedia including the local media data.

Optionally, the local media data includes at least two pieces of image data, and generating the associated multimedia including the local media data may refer to associated video, and after the computer device obtains at least two pieces of image data selected by the target participants, it may splice the at least two pieces of image data to obtain spliced image data. Further, the computer device may acquire image description information matching the spliced image data, and the image description information refers to image subject text, background music, and the like. Wherein, the computer device can perform image recognition on the stitched image data to obtain the target theme corresponding to the stitched image data. Further, according to the target theme, the computer device can obtain the target theme text corresponding to the spliced image data from the theme text library, and obtain the target background music corresponding to the spliced image data from the background music library. Further, the computer device may perform video conversion on the mosaic image data to obtain a mosaic video, and add target theme text and target background music to the mosaic video to generate an initial associated video, and determine to generate an associated video including the local media data according to the initial associated video. Optionally, in order to ensure the quality of the generated associated video, the number of at least two pieces of image data may be limited to be less than or equal to the target number threshold. The target number threshold may be determined according to the device attribute information of the terminal device or the video viewing effect, or may be set according to specific circumstances, which is not limited in this application. For example, if the video viewing effect is better when the duration of the associated video does not exceed 30s, then the video duration of each piece of image data can be determined according to the duration of 30s, and the target quantity threshold can be determined according to the video duration of each piece of image data.

Optionally, the local media data includes at least two pieces of image data, and generating associated multimedia including the local media data may refer to associated videos. After the computer device obtains at least two pieces of image data selected by the target participant, it can convert each piece of image data in the at least two pieces of image data into a video whose duration is the target number of seconds (such as 3 seconds). The computer device splices the video corresponding to each piece of image data to obtain an initial associated video, and determines to generate an associated video including the local media data according to the initial associated video.

Optionally, the local media data includes local multimedia data, and when the target participant selects local multimedia data, the computer device may detect whether the local multimedia data selected by the target participant satisfies the target condition. If the computer device detects that the local multimedia data does not meet the target condition, the local multimedia data is adjusted according to the target condition, the local multimedia data is adjusted to a standard multimedia meeting the target condition, and the standard multimedia is determined as the initial associated multimedia, and the initial associated multimedia is determined as the associated multimedia.

Specifically, when the associated multimedia is video or audio, the target condition may be to meet the target duration. Wherein, the computer device can detect whether the multimedia duration of the local multimedia data selected by the target participant meets the target duration, and if the local multimedia data selected by the target participant does not meet the target duration, then adjust the local multimedia data selected by the target participant to adjust the local multimedia to the initial associated multimedia that meets the target duration. For example, when the associated multimedia is video and the target duration is 3 seconds to 30 seconds, if the local multimedia data selected by the target participant is 40 seconds, then output prompt information to prompt adjustment of the local multimedia data and obtain the adjusted local multimedia data. Alternatively, the computer device may detect the multimedia quality of the multimedia frames of the local multimedia data, delete the multimedia frames whose multimedia quality does not meet the standard, and adjust the local multimedia data to the initial associated multimedia meeting the target duration.

Specifically, when the associated multimedia is video, the target condition may be to satisfy the target resolution. Wherein, the computer device may detect whether the multimedia resolution of the local multimedia data selected by the target participant meets the target resolution, and if the multimedia resolution of the local multimedia data selected by the target participant does not meet the target resolution, then adjust the local multimedia data to the initial associated multimedia meeting the target resolution. For example, the target resolution is 1080P*1080P, if the multimedia resolution of the local multimedia data selected by the target participant does not meet the target resolution (such as greater or smaller than the target resolution), then the multimedia resolution of the local multimedia data is adjusted, and the local multimedia data is adjusted to meet the initial associated video of the target resolution.

Specifically, when the associated multimedia is video, the target condition may be to meet the target multimedia frame rate. Wherein, the computer device can detect whether the multimedia resolution of the local multimedia data selected by the target participant meets the target multimedia frame rate, and if the multimedia frame rate of the local multimedia data selected by the target participant does not meet the target multimedia frame rate, then adjust the local multimedia data to the initial associated multimedia that meets the target multimedia frame rate. For example, if the target resolution is 30 frames, if the multimedia frame rate of the local multimedia data selected by the target participating object does not meet the target multimedia frame rate (such as greater than or less than the target multimedia frame rate), the multimedia frame rate of the local multimedia data is adjusted, and the local multimedia data is adjusted to the associated multimedia.

Optionally, the target participant can generate associated multimedia in the form of text input. The computer device may respond to the participation operation for the target multimedia, and the specific manner of producing and publishing the associated multimedia may include: in response to the participation operation for the target multimedia, displaying a text input control on the media interaction interface; in response to the selection operation for the text input control, acquiring input text data obtained based on the input of the text input control, generating associated multimedia including the input text data, and publishing the associated multimedia including the input text data.

Specifically, the computer device may display a text input control on the media interaction interface in response to the participation operation for the target multimedia, and may also display other collection controls. When the target participant selects the text input control in the media interaction interface, the computer device may input the text input box in response to the selection operation on the text input control. The target participating object can input text data in the text input box, and when the input of the target participating object is completed, the computer device can obtain the input text data obtained based on the input of the text input control, and determine the input text data as the associated multimedia including the input text data, and publish the associated multimedia including the input text data.

Optionally, after the computer device obtains the input text data input by the target participant, the specific manner of generating the associated multimedia including the input text data may include: performing voice conversion processing on the input text data, obtaining the converted voice data and generating a second text background image according to the input text data; synthesizing the converted voice data and the second text background image to obtain the associated multimedia including the input text data.

Specifically, the computer device may perform speech conversion processing on the input text data to obtain converted speech data corresponding to the input text data, and add the input text data to an initial image to obtain a second text background image corresponding to the input text data. The initial image may refer to a blank image or an image with a background color or pattern added. Further, the computer device may determine the second text background image as the background image, synthesize it with the converted voice data to obtain initial associated multimedia, and generate associated multimedia including the input text data according to the initial associated multimedia.

Optionally, the computer device may respond to the participation operation for the target multimedia, pull the media interaction interface, overlay the media interaction interface on the multimedia display interface currently displaying the target multimedia, and display one or more collection controls among controls such as shooting controls, voice controls, text controls, and local media data selection controls on the media interaction interface. The target participating object can select a target collection control (any one of multiple collection controls such as shooting control and voice control) from the one or more collection controls, and the computer device can respond to the selection operation for the target collection control, output the data collection area corresponding to the target collection control selected by the selection operation, and display the collected multimedia data in the data collection area corresponding to the target collection control. When the collection ends, generate associated multimedia according to the multimedia data collected in the data collection area corresponding to the target collection control.

Optionally, the computer device may respond to the participation operation on the target multimedia, quickly pull up the comment publishing interface, switch the multimedia display interface currently displaying the target multimedia, and display the media interaction interface. The computer device can have one or more acquisition controls such as shooting controls, voice controls, text controls, and local media data selection controls in the media interaction interface. The target participating object can select a target collection control (any one of multiple collection controls such as shooting control and voice control) among the plurality of collection controls, and the computer device can respond to the selection operation for the target collection control, display the data collection area corresponding to the target collection control, and display the collected comment data in the data collection area corresponding to the target collection control. When the collection ends, the associated multimedia is generated according to the multimedia data collected in the data collection area corresponding to the target collection control.

Optionally, the specific method for the computer device to generate the associated multimedia according to the initial associated multimedia may include: displaying the initial multimedia data in the media interaction interface, and displaying the edited associated multimedia obtained based on the editing operation in response to the editing operation for the initial associated multimedia; in response to the trigger operation for publishing controls in the media interactive interface, determining the edited associated multimedia displayed in the media interaction interface as associated multimedia.

Specifically, the computer device can display the initial associated multimedia in the media interaction interface, and the target participants can edit the initial associated multimedia, such as adding text to the initial associated multimedia, adding patterns to the initial associated multimedia, adding background music to the initial associated multimedia, zooming the initial associated multimedia and other editing operations. The computer device may respond to the editing operation of the target participating object on the initial associated multimedia, update the initial associated multimedia based on the editing operation, and display the edited associated multimedia obtained based on the editing operation. For example, after the target participants add target text to the initial associated multimedia, the computer device can display the edited associated multimedia after adding the target text. In this way, the target participant can customize the initial associated multimedia, and at the same time increase the display effect of the associated multimedia, thereby improving the interactivity of the associated multimedia. When the target participant finishes editing, the release control in the media interaction interface can be triggered, and the computer device can determine the currently displayed edit-associated multimedia in the media interaction interface as the associated multimedia in response to the target participant's trigger operation on the release control.

As shown in FIG. 5, FIG. 5 is a schematic diagram of a media interaction interface provided by the embodiment of the present application. As shown in FIG. 5, the target multimedia may refer to the target video, and the associated multimedia associated with the target multimedia may refer to the comment video used to comment on the target video, and the participation operation for the target multimedia may refer to a comment operation. As shown in FIG. 5 , when the participating objects watch the target video 50b in the multimedia display interface 50a and want to publish comment data on the target video 50b, they can implement the participation operation on the target video 50b. As shown in Figure 5, the participating object can click the comment control 50c in the multimedia display interface 50a, and the computer device can respond to the trigger operation of the participating object on the comment control 50, determine the participating object sending the participating operation for the target video as the target participating object, and switch the multimedia display interface 50a to the media interaction interface 50d. As shown in Figure 5, the media interaction interface displays a "photo album" control, a "shooting" control, a "voice" control, and a "text" control. When the participant clicks on the "shooting" control, the computer device can display the data collection interface corresponding to the "shooting" control. As shown in FIG. 5 , when the computer device detects that the target participant continuously presses the video shooting control 50e, video shooting is performed, and the video data obtained from the shooting is displayed on the data collection interface corresponding to the "shooting" control. When the computer room equipment detects that the target participant releases the video shooting control 50e, the shooting is stopped, and the shooting video obtained by shooting is determined as a commentary video for commenting on the target video 50b.

As shown in FIG. 6, FIG. 6 is a schematic diagram of generating associated multimedia provided by an embodiment of the present application. As shown in FIG. 6, the target multimedia may refer to a target video, and the associated multimedia associated with the target multimedia may refer to a comment video for commenting on the target video, and the participation operation for the target multimedia may refer to a comment operation. When a participating object triggers a participating operation for the target multimedia, the computer device may respond to the participating operation triggered by the participating object, determine the participating object that triggers the participating operation as the target participating object, and display the media interaction interface. The media interaction interface may include a text control (ie, a text control), an album control (ie, a local media data selection control), a shooting control, and a voice control. The target participant can select the text control, and the computer device can acquire the input text data acquired based on the text control in response to the target participant's selection operation on the text control. Furthermore, the computer device can perform video conversion on the input text data to obtain the initial comment video.

Optionally, the target participant object may also select the photo album control, and the computer device may acquire the local media data obtained based on the photo album control in response to the target participant object's selection operation on the photo album control. Further, the computer device can perform video conversion on the local media data to obtain the initial comment video. Optionally, the target participant can also select the shooting control, and the computer device can respond to the target participant's selection operation on the shooting control, obtain the shooting video shot based on the shooting control, and determine the shooting video obtained by shooting as the initial comment video. Optionally, the target participant can also select the voice control, and the computer device can acquire input voice data obtained based on the voice control in response to the target participant's selection operation on the voice control. Further, the computer device can perform video conversion on the input voice data to obtain the initial commentary video. The target participant can edit the initial review video, and the computer device can respond to the target participant's editing operation on the initial review video to obtain an edited initial review video, and determine the edited initial review video as a review video for commenting on the target video.

S103. Display associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface.

Specifically, the computer device may display associated multimedia associated with the target multimedia on the presentation area of the multimedia display interface. Wherein, the computer device may display associated multimedia associated with the target multimedia on the presentation area of the multimedia display interface including the target multimedia. That is to say, the target multimedia and the associated multimedia of the target multimedia are simultaneously displayed on the presentation area of the multimedia display interface, which is beneficial for the target participants to compare the target multimedia and the associated multimedia. Alternatively, the computer device may update and display the target multimedia displayed on the presentation area of the multimedia display interface as associated multimedia, that is, only display the associated multimedia of the target multimedia on the multimedia display interface, which is beneficial for the target participant to view the interaction effect for the target multimedia.

Optionally, when the number of associated multimedia associated with the target multimedia is at least two, the computer device may display the associated multimedia belonging to the target participating object on the multimedia display interface, or the computer device may display at least two associated multimedia of the target multimedia in a scrolling display mode, such as displaying P first associated multimedia of the target multimedia at the first time, and displaying P second associated multimedia of the target multimedia at the second time, where P is a positive integer greater than or equal to 1, and the associated multimedia belonging to the target object belongs to the first associated multimedia or the second associated multimedia. Alternatively, the computer device may simultaneously display the associated multimedia of the target multimedia (ie, the abbreviated multimedia obtained by shrinking the associated multimedia) on the multimedia display interface.

Specifically, when the target participant implements a trigger operation for publishing controls in the media interaction interface, the computer device can obtain the currently displayed editing-associated multimedia in the media interaction interface, determine the currently displayed editing-associated multimedia as associated multimedia, and publish the associated multimedia. Further, the computer device can perform page switching, switch the media interaction interface to a multimedia display interface, and display associated multimedia in the multimedia display interface, the associated multimedia is generated based on the multimedia data input by the target participant's participation operation. It can be seen that when the participating object watches the target multimedia released by the publishing object, it can generate multimedia data in the form of video, image, text, voice, etc., and the computer device can generate associated multimedia according to the multimedia data, form a multimedia group with the target multimedia, and send it to the recommendation stream in the form of combination. In this way, when the participating objects watch the target multimedia, they can slide the target multimedia in the first direction to view the associated multimedia corresponding to the target multimedia, which can improve the interaction between the participating objects and the publishing objects. At the same time, the participating objects are changed from watching a single target multimedia to watching in various multimedia groups (ie, a combination of the target multimedia and its corresponding associated multimedia), which can improve the experience of the participating objects watching multimedia. Here, the first direction may refer to the first direction of the above-mentioned page view.

Optionally, the computer device may display associated multimedia by responding to a trigger operation on the object information. In the multimedia display interface, the computer device displays the associated multimedia for commenting on the target multimedia. The specific manner may include: displaying in the multimedia display interface the object information of the target participating object corresponding to the participating operation; in response to the first operation on the object information of the target participating object, updating and displaying the target multimedia on the multimedia display interface as associated multimedia belonging to the target participating object; the associated multimedia belonging to the target participating object is produced according to the participating operation of the target participating object on the target multimedia.

Specifically, the computer device may display the object information of the target participating object corresponding to the participating operation on the multimedia display interface, and the object information may refer to any one or more of information such as user avatar, user ID, user nickname, and user identification. When the target participating object, publishing object or other participating objects click on the object information of the target participating object, the computer device may respond to the first operation on the object information of the target participating object, and update the currently displayed target multimedia on the multimedia display interface to the associated multimedia belonging to the target participating object, that is, the associated multimedia belonging to the target participating object is produced according to the participating operation of the target participating object on the target multimedia. Wherein, the multimedia display interface includes a participating object area, and the participating object area includes object information arranged in order of publishing time. The first object identifier in the participant object area is the object information of the target multimedia release object, and the other object information is arranged according to the order of participation time. At the same time, the arrangement order of the object information can be the automatic play sequence of the associated multimedia released by the corresponding target participant object. It can be understood that the participating objects and publishing objects can arbitrarily click on the object information in the participating object area, and the computer device can respond to the trigger operation of the participating objects to display the associated multimedia corresponding to the object information clicked by the participating objects. In this way, participants can click on the object information in the participant object area at will to view the associated multimedia of the corresponding object information, which can improve the flexibility of the participants in viewing multimedia, and further improve the experience of the participants watching the associated multimedia.

Optionally, the specific manner in which the computer device displays the associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface may include: in response to the second operation in the first direction on the target multimedia in the presentation area, updating and displaying the target multimedia presented in the presentation area as the associated multimedia associated with the target multimedia; or, after the target multimedia is played, displaying the associated multimedia associated with the target multimedia in the presentation area.

Specifically, the computer device may update and display the target multimedia presented in the presentation area as associated multimedia associated with the target multimedia in response to the second operation in the first direction on the target multimedia in the presentation area. Wherein, the first direction may refer to portrait or landscape orientation, and the second operation may refer to a sliding operation or a clicking operation. For example, the computer device may update and display the target multimedia presented in the presentation area as associated multimedia associated with the target multimedia in response to a left slide operation on the target multimedia in the presentation area in a horizontal direction. Optionally, the computer device may display associated multimedia associated with the target multimedia in the presentation area after the target multimedia is played.

Optionally, the specific manner in which the computer device displays associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface may include: displaying identification information of the target multimedia and associated multimedia in the presentation area of the multimedia display interface in a preset order.

Specifically, the computer device may acquire multimedia attribute information corresponding to the target multimedia and associated multimedia respectively. The multimedia attribute information may refer to a generation time or a release time, and may also include a management sequence of publishing object settings, such as setting the associated multimedia corresponding to a certain target participating object to the top (i.e., ranked first), etc., and determine the preset sequence of the target multimedia and associated multimedia according to the multimedia attribute information. Displaying the identification information of the target multimedia and associated multimedia in the presentation area of the multimedia display interface in a preset order.

Optionally, the specific manner in which the computer device displays the identification information of the target multimedia and associated multimedia in the presentation area of the multimedia display interface in a preset order may include: arranging and displaying the identification information of the target multimedia and associated multimedia in the presentation area of the multimedia interface in sequence according to the time sequence of generation.

Optionally, the number of associated multimedia is M, where M is a positive integer greater than or equal to 2, and the M associated multimedia includes associated multimedia belonging to the target participating object. In the multimedia display interface of the computer device, displaying the object information of the target participating objects corresponding to the participating operation includes: determining the display order of the M associated multimedia according to the multimedia attribute information of the M associated multimedia; according to the display order of the M associated multimedia, arranging and displaying the object information of the target participating objects of the M associated multimedia in the multimedia display interface; the objects corresponding to the M associated multimedia include the target participating object.

Specifically, the number of associated multimedia is M, and the M associated multimedia includes the associated multimedia belonging to the target participating object, that is, the number of associated multimedia used to comment on the target multimedia is multiple, and the computer device can obtain the multimedia attribute information corresponding to the M associated multimedia respectively. Further, the computer device may determine the display order corresponding to the M associated multimedia according to the multimedia attribute information respectively corresponding to the M associated multimedia. Wherein, the computer device may determine the generation time sequence of each associated multimedia as the display sequence corresponding to each associated multimedia. Wherein, the computer device may determine the sequence of release time of each associated multimedia as the display sequence corresponding to each associated multimedia. Wherein, the computer device can determine the display sequence of each associated multimedia in combination with the publishing time and management sequence of each associated multimedia. Further, the computer device may arrange and display the object information of the target participating objects respectively corresponding to the M associated multimedia in the multimedia display interface according to the display sequence corresponding to the M associated multimedia. Wherein, the objects corresponding to the M associated multimedia include target participating objects.

As shown in FIG. 7, FIG. 7 is a schematic diagram of displaying associated multimedia provided by the embodiment of the present application. As shown in FIG. 7, when the participating object watches the target multimedia 70b in the multimedia display interface 70a, and wants object 4 to associate multimedia with the target multimedia 70b, you can click on the avatar of the object 4 in the participating object area in the multimedia display interface 70a. The computer device can respond to the click operation of the participating object on the avatar of the object 4 in the participating object area in the multimedia display interface 70a, acquire the associated multimedia of the object 4 for the target multimedia, switch the multimedia display interface 70a to the multimedia display interface 70c, update and display the target multimedia 70b in the multimedia display interface 70a as the associated multimedia corresponding to the object 4. Wherein, the display sequence of the avatar icons respectively corresponding to Object 1, Object 2, Object 3, and Object 4 in the multimedia display interface 70a may be determined by the order of release time of the corresponding associated multimedia. In this way, the participants can arbitrarily select the comment data of the target participants they want to view, which can improve the convenience and experience of the participants watching multimedia.

Optionally, the computer device may display the associated multimedia by responding to the second trigger operation in the first direction for the target multimedia. In the multimedia display interface, the computer device displays the associated multimedia for commenting on the target multimedia may include: in response to the second operation in the first direction on the target multimedia in the multimedia display interface, updating and displaying the target multimedia on the multimedia display interface as associated multimedia for commenting on the target multimedia.

Specifically, when the target participating object, publishing object or other participating objects browse the multimedia group corresponding to the target multimedia on the multimedia display interface, by implementing the second operation on the target multimedia in the first direction, such as sliding the target multimedia to the right, sliding to the left, sliding down or sliding up, the computer device can update and display the target multimedia displayed on the multimedia display interface as associated multimedia for commenting on the target multimedia. For example, when a target participating object, publishing object or other participating objects slides the target multimedia to the left on the multimedia display interface, the computer device may obtain the associated multimedia corresponding to the target multimedia, and display the associated multimedia of the target multimedia. In this way, the participants can slide the target multimedia and the associated multimedia of the target multimedia in the first direction to view the multimedia they want to watch, which can improve the experience of the participants watching multimedia.

Optionally, the number of associated multimedia is M, and M is a positive integer greater than or equal to 2. In response to the second operation in the first direction on the target multimedia in the multimedia display interface, the computer device updates and displays the target multimedia on the multimedia display interface as associated multimedia for commenting on the target multimedia may include: determining the display order of the M associated multimedia according to the multimedia attribute information of the M associated multimedia. The target associated multimedia with the earliest display sequence is determined from the M associated multimedia. In response to a second trigger operation in the first direction on the target multimedia in the multimedia display interface, the target multimedia on the multimedia display interface is updated and displayed as the target associated multimedia.

Specifically, when the number of associated multimedia corresponding to the target multimedia is M, the M associated multimedia includes the associated multimedia belonging to the target participating object, and when the computer device detects the second operation in the first direction on the target multimedia, it acquires the multimedia attribute information of the M associated multimedia. Further, the computer device may determine the display order of the M associated multimedia according to the multimedia attribute information of the M associated multimedia, and determine the target associated multimedia with the earliest display order from the M associated multimedia. Further, the computer device may update and display the target multimedia on the multimedia display interface as the target associated multimedia in response to the second trigger operation in the first direction on the target multimedia in the multimedia display interface.

Optionally, automatically display associated multimedia. A specific manner in which the computer device displays associated multimedia for commenting on the target multimedia on the multimedia display interface may include: playing the target multimedia on the multimedia display interface in response to a play operation on the target multimedia. When the playing of the target multimedia is completed, the associated multimedia is displayed on the multimedia display interface.

Specifically, when the participating object or the publishing object plays the target multimedia, the computer device may play the target multimedia on the multimedia display interface in response to a play operation on the target multimedia. When the computer device detects that the playing of the target multimedia is completed, the associated multimedia will be displayed on the multimedia display interface. It can be understood that, after the target multimedia is played, the computer device can automatically play the associated multimedia. In this way, the associated multimedia corresponding to the target multimedia can be played without manual triggering by the participating objects, which can improve the display effect of the associated multimedia of the target multimedia and improve the experience of the participating objects.

Optionally, when the number of associated multimedia is M, the M associated multimedia includes the associated multimedia belonging to the target participating object, and when the computer device finishes playing the target multimedia, in the multimedia display interface, the specific manner of displaying and playing the associated multimedia may include: determining the playing sequence of the M associated multimedia according to the multimedia attribute information of the M associated multimedia. When the playing of the target multimedia is completed, the M associated multimedia are sequentially displayed and played on the multimedia display interface according to the playing sequence of the M associated multimedia.

Specifically, the computer device may obtain multimedia attribute information corresponding to the M associated multimedia, and the multimedia attribute information may include the generation time or release time of the associated multimedia, and may also include the management sequence corresponding to the M associated multimedia by the publishing object. Further, the computer device may determine the playing sequence of the M associated multimedia according to the multimedia attribute information of the M associated multimedia. When the playing of the target multimedia is completed, the computer device may sequentially display and play the associated multimedia in the multimedia display interface according to the playing sequence of the M associated multimedia.

As shown in FIG. 8 , FIG. 8 is a schematic diagram of displaying associated multimedia provided by an embodiment of the present application. As shown in FIG. 8 , the target multimedia may refer to a target video, and the associated multimedia associated with the target multimedia may refer to a comment video used to comment on the target video, and the participation operation for the target multimedia may refer to a comment operation. When the participating object watches the target video in the video display interface 80a and wants to publish a comment video for the target video, he can slide the target video in the video display interface 80a to the left. The computer device may respond to the participant's sliding operation on the target video in the video display interface 80a, acquire all comment videos corresponding to the target video, and acquire the display order of all comment videos. The computer device may determine to display the first commented video, that is, the commented video corresponding to the object 2, according to the display order of the commented videos. The computer device can update and display the target video in the video display interface as the comment video corresponding to object 2, and switch the video display interface 80a to the video display interface 80b. In this way, the participant can slide horizontally to watch the comment data about the target video, which can improve the experience of the participant watching the video.

Optionally, the specific manner in which the computer device displays associated multimedia for commenting on the target multimedia in the multimedia display interface may include: acquiring device attribute information of terminal devices used to respond to the participating operation on the target multimedia. From the set of associated multimedia, determine associated multimedia that matches the device attribute information; the set of associated multimedia includes at least two associated multimedia with different display qualities. In the presentation area of the multimedia display interface, the determined associated multimedia is displayed.

Specifically, after the computer device obtains the associated multimedia, it may acquire device attribute information of a terminal device used to respond to the participating operation for the target multimedia. The terminal device may refer to a terminal device held by the target participating object, that is, a terminal device that responds to the target participating object implementing the participating operation for the target multimedia. Wherein, the device attribute information may include the size of the display screen of the device, the network status of the device, the resolution of the current multimedia playback of the device, and the like. Further, the computer device may determine associated multimedia that matches the device attribute information from a set of associated multimedia, where the set of associated multimedia includes at least two associated multimedia with different playback qualities. Further, the computer device may display the determined associated multimedia on the multimedia display interface. Because in the case of some conventional multimedia players and weak networks, directly playing the associated multimedia may cause the multimedia playback to freeze or fail to play, thereby affecting the viewing effect and experience of the participating objects watching the multimedia. Therefore, by displaying associated multimedia of different sizes, different resolutions, and different sizes according to the device attribute information of the terminal device, in order to select an appropriate associated multimedia to play under a weak network or other conditions, that is, to play associated multimedia of different qualities according to different device attribute information, the viewing effect and experience of multimedia viewing by the participating objects can be improved.

Wherein, when the terminal device is playing the associated multimedia, it can obtain the device attribute information of the terminal device, and send the device attribute information to the server. The server can transcode the associated multimedia used for commenting on the target multimedia according to the device attribute information, transcode the associated multimedia into a plurality of transcoded associated multimedia with different resolutions, sizes, and sizes, and add the transcoded associated multimedia with different resolutions, sizes, and sizes to the set of associated multimedia. Further, the computer device can return the set of associated multimedia to the terminal device. The attribute information is to obtain associated multimedia that matches the attribute information of the current device from the set of associated multimedia, and display the determined associated multimedia.

Wherein, the terminal device may also send the current device attribute information of the terminal device to the server in real time, and the server performs transcoding processing on the associated multimedia used for commenting on the target multimedia according to the current device attribute information to obtain the transcoded associated multimedia. The server may return the transcoded associated multimedia to the terminal device, and the terminal device may display the transcoded associated multimedia.

Wherein, when the target participating object publishes the associated multimedia for the target multimedia, the computer device can generate a notification message according to the object information of the target participating object and the associated multimedia corresponding to the target participating object, and send the notification message to the terminal device of the object associated with the target multimedia. The terminal device of the object associated with the target multimedia can display the notification message in the corresponding comment detail information interface, so that the object associated with the target multimedia can view the associated multimedia corresponding to the target participating object, which can improve the interaction between the participating object and the publishing object. In addition, the object associated with the target multimedia can quickly locate the target participating object through the notification message, and can quickly establish contact with the target participating object through communication functions such as small notes and IM chat (ie chat room).

As shown in FIG. 9, FIG. 9 is a schematic diagram of displaying associated multimedia provided by the embodiment of the present application. As shown in FIG. 9, the target multimedia may refer to the target video, and the associated multimedia associated with the target multimedia may refer to the comment video used to comment on the target video, and the participation operation for the target multimedia may refer to a comment operation. After the participating object implements the participating operation for the target multimedia in the multimedia display interface 90a, the computer device can respond to the participating operation, determine the participating object that triggers the participating operation as the target participating object, and switch the multimedia display interface 90a to the media interaction interface 90b. When the target participant selects the shooting control to collect comment data, the computer device may respond to the target participant's selection operation on the shooting control, acquire the shooting multimedia obtained based on the shooting control, and determine the shooting video as the comment data obtained by participating in the operation. Further, the computer device may perform video conversion on the comment data corresponding to the target participants to obtain an initial comment video 90d, and display the initial comment video 90d on the media interaction interface 90c. Further, the target participant can edit the initial comment video 90d, as shown in the media interaction interface 90c in FIG. 9, the target participant can click the "Add Background Music" control to add background music to the initial comment video 90d. The target participant can click on the "add text" control to add text to the initial review video 90d. The target participant can also click on the "zoom video" control to scale the size of the initial review video 90d. The target participant can also click "beautify" to beautify the initial review video 90d. Wherein, while the target participating object is editing the initial comment video 90d, the computer device may display the edited initial comment video on the media interaction interface 90c in response to the editing operation of the target participating object.

Further, after the target participants finish editing the initial comment video 90d, they can click on the release control 90e in the media interaction interface 90c. The computer device can respond to the trigger operation of the target participant object on the release control 90e, determine the initial associated multimedia after editing as the comment video for commenting on the target video, and switch the media interaction interface 90c to the multimedia display interface 90f. As shown in the multimedia display interface 90f, the computer device can obtain the object avatar of the target participant, and display the object avatar of the target participant in the participant area in the multimedia display interface 90f, that is, the object 490g, and simultaneously display the target video on the multimedia display interface. Further, the participating object can click the object portrait of the object 4 in the participating object area, and the computer device can display the comment video corresponding to the object 4 in response to the participating object's click operation on the object portrait of the object 4 . In addition, the participating object can also slide the target video to the left to play the commentary videos corresponding to object 2, object 3, and object 4 respectively. In addition, when the computer device detects that the playing of the target video is completed, and no triggering operation of the participating object on the target video is detected, the comment videos corresponding to the playback object 2, object 3, and object 4 are sequentially displayed.

In the embodiment of the present application, by displaying the target multimedia in the presentation area of the multimedia display interface, when the participating object (that is, the viewing object) interacts with the target multimedia, the computer device can generate and publish associated multimedia in response to the participation operation on the target multimedia. The associated multimedia can include one or more of video, text, image data, voice data, and special effects. Further, the associated multimedia associated with the target multimedia can be displayed in the presentation area of the multimedia display interface, the associated multimedia and the target multimedia form a first associated multimedia group, and the interaction between objects corresponding to the multimedia in the associated multimedia group can be realized. The format and content of the associated multimedia are not limited, and the flexibility of interaction can be improved, and the interaction and interest between the viewing object and the publishing object of the target multimedia can be enhanced. Among them, the multimedia data obtained by participating in the operation can be transformed into initial associated multimedia, and the target participant can perform personalized editing on the initial associated multimedia to increase the personalization of the associated multimedia. In addition, when the associated multimedia is displayed in the multimedia display interface, the associated multimedia corresponding to the target participant can be displayed by clicking on the object information of the target participant, or the associated multimedia can be displayed by sliding the target multimedia in the first direction, or the associated multimedia can be automatically played when the target multimedia is played.

As shown in FIG. 10 , FIG. 10 is a schematic flowchart of a multimedia interaction method provided by an embodiment of the present application. The multimedia interaction method can be executed by any user terminal in FIG. 1, can also be executed by the server in FIG. 1, and can also be executed jointly by any user terminal and server in FIG. 1, and the devices used to execute the method in this application can be collectively referred to as computer devices. As shown in Figure 10, the multimedia interaction method may include but not limited to the following steps:

S201. Display target multimedia in a presentation area of a multimedia display interface.

Optionally, displaying the associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface includes: uploading the associated multimedia associated with the target multimedia to a media service device, where the associated multimedia is used to instruct the media service device to compress the associated multimedia to obtain the compressed associated multimedia, and generate a first associated multimedia group according to the compressed associated multimedia and the target multimedia; during the process of compressing the associated multimedia, the media service device obtains the associated multimedia associated with the target multimedia from a local database, and displays it in the multimedia display interface In the presentation area, the associated multimedia associated with the target multimedia is displayed; after the media service device compresses the associated multimedia, delete the associated multimedia associated with the target multimedia in the local database, obtain the compressed associated multimedia from the first associated multimedia group in the media service device, and display the associated multimedia associated with the target multimedia in the presentation area of the media display interface according to the compressed associated multimedia.

Specifically, when the media service device compresses the associated multimedia, that is, when the media service device compresses the associated multimedia, the associated multimedia associated with the target multimedia is obtained from the local database of the computer device, and the associated multimedia associated with the target multimedia is displayed in the presentation area of the multimedia display interface. After the media service device compresses the associated multimedia, delete the associated multimedia associated with the target multimedia in the local database, obtain the compressed associated multimedia from the first associated multimedia group in the media service device, obtain the associated multimedia associated with the target multimedia from the compressed associated multimedia, and display the associated multimedia associated with the target multimedia in the presentation area of the media display interface. This can improve the multimedia experience and prevent the multimedia from taking up too much memory space on the computer device.

Optionally, displaying the associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface includes: uploading the associated multimedia associated with the target multimedia to a media service device, where the associated multimedia is used to instruct the media service device to compress the associated multimedia to obtain the compressed associated multimedia, and generate a first associated multimedia group according to the compressed associated multimedia and the target multimedia; when uploading the associated multimedia associated with the target multimedia to the media service device is not completed, in the presentation area of the media display interface, display the associated multimedia associated with the target multimedia Identification information of the associated multimedia; in response to a play operation on the identification information of the associated multimedia associated with the target multimedia, in the presentation area of the media display interface, play the associated multimedia associated with the target multimedia in the local database.

Specifically, when the associated multimedia associated with the target multimedia is not uploaded to the media service device, the computer device displays the identification information of the associated multimedia associated with the target multimedia in the presentation area of the media display interface. If the target object needs to play the associated multimedia associated with the target multimedia, it can perform a playback operation on the identification information of the associated multimedia associated with the target multimedia; correspondingly, the computer device can respond to the playback operation of the identification information of the associated multimedia associated with the target multimedia, in the presentation area of the media display interface, play the associated multimedia associated with the target multimedia in the local database, which can improve the playback experience.

Optionally, displaying the associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface includes: uploading the associated multimedia associated with the target multimedia to a media service device, the associated multimedia is used to instruct the media service device to compress the associated multimedia to obtain the compressed associated multimedia, and generate a first associated multimedia group according to the compressed associated multimedia and the target multimedia; In the presentation area of , the identification information of the multimedia in the first associated multimedia group is displayed.

Specifically, after uploading the associated multimedia associated with the target multimedia to the media service device, the computer device can delete the associated multimedia associated with the target multimedia in the local database, and display the identification information of the multimedia in the first associated multimedia group in the presentation area of the media display interface, so as to prevent the associated multimedia from occupying memory space.

S202. In response to the participation operation on the target multimedia, generate and publish associated multimedia.

S203. Display associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface.

Specifically, for the specific content of steps S201-S203 in the embodiment of the present application, refer to the specific content of step S101-step S103 in FIG. 3 above, which will not be repeated here in the embodiment of the present application.

S204. In response to the viewing operation on the detailed interaction information of the target multimedia, display the object information of the participating objects who perform participation operations on the target multimedia and the interaction statistics information of the target multimedia on the interaction detailed information interface.

Specifically, when the computer device obtains the associated multimedia in which the target participating object comments on the target multimedia, and displays the associated multimedia in the multimedia display interface, it can generate a notification message corresponding to the associated multimedia, and display the notification message in the interaction details information interface of the object (such as the publishing object or participating object) associated with the target multimedia. Wherein, if the number of associated multimedia used to comment on the target multimedia is M, the computer device may obtain multimedia attribute information corresponding to the M associated multimedia, and the multimedia attribute information may be the release time and generation time of the associated multimedia. Further, the computer device may determine the notification order of the M associated multimedia according to the multimedia attribute information of the M associated multimedia, and generate the notification messages of the M associated multimedia according to the notification order. Specifically, the computer device can arrange the object information of the participating objects respectively corresponding to the M associated multimedia according to the notification order, and obtain the notification messages of the M associated multimedia, such as horizontally arranged and displayed in one line. When other target participating objects or publishing objects trigger the viewing operation of the detailed comment information of the target multimedia, for example, when the participating object or publishing object opens the multimedia comment detail page, the computer device may respond to the viewing operation of the interactive detailed information of the target multimedia. The interaction statistical information may include the number of participating objects performing participation operations on the target multimedia, the multimedia cover information of the target multimedia, and the like. Wherein, the object information of the target participating object corresponding to the associated multimedia with the earliest notification order can be enlarged and displayed, and the cover information of the target multimedia can be displayed, and the cover information can refer to any frame of image in the target multimedia. For example, the publishing object of the target multimedia is object D, and the target participating objects of the historical associated multimedia of the target multimedia are object E and object F. When the target participating object H comments on the target multimedia and generates the associated multimedia corresponding to the target participating object H, the computer device can generate a notification message of the associated multimedia corresponding to the target participating object H, and display the notification message on the interaction details information interface of the terminal devices held by the object D, object E, and object F respectively.

As shown in FIG. 11 , FIG. 11 is a schematic diagram of an interaction details information interface provided by the embodiment of the present application. As shown in FIG. 11 , the target multimedia may refer to the target video, and the associated multimedia associated with the target multimedia may refer to the comment video used to comment on the target video, and the participation operation for the target multimedia may refer to a comment operation. When the subject 1 wants to view detailed information about the interaction of the target multimedia, he can click on the "interaction" control. In response to object 1's click operation on the "interaction" control, the computer device may display object attribute information of participating objects that perform participation operations on the target multimedia and interaction statistics information of the target multimedia in the interaction detail information interface. As shown in FIG. 11 , when Object 2, Object 3, Object 4, Object 5, Object 6, Object 7, and Object 8 respectively perform participation operations for the target multimedia 1 and generate corresponding associated multimedia, the computer device may display notification messages corresponding to Object 2, Object 3, Object 4, Object 5, Object 6, Object 7, and Object 8 in the interaction details information interface. Wherein, the target multimedia 1 is the target multimedia published by the object 1 . As shown in FIG. 11 , the computer device can acquire the object information of the target participant object corresponding to the first generated associated multimedia, display the object avatar of the first commented target participant object first, and display the object ID (such as the object nickname "******") of the first commented target participant object. As shown in Figure 10, the computer device can also perform statistics on the attributes of other target participating objects, and display the text "6 people replied to your multimedia", that is, object 3, object 4, object 5, object 6, object 7, and object 8, and display the time when the last commented object commented, such as "3:20 p.m.".

As shown in FIG. 11 , after the object 1 implements the participation operation for the target multimedia 2 published by the object 6, when there is a new target participating object that triggers the target multimedia 2 published for the object 6, a notification message will be generated to notify the object 1. As shown in FIG. 11 , the computer device can display the avatar of the object 6 and the object ID of the object 6 (such as the object nickname "*****") in the interactive detailed information interface. The computer device can also display the statistical information of the new target participant, that is, the display video [***] (i.e. the name of the target multimedia 2) has 2 new replies, and displays the object avatar of the target participant corresponding to the 2 new replies, and displays the comment time of the last commented target participant, such as "11:20 in the morning".

Specifically, if a participating object wishes to comment on the target multimedia while watching the target multimedia, a comment control for the target multimedia may be triggered, and comment data may be input in the comment publisher. The terminal device held by the target participating object that triggers the participating operation can perform multimedia conversion on the associated multimedia to obtain the associated multimedia, and upload the associated multimedia and the object information of the target participating object that triggers the participating operation to the server. After the terminal device uploads successfully, the server can review the validity of the associated multimedia, and when the review is passed, the target participant object is sent to the terminal device of each participant object. The terminal device of each participating object can splice the associated multimedia corresponding to the target participating object behind the target multimedia, and splice the object information of the target participating object behind the object information in the multimedia group corresponding to the target multimedia, that is, display the object information of the target participating object in the multimedia display interface of the terminal device of each participating object. Other participating objects can play the associated multimedia corresponding to the target participating object, and can also make new comments after the associated multimedia of the target participating object (that is, generate new associated multimedia).

Wherein, the display order of the associated multimedia corresponding to each target participating object corresponding to the target multimedia may be determined according to the publishing time of each associated multimedia, and when the playing of the associated multimedia arranged earlier is finished, the subsequent associated multimedia may be played sequentially according to the display order. Wherein, during the process of playing the target multimedia or associated multimedia, the participant can click to pause the multimedia playback, or click the object information of each target participant to jump to play the associated multimedia corresponding to the corresponding target participant. In addition, the participant can also slide the object information of multiple target participants corresponding to the target multimedia to view more object information of the target participant. When clicking on the object information of the target participant, he can also watch the associated multimedia corresponding to the target participant.

Specifically, a vertical pageview (ie, a page view) is included in the multimedia display interface for carrying multiple associated multimedia groups (an associated multimedia group includes a target multimedia and associated multimedia corresponding to the target multimedia). When the participating object performs a sliding operation on the target multimedia in a switching direction (such as vertical sliding), different associated multimedia groups can be switched. For example, participants can slide the target multimedia up and down to view different associated multimedia groups, and when the slide bottoms out, they will actively pull more associated multimedia groups from the background. Wherein, multiple horizontal pageviews are nested in the vertical pageview of the multimedia display interface, and each horizontal pageview contains an associated multimedia group. When the participating object performs a trigger operation on the target multimedia in the first direction, it switches between different associated multimedia of the target multimedia. For example, the participating counterparty can perform multimedia switching in the associated multimedia group by sliding left and right or clicking on the object information of other participating objects at the bottom. At the same time, the computer device can detect the completion event of each multimedia, and if the current multimedia playback is completed, if the participating object does not actively perform the playback adjustment operation, it will automatically switch to the next multimedia in the current multimedia group. If it is the last multimedia in the current multimedia group that has been played, then play the first multimedia in the current multimedia group. In addition, the participant can load more multimedia of the current multimedia group by sliding left and right on the participant list at the bottom.

Among them, in the management of multimedia instances, we have also adopted a unique technical solution. In the traditional multimedia playback technology, the multimedia stream is vertically scrolled in one direction and one dimension, and the multimedia cannot be skipped (that is, the next multimedia to be played must be the vertically upper or vertically lower multimedia, and cannot be skipped across multiple multimedia). To achieve a better multimedia playback experience, only the upper and lower multimedia instances need to be preloaded. In this solution, there are two directions of horizontal and vertical multimedia streams, and for multimedia in the same multimedia group (shown as horizontal multimedia on the user interface), the user can click on the object information of the bottom participant to skip across multiple multimedia. Based on this current situation, this solution only retains the currently displayed multimedia, the left multimedia adjacent to the currently displayed multimedia (if any) and the right multimedia adjacent to the currently displayed multimedia (if any) in the horizontal direction. In the portrait direction, only the lower multimedia adjacent to the currently displayed multimedia and the upper multimedia adjacent to the currently displayed multimedia are reserved. It can be seen that in this solution, a maximum of 5 multimedia can exist at the same time, and a balance is achieved in terms of user experience and client performance.

Wherein, after the terminal device corresponding to the target participant object obtains the associated multimedia of the target participant object for the target multimedia, the terminal device corresponding to the target participant object may perform two parts of processing on the associated multimedia. One is to save the associated multimedia locally on the terminal device and generate a local access address, and the other is to upload it to the cos (ie object storage) in the server and generate corresponding online access addresses. Further, the terminal device may send the local access address, the online access address, object information of the target participating object, associated multimedia, and related information of the video group corresponding to the target multimedia to the server. After uploading to the server, the server can compress the associated multimedia, and at the same time perform necessary data splicing on the associated multimedia (splicing the object information of the target participating object, the associated multimedia, and the relevant information of the video group corresponding to the target multimedia to obtain the splicing information.

Further, after the terminal device successfully uploads the local access address, online access address, object information of the target participant, associated multimedia, and related information of the video group corresponding to the target multimedia to the server, the terminal device of the target participant will automatically perform a data request, pull the mosaic information spliced by the server, and splice the comments into the first associated multimedia group in the multimedia display interface of the target participant. For the target participant of the associated multimedia, the server will return the local link of the associated multimedia before the video compression process of the associated multimedia is completed, so that the target participant can directly play the associated multimedia stored locally before releasing the associated multimedia, which can improve the playback experience. After the server completes the video processing of the associated multimedia, it will send the online access link stored on the cos to the object associated with the target multimedia, and actively delete the associated multimedia stored locally on the terminal device of the target participating object, so as to prevent the storage space of the terminal device of the target participating object from being occupied. For non-target participants, before the server performs video compression processing on the associated multimedia, the online access link of the associated multimedia will not be issued to avoid the situation that the video cannot be played.

Specifically, after the computer device obtains the associated multimedia of the target participating object for the target multimedia, functions such as uploading, reviewing, storing, and comment notification of the associated multimedia can be completed.

Specifically, the computer device can convert the uploaded associated multimedia into a resource and store it in the underlying storage component. This type of component is usually called OSS (Object Storage Service, ie, object storage service). The feature of the OSS component is a massive, safe, low-cost, and highly reliable cloud storage service, suitable for storing any type of file, elastic expansion of capacity and processing power, multiple storage types for selection, and comprehensive optimization of storage costs. After the upload action is passed, an online access link corresponding to the associated multimedia can be generated, and the associated multimedia can be accessed through the online access link.

Further, the computer device can verify the legality of the uploaded associated multimedia, such as verifying whether the uploaded associated multimedia complies with legal regulations, and if the associated multimedia complies with the legal rules, it can be determined that the associated multimedia is legal, the associated multimedia is stored, and displayed in the presentation area of the multimedia display interface. If the associated multimedia does not comply with the legal requirements, output prompt information on the multimedia display interface of the target participant's terminal device to remind the target participant that the associated multimedia published by the target participant does not comply with the regulations, and the release of the associated multimedia fails.

Further, the computer device may store the uploaded related multimedia information. Among them, the data stored in the associated multimedia of different multimedia publishing types will be different. One is that the publishing object actively publishes the video, which is called the building; the other is the video that other participating objects interact with the building, which is called the layer. The difference between stored information between floors and floors is introduced below. When the publishing object publishes the target multimedia, when the computer device stores the target multimedia, it mainly records the object information of the publishing object, when the video was released, and by what form (such as shooting, forwarding, etc.) to generate the target multimedia. After the target participating object generates associated multimedia for the participating operation of the target multimedia, when the computer device stores the associated multimedia, it mainly records the object information of the target participating object, and when and whose building video was replied.

Among them, the storage information between the building video and the floor video is maintained separately through components that support orderly storage. When the target participant is viewing the first associated media group corresponding to the target multimedia, the building video (i.e. the target multimedia) and the floor videos (i.e. the associated multimedia) of all target participants will be presented to the participant in a certain display order. Wherein, the display sequence may be the release time sequence of each multimedia, or the sequence after the release objects are managed, and the like. Among them, the computer device can also know which building videos each object has released (stored according to the release time sequence), which building videos participated in the interaction (stored according to the release time sequence), which building videos have been collected (stored according to the release time sequence), and so on. Among them, the interaction between objects is mainly realized through video. For example, three users are user A, user B, and user C. When user A replies to a target multimedia of user B, a notification message will be stored for user B at this time. In addition, after user C also replies to a target multimedia of user B, a notification message will also be stored for user A and user B. Wherein, the notification information also needs to be stored in an orderly manner according to the release time sequence of the corresponding associated multimedia.

Wherein, after displaying the associated multimedia corresponding to the target participating object on the display interface, the computer device may generate a notification message about the associated multimedia, and send the notification message to the object associated with the target multimedia. Wherein, the objects associated with the target multimedia include the publishing object of the target multimedia, and other target participating objects that send notification messages to the target multimedia (that is, the target participating objects that have historically triggered participation operations for the target multimedia). In this way, by sending a notification message to the object associated with the target multimedia, the objects associated with the target multimedia (such as the publishing object of the target multimedia and other target participating objects) can be notified in time to view the associated multimedia in time, so that the target participating objects and objects associated with the target multimedia can interact and establish connections to improve the interactivity between objects.

As shown in FIG. 12, FIG. 12 is a schematic diagram of a multimedia interaction provided by the embodiment of the present application. As shown in FIG. 12, the target multimedia may refer to the target video, and the associated multimedia associated with the target multimedia may refer to the comment video used to comment on the target video, and the participation operation for the target multimedia may refer to a comment operation. The terminal device can display the target multimedia 120a on the multimedia display interface, and the participants can browse the target multimedia on the multimedia display interface. When a participant wants to publish related multimedia for the target multimedia, the comment control in the multimedia display interface can be triggered, and the terminal device can display the media interaction interface 120b in response to the trigger operation of the participating user on the comment control. The terminal device can determine the participant who triggers the participation operation as the target participant, obtain comment data collected by the target participant on the media interaction interface, and generate associated multimedia for interacting with the target multimedia. The terminal device can upload the associated multimedia and the object information of the target participants to the server 120c. After receiving the associated multimedia uploaded by the terminal device, the server can conduct a review 120d on the validity of the associated multimedia to obtain the review result. Further, if the server determines that the audit result indicates that the associated multimedia is legal, it stores the associated multimedia 120e, and associates a notification message corresponding to the multimedia. The server may send a notification message corresponding to the associated multimedia to the terminal device of the object associated with the target multimedia, and the terminal device of the object associated with the target multimedia may update and display the participating object list 120f in the multimedia display interface according to the notification message.

Wherein, the target multimedia data in this solution may also refer to the target image data, the associated multimedia data associated with the target multimedia may refer to adding image data, and the participating operation for the target multimedia data may refer to a content adding operation. In this way, the participating object can trigger the content addition operation for the target image data, input the added data, and the computer device generates the added image data according to the added data input by the target participating object in response to the adding operation of the participating object. Further, the computer device can display the added image data on the multimedia display interface, so that when the participating objects watch the target image data, they can also watch the added image data associated with the target image data. In this way, the consumption of single image data can be changed to various image data consumption, the interaction between multimedia data can be improved, the flexibility of interaction can also be improved, and the interaction and interest between target multimedia viewing objects and publishing objects can be enhanced.

Among them, when the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use, and processing of information such as the object information of the publishing object, the object information of the participating object, the object information of the target participating object, and the device attribute information of the terminal device held by the target participating object must comply with the relevant laws, regulations and standards of the relevant countries and regions. That is to say, the computer device can obtain information such as the object information of the publishing object, the object information of the participating object, the object information of the target participating object, and the device attribute information of the terminal device held by the target participating object when the computer device obtains the user's authorization information for the above information.

In the embodiment of the present application, by displaying the target multimedia in the presentation area of the multimedia display interface, when the participating object (that is, the viewing object) interacts with the target multimedia, the computer device can generate and publish associated multimedia in response to the participation operation on the target multimedia. The associated multimedia can include one or more of video, text, image data, voice data, and special effects. Further, the associated multimedia associated with the target multimedia can be displayed in the presentation area of the multimedia display interface, the associated multimedia and the target multimedia form a first associated multimedia group, and the interaction between objects corresponding to the multimedia in the associated multimedia group can be realized. The format and content of the associated multimedia are not limited, and the flexibility of interaction can be improved, and the interaction and interest between the viewing object and the publishing object of the target multimedia can be enhanced.

Please refer to FIG. 13 . FIG. 13 is a schematic structural diagram of a multimedia interaction device provided by an embodiment of the present application. The above-mentioned multimedia interactive device may be a computer program (including program code) running in a computer device, for example, the multimedia interactive device is an application software; the multimedia interactive device may be used to execute the corresponding steps in the multimedia interactive method provided by the embodiment of the present application. As shown in FIG. 13 , the multimedia interaction device may include: a first display module 11 , a generating module 12 , a second display module 13 , a third display module 14 , and a fourth display module.

The first display module is configured to display target multimedia in the presentation area of the multimedia display interface;

A generating module, configured to generate and publish associated multimedia in response to the participation operation for the target multimedia;

The second display module is configured to display associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface, where the associated multimedia and the target multimedia form a first associated multimedia group.

Optionally, the second display module displays associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface, including:

In the presentation area, display the object information of the target participating object corresponding to the participating operation;

In response to the first operation on the object information of the target participant object, updating and displaying the target multimedia in the presentation area as associated multimedia belonging to the target participant object; the associated multimedia belonging to the target participant object is produced according to the participation operation of the target participant object on the target multimedia.

Optionally, the second display module displays associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface, including:

In response to a second manipulation in the first direction for the target multimedia in the presentation area, updating the display of the target multimedia presented in the presentation area as associated multimedia associated with the target multimedia; or

After the target multimedia is played, associated multimedia associated with the target multimedia is displayed in the presentation area.

Optionally, the second display module displays associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface, including:

Displaying the identification information of the target multimedia and associated multimedia in the presentation area of the multimedia display interface in a preset order.

Optionally, the second display module displays the identification information of the target multimedia and associated multimedia in the presentation area of the multimedia display interface in a preset order, including:

Arranging and displaying the identification information of the target multimedia and associated multimedia in the presentation area of the multimedia interface in sequence according to the generated time sequence.

Optionally, a third display module, configured to update and display the first multimedia group on the multimedia display interface as a second associated multimedia group in response to a third operation in the second direction on the multimedia display interface.

Optionally, the second display module displays associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface, including:

Acquiring device attribute information of the terminal device used to respond to the participating operation for the target multimedia;

From the set of associated multimedia, determine the associated multimedia that matches the device attribute information; the set of associated multimedia includes at least two associated multimedia with different display qualities;

In the presentation area of the multimedia display interface, the determined associated multimedia is displayed.

Optionally, the second display module displays associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface, including:

Uploading the associated multimedia associated with the target multimedia to the media service device, the associated multimedia is used to instruct the media service device to compress the associated multimedia to obtain the compressed associated multimedia, and generate a first associated multimedia group according to the compressed associated multimedia and the target multimedia;

During the compression process of the associated multimedia by the media service device, the associated multimedia associated with the target multimedia is obtained from a local database, and the associated multimedia associated with the target multimedia is displayed in the presentation area of the multimedia display interface;

After the media service device compresses the associated multimedia, delete the associated multimedia associated with the target multimedia in the local database, obtain the compressed associated multimedia from the first associated multimedia group in the media service device, and display the associated multimedia associated with the target multimedia in the presentation area of the media display interface according to the compressed associated multimedia.

Optionally, the second display module displays associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface, including:

Uploading the associated multimedia associated with the target multimedia to the media service device, the associated multimedia is used to instruct the media service device to compress the associated multimedia to obtain the compressed associated multimedia, and generate a first associated multimedia group according to the compressed associated multimedia and the target multimedia;

When the associated multimedia associated with the target multimedia is not uploaded to the media service device, in the presentation area of the media display interface, display the identification information of the associated multimedia associated with the target multimedia;

In response to a play operation directed to the identification information of the associated multimedia associated with the target multimedia, in the presentation area of the media display interface, the associated multimedia associated with the target multimedia in the local database is played.

Optionally, the second display module displays associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface, including:

Uploading the associated multimedia associated with the target multimedia to the media service device, the associated multimedia is used to instruct the media service device to compress the associated multimedia to obtain the compressed associated multimedia, and generate a first associated multimedia group according to the compressed associated multimedia and the target multimedia;

After the associated multimedia associated with the target multimedia is uploaded to the media service device, the associated multimedia associated with the target multimedia in the local database is deleted, and the identification information of the multimedia in the first associated multimedia group is displayed in the presentation area of the media display interface.

Optionally, the production module produces and publishes associated multimedia in response to the participation operation for the target multimedia, including:

displaying shooting controls on the media interaction interface in response to the participating operation on the target multimedia;

Responding to a selection operation on the shooting control, acquiring a shooting video obtained based on the shooting control;

Generate associated multimedia including the captured video, and publish the associated multimedia including the captured video.

Optionally, the production module generates associated multimedia including the captured video, including:

Acquire video description information matching the captured video;

The video description information is added to the shot video to obtain associated multimedia including the shot video.

Optionally, the production module produces and publishes associated multimedia in response to the participation operation for the target multimedia, including:

displaying a voice control on the media interaction interface in response to the participating operation for the target multimedia;

In response to a selection operation on the voice control, acquiring input voice data obtained based on the input of the voice control;

Generate associated multimedia including the input voice data, and publish the associated multimedia including the input voice data.

Optionally, the production module generates associated multimedia including the input voice data, including:

Carrying out text conversion processing to described input speech data, obtains conversion text data;

generating a first text background image according to the converted text data;

Synthesizing the input voice data and the first text background image to obtain associated multimedia including the input voice data.

Optionally, the production module produces and publishes associated multimedia in response to the participation operation for the target multimedia, including:

displaying a local media data selection control on the media interaction interface in response to the participating operation for the target multimedia;

In response to a selection operation on the local media data selection control, acquire local media data selected based on the local media data selection control;

Generate associated multimedia including the local media data, and publish the associated multimedia including the local media data.

Optionally, the local media data includes at least two pieces of image data, and the production module generates associated multimedia including the local media data, including:

performing splicing processing on the at least two pieces of image data to obtain spliced image data;

determining image description information matching the stitched image data;

Generate associated multimedia including the local media data according to the spliced image data and the image description information.

Optionally, the production module produces and publishes associated multimedia in response to the participation operation for the target multimedia, including:

displaying a text input control on the media interaction interface in response to the participating operation for the target multimedia;

Responding to a trigger operation on the text input control, acquiring input text data obtained based on the text input control;

Generate associated multimedia including the input text data, and publish the associated multimedia including the input text data.

Optionally, the production module generates associated multimedia including the input text data, including:

Carrying out speech conversion processing on the input text data to obtain converted speech data;

generating a second text background image according to the input text data;

Synthesizing the converted voice data and the second text background image to obtain associated multimedia including the input text data.

Optionally, the fourth display module is configured to, in response to an operation of viewing the detailed interaction information of the target multimedia, display object information of participating objects that perform participation operations on the target multimedia and interactive statistical information of the target multimedia in the interaction detailed information interface.

According to an embodiment of the present application, each module in the multimedia interactive device shown in FIG. 13 can be separately or all combined into one or several units to form, or one (some) of the units can be further split into functionally smaller multiple subunits, and the same operation can be realized without affecting the realization of the technical effect of the embodiment of the present application. The above-mentioned modules are divided based on logical functions. In practical applications, the functions of one module can also be realized by multiple units, or the functions of multiple modules can be realized by one unit. In other embodiments of the present application, the test device may also include other units. In practical applications, these functions may also be implemented with the assistance of other units, and may be implemented cooperatively by multiple units.

In the embodiment of the present application, by displaying the target multimedia in the presentation area of the multimedia display interface, when the participating object (that is, the viewing object) interacts with the target multimedia, the computer device can generate and publish associated multimedia in response to the participation operation on the target multimedia. The associated multimedia can include one or more of video, text, image data, voice data, and special effects. Further, the associated multimedia associated with the target multimedia can be displayed in the presentation area of the multimedia display interface, the associated multimedia and the target multimedia form a first associated multimedia group, and the interaction between objects corresponding to the multimedia in the associated multimedia group can be realized. The format and content of the associated multimedia are not limited, and the flexibility of interaction can be improved, and the interaction and interest between the viewing object and the publishing object of the target multimedia can be enhanced.

Please refer to FIG. 14 , which is a schematic structural diagram of a computer device provided by an embodiment of the present application. As shown in FIG. 14 , the computer device 1000 may include: a processor 1001 , a network interface 1004 and a memory 1005 . In addition, the computer device 1000 may further include: a user interface 1003 and at least one communication bus 1002 . Wherein, the communication bus 1002 is used to realize connection and communication between these components. Wherein, the user interface 1003 may include a display screen (Display) and a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. Optionally, the network interface 1004 may include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory, or a non-volatile memory (non-volatile memory), such as at least one disk memory. Optionally, the memory 1005 may also be at least one storage device located away from the aforementioned processor 1001 . As shown in FIG. 14 , the memory 1005 as a computer-readable storage medium may include an operating system, a network communication module, a user interface module, and a device control application program.

In the computer device 1000 shown in FIG. 14 , the network interface 1004 can provide a network communication function; the user interface 1003 is mainly used to provide an input interface for the target user; and the processor 1001 can be used to call the device control application program stored in the memory 1005 to realize:

displaying the target multimedia in the presentation area of the multimedia display interface;

In response to the participating operation for the target multimedia, generate and publish associated multimedia;

In the presentation area of the multimedia display interface, associated multimedia associated with the target multimedia is displayed, and the associated multimedia and the target multimedia form a first associated multimedia group.

It should be understood that the computer device 1000 described in the embodiment of the present application can execute the description of the multimedia interaction method in the embodiment corresponding to FIG. 3 or FIG. 10 above, and can also execute the description of the multimedia interaction device in the embodiment corresponding to FIG. In addition, the description of the beneficial effect of adopting the same method will not be repeated here.

In addition, it should be pointed out here that the embodiment of the present application also provides a computer-readable storage medium, and the computer-readable storage medium stores the computer program executed by the multimedia interaction device mentioned above, and the computer program includes program instructions. When the processor executes the program instructions, it can execute the description of the multimedia interaction method in the embodiment corresponding to FIG. 3 and FIG. 10 above, so details will not be repeated here.

In addition, it should be pointed out here that the embodiment of the present application also provides a computer-readable storage medium, and the computer-readable storage medium stores the computer program executed by the multimedia interaction device mentioned above, and the computer program includes program instructions. When the processor executes the program instructions, it can execute the description of the multimedia interaction method in the embodiment corresponding to FIG. 3 and FIG. 10 above, so details will not be repeated here.

In addition, the description of the beneficial effect of adopting the same method will not be repeated here. For the technical details not disclosed in the embodiments of the computer-readable storage medium involved in the present application, please refer to the description of the method embodiments of the present application. As an example, the program instructions can be deployed to execute on one computing device, or executed on multiple computing devices located at one location, or executed on multiple computing devices distributed at multiple locations and interconnected through a communication network, and multiple computing devices distributed at multiple locations and interconnected through a communication network can form a blockchain system.

In addition, it should be noted that the embodiment of the present application also provides a computer program product or computer program, where the computer program product or computer program may include computer instructions, and the computer instructions may be stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor can execute the computer instructions, so that the computer device executes the description of the multimedia interaction method in the embodiment corresponding to Figure 3 and Figure 10 above, so it will not be repeated here. In addition, the description of the beneficial effect of adopting the same method will not be repeated here. For the technical details not disclosed in the computer program products or computer program embodiments involved in this application, please refer to the description of the method embodiments in this application.

It should be noted that, for the sake of simple description, all the foregoing method embodiments are expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited by the described action order, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification belong to preferred embodiments, and the actions and modules involved are not necessarily required by this application.

The steps in the methods of the embodiments of the present application can be adjusted, combined and deleted according to actual needs.

The modules in the device of the embodiment of the present application can be combined, divided and deleted according to actual needs.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the foregoing embodiments are realized,

Those of ordinary skill in the art can understand that realizing all or part of the processes in the methods of the above embodiments can be completed by instructing related hardware through a computer program, and the program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Wherein, the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM).

The above disclosures are only preferred embodiments of the present invention, and certainly cannot limit the scope of rights of the present invention. Therefore, equivalent changes made according to the claims of the present invention still fall within the scope of the present invention.

Claims (23)

1. A method of multimedia interaction, comprising:

displaying target multimedia in a presentation area of a multimedia display interface;

generating and publishing associated multimedia in response to the participation operation for the target multimedia;

and displaying the associated multimedia associated with the target multimedia in a presentation area of the multimedia display interface, wherein the associated multimedia and the target multimedia form a first associated multimedia group.

2. The method of claim 1, wherein displaying the associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface comprises:

displaying object information of a target participation object corresponding to the participation operation in the presentation area;

in response to a first operation of object information for the target participant object, displaying a target multimedia update of the presentation area as associated multimedia belonging to the target participant object; the associated multimedia belonging to the target participation object is produced according to the participation operation of the target participation object on the target multimedia.

3. The method of claim 1, wherein displaying the associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface comprises:

responsive to a second operation in a first direction for the target multimedia in the presentation area, displaying the target multimedia update presented by the presentation area as associated multimedia associated with the target multimedia; or alternatively

And after the target multimedia is played, displaying the associated multimedia associated with the target multimedia in the presentation area.

4. The method of claim 1, wherein displaying the associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface comprises:

and displaying the identification information of the target multimedia and the associated multimedia in a presentation area of the multimedia display interface according to a preset sequence.

5. The method according to claim 4, wherein displaying the identification information of the target multimedia and the associated multimedia in the presentation area of the multimedia display interface in a preset order includes:

And sequentially arranging and displaying the identification information of the target multimedia and the associated multimedia in the presentation area of the multimedia interface according to the generated time sequence.

6. The method according to claim 1, wherein the method further comprises:

in response to a third operation in a second direction for the multimedia display interface, the first multimedia group update on the multimedia display interface is displayed as a second associated multimedia group.

7. The method of claim 1, the displaying, in a presentation area of the multimedia display interface, associated multimedia associated with the target multimedia, comprising:

acquiring device attribute information of a terminal device for responding to the participation operation for the target multimedia;

determining associated multimedia matched with the equipment attribute information from a set of associated multimedia; the set of associated multimedia comprises at least two associated multimedia with different display quality;

and displaying the determined associated multimedia in a presentation area of the multimedia display interface.

8. The method of claim 1, wherein displaying the associated multimedia associated with the target multimedia in a presentation area in the multimedia display interface comprises:

Uploading associated multimedia associated with the target multimedia to media service equipment, wherein the associated multimedia is used for indicating the media service equipment to compress the associated multimedia to obtain compressed associated multimedia, and generating a first associated multimedia group according to the compressed associated multimedia and the target multimedia;

acquiring the associated multimedia associated with the target multimedia from a local database in the process of compressing the associated multimedia by the media service equipment, and displaying the associated multimedia associated with the target multimedia in a presentation area of the multimedia display interface;

after the media service device compresses the associated multimedia, deleting the associated multimedia associated with the target multimedia in the local database, acquiring the compressed associated multimedia from the first associated multimedia group in the media service device, and displaying the associated multimedia associated with the target multimedia in a presentation area of the media display interface according to the compressed associated multimedia.

9. The method of claim 1, wherein displaying the associated multimedia associated with the target multimedia in a presentation area in the multimedia display interface comprises:

Uploading associated multimedia associated with the target multimedia to media service equipment, wherein the associated multimedia is used for indicating the media service equipment to compress the associated multimedia to obtain compressed associated multimedia, and generating a first associated multimedia group according to the compressed associated multimedia and the target multimedia;

when the associated multimedia associated with the target multimedia is not uploaded to the media service equipment, displaying identification information of the associated multimedia associated with the target multimedia in a presentation area of the media display interface;

and responding to the playing operation of the identification information of the associated multimedia associated with the target multimedia, and playing the associated multimedia associated with the target multimedia in a local database in a presentation area of the media display interface.

10. The method of claim 1, wherein displaying the associated multimedia associated with the target multimedia in a presentation area in the multimedia display interface comprises:

uploading associated multimedia associated with the target multimedia to media service equipment, wherein the associated multimedia is used for indicating the media service equipment to compress the associated multimedia to obtain compressed associated multimedia, and generating a first associated multimedia group according to the compressed associated multimedia and the target multimedia;

And deleting the associated multimedia associated with the target multimedia in the local database after the associated multimedia associated with the target multimedia is uploaded to the media service equipment, and displaying the identification information of the multimedia in the first associated multimedia group in the display area of the media display interface.

11. The method of claim 1, wherein the creating and publishing associated multimedia in response to the participation operation for the target multimedia comprises:

responding to the participation operation aiming at the target multimedia, and displaying a shooting control on a media interaction interface;

responding to the selection operation of the shooting control, and acquiring shooting video shot based on the shooting control;

and generating the associated multimedia comprising the shot video, and publishing the associated multimedia comprising the shot video.

12. The method of claim 11, wherein the generating the associated multimedia comprising the captured video comprises:

acquiring video description information matched with the shot video;

and adding the video description information into the shot video to obtain associated multimedia comprising the shot video.

13. The method of claim 1, wherein the creating and publishing associated multimedia in response to the participation operation for the target multimedia comprises:

responding to the participation operation aiming at the target multimedia, and displaying a voice control on a media interaction interface;

responding to the selection operation of the voice control, and acquiring input voice data input based on the voice control;

generating associated multimedia including the input voice data, and publishing the associated multimedia including the input voice data.

14. The method of claim 13, wherein the generating associated multimedia comprising the input voice data comprises:

performing text conversion processing on the input voice data to obtain converted text data;

generating a first text background image according to the converted text data;

and synthesizing the input voice data and the first text background image to obtain the associated multimedia comprising the input voice data.

15. The method of claim 1, wherein the creating and publishing associated multimedia in response to the participation operation for the target multimedia comprises:

Responsive to a participation operation for the target multimedia, displaying a local media data selection control on a media interactive interface;

responding to the selection operation of the local media data selection control, and acquiring the local media data selected based on the local media data selection control;

generating associated multimedia including the local media data, and publishing the associated multimedia including the local media data.

16. The method of claim 15, wherein the local media data comprises at least two pieces of image data, the generating associated multimedia comprising the local media data comprising:

performing stitching processing on the at least two pieces of image data to obtain stitched image data;

determining image description information matched with the spliced image data;

and generating associated multimedia comprising the local media data according to the spliced image data and the image description information.

17. The method of claim 1, wherein the creating and publishing associated multimedia in response to the participation operation for the target multimedia comprises:

responsive to a participation operation for the target multimedia, displaying a text input control on a media interactive interface;

Responding to the triggering operation of the text input control, and acquiring input text data obtained based on the text input control;

generating associated multimedia including the input text data, and publishing the associated multimedia including the input text data.

18. The method of claim 17, wherein the generating associated multimedia including the input text data comprises:

performing voice conversion processing on the input text data to obtain converted voice data;

generating a second text background image according to the input text data;

and synthesizing the converted voice data and the second text background image to obtain the associated multimedia comprising the input text data.

19. The method according to claim 1, wherein the method further comprises:

and in response to the view operation of the interaction detail information of the target multimedia, displaying object information of a participation object for executing the participation operation on the target multimedia and interaction statistical information of the target multimedia in an interaction detail information interface.

20. A multimedia interaction device, comprising:

The first display module is used for displaying target multimedia in the multimedia display interface;

the making module is used for responding to the participation operation aiming at the target multimedia, making and publishing the associated multimedia;

and the second display module is used for displaying the associated multimedia associated with the target multimedia in the multimedia display interface, and the associated multimedia and the target multimedia form a first associated multimedia group.

21. A computer device, comprising: a processor and a memory;

the processor is connected to a memory, wherein the memory is configured to store a computer program, and the processor is configured to invoke the computer program to cause the computer device to perform the method of any of claims 1-19.

22. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program adapted to be loaded and executed by a processor to cause a computer device having the processor to perform the method of any of claims 1-19.

23. A computer program product or computer program, characterized in that it comprises computer instructions stored in a computer-readable storage medium, which are adapted to be read and executed by a processor to cause a computer device with the processor to perform the method of any of claims 1-19.