CN118264861B

CN118264861B - A collaborative playback method and terminal based on multimedia copyright

Info

Publication number: CN118264861B
Application number: CN202211679660.8A
Authority: CN
Inventors: 姬峰
Original assignee: Petal Cloud Technology Co Ltd
Current assignee: Petal Cloud Technology Co Ltd
Priority date: 2022-12-26
Filing date: 2022-12-26
Publication date: 2024-11-22
Anticipated expiration: 2042-12-26
Also published as: CN118264861A; CN119967246A

Abstract

The present application provides a collaborative playback method and terminal based on multimedia copyright. The method includes that after receiving a first indication message from a second terminal, the first terminal can identify the device playback copyright of at least one multimedia identifier contained in the list of multimedia information to be played indicated by the first indication message. When the first terminal has the device playback copyright of the first multimedia identifier, the multimedia file corresponding to the first multimedia identifier can be downloaded from the service device and the multimedia file can be played. When the first terminal does not have the device playback copyright of the first multimedia identifier, a second indication message can be sent to the second terminal, and the multimedia data stream corresponding to the first multimedia identifier from the second terminal can be received and played. In this way, the method can enable the first terminal to independently play the multimedia file corresponding to the multimedia identifier with the device playback copyright, and can bring users an imperceptible multi-terminal collaborative playback experience.

Description

Collaborative playing method and terminal based on multimedia copyright

Technical Field

The application relates to the technical field of communication, in particular to a collaborative playing method and a terminal based on multimedia copyright.

Background

With rapid development of technology and increasing level of living of people, more and more people begin to use multimedia services (such as listening to music) to enrich the mental lives of people. For example, taking a case that a certain user uses a multimedia service in a home as an example, in order to improve the experience of the user using the multimedia service in the home, a terminal (such as a smart phone) owned by the user may use a multimedia collaborative playing mode to play multimedia data to be played in the terminal through another terminal (such as a sound box).

At present, the schemes for multi-terminal collaborative playing of multimedia mainly include the following.

Scheme one: a terminal (such as terminal a) and another terminal (such as terminal B) realize the collaborative play of multimedia data through a bluetooth protocol or a mirror image screen projection protocol. In the collaborative playback implementation, the terminal a and the terminal B establish a bluetooth communication link through the bluetooth protocol, and then the terminal a transmits multimedia data (such as an audio stream of a song) to be played in the terminal a to the terminal B through the bluetooth communication link for playing.

However, in the first scheme, in the process of implementing bluetooth playing or mirror image screen projection playing, a playing source of the terminal a needs to be relied on, and the terminal B cannot independently play multimedia data. Meanwhile, before transmitting the multimedia data, the terminal A needs to transcode the multimedia data, so that details of the multimedia data are damaged, and playing experience is affected.

Scheme II: a terminal (such as terminal a) and another terminal (such as terminal B) realize collaborative play of multimedia data through a Digital Living Network Alliance (DLNA) screen-casting protocol. In the collaborative playing implementation process, firstly, a terminal a and a terminal B establish a DLNA screen-projection communication link through a DLNA screen-projection protocol, and then, the terminal a transmits multimedia data (such as an audio stream of a song) to be played in the terminal a to the terminal B for playing through the DLNA screen-projection communication link.

However, in the second scheme, the terminal B needs to rely on the terminal a to transmit the multimedia data to be played, so as to realize independent playing of the multimedia data. Meanwhile, the terminal A and the terminal B need to simultaneously support the DLNA screen-throwing protocol.

Disclosure of Invention

The embodiment of the application provides a collaborative play method and a terminal based on multimedia copyright, which are used for solving the problem that a terminal serving as a collaborative play side in the prior art cannot automatically and independently play multimedia data.

In a first aspect, an embodiment of the present application provides a collaborative playback method based on multimedia rights, where the method may be performed by a first terminal or a component (such as a chip system or a circuit) capable of supporting functions required by the first terminal to implement the method. Optionally, taking the first terminal as an example to execute the collaborative playing method based on the multimedia copyright, in the method, after receiving the first indication information from the second terminal, the first terminal may perform device playing copyright identification on at least one multimedia identifier included in the multimedia information list to be played indicated by the first indication information; when the first terminal has the equipment playing copyright of the first multimedia identifier, the first terminal can download the multimedia file corresponding to the first multimedia identifier from the service equipment and play the multimedia file, wherein the first multimedia identifier is any one of at least one multimedia identifier; when the first terminal does not have the equipment playing copyright of the first multimedia identifier, the first terminal can send second indication information to the second terminal and receive a multimedia data stream corresponding to the first multimedia identifier from the second terminal; and then, the first terminal plays the multimedia data stream, wherein the second indication information is used for indicating the playing copyright of the equipment which does not have the first multimedia identifier.

In the above design, the first terminal may determine which multimedia identifiers have the device playing rights and which multimedia identifiers do not have the device playing rights by performing device playing rights identification on at least one multimedia identifier included in the multimedia information list to be played. For the multimedia identifier with the equipment playing copyright of the first terminal, the first terminal can independently download the multimedia file corresponding to the multimedia identifier from the service equipment to play, so that the first terminal can independently play the multimedia file corresponding to the multimedia identifier with the equipment playing copyright, the transcoding detail loss of the multimedia data in the transmission process can be effectively reduced, and the playing experience of the multimedia data can be improved. For the multimedia identifier of the first terminal without the equipment playing copyright, the first terminal can timely send the second indication information to the second terminal, so that the second terminal can timely transmit the multimedia data stream corresponding to the multimedia identifier to the first terminal for playing, and therefore automatic collaborative playing among multiple terminals can be achieved, multimedia content corresponding to the multimedia identifier of a certain terminal (such as the first terminal) without the equipment playing copyright, and the multi-terminal collaborative playing experience without perception can be brought to a user.

In one possible design, the method further comprises:

the first terminal can firstly acquire the equipment copyright support information of the first multimedia identifier;

when the equipment type of the first terminal exists in at least one equipment type authorized to play by the first multimedia identifier according to the equipment copyright supporting information of the first multimedia identifier, the first terminal can determine that the first terminal has the equipment playing copyright of the first multimedia identifier; or alternatively

When it is determined that the device type of the first terminal does not exist in the at least one device type authorized to be played by the first multimedia identifier according to the device copyright support information of the first multimedia identifier, the first terminal may determine that the first terminal does not have the device playing copyright of the first multimedia identifier.

In the above design, the first terminal can timely and accurately determine whether the first terminal has the equipment playing copyright of the first multimedia identifier according to the equipment copyright supporting information of the first multimedia identifier.

Optionally, in an example, the first terminal may also obtain, through the cloud or other devices, the result of the first terminal to identify the device play copyright of the first multimedia identifier, so that the computing pressure of the first terminal to identify the first multimedia identifier to play copyright support information of the device of the first terminal may be reduced, which is helpful to reduce the computing resource consumption generated by identifying the first multimedia identifier to play copyright support information of the device of the first terminal.

In one possible design, a first terminal receives a multimedia data stream from a second terminal, comprising:

The first terminal can receive the multimedia data stream from the second terminal through a communication link corresponding to a target cooperative play mode negotiated by the first terminal and the second terminal, wherein the target cooperative play mode is used for indicating the cooperative play mode corresponding to the first multimedia identifier.

In the above design, when the first terminal does not have the device playing copyright of the first multimedia identifier, the first terminal may automatically negotiate with the second terminal about a target collaborative playing mode for playing the multimedia content corresponding to the first multimedia identifier, where the first terminal does not have the device playing copyright of the first multimedia identifier, so that the second terminal transmits the multimedia data stream corresponding to the first multimedia identifier to the first terminal for playing through a communication link corresponding to the target collaborative playing mode established between the first terminal and the second terminal.

In one possible design, the target cooperative play mode may be selected by the second terminal and the first terminal through negotiation in at least one cooperative play mode that is commonly owned.

In the above design, the first terminal and the second terminal can select one cooperative play mode from at least one cooperative play mode supported by the first terminal and the second terminal as the target cooperative play mode through negotiation, so that the first terminal and the second terminal can effectively complete cooperative play of multimedia content corresponding to the multimedia identifier of the first terminal without equipment play copyright.

In one possible design, when the first terminal and the second terminal negotiate to select a target cooperative play mode, the target cooperative play mode may be any one cooperative play mode selected randomly from at least one cooperative play mode; or alternatively

The target cooperative play mode may be a cooperative play mode with a highest priority among at least one cooperative play mode.

In the design, the implementation mode of selecting the target cooperative play mode is flexible and various, and the application requirements of different application scenes can be met. For example, the first terminal and the second terminal may select the target cooperative play mode through negotiation in two possible implementation manners. One possible implementation manner is to randomly select one cooperative play mode from at least one cooperative play mode supported by both the first terminal and the second terminal as a target cooperative play mode. Another possible implementation manner is to select a collaborative play mode with the highest priority from at least one collaborative play mode supported by both the first terminal and the second terminal as a target collaborative play mode.

In one possible design, the target collaborative playback mode may be one of the following collaborative playback modes: bluetooth playing mode, mirror image screen-throwing playing mode, DLNA screen-throwing playing mode or circulation playing mode.

In the design, the cooperative play modes are various, different use requirements of the terminals can be met, and the first terminal and the second terminal can negotiate a cooperative play mode meeting the requirements of the two parties as a target cooperative play mode.

In one possible design, the first terminal sends the second indication information to the second terminal, including:

When detecting that the remaining playing duration of the multimedia file or the multimedia data stream corresponding to the second multimedia identifier is less than or equal to the duration threshold, the first terminal can generate second indication information, and then the first terminal can send the second indication information to the second terminal.

The second multimedia identifier is a multimedia identifier in the multimedia information list, wherein the playing sequence of the multimedia identifier is positioned before the first multimedia identifier. For example, the second multimedia presentation is located before and adjacent to the first multimedia presentation.

In the above design, when the first terminal does not have the device playing copyright of the first multimedia identifier, if the playing sequence of the first multimedia identifier is not located at the starting position, the first terminal detects that the playing sequence of the second multimedia identifier located in front of the first multimedia identifier in the multimedia information list is smaller than or equal to the duration threshold, the second indication information can be generated and the second indication information can be timely sent to the second terminal, so that the second terminal can timely judge that the first multimedia identifier plays copyright support information for the device playing of the second terminal, thereby being convenient for the second terminal to effectively negotiate with the first terminal about a target collaborative playing mode for playing the multimedia content corresponding to the first multimedia identifier, further realizing automatic collaborative playing among multiple terminals of the multimedia content corresponding to the multimedia identifier (such as the first terminal) without the device playing copyright, and bringing non-perception playing experience to the user of the terminal.

Optionally, when the first terminal does not have the device playing copyright of the first multimedia identifier, if the playing sequence of the first multimedia identifier is located at the starting position, the first terminal may directly generate the second indication information and send the second indication information to the second terminal.

In a second aspect, an embodiment of the present application provides a collaborative playback method based on multimedia rights, which may be performed by a second terminal or a component (such as a chip system or a circuit) capable of supporting functions required for the second terminal to implement the method. Optionally, taking the second terminal as an example to execute a collaborative play method based on the multimedia copyright, in the method, when the second terminal receives a collaborative play instruction issued by a user, first indication information may be sent to the first terminal, where the collaborative play instruction is used to instruct the first terminal to cooperatively play multimedia to be played in the second terminal through data interaction with the second terminal; the first indication information is used for indicating a multimedia information list to be played in the second terminal, the multimedia information list comprises at least one multimedia identifier, the at least one multimedia identifier comprises a first multimedia identifier, and then when the second terminal receives the second indication information from the first terminal, the second terminal sends a multimedia data stream corresponding to the first multimedia identifier to the first terminal. Optionally, the second indication information may be used to indicate that the first terminal does not have the playing copyright of the device with the first multimedia identifier, or the second indication information may also carry the first multimedia identifier.

In the above design, in the process of playing the multimedia to be played in the second terminal in the cooperation of the first terminal and the second terminal, the multimedia file corresponding to the multimedia identifier can be independently played by the first terminal for the multimedia identifier with the equipment playing copyright of the first terminal, so that the multimedia file corresponding to the multimedia identifier with the equipment playing copyright of the first terminal can be independently played, the transcoding detail loss of the multimedia data in the transmission process can be effectively reduced, and the playing experience of the multimedia data can be improved. For the multimedia identifier of the first terminal without the equipment playing copyright, after the first terminal is required to feed back the multimedia identifier to the second terminal, the second terminal transmits the multimedia data stream corresponding to the multimedia identifier to the first terminal for playing, so that the multimedia content corresponding to the multimedia identifier of a certain terminal (such as the first terminal) without the equipment playing copyright can be automatically and cooperatively played among multiple terminals, and the non-perception playing experience can be brought to the user of the terminal.

In one possible design, the second indication information may be generated when the first terminal detects that a remaining playing duration of a multimedia file or a multimedia data stream corresponding to the second multimedia identifier is less than or equal to a duration threshold, where the second multimedia identifier is a multimedia identifier in the multimedia information list, and a playing order of the multimedia identifier is located before the first multimedia identifier.

In one possible design, the second terminal sends a multimedia data stream corresponding to the first multimedia identifier to the first terminal, including:

The second terminal can negotiate a target collaborative play mode corresponding to the first multimedia identifier with the first terminal. And then, the second terminal can establish a communication link corresponding to the target cooperative play mode with the first terminal, and then, the second terminal can send the multimedia data stream corresponding to the first multimedia identifier to the first terminal through the communication link corresponding to the target cooperative play mode.

In a third aspect, embodiments of the present application provide a first terminal, and the beneficial effects may be referred to the description of the first aspect, which is not repeated herein. The first terminal has functionality to implement the behavior in the method example of the first aspect described above. The functions may be implemented by hardware, or may be implemented by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the functions described above. In one possible design, the first terminal includes a first transceiver module and a first processing module. The first transceiver module is configured to receive first indication information from the second terminal, where the first indication information is used to indicate a multimedia information list to be played in the second terminal, and the multimedia information list includes a first multimedia identifier. The first processing module is used for downloading the multimedia file corresponding to the first multimedia identifier from the service equipment and playing the multimedia file when the equipment with the first multimedia identifier of the first terminal plays the copyright; or when the first terminal does not have the device playing copyright of the first multimedia identifier, sending second instruction information to the second terminal, receiving the multimedia data stream corresponding to the first multimedia identifier from the second terminal, and playing the media data stream from the second terminal, wherein the second instruction information is used for instructing the first terminal not to have the device playing copyright of the first multimedia identifier. These modules may perform the corresponding functions in the design of any one of the possible implementations of the first aspect, which are specifically referred to in the detailed description of the method examples and are not described here in detail.

In a fourth aspect, an embodiment of the present application provides a first terminal, where the first terminal includes a first communication interface and a first processor. Optionally, the first terminal further includes a first memory. The first memory is configured to store a computer program or instructions, and the first processor is coupled to the first memory and the first communication interface, and when the first processor executes the computer program or instructions, the first terminal is caused to execute the method in any one of the possible designs of the first aspect.

In a fifth aspect, embodiments of the present application provide a second terminal, and the beneficial effects may be referred to the description of the second aspect, which is not repeated herein. The second terminal has the functionality to implement the behavior in the method example of the second aspect described above. The functions may be implemented by hardware, or may be implemented by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the functions described above. In one possible design, the second terminal includes a second transceiver module and a second processing module. The second transceiver module is configured to receive a collaborative play instruction issued by a user, where the collaborative play instruction is used to instruct the first terminal to interact with the second terminal through data, and cooperatively play multimedia to be played in the second terminal. The second processing module is configured to send first indication information to the first terminal according to the collaborative play instruction, where the first indication information is used to indicate a multimedia information list to be played in the second terminal, and the multimedia information list includes a first multimedia identifier. The second processing module is further configured to send, to the first terminal, a multimedia data stream corresponding to the first multimedia identifier when receiving second indication information from the first terminal, where the second indication information is used to indicate that the first terminal does not have a device playing right of the first multimedia identifier. These modules may perform the corresponding functions in the design of any one of the possible implementations of the second aspect, which are specifically referred to in the detailed description of the method examples and are not described here in detail.

In a sixth aspect, an embodiment of the present application provides a second terminal, where the second terminal includes a second communication interface and a second processor. Optionally, the second terminal further comprises a second memory. Wherein the second memory is configured to store a computer program or instructions, and the second processor is coupled to the second memory and the second communication interface, such that the second terminal is caused to perform the method according to any one of the possible designs of the second aspect.

In a seventh aspect, embodiments of the present application provide a computer program product comprising a computer program or instructions which, when run on a computer, cause the computer to perform the method of any one of the possible designs of the first aspect described above or the method of any one of the possible designs of the second aspect described above.

In an eighth aspect, embodiments of the present application provide a computer-readable storage medium having stored therein a computer program or instructions which, when executed by a computer, cause the computer to perform the method of any one of the possible designs of the first aspect or the method of any one of the possible designs of the second aspect.

In a ninth aspect, embodiments of the present application further provide a chip coupled to a memory, the chip being configured to read a computer program stored in the memory, to perform the method of any one of the possible designs of the first aspect or the method of any one of the possible designs of the second aspect.

In a tenth aspect, embodiments of the present application further provide a chip system, the chip system including a processor for supporting a computer device to implement the method of any one of the possible designs of the first aspect or the method of any one of the possible designs of the second aspect. In one possible design, the chip system further includes a memory for storing programs and data necessary for the computer device. The chip system may be formed of a chip or may include a chip and other discrete devices.

Further combinations of the present application may be made to provide further implementations based on the implementations provided in the above aspects.

Drawings

Fig. 1 schematically illustrates a possible application scenario provided by an embodiment of the present application;

fig. 2 schematically illustrates a structure of a terminal according to an embodiment of the present application;

Fig. 3 is a schematic flow chart illustrating a collaborative playback method based on multimedia rights according to an embodiment of the present application;

Fig. 4 is a schematic flow chart illustrating another collaborative playback method based on multimedia rights according to an embodiment of the present application;

fig. 5 schematically illustrates a structural diagram of one possible first terminal according to an embodiment of the present application;

fig. 6 schematically illustrates a structural diagram of one possible first terminal according to an embodiment of the present application;

fig. 7 schematically illustrates a structural diagram of a possible second terminal according to an embodiment of the present application;

fig. 8 schematically illustrates a possible second terminal structure according to an embodiment of the present application.

Detailed Description

Embodiments of the present application will be described in detail below with reference to the accompanying drawings.

In the following, possible application scenarios of the present application are described. It should be noted that these descriptions are for the purpose of facilitating understanding by those skilled in the art, and are not intended to limit the scope of the application as claimed.

Fig. 1 schematically illustrates one possible application scenario to which the embodiment of the present application is applicable. As shown in fig. 1, the application scenario includes a terminal 100 and a terminal 200.

The terminal 100 or the terminal 200 may be an entity with a signal receiving and transmitting function on the user side, and may provide service functions such as audio, video, voice, and data connectivity for the user. Alternatively, terminal 100 or terminal 200 may also have data processing capabilities. Alternatively, the terminal 100 may have a multimedia application installed thereon, and the terminal 200 may have a multimedia application installed thereon.

By way of example, the terminal 100 or the terminal 200 may be a smart phone, a tablet computer, a desktop computer, a computer with a wireless transceiving function (such as a notebook computer, etc.), a palm computer (Personal DIGITAL ASSISTANT, PPD), a mobile internet device (mobile INTERNET DEVICE, MID), a vehicle-mounted terminal (such as a cabin car machine, which may also be referred to as a vehicle-mounted infotainment system), a wearable device with a wireless communication function (such as a smart watch, a smart bracelet, a smart glasses, a smart helmet, etc.), a Virtual Reality (VR) device, an augmented reality (augmented reality, AR) device, a smart home device (such as a smart speaker, a smart television, etc.), etc. It should be understood that the specific device configuration of the terminal is not limited by the present application.

Alternatively, a communication connection may be made between the terminal 100 and the terminal 200. The terminal 100 and the terminal 200 may be communicatively connected by a wired network, or may be communicatively connected by a wireless network, which is not limited in this embodiment of the present application.

Alternatively, when the terminal 100 and the terminal 200 are communicatively connected by a wireless network, the wireless network may be a wireless local area network (wireless local area networks, WLAN), such as a wireless fidelity (WIRELESS FIDELITY, wifi) network, a ZigBee network, a Bluetooth (BT) network, or a near field communication (NEAR FIELD communication) network, or may be another form of communication network, which is not limited in this embodiment of the present application.

In the following, taking the terminal 100 as a smart phone and the terminal 200 as a smart speaker as an example, a multimedia collaborative play scenario between the terminal 100 and the terminal 200 will be described. Optionally, a multimedia application (such as a music application or a video application or application software for playing a television series, a movie, etc.) is installed on the smart phone, and a multimedia application is installed on the smart speaker. For example, when a user wants to play music to be played in a smart phone through a smart speaker in a home or other places, or when the user listens to songs using a music application installed in a smart phone owned by the user outdoors and returns to home to play music to be played in the smart phone through the smart speaker, the user may perform a corresponding collaborative play instruction operation in the smart phone (for example, the user may input a collaborative play command in the smart phone or click a collaborative play button), which is used to instruct the smart phone to play songs to be played in the smart phone through the smart speaker.

After receiving the collaborative play instruction operation of the user, the smart phone can establish a streaming communication link with the smart sound box, and stream the music information list to be played in the smart phone to the smart sound box through the streaming communication link. Optionally, the music information list includes at least one music identifier. After receiving the song information list, the intelligent sound box can identify equipment copyright for at least one music identifier contained in the music information list. Optionally, for a certain music identifier with playing copyright of the intelligent sound box, the intelligent sound box can independently download a music file corresponding to the music identifier from the music platform, and can independently play the music file, so that a loss-free music experience can be provided for a user; for a certain music identifier of which the intelligent sound box does not have equipment playing copyright, the intelligent sound box can send corresponding indication information to the intelligent mobile phone. The indication message is used for indicating that the intelligent sound box does not have the equipment playing copyright of the music identifier. Optionally, the indication message may include the music identifier.

After receiving the indication information from the intelligent sound box, the intelligent mobile phone can automatically negotiate with the intelligent sound box, and select one cooperative play mode from the cooperative play modes (also called cooperative play capability) supported by the intelligent mobile phone and the intelligent sound box respectively to play the music corresponding to the music identifier. Optionally, the collaborative playback manner may include, but is not limited to: bluetooth playing mode, mirror image screen-throwing playing mode, DLNA screen-throwing playing mode or circulation playing mode, etc. By taking the negotiated cooperative play mode as an example of the bluetooth play mode, the smart phone may establish a bluetooth communication link with the smart speaker, and may transmit a music data stream (i.e. an audio stream) corresponding to the music identifier to the smart speaker through the bluetooth communication link for playing, where the smart speaker is used as a bluetooth sound device.

It should be noted that, the application scenario shown in fig. 1 is only an example, and the schematic application scenario is for more clearly describing the technical solution of the embodiment of the present application, and is not limited to the application scenario configuration of the image processing method provided by the present application. Also, the form and number of the respective structures in the application scenario shown in fig. 1 are only for example, and do not constitute a limitation of the present application. In addition, the names of the structures in the application scenario shown in fig. 1 are only an example, and the names of the structures in the specific implementation may be other names, which is not specifically limited in the present application.

Based on the application scenario shown in fig. 1, the application further provides a structure schematic diagram of the terminal. Referring to fig. 2, the terminal may be divided into the following functional modules according to logic functions: multimedia applications, streaming modules, collaborative playback modules, and the like. Alternatively, the multimedia application may include, but is not limited to, at least one of: the system comprises a circulation management module, a task management module, a cooperative management module, a transmission management module or a copyright management module and the like. Optionally, the collaborative playback module may include, but is not limited to, at least one of: bluetooth module, mirror image screen projection module or DLNA screen projection module, etc.

It should be noted that the connection relationship between the functional modules illustrated in fig. 2 is only an example, and does not limit the present application. The functions of the respective functional modules are described below.

And the circulation module is used for establishing circulation communication links between the terminals by using a certain communication protocol (such as circulation protocol) when the terminals need to cooperatively play the multimedia.

And the collaborative play module is used for realizing the function of playing multimedia cooperatively by the terminal. For example, the collaborative play module may be configured to implement a certain collaborative play mode (such as a bluetooth play mode, a mirror image screen-throwing play mode, or a DLNA screen-throwing play mode) between a plurality of terminals to cooperatively play multimedia.

And the Bluetooth module is used for establishing Bluetooth communication links between the terminals by using a Bluetooth protocol when the terminals select to play the multimedia in a Bluetooth playing mode through negotiation.

The mirror image screen-throwing module is used for establishing a mirror image screen-throwing communication link between the plurality of terminals by using a mirror image screen-throwing protocol when the plurality of terminals select to play the multimedia in a mirror image screen-throwing playing mode through negotiation.

The DLNA screen-throwing module is used for establishing a DLNA screen-throwing communication link between the plurality of terminals by using a DLNA screen-throwing protocol when the plurality of terminals select to play the multimedia in a DLNA screen-throwing playing mode through negotiation.

And the multimedia application is used for realizing the function of playing the multimedia of the terminal. For example, a multimedia application may be used to enable collaborative playback of multimedia between multiple terminals.

Alternatively, the multimedia application may be an application program installed on the terminal. For example, taking a multimedia application as an example of a music application, the music application may include, but is not limited to: Or (b) Etc.

And the circulation management module is used for managing and calling the circulation module.

And the task management module is used for managing and calling the collaborative management module according to the equipment playing copyright support information of the multimedia identifier to be played.

And the collaborative management module is used for negotiating a collaborative play mode of the terminal where the multimedia application is located.

And the transmission management module is used for transmitting and managing a collaborative play mode, multimedia play state information, multimedia identification information or multimedia streaming media data and the like negotiated among the plurality of terminals.

And the copyright management module is used for identifying the equipment playing copyright support information of the multimedia identifier to be played.

For example, taking two terminals (such as the terminal 100 and the terminal 200) as an example, when the terminal 100 needs to perform data interaction with the terminal 200, and cooperatively play the multimedia to be played in the terminal 100, the terminal 100 may call the streaming module through the streaming management module in the multimedia application, and the terminal 200 may also call the streaming module through the streaming management module in the multimedia application, so as to establish a streaming communication link between the terminal 100 and the terminal 200. Thereafter, the terminal 100 may stream the multimedia information list to be played in the terminal 100 to the terminal 200 through the streaming communication link. Optionally, the multimedia information list includes at least one multimedia identifier.

After receiving the multimedia information list, the terminal 200 may perform device copyright identification on at least one multimedia identifier included in the multimedia information list through a copyright management module in the multimedia application, and determine that at least one multimedia identifier has device type of the terminal 200 (i.e., device playing copyright of the terminal 200 with which multimedia identifier is authorized to play) among device types of the terminal 200, and does not have device type of the terminal 200 (i.e., device playing copyright of the terminal 200 with which multimedia identifier is not authorized to play) among device types of the terminal 200.

Alternatively, when the terminal 200 has a device playing copyright of a certain multimedia identifier, the multimedia application in the terminal 200 may download the multimedia file corresponding to the multimedia identifier from the corresponding multimedia platform, and may play the multimedia file corresponding to the multimedia identifier.

Alternatively, when the terminal 200 does not have a device with a certain multimedia identifier to play the copyright, the multimedia application in the terminal 200 may send the corresponding indication information to the terminal 100 through the streaming communication link. The indication information is used for indicating that the terminal 200 does not have the playing copyright of the device with the multimedia identifier. Optionally, the indication information may include the multimedia identifier. After receiving the indication information, when the terminal 100 recognizes that the terminal 100 has the device playing copyright of the multimedia identifier through the copyright management module in the multimedia application, the terminal 100 may invoke the collaborative management module in the multimedia application through the task management module in the multimedia application to negotiate a target collaborative playing mode (such as a mirror image screen projection playing mode) corresponding to the multimedia identifier with the terminal 200. After that, the terminal 100 establishes a mirror image screen-projection communication link with the terminal 200 by using a mirror image screen-projection protocol according to the mirror image screen-projection playing mode, and transmits the multimedia data stream corresponding to the multimedia identifier to the terminal 200 for playing through the mirror image screen-projection communication link.

Taking a multimedia application as a video application, taking a multimedia information list as a video information list as an example, it is assumed that 3 video identifications, namely a video identification a, a video identification b and a video identification c, are included in the multimedia information list, and it is assumed that a play order corresponding to the video identification a precedes a play order corresponding to the video identification b, and a play order corresponding to the video identification b precedes a play order corresponding to the video identification c. Wherein, the terminal 200 has the device playing copyright of the video identifier a, the terminal 200 does not have the device playing copyright of the video identifier b, and the terminal 200 has the device playing copyright of the video identifier c.

When the video identifier a to be played is identified according to the playing sequence corresponding to each video identifier, because the terminal 200 has the equipment playing copyright of the video identifier a, the video application in the terminal 200 can download the video file corresponding to the video identifier a from the corresponding video platform and can play the video file corresponding to the video identifier a. When it is detected that the playing of the video file corresponding to the video identifier a is about to end (for example, the remaining duration of the video playing is 10 s) and the next video identifier to be played is the video identifier b, because the terminal 200 does not have the device playing copyright of the video identifier b, the video application in the terminal 200 needs to send corresponding indication information to the terminal 100. The indication information is used for indicating that the terminal 200 does not have the device playing copyright of the video identifier b. Alternatively, the indication information may include the video identifier b. After receiving the indication information, when the terminal 100 recognizes that the terminal 100 has the device playing copyright of the video identifier b through the copyright management module in the video application, the terminal 100 may call the collaborative management module in the video application through the task management module in the video application, and negotiate a target collaborative play mode (such as a DLNA screen-throwing play mode) corresponding to the video identifier b with the terminal 200. Then, the video application in the terminal 100 may use the DLNA screen-projection protocol to establish a DLNA screen-projection communication link with the terminal 200 according to the DLNA screen-projection playing mode, and transmit the video data stream corresponding to the video identifier b to the terminal 200 for playing through the DLNA screen-projection communication link.

When it is detected that the video playing corresponding to the video identifier b is finished and the next video identifier to be played is the video identifier c, because the terminal 200 has the device playing copyright of the video identifier c, the video application in the terminal 100 can send corresponding indication information to the terminal 200. The corresponding indication information is used for indicating that the video data stream corresponding to the video identifier b is played. Optionally, the corresponding indication information may include a video identifier b. After receiving the corresponding indication information, when the video identifier with the playing sequence located after the video identifier b is the video identifier c, because the terminal 200 has the device playing copyright of the video identifier c, the video application in the terminal 200 can download the video file corresponding to the video identifier c from the corresponding video platform and can play the video file corresponding to the video identifier c.

The following describes in detail a specific implementation of the collaborative playback method based on multimedia rights in the embodiment of the present application based on the application scenario shown in fig. 1.

Fig. 3 is a schematic flow chart illustrating a collaborative playback method based on multimedia rights according to an embodiment of the present application. The method is applicable to the application scenario illustrated in fig. 1. The method flow can be realized by data interaction among a plurality of terminals. Illustratively, two terminals (such as terminal a and terminal B) are taken as an example, terminal a may be terminal 100 as illustrated in fig. 1, terminal B may be terminal 200 as illustrated in fig. 1, or terminal a may be terminal 200 as illustrated in fig. 1, and terminal B may be terminal 100 as illustrated in fig. 1. In order to facilitate the description of the technical solution provided by the embodiments of the present application, the following description will take, as an example, a process of implementing a collaborative playback method based on multimedia rights by performing data interaction between two terminals (for example, one terminal is a first terminal and the other terminal is a second terminal). As shown in fig. 3, the method includes:

step 301: when a collaborative play instruction issued by a user is received, the second terminal sends first indication information to the first terminal.

Optionally, the collaborative play instruction may be used to instruct the first terminal to cooperatively play the multimedia to be played in the second terminal through data interaction with the second terminal.

For example, when the user of the second terminal wants to cooperatively play the multimedia (such as music, television play, movie, video or animation) to be played in the second terminal through other terminals (such as the first terminal), the user of the second terminal may perform a corresponding cooperative play instruction operation in the second terminal (such as the user of the second terminal may input a cooperative play command in the second terminal or click on a cooperative play button), so as to form a cooperative play instruction issued by the user of the second terminal to the second terminal.

Optionally, the second terminal may also display a collaborative play prompt interface to the user to which the second terminal belongs after identifying that the first terminal to which the multimedia to be played in the second terminal is to be collaborative played exists in the vicinity, where the user to which the second terminal belongs triggers a corresponding operation on the collaborative play prompt interface (for example, the user to which the second terminal belongs inputs a collaborative play command on the collaborative play prompt interface or clicks a collaborative play button on the collaborative play prompt interface), so as to form a collaborative play command issued by the user to the second terminal by the user to which the second terminal belongs.

For example, the first indication information may be used to indicate a multimedia information list to be played in the second terminal, where the multimedia information list may include one or more multimedia identifications, such as the first multimedia identification or the second multimedia identification, etc.

Optionally, before the second terminal sends the first indication information to the first terminal, the second terminal may establish a streaming communication link with the first terminal according to a collaborative play instruction issued by a user to which the second terminal belongs. For example, the second terminal and the first terminal may establish a streaming communication link between the second terminal and the first terminal based on a streaming protocol. For example, the streaming communication link may be used to transmit a first indication message (for example, the first indication message carries a multimedia information list or a multimedia playing progress, etc.), a second indication message (for example, the second indication message carries one or more multimedia identifications without device playing copyrights), a multimedia playing state, a negotiated collaborative playing mode, etc.

In an exemplary embodiment, taking a first terminal as a smart speaker and a second terminal as a smart phone as an example, a user to whom the smart phone belongs uses a music application installed in the smart phone outdoors to listen to songs, after the smart phone returns indoors from outdoors, the smart phone can display a collaborative play prompt interface to the user when detecting that the smart speaker capable of performing data interaction with the smart phone exists indoors and playing music to be played in the smart phone in a collaborative manner. The user triggers corresponding operation on the collaborative play prompt interface (for example, the user of the smart phone inputs a collaborative play command on the collaborative play prompt interface or clicks a collaborative play button on the collaborative play prompt interface), so as to form an instruction for indicating the smart phone to interact with the smart sound box through data and cooperatively play the multimedia to be played in the smart phone. And after receiving the instruction, the smart phone sends corresponding indication information to the smart sound box. Optionally, the corresponding indication information carries a list of music information (such as music identifier 1-5) that the user needs to play currently, or may also carry a playing progress of a certain music identifier that the user is playing currently (such as a progress that music identifier 1 has been played to 30 s).

Step 302: when the first terminal has the equipment playing copyright of the first multimedia identifier, the first terminal downloads the multimedia file corresponding to the first multimedia identifier from the service equipment and plays the multimedia file.

Optionally, after receiving the first indication information, the first terminal may identify a device playing right of one or more multimedia identifiers included in the multimedia information list, and determine device playing right support information of the one or more multimedia identifiers for the first terminal, for example, device playing rights of which multimedia identifiers the first terminal has, or device playing rights of which multimedia identifiers the first terminal does not have. For example, taking a first multimedia identifier included in the multimedia information list as an example, when the first terminal has a device playing copyright of the first multimedia identifier, the first terminal may download a multimedia file corresponding to the first multimedia identifier from a corresponding service device (such as a multimedia service device), and may play the multimedia file corresponding to the first multimedia identifier.

Illustratively, based on the foregoing, the following several possible examples are presented to implement the device play right identification by the first terminal on one or more multimedia identifications included in the multimedia information list.

Example one: when the multimedia information list contains a multimedia identifier, the first terminal may perform device play rights identification on the multimedia identifier according to the device rights support information (such as a device play rights mapping table) of a plurality of pre-stored multimedia identifiers, and determine whether a device type of the first terminal exists in at least one device type authorized to play by the multimedia identifier. When the equipment type of the first terminal exists in at least one equipment type authorized to play by the multimedia identifier, the first terminal determines that the first terminal has the equipment playing copyright of the multimedia identifier. When the device type of the first terminal does not exist in at least one device type of the multimedia identifier authorized to play, the first terminal determines that the first terminal does not have the device play copyright of the multimedia identifier. The device copyright supporting information (such as a device playing copyright mapping relation table) of the plurality of multimedia identifiers comprises a corresponding relation between the multimedia identifiers and the device types with playing rights.

Illustratively, taking the device play right mapping relation table as an example, the representation form of the device play right mapping relation table may be referred to in table 1.

TABLE 1

Multimedia identification	Device type with play rights
		Sign 1	Device type 1 or device type 2, etc
Sign 2	Device type 1, device type 3, device type 4, etc
		Sign 3	Device type 2 or device type 5, etc
……	……

It should be noted that table 1 is only a simple example, and is for convenience of describing the technical solutions in the embodiments of the present application, and is not limited to the technical solutions in the embodiments of the present application.

Example two: when the multimedia information list includes a plurality of multimedia identifications, the first terminal may perform device play copyright identification on the plurality of multimedia identifications according to the pre-stored device copyright support information of the plurality of multimedia identifications, and determine whether one or more device types of the plurality of multimedia identifications authorized to play have the device type of the first terminal (for example, which multimedia identifications authorized to play have the device type of the first terminal, and which multimedia identifications authorized to play do not have the device type of the first terminal). For example, taking the first multimedia identifier as an example, when there is a device type of the first terminal in one or more device types authorized for playing by the first multimedia identifier, the first terminal determines that the first terminal has a device playing right of the first multimedia identifier. When the device type of the first terminal does not exist in the one or more device types authorized to play by the first multimedia identifier, the first terminal determines that the first terminal does not have the device play copyright of the first multimedia identifier. Wherein the first multimedia tag is any one of a plurality of multimedia tags.

For example, taking a device play rights mapping table as an example, where the multimedia information list includes 3 multimedia identifiers (such as identifier 1, identifier 2 and identifier 3), the device rights support information of the plurality of multimedia identifiers is assumed that the device type of the first terminal is device type 1. The first terminal can judge that the first terminal has the equipment playing copyrights of the identifier 1 and the identifier 2 according to the pre-stored equipment playing copyrights mapping relation table, and the first terminal does not have the equipment playing copyrights of the identifier 3.

Alternatively, the device copyright support information of the plurality of multimedia identifications mentioned in the above example one or example two may be obtained in advance by the first terminal from a cloud (may also be referred to as a cloud or a cloud server, etc.) or other devices (such as a distributed computer or a data center, etc. storing the device copyright support information of the plurality of multimedia identifications).

Optionally, after receiving the first indication information, the first terminal may also send the multimedia information list to the cloud end or other devices. After receiving the multimedia information list, the cloud or other devices can identify the device playing rights of one or more multimedia identifiers contained in the multimedia information list according to the device playing rights support information of the multimedia identifiers, and determine the device playing rights support information of the one or more multimedia identifiers for the first terminal, such as the device playing rights of the first terminal with which multimedia identifiers or the device playing rights of the first terminal without which multimedia identifiers. The cloud or other device may then send the one or more multimedia identifications to the first terminal's device playback rights support information.

For example, taking the first multimedia identifier included in the multimedia information list as an example, after the first terminal receives the first multimedia identifier play copyright support information for the device of the first terminal from the cloud or other devices, it can be known whether the first terminal has the device play copyright of the first multimedia identifier. When the first terminal has the device playing copyright of the first multimedia identifier, the first terminal can download the multimedia file corresponding to the first multimedia identifier by corresponding service equipment (such as multimedia service equipment) and can play the multimedia file corresponding to the first multimedia identifier.

Illustratively, based on the foregoing, the following description describes the implementation of device play rights identification by a cloud or other device for one or more multimedia identifications included in a multimedia information list through several possible examples.

Example one: when the multimedia information list contains a multimedia identifier, the cloud or other devices perform device play copyright identification on the multimedia identifier according to device copyright support information (such as a device play copyright mapping relation table) of a plurality of multimedia identifiers, and determine whether a device type of the first terminal exists in at least one device type authorized to play by the multimedia identifier. When the equipment type of the first terminal exists in at least one equipment type authorized to play by the multimedia identifier, the cloud or other equipment determines that the first terminal has the equipment playing copyright of the multimedia identifier. When the device type of the first terminal does not exist in at least one device type authorized to play by the multimedia identifier, the cloud or other devices determine that the first terminal does not have the device play copyright of the multimedia identifier. Then, the cloud or other devices may send the situation that the first terminal has the playing rights of the device with the multimedia identifier or the situation that the first terminal does not have the playing rights of the device with the multimedia identifier to the first terminal.

Example two: when the multimedia information list contains a plurality of multimedia identifications, the cloud or other equipment carries out equipment playing copyright identification on the plurality of multimedia identifications according to equipment copyright supporting information of the plurality of multimedia identifications, and whether the equipment type of the first terminal exists in one or more equipment types authorized to be played by the plurality of multimedia identifications is determined. For example, taking the first multimedia identifier as an example, when there is a device type of the first terminal in one or more device types authorized for playing by the first multimedia identifier, the first terminal determines that the first terminal has a device playing right of the first multimedia identifier. When the device type of the first terminal does not exist in the one or more device types authorized to play by the first multimedia identifier, the first terminal determines that the first terminal does not have the device play copyright of the first multimedia identifier. Wherein the first multimedia tag is any one of a plurality of multimedia tags. The cloud or other device may then send the device playback rights support information for the plurality of multimedia identifications for the first terminal (e.g., the device playback rights for the first terminal that have or do not have the plurality of multimedia identifications).

Step 303: and when the first terminal does not have the equipment playing copyright of the first multimedia identifier, the first terminal sends second indication information to the second terminal.

Step 304: and the second terminal sends the multimedia data stream corresponding to the first multimedia identifier to the first terminal according to the second indication information.

Optionally, when the first terminal does not have the device playing copyright of the first multimedia identifier, the first terminal may send second indication information to the second terminal through a streaming communication link or other communication links that may be used to transmit indication information, where the second indication information is used to indicate that the first terminal does not have the device playing copyright of the first multimedia identifier. Optionally, the second indication information may carry the first multimedia identifier. In addition, in other examples, the second indication information may also be used to indicate that the first terminal does not have the device playback rights of a plurality of consecutive multimedia identifications, for example, the second indication information may be used to indicate that the first terminal does not have the device playback rights of the multimedia identifications 5, 6 and 7, or may also be used to indicate that the first terminal does not have the device playback rights of a plurality of discontinuous multimedia identifications, for example, the second indication information may be used to indicate that the first terminal does not have the device playback rights of the multimedia identifications 3, 6 and 7.

After receiving the second indication information, the second terminal can acquire the multimedia data stream corresponding to the first multimedia identifier and send the multimedia data stream corresponding to the first multimedia identifier to the first terminal. Optionally, after receiving the second indication information, the second terminal may also determine whether the second terminal has the device playing copyright of the first multimedia identifier. When the second terminal has the device playing copyright of the first multimedia identifier, the second terminal may locally query the multimedia data stream corresponding to the first multimedia identifier, or may download the multimedia file corresponding to the first multimedia identifier from a corresponding service device (such as a multimedia service device), and may convert the multimedia file corresponding to the first multimedia identifier into the multimedia data stream corresponding to the first multimedia identifier. The second terminal may then send the multimedia data stream corresponding to the first multimedia identifier to the first terminal.

Optionally, the implementation manner of determining, in steps 303 to 304, that the second terminal has the playing right of the device with the first multimedia identifier may refer to the implementation manner of determining, in step 302, that the first terminal has the playing right of the device with the first multimedia identifier, which is not described herein.

Illustratively, based on the foregoing, the following description describes how the first terminal sends the second indication information to the second terminal by using the following several possible examples.

Example one: when the first terminal does not have the equipment playing copyright of the first multimedia identifier, the first terminal can generate second indication information when detecting that the residual playing duration of the multimedia file corresponding to the second multimedia identifier is less than or equal to a duration threshold value, and can send the second indication information to the second terminal through a circulation communication link.

The second multimedia identifier may be a multimedia identifier in the multimedia information list, where the playing sequence of the multimedia identifier is located before the first multimedia identifier, and the first terminal has a playing copyright of the device of the second multimedia identifier, and the playing sequence of the first multimedia identifier is not located at the starting position in the multimedia information list.

Alternatively, when the first terminal does not have the device playing copyrights of the first multimedia identifier, if the playing order of the first multimedia identifier is at the starting position in the multimedia information list, the first terminal may directly generate the second indication information and send the second indication information to the second terminal.

Example two: when the first terminal does not have the equipment playing copyright of the first multimedia identifier, the first terminal can generate second indication information when detecting that the residual playing duration of the multimedia data stream corresponding to the second multimedia identifier is less than or equal to a duration threshold value, and can send the second indication information to the second terminal through a circulation communication link.

The second multimedia identifier may be a multimedia identifier in the multimedia information list, where the playing sequence of the multimedia identifier is located before the first multimedia identifier, and the first terminal does not have a playing copyright of the device of the second multimedia identifier, and the playing sequence of the first multimedia identifier is not located at a starting position in the multimedia information list.

Optionally, before sending the multimedia data stream corresponding to the first multimedia identifier to the first terminal, the second terminal may negotiate, with the first terminal, a target collaborative play mode corresponding to the first multimedia identifier, where the target collaborative play mode is used to play the multimedia data stream corresponding to the first multimedia identifier. And then, the second terminal can establish a communication link corresponding to the target cooperative play mode with the first terminal according to the target cooperative play mode. And then, the second terminal can send the multimedia data stream corresponding to the first multimedia identifier to the first terminal through the communication link corresponding to the target cooperative play mode for playing.

Optionally, in the process of negotiating the target cooperative play mode with the first terminal, the second terminal may transmit, through a communication link between the first terminal and the second terminal, at least one cooperative play mode that the second terminal has or supports to the first terminal. Of course, the first terminal may also transmit, to the second terminal, at least one cooperative play mode that the first terminal has or supports, through a streaming communication link between the first terminal and the second terminal. Thus, the first terminal and the second terminal can mutually acquire the cooperative play mode which is possessed or supported by each other through the circulation communication link, so that the first terminal and the second terminal can conveniently and effectively negotiate a target cooperative play mode which meets the requirements of the two parties in time.

Illustratively, the collaborative playback manner may include, but is not limited to: bluetooth playing mode, mirror image screen-throwing playing mode, DLNA screen-throwing playing mode or circulation playing mode, etc.

Based on the foregoing, the following description describes the implementation procedure of the second terminal negotiating the target collaborative play mode corresponding to the first multimedia identifier with the first terminal through the following several possible implementation manners.

Mode one: the second terminal randomly selects one cooperative play mode from at least one cooperative play mode shared by the second terminal and the first terminal as a target cooperative play mode through negotiating with the first terminal.

Mode two: the second terminal negotiates with the first terminal, and selects a cooperative play mode with the highest priority from at least one cooperative play mode shared by the second terminal and the first terminal as a target cooperative play mode according to the priorities of the plurality of cooperative play modes.

Mode three: the second terminal negotiates with the first terminal, orders the priority of at least one cooperative play mode shared by the second terminal and the first terminal according to the order of the priority from high to low, and can take any one cooperative play mode of the cooperative play modes with the priority ordered in the first m as a target cooperative play mode.

Step 305: the first terminal plays the multimedia data stream corresponding to the first multimedia identifier.

Optionally, the second terminal may play the multimedia data stream corresponding to the first multimedia identifier through the first terminal serving as the sounding device according to the target cooperative play mode.

In an exemplary embodiment, taking a bluetooth playing mode as an example of a target cooperative playing mode negotiated by the first terminal and the second terminal, the second terminal plays the multimedia data stream corresponding to the first multimedia identifier through the first terminal serving as the bluetooth sounding device according to the bluetooth playing mode.

Optionally, in an example, when the first terminal finishes playing the multimedia data stream corresponding to the first multimedia identifier, if the first terminal has the device playing copyright of the third multimedia identifier, the second terminal may send third indication information to the first terminal through the streaming communication link, where the third indication information is used to indicate that the playing of the multimedia data stream corresponding to the first multimedia identifier has ended. Optionally, the third indication information may include a first multimedia identifier, and the third multimedia identifier may be a multimedia identifier in the multimedia information list, where the playing order of the multimedia identifiers is located after the first multimedia identifier.

After receiving the third indication information, the first terminal detects that the multimedia identifier in the multimedia information list, the playing sequence of which is located behind the first multimedia identifier, is the third multimedia identifier, and because the first terminal has the device playing copyright of the third multimedia identifier, the first terminal can download the multimedia file corresponding to the third multimedia identifier from the corresponding service device (such as the multimedia service device) and can play the multimedia file corresponding to the third multimedia identifier.

For example, based on the technical solutions provided in the foregoing steps 301 to 305, referring to fig. 4, taking the first terminal as a smart speaker, the second terminal as a smart phone, and taking multimedia as music as an example, the implementation process of performing data interaction between the smart phone and the smart speaker and playing music in the smart phone cooperatively is described. The intelligent sound box is provided with a music application, and cloud end identifies that music plays copyright support information to the intelligent sound box or equipment of the intelligent sound box. As shown in fig. 4, the method includes:

Step 401: the intelligent mobile phone and the intelligent sound box establish a circulation communication link through a circulation module.

For example, the streaming communication link may be used to stream a music information list, a music playing progress or a music playing status (such as a music file corresponding to a certain music identifier or a music data stream playing end), or the like, or may also be used to negotiate a target collaborative playing manner between the first terminal and the second terminal.

Optionally, the smart phone may call the circulation module through a circulation management module in a music application installed on the smart phone, and the smart speaker may call the circulation module through a circulation management module in a music application installed on the smart speaker, so as to establish a circulation communication link between the smart phone and the smart speaker.

Step 402: the smart phone sends the music information list and the music playing progress to the smart sound box through the circulation communication link.

Alternatively, the music information list may include at least one music identifier, such as 10 music identifiers (i.e., identification information of 10 songs), that is, music identifiers 001 to 010.

Taking the example that the music identifier 001 currently being played by the smart phone as an example, it is assumed that the playing progress of the music identifier 001 currently being played by the smart phone is 45s.

Optionally, the smart phone may transfer the music identifier 001 to the music identifier 010 and the playing progress 45s of the music identifier 001 currently being played by the smart phone to the smart speaker through the transfer communication link.

Step 403: the intelligent sound box sends the music information list to the cloud.

In one example, after receiving the music information list and the music playing progress, the intelligent speaker may send the music information list to the cloud (i.e. a platform for identifying the playing rights of the device deployed by a developer of the music application), or may send the music information list to the cloud through the music application installed on the intelligent speaker, where the cloud identifies the playing rights of the device for at least one music identifier (such as the music identifier 001-music identifier 010) included in the music information list.

In another example, after receiving the music information list and the music playing progress, the intelligent sound box may also perform device playing copyright identification on at least one music identifier included in the music information list according to device copyright support information of a plurality of music identifiers acquired from the cloud or other devices.

Step 404: and the cloud performs equipment playing copyright identification on at least one music identifier contained in the music information list, and determines equipment playing copyright supporting information of the at least one music identifier for the intelligent sound box.

Optionally, taking the cloud end as an example of performing device playing copyright identification on at least one music identifier included in the music information list, after receiving the music information list, the cloud end can determine whether a device type of the intelligent sound box is included in a device type authorized to be played by each music identifier in the at least one music identifier according to the device copyright support information of the plurality of music identifiers. When the equipment type of the intelligent sound box is included in the equipment type authorized to play by the music identifier, the cloud end can determine that the intelligent sound box has the equipment playing copyright of the music identifier. When the equipment type of the intelligent sound box is not included in the equipment type authorized to play by the music identifier, the cloud can determine that the intelligent sound box does not have the equipment playing copyright of the music identifier.

For example, taking a music information list containing 10 music identifiers (for example, music identifiers 001-010) as an example, the cloud determines, according to the device copyright support information of the plurality of music identifiers, device playing copyright support information of the 10 music identifiers for the intelligent sound box, for example, the intelligent sound box has device playing copyrights of the music identifiers 001-003 and the music identifiers 007-010, and the intelligent sound box does not have device playing copyrights of the music identifiers 004-006.

Step 405: and the cloud end sends the equipment playing copyright support information of the at least one music identifier for the intelligent sound box to the intelligent sound box.

Optionally, after determining that the at least one music identifier corresponds to the device playing copyright support information of the intelligent sound box (for example, the intelligent sound box has the device playing copyright of the music identifier 001-003 and the music identifier 007-010, and the intelligent sound box does not have the device playing copyright of the music identifier 004-006), the cloud end may send the device playing copyright support information of the at least one music identifier corresponds to the intelligent sound box.

Step 406: when the intelligent sound box has the equipment playing copyright of the first music identifier, the intelligent sound box downloads the music file corresponding to the first music identifier from the music service equipment and plays the music file.

Step 407: when the intelligent sound box does not have the equipment playing copyright of the first music identifier, the intelligent sound box sends a first notification message to the intelligent mobile phone.

Optionally, the first music identifier is any one of at least one music identifier contained in the music information list.

Optionally, the first notification message may carry indication information for indicating that the intelligent sound box does not have the playing copyright of the device with the first music identifier, or may also carry the first music identifier.

For example, taking a music information list containing 10 music identifiers (for example, music identifiers 001-010) as an example, after receiving the device playing copyright support information of the 10 music identifiers from the cloud for the intelligent sound box, the intelligent sound box can know that the intelligent sound box has the device playing copyright of the music identifiers 001-003 and the music identifiers 007-010 and does not have the device playing copyright of the music identifiers 004-006.

Optionally, for the music identifier of the intelligent sound box with the equipment playing copyright, the intelligent sound box can directly and independently play the music corresponding to the music identifier. For example, the intelligent sound box has the device playing copyrights of the music identifiers 001-003, and the intelligent sound box can download the music files corresponding to the music identifiers 001-003 from the music service device (namely, the server deployed by the developer of the music application), and since the playing progress of the music identifier 001 is 45s, the intelligent sound box can start playing from the 45s playing position of the music file corresponding to the music identifier 001 until the music file corresponding to the music identifier 003. In addition, since the intelligent sound box does not have the equipment playing copyrights of the music identifiers 004-006, the intelligent sound box can send the first notification message to the smart phone through the circulation communication link when the music file corresponding to the music identifier 003 is played to be finished soon (for example, the residual playing time length of the music file corresponding to the music identifier 003 is less than or equal to 15 s). Optionally, the first notification message may carry a music identifier 004 to a music identifier 006, or may also carry indication information for indicating that the intelligent sound box does not have a device playing copyright of the music identifier 004 to the music identifier 006.

In an example, after receiving the first notification message, the smart phone may send the music identifier 004 to the music identifier 006 carried in the first notification message to the cloud, or may also send the music identifier 004 to the music identifier 006 to the cloud through a music application installed on the smart phone, and the cloud performs device play copyright identification on the music identifier 004 to the music identifier 006, so as to determine device play copyright support information of the music identifier 004 to the music identifier 006 on the smart phone.

Optionally, the cloud end may determine, according to the device copyright support information of the plurality of music identifiers, whether a device type of the smart phone is included in the device types authorized to be played by each of the music identifiers 004 to 006. When the device type of the smart phone is included in the device type authorized to play by the music identifier 004, the cloud can determine that the smart phone has the device playing copyright of the music identifier 004. When the device type of the smart phone is not included in the device type authorized to play by the music identifier 004, the cloud can determine that the smart phone does not have the device playing copyright of the music identifier 004. When the device type of the smart phone is included in the device type authorized to be played by the music identifier 005, the cloud can determine that the smart phone has the device playing copyright of the music identifier 005. When the device type of the smart phone is not included in the device type authorized to be played by the music identifier 005, the cloud end can determine that the smart phone does not have the device playing copyright of the music identifier 005. When the device type of the smart phone is included in the device type authorized to play by the music identifier 006, the cloud can determine that the smart phone has the device playing copyright of the music identifier 006. When the device type of the smart phone is not included in the device type authorized to play by the music identifier 006, the cloud can determine that the smart phone does not have the device playing copyright of the music identifier 006.

In another example, after receiving the first notification message, the smart phone may also perform device play rights identification on the music identifiers 004 to 006 according to the device rights support information of a plurality of music identifiers acquired from the cloud or other devices, and determine the device play rights support information of the music identifiers 004 to 006 for the smart phone.

Optionally, the smart phone may determine, according to the device copyright support information of the plurality of music identifiers, whether the device type of the smart phone is included in the device type authorized to play by each of the music identifiers 004 to 006. When the device type of the smart phone is included in the device type authorized to play by the music identifier 004, the smart phone can determine that the smart phone has the device playing copyright of the music identifier 004. When the device type of the smart phone is not included in the device type authorized to play by the music identifier 004, the smart phone can determine that the smart phone does not have the device playing copyright of the music identifier 004. When the device type of the smart phone is included in the device type authorized to play by the music identifier 005, the smart phone can determine that the smart phone has the device playing copyright of the music identifier 005. When the device type of the smart phone is not included in the device type authorized to play by the music identifier 005, the smart phone can determine that the smart phone does not have the device playing copyright of the music identifier 005. When the device type of the smart phone is included in the device type authorized to play by the music identifier 006, the smart phone can determine that the smart phone has the device play right of the music identifier 006. When the device type of the smart phone is not included in the device types authorized to play by the music identifier 006, the smart phone may determine that the smart phone does not have the device play right of the music identifier 006.

Step 408: the smart phone and the smart sound box negotiate a target collaborative play mode for playing the music content corresponding to the music identifier (such as the first music identifier) of the smart sound box, which does not have equipment playing rights, through a circulation communication link.

Optionally, the smart phone may negotiate, with the smart speaker, a target collaborative playback manner for playing the music content (such as the music data stream) corresponding to the first music identifier (such as the music identifier 004) through the circulation communication link.

Taking the example that the intelligent sound box does not have the equipment playing copyrights of the music marks 004-006 as the example, when the intelligent mobile phone does not have the equipment playing copyrights of the music marks 004-006, the intelligent mobile phone can determine that the intelligent mobile phone does not have the authority to play the music content corresponding to the music marks 004-006, and the target cooperative playing mode is not required to be negotiated with the intelligent sound box. When the smart phone has the equipment playing copyrights of at least one music identifier of the music identifiers 004-006, the smart phone can negotiate a target collaborative playing mode for playing the at least one music identifier with the smart sound box on the circulation communication link. For example, the smart phone and the smart speaker may first send the respective collaborative playback manners to the other party through the circulation communication link, and then the smart phone may negotiate with the smart speaker about a target collaborative playback manner for playing the at least one music identifier from at least one collaborative playback manner shared by the smart phone and the smart speaker.

For example, table 2 may be referred to for the device copyright support conditions of the smart phone and the smart speaker, for the cooperative play mode of the smart phone and the smart speaker, and for the music identifiers 001 to 010.

TABLE 2

It should be noted that table 2 is only a simple example, and is for convenience of describing the technical solutions in the embodiments of the present application, and is not limited to the technical solutions in the embodiments of the present application.

Based on table 2, the smart phone and the smart speaker have a cooperative playing mode, such as a stream playing mode, a DLNA projection playing mode, and a bluetooth playing mode. Taking the priority of the smart phone and the smart speaker according to the collaborative play mode, the negotiation of the target collaborative play mode is taken as an example, for example, the priority of the mirror image screen-throwing play mode is higher than the priority of the bluetooth play mode, the priority of the bluetooth play mode is higher than the priority of the DLNA screen-throwing play mode, and it is assumed that the smart phone and the smart speaker select the bluetooth play mode from the circulation play mode, the DLNA screen-throwing play mode and the bluetooth play mode as the target collaborative play mode through the negotiation.

Step 409: and the intelligent mobile phone and the intelligent sound box establish a communication link corresponding to the target cooperative play mode.

Step 410: the smart phone sends the music content corresponding to the first music identifier to the smart sound box through a communication link corresponding to the target cooperative play mode.

Taking a bluetooth playing mode as an example, the target collaborative playing mode negotiated by the smart phone and the smart speaker is taken as the example, when the smart speaker finishes playing the music file (such as music 3.mp3) corresponding to the music identifier 003, the smart speaker can send a second notification message to the smart phone through the streaming communication link. Optionally, the second notification message may carry indication information for indicating that the music file corresponding to the music identifier 003 is played and ended, or may be used for notifying that the smart phone starts playing the music content (such as a music data stream) corresponding to the music identifier that the smart speaker does not have the device playing copyright. After receiving the second notification message, the smart phone can establish a bluetooth communication link with the smart speaker. Then, the smart phone can transmit the music data stream corresponding to the music identifier (such as the music identifier 004-the music identifier 006) of the smart sound box without the equipment playing copyright to the smart sound box for playing according to the Bluetooth playing mode through the Bluetooth communication link.

Step 411: and when the intelligent mobile phone finishes playing the music content corresponding to the first music identifier according to the target cooperative playing mode, sending a third notification message to the intelligent sound box.

Optionally, the third notification message may carry indication information for indicating that the music content corresponding to the music identifier (such as the first music identifier) of the intelligent sound box without the device playing copyright has been played, or may be used for notifying that the music content corresponding to the music identifier of the intelligent sound box without the device playing copyright has been collaborative played.

For example, taking the example that the intelligent sound box does not have the playing copyrights of the devices of the music identifiers 004-006, the third notification message may carry indication information for indicating that the playing of the music content corresponding to the music identifiers 004-006 is finished, or may be used for notifying that the playing of the music content corresponding to the music identifiers 004-006 of the intelligent sound box is finished, or may be used for notifying that the collaborative playing of the music content corresponding to the music identifiers 004-006 of the intelligent sound box is finished.

For example, continuing taking the target cooperative play mode negotiated by the smart phone and the smart speaker as the bluetooth play mode as an example, when the smart phone plays the music content corresponding to the music identifier 004-006 according to the bluetooth play mode, a third notification message may be sent to the smart speaker through the circulation communication link.

Step 412: the intelligent sound box downloads the music file corresponding to the second music identifier from the music service equipment and plays the music file corresponding to the second music identifier.

Optionally, the second music identifier is any one of the other music identifiers in the music information list except the music identifier with the playing completion, the playing sequence of the second music identifier is located after the playing sequence of the first music identifier, and the intelligent sound box has the playing copyright of the equipment with the second music identifier.

For example, after the intelligent sound box receives the third notification message, the intelligent sound box may independently play the music file corresponding to the music identifier (such as the music identifier 007 to the music identifier 010) with the device playing copyright. Alternatively, the smart speaker may download music files (such as music 7.mp3, music 8.mp3, music 9.mp3, and music 10.mp3) corresponding to the music identifications 007 to 010 from the music service device, and after the smart speaker downloads music 7.mp3, music 8.mp3, music 9.mp3, and music 10.mp3 from the music service device, music 7.mp3, music 8.mp3, music 9.mp3, and music 10.mp3 may be played.

In the description of the present application, "at least one" means one or more, and "a plurality" means two or more. "and/or", describes an association relationship of an association object, and indicates that there may be three relationships, for example, a and/or B, and may indicate: cases where A alone, both A and B together, and B alone, where A and B may be singular or plural. The character "/" generally indicates that the context-dependent object is an "or" relationship. "at least one of" or the like means any combination of these items, including any combination of single item(s) or plural items(s). For example, "at least one of A, B, and C" includes A, B, C, AB, AC, BC, or ABC. And, unless otherwise specified, references to "first," "second," "third," etc. ordinal words of the embodiments of the present application are used for distinguishing between multiple objects and are not used for limiting the order, timing, priority, or importance of the multiple objects. Furthermore, the terms "comprising," "including," "having," and variations thereof herein, are intended to be "including but not limited to" unless otherwise specifically limited to.

In addition, each step in the foregoing embodiments may be performed by a corresponding device, or may be performed by a component such as a chip, a processor, or a chip system in the device, which is not limited by the embodiment of the present application. The above embodiments are described only as examples to be executed by the respective apparatuses.

In the above embodiments, some steps may be selected and performed, or the order of steps in the drawings may be adjusted and performed, which is not limited to the present application. It should be understood that it is within the scope of the present application to perform some of the steps in the illustrations, adjust the order of the steps, or implement them in combination with each other.

It will be appreciated that, in order to implement the functions of the above embodiments, each device involved in the above embodiments includes a corresponding hardware structure and/or software module for performing each function. Those of skill in the art will readily appreciate that the various illustrative elements and method steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application scenario and design constraints imposed on the solution.

Note that: the "step" in the embodiments of the present application is merely illustrative, and is used to better understand a performance method adopted by the embodiments, and does not essentially limit the implementation of the solution of the present application, for example: this "step" may also be understood as a "feature". In addition, the execution sequence of the scheme of the application is not limited in any way, and any operation such as step sequence change or step combination or step splitting which does not affect the implementation of the whole scheme is made on the basis, so that the formed new technical scheme is also within the scope of the disclosure of the application.

Based on the same conception, the embodiment of the present application also provides a possible first terminal, which is suitable for the application scenario illustrated in fig. 1. The first terminal is configured to implement the technical scheme related to the first terminal in the above embodiment, or the module (such as a chip) of the first terminal is configured to implement the technical scheme related to the first terminal in the above embodiment, so that the beneficial effects of the first terminal in the above embodiment can also be implemented. In an embodiment of the present application, the first terminal may be the terminal 100 (or the terminal 200) as illustrated in fig. 1.

Referring to fig. 5, the first terminal 500 includes a first transceiver module 501 and a first processing module 502. The first transceiver module 501 is configured to receive first indication information from a second terminal, where the first indication information is used to indicate a multimedia information list to be played in the second terminal, and the multimedia information list includes a first multimedia identifier. The first processing module 502 is configured to download, from a service device, a multimedia file corresponding to a first multimedia identifier and play the multimedia file when the first terminal has a device play right of the first multimedia identifier; or when the first terminal does not have the device playing copyright of the first multimedia identifier, sending second instruction information to the second terminal, receiving the multimedia data stream corresponding to the first multimedia identifier from the second terminal, and playing the media data stream from the second terminal, wherein the second instruction information is used for instructing the first terminal not to have the device playing copyright of the first multimedia identifier.

For a more detailed description of the first transceiver module 501 and the first processing module 502, reference may be made to the related description of the first terminal in the above method embodiment, which is not described in detail herein.

It should be appreciated that the first transceiver module 501 in the embodiment of the present application may be implemented by a first communication interface or a first communication interface related circuit component, and the first processing module 502 may be implemented by a first processor or a first processor related circuit component.

It should be noted that, in the embodiment of the present application, the division of the modules is merely schematic, and there may be another division manner in actual implementation, and in addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or may exist separately and physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be embodied essentially or in part or all or part of the technical solution contributing to the prior art, or in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, etc.) or a processor (processor) to perform all or part of the steps of the methods of the various embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a read-only memory (ROM), a random access memory (random access memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

Based on the same conception, the application also provides a possible first terminal which is suitable for the application scene shown in fig. 1. The first terminal is configured to implement the technical scheme related to the first terminal in the above embodiment, so that the beneficial effects of the first terminal in the above method embodiment can also be implemented. Referring to fig. 6, the first terminal 600 includes: a first communication interface 601, a first processor 602. Optionally, the first terminal 600 further includes a first memory 603. Wherein the first communication interface 601, the first processor 602, and the first memory 603 are connected to each other. When the first terminal 600 is used to implement the technical solution related to the first terminal in the above embodiment, the first communication interface 601 may be used to implement the functions of the first transceiver module 501, and the first processor 602 is used to implement the functions of the first processing module 502.

Optionally, the first communication interface 601, the first processor 602, and the first memory 603 are connected to each other through a bus 604. The bus 604 may be a peripheral component interconnect standard (PERIPHERAL COMPONENT INTERCONNECT, PCI) bus, or an extended industry standard architecture (extended industry standard architecture, EISA) bus, or the like. The buses may be classified as address buses, data buses, control buses, etc. For ease of illustration, only one thick line is shown in fig. 6, but not only one bus or one type of bus.

The first communication interface 601 is configured to receive and send data, for example, when the first terminal is the terminal 100 as illustrated in fig. 1, the first communication interface 601 may be configured to communicate with the terminal 200 as illustrated in fig. 1, or may also be configured to communicate with a device (such as a cloud or a service device) other than the application scenario illustrated in fig. 1. Alternatively, the first communication interface 601 may be an input-output interface. For example, the first terminal may communicate with a cloud or service device using a first communication interface.

The function of the first processor 602 may refer to the description of the corresponding function related to the first terminal in the above embodiment, which is not repeated herein. The first processor 602 may be a central processor (central processing unit, CPU), a network processor (network processor, NP) or a combination of CPU and NP, among others. The first processor 602 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (programmable logic device, PLD), or a combination thereof. The PLD may be a complex programmable logic device (complex programmable logic device, CPLD), a field-programmable gate array (FPGA) GATE ARRAY, generic array logic (GENERIC ARRAY logic, GAL), or any combination thereof. The first processor 602 may be implemented by hardware when implementing the above functions, and may of course be implemented by executing corresponding software by hardware.

The first memory 603 is configured to store program instructions and the like. In particular, the program instructions may comprise program code comprising computer-operating instructions. The first memory 603 may include random access memory (random access memory, RAM) and may also include non-volatile memory (non-volatile memory), such as at least one disk memory. The first processor 602 executes the program instructions stored in the first memory 603 to implement the above-mentioned functions, thereby implementing the method steps required to be executed by the first terminal in the above-mentioned embodiment.

Based on the same conception, the embodiment of the application also provides a possible second terminal, which is suitable for the application scenario illustrated in fig. 1. The second terminal is configured to implement the technical scheme related to the second terminal in the above embodiment, or the module (such as a chip) of the second terminal is configured to implement the technical scheme related to the second terminal in the above embodiment, so that the beneficial effects of the second terminal in the above embodiment can also be implemented. In an embodiment of the present application, the second terminal may be the terminal 200 (or the terminal 100) as illustrated in fig. 1.

Referring to fig. 7, the second terminal 700 includes a second transceiver module 701 and a second processing module 702. The second transceiver module 701 is configured to receive a collaborative play instruction issued by a user, where the collaborative play instruction is used to instruct the first terminal to cooperatively play, through data interaction, multimedia to be played in the second terminal. The second processing module 702 is configured to send first indication information to the first terminal according to the collaborative playback instruction, where the first indication information is used to indicate a multimedia information list to be played in the second terminal, and the multimedia information list includes a first multimedia identifier. The second processing module 702 is further configured to send, to the first terminal, a multimedia data stream corresponding to the first multimedia identifier when receiving second indication information from the first terminal, where the second indication information is used to indicate that the first terminal does not have a device play right of the first multimedia identifier.

For a more detailed description of the second transceiver module 701 and the second processing module 702, reference may be made to the related description of the second terminal in the above method embodiment, which is not described in detail herein.

It should be appreciated that the second transceiver module 701 in the embodiment of the present application may be implemented by a second communication interface or a second communication interface related circuit component, and the second processing module 702 may be implemented by a second processor or a second processor related circuit component.

Based on the same conception, the application also provides a possible second terminal which is suitable for the application scene shown in fig. 1. The second terminal is configured to implement the technical scheme related to the second terminal in the above embodiment, so that the beneficial effects of the second terminal in the above method embodiment can also be implemented. Referring to fig. 8, the second terminal 800 includes: a second communication interface 801, a second processor 802. Optionally, the second terminal 800 further comprises a second memory 803. Wherein the second communication interface 801, the second processor 802, and the second memory 803 are connected to each other. When the second terminal 800 is used to implement the technical solution related to the second terminal in the above embodiment, the second communication interface 801 may be used to implement the function of the second transceiver module 701, and the second processor 802 is used to implement the function of the second processing module 702.

Optionally, the second communication interface 801, the second processor 802, and the second memory 803 are connected to each other through a bus 804. The bus 804 may be a peripheral component interconnect standard (PERIPHERAL COMPONENT INTERCONNECT, PCI) bus, or an extended industry standard architecture (extended industry standard architecture, EISA) bus, or the like. The buses may be classified as address buses, data buses, control buses, etc. For ease of illustration, only one thick line is shown in fig. 8, but not only one bus or one type of bus.

The second communication interface 801 is configured to receive and send data, for example, when the first terminal is the terminal 200 illustrated in fig. 1, the second communication interface 801 may be configured to communicate with the terminal 100 illustrated in fig. 1, or may also be configured to communicate with a device other than the application scenario illustrated in fig. 1 (such as a cloud or service device). Alternatively, the second communication interface 801 may be an input-output interface. For example, the second terminal may communicate with a cloud or service device using a second communication interface.

The function of the second processor 802 may refer to the description of the corresponding function related to the second terminal in the above embodiment, which is not repeated herein. The second processor 802 may be a central processor (central processing unit, CPU), a network processor (network processor, NP) or a combination of CPU and NP, among others. The second processor 802 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (programmable logic device, PLD), or a combination thereof. The PLD may be a complex programmable logic device (complex programmable logic device, CPLD), a field-programmable gate array (FPGA) GATE ARRAY, generic array logic (GENERIC ARRAY logic, GAL), or any combination thereof. The second processor 802 may be implemented by hardware when implementing the above functions, and may of course be implemented by executing corresponding software by hardware.

The second memory 803 is used for storing program instructions and the like. In particular, the program instructions may comprise program code comprising computer-operating instructions. The second memory 803 may include a random access memory (random access memory, RAM) and may further include a non-volatile memory (non-volatile memory), such as at least one disk memory. The second processor 802 executes the program instructions stored in the second memory 803 to implement the above-mentioned functions, thereby implementing the method steps required to be executed by the second terminal in the above-mentioned embodiment.

Based on the same conception, the present embodiment also provides a computer program product comprising a computer program or instructions which, when run on a computer, cause the computer to perform the method provided by the above embodiments.

Based on the same conception, the present embodiment also provides a computer-readable storage medium having stored therein a computer program or instructions, which when executed by a computer, cause the computer to perform the method provided by the above embodiment.

Wherein a storage medium may be any available medium that can be accessed by a computer. Taking this as an example but not limited to: the computer-readable medium may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage media or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer.

Based on the same conception, the embodiment of the application also provides a chip, which is coupled with the memory and is used for reading the computer program stored in the memory, so as to realize the method provided by the embodiment.

Based on the same conception, the embodiment of the present application also provides a chip system, which includes a processor for supporting the computer device to implement the functions related to the terminal device (such as the first terminal or the second terminal) in the above embodiment. In one possible design, the chip system further includes a memory for storing programs and data necessary for the computer device. The chip system can be composed of chips, and can also comprise chips and other discrete devices.

The method provided by the embodiment of the application can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, the processes or functions described in accordance with embodiments of the present application are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a high-density digital video disc (digital video disc, DVD)), or a semiconductor medium (e.g., a solid-state disk (solid-state drive STATE DRIVE, SSD)), or the like.

The steps of a method described in embodiments of the present application may be embodied directly in hardware, in a software element executed by a processor, or in a combination of the two. The software units may be stored in RAM, ROM, EEPROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. In an example, a storage medium may be coupled to the processor such that the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

It will be apparent to those skilled in the art that various modifications and variations can be made to the present application without departing from the spirit or scope of the application. Thus, it is intended that the present application also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.

Claims

1. The collaborative playing method based on the multimedia copyright is characterized by comprising the following steps:

The method comprises the steps that a first terminal receives first indication information from a second terminal, wherein the first indication information is used for indicating a multimedia information list to be played in the second terminal, and the multimedia information list comprises a first multimedia identifier;

When the first terminal has the equipment playing copyright of the first multimedia identifier, the first terminal downloads the multimedia file corresponding to the first multimedia identifier from a service equipment and plays the multimedia file; or alternatively

When the first terminal does not have the equipment playing copyright of the first multimedia identifier, the first terminal sends second indication information to the second terminal, negotiates a target cooperative playing mode corresponding to the first multimedia identifier with the second terminal, receives a multimedia data stream corresponding to the first multimedia identifier from the second terminal through a communication link corresponding to the target cooperative playing mode, and plays the multimedia data stream from the second terminal, wherein the second indication information is used for indicating the equipment playing copyright of the first terminal not having the first multimedia identifier, and the target cooperative playing mode is used for playing the multimedia data stream corresponding to the first multimedia identifier.

2. The method of claim 1, wherein the method further comprises:

The first terminal acquires equipment copyright support information of the first multimedia identifier;

When the equipment type of the first terminal exists in at least one equipment type authorized to play by the first multimedia identifier according to the equipment copyright supporting information of the first multimedia identifier, the first terminal determines that the first terminal has the equipment playing copyright of the first multimedia identifier; or alternatively

When the equipment type of the first terminal does not exist in at least one equipment type authorized to play by the first multimedia identifier according to the equipment copyright supporting information of the first multimedia identifier, the first terminal determines that the first terminal does not have the equipment playing copyright of the first multimedia identifier.

3. The method of claim 1, wherein the target collaborative playback mode is selected from at least one collaborative playback mode that the second terminal and the first terminal have in common by negotiating.

4. The method of claim 3, wherein the target collaborative play mode is any one collaborative play mode selected randomly from the at least one collaborative play modes; or alternatively

The target cooperative play mode is the cooperative play mode with the highest priority in the at least one cooperative play mode.

5. The method of any one of claims 1-4, wherein the target collaborative playback mode is one of the following collaborative playback modes: bluetooth playing mode, mirror image screen-throwing playing mode, DLNA screen-throwing playing mode or circulation playing mode.

6. The method according to any of claims 1-5, wherein the first terminal sending second indication information to the second terminal comprises:

When detecting that the residual playing time length of the multimedia file or the multimedia data stream corresponding to the second multimedia identifier is smaller than or equal to a time length threshold value, the first terminal generates second indication information;

the first terminal sends the second indication information to the second terminal;

the second multimedia identifier is a multimedia identifier of which the playing sequence is positioned before the first multimedia identifier in the multimedia information list.

7. The collaborative playing method based on the multimedia copyright is characterized by comprising the following steps:

The method comprises the steps that a second terminal receives a collaborative play instruction issued by a user, wherein the collaborative play instruction is used for indicating a first terminal and the second terminal to cooperatively play multimedia to be played in the second terminal through data interaction;

The second terminal sends first indication information to the first terminal according to the collaborative play instruction, wherein the first indication information is used for indicating a multimedia information list to be played in the second terminal, and the multimedia information list comprises a first multimedia identifier;

When receiving second indication information from the first terminal, the second terminal negotiates a target cooperative play mode corresponding to the first multimedia identifier with the first terminal, establishes a communication link corresponding to the target cooperative play mode with the first terminal, and sends a multimedia data stream corresponding to the first multimedia identifier to the first terminal through the communication link corresponding to the target cooperative play mode, wherein the second indication information is used for indicating that the first terminal does not have equipment play copyright of the first multimedia identifier, and the target cooperative play mode is used for playing the multimedia data stream corresponding to the first multimedia identifier.

8. The method of claim 7, wherein the second indication information is generated by the first terminal when detecting that a remaining playing duration of a multimedia file or a multimedia data stream corresponding to a second multimedia identifier is less than or equal to a duration threshold, where the second multimedia identifier is a multimedia identifier in the multimedia information list, and a playing order of the multimedia identifier is located before the first multimedia identifier.

9. The method of claim 7, wherein the target collaborative playback mode is selected from at least one collaborative playback mode that the second terminal and the first terminal have in common by negotiating.

10. The method of claim 9, wherein the target collaborative play mode is any one of the at least one collaborative play modes selected randomly; or alternatively

11. The method of any one of claims 7-10, wherein the target collaborative playback mode is one of the following collaborative playback modes: bluetooth playing mode, mirror image screen-throwing playing mode, DLNA screen-throwing playing mode or circulation playing mode.

12. A first terminal, comprising:

a first communication interface for receiving and transmitting data;

A first memory for storing computer program instructions and data;

A first processor for executing computer program instructions and data that invoke the first memory to cause the first terminal to perform the method of any of claims 1-6.

13. A second terminal, comprising:

a second communication interface for receiving and transmitting data;

a second memory for storing computer program instructions and data;

A second processor for executing computer program instructions and data calling in the second memory to cause the second terminal to perform the method according to any of claims 7-11.

14. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program or instructions, which when executed by a computer, cause the computer to perform the method according to any of claims 1-6 or the method according to any of claims 7-11.

15. A computer program product, characterized in that the computer program product comprises a computer program or instructions which, when run on a computer, cause the computer to perform the method according to any one of claims 1-6 or the method according to any one of claims 7-11.