CN102196303B - Media synchronization method and system - Google Patents

Abstract

The invention discloses a method for media synchronization, which includes: determining a plurality of media streams that need to be synchronized, and selecting one of the media streams as a reference media stream; obtaining the time parameters of the reference media streams, the time parameters include the absolute time of playing and the time of playing Relative time: according to the time parameter of the reference media stream, adjust the playback status of other media streams in the multiple media streams to synchronize with the reference media stream. The invention also discloses a system for media synchronization. Through the method and system of the present invention, the synchronization between multiple media streams is realized, which provides a premise for the realization of unified media control.

Description

Method and system for media synchronization

technical field

The invention relates to multimedia synchronization technology in the communication field, in particular to a method and system for media synchronization.

Background technique

Internet Protocol Television (IPTV) can provide users with a variety of multimedia services, including live broadcast, on-demand and other program forms. With the development of "three screens in one" or even "three networks in one", displaying the same service on multiple types of terminals will become a basic service form. The so-called "three screens in one" refers to the integration of the three major information dissemination channels of mobile phones, computers, and televisions. Integrated multimedia communication services such as data and images.

Based on the development of "three screens in one" and "three networks in one", the media recommendation service will also be widely used. The so-called media recommendation service refers to a service that enables mutual recommendation of multimedia between different users or between different devices of the same user. In the media recommendation service, unified media control will provide users with a better service experience, and only when the playback positions of two media streams recommended by the media are synchronized, the unified media control is meaningful.

However, in the prior art, there is only a technical solution for realizing media synchronization between the terminal and the system side, and cannot provide a technical solution for realizing synchronization between multiple media streams, which brings difficulties to the realization of unified media control.

Contents of the invention

In view of this, the main purpose of the present invention is to provide a method and system for media synchronization, so as to realize the synchronization among multiple media streams.

In order to achieve the above object, technical solution of the present invention is achieved in that way:

The present invention provides a method for media synchronization, the method comprising:

Determine multiple media streams that need to be synchronized, and select one of the media streams as the reference media stream;

Acquiring time parameters of the reference media stream, the time parameters include absolute playback time and relative playback time;

According to the time parameter of the reference media stream, adjust the playback status of other media streams in the multiple media streams to be synchronized with the reference media stream.

According to the time parameter of the reference media stream, adjust the playback status of other media streams in the multiple media streams to synchronize with the reference media stream, specifically:

According to the playing absolute time of the reference media stream, obtain the relative playing time corresponding to the playing absolute time of other media streams;

Comparing the acquired relative playback times of other media streams with the relative playback times of the reference media streams to obtain the difference in the relative playback times;

According to the relative time difference between other media streams and the reference media stream, the playback status of other media streams is adjusted to be synchronized with the reference media stream.

The media synchronization is initiated by the service control module, or by the terminal playing the media stream.

The media synchronization is performed during the media recommendation process, specifically including:

The active direction service control module of the media recommendation requests the media recommendation service, and carries the time parameter of the media stream recommended by the active party in the request;

The service control module sends a media recommendation to the passive party, and sends the time parameters of the recommended media stream to the media function module of the passive party;

The media function module of the passive side adjusts the starting state of the recommended media stream on the passive side to synchronize with the current playing state on the active side according to the received time parameter.

The media synchronization is performed during media playback after media recommendation, specifically including:

The active direction of the media recommendation recommends media streams to the passive party, and the active party and the passive party respectively establish corresponding media streams with their respective media function modules;

The service control module selects the media stream played by the active party as the reference media stream, and obtains the time parameters of the reference media stream from the media function module of the active party;

The service control module requests the media function module of the passive side to adjust the playing state of the media stream of the passive side, and carries the time parameter of the reference media stream in the request;

The media function module of the passive side adjusts the media stream playback state of the passive side to be synchronized with the reference media stream playback state of the active side according to the time parameter in the request.

The present invention also provides a system for media synchronization, which includes: a service control module and a media function module, wherein,

The service control module is configured to determine a plurality of media streams that need to be synchronized, select one of the media streams as a reference media stream, and obtain time parameters of the reference media stream from the media function module, the time parameters include playing Absolute time and relative playing time; it is also used to notify the media function module to adjust the playing status of other media streams in multiple media streams according to the time parameter of the reference media stream;

The media function module is used to provide media services and provide time parameters of media streams for the service control module; it is also used to adjust the playback status of other media streams in multiple media streams according to the notification of the service control module , adjusting the other media stream to the same playing relative time as the reference media stream.

The media function module is further used for, according to the playing absolute time of the reference media stream, obtains the relative playing time of other media streams corresponding to the playing absolute time; Comparing with the playing relative time of the reference media stream, the difference of the playing relative time is obtained; according to the difference of the playing relative time of other media streams and the reference media stream, the playing status of other media streams is adjusted to be synchronized with the reference media stream.

The media synchronization is initiated by the service control module, or by the terminal playing the media stream.

The media synchronization is performed during the media recommendation process, correspondingly,

The service control module is further configured to, when receiving the media recommendation service request sent by the active party for media recommendation, send the media recommendation to the passive party, and send the time parameter of the media stream recommended by the active party carried in the request A media function module for the passive party;

The media function module of the passive side is further configured to, according to the received time parameter, adjust the starting state of the recommended media stream on the passive side to be synchronized with the current playing state on the active side.

The media synchronization is performed during media playback after media recommendation, and correspondingly,

The service control module is further used to select the media stream played by the active party as the reference media stream, and obtain the time parameters of the reference media stream from the media function module of the active party; it is also used to request the media function module of the passive party to adjust the media stream of the passive party. The playback state of the media stream, and carry the time parameter of the reference media stream in the request;

The media function module is further used to set up corresponding media streams respectively with the active party and the passive party recommended by the media; the media function module of the passive party adjusts the time parameter of the media stream of the passive party according to the time parameter in the request from the service control module. The playback state is synchronized with the playback state of the reference media stream on the active side.

A method and system for media synchronization provided by the present invention firstly determines a plurality of media streams that need to be synchronized, and selects one of the media streams as a reference media stream; then obtains the time parameters of the reference media streams, which include the absolute Time and relative playback time; then adjust the playback status of other media streams in the multiple media streams to synchronize with the reference media stream according to the time parameters of the reference media stream. Through the method and system of the present invention, the synchronization between multiple media streams is realized, which provides a premise for the realization of unified media control.

Description of drawings

Fig. 1 is the flowchart of a kind of media synchronization method of the present invention;

Fig. 2 is the composition structural representation of the IPTV system based on next generation network (NGN, Next Generation Network) in the embodiment of the present invention;

FIG. 3 is a flowchart of a media synchronization method according to Embodiment 1 of the present invention;

FIG. 4 is a flowchart of a media synchronization method according to Embodiment 2 of the present invention.

Detailed ways

The technical solutions of the present invention will be further elaborated below in conjunction with the accompanying drawings and specific embodiments.

The present invention provides a media synchronization method, aiming to select a media stream from multiple related media streams as a reference media stream, and adjust the playback position of other related media streams according to the playback position of the reference media stream, so as to realize multiple The playback of the two media streams is synchronized. As shown in Figure 1, the method mainly includes the following steps:

Step 101, determine multiple media streams that need to be synchronized, and select one of the media streams as a reference media stream.

Because only the media streams with the same media file need to be synchronized, the multiple media streams to be synchronized must be selected from the media streams with the same media file. The basis for selecting the reference media stream can be determined according to actual needs, which is not limited in the present invention.

In step 102, the time parameter of the reference media stream is acquired, and the time parameter includes an absolute playback time and a relative playback time.

For media playback, the parameter representing the media playback position is usually an offset time, also called playback relative time, which represents the offset time of the current media playback relative to the start position of the media file. The so-called absolute playback time refers to the system time when the relative playback time is obtained. The system can determine the exact position of the media at a certain time by playing the absolute time and the relative time.

Step 103, according to the time parameter of the reference media stream, adjust the playback state of other media streams in the multiple media streams to be synchronized with the reference media stream.

The specific synchronization processing includes: first, according to the absolute time of playing the reference media stream, obtain the relative playing time of other media streams corresponding to the absolute time of playing; The relative time is compared to obtain the difference of the relative playing time; and then according to the difference of the relative playing time of other media streams and the reference media stream, the playback status of other media streams is adjusted to be synchronized with the reference media stream.

Corresponding to the above media synchronization method, the present invention also provides a corresponding media synchronization system, including: a service control module and a media function module. Among them, the business control module is used to determine multiple media streams that need to be synchronized, select one of the media streams as the reference media stream, and obtain the time parameters of the reference media stream from the media function module, the time parameters include the absolute time of playback and the relative time of playback. Time; it is also used to notify the media function module to adjust the playing status of other media streams in the multiple media streams according to the time parameter of the reference media stream. The media function module is used to provide media services and provide time parameters of media streams for the service control module; it is also used to adjust the playback status of other media streams in multiple media streams and adjust other media streams according to the notification of the service control module. to the same playback relative time as the reference media stream.

The media synchronization method of the present invention will be further described in detail below in conjunction with the NGN-based IPTV system shown in FIG. 2 . In the structure of the IPTV system shown in FIG. 2 , the terminal may be a set-top box of a digital TV, a personal digital assistant (PDA, Personal Digital Assistant) or other equipment. The media function module is the main component of the content distribution network (CDN, Content Delivery Network) in the IPTV system, which provides media services for the terminal, including functions such as media control and media delivery. The name and structure of the media control function are different in different standards. In the International Telecommunication Union Telecommunication Standardization Sector (ITU-T, International Telecommunication Union Telecommunications standardization sector) standard, the media control function corresponds to content distribution and storage (Content Delivery) and Storage); corresponding to the media function (MF, Media Function) in the business and protocol (TISPAN, Telecommunication and Internet converged Services and Protocols for Advanced Networking) for advanced network communication and Internet convergence; in the Open IPTV Forum (OIPF, Open IPTV Forum) standard corresponds to cluster control (CC, Clustered Control) and media delivery function (CDF). The service control module is the control function entity of the service, including the use authority control of the service, service logic control, etc.; the service control module corresponding to IPTV is responsible for the logic control of the IPTV service, and all IPTV services are under the control of the service control module conduct. The service session control module is responsible for the IP Multimedia Subsystem (IMS, IP Multimedia Subsystem) control function in the NGN, and is responsible for the unified control of all IMS signaling.

Among them, the IPTV service control module is used to determine a plurality of media streams that need to be synchronized, select one of the media streams as the reference media stream, and obtain the time parameters of the reference media stream from the media function module. Relative time; it is also used to notify the media function module to adjust the playback status of other media streams in the multiple media streams according to the time parameter of the reference media stream. The media function module is used to provide media services and provide time parameters of media streams for the service control module; it is also used to adjust the playback status of other media streams in multiple media streams and adjust other media streams according to the notification of the service control module. to the same playback relative time as the reference media stream. For example: in Fig. 2, IPTV service control module determines the media stream 1 and media stream 2 that need to be synchronized, and selects media stream 1 as the reference media stream, obtains the time parameter of media stream 1 from the media function module; According to the time of media stream 1 Parameters, notify the media function module to adjust the playback state of media stream 2, the notification carries the time parameter of media stream 1; after receiving the notification, the media function module adjusts the playback state of media stream 2 according to the time parameter of media stream 1, Stream 2 is adjusted to the same playback relative time as media stream 1, so that the playback of media stream 2 and media stream 1 is synchronized.

It should be noted that the multiple media streams that need to be synchronized in the present invention can be controlled by the same media function module, or can be controlled by different media function modules. In addition, the media synchronization method of the present invention is applicable to the media recommendation service, and the media synchronization operation can be performed during the media recommendation process, and can also be performed during the media playback process after the media recommendation. The following will be described in conjunction with specific embodiments.

In the first embodiment shown in Figure 3, the media synchronization operation occurs during the media playback process after media recommendation, and multiple media streams (media stream 1, media stream 2) that need to be synchronized are performed by different media function modules control. As shown in Figure 3, media synchronization mainly includes the following steps:

Step 301, through media recommendation, terminal 1 (the active party of media recommendation) establishes a corresponding media stream with media function module 1, and terminal 2 (the passive party of media recommendation) establishes a corresponding media stream with media function module 2 .

Terminal 1 and terminal 2 in a service network establish media streaming services with media function module 1 and media function module 2 respectively. These two related media streams are established through media recommendation, for example: the user of terminal 1 recommends the media stream he is playing to the user of terminal 2, so that the user of terminal 2 can watch it together; then after the recommendation, the terminal 1 establishes a corresponding media stream with the media function module 1, and the terminal 2 establishes a corresponding media stream with the media function module 2.

Step 302 , the IPTV service control module selects media stream 1 as a reference media stream, and sends a request to the media function module 1 to obtain the time parameter of media stream 1 through the service session control module.

It should be noted that, in practical applications, the synchronization request of the media stream can be initiated by terminal 1 or terminal 2, or from the IPTV service control function module itself; when the IPTV service control function module learns that there is a media stream synchronization requirement, The operation of step 302 is only started.

In step 303, the media function module 1 returns the time parameter of the media stream 1 to the IPTV service control module through the service session control module. The time parameter includes: the absolute playing time and the relative playing time.

The so-called relative playback time refers to the offset time of the playback of the current media stream 1 relative to the starting position of the media file; the absolute playback time refers to the system time when the offset time is obtained.

In steps 304-305, the IPTV service control module requests the media function module 2 to modify the playing state of the media stream 2 according to the time parameter of the media stream 1 through the service session control module.

In the request sent to the media function module 2, the time parameter of the media stream 1 is carried, that is, the absolute playing time and the relative playing time of the media stream 1, which is the basis for the media function module 2 to adjust the playing status of the media stream 2.

In steps 306-308, the media function module 2 adjusts the playing state of the media stream 2 according to the time parameter in the request, and returns a confirmation response to the IPTV service control module through the service session control module.

The media function module 2 calculates the difference between the media stream 2 and the media stream 1 in the relative playing time according to the time parameter in the request (the absolute playing time and the playing relative time of the media stream 1), and then adjusts the media stream 2 according to the difference The current playing relative time, and then the playing state of media stream 2 is synchronized with the playing state of media stream 1.

In the second embodiment shown in FIG. 4 , the media synchronization operation occurs during the media recommendation process, and the multiple media streams (media stream 1 and media stream 2 ) that need to be synchronized are controlled by different media function modules. As shown in Figure 4, media synchronization mainly includes the following steps:

Step 401, terminal 1 (the active party of media recommendation) requests the media recommendation service from the IPTV service control module, and carries the time parameter of the media stream 1 currently played by terminal 1 in the request, that is, the absolute time of playing media stream 1 and the relative time of playing media stream 1. time.

Step 402 , the IPTV service control module sends the media recommendation to the terminal 2 (the passive party of the media recommendation), and sends the time parameter of the recommended media stream 1 to the media function module 2 .

After receiving the media recommendation service request from the terminal 1, the IPTV service control module notifies the media function module 2 to establish a media connection with the terminal 2, and sends the time parameter of the recommended media stream 1 to the media function module 2.

Step 403, the media function module 2 directly adjusts the playing state of the media stream 2 played on the terminal 2 according to the time parameter of the media stream 1, so that the starting state of the media stream 2 is synchronized with the current playing state of the media stream 1.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the protection scope of the present invention.

Claims (8)

1. a method for media sync, is characterized in that, the method comprises:

Determine to need synchronous a plurality of Media Streams, and select one of them Media Stream as with reference to Media Stream;

Obtain the time parameter of described reference medium stream, described time parameter comprises to be play absolute time and plays relative time;

According to the time parameter of described reference medium stream, the broadcast state of adjusting other Media Streams in described a plurality of Media Stream is synchronizeed with described reference medium stream;

When described media sync is carried out in media recommendation process, specifically comprise:

The active direction message control module request media that media are recommended are recommended business, and in request, carry the time parameter of Media Stream that masters is recommended;

Described message control module sends media to passive side and recommends, and the time parameter of recommended Media Stream is sent to described passive side's media function module;

Described passive side's media function module is according to the time parameter receiving, and adjusts institute's Media Stream of recommending and starts the state of broadcasting and in the current playing status synchronism of masters passive side.

2. the method for media sync according to claim 1, is characterized in that, described according to the time parameter of reference medium stream, and the broadcast state of adjusting other Media Streams in a plurality of Media Streams flows and synchronizes with reference medium, is specially:

According to the broadcasting absolute time of described reference medium stream, obtain other each Media Streams at the corresponding broadcasting relative time of described broadcasting absolute time;

The broadcasting relative time of other each Media Streams that obtain is compared with the broadcasting relative time of reference medium stream respectively, obtain playing the difference of relative time;

According to the difference of the broadcasting relative time of other each Media Streams and reference medium stream, the broadcast state of adjusting other each Media Streams is synchronizeed with reference medium stream.

3. according to the method for media sync described in claim 1 or 2, it is characterized in that, described media sync is initiated by message control module, or is initiated by the terminal of playing described Media Stream.

4. the method for media sync according to claim 3, is characterized in that, in the media play process of described media sync after media are recommended, carries out, and specifically comprises:

The active direction passive side that media are recommended recommends Media Stream, and described masters and passive side set up corresponding Media Stream with media function module separately respectively;

Message control module selects Media Stream that masters plays as with reference to Media Stream, and from the media function module of masters, obtains the time parameter of reference medium stream;

Described message control module request passive side's media function module is adjusted the broadcast state of passive side's Media Stream, and in described request, carries the time parameter of reference medium stream;

Described passive side's media function module is according to the time parameter in request, the playing status synchronism of the Media Stream broadcast state of adjusting described passive side and reference medium stream in masters.

5. a system for media sync, is characterized in that, this system comprises: message control module and media function module, wherein,

Described message control module, for determining, need synchronous a plurality of Media Streams, select one of them Media Stream as with reference to Media Stream, and from described media function module, obtain the time parameter of described reference medium stream, described time parameter comprises to be play absolute time and plays relative time; Also, for according to the time parameter of described reference medium stream, notify described media function module to adjust the broadcast state of other Media Streams in a plurality of Media Streams;

Described media function module, for media services are provided, and provides the time parameter of Media Stream for described message control module; Also, for according to the notice of described message control module, adjust the broadcast state of other Media Streams in a plurality of Media Streams, described other Media Streams are adjusted to reference medium and flowed identical broadcasting relative time;

When described media sync is carried out in media recommendation process, corresponding,

Described message control module is further used for, when the media that send in the masters that receives media recommendation are recommended service request, to passive side, send media and recommend, and the time parameter of the Media Stream that masters is recommended carrying in described request is sent to described passive side's media function module;

Described passive side's media function module is further used for, and according to the time parameter receiving, adjusts institute's Media Stream of recommending and starts the state of broadcasting and in the current playing status synchronism of masters passive side.

6. the system of media sync according to claim 5, it is characterized in that, described media function module is further used for, and according to the broadcasting absolute time of described reference medium stream, obtains other each Media Streams at the corresponding broadcasting relative time of described broadcasting absolute time; The broadcasting relative time of other each Media Streams that obtain is compared with the broadcasting relative time of reference medium stream respectively, obtain playing the difference of relative time; According to the difference of the broadcasting relative time of other each Media Streams and reference medium stream, the broadcast state of adjusting other each Media Streams is synchronizeed with reference medium stream.

7. according to the system of media sync described in claim 5 or 6, it is characterized in that, described media sync is initiated by message control module, or is initiated by the terminal of playing described Media Stream.

8. according to the system of media sync described in claim 5 or 6, it is characterized in that, in the media play process of described media sync after media are recommended, carry out, corresponding,

Described message control module is further used for, and selects Media Stream that masters plays as with reference to Media Stream, and from the media function module of masters, obtains the time parameter of reference medium stream; Also for asking the broadcast state of passive side's media function module adjustment passive side Media Stream, and in described request, carry the time parameter of reference medium stream;

Described media function module is further used for, and sets up corresponding Media Stream respectively with masters and the passive side of media recommendation; Passive side's media function module, according to from the time parameter in the request of message control module, is adjusted the broadcast state of passive side's Media Stream and is flowed playing status synchronism with the reference medium in masters.

Images