CN1859544A - System and method for playing medium - Google Patents

Abstract

The present invention relates to a system and method for synchronously playing media on audio and video equipment. The entire media playing system includes: a control point CP, a digital media server DMS, an audio digital media display device DMR and a video digital media display device DMR; the control point The CP selects the audio digital media demonstrator and the video digital media demonstrator in the home network to form a combination to play the media selected on the digital media server synchronously; the audio of the media is output by the audio digital media demonstrator; the video of the media is output by the video digital media Media presenter output. Utilize the present invention user can properly select the existing audio and video media playback equipment in the local network to form a combination to play media, improve the quality of media audio and video enjoyed by the user, reduce the number and types of audio and video media playback equipment, for Users save money.

Description

System and method for playing media

technical field

The present invention relates to a system and method for playing media, in particular to a system and method for synchronously playing media on audio equipment and video equipment.

Background technique

With the development of digital information technology, digital devices and digital home appliances are becoming more and more common. These digital devices use protocols such as UPnP (Universal Plug and Play), IGRS (Intelligent Grouping and Resource Sharing, intelligent interconnection of information devices, resource sharing and collaborative services), and are connected in a wired or wireless manner to form a home interior. Local area network, to create a seamless environment for new digital media and content services, to realize the sharing of content and equipment, is the concept of digital home network.

Digital devices in the digital home network, including digital media presenter (DMR) equipment, such as digital television (DTV), stereo and home theater, etc.; also include digital media server (DMS) equipment, such as set-top box (STB), digital Video recorder (DVR), personal computer, etc. As shown in FIG. 1 , a user can control a digital media presenter (DMR) to play media resources on a digital media server (DMS) through a control point (CP) in a digital home network. Wherein the audio digital media demonstrator (DMR) is used to play the audio media resource on the digital media server (DMS); the video digital media demonstrator (DMR) is used to play the video media resource on the digital media server (DMS), and can also simultaneously Audio media playback is supported.

When playing video media resources, there are the following two prior art solutions:

One is that media audio data and video data are played synchronously on the same digital media demonstrator (DMR). The general playback process is as follows:

1. The media data is transmitted from the digital media server (DMS) to the digital media presenter (DMR) through the home network.

2. A digital media presenter (DMR) separates audio and video data from the media data, and synchronizes the audio and video data.

3. Use two methods to decode and output audio and video data;

(1) A digital media demonstrator (DMR) decodes audio and video data, respectively, and outputs audio and video signals.

(2) The digital media demonstrator (DMR) decodes the video data and outputs the video signal; sends the audio data directly or converts the audio data format to another audio device through a certain data interface, and the audio device decodes the audio data and outputs the audio signal.

The shortcoming of above-mentioned scheme is: when adopting the decoding of mode (1), if DMR usually can only reach the audio output effect of 2.1 like television, if it is the medium of AC-3 or DTS 5.1 higher quality audio effect, the user can't appreciate it. To achieve this audio effect; the cost will be greatly increased if a digital media presenter can achieve higher quality audio effect. When the decoding method (2) is used, an audio device needs to be added, and it cannot be connected to the home network to become a shared device.

The technical solution disclosed in the Chinese patent with the authorization number 00804959.9 is to realize synchronous playback of audio and video data by saving the offset waiting time table on each device. The playback process of this program is as follows:

1. Each device (including the source device and the target device) maintains a waiting time table, marking the signal processing capability of the device and the waiting time associated with each such capability.

2. The source device reads the media data, and separates the audio and video data from the media data; the audio data is stored in the audio buffer, and the video data is stored in the video buffer.

3. Calculate the amount of delay required for audio or video data according to the waiting time table of each device; audio or video data generates a corresponding delay in the audio buffer or video buffer.

4. Synthesize the delayed audio and video data in the audio buffer and the video buffer into a single data stream, and send them to the target device, ie, the audio and video devices, respectively through the bus.

5. After the audio device receives the data, it separates the audio data, decodes and outputs the audio signal; after the video device receives the data, it separates the video data, decodes and outputs the video signal.

The disadvantages of this scheme are:

1. The delay in the process of transmitting the synthesized media data to the audio and video equipment through the bus is not considered. This method is only suitable for real-time bus transmission such as 1394 bus synchronous mode; it is not suitable for asynchronous transmission such as HTTP GET protocol transmission. If the transfer time of the media data to the audio and video devices via the bus is different, it is difficult to realize synchronous playback of the audio and video data.

2. There is no data buffer device on the audio and video equipment. When the bus bandwidth fluctuates, it will affect the playback quality of audio and video.

3. Before the media data is transmitted, the media data should be separated, respectively delayed in the audio buffer or video buffer, then synthesized, and then transmitted. These all need to increase functional device, thereby increase difficulty and cost.

Contents of the invention

In view of the above-mentioned problems in the prior art, the object of the present invention is to provide a system and method for synchronously playing media on audio and video equipment.

In order to achieve the above object, the system for synchronously playing media on audio and video equipment provided by the present invention includes a digital media server, a control point, an audio digital media demonstrator and a video digital media demonstrator:

The audio digital media demonstrator and the video digital media demonstrator respectively include a data buffer device; the user selects the audio digital media demonstrator and the video digital media demonstrator in the local network through the control point to form a combination.

The audio digital media presenter and the video digital media presenter also include a data separation device and/or a data decoding device.

The system further includes:

The audio digital media demonstrator includes a media data transmission subsystem, a data separator, a data buffer, a data decoder, and an audio playback hardware output module;

Media data transmission subsystem: used to receive media data transmitted from the digital media server through the network;

Data separator: used to separate the audio data in the media data;

Data buffer: used to buffer the separated audio data;

Data decoder: used to decode audio data;

Audio playback hardware output module: used to convert the decoded audio data into audio signal output.

The system also includes:

The video digital media demonstrator includes a media data transmission subsystem, a data separator, a data buffer, a data decoder, and a video playback hardware output module;

Media data transmission subsystem: used to receive media data transmitted from the digital media server through the network;

Data separator: used to separate video data from media data;

Data buffer: used to buffer the separated video data;

Data decoder: used to decode video data;

Video playback hardware output module: used to convert the decoded video data into video signal output.

The system further includes:

The networking mode of the network includes wired networking: IEEE1394, Ethernet and/or wireless networking: 802.11, Bluetooth.

The method for synchronously playing media on audio and video equipment provided by the present invention includes:

The control point selects and controls the audio digital media presenter and the video digital media presenter according to the media content, and realizes synchronous output by processing the media data on the audio digital media presenter and the video digital media presenter respectively.

The method further includes:

A. The user determines the audio digital media presenter and the video digital media presenter at the control point according to the media content to be played;

B. The digital media server establishes a media data transmission connection with the audio digital media demonstrator and the video digital media demonstrator respectively;

C. The control point sets the audio digital media demonstrator and the video digital media demonstrator to a synchronous playback mode;

D. Store the separated data into the data buffer;

E. Audio data and video data are output synchronously.

The method also includes:

Add an AV synchronization service to the digital media presenter; or

Add the synchronous operation function on the basis of the connection management service of the media presentation device; or add the synchronous operation function on the basis of the AV transmission service of the digital media presentation device. Step A described in the method specifically includes:

A1. The control point searches and selects the media content on the digital media server, and obtains the transmission protocol and data format supported by the digital media server to transmit the media content to the network;

A2. The control point selects an audio digital media demonstrator and a video digital media demonstrator to form a combination according to the selected media content;

A3. The control point obtains the transmission protocol/data format supported by the audio digital media presentation device and the video digital media presentation device, and selects a suitable transmission protocol and data format.

The step A3 described in the method specifically also includes:

The control point compares the transmission protocol and data format of the returned digital media server with the audio digital media presenter and the video digital media presenter, and selects the appropriate media data to transmit to the audio media presenter. The transfer protocol and data format, as well as the appropriate media data The transfer protocol and data format for transfer to the video media presenter.

The step C described in the method specifically also includes:

C1. The media data separation mode of the audio data separator and the video data separator is set;

C2. the length of audio data buffer and video data buffer buffer data is set;

C3. The audio digital media demonstrator and the video digital media demonstrator enter a synchronous playback state. Step C of the method specifically further includes: setting the video digital media presenter to a mute state. The step D described in the method specifically also includes:

D1. The audio data separator and the video data separator respectively separate the audio data and the video data in the received media data;

D2. The audio data and the video data are respectively stored in the audio data buffer and the video data buffer. The step E described in the method specifically also includes:

E1. When the data in the buffer reaches the set length, the data synchronization preparation is completed;

E2. The control point sends a synchronization control message to the audio digital media presenter and the video digital media presenter respectively, and the audio data in the audio data buffer and the video data in the video data buffer are synchronized.

Through the present invention, the user selects the existing audio digital media demonstrator (DMR) and video digital media demonstrator (DMR) in the home network through the control point (CP) in the home network to form a combination to play the digital media in the home network synchronously. Media on a media server (DMS). That is, the video of the media is played on the video digital media presenter (DMR), and the audio of the media is played synchronously on the audio digital media presenter (DMR).

The method allows the user to select existing audio and video digital media demonstrators (DMR) to form a combination to play media according to needs, so as to achieve the media playback effect expected by the user.

Description of drawings

Fig. 1 is the interactive diagram of CP, DMR, DMS of prior art;

Fig. 2 is the internal functional block diagram of audio digital media demonstrator and video digital media demonstrator of the present invention;

Fig. 3 is a flowchart of the present invention;

Fig. 4 is the relation figure of AV synchronous service and each functional module of the present invention;

Fig. 5 is that UPnP AV architecture of the present invention expands AV synchronous service (AVS) and realizes synchronous play flowchart;

Fig. 6 is the relationship diagram between the connection management service (CMS) and each functional module that has increased the synchronous operation of the present invention;

Fig. 7 is that UPnP AV system structure of the present invention expands connection management service (CMS) or expands AV transmission service (AVT) and realizes synchronous play flowchart;

FIG. 8 is a relationship diagram between the AV transmission service (AVT) with synchronous operation added and each functional module of the present invention.

Detailed ways

Video The digital media presenter (DMR) plays both the audio and the video of the media, that is, the audio and video of the media are played on the same digital media presenter (DMR). This is not conducive to users enjoying high-quality audio and video, and even brings inconvenience to users. Please see the scene below.

Scenario 1: The user buys a new DVD (Digital Versatile Disc) movie, which is equipped with AC-3 (a surround sound effect) and DTS (Digital Theater System) 5.1 audio output effect. He uses a high-definition digital TV (DTV) in the home network to play in the living room, but the high-definition digital TV (DTV) only has 2.1 audio output, and users cannot enjoy high-quality AC-3 or DTS 5.1 audio effects.

Scenario 2: The user watches a wonderful football game on the high-definition digital TV (DTV) in the living room at night, but his family is going to rest. At this time, the user can turn down the sound, but this can neither affect the family at all, nor allow the user to enjoy watching the game.

As shown in Figure 2, the present invention is connected control point (CP) 10, digital media server (DMS) 16, audio digital media presenter (DMR) 12 and video digital media presenter (DMR) 14 by home network 18, forms the whole Media playback system. Select audio digital media display device (DMR) 12 and video digital media display device (DMR) 14 in the home network to form a combination by control point (CP) 10, and play the selected media on digital media server (DMS) 16 synchronously . The audio of the media is output by an audio digital media renderer (DMR) 12 and the video of the media is output by a video digital media renderer (DMR) 14 . Video Digital Media Presenter (DMR) 14 no longer outputs audio. The home network 18 may include various networking technologies, such as wired networking: IEEE1394, Ethernet, etc.; wireless networking: 802.11, Bluetooth, etc.

There are media data transmission subsystems 26, 36, data separators 20, 30, data buffers 22, 32, data decoders 24, 34, audio and video playback hardware output modules 28, 38, etc. inside the digital media demonstrator (DMR) module. The functions of these modules are:

Media data transmission subsystem: receive the media data transmitted from the digital media server (DMS) through the home network 18;

Data separator: separate the audio or video data from the media data;

Data buffer: buffer the separated audio or video data;

Data decoder: decode audio or video data;

Audio and video playback hardware output module: convert the decoded audio or video data into audio or video signal output.

The flow chart of the technical solution of the present invention is provided below, as shown in Figure 3, the flow chart corresponds to Figure 2:

1. The Control Point (CP) 10 looks up the media content on the Digital Media Server (DMS) 16 .

1.1 Locate the content to be played on the digital media server (DMS) 16 through the control point (CP) 10 .

1.2 Return the transmission protocol and data format supported by the digital media server (DMS) 16 to transmit the media content to the home network 18 .

2. Control point (CP) 10 selects audio digital media renderer (DMR) 12 and video digital media renderer (DMR) 14 to form a combination.

2.1 Select Audio Digital Media Presenter (DMR) 12 .

2.2 Select Video Digital Media Presenter (DMR) 14 .

The user can select the audio digital media presenter (DMR) 12 and the video digital media presenter (DMR) 14 in the home network 18 to form a combination according to the actual situation. For example, if a DVD is played, and the DVD supports DTS, the user can select an audio digital media presenter (DMR) 12 supporting DTS decoding and a video digital media presenter (DMR) 14 supporting MPEG2 decoding in the home network 18 to form a combination. If the selected video digital media presenter (DMR) 14 also has an audio output function, the audio output function of the video digital media presenter (DMR) 14 can be turned off in the next operation.

2.1 and 2.2 can be in no particular order.

3. The control point (CP) 10 obtains the transmission protocol/data format supported by the audio digital media renderer (DMR) 12 and the video digital media renderer (DMR) 14 .

3.1 Select the transmission protocol/data format supported by the audio digital media presenter (DMR) 12.

3.2 Return the transmission protocol/data format supported by the audio digital media renderer (DMR) 12 .

3.3 Select the transmission protocol/data format supported by the video digital media presenter (DMR) 14 .

3.4 Return the transmission protocol/data format supported by the video Digital Media Presenter (DMR) 14 .

3.1, 3.2 and 3.3, 3.4 can be in no particular order.

4. Select the appropriate transfer protocol and data format.

Control point (CP) 10 compares the transfer protocol and the data format of the returned media server (DMS) 16 and audio media demonstrator (DMR) 12 and video media demonstrator (DMR) 14, and selects the media data to transmit to the audio media demonstrator ( The transfer protocol and data format of DMR) 12, and the transfer protocol and data format of media data to video media renderer (DMR) 14.

5. A media data transmission connection is established between the digital media server (DMS) 16 and the audio digital media presenter (DMR) 12 and the video digital media presenter (DMR) 14 .

5.1-5.4 A media data transmission connection is established between the digital media server (DMS) 16 and the audio digital media presenter (DMR) 12 .

5.5-5.8 A media data transmission connection is established between the digital media server (DMS) 16 and the video digital media presenter (DMR) 14 .

5.1-5.4 and 5.5-3.8 can be done in no particular order.

6. Set the audio digital media presenter (DMR) 12 and the video digital media presenter (DMR) 14 to a synchronous playback mode.

6.1 Set the audio digital media presenter (DMR) 12 to a synchronous playback mode.

6.2 Set the video digital media presenter (DMR) 14 to the synchronous playback mode.

Set the audio digital media demonstrator (DMR) 12 and the video digital media demonstrator (DMR) 14 to the synchronous play mode, and enter the synchronous play state. It includes setting the media data separation mode of the audio data separator 20 and the video data separator 30 ; setting the length of buffered data in the audio data buffer 22 and the video data buffer 32 . Because the audio of the media is played by the audio digital media presenter (DMR) 12, the video digital media presenter (DMR) 14 no longer plays audio, and the video digital media presenter (DMR) 14 can be set to a mute state.

6.1 and 6.2 can be in no particular order.

7. The media data is transmitted to the audio digital media renderer (DMR) 12 and the video digital media renderer (DMR) 14 through the home network 18, respectively.

7.1 The media data transmission subsystem 26 transmits the media data to the audio digital media renderer (DMR) 12 through the home network 18 .

7.2 The media data transmission subsystem 36 transmits the media data to the video digital media renderer (DMR) 14 through the home network 18 .

7.1 and 7.2 are performed simultaneously.

8. The audio data separator 20 and the video data separator 30 respectively separate audio data and video data from the media data, and the audio data and video data are stored into the audio data buffer 22 and the video data buffer 32 respectively.

8.1 The audio data separator 20 separates the audio data from the media data and stores it in the audio data buffer 22 .

8.2 The video data separator 30 separates the video data from the media data and stores it in the video data buffer 32 .

8.1 and 8.2 are performed concurrently.

9. Audio and video data synchronization preparation.

9.1 Audio data synchronization preparation.

9.2 Return the information that the audio data synchronization is ready.

9.3 Video data synchronization preparation.

9.4 Return the information that video data synchronization is ready.

The audio data buffer 22 and the video data buffer 32 buffer data of a certain length, such as 3 or 5 seconds. When the data in the buffer reaches the set length, it will return the information that the data synchronization is ready.

9.1, 9.2 and 9.3, 9.4 can be in no particular order.

10. Synchronization of audio data and video data.

Control point (CP) 10 sends synchronous control message to audio digital media presenter (DMR) 12 and video digital media presenter (DMR) 14 respectively, the audio frequency data in the audio data buffer 22 and the video in the video data buffer 32 The data is synchronized.

The sending of the control point (CP) synchronization message may be an algorithm. The time it takes for the synchronization message to be transmitted to the audio digital media renderer (DMR) 12 and the video digital media renderer (DMR) 14 may be different, and the audio data decoding of the audio digital media renderer (DMR) 12 and the video digital media renderer (DMR)14 video data decoding time may also vary. Considering these factors, the algorithm can generate a corresponding delay for the synchronization message sent to the audio digital media renderer (DMR) 12 or the video digital media renderer (DMR) 14 according to these differences. For example, the synchronization message is transmitted from the control point (CP) 10 to the audio digital media display device (DMR) 12, which takes 30ms, and the decoding audio data takes 50ms; while the synchronization message is transmitted to the video digital media display device (DMR) 14, it takes 40ms, and the decoding video data It takes 70ms. For synchronization, the synchronization message sent by the control point (CP) 10 to the audio digital media presenter (DMR) 12 is delayed by (40+70) ms-(30+ 50) ms=30 ms.

11. Audio and video signal output.

11.1 Audio signal hardware output.

11.2 Video signal hardware output.

The audio data is decoded by the audio data decoder 24, and the audio signal is output by 28 audio hardware; the video data is decoded by the video data decoder 34, and the video signal is output by the 38 video hardware.

11.1 and 11.2 run concurrently.

12. The media data transmission is completed.

Repeatedly select the current media content or select the next content to play, then go to step 7; otherwise, go to step 13.

13. Media playback terminated.

13.1 The synchronous audio playback is terminated, and the synchronous playback mode of the audio digital media demonstrator (DMR) 12 is cancelled.

13.2 The synchronous playback of the video is terminated, the synchronous playback mode of the video digital media demonstrator (DMR) 14 is canceled, and the sound state of the video digital media demonstrator (DMR) 14 is restored.

13.3 The synchronous media playback is terminated, and the connection established between the digital media server (DMS) 16 and the digital media server (DMS) 12 and the audio digital media demo device (DMR) 14 is closed.

13.1, 13.2 and 13.3 can be done in no particular order.

Utilizing the present invention corresponds to the solution of the preceding scenario 1: the living room has another set of high-quality 5.1 speakers connected to the home network. Users select high-definition digital TV (DTV) to play DVD video through the control point (CP), and select high-quality 5.1 audio to play DVD audio synchronously. In this way, users can enjoy high-quality AC-3 or DTS 5.1 audio effects while enjoying high-quality video.

The solution corresponding to the previous scenario 2: the user uses his high-quality wireless headset connected to the home network to play audio synchronously. That is, the high-definition digital TV (DTV) plays the video, and the wireless headset plays the audio synchronously.

The method will be described below in conjunction with specific examples

This example is to realize the synchronous playback of media on the UPnP audio device and UPnP video device in the home network. Through the UPnP control point (CP) in the home network, select the existing UPnP audio digital media demonstrator (DMR) and UPnP video digital media demonstrator (DMR) in the home network to form a combination to play the UPnP digital media in the home network synchronously Media style on the server (DMS).

The UPnP AV (Audio with Video audio and video) architecture defined in the UPnP device architecture framework does not involve the content of media synchronous playback. The media presenter (DMR) in the UPnP AV architecture includes a presentation control service (RCS: Rendering Control Service), a connection management service (CMS: Connection Manager Service) and an optional AV transmission service (AVT: AV Transport Service). On the basis of the existing service of Media Presenter (DMR), it is extended to realize the synchronous playback of media. There can be multiple extension methods, three of which are given below. For the content of UPnP AV architecture, please refer to the UPnP AV architecture documentation released by UPnP.

Extension method 1: Add an AV synchronization service (AVS: AV Synchro Service).

The relationship diagram between the AV synchronization service (AVS) and each functional module is shown in FIG. 4 . UPnP audio and video digital media presenter (DMR) 12,14 receives the media data transmitted from the home network 18 through the media data transmission subsystem 26,36, and separates the audio through the audio data separator 20 and the video data separator 30 and video data, enter the audio data buffer 22 and the video data buffer 32 respectively. The audio and video data are synchronized in the data buffers 22, 32 before they are decoded. Synchronization messages can be sent by a Control Point (CP). The AV Synchronization Service (AVS) includes the following synchronization operations: SetSynchroMode(), PrepareForSynchroData(), AVSynchro(), and SynchroComplete() to synchronize audio and video data.

(1) AVS::SetSynchroMode(): set the audio digital media presenter (DMR) 12 and the video digital media presenter (DMR) 14 to a synchronous playback mode. Set the media data separation mode; set the length of the buffered data in the audio data buffer 22 and the video data buffer 32; set the sound of the video digital media demonstrator (DMR) 14 to a mute state.

(2) AVS::PrepareForSynchroData(): the audio data buffer 22 is ready for audio data, and the video data buffer 32 is ready for video data, making preparations for synchronizing audio data and video data.

(3) AVS::AVSynchro(): Audio data and video data are synchronized.

(4) AVS::SynchroComplete (): cancel the synchronous playback mode of the audio digital media demonstrator (DMR) 12 and the video digital media demonstrator (DMR) 14, and restore the sound state of the video digital media demonstrator (DMR) 14.

The flow chart of the extension method 1 is given below, as shown in Figure 5, and the flow chart corresponds to Figure 2:

1. The Control Point (CP) 10 looks up the media content on the Digital Media Server (DMS) 16 .

1.1 The control point (CP) 10 is operated by DMS::Browse () or Search () of the content directory service (CDS: Content Directory Service) of the digital media server (DMS) 16 to locate the digital media server (DMS) 16 to play Content.

1.2 Return the transmission protocol and data format supported by the digital media server (DMS) 16 to transmit the media content to the home network 18 .

2. Control point (CP) 10 selects audio digital media renderer (DMR) 12 and video digital media renderer (DMR) 14 to form a combination.

2.1 Select Audio Digital Media Presenter (DMR) 12 .

2.2 Select Video Digital Media Presenter (DMR) 14 .

2.1 and 2.2 can be in no particular order.

3. The control point (CP) 10 obtains the transmission protocol/data format supported by the audio digital media renderer (DMR) 12 and the video digital media renderer (DMR) 14 .

3.1 Obtain the transmission protocol/data format supported by the audio digital media renderer (DMR) 12 through the CM::GetProtocolInfo() operation of the connection management service of the audio digital media renderer (DMR) 12 .

3.2 Return the transmission protocol/data format supported by the audio digital media renderer (DMR) 12 .

3.3 Obtain the transmission protocol/data format supported by the video digital media presenter (DMR) 14 through the CM::GetProtocolInfo() operation of the connection management service of the video digital media presenter (DMR) 14 .

3.4 Return the transmission protocol/data format supported by the video Digital Media Presenter (DMR) 14 .

3.1, 3.2 and 3.3, 3.4 can be in no particular order.

4. Select the appropriate transfer protocol and data format.

Control point (CP) 10 compares the transfer protocol and the data format of the returned media server (DMS) 16 and audio media demonstrator (DMR) 12 and video media demonstrator (DMR) 14, and selects the media data to transmit to the audio media demonstrator ( The transfer protocol and data format of DMR) 12, and the transfer protocol and data format of media data to video media renderer (DMR) 14.

5. A media data transmission connection is established between the digital media server (DMS) 16 and the audio digital media presenter (DMR) 12 and the video digital media presenter (DMR) 14 .

5.1-5.4 The digital media server (DMS) 16 and the audio digital media presenter (DMR) 12 notify the DMS and the audio DMR that there will be an input/output connection through the CM::PrepareForConnection() operation of their respective connection management services (CMS) , depending on the transmission protocol, DMS or audio DMR returns an AVT entity ID; audio DMR also returns an RCS entity ID and an AVS entity ID.

5.5-5.8 The digital media server (DMS) 16 and the video digital media presenter (DMR) 14 notify the DMS and the video DMR that there will be an input/output connection through the CM::PrepareForConnection() operation of their respective connection management services (CMS) , depending on the transmission protocol, DMS or video DMR returns an AVT entity ID; video DMR also returns an RCS entity ID and an AVS entity ID.

The CM::PrepareForConnection() operation is optional in the UPnP AV architecture and may not be implemented. Only one AVT Entity ID can be returned in either DMS or MDR. For more detailed content, please refer to the UPnP AV architecture defined in the UPnP Device Architecture Framework.

5.1-5.4 and 5.5-3.8 can be done in no particular order.

6. Set the audio digital media presenter (DMR) 12 and the video digital media presenter (DMR) 14 to a synchronous playback mode.

6.1 Set the audio digital media presenter (DMR) 12 to the synchronous playback mode through the AVS::SetSynchroMode() operation, and enter the synchronous playback state. It includes setting the media data separation mode of the audio data separator 20; setting the length of the buffered data in the audio data buffer 22.

6.2 Set the video digital media presenter (DMR) 14 to the synchronous playback mode through the AVS::SetSynchroMode() operation, and enter the synchronous playback state. It includes setting the media data separation mode of the video data separator 30 and setting the buffer data length of the video data buffer 32 . Because the audio of the media is played by the audio digital media presenter (DMR) 12, the video digital media presenter (DMR) 14 no longer plays the audio, and the video digital media presenter (DMR) 14 can be muted by RCS::SetMute() state.

6.1 and 6.2 can be in no particular order.

7. The media data is transmitted to the audio digital media renderer (DMR) 12 and the video digital media renderer (DMR) 14 through the home network 18, respectively.

7.1 Through the AVT::SetAVTransportURI () operation to identify the content that needs to be transmitted, the AVT transmission service calls the transmission control operation that the user wants, such as the playback operation AVT::Play (), the media data transmission subsystem 26 passes the media data through the home network 18 is transmitted to an audio Digital Media Presenter (DMR) 12 .

7.2 Through the AVT::SetAVTransportURI () operation to identify the content that needs to be transmitted, the AVT transmission service calls the transmission control operation that the user wants, such as the playback operation AVT::Play (), the media data transmission subsystem 26 passes the media data through the home network 18 Transfer to a video Digital Media Presenter (DMR) 14 .

Among them, the AVT::SetAVTransportURI() operation can only be performed on one of DMS and MDR. For more detailed content, please refer to the UPnP AV architecture defined in the UPnP Device Architecture Framework.

7.1 and 7.2 are performed simultaneously.

8. The audio data separator 20 and the video data separator 30 respectively separate the audio data and the video data in the media data, and store them into the audio data buffer 22 and the video data buffer 32 respectively.

8.1 The audio data separator 20 separates the audio data from the media data and stores it in the audio data buffer 22 .

8.2 The video data separator 30 separates the video data from the media data and stores it in the video data buffer 32 .

8.1 and 8.2 are performed concurrently.

9. Audio and video data synchronization preparation.

9.1 Prepare audio data synchronously through AVS::PrepareForSynchroData().

9.2 Return the information that the audio data synchronization is ready.

9.3 Prepare video data synchronization through AVS::PrepareForSynchroData().

9.4 Return the information that video data synchronization is ready.

The audio data buffer 22 and the video data buffer 32 buffer data of a certain length, such as 3 or 5 seconds. When the data in the buffer reaches the set length, it will return the information that the data synchronization is ready.

9.1, 9.2 and 9.3, 9.4 can be in no particular order.

10. Synchronization of audio data and video data.

Control point (CP) 10 sends synchronous control message to audio digital media presenter (DMR) 12 and video digital media presenter (DMR) 14 respectively, by AVS::AVSynchro () operation, the audio data in the audio data buffer 22 It is synchronized with the video data in the video data buffer 32.

The sending of control point (CP) synchronization messages can be determined by an algorithm.

11. Audio and video signal output.

11.1 Audio signal hardware output.

11.2 Video signal hardware output.

The audio data is decoded by the audio data decoder 24, and the audio signal is output by 28 audio hardware; the video data is decoded by the video data decoder 34, and the video signal is output by the 38 video hardware.

11.1 and 11.2 run concurrently.

12. The media data transmission is completed.

Repeatedly select the current media content or select the next content to play, then go to step 7; otherwise, go to step 13.

13. Media playback terminated.

13.1 The synchronous audio playback is terminated, and the synchronous playback mode of the audio digital media presenter (DMR) 12 is canceled through the AVS::AVSynchroComplete() operation.

13.2 The synchronous video playback is terminated, and the synchronous playback mode of the video digital media demo (DMR) 14 is canceled through the AVS::AVSynchroComplete() operation, and the sound state of the video digital media demo (DMR) 14 is restored.

13.3 The synchronous media playback is terminated, and the established connection between the digital media server (DMS) 16 and the digital media server (DMS) 12 and the audio digital media demo device (DMR) 14 is closed through CM::ConnectionComplete() operation.

13.1, 13.2 and 13.3 can be done in no particular order.

Extension method 2: Add a synchronous operation function on the basis of the connection management service (CMS).

FIG. 6 is a relationship diagram between the connection management service (CMS) and each functional module with synchronous operation added. Add synchronization operations based on the existing operations of the Connection Management Service (CMS): SetSynchroMode(), PrepareForSynchroData(), AVSynchro(), and SynchroComplete() to synchronize audio and video data. The process of each operation is the same as that of the extension method 1, and will not be repeated here.

The flow chart of the extension method 2 is given below, as shown in Figure 7, the flow chart corresponds to Figure 2, except that the following steps are different from the extension method 1, the others are the same:

5. A media data transmission connection is established between the digital media server (DMS) 16 and the audio digital media presenter (DMR) 12 and the video digital media presenter (DMR) 14 .

5.1-5.4 The digital media server (DMS) 16 and the audio digital media presenter (DMR) 12 notify the DMS and the audio DMR that there will be an input/output connection through the CM::PrepareForConnection() operation of their respective connection management services (CMS) , depending on the transmission protocol, DMS or audio DMR returns an AVT entity ID; audio DMR also returns an RCS entity ID.

5.5-5.8 The digital media server (DMS) 16 and the video digital media presenter (DMR) 14 notify the DMS and the video DMR that there will be an input/output connection through the CM::PrepareForConnection() operation of their respective connection management services (CMS) , depending on the transmission protocol, DMS or video DMR returns an AVT entity ID; video DMR also returns an RCS entity ID.

Extension method 3: Add a synchronous operation function on the basis of the AV transmission service (AVT).

In the UPnP AV architecture, the AV Transport Service (AVT) does not have to be implemented on the Digital Media Presenter (DMR). If the AV transmission service (AVT) has already been implemented on the digital media presenter (DMR), it is also possible to increase the synchronous operation on the basis of the existing operation of the AV transmission service (AVT) as in the second extension method: SetSynchroMode(), PrepareForSynchroData(), AVSynchro(), and SynchroComplete() are used to synchronize audio and video data. FIG. 8 is a relationship diagram between the AV transmission service (AVT) and each functional module with synchronous operation added. The process of each operation is the same as that of the extension method 1, and will not be repeated here.

The flow chart of the extension method three is given below, as shown in Figure 7, the flow chart corresponds to Figure 2, except that the following steps are different from the extension method one, the others are the same:

5. A media data transmission connection is established between the digital media server (DMS) 16 and the audio digital media presenter (DMR) 12 and the video digital media presenter (DMR) 14 .

5.1-5.4 The digital media server (DMS) 16 and the audio digital media presenter (DMR) 12 notify the DMS and the audio DMR that there will be an input/output connection through the CM::PrepareForConnection() operation of their respective connection management services (CMS) , the audio DMR returns an AVT entity ID; the audio DMR also returns an RCS entity ID.

5.5-5.8 The digital media server (DMS) 16 and the video digital media presenter (DMR) 14 notify the DMS and the video DMR that there will be an input/output connection through the CM::PrepareForConnection() operation of their respective connection management services (CMS) , the video DMR returns an AVT entity ID; the video DMR also returns an RCS entity ID.

Where MDR returns an AVT entity ID, DMS does not return an AVT entity ID. For more detailed content, please refer to the UPnP AV architecture defined in the UPnP Device Architecture Framework.

5.1-5.4 and 5.5-3.8 can be done in no particular order.

The above is only a preferred embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed in the present invention can easily think of changes or Replacement should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be determined by the protection scope of the claims.

Claims (13)

1, a kind of system of media play, comprise control point, digital media server, digital audio media demo device and digital video media demo device, it is characterized in that described digital audio media demo device and digital video media demo device comprise data buffering equipment respectively; The user selects digital audio media demo device and digital video media demo device in the local network to form combination by described control point.

2, system according to claim 1 is characterized in that, described digital audio media demo device and digital video media demo device also comprise data separating equipment and/or data decoding apparatus.

3, system according to claim 2 is characterized in that, described audio/video digital media presentation device comprises

Media data transmission subsystem: be used for receiving the media data that sends by network from digital media server;

Data extractor: be used for isolating the audio/video data in the media data;

Data buffer: be used for cushioning the audio/video data of separating;

Data decoder: be used for the audio/video data of decoding;

Audio/video is play the hardware output module: be used for the audio/video data of decoding is converted to the output of audio/video signal.

4, system according to claim 1 is characterized in that, the networking mode of described network comprises wired networking: IEEE1394, Ethernet and/or wireless networking: 802.11, bluetooth.

5, a kind of method of media play, it is characterized in that, the user selects and control audio digital media presentation device and digital video media demo device according to media content by the control point, by respectively on digital audio media demo device and digital video media demo device processing media data realize synchronous output.

6, method according to claim 5 is characterized in that, comprising:

A. the user determines digital audio media demo device and digital video media demo device by the control point according to the media content that will play;

B. digital media server is set up media data with digital audio media demo device and digital video media demo device respectively and is transmitted and to be connected;

C. the control point is provided with digital audio media demo device and digital video media demo device is the synchronous playing pattern;

D. be deposited in the data buffer after isolating data;

E. carry out buffering according to isolated data, voice data and video data are exported synchronously.

7, method according to claim 6 is characterized in that, also comprises:

On the basis of digital media presentation device, increase an AV synchronous service; Or

On the basis of media demo device connection management service, increase synchronous operation function; Or

On the basis of digital media presentation device AV transmission service, increase synchronous operation function.

8, method according to claim 6 is characterized in that, described steps A specifically comprises:

A1. the media content on the digital media server is searched and is chosen at the control point, and obtains transportation protocol and data format that the digital media server transfers media content is supported to network;

A2. the control point selects digital audio media demo device and digital video media demo device to form combination according to the media content of choosing;

A3. transportation protocol/data format that digital audio media demo device and digital video media demo device are supported is obtained at the control point, and selects suitable transportation protocol and data format.

9, method according to claim 8 is characterized in that, described steps A 3 specifically also comprises:

The transportation protocol and the data format of digital media server that the control point is relatively returned and digital audio media demo device and digital video media demo device, select suitable media data to be sent to the transportation protocol and the data format of audio frequency media demonstration device, and suitable media data is sent to the transportation protocol and the data format of video media demonstration device.

10, method according to claim 6 is characterized in that, described step C specifically also comprises:

C1., the media data separate mode of voice data separator and video data separator is set;

C2., the length of audio data buffer and video data buffer buffered data is set;

C3. digital audio media demo device and digital video media demo device enter the synchronous playing state.

11, method according to claim 10 is characterized in that, described step C specifically also comprises: it is mute state that digital video media demo device is set.

12, method according to claim 6 is characterized in that, described step D specifically also comprises:

D1. voice data separator and video data separator are isolated voice data and the video data in the media data that receives respectively;

D2. voice data and video data deposit audio data buffer and video data buffer respectively in.

13, method according to claim 6 is characterized in that, described step e specifically also comprises:

When E1. the data in buffer reached the length that sets, data sync was ready;

E2. carry out to voice data and the video data in the video data buffer that digital audio media demo device and digital video media demo device send in Synchronization Control message, the audio data buffer respectively synchronously at the control point.

Images