CN1997153B - A method and device for computer multi-video playing - Google Patents

Abstract

This invention provides a computer multiple visual play method and a device, wherein the method comprises the following steps: receiving at least two media source information from remote end and local place; reading relative media according to at least two media source addresses and decoding the media to respectively generate a path of visual frame data and an audio frequency data; displaying the at least two visual frames onto different window in same screen by calling a D3D port, wherein one window as main window and others as aid windows; selecting audio data relatived with the visual frame in main window for play and output. The invention realizes a multiple visual play PIP(picture in picture) function in computer, and greatly improve the user experience and expand the application and service of the video and the business market.

Description

A computer multi-video playback method and device

technical field

The present invention relates to the technical field of video playing, in particular, to a computer multi-video playing method and device.

Background technique

Watching video has become the main application of personal computer. Especially today when the Internet has entered millions of households, the network and network video have become a new channel for multimedia information dissemination. All kinds of video content, whether personal videos produced by ordinary users or video programs produced by professional media, can be downloaded or played online by Internet users around the world anytime and anywhere.

The original video signal needs to be compressed and encoded in order to reduce the size of the video file and reduce the bandwidth requirements in network transmission under the premise of ensuring the maximum audio and video quality. The compressed and encoded video needs to be decoded and restored to a watchable video on the user's computer.

Video encoding and decoding algorithms are relatively complex, especially for those videos with high compression ratio and high audio and video quality, if the video is encoded and decoded by software, it will consume a lot of system resources, and the processing power of the CPU and the size of the memory will be affected. very demanding. For this reason, encoding hardware equipment is required when a large number of videos are produced and transmitted; and in some embedded devices, such as set-top boxes, MP4 players, etc., decoder chips are used to restore videos.

The original videos are basically distributed in the form of files, and users need to completely download a copy of the video file before they can start watching, and because the video file is relatively large, it takes a long time to wait. For this reason, network-based streaming media video emerges at the historic moment, and users can watch streaming media video while downloading. The birth of streaming video has made IPTV an area of focus for telecom operators and video content providers in recent years. Users can watch various videos online on the broadband network. In addition, with the popularity of video DV equipment, ordinary users can also make personal videos like professional media. Therefore, various online video sharing sites have also been born. No matter which video service the user uses and which format the video content is obtained, the final video will be decoded and restored into a watchable video screen through the "video player".

Currently, the main operating modes of mainstream video players include: an independent application program mode (window mode), a mode embedded in a web browser, and a full-screen playback mode.

In the windowed mode, the user can use the player's menu, playback control buttons, maximize and minimize windows, and other functions like ordinary computer applications.

The mode of embedding a web browser is slightly different from the window mode. Some buttons and right-click menus for controlling video playback are retained, while functions such as maximization, minimization, and menus are removed. In most of the websites that provide various online video content and services, it can be seen that a video player is embedded on the webpage, and the user can watch the corresponding video content while browsing the webpage information.

Whether in windowed mode or embedded in webpage mode, users can make the video full-screen, that is, let the video screen occupy the entire display space. In full-screen mode, video scaling and control (pause, fast-forward, etc.) functions will be superimposed on the video screen, and users can control the video without exiting full-screen mode. Full-screen mode is a traditional video experience for users to watch TV and movies for a long time. In the case of full screen, the video will monopolize the user's attention, and full screen also has very high requirements for video quality.

All video players currently on the market have adopted the above three modes. On the one hand, it shows that Internet users have gradually formed a habitual behavior pattern of watching online videos. On the other hand, it also shows that this simple video watching mode has some key and difficult problems that cannot be overcome, including:

(1) Single video

These video players can only play one video in one player at any time. When the user needs to obtain multiple video contents, it can only be realized by opening more video windows. Multiple video windows can cause problems such as sound mixing together, taking up more system resources, and so on. The user experience can only be described as chaotic. Moreover, at present, on a PC without a specific graphics card installed, it is not possible to play another video on the screen while playing one video in full screen at the same time, that is, it is difficult to realize the picture-in-picture (PIP) under the full screen in a pure software manner.

(2) Separation of video and information

A large number of pictures, texts and Flash content on the Internet can only coexist with videos in web pages. To a large extent, due to its particularity, video attracts users' attention enormously, so it is difficult to pay attention to these related contents. In addition, under the full-screen or windowed playback mode, the user cannot obtain other types of information while watching the video.

The above problems in traditional video players have greatly restricted the creation of innovative video applications and services, especially hindering the development of the online advertising video market.

Advertising is one of the successful business models of the Internet. Traditional online advertisements are mainly based on pictures, Flash and text content, but the brand power that video advertisements can convey is unmatched by traditional methods. However, the current video advertising model includes the following two methods:

(1) Insert advertising video during program video playback (such as Yahoo Movie)

Similar to TV commercials, video ads are inserted during the broadcast of the program and completely replace the original video. For this method, on the one hand, the user experience is poor, and the user's normal viewing behavior is interrupted, and the user will often shift his viewing point to do other things during the playback of the advertising video. In-stream video, on the other hand, can only be implemented in two ways:

1) When making a program video, cut the advertisement into it

This requires a lot of manpower and material resources to be invested in video editing in the early stage, and once the video production is completed, the advertising content cannot be modified.

2) It is often only interrupted at the beginning and end of the program video playback

This wastes a lot of effective advertising opportunities and time, and it is difficult for users to fully focus on the video at the beginning and end. Moreover, such advertisement placement is relatively separated from the process of watching the program, and the user cannot choose, so the user experience is not good.

(2) Video advertisements appear on the page (such as iCast)

When the user browses the web, the video advertisement will automatically pop up. A large area blocks the content of the webpage, and users have no choice. Therefore, the user experience is relatively poor, and most of such advertisements will be blocked by the browser or the toolbar and cannot pop up.

In addition, online video can theoretically have infinite channels, which is different from the fixed number of traditional TV channels. But for individual users, their attention is limited. However, in the case of a single video, users do not fully enjoy the right to choose the various contents broadcast in these massive online video channels.

With the expansion of network bandwidth, the reduction of video storage costs and the popularity of video sharing and viewing, "video" has become the new focus of the Internet. The emergence of applications and services also hinders the innovation and development of video service business models.

Contents of the invention

In view of the above problems, the object of the present invention is to provide a computer multi-video playback method and device, so as to realize the picture-in-picture display of multi-video in the computer and improve user experience.

In order to achieve the above object, the technical solution of the present invention is:

A method for playing multiple videos of a computer, comprising the steps of:

According to the configuration setting interface display parameters in the configuration file and generate media reading control parameters, the configuration file includes the configuration of pre-defined templates, play plans and scripts, the interface display parameters include the position and size of the video, so The media read control parameter is a parameter used to control the media read time or frequency;

receiving at least two media source information from remote or local;

Read the corresponding media according to the addresses of the at least two media sources and the media read control parameters, and decode the media to generate one channel of video frame data and one channel of audio data;

According to the interface display parameters, using more than two triangles indicating the position and size to represent the position and size of each video frame to be displayed, and using a texture object to describe the bitmap data of each video frame;

Using D3D, based on the texture object and the positions and sizes indicated by the two or more triangles, at least two video frames generated by decoding are displayed on different windows of the same display screen, and one of the windows is used as the main window, so that Windows other than the main window are used as auxiliary windows;

Select the audio pulse modulation data corresponding to the video frame in the main window for playback and output.

The display refresh rate of the D3D interface is set to 25 frames per second.

The method also includes: setting interface display parameters in advance, so as to output and play video according to the interface display parameters.

The interface display parameters include: size, position, transparency and/or animation effect information of the video.

The method also includes: setting media reading control parameters in advance, so as to control the reading of each media according to the control information.

The media read control parameters include: media address and read time or frequency control information.

The media includes video streams and media files, and the media files include video, audio, FLASH, text and pictures.

The method also includes: setting a hyperlink on the video frame.

The method also includes: setting a shortcut key of the mouse or the keyboard to switch the main window and the auxiliary window.

The parameters are configured through an XML format configuration file, a command line, or a user-specified manner.

The main window and the auxiliary window are displayed in a stacked or side-by-side manner.

A multi-video playback device in a computer, comprising: an interface management unit, at least two media source reading units, a video presentation unit and an audio presentation unit;

The interface management unit is used to receive at least two media source information from remote or local, set the media source address according to the media source information, and set the interface display parameters and media read control parameters according to the configuration in the configuration file, The configuration file includes the configuration of predefined templates, play plans and scripts, the interface display parameters include the position and size of the video, and the media reading control parameters are used to control the media reading time or frequency parameters;

The media source reading unit is configured to receive a media source address, read the media according to the media reading control parameters, and decode the media to generate video frame data and audio data, and store the video frame data Send to the video display unit;

The video presentation unit is configured to use more than two triangles indicating the positions and sizes to indicate the positions and sizes of the video frames to be displayed according to the interface display parameters, and use texture objects to describe the video frames of the various channels. Bitmap data, and using D3D, based on the position and size indicated by the texture object and the two or more triangles, the video frames generated by the at least two media source reading units are displayed on different windows of the same screen, And use one of the windows as the main window, and use the window other than the main window as the auxiliary window;

The audio presentation unit is used to receive and play audio data corresponding to video frames in the main window.

The interface management unit is also used to preset interface display parameters, and transmit the interface display parameters to the video presentation unit, so as to output and play video according to the interface display parameters.

The interface display parameters include: size, position, transparency and/or animation effect information of the video.

The interface management unit is also used to set media reading control parameters, so as to control the reading of various media according to the control information.

The media reading control parameters include media reading time or frequency control information.

The display refresh rate of the D3D interface is 25 frames per second.

The media includes video streams and media files, and the media files include video, audio, FLASH, text and pictures.

By the present invention as described above, the mutual overlapping (or side-by-side) playback of multiple videos (video, pictures, text, FLASH, etc.) on the same screen is realized, that is, the picture-in-picture function of multi-video playback on the computer is realized , greatly improving user experience, expanding video applications and services, and expanding the commercial market.

Description of drawings

Fig. 1 is method flowchart of the present invention;

Fig. 2 is a schematic flow chart of displaying video frame data of the present invention;

Fig. 3 is the structural block diagram of multi-video playback device of the present invention;

FIG. 4 is a schematic diagram of a display scene 3 according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a display scene 4 according to an embodiment of the present invention;

FIG. 6 is a schematic diagram of a display scene 5 according to an embodiment of the present invention;

FIG. 7 is a schematic diagram of a display scene 6 according to an embodiment of the present invention;

8a and 8b are schematic diagrams of a display scene 7 according to an embodiment of the present invention.

Detailed ways

In order to make the object, technical solution and advantages of the present invention clearer, specific embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.

Example 1

This embodiment uses Microsoft's Direct3D (abbreviated as D3D) technology, utilizes the ability of Direct3D to process a plurality of graphic objects simultaneously, and realizes that a plurality of videos are simultaneously displayed on a full screen (picture-in-picture function).

In this embodiment, the basic principle of realizing computer video picture-in-picture display is: use two or more triangles to describe the position and size of a video/picture/text, and then input the data of these triangles to the function function of D3D to display them.

Computer video is generally a 4:3 rectangle, which can be represented by a right-angled triangle connected by two hypotenuses. The bitmap data of the video is described by a texture object (texture) supported by D3D. This texture is combined with the above two triangles. Correlation, and then input these data into the D3D function, a frame of video can be displayed with the specified position and size, and subsequent video frames can be continuously displayed to get the video playback screen.

Using the same working principle, you can put multiple different videos/pictures/texts on a screen, describe it with a series of triangles, and then input the D3D function for display at one time. By repeating this action continuously, you can get the effect that multiple videos/pictures/texts are intertwined and displayed at the same time.

Taking advantage of the video feature of 25 frames per second, the display refresh rate of D3D is also set to 25 frames per second, which can not only obtain smooth playback images, but also well control the consumption of CPU and memory. This is because D3D's processing power can simultaneously display many triangles and add textures within one second, and our system can describe a video/picture/text object with two triangles, and the objects that appear on the screen at the same time are generally No more than 50 (too many objects will cause confusion in the picture, which rarely occurs in practice), so in fact, most of the time, the number of triangles that need to be displayed per second is 50*2*25=2500, which is only a low 2500/3000000=0.08% of the D3D triangle processing capability of the configured machine (such as a laptop). The bitmap size of a frame of video is generally 640*480, and the number of bitmap points that need to be processed in one second is 640*480*25=7.68M, which only accounts for the D3D texture processing capability of machines with lower configurations (such as laptops). 7.68M/242.6M = 3.17%. It can be seen that D3D is fully capable of processing high dynamic data streams such as several videos.

D3D supports two display modes of window and full screen, and can switch between the two modes at any time. The functions supported by the two display modes are the same. Since the way we implement it is to directly use D3D to realize the functions of multi-video and image-text superimposition, these functions have the same performance under the window and full screen.

D3D supports the mouse function in both window and full-screen modes. During video playback, when the computer receives a mouse click event, it will search in the screen object list according to the coordinate position of the mouse. The screen objects contain information such as position and size. , you can judge which object the mouse clicked. If the object defines an associated action, the playback system will execute the action. This action can be a wide range of functions, such as showing/hiding an object, generating/destroying it other objects etc. In this way, further information can be provided for the user, and an interactive function can be provided for the user.

Our system displays 25 times per second. Before each display, the properties such as the position, size and texture of the triangle can be changed, so the system can provide real-time update of the displayed picture/text information, change the position and size, and make animation effects, etc. .

Although in this embodiment, the D3D function is used to realize the picture-in-picture display of multiple videos, the present invention is not limited thereto. Using OpenGL, DirectShow and other computer graphics and video processing interfaces similar to D3D can also process multiple visual objects and display them on the same screen, but the effect achieved is difficult to compare with D3D.

If we adopt other 3D technologies, such as OpenGL, we can also achieve all the functions of our system realized by D3D, but OpenGL is aimed at professional users and has high requirements for hardware. In addition, the control VMR9 (Video Mixing Render 9) provided by Microsoft in the DirectShow SDK can also superimpose and display two decoded video streams on the screen, but there are many problems in the application of VMR9, such as difficulty Smoothly move or change the size of a small video window, and there are large efficiency problems when displaying more objects.

Fig. 1 is a schematic flow diagram of realizing multi-video playback in the same screen according to the present invention. As shown in Figure 1, the following steps may be included:

(1) Read XML (eXtensible Markup Language, Extensible Markup Language) configuration file

In this embodiment, an XML configuration file can be used to configure multi-video playback. When various multimedia contents are simultaneously displayed in a centralized interactive interface, it is not only necessary to coordinate the synchronization and step-by-step display of various contents, but also to handle user interaction, respond to user actions, and so on. Therefore, it is necessary to pre-define templates, play plans and scripts to control video content and other multimedia information, and be responsible for communicating with the server to process user control signals at any time. Pre-defined templates, play plans and scripts can be configured through XML configuration files. The configuration file also includes multiple (including two) media source information to be played.

Said configuration can also be realized by manual configuration or by entering a command line.

(2) Generate interface elements according to the configuration file, and set various attributes of the interface elements.

Corresponding to the number of media to be played, the same number of interface elements is generated. Here, the interface elements include interface display parameters such as video size, position, transparency, animation effects (such as fade in and fade out, rotation), and setting the properties of the interface elements means setting the interface display parameters. The set interface elements can be sent to the unit for video display in the form of a queue. According to the set interface elements, the display effect of the media can be controlled when the corresponding media is played.

(3) generate media reading control parameters according to the configuration in the configuration file, set the media source address (such as URL, Uniform Resource Locator, i.e. URL), and read the corresponding media (comprising media files and media streams, etc.) according to the settings, The media can be located on a local computer or a remote server), and respectively decode the media packets into video frame data and audio pulse modulation data. Corresponding to multiple media, it is decoded into corresponding multiple channels of video frame data and audio pulse modulation data. For example, in the case of displaying two videos at the same time, the two media sources will be decoded into two channels of video data and two channels of audio data according to the addresses corresponding to the two media sources.

Here, the media reading control parameter is a parameter used to control the time or frequency of media reading. For example, control the media that generates the auxiliary window to be read and played every 5 minutes, or read and play when the media in the main window is connected, downloaded, and buffered. This parameter can be easily modified and set as required.

(4) Display the multi-channel video frame data generated by decoding in different windows on the same screen according to the setting of interface elements. The specific steps are shown in Figure 2.

The video display unit continuously checks whether there are any interface elements that need to be displayed in the interface element queue. When the video display unit finds that there are elements that need to be displayed, it will set the display parameters according to the parameters specified by the interface structure unit, and then display the elements from the queue. Interface elements are removed.

The video display unit decomposes the interface elements to be displayed into triangles. If the interface elements to be displayed are videos, the video display unit will obtain the bitmap data of the video frame from the unit that reads the media source and convert it into a texture object .

The video presentation unit sets the texture, position, and size of the triangle according to the obtained display parameters and texture data. Then call the D3D interface to output the display screen of interface elements composed of many triangles to the screen buffer.

At this time, the video display unit will check whether the display of the previous frame has passed 1/25 second, if not, then wait, if it has passed 1/25 second, then call the D3D interface to output the display picture in the picture buffer to the computer screen superior.

The video displayer will continuously repeat the process shown in Figure 2, so that the video can be played smoothly.

Among the different displayed windows, one of the windows is used as the main window, and the other windows are used as auxiliary windows. For example, the window with the larger display size can be used as the main window.

(5) Select to play the audio decoding data of a certain media source as required.

Usually, the audio decoding data corresponding to the video frame in the main window is used for playback output.

After the above steps, the multi-video playback effect with the picture-in-picture function is realized. Not only can avoid the monotony of a single video, but also will not cause the sound to be mixed; and when playing the main video, if you want to insert media content such as advertisements, you don’t need to cut the advertisements when making the main video media, and you can play them at any time and, since the position size, transparency, etc. of the advertisement page can be controlled, it can be played when the main video media is played in time, and the viewing effect of the main video media will not be affected too much, thus greatly improving the user experience.

Using 3D technology, the multi-video playback method of the present invention can support at least two video windows seamlessly and smoothly overlapping experience (picture-in-picture function): if the picture is divided into a main video window and an auxiliary video window, what the user hears The sound is the sound played in the main video window.

The present invention can also superimpose a plurality of auxiliary videos, Flash, pictures and text content on the video playback interface, and can support the superimposition of scrolling subtitles (including text and pictures) on the video through the setting of interface elements. The content and related parameters of subtitles can be set.

The present invention can also switch the main video window and the auxiliary video window by setting a shortcut key, that is, to exchange the broadcasting positions of the main video program and the auxiliary video content broadcast simultaneously. After the auxiliary video content is played, the main program video will return to the main playback window for playback.

The invention also supports the insertion of video advertisements during P2P connection, download and buffering. When the playback client connects or switches channels for the first time, there will be no playback content in the main video window due to connection, download and buffering. At this time, the client broadcasts the advertisement in the main video window according to the arrangement of the auxiliary video delivery plan, and simultaneously displays the progress of connection, download and buffering. When the buffering of the main video program is completed, it will be played directly in the main video window, and the advertising video will be automatically switched to the auxiliary video window to continue playing until the auxiliary video is played.

The present invention also supports hyperlinks. A hyperlink can be specified on the content (text and picture) of the advertisement video, picture and scrolling subtitle. After the user clicks on the auxiliary video window, picture and text content, a new browser window pops up to open the corresponding link.

In the process of switching main and auxiliary video windows and the appearance of auxiliary video content, the present invention supports various scene switching effects. Such as: 1. Fade in and fade out, 2. Pop in and pop out, 3. Fly in and fly out effect switching.

The present invention also supports full-screen and window playing. When the user double-clicks the video playback position, it will automatically switch to the window or full-screen playback mode.

The present invention can provide users with shortcut keys for mouse operation and keyboard, and perform the following actions: 1. Switch between the main video window and the auxiliary video window; 2. Switch between full screen and window playback; 3. Switch the broadcast address of the main program video (channel switching). For example, the channel of each program video can be superimposed on the main program video window in the form of text, and the channel can be switched by clicking the corresponding channel with the mouse or operating the shortcut key of the keyboard.

The invention can also provide a separate client application. Users can directly run the client program to watch the main video stream and the corresponding advertisement delivery content. The operating systems that need to be supported include: WindowsXP and Windows 2003.

In addition, the client can be embedded in a web page. The client can be embedded into the webpage, and the embedded client can also play the main video program and advertisement delivery content. The same interaction is supported (mouse and keyboard shortcuts, etc.). In addition, users can switch channels by clicking the channel link on the page.

The above picture-in-picture multi-video playback method in this embodiment can be realized by software, hardware or a combination of software and hardware. For example, a new video player for multi-video playback can be produced by software according to the above steps, so as to run on the computer. The video player of the present invention may include the following modules (illustrated with the picture-in-picture display comprising 2 videos as an example):

Interface management module, two media source reading modules, video display module and audio display module.

The interface management module is used to receive two media source information, and set the media source address, interface display parameters and media read control parameters; wherein, the interface display parameters (or interface elements in general) mainly include the size and position of the video , transparency, animation effects (such as fade in and fade out, rotation) etc. (but not limited to this, may also include some other commonly used screen display parameters), these parameters can be modified and set. The media reading control parameter is mainly used to control the reading of the media file by the media reading module, for example, the media file that controls the generation of the auxiliary window is read and played once every 5 minutes, and is read and played simultaneously with the main video media file , or play files in the main window to read and play when connecting, downloading and buffering. The interface management module transmits two interface display information (or interface elements) corresponding to two media sources to the video display module.

The two media source reading modules are used to read media (such as media files and/or media streams) according to respective media source addresses, and decode the media to generate corresponding video frame data and audio data, and and transmitting the video frame data to a video presentation unit.

The video presentation module is configured to display the video frames generated by the two media source reading units on different windows of the same screen, and use one of the windows as the main window, and use windows other than the main window as auxiliary windows Windows;

The audio display module is used to receive and play one of the two channels of audio pulse modulation data. For example, the audio pulse modulation data corresponding to the video played in the main window can be selected for playback.

The video player of the present invention can support playing mainstream video format files or streams, such as WMV, H.264, mpeg-2/4, Flash, etc.

The XML configuration file can be used to pre-configure the display template, play plan, etc., and the interface management module can set the client parameters according to the configuration of the Xml configuration file. Therefore, the following playback management functions can be realized through the XML configuration file and the interface management module:

(1) Can control the broadcasting of advertising videos. For example: 1. Specify the location of the advertisement video (file or video stream address); 2. The time and frequency of advertisement delivery; 3. The initial size, appearance position and switching effect of the auxiliary video window where the advertisement is located.

(2) It can control the broadcasting of advertisements with scrolling subtitles. 1. Can control the content of scrolling subtitles (text and pictures); 2. Can control the time and frequency of subtitles; 3. Can control the speed of scrolling; 4. Can control the position of subtitles; 5. Can set the appearance of subtitles, Including size, font, color and translucency.

(3) Can control the placement of image advertisements. For example, the image file address, appearance time and frequency, image position and size of the advertisement image (such as Logo) can be set.

(4) Support real-time interstitial advertisements. For example, the client can receive instructions from the server through the remote interface, and insert video advertisements in real time.

(5) It can be broadcast according to the pre-release advertising plan. In the form of a remote interface or a file, it supports the Schedule for advertising delivery. These Schedules are pre-published to the client before the advertisement is broadcast. The client will broadcast advertisements in the form of Schedule. The Schedule can include advertisement content, broadcast form, and broadcast plan (broadcast time/scheduled broadcast frequency).

(6) Record the advertisement playing log. It can record the actual situation of the advertisement broadcast when the user is watching the video. The data to be recorded includes: 1. User ID or client ID; 2. Time; 3. Main video program ID; 4. Advertisement ID, start broadcasting Time and duration; 5. The advertising space used for advertising.

(7) Support asynchronous download of advertising videos. The advertisement video to be delivered can be downloaded to the client in advance in an asynchronous manner.

(8) Provide remote management interface. It can provide a remote call interface and support the following controls: 1. Advertisement video placement and playback control; 2. Text and image advertisement placement and control; 3. Advertisement playback log data collection.

(9) Flexible installation and upgrade. Users can download or install the client online. Users can upgrade the client online.

(10) Asynchronous advertisement broadcast log collection. Ad broadcast logs recorded by the client can be collected periodically in an asynchronous manner.

(11) Provide advertising statistics reports. Perform data mining on actual broadcast logs in various dimensions, and generate reports: 1. by advertiser; 2. by advertisement content; 3. by advertisement position; 4. by advertisement period; 5. others. Moreover, statistical results can be output in the form of Xml or Excel files.

Several scenarios are listed below to illustrate the user experience brought by the video player of the present invention.

scene 1:

Ms. A likes to watch Taiwan's variety show "Kangxi Is Coming" recently, but because the mainland TV station does not broadcast it, Ms. A can only watch it through online video.

As usual, Ms. A went to her favorite online video site to watch the latest issue of "Kangxi Is Coming". The guest of this issue is Taiwanese singer - Ren Xianqi.

Miss A clicks the webpage link, and the webpage invokes the video player of the present invention to start playing.

1) When starting to play, due to the time required for network connection and buffering, what Ms. A sees in the player during this time is the trailer of other exciting video programs on the video website;

2) After the connection is successful and the buffering is completed, Ms. A starts to watch "Kangxi Is Coming". One minute after starting to watch, a rotating video website Logo picture will automatically appear on the video screen, reminding the user that this video is copyrighted;

3) After 5 minutes of watching, a scrolling subtitle appeared at the bottom of the video screen, prompting the user "Ren Xianqi's fan club will be held at X on X, X...";

4) After 10 minutes of watching, a small video window slowly popped up at the bottom of the video screen. The content of the video was an advertisement video. The content of the video was "Ren Xianqi's latest album release and MV clip". "Kangxi Is Coming" was switched to the small window for broadcast, while the advertising video was switched to the main video window for broadcast.

Ms. A was very interested in the content of the advertisement. After clicking the main video window, the page of the online book audio-visual website popped up, and she started to buy. At the same time, "Kangxi Is Coming" switched back to the main video window and started playing.

Scenario 2:

The 2010 World Cup kicked off. Mr. Cool heard that the digital signal of Sky TV in the UK passes through multiple channels, and the pictures taken by multiple cameras in different positions of a game are broadcast live at the same time. TV viewers can freely choose and switch their desired From which angle to watch the game. Mr. Cool also found an online video live broadcast website that provides similar services on the Internet.

Mr.Cool opens the live video website, selects a live match (Netherlands vs. Germany), and the web page invokes the video player of the present invention to start playing.

1) The main video window initially plays the video content transferred from the public TV signal

2) There are four small video windows below the main video window, which are synchronously playing three live video streams transmitted from the cameras behind the goals of the two teams and the camera tracking star players, and one is just edited by the website editor A video stream of the game highlights played repeatedly.

3) The Dutch team attacked, Mr. Cool quickly switched to the video stream behind the German team's goal. The ball went in! During the half-time break, Mr.Cool switched to the highlights video window to watch the replay of highlights from the first half.

scene 3

During P2P connection or video download, the advertisement is displayed in full screen, and the connection progress is displayed in a small window at the same time (as shown in Figure 4). After the connection is complete, the main window displays the original video.

scene 4

During the advertising time of the rebroadcast program, the small window rises to broadcast the operator's program preview advertisement (as shown in Figure 5). The operator's program preview advertisement is automatically switched to the large window (advertisement at this time), and the small window continues to display the original program (advertisement at this time), or it is switched by the user, because the preview program seems to be more attractive than the original advertisement.

scene 5

During the broadcasting of the program, a small window is displayed according to the pre-established advertising policy, and the advertisement is played (as shown in FIG. 6 ), and the user can switch between the programs. Wherein the advertisement small window can be set to play once every fixed time (every half an hour), and the duration is 5 minutes.

scene 6

A picture (as shown in FIG. 7 ) is displayed on the upper left of the screen (or at any position), and the display time and times can be controlled. The picture can be an advertisement or a station logo.

scene 7

Superimpose and display the clock on the video, start displaying one minute before the hour or the half hour, and continue to display for one minute to one and a half minutes. While displaying the time, it can display clock advertisements, and an analog clock can be set on the dial (as shown in Figure 8a) , the digital clock is at the top (as shown in Figure 8b).

Example 2

In this embodiment, a device for realizing multi-video playback is described.

FIG. 3 is a structural block diagram of the multi-video playback device of the present invention. Here, only a picture-in-picture playback device including two videos is used as an example for illustration, so that it can be easily extended to the picture-in-picture display of multiple videos. As shown in FIG. 2 , the device mainly includes: an interface management unit, two media source reading units, a video presentation unit and an audio presentation unit.

The interface management unit is used to receive two media source information, and set media source address, interface display parameters and playback control parameters according to each media source information; wherein, the interface display parameters (or collectively referred to as interface elements) mainly include video The size, position, transparency, animation effects (such as fade in and fade out, rotation) etc. (but not limited to this, may also include some other commonly used screen display parameters), these parameters can be modified and set. The play control parameter is mainly used to control the media reading unit to read the media file, for example, the media file that controls the generation of the auxiliary window is read and played once every 5 minutes, read and played simultaneously with the main video media file, or Play files in the main window, read and play when connecting, downloading and buffering. The interface management unit transmits two interface display information (or interface elements) corresponding to the two media sources to the video presentation unit.

The two media source reading units are used to read media files (comprising media streams) according to the respective media source addresses, and decode the media files to generate corresponding video frame data and audio data, and transmit the The video frame data is sent to the video presentation unit.

The video presentation unit is configured to display the video frames generated by the at least two media source reading units on different windows of the same screen, and use one of the windows as the main window, and use a window other than the main window as the main window. Auxiliary window;

The audio display unit is used for selectively receiving one of the two channels of audio pulse modulation data for playing. For example, the audio pulse modulation data corresponding to the video played in the main window can be selected for playing.

By setting the above unit in the computer, the picture-in-picture playback of the video can be realized.

The above specific embodiments are only used to illustrate the present invention, but not to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.

Claims (11)

1. a multi-video playback method of computer, is characterized in that, the method comprises the steps: According to the configuration setting interface display parameters in the configuration file and generate media reading control parameters, the configuration file includes the configuration of pre-defined templates, play plans and scripts, the interface display parameters include the position and size of the video, so The media read control parameter is a parameter used to control the media read time or frequency; receiving at least two media source information from remote or local; Read the corresponding media according to the addresses of the at least two media sources and the media read control parameters, and decode the media to generate one channel of video frame data and one channel of audio data; According to the interface display parameters, using more than two triangles indicating the position and size to represent the position and size of each video frame to be displayed, and using a texture object to describe the bitmap data of each video frame; Using D3D, based on the texture object and the positions and sizes indicated by the two or more triangles, at least two video frames generated by decoding are displayed on different windows of the same display screen, and one of the windows is used as the main window, so that Windows other than the main window are used as auxiliary windows; Select the audio pulse modulation data corresponding to the video frame in the main window for playback and output. 2. The method according to claim 1, characterized in that: Set the display refresh rate of the D3D interface to 25 frames per second. 3. The method according to claim 1, wherein the interface display parameters further include: transparency and/or animation effect information of the video. 4. The method according to claim 1, characterized in that: The media includes video streams and media files, and the media files include video, audio, FLASH, text and pictures. 5. The method according to claim 1, characterized in that the method further comprises: A hyperlink is set on the video frame. 6. The method according to claim 1, characterized in that the method further comprises: Set a mouse or keyboard shortcut to switch between the main window and the auxiliary window. 7. The method of claim 1, wherein: The main window and the auxiliary window are displayed in a stacked or side-by-side manner. 8. A multi-video playback device in a computer, characterized in that the device comprises: an interface management unit, at least two media source reading units, a video presentation unit and an audio presentation unit; The interface management unit is used to receive at least two media source information from remote or local, set the media source address according to the media source information, and set the interface display parameters and media read control parameters according to the configuration in the configuration file, The configuration file includes the configuration of predefined templates, play plans and scripts, the interface display parameters include the position and size of the video, and the media reading control parameters are used to control the media reading time or frequency parameters; The media source reading unit is used to receive the media source address, read the media according to the media reading control parameters, and decode the media to generate video frame data and audio data, and transmit the video frame data to the video display unit; According to the interface display parameters, the video presentation unit uses more than two triangles indicating the positions and sizes to indicate the positions and sizes of the video frames to be displayed, and uses texture objects to describe the bitmaps of the video frames data, and use D3D to display the video frames generated by the at least two media source reading units on different windows of the same screen based on the texture object and the positions and sizes indicated by the two or more triangles, and use One of the windows is used as the main window, and the window other than the main window is used as the auxiliary window; The audio presentation unit is used to receive and play audio data corresponding to video frames in the main window. 9. The device according to claim 8, characterized in that: The interface display parameters also include: video transparency and/or animation effect information. 10. The device of claim 8, wherein: The display refresh rate of the D3D interface is 25 frames per second. 11. The device of claim 8, wherein: The media includes video streams and media files, and the media files include video, audio, FLASH, text and pictures.

Images