TWI497983B - Internet video playback system and its method - Google Patents

Description

Network video playing system and method thereof

The present invention relates to a multimedia playback system and method, and more particularly to a network video playback system and method thereof.

User Generated-Content (UGC) service is a new type of network service developed in recent years. It mainly provides a sharing space for network users to upload information or files. Through this service, each network user no longer accepts the information provided by the network administrator in one direction, but can actively distribute information and provide file information to other road users. Under this kind of network service, users start to create a large variety of materials such as text, pictures or video data (Multimedia Data), and upload them to user-originated content service websites such as FACEBOOK or YOUTUBE. Because of this, the amount of information stored in these user-originated content service websites has grown rapidly, allowing each web user to view more information.

User-originated content services can provide a large number of, multi-category and multi-view information, but in order to avoid excessive data resources burden caused by excessive data files, user-originated content service websites often limit the file size of uploaded videos in the video uploading part. The length of time to play with the movie. Therefore, when a web user uploads a movie, it is often necessary to cut the movie into multiple clip movies. In this case, the network user must set specific search conditions, through the file search tool built in the user-originated content service website, or the information search website such as GOOGLE, etc., in order to obtain the complete movie group of the movie, and play the sequence in sequence. And other clip videos to understand the content of the entire film.

Moreover, when playing the video clips, the network user must first find and play the first video of the clip movie, and after the browsing ends, find the succeeding lower segment from the plurality of clip videos at intervals and frequently. Video; continuous playback and selection of such a game in order to fully view a complete movie is very time consuming and inconvenient.

Although there is mobile Internet Protocol Television (IPTV) technology, which allows network users to enjoy multimedia services via wireless networks and through application devices such as smart phones, it can only provide limited multimedia data. Accepting limited service requirements and not being able to provide a wide range of multimedia services for a wide range of users.

In view of this, the main object of the present invention is to provide a method for playing a network movie, which can correctly sort and continuously play a complete segmented movie in the same movie, so as to avoid constantly searching for segmented films and judging the order thereof. Troubled.

An object of the present invention is to provide a network video playing system, which can be used by a user to browse a favorite television program on a user-originated content website through an Internet on an application device, and can continue to play without interruption. .

In order to achieve the purpose of the foregoing disclosure, the method for playing a network video provided by the present invention is mainly for playing a group of videos obtained by searching on the network according to predetermined conditions; the main steps are as follows:

a. From each film of the film group, at least one picture is taken at the beginning end and the end end respectively;

b. Aligning the start picture of each movie with the end picture of other movies, and approximating the start picture to the end picture of another movie, sorted after the other movie;

c. According to the sorting done in step b, the videos in the sorting are continuously played.

Similarly, in order to achieve the foregoing objective, the present invention provides a network video playing system for implementing the above method, including a management server and at least one application device, and the management server and the application device have network interconnection. The management server includes a browsing module, a parsing module, and a streaming module. The application device includes a user interface module and a playing module.

The user interface module is used for the user to input a retrieval command and transmit the instruction to the browsing module via the network.

The browsing module is configured to search for a movie group that meets the search instruction in the Internet resource according to the retrieval instruction transmitted by the interface module, and download the video group to the management server.

The parsing comparison module is configured to capture at least one picture from the beginning and the end of each movie of the film group, and compare the start picture of each movie with the end picture of other videos, and The starting picture is similar to the movie of the end picture of another movie, sorted in the manner behind the other movie, the playing order of the film group is arranged, and the film group is transmitted to the streaming module in this order.

The stream module is configured to continuously stream the film group transmitted by the parsing module to the player module.

The play module is used to continuously play a group of videos streamed by the stream module.

The method for playing a network video according to the present invention is mainly for playing a group of videos obtained by searching on the network according to predetermined conditions.

The "predetermined condition" refers to a text search condition such as the name of the selected movie or program, the date or time of the broadcast, the name of the actor, or the length of the movie. Before entering the text search conditions, you can first search for the electronic program form (EPG) from a user-originated content service website such as FACEBOOK or YOUTUBE, or an information search website such as GOOGLE, using keywords such as program names. Then, from the electronic program form, confirm other information such as the broadcast date or time, the name of the actor, the length of the movie, or the summary of the content of the movie, and then use the information as a text search condition.

The "searching on the Internet" refers to searching on a user-originated content service website such as FACEBOOK or YOUTUBE, or an information search website such as GOOGLE, according to the above search conditions; It is a film with the above search conditions in Metadata.

The main method steps of the method of the present invention are as follows:

a. From each film of the film group, at least one picture is taken at the beginning end and the end end respectively;

b. Aligning the start picture of each movie with the end picture of other movies, and approximating the start picture to the end picture of another movie, sorted after the other movie;

c. According to the sorting done in step b, the videos in the sorting are continuously played.

Among them, in view of the transmission, most of the multimedia data on the network is compressed (Video Compression), such as encoding the video file by using MPEG or H.264 compression method. Therefore, in the above step a, the video compression format and the number of images are parsed through a Network Abstraction Layer header (NAL header), and the beginning and the end of each video file are captured ( The Group of picture, GOP) data is decoded to be restored to raw data, and at least one picture is selected therein.

Based on the preferred considerations, in the above step a, after capturing the group of picture (GOP) data at the beginning and end of each video file for decoding to restore the original data, it is also possible. The start-end picture group and the end picture group are directly selected for comparison with the subsequent step b.

In the above step b, the method of comparing the start-end picture of each movie and the end picture of other movies mainly intercepts the feature values of the respective pictures, and compares the pictures according to the manner disclosed in the above step b. The feature value of the captured picture may be intercepted for an object of the picture, such as an object boundary, a color space, an action vector, or a specified block. There are many ways to extract eigenvalues, including wavelet transform, grayscale conversion, dynamic time migration, and discrete cosine transform.

In this embodiment, the method for comparing pictures according to step b is to obtain the feature values of the respective pictures by Discrete Cosine Transform (DCT) and the averaging operation, and then compare the starting ends of the respective pictures. The picture feature value and the end picture feature value of other movies; wherein, the operation value of the feature value υ is as follows:

among them,

In the above expression, N is the number of columns of the respective pictures; M is the number of rows of the respective pictures; i is the column position of the respective picture space fields; j is the row direction pixel position of the respective picture space fields; For each pixel frequency domain column to the pixel position; v is the row direction pixel position of the respective picture frequency domain.

In order to avoid lengthy comparison time, the preferred method disclosed in the present invention is to first cut each picture into a plurality of blocks, and perform discrete cosine conversion on the blocks based on the above operation formula (Discrete) Cosine Transform (DCT) and averaging operations to obtain the block eigenvalue f , which is expressed as follows:

among them,

Then, the feature values f of the respective blocks of the picture are added and divided by the number of blocks, and the feature values of each picture are obtained, and the calculation formula is as follows:

Where N is the number of columns of each block; M is the number of rows of each block; i is the column position of the spatial domain of each block; j is the row-to-pixel position of each block spatial domain; u is the area The column frequency domain is listed to the pixel position; v is the row direction pixel position of each block frequency domain; R is the number of blocks in each picture; x=1, 2, 3, ... R.

After obtaining the feature values of the pictures, the film is compared with the feature values of the pictures in the manner disclosed in the above step b, and the feature values of the start picture are approximated to the feature values of the end pictures of another movie, and are sorted in After the other film.

In order to improve the correctness of the comparison, after obtaining the characteristic values of each picture, the block trend F _TR can be taken again, and the calculation formula is as follows:

Where n = 1, 2, 3, ... R-1; K is an offset constant.

Then, in addition to the features of the above-mentioned steps b, the block trend values of the pictures can be compared with the picture block values of the pictures in the manner of the above step b to obtain a more accurate comparison result.

In order to obtain a more accurate comparison result, in the above step a, the group of picture (GOP) data of the beginning and end of each video file is captured for decoding to restore the original image (raw data). Alternatively, the start-end picture group and the end picture group may be directly selected for comparison with the subsequent step b. In the above step b, each picture feature value in each picture group is added, and then the picture number of the picture group is divided to obtain a group feature value of each picture group. Then, according to the method disclosed in the above step b, the group feature values of the group of pictures are compared, and the group feature values of the start picture group are approximated to the group feature values of the end image group of another movie, and are sorted in After the other film.

In the above step c, according to the sorting done in the above step b, the manner of playing the video in the sorting may be firstly from the user's original content service website such as FACEBOOK or YOUTUBE, or the information search website such as GOOGLE. Waiting for the video to be downloaded to a device with a video playback function, such as a personal computer, a mobile phone, a personal digital assistant (PDA), or a device such as a set-top box, and then continuously playing the sorted video in sequence. . Alternatively, the videos may be serially streamed to a device having a movie playing function, such as a personal computer, a mobile phone, a Personal Digital Assistant (PDA), or a set-top box. Wait for the device to play.

With the above-mentioned online video playing method, the action of replaying and selecting the movie replaying action and distinguishing the order of the video can be eliminated and repeated, and the time before playing a network movie can be greatly shortened.

In order to apply the above method of the present invention, the present invention further provides a network video playing system, which is illustrated by the following embodiments.

Please refer to FIG. 1, which is a schematic diagram showing an application architecture of a network video playing system 1 according to a preferred embodiment of the present invention. As shown, the network video playback system 1 mainly includes a management server 12 and an application device 13. It should be noted that the number of application devices is not limited thereto, and the network video playing system 1 can also be applied to multiple application devices. Further, the application device 13 refers to a device that can connect to a network and execute an application, such as a mobile phone (especially a smart phone), a notebook computer, a personal computer, or a personal digital assistant (PDA). Moreover, the network may include a regional network or a wide area network, and the regional network may be connected to a wired network such as an Ethernet network or a wireless network such as Wi-Fi or 3G.

In general, the user can establish a streaming connection mechanism with the management server 12 by the application device 13. After the connection mechanism is completed, the user can use the previous browsing history or the user to input the browsing request message through the application device 13, and the management server 12 receives the browsing request message, and then based on the message content on the user original content website. 11, 11 ', 11" to find relevant information, such as the relevant electronic program form, and according to the browsing request message, compare the electronic program form to capture the relevant movie name, play date or channel and other video on-demand menu information, and transmit The application device 13 is created as a movie on-demand menu for the user to select a favorite movie.

Due to the limitation of the size of the uploaded video and the length of the playback time of the user-originated content website 11, 11', 11", when the web user uploads a movie, the video must be cut into a plurality of clip videos, so the user is After selecting the favorite movie, the management server 12 retrieves relevant information corresponding to the selected movie, such as the name of the movie, the date and time of the play, the performer, the length of the movie, etc., and uses the information on the user-generated content website 11, 11', 11" Compare the interpretation of the film (METADATA) and download all the segmented videos in the interpretation data that match the information.

The interpretation data (METADATA) is a semantic format used to assist in describing the file format. It can be described by Extensible Markup Language (XML) or HyperText Markup Language (HTML). Users of non-owners can easily understand the information about their files and use them for data exploration.

Please refer to FIG. 2, which is a block diagram of the basic architecture of the network video playing system 1 of this embodiment.

The management server 1 management server 12 includes a browsing module 121, an analytical comparison module 122, and a streaming module 123. The application device 13 includes a use interface module 131 and a video play module 132.

The browsing module 121 is configured to retrieve the user original content website 11 by using a keyword, and obtain relevant electronic program form information, interpretation data, and link website information, and transmit the information to the analysis comparison module 122 for data comparison. Correct. The parsing comparison module 122 further includes a program form matching unit 1221, an interpreting data matching unit 1222 and an image feature matching unit 1223, where each unit executes the program.

Referring to FIG. 3, after the parsing module 122 receives the relevant data from the browsing module 121, the electronic program form information and the interpretation data are respectively delivered to the program form comparison unit 1221 and the interpretation data comparison unit 1222.

The electronic program form is an extended markup language format file transmitted via a digital television or a network, and the content includes a channel list, a program name, a start time, an end time, and an introduction to the program. The program form matching unit 1221 uses the Simple API for XML (SAX) to parse and extend the markup language file data, and the SAX is an extended markup language file access analysis interface, which treats the extended markup language file as a text stream data. During the process of reading the extended markup language, a series of trigger events are set, and the event is triggered when the system resolves to the set condition; this method belongs to a unique and forward-only algorithm, which consumes less energy and consumes less memory. It can also reduce the system resolution time.

The program form matching unit 1221 compares the Chinese and English names of all the videos in the electronic program form, and captures the video on-demand menu information such as the movie name, channel and playing time according to the condition of the matching condition, and stores the information in a database and transmits the information. To use the interface module 131 to create a channel-selected video on-demand menu for the user to select a favorite movie. After the user selects the favorite movie, the information of the movie is transmitted by the interface module 131 to the interpretation data comparison unit 1222.

The interpretation data comparison unit 1222 is for interpreting the interpretation data from the user-originated content website 11 based on the video material transmitted by the application device 13. First of all, compare the release time (video upload time), first find out whether there is part_pt+Num/Num|Num-Num style movie segmentation information from the interpretation data, if there is any upload time comparison, to get the upload A segment of the film that is close in time. Then, the segmented film group is sorted by "i-th part" according to the movie segmentation information, and further compared according to the "author" (uploader) name to shave the non-conformity. Finally, according to the description of the video, the key information such as "action", "literary art" and the like are described to accurately obtain the segmented film group of the movie that the user wants to watch.

The above-mentioned interpretation data comparison method is mainly for correctly and quickly finding a segmented film group of a movie to be viewed by the user from the user-originated content website 11, and therefore the method of comparison is not limited to the above.

After the interpretation data comparison is completed, the obtained segmented image group is downloaded to the management server, and the image feature comparison unit 1223 performs image playback sequence analysis. The image feature comparison unit 1223 compares the order in which the videos are played, mainly from the segmented films of the segmented film group, at least one picture at the beginning end and the end end respectively; and then compares the start ends of the films. The end image of the picture and other movies, and the start picture is similar to the picture at the end of the other movie, sorted after the other movie. The detailed comparison method has been described in detail as described above, and will not be described again here.

After the image feature comparison unit 1223 completes the playing sequence of the segmented films, the segmented videos are transmitted to the streaming module 123 in the playing order, and the streaming module 123 is responsible for connecting the segmented videos. The stream is transmitted to the application device 13 for playback to achieve the effect of playing the network video.

Next, please refer to FIG. 4, which is a basic structural block diagram of the application device 13 of the network video playing system 1 of this embodiment.

The architecture is an operating system basic architecture, including a system core 134, a library 135, a video decoder 136a and an audio decoder 136b, an image receiving end 137a and an audio receiving end 137b, a JAVA machine 138, and a software development kit 139. . Since the core architecture of the operating system is a well-known infrastructure, the functions and internal architecture will not be described in further detail below. The interface module 131 and the video playing module 132 are mainly used herein. Wherein, when the application device 13 receives the video on-demand menu information, the interface module 131 can be used to write a personalized user interface according to a software development kit (SDK) 139, which inherits the electronic program form category and follows the extension. The format of the markup language defines the various functional elements in the user interface. The video playing module 132, after receiving the video, parses the video header file (including the length of the movie, the size of the movie, the information of Audio/Video, etc.), knows the format of the video, and transmits the video to the image decoder 136a and the audio decoding. The device 136b performs video and audio decoding, and drives the screen driver of the system core 134 to play the television program on the screen of the application device 13.

In addition to the network video playing system disclosed in the above embodiments, the present invention further provides a network video playing device.

Referring to FIG. 5, the network video playing device 2 of the preferred embodiment of the present invention is different from the network video playing system disclosed in the above embodiment in that the playing device 2 integrates a browsing module 121 and a resolution ratio. The module 122, a usage interface module 131, and a video playback module 132 are included therein, and the program form comparison unit 1221 and the interpretation data comparison unit 1222 of the analysis comparison module 122 are from the user-originated content website. The downloaded segmented image group is successively played by the image feature comparison unit 1223 after being sorted by the image feature comparison unit 1223, and is continuously played through the image playback module 132 in the playback order instead of flowing through the network through a streaming module. The video playback module 132 plays.

In summary, with the implementation of the network video playing system, apparatus and method of the present invention, the user can view a large number of videos provided by the user's original content website through the application device. Through the electronic program form information, interpretation data comparison to obtain a complete segment of the film group, and through the image comparison to correctly sequence the playback of the segmented film group and sequentially play in sequence, can be successfully resolved Users need to frequently find and select the segmentation film to improve the convenience of multimedia viewing.

1. . . Online video playback system

10. . . network

11, 11’, 11”... user-generated content website

12. . . Management server

121. . . Browse module

122. . . Analytical comparison module

1221. . . Program form comparison unit

1222. . . Interpretation information comparison unit

1223. . . Image feature comparison unit

13. . . Application device

131. . . Interface module

132. . . Video playback module

134. . . System core

135. . . Library

136a. . . Video decoder

136b. . . Audio decoder

137a. . . Image receiving end

137b. . . Audio receiver

138. . . JAVA machine

139. . . Software development kit

2. . . Network video player

1 is a block diagram showing an application architecture of a network video playing system according to a preferred embodiment of the present invention;

Figure 2 is a block diagram showing the basic structure of the embodiment shown in the first figure;

3 is a detailed block diagram of the resolution comparison module in the embodiment shown in the first figure;

Figure 4 is a block diagram showing the basic structure of the application device in the embodiment shown in the first figure;

FIG. 5 is a block diagram showing an application architecture of a network video playing device according to a preferred embodiment of the present invention.

1. . . Online video playback system

11. . . User-generated content site

12. . . Management server

121. . . Browse module

122. . . Analytical comparison module

1221. . . Program form comparison unit

1222. . . Interpretation information comparison unit

1223. . . Image feature comparison unit

13. . . Application device

131. . . Interface module

132. . . Video playback module

Claims (8)

A method for playing a network video for playing a group of videos obtained by searching on the Internet according to predetermined conditions, comprising the following steps: a. from each of the videos of the film group, at least at the beginning and the end, each at least a picture; b. compares the start picture of each movie with the end picture of other movies, and approximates the start picture to the picture of the end picture of another movie, sorted after the other movie, and the comparison picture is first Through the Discrete Cosine Transform (DCT) and the averaging operation, the eigenvalues of the respective pictures are obtained, and then the picture feature values of the starting end of each movie and the end picture feature values of other films are compared; wherein, the feature values are The expression is as follows: among them, In addition, N is the number of columns of the respective pictures; M is the number of rows of the respective pictures; i is the column position of the respective picture space fields; j is the row position of the pixel space of each picture; u is Each picture frequency domain is listed to the pixel position; v is the row direction pixel position of the respective picture frequency domain; c. according to the sorting done in step b, the movie in the sort is played continuously. According to the method for playing a network video according to item 1 of the patent application scope, the step a is taken from each movie, at the beginning end and the end end, each of which contains a number a group of pictures of the picture; in step b, the picture group of the beginning of each movie and the end picture group of other movies are compared, and the picture of the start picture group is approximated to the picture group of the end of the other picture, sorted in the picture After another movie. According to the method for playing a network video according to the first aspect of the patent application, the method for comparing pictures according to the step b is to first cut each picture into a plurality of blocks, and perform discrete cosine conversion on the blocks. And the averaging operation to obtain the block eigenvalue f, the expression is as follows: among them, Then, the feature values f of the respective blocks of the picture are added and divided by the number of blocks, and the feature values of each picture are obtained, and the calculation formula is as follows: Where N is the number of columns of each block; M is the number of rows of each block; i is the column position of the spatial domain of each block; j is the row-to-pixel position of each block spatial domain; u is the area The column frequency domain is aligned to the pixel position; v is the row direction pixel position of each block frequency domain; R is the number of blocks in each picture; x=1, 2, 3, ... R; After the feature values of the respective pictures, the picture feature values at the beginning of each movie and the end picture feature values of other movies are compared. According to the method for playing a network video according to item 3 of the patent application scope, in step b, the block trend F _{TR of} each picture is taken, and the calculation formula is as follows: Where n = 1, 2, 3, ... R-1; K is an offset constant; in addition to the eigenvalues of the pictures, the block trend of the picture at the beginning of each movie is compared The value of the block and the block trend value of the end image of other movies. According to the method for playing a network video according to the first aspect of the patent application, in the above step a, the video compression format and the number of images are first analyzed through a Network Abstraction Layer header (NAL header), and A group of picture (GOP) data of each video file is decoded to be restored to original data, and at least one picture is selected therein. According to the method for playing a network video according to item 4 of the patent application scope, in the above step a, the video compression format and the number of images are first analyzed through a Network Abstraction Layer header (NAL header), and The group of picture (GOP) data at the beginning and the end of each video file is decoded to be restored to the original image, and the starting image group and the ending image group are directly selected for subsequent In step b, the image feature values of each picture group are added, and then the number of pictures of the picture group is divided to obtain group feature values of each picture group; Then, the group feature value of the picture group at the beginning of each movie and the group feature value of the end picture group of other movies are compared. A network video playing system including a management server and at least one should The device has a network interconnection function between the management server and the application device; wherein the management server comprises a browsing module, an analytical comparison module and a streaming module, the application device includes Using a interface module and a playback module; the user interface module is used for the user to input a retrieval command and transmit the command to the browsing module via the network; the browsing module is used And searching for the movie group that meets the search instruction in the Internet resource according to the retrieval instruction transmitted by the interface module, and downloading the video group to the management server; the analysis comparison module is used for At the beginning and end of each movie of the film group, at least one picture is taken, and the start picture of each movie and the end picture of other videos are compared, and the start picture is approximated to the end of the other picture. After the other movie, the movie group is transmitted to the streaming module according to the order; the streaming module is used to continuously stream the film group transmitted by the parsing module. To this a player module; the player module is configured to continuously play a group of video streams streamed by the stream module; wherein the user interface module is configured to input a text retrieval command by the user, and the text is The search instruction is transmitted to the browsing module; after receiving the text retrieval instruction, the browsing module retrieves relevant electronic program form information, interpretation data and link website information from the Internet resources according to the content of the instruction, and the like Information is transmitted to the parsing comparison module for data comparison; the parsing comparison module includes a program form ratio a unit, an interpretation information comparison unit, and an image feature comparison unit, wherein the program form comparison unit is configured to compare all the movie information in the electronic program form, and select a film that meets the comparison condition The information is stored in a database and transmitted to the user interface module; after receiving the information, the user interface module creates a video on-demand menu for the user to select the video to be viewed and transmitted by the application device. To the management server; the interpretation information comparison unit is configured to select a video data according to a user transmitted by the application device, and compare the interpretation data from the browsing module; the image feature comparison unit is used Taking at least one picture from the beginning and the end of each film of the film group, and comparing the start picture of each movie with the end picture of other videos, and approximating the start picture to the end picture of another movie The movie is sorted after the other movie, and the movie group is transmitted to the streaming module according to the order. A network video playback device includes a browsing module, a parsing module, a user interface module, and a playing module. The user interface module is used for a user to input a search command. And transmitting the instruction to the browsing module; the browsing module is configured to retrieve, according to the retrieval instruction sent by the interface module, the video group that meets the retrieval instruction in the internet resource, and download the video group To the player, the parsing module is configured to capture at least one picture from the beginning and the end of each movie of the film group, and compare the start picture and other pictures of each film. The end image of the movie, and the movie that approximates the start image to the end image of another movie, sorted after the other movie, and transmits the movie group to the play module in the order; the play module, a video group for continuously playing the image of the parsing module; wherein the user interface module is configured to allow a user to input a text search command and transmit the text search command to the browsing module; After receiving the text search instruction, the browsing module retrieves relevant electronic program form information, interpretation data and link website information from the Internet resources according to the content of the instruction, and transmits the information to the analysis comparison module. Performing data comparison; the parsing comparison module comprises a program form table pair unit, an interpretation information comparison unit and an image feature comparison unit, wherein the program form comparison unit is used to compare the electronic program All the video information in the form, and the video information matching the matching conditions is stored in a database and transmitted to the user interface module; the interface module is used. After receiving the information, a video on-demand menu is created for the user to select the video to be watched, and the relevant information interpretation data ratio unit is transmitted; the interpretation information comparison unit is used to transmit according to the usage interface module. The user selects the video material and compares the interpretation data from the browsing module to accurately obtain the video group of the movie that the user wants to watch; the image feature comparison unit is used for the video group. At the beginning and end of each movie, at least one picture is taken, and the picture of the end picture of each movie and the end picture of other movies is compared, and the picture of the start end is approximated to the end picture of another movie, and is sorted in The way after the other movie, the order in which the film group is played is arranged. And transmitting the movie group to the player module in this order.