CN102567435A - Integration method of multimedia information source and hyperlink device and electronic device thereof - Google Patents

Abstract

A method for integrating multimedia information sources and its hyperlink generating device and electronic device. After receiving the multimedia file, search for keyword strings in the text content of the multimedia file according to the hyperlink database. Moreover, hyperlink content is generated based on the URL corresponding to the keyword string. When playing multimedia files, hyperlink content is displayed.

Description

Integration method of multimedia information source and its hyperlink device and electronic device

technical field

The invention relates to a playback mechanism of multimedia files, in particular to a method for integrating multimedia information sources of automatic hyperlinks, a hyperlink generating device and an electronic device. the

Background technique

With the advancement of technology, Internet-enabled TV can be said to be one of the major reforms in the TV industry. The open platform model makes the connected TV hardware more diversified. In the future, in addition to TVs, set-top boxes (Set-Top Box, STB) and Blu-ray players can become hardware tools for connected TVs. the

For now, connected TVs are all about text input and instant Internet access. In the current operation mode, Internet-connected TVs are controlled by various remote controls. On a specific website page, it is extremely inconvenient to use the on-screen keyboard to input text, and it is impossible to achieve screen synchronization, and it is impossible to meet the demand for immediate answers. the

Contents of the invention

The invention provides an electronic device, which can improve the way of quickly linking websites. the

The invention provides a hyperlink generating device, which can add hyperlink content to multimedia information sources. the

The invention provides a method for integrating multimedia information sources, which can display hyperlink content while playing multimedia files. the

The invention proposes a method for integrating multimedia information sources. In the method, the multimedia file is received, and the keyword string is searched in the text content of the multimedia file according to the hyperlink database. Moreover, hyperlink content is generated according to the URL corresponding to the keyword string. When playing a multimedia file, display the hyperlink content. the

In an embodiment of the present invention, after receiving the multimedia file, one or a combination of the audio data, text data, and frame data of the multimedia file can be analyzed to obtain the text content. the

In an embodiment of the present invention, in the above-mentioned step of generating hyperlink content based on the URL corresponding to the keyword string, the keyword string can be associated with the URL, or the URL can be associated with its corresponding icon (icon) . the

In an embodiment of the present invention, after the hyperlink content is generated according to the URL corresponding to the keyword string, the hyperlink content can be recorded in a hyperlink list. the

In an embodiment of the present invention, after the hyperlink content is displayed when the multimedia file is played, when the hyperlink content is selected, a link is made to a corresponding website and a web page corresponding to the website is displayed. For example, the multimedia file and the web page can be displayed in picture-in-picture or side by side on the same display unit, or can be displayed on different display units. the

The invention also proposes a hyperlink generation device, including a content classifier and a hyperlink unit. The content classifier is used for receiving multimedia files and obtaining text content from the multimedia files. The hyperlink unit searches the text content of the multimedia file for keyword strings according to the hyperlink database, and generates hyperlink content according to the URLs corresponding to the keyword strings. the

The invention also proposes an electronic device including a content classifier, a hyperlink unit and a first display unit. The content classifier is used for receiving multimedia files and obtaining text content from the multimedia files. The hyperlink unit is used for searching keyword strings in the text content of the multimedia file according to the hyperlink database, and generating hyperlink content according to URLs corresponding to the keyword strings. The first display unit is used for displaying multimedia files and hyperlink content. the

In an embodiment of the present invention, the above-mentioned first display unit displays a user interface for playing multimedia files and hyperlink content in the user interface. Moreover, when the hyperlink content is selected, the multimedia file and the web page corresponding to the URL are displayed in picture-in-picture or displayed side by side in the user interface. In addition, the electronic device may further include a second display unit, and the second display unit may also display a user interface. In the user interface of the second display unit, multimedia files and hyperlink contents are displayed synchronously with the first display unit or extended to interact with the first display unit. Here, the first display unit is, for example, a television, a computer, a projector, or a mobile phone, and the second display unit is, for example, a tablet computer, a mobile phone, or a remote controller with a screen. the

In an embodiment of the present invention, the above-mentioned electronic device further includes a hyperlink database, which includes a plurality of preset keyword strings and preset URLs corresponding to each preset keyword string. the

In one embodiment of the present invention, the above-mentioned content classifier analyzes whether the multimedia file has text data, if the multimedia file has text data, then takes out the text content in the text data, if the multimedia file does not have text data, then analyzes the multimedia file Speech data or frame data of a file to obtain text content. the

In an embodiment of the present invention, the above-mentioned electronic device further includes a storage unit for storing a hyperlink list for recording hyperlink content in the storage unit. the

Based on the above, the present invention can generate hyperlink content in the text content of the multimedia file, and display the hyperlink content while playing the multimedia file. Accordingly, the user can link to the corresponding website in real time. the

In order to make the above-mentioned features and advantages of the present invention more comprehensible, the following specific embodiments are described in detail with reference to the accompanying drawings. the

Description of drawings

1A and 1B are block diagrams of an electronic device according to an embodiment of the present invention. the

2A to 2C are schematic diagrams illustrating contents of an event information table according to an embodiment of the present invention. the

FIG. 3 is a block diagram of an electronic device according to another embodiment of the present invention. the

FIG. 4 is a flowchart of a method for integrating multimedia information sources according to an embodiment of the invention. the

5A-5B are schematic diagrams of display screens for playing multimedia files according to an embodiment of the present invention. the

5C-5D are schematic diagrams of a hyperlink list according to an embodiment of the present invention. the

FIG. 6 is a schematic diagram of an electronic program guide according to an embodiment of the invention. the

FIG. 7A is a schematic diagram of a picture-in-picture display according to an embodiment of the present invention. the

FIG. 7B is a schematic diagram of parallel display according to an embodiment of the present invention. the

Description of reference symbols

100: electronic device

110: hyperlink generating device

120: Content Classifier

130: Hyperlink unit

140: display unit

150, 220: hyperlink database

160: storage unit

201~209: block

310: Internet

500: User Interface

510: Multimedia file screen

520: text content

521, 523: hyperlink content

530: List of hyperlinks

531, 532, 533, 611, 612, 613: link

540: Web page screen

541: time field

543: Description field

S405-S420: each step of the method for integrating multimedia information sources according to an embodiment of the present invention

Detailed ways

1A and 1B are block diagrams of an electronic device according to an embodiment of the present invention. Please refer to FIG. 1A , the electronic device 100 includes a hyperlink generating device 110 and a display unit 140 . The hyperlink generation device 110 includes a content classifier 120 and a hyperlink unit 130 . the

The content classifier 120 is used to receive multimedia files and obtain text content from the multimedia files. In this embodiment, the input terminal covers any multimedia information source that may have text content, including multimedia (Multimedia) files, network movies, analog television (Analog Television, ATV), digital television (Digital Television, DTV) streaming, personal Video recorder (Personal Video Recorder, PVR), Electronic Program Guide (Electronic Program Guide, EPG), subtitle (Subtitle) data, music title, music lyrics downloaded by mobile, etc., can be obtained from these multimedia information sources via the content classifier 120 Extract text content from . For example, if the multimedia file received by the electronic device 100 is a TV stream, an event information table (Event Information Table, EIT) can be used to retrieve the text content. And if the received multimedia file is a network video, then the text content can be extracted by programming languages such as Extensible Markup Language (XML) or Hypertext Markup Language (Hypertext Markup Language, HTML). the

For example, the above-mentioned event information table includes a short event description (short event description) for recording program profiles, a content description (content description) for recording program categories, and a time offset table (Time Offset Table, TOT) describing time zone shifting time; Describe the time and date table (Time and Date Table, TDT) of Greenwich Mean Time, record the service name (service name) of channel name, program name (program name), service provider (Service provider) (for the broadcast end of the program) Service providers), closed captions of teletext included in recorded programs, etc. Among them, teletext is a messaging service that includes text pages such as news, information, games and other services. the

2A to 2C are schematic diagrams illustrating contents of an event information table according to an embodiment of the present invention. FIG. 2A is a program list, and the block 201 is used to display the channel numbers and channel names corresponding to multiple channels provided by the service provider (for example, the numbers in front are channel numbers, and the channel names are displayed in the rear). Block 203 and block 205 are respectively used to display the program broadcasting time and program name of each channel. Here, taking "Channel 1" as an example, block 203 and block 205 display the program playing time and program name of "Channel 1". Block 207 is used to display the current time. Block 209 is used to display the program category corresponding to the selected program name. As far as the program name "Regional News" is concerned, its program category is news documentary. FIG. 2B is a program brief introduction. For the program name "Regional News", the program brief introduction is "Introduction of local sports news and local anecdotes". FIG. 2C is a text page of the TV text broadcast. In FIG. 2C , the user can click on "Telephone Service", and "Tel: 123-4567" will be displayed on the screen. the

The hyperlink unit 130 is used to search for the keyword string in the text content of the multimedia file according to the built-in hyperlink database or the hyperlink database provided on the Internet, and generate hyperlink content according to the URL corresponding to the keyword string . The hyperlink unit 130 is used to determine whether there is a linkable information source in the text content, that is, whether there is a preset keyword string built into the hyperlink database in the search text content. Here, the hyperlink content can also be combined with the way of advertising, for example, in cooperation with the provider of the specific website, by searching for the keyword string related to the specific website in the text content of the multimedia file, and according to the URL of the specific website Generate hyperlink content with its keyword string. In this way, a link to a specific website can be added to the multimedia file, and when the user clicks on the content of the hyperlink, the provider of the specific website can be charged for advertising. the

In addition, the hyperlink unit 130 can not only associate the keyword string with the URL, but also associate the URL with the icon (icon) and text corresponding to the URL to generate hyperlink content, and can also renew the hyperlink content. added to the text content. For example, in the case of a TV menu, the logo (LOGO) of each channel can be combined with the channel name, and then the logo can be added with a corresponding URL to generate a hyperlink content. the

The display unit 140 is used for displaying multimedia information source and hyperlink content, and displaying hyperlink content when the multimedia file is played. For example, a user interface can be provided and displayed on the display unit 140 . Play multimedia files in the user interface, and add background background color, font color replacement, font deformation, word level scaling, frame block selection, bottom line marking, animation flashing, and image in the text content of multimedia files Prompts, location marks, anchor point embedding, picture display, etc. are used to display hyperlink content, so that users can easily identify the difference between hyperlink content and general text content. the

In other embodiments, the electronic device 100 may be provided with two display units, both of which have user interfaces, so as to simultaneously display or extend the multimedia files and hyperlink content on the user interfaces of the two display units. In addition, one of the display units can be used as an input interface, and the other display unit can be used as an output interface. The display unit used as the input interface is, for example, a tablet computer, a mobile phone, or a remote controller with a screen; the display unit used as the output interface is, for example, a TV, a computer, a projector or a mobile phone. the

In this embodiment, the electronic device 100 may further include a hyperlink database 150 and a storage unit 160 , as shown in FIG. 1B . Here, the hyperlink database 150 is built in the hyperlink generating device 110 . the

The hyperlink database 150 has multiple sets of preset keyword strings and corresponding preset URLs. There may be one or more URLs corresponding to a group of keyword strings. In addition, multiple keyword strings may also correspond to the same group of URLs (one or more than one URLs). For example, taking the musician Mozart (Mozart) as an example, the default keyword string can be one of "Mozart", "Amadeus", "Music Prodigy" and "Mozart", etc. or A combination thereof, and the corresponding preset URL may include a page introducing Mozart in Wikipedia, a page introducing Mozart in online Encyclopedia Britannica, and the like. the

The storage unit 160 is used for storing a hyperlink list recording hyperlink content. That is to say, after the hyperlink unit 130 generates the hyperlink content, it can record the hyperlink content into the hyperlink list, so that the user can view it later. Accordingly, even when the multimedia file is not being played, the recorded hyperlink content can be queried directly in the hyperlink list. In addition, if the source device of the multimedia information source has a video recording function, the hyperlink content and related video recording settings can also be stored at the same time. the

In addition, in other embodiments, the hyperlink unit 130 can also connect to an online hyperlink database through the Internet to perform search and comparison. Here is another example to illustrate. FIG. 3 is a block diagram of an electronic device according to another embodiment of the present invention. Please refer to FIG. 3 , the hyperlink unit 130 of the electronic device 100 is connected to the online hyperlink database 320 through the Internet 310, so as to search for keyword strings in the text content of the multimedia file according to the hyperlink database 220. the

In addition, the hyperlink generating device 110 can simultaneously utilize the built-in preset hyperlink database 150 (as shown in FIG. 1B ) and the hyperlink database 320 provided by the network. That is to say, the hyperlink generating device 110 can first inquire whether there is a keyword string in the built-in preset hyperlink database 150, if not, then inquire from the hyperlink database 320 provided by the network, so as to determine the text of the multimedia file Whether the content contains a linkable information source, and the hyperlink content is obtained, and displayed or indirectly opened through the user interface by default, so that the user can instantly link (or import a buffer mechanism) to the corresponding URL. the

Each step of the method for integrating multimedia information sources will be described in detail below in conjunction with the above-mentioned electronic device 100 . the

FIG. 4 is a flowchart of a method for integrating multimedia information sources according to an embodiment of the invention. Please refer to FIG. 1B and FIG. 4 at the same time. In step S405, the content classifier 120 receives the multimedia file, so as to use different methods to extract the text content of the multimedia file according to the source of the multimedia file. The source of the multimedia file is, for example, the content provider of the TV system, the TV hardware itself, or the network service platform. For example, assuming that the multimedia file is a digital TV multimedia file, the multimedia file will include a text data. The content classifier 120 can analyze the text data to obtain the text content. the

In addition, in other embodiments, the content classifier 120 will analyze whether the multimedia file has text data. If the multimedia file has text data, the text content in the text data is taken out. If the multimedia file does not have text data, the audio data or frame data of the multimedia file can be further analyzed to obtain text content. For example, speech recognition is used to analyze speech data of multimedia files. Alternatively, image recognition is used to analyze whether the frame data of the multimedia file includes text content such as subtitles and marquees every few frames. the

In addition to text content, image recognition can also be used to analyze whether the frame data of multimedia files includes images such as channel logos (Channel LOGO) or specific buildings, so as to obtain corresponding text content based on the images. For example, an image database can be established, and a plurality of preset images and preset text content corresponding to each preset image can be set in the image database. the

Next, in step S410 , the hyperlink unit 130 searches for a keyword string in the text content of the multimedia file according to the hyperlink database 150 . In other embodiments, the hyperlink unit 130 can also be connected to the online hyperlink database 320 through the Internet 310 . Alternatively, the built-in hyperlink database 150 can be searched simultaneously and the online hyperlink database 320 can be searched by connecting to the Internet 310. the

Afterwards, in step S415, the hyperlink unit 130 generates hyperlink content according to the URL corresponding to the keyword string. For example, in the text content of streaming media files, use background color, font color replacement, font deformation, word level scaling, frame block circle selection, underline marking, animation flashing, image prompts, position marks, anchor points Embedding, picture display, etc. to display hyperlink content, so that users can easily identify the difference between hyperlink content and general text content. After the hyperlink unit 130 generates the hyperlink content, it can also record the hyperlink content into the hyperlink list of the storage unit 160 . the

The hyperlink content of the hyperlink list can be sorted according to the time axis, program period, hyperlink distribution position, picture position, voice dialogue, action narration, prefix of keyword string, etc. In addition, URL links can be divided into image links, movie links, portal sites, official sites, semantic sites, news, maps, online ads, keyword ads, etc. the

Finally, in step S420, when the multimedia file is played on the display unit 140, the hyperlink content is displayed. For example, assuming that the multimedia file has text data, hyperlink content is added to the text data, so that the hyperlink content can be displayed simultaneously with the playback of the multimedia file. the

For example, FIG. 5A and FIG. 5B are schematic diagrams of display screens for playing multimedia files according to an embodiment of the present invention. FIG. 5C and FIG. 5D are schematic diagrams illustrating a list of hyperlinks according to an embodiment of the present invention. the

In FIG. 5A , the user interface 500 displays a multimedia file screen 510 (for displaying multimedia files) and text content 520 . The text content 520 includes two hyperlink contents, ie hyperlink contents 521 and 523 . The multimedia file screen 510 and the text content 520 are not overlapped here, but in other embodiments, they can also be overlapped and integrated. For example, the multimedia file screen 510 includes the text content 520 . the

Because the text data will follow the rhythm of the multimedia file, and there are speeds. Assuming that when the text data is displayed quickly, the user has no time to check whether the identified information source can be hyperlinked, and will miss the keyword string that can be hyperlinked. Therefore, a trigger mechanism can be set to open the hyperlink list in the storage unit 160 . In FIG. 5B , the hyperlink list 530 can be opened in the user interface 500 . The hyperlink content corresponding to each keyword string is recorded in the hyperlink list 530 , and the user only needs to select one of the hyperlink contents to be connected to the website corresponding to the hyperlink content. the

In addition, if the keyword string has multiple corresponding URLs, as shown in Figure 5C, all the URLs (link 531, link 532, and link 533) corresponding to the keyword string are listed. The icon (icon) corresponding to the URL. Assuming that the multimedia file has an electronic program guide, the electronic program guide can also use this method to add hyperlink content. In addition, in FIG. 5D , a time field 541 and a description field 542 can also be added to the hyperlink list 530 . The time field 541 is used to display the time when each hyperlink content appears in the multimedia file. And the description field 543 is used to display the hyperlink website category of the selected hyperlink content (for example, "Taipei 101 building"). FIG. 6 is a schematic diagram of an electronic program guide according to an embodiment of the invention. Please refer to FIG. 6 , when one of the keyword strings is clicked, the URL (link 611 , link 612 and link 613 ) corresponding to the keyword string is displayed. the

When the hyperlink content is selected, link to the corresponding URL and display the webpage corresponding to the URL. At this point, the multimedia file and the webpage can be displayed in a picture-in-picture manner or displayed side by side. For example, FIG. 7A is a schematic diagram of a picture-in-picture display according to an embodiment of the present invention. FIG. 7B is a schematic diagram of parallel display according to an embodiment of the present invention. Please refer to FIG. 7A and FIG. 7B , in this embodiment, the hyperlink content 521 is clicked as an example. The hyperlink content 521 corresponds to the web page frame 540 (used to display a web page). the

In FIG. 7A , when the hyperlink content 521 is selected, the multimedia document screen 510 and the web page screen 540 are simultaneously displayed in a picture-in-picture mode. In FIG. 7B , when the hyperlink content 521 is selected, the multimedia file screen 510 and the web page screen 540 are simultaneously displayed in parallel display. In practical applications, a display mode may be provided in the user interface 500 to allow the user to select a picture-in-picture display or a side-by-side display. the

To sum up, the present invention analyzes the received multimedia files to obtain text content, and judges whether the text content includes linkable information sources according to the built-in or network hyperlink database, so as to generate hyperlink content. In this way, the user can link to the corresponding URL in real time. In addition, an identifiable user interface and classified display links are provided in the display unit, and external input control devices (remote controller, keyboard, mouse, mobile phone, computer, etc.) Link to URL (for example: portal website, official website, semantic website, news, map, network advertisement or keyword advertisement, etc.). It also allows users to sort and select the content of these hyperlinks, and after linking, it can set picture-in-picture display or side-by-side display to present the images of web pages and multimedia files, which is convenient for users to watch. the

Although the present invention has been disclosed above with the embodiments, it is not intended to limit the present invention. Those skilled in the art can make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, the present invention The scope of protection is based on the claims of the present invention. the

Claims (17)

1. the integration method of a multimedia information source comprises:

Receive multimedia file;

According to the hyperlink database, in the word content of this multimedia file, seek the key word word string;

The network address corresponding according to this key word word string produces the hyperlink content; And

When playing this multimedia file, show this hyperlink content.

2. the integration method of multimedia information source as claimed in claim 1 wherein also comprises after receiving this multimedia files:

Analyze speech data, lteral data and frame data one of them or its combination of this multimedia file, to obtain this literal content.

3. the integration method of multimedia information source as claimed in claim 1 wherein comprises according to the step that this corresponding network address of this key word word string produces this hyperlink content:

This key word word string is associated with this network address.

4. the integration method of multimedia information source as claimed in claim 1 wherein comprises according to the step that this corresponding network address of this key word word string produces this hyperlink content:

The icon that this network address is corresponding with this network address is associated.

5. the integration method of multimedia information source as claimed in claim 1 wherein after this network address corresponding according to this key word word string produces the step of this hyperlink content, also comprises:

Write down this hyperlink content to hyperlink inventory.

6. the integration method of multimedia information source as claimed in claim 1, wherein when playing this multimedia file, show the step of this hyperlink content after, also comprise:

When this hyperlink content is selected, links to this network address and show the webpage that this network address is corresponding.

7. the integration method of multimedia information source as claimed in claim 6 wherein comprises in the step that shows this webpage that this network address is corresponding:

This multimedia file and this webpage are carried out PIP demonstration or demonstration side by side.

8. hyperlink generation device comprises:

The classifying content device receives multimedia file, and this multimedia file obtains word content certainly; And

The key word word string is sought according to the hyperlink database in the hyperlink unit in the word content of this multimedia file, and produces the hyperlink content according to the corresponding network address of this key word word string.

9. hyperlink generation device as claimed in claim 8; Wherein whether this this multimedia file of classifying content device analysis has lteral data; If this multimedia file has this lteral data, take out this literal content in this lteral data, if this multimedia file does not have this lteral data; Then analyze the speech data or the frame data of this multimedia file, to obtain this literal content from this speech data or this frame data respectively by voice recognition unit or image recognition unit.

10. hyperlink generation device as claimed in claim 8, wherein this hyperlink database is built in this hyperlink generation device in being or is arranged at far-end.

11. an electronic installation comprises:

The classifying content device receives the multimedia file multimedia information source, and this multimedia file multimedia information source obtains word content certainly;

The key word word string is sought according to the hyperlink database in the hyperlink unit in the word content of this multimedia file multimedia information source, and produces the hyperlink content according to the corresponding network address of this key word word string; And

First display unit shows this multimedia file and this hyperlink content.

12. electronic installation as claimed in claim 11; Wherein show a user interface in this first display unit; In this user interface, to play this multimedia file and this hyperlink content; And when this hyperlink content was selected, the webpage that this multimedia file is corresponding with this network address carried out the PIP demonstration or is shown in side by side in this user interface.

13. electronic installation as claimed in claim 12 also comprises:

The hyperlink database, comprise a plurality of preset key word word strings with it pairing a plurality of preset network address.

14. electronic installation as claimed in claim 12; Wherein whether this this multimedia file of classifying content device analysis has lteral data; If this multimedia file has this lteral data, take out this literal content in this lteral data, if this multimedia file does not have this lteral data; Then analyze the speech data or the frame data of this multimedia file, to obtain this literal content.

15. electronic installation as claimed in claim 12 also comprises:

Storage element stores the hyperlink inventory, this hyperlink content of record in this hyperlink inventory.

16. electronic installation as claimed in claim 11 also comprises:

Second display unit has the user interface, in this user interface, to show synchronously with this first display unit or to extend this multimedia file of demonstration and this hyperlink content, with interactive with this first display unit.

17. electronic installation as claimed in claim 16, wherein this second display unit be flat computer, mobile phone and remote controller with screen one of them, this first display unit be TV, computing machine, projector and mobile phone one of them.

Images