[go: up one dir, main page]

WO2014082116A1 - Distribution d'un contenu de substitution - Google Patents

Distribution d'un contenu de substitution Download PDF

Info

Publication number
WO2014082116A1
WO2014082116A1 PCT/AU2013/001226 AU2013001226W WO2014082116A1 WO 2014082116 A1 WO2014082116 A1 WO 2014082116A1 AU 2013001226 W AU2013001226 W AU 2013001226W WO 2014082116 A1 WO2014082116 A1 WO 2014082116A1
Authority
WO
WIPO (PCT)
Prior art keywords
content
processing system
original
substitute
original content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/AU2013/001226
Other languages
English (en)
Inventor
Wolfgang MUELLER-LEYDIG
James MCPARLANE
Louise VAN ROOYEN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from AU2012905193A external-priority patent/AU2012905193A0/en
Application filed by Individual filed Critical Individual
Publication of WO2014082116A1 publication Critical patent/WO2014082116A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
    • H04H20/10—Arrangements for replacing or switching information during the broadcast or the distribution
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/35—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
    • H04H60/37—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying segments of broadcast information, e.g. scenes or extracting programme ID
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2389—Multiplex stream processing, e.g. multiplex stream encrypting
    • H04N21/23892—Multiplex stream processing, e.g. multiplex stream encrypting involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866—Management of end-user data
    • H04N21/25891—Management of end-user data being end-user preferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2668—Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • H04N21/4668—Learning process for intelligent management, e.g. learning user preferences for recommending movies for recommending content, e.g. movies

Definitions

  • the present invention relates to a device, method, system, and computer program for facilitating the delivery of substitute content.
  • display devices such as televisions and the like present various types of content that the consumer is able to select for viewing.
  • television content is non-customised for an individual consumer.
  • the television broadcast includes generic content designed to cater for the broadcaster's target audience. Additionally, the television broadcast does not cater for viewing habits of particular consumer.
  • a live television program displays consumer feedback received via social media, a consumer will generally be required to actively use a different device, such as a computer or the like, in order to provide feedback. Whilst these problems have been highlighted with reference to television, at least some of these problems also exist in other mediums, for example radio.
  • a content substitution device including a processing system having an interface coupled to a processor, wherein the method includes:
  • the substitute content includes one of:
  • the method includes at least one of:
  • At least some of the original content identities are indicative of a respective digital fingerprint for at least a portion of the respective original content.
  • the method includes using a consumer profile to determine if original content is to be substituted.
  • the consumer profile is defined by at least one of:
  • the method includes:
  • the original content includes an advertisement
  • the method includes the processor facilitating identification of the advertisement and determining if substitute content is to be delivered based on the identified advertisement.
  • the content delivery device is a display device.
  • the substitute content includes at least one of:
  • the original content is received by the content substitution device as a video signal.
  • a server processing system in communication with a content substitution device wherein the method includes:
  • the method includes the server processing system determining, using one or more rules, if the original content is to be substituted with substitute content.
  • the one or more rules are based upon a consumer profile stored in a repository accessible by the server processing system.
  • the consumer profile includes one or more consumer preferences.
  • the consumer profile is defined by at least one of:
  • the method includes at least one of:
  • a content substitution device including a processing system for facilitating provision of substitute content, wherein the processing system includes:
  • an interface configured to receive an indication of original content for delivery by a content delivery device
  • a processor configured to:
  • the processing system is configured to perform the method of the first aspect.
  • a computer program for configuring a content substitution device including a processing system to facilitate provision of substitute content, wherein the processing system includes an interface coupled to a processor, wherein execution of the computer program by the processor configures the processing system to:
  • a) receive, via the interface, an indication of original content for delivery by a content delivery device
  • c) facilitate, by the processor, delivery of substitute content by the content delivery device in the event of a positive determination.
  • execution of the computer program configures the processing system to perform the method of the first aspect.
  • a server processing system for facilitating provision of substitute content, wherein the server processing system is in communication with a content substitution device, wherein the server processing system is configured to:
  • the server processing system is configured to perform the method of the second aspect.
  • a computer program for configuring a server processing system for facilitating provision of substitute content, wherein the server processing system is in communication with a content substitution device, wherein execution of the computer program configures the server processing system to:
  • execution of the computer program configures the server processing system to perform the method of the second aspect.
  • a seventh aspect there is provided a system for facilitating provision of substitute content, wherein the system includes:
  • Figure 1 illustrates a functional block diagram of an example processing system that can be utilised to embody or give effect to a particular embodiment
  • Figure 2 illustrates an example network infrastructure that can be utilised to embody or give effect to a particular embodiment
  • Figure 3 is a flowchart representing an example method of facilitating provision of substitute content
  • Figure 4 is a block diagram representing an example system for facilitating the provision of substitute content
  • Figure 5 is a flowchart representing an example method performed by the system of Figure 4.
  • Figure 6 is a block diagram representing an example content substitution device for facilitating the provision of substitute content.
  • FIG. 7 is a block diagram representing an example server processing system for facilitating the provision of substitute content.
  • the processing system 100 generally includes at least one processor 102, or processing unit or plurality of processors, memory 104, at least one input device 106 and at least one output device 108, coupled together via a bus or group of buses 110.
  • input device 106 and output device 108 could be the same device.
  • An interface 112 can also be provided for coupling the processing system 100 to one or more peripheral devices, for example interface 112 could be a PCI card or PC card.
  • At least one storage device 114 which houses at least one database 116 can also be provided.
  • the memory 104 can be any form of memory device, for example, volatile or nonvolatile memory, solid state storage devices, magnetic devices, etc.
  • the processor 102 could include more than one distinct processing device, for example to handle different functions within the processing system 100.
  • Input device 106 receives input data 118 and can include, for example, a keyboard, a pointer device such as a pen-like device or a mouse, audio receiving device for voice controlled activation such as a microphone, data receiver or antenna such as a modem or wireless data adaptor, data acquisition card, etc.
  • Input data 118 could come from different sources, for example keyboard instructions in conjunction with data received via a network.
  • Output device 108 produces or generates output data 120 and can include, for example, a display device or monitor in which case output data 120 is visual, a printer in which case output data 120 is printed, a port for example a USB port, a peripheral component adaptor, a data transmitter or antenna such as a modem or wireless network adaptor, etc.
  • Output data 120 could be distinct and derived from different output devices, for example a visual display on a monitor in conjunction with data transmitted to a network. A user could view data output, or an interpretation of the data output, on, for example, a monitor or using a printer.
  • the storage device 114 can be any form of data or information storage means, for example, volatile or non-volatile memory, solid state storage devices, magnetic devices, etc.
  • the processing system 100 is adapted to allow data or information to be stored in and/or retrieved from, via wired or wireless communication means, the at least one database 116.
  • the interface 112 may allow wired and/or wireless communication between the processing unit 102 and peripheral components that may serve a specialised purpose.
  • the processor 102 receives instructions as input data 118 via input device 106 and can display processed results or other output to a user by utilising output device 108. More than one input device 106 and/or output device 108 can be provided. It should be appreciated that the processing system 100 may be any form of terminal, server, specialised hardware, or the like.
  • the processing system 100 may be a part of a networked communications system 200, as shown in Fig. 2.
  • Processing system 100 could connect to network 202, for example the Internet or a WAN.
  • Input data 118 and output data 120 could be communicated to other devices via network 202.
  • Other terminals for example, thin client 204, further processing systems 206 and 208, notebook computer 210, mainframe computer 212, PDA 214, pen-based computer 216, server 218, etc., can be connected to network 202.
  • a large variety of other types of terminals or configurations could be utilised.
  • the transfer of information and/or data over network 202 can be achieved using wired communications means 220 or wireless communications means 222.
  • Server 218 can facilitate the transfer of data between network 202 and one or more databases 224.
  • Server 218 and one or more databases 224 provide an example of an information source.
  • networks may communicate with network 202.
  • telecommunications network 230 could facilitate the transfer of data between network 202 and mobile or cellular telephone 232 or a PDA-type device 234, by utilising wireless communication means 236 and receiving/transmitting station 238.
  • Satellite communications network 240 could communicate with satellite signal receiver 242 which receives data signals from satellite 244 which in turn is in remote communication with satellite signal transmitter 246.
  • Terminals for example further processing system 248, notebook computer 250 or satellite telephone 252, can thereby communicate with network 202.
  • a local network 260 which for example may be a private network, LAN, etc., may also be connected to network 202.
  • network 202 could be connected with ethernet 262 which connects terminals 264, server 266 which controls the transfer of data to and/or from database 268, and printer 270.
  • ethernet 262 which connects terminals 264, server 266 which controls the transfer of data to and/or from database 268, and printer 270.
  • Various other types of networks could be utilise
  • the processing system 100 is adapted to communicate with other terminals, for example further processing systems 206, 208, by sending and receiving data, 118, 120, to and from the network 202, thereby facilitating possible communication with other components of the networked communications system 200.
  • the networks 202, 230, 240 may form part of, or be connected to, the Internet, in which case, the terminals 206, 212, 218, for example, may be web servers, Internet terminals or the like.
  • the networks 202, 230, 240, 260 may be or form part of other communication networks, such as LAN, WAN, ethernet, token ring, FDDI ring, star, etc., networks, or mobile telephone networks, such as GSM, CDMA or 3G, etc., networks, and may be wholly or partially wired, including for example optical fibre, or wireless networks, depending on a particular implementation.
  • FIG 3 there is shown a flowchart representing a method 300 of facilitating provision of substitute content. The method 300 is performed by a processing system such as that exemplified in Figure 1.
  • the method 300 includes receiving, at the interface 112, an indication of original content for delivery by a content delivery device 410 (see Figure 4).
  • the method 300 includes determining, by the processor 102, if the original content is to be substituted based upon the indication.
  • the method 300 includes facilitating, by the processor 102, delivery of substitute content in the event of a positive determination.
  • the system 400 includes a content substitution device 410 in communication with a server processing system 420, a content delivery device 430 and an original content source 440.
  • the content delivery device 430 will be discussed with respect to a television. However it will be appreciated that the invention can be used with other content delivery devices 430.
  • the content substitution device 410 can be based substantially upon processing system 100 described with reference to Figure 1.
  • the content substitution device 410 includes a processor 102 coupled to an input/output interface 112 via a bus 110.
  • the content substitution device 410 can also include one or more input devices 106 coupled with the processor 102 via the bus 110, wherein the one or more input devices 106 can include a control interface such as one or more buttons or the like.
  • the content substitution device 410 can also include at least one output device 108 which is coupled to the processor 102 via the bus 110.
  • the at least one output device 108 includes an electronically controlled display.
  • the content substitution device 410 also includes a memory 104 coupled to the processor 102 via the bus 110.
  • the memory 104 generally includes volatile and non-volatile memory.
  • a computer program can be stored in the memory 104 which is executable by the processor 102 to perform parts of the method described herein.
  • the content substitution device 410 is in communication with the television 430.
  • the content substitution device 410 can be in communication with the television 430 via a hard wired medium such as a HDMI (High Definition Multimedia Interface) cable although it will be appreciated that other communication mediums can be utilised.
  • the content substitution device 410 is in communication with the server processing system 420 via a communication network including a computer network such as the Internet. Other communication networks can also be utilised such as private computer networks, telecommunication networks and the like.
  • the content substitution device 410 is also in communication with the original content source 440 which can be a video source.
  • the video source 440 may be in communication with the content substitution device 410 via a HDMI cable although other communication mediums may be utilised.
  • the video source 440 may be a digital set-top box/unit although other video sources may also be used.
  • the content substitution device 410 may also be in communication with one or more remote control devices 450.
  • the content substitution device 410 may be in communication with a remote control device 450 for controlling the content substitution device 410.
  • the content substitution device 410 may also be in communication with a remote control device 450 of another device such as a remote control for a television 430 or the video source 440.
  • the remote control devices 450 are generally in communication with the content substitution device 410 wirelessly such as via receiving infrared or radio communication mediums although other communication mediums may be utilised.
  • the server processing system 420 is a processing system substantially based upon Figure 1.
  • the server processing system 420 and the content substitution device 410 form a distributed processing system.
  • the server processing system 420 has access to one or more repositories 425.
  • at least one of the repositories 425 has stored therein content identifier data for use in identifying original content.
  • the system 400 also includes a mobile communication device 460 which executes thereon a mobile software application.
  • a consumer can interact with the mobile software application to issues commands to the content substitution device 410 via a wireless medium such as Bluetooth or Wi-Fi.
  • the mobile communication device 460 can also be in data communication with the server processing system 420. Commands issued can be relayed to the content substitution device 410 via the server processing system 420 if required.
  • the mobile communication device 460 may be provided in the form of a mobile telephone, tablet or the like.
  • FIG. 5 there is shown a flowchart representing an example method 500 performed by the system 400 of Figure 4 for facilitating the provision of substitute content to the television 430.
  • the content substitution device 410 is configured to receive an indication of original content for presentation by the television 430.
  • the content substitution device 410 receives the original content before presentation by the television 430.
  • the indication of the original content is the original content itself that is received from the video source 440.
  • the content substitution device 410 buffers the original content in memory.
  • the processor 102 of the content substitution device 410 generates a content identity of at least a portion of the original content.
  • the content identity is a digital fingerprint of at least a portion of the original content.
  • the digital fingerprint is a sample of the original content.
  • the digital fingerprint is then transferred from the content substitution device 410 to the server processing system 420.
  • the content substitution device 410 may also include a local storage of digital fingerprints in order to attempt to identify the original content prior to transferring the request to the server processing system 420.
  • the server processing system 420 compares the digital fingerprint against the one or more repositories 425 including a content identifier data store to identify the original content. It will be appreciated that the server processing system 420 attempts to identify a substantially similar digital fingerprint within particular tolerances of the digital fingerprint generated by the content substitution device 410.
  • the server processing system 420 uses the content identity to retrieve from the one or more repositories 425 an original content record which is indicative of various details related to the original content.
  • the original content record may be indicative of the name of the original content, the genre of the original content, and the presentation length of the original content.
  • the server processing system 420 uses one or more rules to determine if the identified original content should be substituted.
  • the one or more rules can be based upon a consumer profile stored in at least one of the repositories 425 of the server processing system 420.
  • the consumer profile may be indicative of one or more consumer preferences defined by the consumer. Additionally or alternatively, the consumer profile may be automatically stored, generated and/or modified by the content substitution device 410 and/or the server processing system 420.
  • the one or more rules for determining if the identified original content can utilise the data indicated by the retrieved original content record.
  • step 530 the method 500 proceeds to step 535 where the server processing system 420 transfers data indicative of the identified original content to the content substitution device 410.
  • the data is indicative of the original content record.
  • the content substitution device 410 determines substitute content for presentation.
  • the substitute content can be modified content based upon the original content.
  • the substitute content may be alternative content that is not based on the original content. Examples of substitute content will be discussed in more detail below.
  • the content substitution device 410 transfers the substitute content to the television 430 for presentation to the consumer.
  • the method 500 then proceeds back to 505 such that the system 400 iteratively performs the method 500.
  • the method 500 proceeds to step 536 where the server processing system 420 indicates that the original content should not be substituted and at step 537 the substitution device 410 transfers the buffered original content to the television 430 for presentation to the consumer. The method 500 then proceeds back to step 505 where the method 500 is iteratively performed over time.
  • the consumer may define the consumer profile to present substitute content, in the form of one or more computer application interfaces or a prompt to launch one or more computer applications when an advertisement is detected to be presented by the television 430.
  • the computer application interface may be a news application which is presented when an advertisement is due for presentation to the consumer.
  • the server processing system 420 is configured to firstly identify the original content as an advertisement.
  • the one or more repositories 425 can include content identities indicative of advertisements in order to identify the original content as an advertisement. Upon successful detection, the server processing system 420 applies the one or more substitution criteria to determine if the original content should be substituted with substitute content.
  • the server processing system 420 detects a positive determination. The server processing system 420 then transfers a signal back to the content substitution device 410 indicating the identified original content and that substitute content is to be presented. In this instance, the content substitution device 410 selects and launches the relevant news application interface that is then presented by the content substitution device 410 as the substitute content.
  • a consumer may define that a social media application interface should be presented simultaneously on the television screen during presentation of a particular current affairs program.
  • the content substitution device 410 facilitates the launch of the relevant social media application interface and augments the original content by overlaying the social media application interface thereby generating the substitute content.
  • the substitute content is then transferred to the television 430 by the content substitution device 410.
  • the content substitution device 410 and/or the server processing system 420 may automatically identify that the user changes the content presented upon the television 430 when a sports-related program is presented.
  • the consumer profile may be automatically defined by the content substitution device 410 or the server processing system 420 indicating that the consumer dislikes sports-related content.
  • the server processing system 420 may use this defined consumer profile to determine that substituted content should be presented.
  • FIG. 6 there is shown a more detailed block diagram of the content substitution device 410.
  • the content substitution device 410 includes an incoming media decoder module 602 which receives an incoming encoded and/or compressed video signal 440 indicative of the original content and decodes said video into individual image frames and audio that can be analysed. The individual image frames and audio is then transferred to an incoming frame/audio buffer module 604. The incoming frame/audio buffer module 604 temporarily stores the incoming frame/audio in memory 104.
  • a reduction function module 606 accesses the buffered frame/audio and applies a mathematical function that reduces the large image and audio frames into smaller and more manageable portions without losing significant information useful for identification analysis.
  • the output of the reduction function module 606 is reduced frame/audio data 608 which is stored in a buffer referred to as a temporal reduced frame/audio buffer 610.
  • Control passes to a segmenter module 612 which applies an analysis process that selects sets of reduced frames/audio from the temporal reduced frame/audio buffer 610 based on data features that can be analysed.
  • the sets selected form a segment of the original content. It will be appreciated that the segment substantially defines the length of time which a consumer is delivered non-filtered content prior to analysis.
  • a temporal reduced frame/audio segment 614 is then transferred to a fingerprint module 616.
  • the fingerprint module 616 applies a fingerprint function which reduces the segment into a digital fingerprint 618.
  • a network message indicative of the digital fingerprint can then transferred by a fingerprint transmitter module 620 to the server processing system 420 for analysis.
  • the digital fingerprint 618 can be stored in memory of the content substitution device 420 in a fingerprint library 622. Additionally, the fingerprint library 622 may receive from a fingerprint library updater module 624 a feed of external fingerprints which are stored in the fingerprint library 622. The fingerprint library 622 can be utilised by the processor 102 of the content substitution device 410 to compare the generated digital fingerprint 618 prior to transferring the digital fingerprint 618 to the server processing system 420 requesting analysis. The digital fingerprint library 622 may also have stored therein digital fingerprints 618 of original content which is scheduled to be broadcast.
  • a fingerprint classification receiver module 626 can receive a network message from the server processing system 420.
  • the network message received by the fingerprint classification receiver module 626 can be indicative of the original content record indicative of the identified original content thereby indicating that the original content should be substituted based on an analysis performed by the server processing system 420 using the consumer profile.
  • the content of the network message is transferred to the control logic module 632.
  • the control logic module 632 receives the original content record for the identified original content.
  • the control logic module 632 can receive an external command from an external command receiver module 628.
  • the external command receiver module 628 may receive commands which may have originated from a companion device such as a mobile communication device 460 like which execute the mobile software application communicating with the content substitution device 410.
  • the commands issued by the mobile communication device 460 via the mobile software application are received wirelessly by the content substitution device 410 or from the server processing system 420 which are then relayed to the content substitution device 410 via the external command receiver module 628.
  • the external command receiver module 628 may also receive an external command via another source such as the remote control unit 450.
  • the control logic module 632 may additionally or alternatively receive a control message from an incoming source device command module 630.
  • the control message may be a command issued by a consumer operating the remote control device 450 for the television 430, wherein this command is intercepted by the incoming source device command module 630 and forwarded to the control logic module 632.
  • the control logic module 632 is configured to determine if the original content should be substituted based on the messages received and the data received from the server processing system 420 to determine whether the original content should be substituted.
  • control logic module 632 If the control logic module 632 detects an external command such as a consumer changing the channel displayed on the television 430, the control logic module 632 can be configured to determine that the original content should not be substituted and instead transfers a signal to a buffer control module 634 to clear the temporal frame/audio buffer 636 such that the processing of the new original content can begin. Alternatively, if the control logic module 632 detects an external command such as a "trick play" command, such as rewind, fast forward, or pause the content, then the control logic module 632 controls the presentation of content from the temporal frame/audio buffer 636 in response to the "trick play" command.
  • an external command such as a consumer changing the channel displayed on the television 430
  • control logic module 632 determines that substitute content is to be presented based on the various inputs, the control logic module 632 transfers a content substitution signal to an application selection module 638 to select one or more applications to launch or present.
  • the application selection module 638 can communicate with an application manager module 640 to launch one or more selected applications that are executed locally or remotely, wherein the substitute content 644 is routed to an overlay user interface module 642.
  • the overlay user interface module 642 applies a method which renders any video or image output from the executing application in a form that is visually understandable to the consumer.
  • the output of the overlay user interface module 642 is then transferred to a frame compositor module 646.
  • the frame compositor module 646 is controlled by a composition control module 648 which controls how and when the frame compositor module 646 should combine the output from the overlay user interface module 646 and the temporal frame/audio buffer 636. Based on the control signals received from the composition control module 648, the frame compositor 646 merges the output from the overlay user interface module 642 and the temporal frame/audio buffer 636.
  • the output of the frame compositor module 646 is received by an outgoing media encoder 650 which encodes the video back into a stream that can be presented by the television such that substitute content is presented to the consumer.
  • FIG. 7 there is shown a block diagram of an example of the server processing system 420 of the system 400.
  • the server processing system 420 includes a messaging module 700 which receives and transfers various messages from a number of sources.
  • the server processing system 420 also includes a fingerprint classification logic module 705.
  • the messaging module 700 receives a network message indicative of the digital fingerprint transferred by the fingerprint transmitter 620 of the content substitution device 410 thereby requesting identification of the original content.
  • the messaging module 700 then transfers the request to a fingerprint classification logic module 705 for analysis.
  • the fingerprint classification logic module 705 utilises a number of repositories 720 to identify the original content.
  • the fingerprint classification logic module 720 can utilise at least one of a fingerprint repository 721 including data indicative of digital fingerprint data, a video content repository 723 including a number of original content records of meta-data, and a previously viewed fingerprint repository 724 indicative of original content previously presented to the consumer.
  • the messaging module 700 also receives commands from an external command device 460 such as the mobile communication device executing the mobile application software. The command can then be relayed by the messaging module 700 to the external command receiver 628 of the content substitution device 410.
  • an external command device 460 such as the mobile communication device executing the mobile application software. The command can then be relayed by the messaging module 700 to the external command receiver 628 of the content substitution device 410.
  • the server processing system 420 also includes a rules engine 710 for determining if substitute content should be presented.
  • the rules engine 710 utilises rules defined in a rules repository 725, data stored in a consumer profile repository 727, and/or the identified original content to determine if the original content should be substituted. A number of rules that can be applied by the rules engine 710 have been exemplified above.
  • the server processing system 420 also includes a web/appli cation server 740 presenting substitute content to the content substitution device 410 if required.
  • the server processing system 420 also includes a consumer selection application repository 726.
  • this repository 726 includes a plurality of applications which the consumer can remotely access such that one or more application interfaces are displayed at least as part of the substitute content.
  • the server processing system 420 also can transfer updates of content identifiers to the fingerprint library updater module 624 via the messaging module 700.
  • the repositories 720 also include a devices repository 722 including a plurality of identities of the devices 410 which are in data communication with the server processing system 420.
  • the repositories 720 also includes an application repository 728 storing therein the applications available for the consumer to be launched by the server processing system 420 or transferred to the content substitution device 410 for local execution.
  • the server processing system 420 also includes a command workflow module 715 which controls the processing by the various components of the server processing system 420.
  • the server processing system 420 also includes a user view compositor module 730 which generates the view of the substitute content based on the data received from the repositories 720.
  • the user view compositor module 730 provides output data to the web/application server 740 for provision as at least part of the substitute content.
  • the server processing system 420 also includes a static content module 735 which can provide static content to the web/application-server 740 which can be provided at least as part of the substitute content.
  • the content substitution device 410 generates at least a portion of the substitution content which is indicative of a menu of computer applications.
  • the content substitution device 410 automatically generates a dynamic menu of relevant computer applications which may be relevant.
  • the consumer is then able to select one or more computer applications from the menu via the input device 106 of the content substitution device 410 or alternatively via the mobile communication device 460.
  • the selected computer application is launched.
  • the computer applications may be dynamically ranked according to a heuristics process wherein the content substitution device 410 applies one or more heuristics to determine the dynamic ranking of the applications. It will be appreciated that at least some of the applications presented may be locally installed and can be executed at the content substitution device 410. Additionally or alternatively, it will be appreciated that at least some of the applications presented may be stored and remotely launched at the server processing system 420 or by some other processing system directly or indirectly in communication with the content sub stitution device 410.
  • the indication received by the content substitution device 410 may be indicative of an identity of the original content.
  • the video source 440 may have an embedded identity, known as a watermark, indicative of the original content.
  • the content substitution device 410 transfers the identity of the original content based on the detected watermark to the server processing system 420 such that the server processing system 420 does not need to perform the identification process, but rather skips over this process and proceeds to determine if the original content should be substituted.
  • the rules engine 710 may also determine other parameters to determine the context which one or more applications should be launched.
  • a video recorder device may be the video source 440 which is indicative of a time-shifted recording of a live game show.
  • One of the rules of the rule engine 710 may indicate that a social media application should be launched automatically when this game show is presented by the television such that the consumer can enter competitions and provide feedback.
  • the rule engine 710 may also determine the current time and the time which the program was recorded and only show the computer application interface if the presentation of the content is live. In this instance, the content substitution device 410 determines that no substitute content should be presented indicative of a social media interface due to the program being delivered is a time-shifted recording of the original content.
  • the content substitution device 410 may restrict launching a particular application for presentation of substituted content.
  • a computer application for voting in a live competition may be only accessible after a certain temporal deadline, wherein prior to this deadline the computer application cannot be launched and is restricted by the content substitution device 410.
  • the content substitution device 410 receives the original content, the content substitution device 410 generates a digital fingerprint of a sample of the original content. The content substitution device 410 then transfers a request to the server processing system 420 to request classification of the original content. When the server processing system 420 detects that original content is the game show, the server processing system 420 may query the rule repository 725 to determine if a particular action should be taken in response to detecting the game show.
  • the user has defined a rule that a computer application, indicated in the consumer selected application repository 726, associated with the game show should be automatically launched by the server processing system 420 such that substitute content indicative of the game show with a user interface overlay representing the game show application is to be presented via the television 430.
  • the substitute content is transferred from the server processing system 420 to the content substitution device 410 which is then transferred to the television 430 as substitute content.
  • the consumer can then interact with the game show application, such as submitting answers to questions presented in the game show, via an application which is executed upon the consumer's mobile communication device 460.
  • the application executed on the mobile communication device 460 may configure the mobile communication device 460 to transfer data directly to the content substitution device 410 via a wireless communication medium such as Bluetooth or Wi-Fi.
  • the content substitution device 410 can then transfer the consumer input to the server processing system 420, wherein the application can be updated accordingly.
  • the web/application server 740 which serves the application being executed by the server processing system 420 can then generate feedback data in response to the consumer input, such as indicating whether the answer submitted was correct or incorrect, which is then presented as part of the substitute content transferred to the television 430.
  • the system 400 may be utilised with various forms of television shows such as a drama show, interview/panel show, live sport show, reality television show, music video show or the like.
  • the content substitution device 410 may receive the original content from a set-top box.
  • the content substitution device 410 can include an input port to allow a video source device 440 to be coupled with the content substitution device 410.
  • a dongle device may be coupled to the content substitution device 410, wherein the dongle operates as a digital tuner to provide original content to the content substitution device 410 for analysis.
  • the content substitution device 410 includes a digital tuner such that it is not necessary for the content substitution device 410 to receive the original content from another video source device.
  • the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, firmware, or an embodiment combining software and hardware aspects.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Computer Graphics (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

L'invention a pour objet d'intercepter un contenu transmis entre des dispositifs, des dispositifs d'affichage de contenu et des dispositifs source de contenu. Une source peut être, de façon non limitative, un boîtier décodeur. Un afficheur peut être, de façon non limitative, un téléviseur. L'interception peut être, de façon non limitative, un transfert HDMI, des lunettes à réalité augmentée ou des dispositifs d'exploration cérébrale. L'invention reçoit un contenu en provenance d'une source. L'invention communique avec un dispositif de reconnaissance de contenu qui réagit par des instructions décrivant des modifications sur le contenu d'entrée. L'invention effectue les modifications prescrites, délivrant en sortie un contenu modifié vers un afficheur. Les modifications apportées au contenu peuvent consister, de façon non limitative, à solliciter une interaction avec tout autre dispositif, notamment de façon non limitative des télécommandes, des téléphones mobiles et des tablettes électroniques. Le résultat de l'interaction sollicitée peut être, de façon non limitative, le lancement d'une application sur un dispositif quelconque.
PCT/AU2013/001226 2012-11-27 2013-10-23 Distribution d'un contenu de substitution Ceased WO2014082116A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
AU2012905193 2012-11-27
AU2012905193A AU2012905193A0 (en) 2012-11-27 Delivery of substitute content

Publications (1)

Publication Number Publication Date
WO2014082116A1 true WO2014082116A1 (fr) 2014-06-05

Family

ID=50826950

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/AU2013/001226 Ceased WO2014082116A1 (fr) 2012-11-27 2013-10-23 Distribution d'un contenu de substitution

Country Status (1)

Country Link
WO (1) WO2014082116A1 (fr)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090222853A1 (en) * 2008-02-29 2009-09-03 At&T Knowledge Ventures, L.P. Advertisement Replacement System
US20100269128A1 (en) * 2009-04-17 2010-10-21 Gordon Donald F Method and System for Remotely Controlling Consumer Electronic Devices

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090222853A1 (en) * 2008-02-29 2009-09-03 At&T Knowledge Ventures, L.P. Advertisement Replacement System
US20100269128A1 (en) * 2009-04-17 2010-10-21 Gordon Donald F Method and System for Remotely Controlling Consumer Electronic Devices

Similar Documents

Publication Publication Date Title
US12262073B2 (en) Systems and methods for managing available bandwidth in a household
US8776105B2 (en) Method and system for automatic content recognition protocols
US11889137B2 (en) Systems and methods for seamlessly connecting devices based on relationships between the users of the respective devices
US8341681B2 (en) System and method of distributing multimedia content
US8805817B2 (en) Techniques to consume content and metadata
US9955227B2 (en) System and method for communicating alerts through a set-top box
US10412434B1 (en) Systems and methods for seamlessly connecting to a user's device to share and display a relevant media asset
US20130346867A1 (en) Systems and methods for automatically generating a media asset segment based on verbal input
US9866913B1 (en) Binary TV
US11979625B2 (en) Dynamic scheduling of content
WO2014082116A1 (fr) Distribution d'un contenu de substitution

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13859480

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13859480

Country of ref document: EP

Kind code of ref document: A1