[go: up one dir, main page]

US20150312648A1 - Mobile device controlled dynamic room environment using a cast device - Google Patents

Mobile device controlled dynamic room environment using a cast device Download PDF

Info

Publication number
US20150312648A1
US20150312648A1 US14/259,834 US201414259834A US2015312648A1 US 20150312648 A1 US20150312648 A1 US 20150312648A1 US 201414259834 A US201414259834 A US 201414259834A US 2015312648 A1 US2015312648 A1 US 2015312648A1
Authority
US
United States
Prior art keywords
media
control signals
room
mobile device
devices
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US14/259,834
Inventor
Gong Zhang
Jian Huang
Gaurav D. Mehta
Jianxiu Hao
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Verizon Patent and Licensing Inc
Original Assignee
Verizon Patent and Licensing Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Verizon Patent and Licensing Inc filed Critical Verizon Patent and Licensing Inc
Priority to US14/259,834 priority Critical patent/US20150312648A1/en
Assigned to VERIZON PATENT AND LICENSING INC. reassignment VERIZON PATENT AND LICENSING INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HAO, JIANXIU, HUANG, JIAN, MEHTA, GAURAV D., ZHANG, GONG
Publication of US20150312648A1 publication Critical patent/US20150312648A1/en
Priority to US15/351,589 priority patent/US10390078B2/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/43615Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • H04N21/41265The peripheral being portable, e.g. PDAs or mobile phones having a remote control device for bidirectional communication between the remote control device and client device
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4131Peripherals receiving signals from specially adapted client devices home appliance, e.g. lighting, air conditioning system, metering devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/418External card to be used in combination with the client device, e.g. for conditional access
    • H04N21/4183External card to be used in combination with the client device, e.g. for conditional access providing its own processing capabilities, e.g. external module for video decoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61Network physical structure; Signal processing
    • H04N21/6106Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6131Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via a mobile phone network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8166Monomedia components thereof involving executable data, e.g. software
    • H04N21/8173End-user applications, e.g. Web browser, game
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8166Monomedia components thereof involving executable data, e.g. software
    • H04N21/8186Monomedia components thereof involving executable data, e.g. software specially adapted to be executed by a peripheral of the client device, e.g. by a reprogrammable remote control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/858Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL

Definitions

  • Cast devices such as Chromecast or Airplay devices, typically plug into a port of a television (TV).
  • a mobile application executed on a mobile device such as a smartphone, tablet, or laptop, sends a user's favorite TV shows, movies, music and other media content to the TV via the cast device. While the media content is streaming to the TV via the cast device, the user can continue to use the mobile device as a second screen device for searching, browsing, or other user activity.
  • FIGS. 1-3 depict an exemplary network environment in which different implementations enable a mobile device to dynamically control a room environment based on media content being delivered to a display device by a cast device;
  • FIG. 4 is a diagram that depicts exemplary components of a device that may correspond to the mobile device, the cast device, and/or the display device of FIGS. 1-3 ;
  • FIG. 5 depicts exemplary implementations for controlling parameters of a room device of FIGS. 1-3 based on a media/media data analysis performed by the mobile device of FIGS. 1-3 ;
  • FIG. 6 depicts an exemplary data structure that may be stored in a memory or storage device of the mobile device or the cast device of FIGS. 1-3 ;
  • FIG. 7 is a flow diagram that illustrates an exemplary process for controlling operational parameters associated with devices in a room environment based on the content of media delivered to a display device via a cast device.
  • FIGS. 1-3 depict different implementations of an exemplary network environment 100 in which a mobile device dynamically controls a room environment based on media content being delivered by a cast device to a display device.
  • Network environment 100 may include a cast device 105 , a mobile device 110 , a room environment 115 , a network 130 , and a wireless network 135 .
  • room environment 115 may include a display device 120 and one or more room devices 125 - 1 through 125 - n.
  • Cast device 105 may include a device, such as a Chromecast or Airplay device, that plugs into a port of display device 120 and which plays digital media (e.g., streamed audio, video or image content) on display device 120 .
  • Cast device 105 may receive media content, or an address (e.g., link) to retrieve the media content, from mobile device 110 so that cast device 105 may stream the media content to display device 120 .
  • the media content may include, for example, television (TV) shows, movies, music and/or other video, audio or image media content.
  • Cast device 105 may include wired or wireless communication interfaces for communicating with display device 120 , mobile device 110 , network 130 and/or wireless network 135 .
  • cast device 105 may be omitted from network environment 100 , and, instead, display device 120 may include a SmartTV that performs functions described herein as being performed by cast device 105 .
  • cast device 105 may also be omitted from network environment 100 and, instead, the functions described herein as being performed by cast device 105 may be performed by a set-top box (STB) (connected to display device 120 and further connected to network 130 ), or by a dongle connected to display device 120 .
  • STB set-top box
  • display device 120 and mobile device 110 may be connected within a same Wi-Fi network.
  • Mobile device 110 may include a portable electronic device, having wireless communication capabilities, that may communicate with wireless network 135 , network 130 , cast device 105 and/or room devices 125 - 1 through 125 - n .
  • Mobile device 110 may include, for example, a laptop, palmtop or tablet computer having wireless capability; a cellular telephone (e.g., a “smart” phone); or a personal digital assistant (PDA) having wireless capability.
  • Mobile device 110 may be carried and operated by a user 150 , who may be located within, or outside of, room environment 115 (shown outside in FIGS. 1-3 ).
  • User 150 may use mobile device 110 for additional functions other than control of operational parameters associated with room devices 125 of room environment 115 .
  • user 150 may use mobile device 110 for web browsing.
  • Mobile device 110 may execute a room environment application that implements the room device control process of FIG. 7 (below). The room environment application may be downloaded from a source in network 130 .
  • Display device 120 may include a device having audio, video and image displaying capabilities. Display device 120 may include, for example, a TV or monitor. Display device 120 may include a port for connecting to cast device 105 . In some implementations, display device 120 may additionally, or alternatively, include a sound system device that connects to one or more room devices 125 that each includes a speaker.
  • Room devices 125 - 1 through 125 - n may include devices located within room environment 115 .
  • Each of room devices 125 - 1 through 125 - n may have an internal device control unit, or an external device control unit, to which mobile device 110 can send respective control signals 155 - 1 through 155 - n via, for example, Wi-Fi or BlueTooth, to control operational parameters of room devices 125 - 1 through 125 - n .
  • one or more of room devices 125 - 1 through 125 - n may connect to network 130 and/or wireless network 135 .
  • Room devices 125 - 1 through 125 - n may include, for example, an air conditioning unit, a fan, an audio speaker, a light, or a hot tub.
  • Network 130 may include one or more different types of networks including, for example, a Public Switched Telephone Network (PSTN), a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), an intranet, the Internet, or a cable network (e.g., an optical cable network).
  • Wireless network 135 may include a satellite network, a Public Land Mobile Network (PLMN), or a wireless LAN or WAN (e.g., Wi-Fi).
  • PLMN Public Land Mobile Network
  • wireless network 135 may be replaced by a wireless network access point (e.g., a wireless router) that connects to network 130 , and mobile device 110 may communicate directly with network 130 via the wireless network access point, avoiding the use of wireless network 135 .
  • a wireless network access point e.g., a wireless router
  • network environment 100 may include additional, fewer and/or different components that may be configured in a different arrangement than those depicted in FIGS. 1-3 .
  • network environment 100 may include any number of mobile devices 110 , room environments 115 , display devices 120 , and/or cast devices 105 .
  • participants, other than user 150 may be present in room environment 115 during playback of media at cast device 105 and display device 120 .
  • Each of the participants may, or may not, have a mobile device 110 of their own for controlling one or more room devices 125 in room environment 115 .
  • mobile device 110 may receive content media 140 from a media source in network 130 and may then forward the content media 140 to cast device 105 for streaming to display device 120 .
  • content media 140 may be delivered to mobile device 110 via network 130 and wireless network 135 .
  • mobile device 110 may perform a media analysis 145 upon the content media 140 , and may further forward content media 140 to cast device 105 via, for example, a wireless connection.
  • cast device 105 may stream content media 140 to display device 120 .
  • mobile device 110 may send one or more control signals 155 - 1 through 155 - n to respective ones of room devices 125 - 1 through 125 - n in room environment 115 to change operational parameters associated with the room devices 125 . For example, if a room device 125 includes a light, mobile device 110 may send a control signal to room device 125 that increases or decreases the intensity of the light based on the media content analyzed at mobile device 110 .
  • content media 140 may be delivered via network 130 to mobile device 110 and to cast device 105 , without any intervening forwarding of content media 140 via mobile device 110 to cast device 105 as in the implementation of FIG. 1 .
  • mobile device 110 may provide a link to media to cast device 105 , and cast device 105 , using the link, may obtain content media 140 from a media source (e.g., a content provider) via network 130 .
  • a media source e.g., a content provider
  • Mobile device 110 may also obtain the same content media 140 from the media source via network 130 and wireless network 135 .
  • cast device 105 may stream content media 140 to display device 120 .
  • mobile device 110 may perform a media analysis 145 upon the content media 140 . Based on the results of the media analysis 145 , mobile device 110 may send one or more control signals 155 - 1 through 155 - n to respective ones of room devices 125 - 1 through 125 - n in room environment 115 to change operational parameters associated with the room devices 125 . For example, if a room device 125 includes an air conditioning or heating unit, mobile device 110 may send a control signal to room device 125 that increases or decreases the temperature of the air circulated through room device 125 .
  • cast device 105 or display device 120 may, based on content media 140 streamed via network 130 , provide media data 160 to mobile device 110 .
  • the media data 160 may include data that identifies particular characteristics of content media 140 that mobile device 110 may use in an analysis.
  • Mobile device 110 may provide an address (e.g., a link) for the media to cast device 105 , and cast device 105 , using the link, may obtain content media 140 from a content provider 130 via network 130 .
  • cast device 105 may stream content media 140 to display device 120 .
  • Cast device 105 may additionally extract specific characteristics from content media 140 and provide those characteristics as media data 160 to mobile device 110 .
  • display device 120 may extract the specific characteristics from content media 140 and provide those characteristics as media data 160 to mobile device 110 .
  • mobile device 110 may perform a media data analysis 165 upon the media data 160 . Based on the results of the media data analysis 165 , mobile device 110 may send one or more control signals 155 - 1 through 155 - n to respective ones of room devices 125 - 1 through 125 - n in room environment 115 to change operational parameters associated with the room devices 125 . For example, if a room device 125 includes audio speakers, mobile device 110 may send a control signal to room device 125 that increases or decreases the volume of the audio generated by the speakers.
  • FIG. 4 is a diagram that depicts exemplary components of a device 400 .
  • Mobile device 110 , cast device 105 and display device 120 may each have the same or similar components in a same or similar configuration to that shown in FIG. 4 .
  • Device 400 may include a bus 410 , a processing unit 420 , a main memory 430 , a read only memory (ROM) 440 , a storage device 450 , an input device(s) 460 , an output device(s) 470 , and a communication interface(s) 480 .
  • Bus 410 may include a path that permits communication among the elements of device 400 .
  • Processing unit 420 may include one or more processors or microprocessors, or processing logic, which may interpret and execute instructions.
  • Main memory 430 may include a random access memory (RAM) or another type of dynamic storage device that may store information and instructions for execution by processing unit 420 .
  • ROM 440 may include a ROM device or another type of static storage device that may store static information and instructions for use by processing unit 420 .
  • Storage device 450 may include a magnetic and/or optical recording medium.
  • Main memory 430 , ROM 440 and storage device 450 may each be referred to herein as a “tangible non-transitory computer-readable medium.”
  • Input device 460 may include one or more mechanisms that permit an operator (or user) to input information to device 400 , such as, for example, a keypad or a keyboard, a display with a touch sensitive panel, voice recognition and/or biometric mechanisms, etc.
  • Output device 470 may include one or more mechanisms that output information to the operator, including a display, a speaker, etc.
  • Communication interface(s) 480 may include a transceiver that enables device 400 to communicate with other devices and/or systems.
  • communication interface(s) 480 may include wired or wireless transceivers for communicating via networks 130 or 135 .
  • Communication interface(s) 480 may include a cellular network transceiver, a BlueTooth transceiver, and/or a Wi-Fi transceiver.
  • device 400 may include additional, fewer and/or different components, or differently arranged components, than those depicted in FIG. 4 .
  • FIG. 5 depicts exemplary implementations for controlling parameters of a room device 125 based on a media/media data analysis performed by mobile device 110 .
  • room device 125 may include an internal device control unit 500 , an external device control unit 510 connected externally and directly to room device 125 (e.g., via a port such as a Universal Serial Bus (USB) port), and/or an external device control unit 520 connected externally and via a power cord 530 to a power outlet 540 .
  • mobile device 110 may perform an analysis 145 of media or media data and, based on the analysis, may generate one or more control signals 155 for controlling operational parameters associated with room device 125 .
  • USB Universal Serial Bus
  • room device 125 includes internal device control unit 500
  • mobile device 110 may send one or more control signals to control unit 500 and, based on the one or more control signals, control unit 500 may control instructed operational parameters of room device 125 .
  • room device 125 includes external device control unit 510
  • mobile device 110 may send one or more control signals to control unit 510 and, based on the one or more control signals, control unit 510 may send instruction signals via an input port to room device 125 to control one or more operational parameters.
  • room device 125 has a power cord 530 that connects to power outlet 540 via external device control unit 520 , then mobile device 110 may send one or more control signals to control unit 520 and, based on the one or more control signals, control unit 520 may control the power supplied to room device 125 from power outlet 540 . For example, control unit 520 may decrease the power supplied to room device 125 , or turn off the supply of power from power outlet 540 entirely.
  • FIG. 6 depicts an exemplary data structure 600 that may be stored in memory 430 or storage device 450 of mobile device 110 or cast device 105 .
  • Data structure 600 may include multiple entries 610 , each of which may include a time field 620 , an analyzed media attribute(s) field(s) 630 , and controlled device parameter fields 640 - 1 through 640 - m (where m is an integer greater than or equal to 1).
  • Data structure 600 may be associated with an item of media (e.g., a video).
  • Each item of media analyzed by mobile device 110 may have its own data structure 600 .
  • the values stored in the fields of each entry 610 of data structure 600 may be manually entered, automatically pre-loaded, or populated based on the analysis performed by mobile device 110 .
  • Time field 620 may store a time stamp, or a range of time, associated with the media corresponding to data structure 600 .
  • mobile device 110 may perform an analysis of the media over a period of time of 3 minutes, running from five minutes (00:05:00) from the start of the media to eight minutes (00:08:00) from the start of the media.
  • Analyzed media attribute(s) field(s) 630 may comprise one or more fields that each stores data indicating a value for an attribute for the media associated with data structure 600 . For example, if mobile device 110 analyzes the color of the media, then field(s) 630 may store a determined color RGB value (e.g., red, green, blue) for the media.
  • RGB value e.g., red, green, blue
  • Controlled device parameter fields 640 - 1 through 640 - m may each store a target value for controlling a respective operational parameter of a room device 125 .
  • field 640 - 1 may store a value indicating “high speed” or “low speed” for instructing room device 125 , that includes a fan, to change its fan speed to a high speed or a low speed.
  • field 640 - m may store a specific temperature value for instructing room device 125 , that includes an air conditioning unit, to change its temperature setting to the temperature value indicated in field 640 - m.
  • each controlled device parameter field 640 may additionally be paired with a room device identifier (ID) field that identifies a particular room device 125 in room environment 115 whose operational parameter(s) identified in the corresponding filed 640 is to be controlled.
  • ID room device identifier
  • FIG. 7 is a flow diagram that illustrates an exemplary process for controlling operational parameters associated with devices 125 in a room environment 115 based on the content of media delivered to a display device via a cast device.
  • the exemplary process of FIG. 7 may be implemented by mobile device 110 .
  • the exemplary process of FIG. 7 is described below with reference to FIGS. 1-3 .
  • the exemplary process of FIG. 7 may be implemented with a delay between the analysis of the media, and the streaming of the media for playback by cast device 105 and display device 120 .
  • the delay permits the performance of blocks 730 , 740 and 750 prior to the streaming of the media for playback at display device 120 .
  • the exemplary process may include mobile device 110 requesting selected media (block 700 ).
  • Mobile device 110 may request media from a media source (e.g., content server) connected to network 130 .
  • a media source e.g., content server
  • One of alternative blocks 710 , 715 or 720 may then be performed based on a particular one of the implementations of FIGS. 1-3 being implemented.
  • mobile device 110 may receive the delivered media from the content server and may send the media to the cast device (block 710 ).
  • media 140 may be delivered (e.g., streamed) from the content server via network 130 and wireless network 135 , and received at mobile device 110 .
  • Mobile device 110 may, in turn, stream media 140 to cast device 105 .
  • mobile device 110 may receive the delivered media from the media source, and may send an address associated with the media to the cast device (block 715 ).
  • media 140 may be delivered (e.g., streamed) from the media source via network 130 and wireless network 135 , and mobile device 110 may send an address (e.g., a link at the content server) to cast device 105 such that cast device 105 may obtain the media from the media source.
  • the media delivered from the content server may additionally include an address at the media source at which the media may be obtained from cast device 105 .
  • mobile device 110 may send an address associated with the media to the cast device, and may receive media data from the cast device (block 720 ).
  • the content server may deliver (e.g., stream) media 140 to cast device 105 based on an address (e.g., link) received from mobile device 110 .
  • Cast device 105 may extract relevant characteristics from the obtained media and send the extracted characteristics as media data 160 to mobile device 110 .
  • Mobile device 110 may perform an analysis of the content of the media, or of the media data received from cast device 105 (block 730 ). Mobile device 110 may perform an analysis that identifies movement (e.g., an individual running) in the scene if the media is video; identifies one or more colors in the scene, or a brightness of the scene, if the media is video or an image(s); or identifies a sound volume if the media is video or audio. In some implementations, mobile device 110 may employ more sophisticated analysis algorithms that can perform image/video analysis to, for example, identify actions occurring in the scene (e.g., a quarterback passing a football, a car crashing, etc.). In other implementations, mobile device 110 may employ speech analysis algorithms to recognize the content of speech (i.e., what is being said) when the media is audio or video.
  • movement e.g., an individual running
  • mobile device 110 may employ more sophisticated analysis algorithms that can perform image/video analysis to, for example, identify actions occurring in the scene (e.g., a quarterback
  • Mobile device 110 may determine parameter(s) of a selected room device(s) to change based on the performed analysis (block 740 ). Mobile device 110 may select more or more room devices 125 in room environment 115 and may determine which parameter(s) of the selected devices are to be changed. For example, mobile device 110 may identify room devices 125 - 1 through 125 - n as including a light, an air conditioning unit, and a set of speakers connected to display device 120 , and may select the light for the changing of parameters. With the light being selected, mobile device 110 may change one or more various operational parameters of the light: 1) on/off; 2) intensity of light (dimness or brightness); or 3) a strobe effect. As another example, mobile device 110 may select the air conditioning unit for the changing of parameters.
  • mobile device 110 may change one or more operational parameters of the AC unit: 1) on/off; 2) fan speed (high or low); or 3) temperature (cold or hot).
  • mobile device 110 may index data structure 600 for the item of media with the current playback time (or time range) and an analyzed media attribute to identify an entry 610 having a same time or time range value in time field 620 and a same analyzed attribute value in field 630 .
  • Mobile device 110 may then retrieve the values from fields 640 - 1 through 640 - m for the identified entry 610 to identify the room devices 125 , and the respective operational parameters for each of the identified room devices, that are to be changed.
  • Mobile device 110 may send control signal(s) to the selected room device(s) to implement a change(s) in the determine parameter(s) (block 750 ).
  • Mobile device 110 may send an appropriate control signal 155 to a selected room device 125 to cause the room device 125 to change the selected operational parameter.
  • mobile device 110 may wirelessly transmit (e.g., via Bluetooth or Wi-Fi) a control signal 155 to a room device 125 that includes a set of speakers.
  • the control signal 155 may increase the volume of the set of speakers.
  • Blocks 710 - 750 may be selectively repeated until the media finishes and is no longer being played back at display device 120 . Therefore, the operational parameters of room devices 125 - 1 through 125 - n in room environment 115 may change throughout media playback based on the analyzed content of the media.
  • This logic or unit may include hardware, such as one or more processors, microprocessors, application specific integrated circuits, or field programmable gate arrays, software, or a combination of hardware and software.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Automation & Control Theory (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

A mobile device analyzes data associated with media handled by a cast device connected to a display device. The mobile device causes control signals to be sent, via the one or more communication interfaces, to one of multiple different devices in a room to change an operational parameter associated with the one of the multiple different devices.

Description

    BACKGROUND
  • Cast devices, such as Chromecast or Airplay devices, typically plug into a port of a television (TV). A mobile application executed on a mobile device, such as a smartphone, tablet, or laptop, sends a user's favorite TV shows, movies, music and other media content to the TV via the cast device. While the media content is streaming to the TV via the cast device, the user can continue to use the mobile device as a second screen device for searching, browsing, or other user activity.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIGS. 1-3 depict an exemplary network environment in which different implementations enable a mobile device to dynamically control a room environment based on media content being delivered to a display device by a cast device;
  • FIG. 4 is a diagram that depicts exemplary components of a device that may correspond to the mobile device, the cast device, and/or the display device of FIGS. 1-3;
  • FIG. 5 depicts exemplary implementations for controlling parameters of a room device of FIGS. 1-3 based on a media/media data analysis performed by the mobile device of FIGS. 1-3;
  • FIG. 6 depicts an exemplary data structure that may be stored in a memory or storage device of the mobile device or the cast device of FIGS. 1-3; and
  • FIG. 7 is a flow diagram that illustrates an exemplary process for controlling operational parameters associated with devices in a room environment based on the content of media delivered to a display device via a cast device.
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • The following detailed description refers to the accompanying drawings. The same reference numbers in different drawings may identify the same or similar elements. The following detailed description does not limit the invention.
  • FIGS. 1-3 depict different implementations of an exemplary network environment 100 in which a mobile device dynamically controls a room environment based on media content being delivered by a cast device to a display device. Network environment 100 may include a cast device 105, a mobile device 110, a room environment 115, a network 130, and a wireless network 135. As further shown in FIG. 1, room environment 115 may include a display device 120 and one or more room devices 125-1 through 125-n.
  • Cast device 105 may include a device, such as a Chromecast or Airplay device, that plugs into a port of display device 120 and which plays digital media (e.g., streamed audio, video or image content) on display device 120. Cast device 105 may receive media content, or an address (e.g., link) to retrieve the media content, from mobile device 110 so that cast device 105 may stream the media content to display device 120. The media content may include, for example, television (TV) shows, movies, music and/or other video, audio or image media content. Cast device 105 may include wired or wireless communication interfaces for communicating with display device 120, mobile device 110, network 130 and/or wireless network 135. In alternative embodiments, cast device 105 may be omitted from network environment 100, and, instead, display device 120 may include a SmartTV that performs functions described herein as being performed by cast device 105. In still further alternative embodiments, cast device 105 may also be omitted from network environment 100 and, instead, the functions described herein as being performed by cast device 105 may be performed by a set-top box (STB) (connected to display device 120 and further connected to network 130), or by a dongle connected to display device 120. In these alternative embodiments, display device 120 and mobile device 110 may be connected within a same Wi-Fi network.
  • Mobile device 110 may include a portable electronic device, having wireless communication capabilities, that may communicate with wireless network 135, network 130, cast device 105 and/or room devices 125-1 through 125-n. Mobile device 110 may include, for example, a laptop, palmtop or tablet computer having wireless capability; a cellular telephone (e.g., a “smart” phone); or a personal digital assistant (PDA) having wireless capability. Mobile device 110 may be carried and operated by a user 150, who may be located within, or outside of, room environment 115 (shown outside in FIGS. 1-3). User 150 may use mobile device 110 for additional functions other than control of operational parameters associated with room devices 125 of room environment 115. For example, user 150 may use mobile device 110 for web browsing. Mobile device 110 may execute a room environment application that implements the room device control process of FIG. 7 (below). The room environment application may be downloaded from a source in network 130.
  • Display device 120 may include a device having audio, video and image displaying capabilities. Display device 120 may include, for example, a TV or monitor. Display device 120 may include a port for connecting to cast device 105. In some implementations, display device 120 may additionally, or alternatively, include a sound system device that connects to one or more room devices 125 that each includes a speaker.
  • Room devices 125-1 through 125-n may include devices located within room environment 115. Each of room devices 125-1 through 125-n may have an internal device control unit, or an external device control unit, to which mobile device 110 can send respective control signals 155-1 through 155-n via, for example, Wi-Fi or BlueTooth, to control operational parameters of room devices 125-1 through 125-n. Though not depicted in FIGS. 1-3, one or more of room devices 125-1 through 125-n may connect to network 130 and/or wireless network 135. Room devices 125-1 through 125-n may include, for example, an air conditioning unit, a fan, an audio speaker, a light, or a hot tub.
  • Network 130 may include one or more different types of networks including, for example, a Public Switched Telephone Network (PSTN), a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), an intranet, the Internet, or a cable network (e.g., an optical cable network). Wireless network 135 may include a satellite network, a Public Land Mobile Network (PLMN), or a wireless LAN or WAN (e.g., Wi-Fi). In one implementation, wireless network 135 may be replaced by a wireless network access point (e.g., a wireless router) that connects to network 130, and mobile device 110 may communicate directly with network 130 via the wireless network access point, avoiding the use of wireless network 135.
  • The configuration of network components of network environment 100 illustrated in FIG. 1 (and FIGS. 2-3 below) is for illustrative purposes. Other configurations may be implemented. Therefore, network environment 100 may include additional, fewer and/or different components that may be configured in a different arrangement than those depicted in FIGS. 1-3. For example, network environment 100 may include any number of mobile devices 110, room environments 115, display devices 120, and/or cast devices 105. Though not shown in FIGS. 1-3, participants, other than user 150, may be present in room environment 115 during playback of media at cast device 105 and display device 120. Each of the participants may, or may not, have a mobile device 110 of their own for controlling one or more room devices 125 in room environment 115.
  • In the implementation depicted in FIG. 1, mobile device 110 may receive content media 140 from a media source in network 130 and may then forward the content media 140 to cast device 105 for streaming to display device 120. As shown in FIG. 1, content media 140 may be delivered to mobile device 110 via network 130 and wireless network 135. Upon receipt of content media 140, mobile device 110 may perform a media analysis 145 upon the content media 140, and may further forward content media 140 to cast device 105 via, for example, a wireless connection. Upon receipt, cast device 105 may stream content media 140 to display device 120. Based on the results of the media analysis 145, mobile device 110 may send one or more control signals 155-1 through 155-n to respective ones of room devices 125-1 through 125-n in room environment 115 to change operational parameters associated with the room devices 125. For example, if a room device 125 includes a light, mobile device 110 may send a control signal to room device 125 that increases or decreases the intensity of the light based on the media content analyzed at mobile device 110.
  • In the implementation depicted in FIG. 2, content media 140 may be delivered via network 130 to mobile device 110 and to cast device 105, without any intervening forwarding of content media 140 via mobile device 110 to cast device 105 as in the implementation of FIG. 1. In the implementation of FIG. 2, mobile device 110 may provide a link to media to cast device 105, and cast device 105, using the link, may obtain content media 140 from a media source (e.g., a content provider) via network 130. Mobile device 110 may also obtain the same content media 140 from the media source via network 130 and wireless network 135. Upon receipt of content media 140 via network 130, cast device 105 may stream content media 140 to display device 120.
  • As shown in FIG. 2, upon receipt of content media 140, mobile device 110 may perform a media analysis 145 upon the content media 140. Based on the results of the media analysis 145, mobile device 110 may send one or more control signals 155-1 through 155-n to respective ones of room devices 125-1 through 125-n in room environment 115 to change operational parameters associated with the room devices 125. For example, if a room device 125 includes an air conditioning or heating unit, mobile device 110 may send a control signal to room device 125 that increases or decreases the temperature of the air circulated through room device 125.
  • In the implementation depicted in FIG. 3, cast device 105 or display device 120 may, based on content media 140 streamed via network 130, provide media data 160 to mobile device 110. The media data 160 may include data that identifies particular characteristics of content media 140 that mobile device 110 may use in an analysis. Mobile device 110 may provide an address (e.g., a link) for the media to cast device 105, and cast device 105, using the link, may obtain content media 140 from a content provider 130 via network 130.
  • Upon receipt of content media 140 via network 130, cast device 105 may stream content media 140 to display device 120. Cast device 105 may additionally extract specific characteristics from content media 140 and provide those characteristics as media data 160 to mobile device 110. Alternatively, upon receipt of content media 140 from cast device 105, display device 120 may extract the specific characteristics from content media 140 and provide those characteristics as media data 160 to mobile device 110.
  • Upon receipt of media data 160, mobile device 110 may perform a media data analysis 165 upon the media data 160. Based on the results of the media data analysis 165, mobile device 110 may send one or more control signals 155-1 through 155-n to respective ones of room devices 125-1 through 125-n in room environment 115 to change operational parameters associated with the room devices 125. For example, if a room device 125 includes audio speakers, mobile device 110 may send a control signal to room device 125 that increases or decreases the volume of the audio generated by the speakers.
  • FIG. 4 is a diagram that depicts exemplary components of a device 400. Mobile device 110, cast device 105 and display device 120 may each have the same or similar components in a same or similar configuration to that shown in FIG. 4. Device 400 may include a bus 410, a processing unit 420, a main memory 430, a read only memory (ROM) 440, a storage device 450, an input device(s) 460, an output device(s) 470, and a communication interface(s) 480. Bus 410 may include a path that permits communication among the elements of device 400.
  • Processing unit 420 may include one or more processors or microprocessors, or processing logic, which may interpret and execute instructions. Main memory 430 may include a random access memory (RAM) or another type of dynamic storage device that may store information and instructions for execution by processing unit 420. ROM 440 may include a ROM device or another type of static storage device that may store static information and instructions for use by processing unit 420. Storage device 450 may include a magnetic and/or optical recording medium. Main memory 430, ROM 440 and storage device 450 may each be referred to herein as a “tangible non-transitory computer-readable medium.”
  • Input device 460 may include one or more mechanisms that permit an operator (or user) to input information to device 400, such as, for example, a keypad or a keyboard, a display with a touch sensitive panel, voice recognition and/or biometric mechanisms, etc. Output device 470 may include one or more mechanisms that output information to the operator, including a display, a speaker, etc. Communication interface(s) 480 may include a transceiver that enables device 400 to communicate with other devices and/or systems. For example, communication interface(s) 480 may include wired or wireless transceivers for communicating via networks 130 or 135. Communication interface(s) 480 may include a cellular network transceiver, a BlueTooth transceiver, and/or a Wi-Fi transceiver.
  • The configuration of components of device 400 illustrated in FIG. 4 is for illustrative purposes only. Other configurations may be implemented. Therefore, device 400 may include additional, fewer and/or different components, or differently arranged components, than those depicted in FIG. 4.
  • FIG. 5 depicts exemplary implementations for controlling parameters of a room device 125 based on a media/media data analysis performed by mobile device 110. As depicted in FIG. 5, room device 125 may include an internal device control unit 500, an external device control unit 510 connected externally and directly to room device 125 (e.g., via a port such as a Universal Serial Bus (USB) port), and/or an external device control unit 520 connected externally and via a power cord 530 to a power outlet 540. As described with respect to FIGS. 1-3 above, mobile device 110 may perform an analysis 145 of media or media data and, based on the analysis, may generate one or more control signals 155 for controlling operational parameters associated with room device 125. If room device 125 includes internal device control unit 500, mobile device 110 may send one or more control signals to control unit 500 and, based on the one or more control signals, control unit 500 may control instructed operational parameters of room device 125. If room device 125 includes external device control unit 510, mobile device 110 may send one or more control signals to control unit 510 and, based on the one or more control signals, control unit 510 may send instruction signals via an input port to room device 125 to control one or more operational parameters. If room device 125 has a power cord 530 that connects to power outlet 540 via external device control unit 520, then mobile device 110 may send one or more control signals to control unit 520 and, based on the one or more control signals, control unit 520 may control the power supplied to room device 125 from power outlet 540. For example, control unit 520 may decrease the power supplied to room device 125, or turn off the supply of power from power outlet 540 entirely.
  • FIG. 6 depicts an exemplary data structure 600 that may be stored in memory 430 or storage device 450 of mobile device 110 or cast device 105. Data structure 600 may include multiple entries 610, each of which may include a time field 620, an analyzed media attribute(s) field(s) 630, and controlled device parameter fields 640-1 through 640-m (where m is an integer greater than or equal to 1). Data structure 600 may be associated with an item of media (e.g., a video). Each item of media analyzed by mobile device 110 may have its own data structure 600. The values stored in the fields of each entry 610 of data structure 600 may be manually entered, automatically pre-loaded, or populated based on the analysis performed by mobile device 110.
  • Time field 620 may store a time stamp, or a range of time, associated with the media corresponding to data structure 600. For example, mobile device 110 may perform an analysis of the media over a period of time of 3 minutes, running from five minutes (00:05:00) from the start of the media to eight minutes (00:08:00) from the start of the media.
  • Analyzed media attribute(s) field(s) 630 may comprise one or more fields that each stores data indicating a value for an attribute for the media associated with data structure 600. For example, if mobile device 110 analyzes the color of the media, then field(s) 630 may store a determined color RGB value (e.g., red, green, blue) for the media.
  • Controlled device parameter fields 640-1 through 640-m may each store a target value for controlling a respective operational parameter of a room device 125. For example, field 640-1 may store a value indicating “high speed” or “low speed” for instructing room device 125, that includes a fan, to change its fan speed to a high speed or a low speed. As another example, field 640-m may store a specific temperature value for instructing room device 125, that includes an air conditioning unit, to change its temperature setting to the temperature value indicated in field 640-m.
  • The number, types, and content of the entries and/or fields in data structure 600 in FIG. 6 are for illustrative purposes. Other types of data structures having different numbers of, types of and/or content of, the entries and/or the fields may be implemented. Therefore, data structure 600 may include additional, fewer and/or different entries and/or fields than those depicted in FIG. 6. For example, each controlled device parameter field 640 may additionally be paired with a room device identifier (ID) field that identifies a particular room device 125 in room environment 115 whose operational parameter(s) identified in the corresponding filed 640 is to be controlled.
  • FIG. 7 is a flow diagram that illustrates an exemplary process for controlling operational parameters associated with devices 125 in a room environment 115 based on the content of media delivered to a display device via a cast device. The exemplary process of FIG. 7 may be implemented by mobile device 110. The exemplary process of FIG. 7 is described below with reference to FIGS. 1-3. In one embodiment, the exemplary process of FIG. 7 may be implemented with a delay between the analysis of the media, and the streaming of the media for playback by cast device 105 and display device 120. The delay permits the performance of blocks 730, 740 and 750 prior to the streaming of the media for playback at display device 120.
  • The exemplary process may include mobile device 110 requesting selected media (block 700). Mobile device 110 may request media from a media source (e.g., content server) connected to network 130. One of alternative blocks 710, 715 or 720 may then be performed based on a particular one of the implementations of FIGS. 1-3 being implemented. In the implementation of FIG. 1, mobile device 110 may receive the delivered media from the content server and may send the media to the cast device (block 710). Referring to FIG. 1, media 140 may be delivered (e.g., streamed) from the content server via network 130 and wireless network 135, and received at mobile device 110. Mobile device 110 may, in turn, stream media 140 to cast device 105.
  • In the implementation of FIG. 2, mobile device 110 may receive the delivered media from the media source, and may send an address associated with the media to the cast device (block 715). Referring to FIG. 2, media 140 may be delivered (e.g., streamed) from the media source via network 130 and wireless network 135, and mobile device 110 may send an address (e.g., a link at the content server) to cast device 105 such that cast device 105 may obtain the media from the media source. The media delivered from the content server may additionally include an address at the media source at which the media may be obtained from cast device 105.
  • In the implementation of FIG. 3, mobile device 110 may send an address associated with the media to the cast device, and may receive media data from the cast device (block 720). Referring to FIG. 3, the content server may deliver (e.g., stream) media 140 to cast device 105 based on an address (e.g., link) received from mobile device 110. Cast device 105 may extract relevant characteristics from the obtained media and send the extracted characteristics as media data 160 to mobile device 110.
  • Mobile device 110 may perform an analysis of the content of the media, or of the media data received from cast device 105 (block 730). Mobile device 110 may perform an analysis that identifies movement (e.g., an individual running) in the scene if the media is video; identifies one or more colors in the scene, or a brightness of the scene, if the media is video or an image(s); or identifies a sound volume if the media is video or audio. In some implementations, mobile device 110 may employ more sophisticated analysis algorithms that can perform image/video analysis to, for example, identify actions occurring in the scene (e.g., a quarterback passing a football, a car crashing, etc.). In other implementations, mobile device 110 may employ speech analysis algorithms to recognize the content of speech (i.e., what is being said) when the media is audio or video.
  • Mobile device 110 may determine parameter(s) of a selected room device(s) to change based on the performed analysis (block 740). Mobile device 110 may select more or more room devices 125 in room environment 115 and may determine which parameter(s) of the selected devices are to be changed. For example, mobile device 110 may identify room devices 125-1 through 125-n as including a light, an air conditioning unit, and a set of speakers connected to display device 120, and may select the light for the changing of parameters. With the light being selected, mobile device 110 may change one or more various operational parameters of the light: 1) on/off; 2) intensity of light (dimness or brightness); or 3) a strobe effect. As another example, mobile device 110 may select the air conditioning unit for the changing of parameters. With the air conditioning unit being selected, mobile device 110 may change one or more operational parameters of the AC unit: 1) on/off; 2) fan speed (high or low); or 3) temperature (cold or hot). In one embodiment, mobile device 110 may index data structure 600 for the item of media with the current playback time (or time range) and an analyzed media attribute to identify an entry 610 having a same time or time range value in time field 620 and a same analyzed attribute value in field 630. Mobile device 110 may then retrieve the values from fields 640-1 through 640-m for the identified entry 610 to identify the room devices 125, and the respective operational parameters for each of the identified room devices, that are to be changed.
  • Mobile device 110 may send control signal(s) to the selected room device(s) to implement a change(s) in the determine parameter(s) (block 750). Mobile device 110 may send an appropriate control signal 155 to a selected room device 125 to cause the room device 125 to change the selected operational parameter. For example, mobile device 110 may wirelessly transmit (e.g., via Bluetooth or Wi-Fi) a control signal 155 to a room device 125 that includes a set of speakers. The control signal 155 may increase the volume of the set of speakers.
  • Blocks 710-750, for an item of requested media, may be selectively repeated until the media finishes and is no longer being played back at display device 120. Therefore, the operational parameters of room devices 125-1 through 125-n in room environment 115 may change throughout media playback based on the analyzed content of the media.
  • The foregoing description of implementations provides illustration and description, but is not intended to be exhaustive or to limit the invention to the precise form disclosed. Modifications and variations are possible in light of the above teachings or may be acquired from practice of the invention. For example, while a series of blocks has been described with respect to FIG. 7, the order of the blocks may be varied in other implementations. Moreover, non-dependent blocks may be performed in parallel.
  • Certain features described above may be implemented as “logic” or a “unit” that performs one or more functions. This logic or unit may include hardware, such as one or more processors, microprocessors, application specific integrated circuits, or field programmable gate arrays, software, or a combination of hardware and software.
  • No element, act, or instruction used in the description of the present application should be construed as critical or essential to the invention unless explicitly described as such. Also, as used herein, the article “a” is intended to include one or more items. Further, the phrase “based on” is intended to mean “based, at least in part, on” unless explicitly stated otherwise.
  • In the preceding specification, various preferred embodiments have been described with reference to the accompanying drawings. It will, however, be evident that various modifications and changes may be made thereto, and additional embodiments may be implemented, without departing from the broader scope of the invention as set forth in the claims that follow. The specification and drawings are accordingly to be regarded in an illustrative rather than restrictive sense.

Claims (25)

1. A method, comprising:
receiving, at a mobile device, data associated with certain media;
analyzing, by the mobile device, the data associated with the certain media, wherein the certain media comprises audio or video media and wherein analyzing the data comprises
recognizing a content of speech within the audio or video media;
determining, by the mobile device, at least one parameter associated with one or more devices in a room environment to change based on the analysis; and
sending, from the mobile device, control signals to the one or more devices to cause the at least one parameter to be changed.
2. The method of claim 1, wherein the data associated with the certain media comprises the certain media in streaming form and further comprising:
streaming, from the mobile device to a cast device, the certain media for media playback.
3. The method of claim 1, wherein the data associated with the certain media comprises an address associated with the certain media and the certain media in streaming form and further comprising:
sending, from the mobile device to a cast device, the address for retrieval and playback of the certain media by the cast device.
4. The method of claim 1, wherein the data associated with certain media comprises the certain media in streaming form.
5. The method of claim 1, wherein the data identifies one or more characteristics of the certain media determined by a cast device.
6. (canceled)
7. The method of claim 1, further comprising:
selecting, by the mobile device, the one or more devices from among a plurality of room devices in the room environment,
wherein determining the at least one parameter associated with the one or more devices to change comprises:
selecting the at least one parameter associated with the one or more devices based on results of the analysis.
8. The method of claim 1, wherein the control signals to the one or more devices comprise at least one of:
control signals to increase or decrease a brightness of a device comprising a light;
control signals to change a color of a device comprising a light;
control signals to change air temperature of a device comprising an air conditioning unit; and
control signals to change a volume or quality of sound of a device comprising a speaker.
9. A portable electronic device, comprising:
a first wireless communication interface configured to:
download, via a source in an external network, a room environment application,
send a request to receive media from a network media source in the external network, and
receive, responsive to the request, data associated with the requested media, wherein the requested media is streamed from the network media source subsequent to receiving the request;
a second wireless communication interface configured to communicate via a wireless local area network (LAN) or a wireless personal area network (PAN); and
a processing unit configured to execute the downloaded room environment application to:
analyze, subsequent to sending the request to receive the media from the network media source and subsequent to the requested media being streamed from the network media source, the data associated with the requested media, wherein the requested media comprises audio or video media and wherein analyzing the data associated with the requested media comprises:
identifying actions occurring within a scene of the video media,
identifying movement within a scene contained in the video media, or
recognizing a content of speech within the audio or video media, and
cause control signals to be sent, via the second wireless communication interface, to one of multiple different room devices within a room environment to change an operational parameter associated with the one of the multiple different room devices based on the analysis of the data associated with the requested media.
10. (canceled)
11. The portable electronic device of claim 9, wherein the data associated with the requested media comprises the requested media in streaming form and wherein the processing unit is further configured to execute the room environment application to:
receive, via the first wireless communication interface, the requested media from the network media source, and
stream, from the portable electronic device to a cast device, the requested media for media playback.
12. The portable electronic device of claim 9, wherein the processing unit is further configured to execute the room environment application to:
send, via the first or second wireless interface, to a cast device, an address for retrieval and playback of the requested media by the cast device.
13. The portable electronic device of claim 9, wherein the data associated with the requested media comprises the requested media in streaming form.
14. The portable electronic device of claim 9, wherein the data identifies one or more characteristics of the requested media determined by a cast device.
15. The portable electronic device of claim 9, wherein the processing unit is further configured to execute the room environment application to:
select the one of the multiple different room devices from among a plurality of room devices currently residing in the room environment,
wherein the processing unit is further configured to execute the room environment application to:
select the operational parameter associated with the one of the multiple different room devices based on results of the analysis.
16. The portable electronic device of claim 9, wherein the control signals to the one of the multiple different room devices comprise at least one of:
control signals to increase or decrease a brightness of a device comprising a light;
control signals to change a color of a device comprising a light;
control signals to change air temperature of a device comprising an air conditioning unit; or
control signals to change a volume or quality of sound of a device comprising a speaker.
17. A non-transitory computer-readable medium containing instructions executable by at least one processor, the computer-readable medium comprising:
one or more instructions for receiving data associated with certain media;
one or more instructions for analyzing the data associated with the certain media, wherein the certain media comprises audio or video media:
one or more instructions for identifying room devices currently residing in a room environment;
one or more instructions for selecting one or more current room devices from the identified current room devices based on the analysis;
one or more instructions for selecting parameters of the selected one or more current room devices to be controlled based on the analysis;
one or more instructions for determining target values for the selected parameters of the selected one or more current room devices based on the analysis;
one or more instructions for populating a database with the determined target values for the selected parameters of the selected one or more current room devices; and
one or more instructions for retrieving the determined target values for the selected parameters of the selected one or more current room devices from the database and causing control signals to be sent to the selected one or more current room devices to cause the selected parameter to be changed based on the determined target values.
18. The non-transitory computer-readable medium of claim 17, wherein the data associated with the certain media comprises the certain media in streaming form and further comprising:
one or more instructions for causing the certain media to be streamed to a cast device for media playback.
19-20. (canceled)
21. The non-transitory computer-readable medium of claim 17, wherein the control signals to be sent to the selected one or more current room devices comprise at least one of:
control signals to increase or decrease a brightness of a device comprising a light;
control signals to change a color of a device comprising a light;
control signals to change air temperature of a device comprising an air conditioning unit; or
control signals to change a volume or quality of sound of a device comprising a speaker.
22. The non-transitory computer-readable medium of claim 17, wherein the data associated with the certain media comprises an address associated with the certain media and the certain media in streaming form and further comprising:
one or more instructions for cause the address to be sent to a cast device for retrieval and playback of the certain media by the cast device.
23. The method of claim 1, wherein the mobile device comprises one of a computer having wireless capability, a cellular telephone, or a personal digital assistant (PDA) having wireless capability.
24. The portable electronic device of claim 9, wherein the first wireless communication interface and the second wireless communication interface are different communication interfaces.
25. The portable electronic device of claim 9, wherein the portable electronic device comprises one of a computer having wireless capability, a cellular telephone, or a personal digital assistant (PDA) having wireless capability.
26. The portable electronic device of claim 9, wherein the received data, associated with the requested media, does not include control or instructional data associated with controlling the operational parameter of the one of the multiple different room devices.
US14/259,834 2014-04-23 2014-04-23 Mobile device controlled dynamic room environment using a cast device Abandoned US20150312648A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US14/259,834 US20150312648A1 (en) 2014-04-23 2014-04-23 Mobile device controlled dynamic room environment using a cast device
US15/351,589 US10390078B2 (en) 2014-04-23 2016-11-15 Mobile device controlled dynamic room environment using a cast device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US14/259,834 US20150312648A1 (en) 2014-04-23 2014-04-23 Mobile device controlled dynamic room environment using a cast device

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/351,589 Continuation US10390078B2 (en) 2014-04-23 2016-11-15 Mobile device controlled dynamic room environment using a cast device

Publications (1)

Publication Number Publication Date
US20150312648A1 true US20150312648A1 (en) 2015-10-29

Family

ID=54336038

Family Applications (2)

Application Number Title Priority Date Filing Date
US14/259,834 Abandoned US20150312648A1 (en) 2014-04-23 2014-04-23 Mobile device controlled dynamic room environment using a cast device
US15/351,589 Active 2034-08-24 US10390078B2 (en) 2014-04-23 2016-11-15 Mobile device controlled dynamic room environment using a cast device

Family Applications After (1)

Application Number Title Priority Date Filing Date
US15/351,589 Active 2034-08-24 US10390078B2 (en) 2014-04-23 2016-11-15 Mobile device controlled dynamic room environment using a cast device

Country Status (1)

Country Link
US (2) US20150312648A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160226999A1 (en) * 2015-02-03 2016-08-04 Google Inc. Interoperability of discovery and connection protocols between client devices and first screen devices
US20170171496A1 (en) * 2015-12-15 2017-06-15 Le Holdings (Beijing) Co., Ltd. Method and Electronic Device for Screen Projection
US10999331B1 (en) 2016-07-06 2021-05-04 Google Llc Reverse discovery and pairing of client devices to a media device
US20210258635A1 (en) * 2020-02-14 2021-08-19 Intel Corporation Move stream content from point to point over the existing IP Gateway
US11115449B2 (en) * 2018-11-19 2021-09-07 AIRMONT DataCast SAS Data casting
US11184364B2 (en) * 2018-01-09 2021-11-23 Cisco Technology, Inc. Localized, proximity-based media streaming
US11550527B2 (en) * 2019-03-28 2023-01-10 Hisense Visual Technology Co., Ltd. Media file processing method for display device and display device
US11695982B2 (en) * 2018-12-04 2023-07-04 Samsung Electronics Co., Ltd Content casting method and electronic device therefor

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3448046A1 (en) * 2017-08-23 2019-02-27 Vestel Elektronik Sanayi ve Ticaret A.S. Method for controlling of external devices in dependency of video and/or audio content
US12295081B2 (en) 2022-01-06 2025-05-06 Comcast Cable Communications, Llc Video display environmental lighting

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100071535A1 (en) * 2006-10-31 2010-03-25 Koninklijke Philips Electronics N.V. Control of light in response to an audio signal
US20140267906A1 (en) * 2013-03-13 2014-09-18 Echostar Technologies L.L.C. Enhanced experience from standard program content

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003089100A1 (en) * 2002-04-22 2003-10-30 Intellocity Usa, Inc. Method and apparatus for data receiver and controller
GB0211898D0 (en) * 2002-05-23 2002-07-03 Koninkl Philips Electronics Nv Controlling ambient light
US20070061725A1 (en) * 2005-03-17 2007-03-15 Isaac Emad S System and method for managing content between devices having different capabilities
EP2005801A1 (en) * 2006-03-31 2008-12-24 Koninklijke Philips Electronics N.V. Combined video and audio based ambient lighting control
US8035320B2 (en) * 2007-04-20 2011-10-11 Sibert W Olin Illumination control network
TW200935972A (en) * 2007-11-06 2009-08-16 Koninkl Philips Electronics Nv Light management system with automatic identification of light effects available for a home entertainment system
EP2297944A2 (en) * 2008-06-04 2011-03-23 Koninklijke Philips Electronics N.V. Ambient illumination system, display device and method of generating an illumination variation and method of providing a data service
WO2010007988A1 (en) * 2008-07-15 2010-01-21 シャープ株式会社 Data transmission device, method for transmitting data, audio-visual environment control device, audio-visual environment control system, and method for controlling audio-visual environment
US20130198786A1 (en) * 2011-12-07 2013-08-01 Comcast Cable Communications, LLC. Immersive Environment User Experience
US8928811B2 (en) * 2012-10-17 2015-01-06 Sony Corporation Methods and systems for generating ambient light effects based on video content

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100071535A1 (en) * 2006-10-31 2010-03-25 Koninklijke Philips Electronics N.V. Control of light in response to an audio signal
US20140267906A1 (en) * 2013-03-13 2014-09-18 Echostar Technologies L.L.C. Enhanced experience from standard program content

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160226999A1 (en) * 2015-02-03 2016-08-04 Google Inc. Interoperability of discovery and connection protocols between client devices and first screen devices
US9992307B2 (en) * 2015-02-03 2018-06-05 Google Llc Interoperability of discovery and connection protocols between client devices and first screen devices
US20180288193A1 (en) * 2015-02-03 2018-10-04 Google Llc Interoperability of discovery and connection protocols between client devices and first screen devices
US10771592B2 (en) * 2015-02-03 2020-09-08 Google Llc Interoperability of discovery and connection protocols between client devices and first screen devices
US20170171496A1 (en) * 2015-12-15 2017-06-15 Le Holdings (Beijing) Co., Ltd. Method and Electronic Device for Screen Projection
US10999331B1 (en) 2016-07-06 2021-05-04 Google Llc Reverse discovery and pairing of client devices to a media device
US11991221B1 (en) 2016-07-06 2024-05-21 Google Llc Reverse discovery and pairing of client devices to a media device
US11368500B1 (en) 2016-07-06 2022-06-21 Google Llc Reverse discovery and pairing of client devices to a media device
US11184364B2 (en) * 2018-01-09 2021-11-23 Cisco Technology, Inc. Localized, proximity-based media streaming
US11115449B2 (en) * 2018-11-19 2021-09-07 AIRMONT DataCast SAS Data casting
US11695982B2 (en) * 2018-12-04 2023-07-04 Samsung Electronics Co., Ltd Content casting method and electronic device therefor
US11550527B2 (en) * 2019-03-28 2023-01-10 Hisense Visual Technology Co., Ltd. Media file processing method for display device and display device
US11917237B2 (en) * 2020-02-14 2024-02-27 Intel Corporation Move stream content from point to point over the existing IP gateway
US20210258635A1 (en) * 2020-02-14 2021-08-19 Intel Corporation Move stream content from point to point over the existing IP Gateway
US20240171813A1 (en) * 2020-02-14 2024-05-23 Intel Corporation Move stream content from point to point over the existing IP Gateway
US12301928B2 (en) * 2020-02-14 2025-05-13 Intel Corporation Move stream content from point to point over the existing IP gateway

Also Published As

Publication number Publication date
US20170064381A1 (en) 2017-03-02
US10390078B2 (en) 2019-08-20

Similar Documents

Publication Publication Date Title
US10390078B2 (en) Mobile device controlled dynamic room environment using a cast device
US20240323639A1 (en) Dynamic positional audio
US11489748B2 (en) Generating playback configurations based on aggregated crowd-sourced statistics
KR102154800B1 (en) Data streaming method of electronic apparatus and electronic apparatus thereof
US20190327526A1 (en) Device setting adjustment based on content recognition
EP3955584A1 (en) Digital media system
KR102354952B1 (en) System and method for output display generation based on ambient conditions
US20160110414A1 (en) Information searching apparatus and control method thereof
CN113950687A (en) Media presentation device control based on trained network model
CN103929662A (en) Electronic Apparatus And Method Of Controlling The Same
US20220303735A1 (en) Providing a summary of media content to a communication device
WO2020135499A1 (en) Image quality adjustment method, television set, and readable storage medium
CN105280160A (en) Method for adjusting the screen luminance of terminal, and terminal equipment
US9875694B2 (en) Smoothing brightness transition during channel change
EP4274387B1 (en) Selecting entertainment lighting devices based on dynamicity of video content
KR102550435B1 (en) Auto set picture mode for each media
CN103731649A (en) Image color temperature adjusting device and method and smart television
US20180285358A1 (en) Media recommendations based on media presentation attributes
US12067955B2 (en) Personalized color temperature adaptation for consumer display devices
WO2020144196A1 (en) Determining a light effect based on a light effect parameter specified by a user for other content taking place at a similar location
US20150074274A1 (en) Multiple devices and a method for accessing content using the same
Schäer et al. Picking Best Suited Smart Device to Provide Response to a Query

Legal Events

Date Code Title Description
AS Assignment

Owner name: VERIZON PATENT AND LICENSING INC., NEW JERSEY

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ZHANG, GONG;HUANG, JIAN;MEHTA, GAURAV D.;AND OTHERS;REEL/FRAME:032740/0179

Effective date: 20140423

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION