US20150312648A1 - Mobile device controlled dynamic room environment using a cast device - Google Patents
Mobile device controlled dynamic room environment using a cast device Download PDFInfo
- Publication number
- US20150312648A1 US20150312648A1 US14/259,834 US201414259834A US2015312648A1 US 20150312648 A1 US20150312648 A1 US 20150312648A1 US 201414259834 A US201414259834 A US 201414259834A US 2015312648 A1 US2015312648 A1 US 2015312648A1
- Authority
- US
- United States
- Prior art keywords
- media
- control signals
- room
- mobile device
- devices
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 230000008859 change Effects 0.000 claims abstract description 24
- 238000004891 communication Methods 0.000 claims abstract description 15
- 238000004458 analytical method Methods 0.000 claims description 23
- 238000000034 method Methods 0.000 claims description 15
- 238000004378 air conditioning Methods 0.000 claims description 9
- 230000007423 decrease Effects 0.000 claims description 7
- 230000001413 cellular effect Effects 0.000 claims description 4
- 230000008569 process Effects 0.000 description 7
- 238000007405 data analysis Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000010438 heat treatment Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
- H04N21/41265—The peripheral being portable, e.g. PDAs or mobile phones having a remote control device for bidirectional communication between the remote control device and client device
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4131—Peripherals receiving signals from specially adapted client devices home appliance, e.g. lighting, air conditioning system, metering devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/418—External card to be used in combination with the client device, e.g. for conditional access
- H04N21/4183—External card to be used in combination with the client device, e.g. for conditional access providing its own processing capabilities, e.g. external module for video decoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/61—Network physical structure; Signal processing
- H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
- H04N21/6131—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via a mobile phone network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8166—Monomedia components thereof involving executable data, e.g. software
- H04N21/8173—End-user applications, e.g. Web browser, game
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8166—Monomedia components thereof involving executable data, e.g. software
- H04N21/8186—Monomedia components thereof involving executable data, e.g. software specially adapted to be executed by a peripheral of the client device, e.g. by a reprogrammable remote control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
- H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL
Definitions
- Cast devices such as Chromecast or Airplay devices, typically plug into a port of a television (TV).
- a mobile application executed on a mobile device such as a smartphone, tablet, or laptop, sends a user's favorite TV shows, movies, music and other media content to the TV via the cast device. While the media content is streaming to the TV via the cast device, the user can continue to use the mobile device as a second screen device for searching, browsing, or other user activity.
- FIGS. 1-3 depict an exemplary network environment in which different implementations enable a mobile device to dynamically control a room environment based on media content being delivered to a display device by a cast device;
- FIG. 4 is a diagram that depicts exemplary components of a device that may correspond to the mobile device, the cast device, and/or the display device of FIGS. 1-3 ;
- FIG. 5 depicts exemplary implementations for controlling parameters of a room device of FIGS. 1-3 based on a media/media data analysis performed by the mobile device of FIGS. 1-3 ;
- FIG. 6 depicts an exemplary data structure that may be stored in a memory or storage device of the mobile device or the cast device of FIGS. 1-3 ;
- FIG. 7 is a flow diagram that illustrates an exemplary process for controlling operational parameters associated with devices in a room environment based on the content of media delivered to a display device via a cast device.
- FIGS. 1-3 depict different implementations of an exemplary network environment 100 in which a mobile device dynamically controls a room environment based on media content being delivered by a cast device to a display device.
- Network environment 100 may include a cast device 105 , a mobile device 110 , a room environment 115 , a network 130 , and a wireless network 135 .
- room environment 115 may include a display device 120 and one or more room devices 125 - 1 through 125 - n.
- Cast device 105 may include a device, such as a Chromecast or Airplay device, that plugs into a port of display device 120 and which plays digital media (e.g., streamed audio, video or image content) on display device 120 .
- Cast device 105 may receive media content, or an address (e.g., link) to retrieve the media content, from mobile device 110 so that cast device 105 may stream the media content to display device 120 .
- the media content may include, for example, television (TV) shows, movies, music and/or other video, audio or image media content.
- Cast device 105 may include wired or wireless communication interfaces for communicating with display device 120 , mobile device 110 , network 130 and/or wireless network 135 .
- cast device 105 may be omitted from network environment 100 , and, instead, display device 120 may include a SmartTV that performs functions described herein as being performed by cast device 105 .
- cast device 105 may also be omitted from network environment 100 and, instead, the functions described herein as being performed by cast device 105 may be performed by a set-top box (STB) (connected to display device 120 and further connected to network 130 ), or by a dongle connected to display device 120 .
- STB set-top box
- display device 120 and mobile device 110 may be connected within a same Wi-Fi network.
- Mobile device 110 may include a portable electronic device, having wireless communication capabilities, that may communicate with wireless network 135 , network 130 , cast device 105 and/or room devices 125 - 1 through 125 - n .
- Mobile device 110 may include, for example, a laptop, palmtop or tablet computer having wireless capability; a cellular telephone (e.g., a “smart” phone); or a personal digital assistant (PDA) having wireless capability.
- Mobile device 110 may be carried and operated by a user 150 , who may be located within, or outside of, room environment 115 (shown outside in FIGS. 1-3 ).
- User 150 may use mobile device 110 for additional functions other than control of operational parameters associated with room devices 125 of room environment 115 .
- user 150 may use mobile device 110 for web browsing.
- Mobile device 110 may execute a room environment application that implements the room device control process of FIG. 7 (below). The room environment application may be downloaded from a source in network 130 .
- Display device 120 may include a device having audio, video and image displaying capabilities. Display device 120 may include, for example, a TV or monitor. Display device 120 may include a port for connecting to cast device 105 . In some implementations, display device 120 may additionally, or alternatively, include a sound system device that connects to one or more room devices 125 that each includes a speaker.
- Room devices 125 - 1 through 125 - n may include devices located within room environment 115 .
- Each of room devices 125 - 1 through 125 - n may have an internal device control unit, or an external device control unit, to which mobile device 110 can send respective control signals 155 - 1 through 155 - n via, for example, Wi-Fi or BlueTooth, to control operational parameters of room devices 125 - 1 through 125 - n .
- one or more of room devices 125 - 1 through 125 - n may connect to network 130 and/or wireless network 135 .
- Room devices 125 - 1 through 125 - n may include, for example, an air conditioning unit, a fan, an audio speaker, a light, or a hot tub.
- Network 130 may include one or more different types of networks including, for example, a Public Switched Telephone Network (PSTN), a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), an intranet, the Internet, or a cable network (e.g., an optical cable network).
- Wireless network 135 may include a satellite network, a Public Land Mobile Network (PLMN), or a wireless LAN or WAN (e.g., Wi-Fi).
- PLMN Public Land Mobile Network
- wireless network 135 may be replaced by a wireless network access point (e.g., a wireless router) that connects to network 130 , and mobile device 110 may communicate directly with network 130 via the wireless network access point, avoiding the use of wireless network 135 .
- a wireless network access point e.g., a wireless router
- network environment 100 may include additional, fewer and/or different components that may be configured in a different arrangement than those depicted in FIGS. 1-3 .
- network environment 100 may include any number of mobile devices 110 , room environments 115 , display devices 120 , and/or cast devices 105 .
- participants, other than user 150 may be present in room environment 115 during playback of media at cast device 105 and display device 120 .
- Each of the participants may, or may not, have a mobile device 110 of their own for controlling one or more room devices 125 in room environment 115 .
- mobile device 110 may receive content media 140 from a media source in network 130 and may then forward the content media 140 to cast device 105 for streaming to display device 120 .
- content media 140 may be delivered to mobile device 110 via network 130 and wireless network 135 .
- mobile device 110 may perform a media analysis 145 upon the content media 140 , and may further forward content media 140 to cast device 105 via, for example, a wireless connection.
- cast device 105 may stream content media 140 to display device 120 .
- mobile device 110 may send one or more control signals 155 - 1 through 155 - n to respective ones of room devices 125 - 1 through 125 - n in room environment 115 to change operational parameters associated with the room devices 125 . For example, if a room device 125 includes a light, mobile device 110 may send a control signal to room device 125 that increases or decreases the intensity of the light based on the media content analyzed at mobile device 110 .
- content media 140 may be delivered via network 130 to mobile device 110 and to cast device 105 , without any intervening forwarding of content media 140 via mobile device 110 to cast device 105 as in the implementation of FIG. 1 .
- mobile device 110 may provide a link to media to cast device 105 , and cast device 105 , using the link, may obtain content media 140 from a media source (e.g., a content provider) via network 130 .
- a media source e.g., a content provider
- Mobile device 110 may also obtain the same content media 140 from the media source via network 130 and wireless network 135 .
- cast device 105 may stream content media 140 to display device 120 .
- mobile device 110 may perform a media analysis 145 upon the content media 140 . Based on the results of the media analysis 145 , mobile device 110 may send one or more control signals 155 - 1 through 155 - n to respective ones of room devices 125 - 1 through 125 - n in room environment 115 to change operational parameters associated with the room devices 125 . For example, if a room device 125 includes an air conditioning or heating unit, mobile device 110 may send a control signal to room device 125 that increases or decreases the temperature of the air circulated through room device 125 .
- cast device 105 or display device 120 may, based on content media 140 streamed via network 130 , provide media data 160 to mobile device 110 .
- the media data 160 may include data that identifies particular characteristics of content media 140 that mobile device 110 may use in an analysis.
- Mobile device 110 may provide an address (e.g., a link) for the media to cast device 105 , and cast device 105 , using the link, may obtain content media 140 from a content provider 130 via network 130 .
- cast device 105 may stream content media 140 to display device 120 .
- Cast device 105 may additionally extract specific characteristics from content media 140 and provide those characteristics as media data 160 to mobile device 110 .
- display device 120 may extract the specific characteristics from content media 140 and provide those characteristics as media data 160 to mobile device 110 .
- mobile device 110 may perform a media data analysis 165 upon the media data 160 . Based on the results of the media data analysis 165 , mobile device 110 may send one or more control signals 155 - 1 through 155 - n to respective ones of room devices 125 - 1 through 125 - n in room environment 115 to change operational parameters associated with the room devices 125 . For example, if a room device 125 includes audio speakers, mobile device 110 may send a control signal to room device 125 that increases or decreases the volume of the audio generated by the speakers.
- FIG. 4 is a diagram that depicts exemplary components of a device 400 .
- Mobile device 110 , cast device 105 and display device 120 may each have the same or similar components in a same or similar configuration to that shown in FIG. 4 .
- Device 400 may include a bus 410 , a processing unit 420 , a main memory 430 , a read only memory (ROM) 440 , a storage device 450 , an input device(s) 460 , an output device(s) 470 , and a communication interface(s) 480 .
- Bus 410 may include a path that permits communication among the elements of device 400 .
- Processing unit 420 may include one or more processors or microprocessors, or processing logic, which may interpret and execute instructions.
- Main memory 430 may include a random access memory (RAM) or another type of dynamic storage device that may store information and instructions for execution by processing unit 420 .
- ROM 440 may include a ROM device or another type of static storage device that may store static information and instructions for use by processing unit 420 .
- Storage device 450 may include a magnetic and/or optical recording medium.
- Main memory 430 , ROM 440 and storage device 450 may each be referred to herein as a “tangible non-transitory computer-readable medium.”
- Input device 460 may include one or more mechanisms that permit an operator (or user) to input information to device 400 , such as, for example, a keypad or a keyboard, a display with a touch sensitive panel, voice recognition and/or biometric mechanisms, etc.
- Output device 470 may include one or more mechanisms that output information to the operator, including a display, a speaker, etc.
- Communication interface(s) 480 may include a transceiver that enables device 400 to communicate with other devices and/or systems.
- communication interface(s) 480 may include wired or wireless transceivers for communicating via networks 130 or 135 .
- Communication interface(s) 480 may include a cellular network transceiver, a BlueTooth transceiver, and/or a Wi-Fi transceiver.
- device 400 may include additional, fewer and/or different components, or differently arranged components, than those depicted in FIG. 4 .
- FIG. 5 depicts exemplary implementations for controlling parameters of a room device 125 based on a media/media data analysis performed by mobile device 110 .
- room device 125 may include an internal device control unit 500 , an external device control unit 510 connected externally and directly to room device 125 (e.g., via a port such as a Universal Serial Bus (USB) port), and/or an external device control unit 520 connected externally and via a power cord 530 to a power outlet 540 .
- mobile device 110 may perform an analysis 145 of media or media data and, based on the analysis, may generate one or more control signals 155 for controlling operational parameters associated with room device 125 .
- USB Universal Serial Bus
- room device 125 includes internal device control unit 500
- mobile device 110 may send one or more control signals to control unit 500 and, based on the one or more control signals, control unit 500 may control instructed operational parameters of room device 125 .
- room device 125 includes external device control unit 510
- mobile device 110 may send one or more control signals to control unit 510 and, based on the one or more control signals, control unit 510 may send instruction signals via an input port to room device 125 to control one or more operational parameters.
- room device 125 has a power cord 530 that connects to power outlet 540 via external device control unit 520 , then mobile device 110 may send one or more control signals to control unit 520 and, based on the one or more control signals, control unit 520 may control the power supplied to room device 125 from power outlet 540 . For example, control unit 520 may decrease the power supplied to room device 125 , or turn off the supply of power from power outlet 540 entirely.
- FIG. 6 depicts an exemplary data structure 600 that may be stored in memory 430 or storage device 450 of mobile device 110 or cast device 105 .
- Data structure 600 may include multiple entries 610 , each of which may include a time field 620 , an analyzed media attribute(s) field(s) 630 , and controlled device parameter fields 640 - 1 through 640 - m (where m is an integer greater than or equal to 1).
- Data structure 600 may be associated with an item of media (e.g., a video).
- Each item of media analyzed by mobile device 110 may have its own data structure 600 .
- the values stored in the fields of each entry 610 of data structure 600 may be manually entered, automatically pre-loaded, or populated based on the analysis performed by mobile device 110 .
- Time field 620 may store a time stamp, or a range of time, associated with the media corresponding to data structure 600 .
- mobile device 110 may perform an analysis of the media over a period of time of 3 minutes, running from five minutes (00:05:00) from the start of the media to eight minutes (00:08:00) from the start of the media.
- Analyzed media attribute(s) field(s) 630 may comprise one or more fields that each stores data indicating a value for an attribute for the media associated with data structure 600 . For example, if mobile device 110 analyzes the color of the media, then field(s) 630 may store a determined color RGB value (e.g., red, green, blue) for the media.
- RGB value e.g., red, green, blue
- Controlled device parameter fields 640 - 1 through 640 - m may each store a target value for controlling a respective operational parameter of a room device 125 .
- field 640 - 1 may store a value indicating “high speed” or “low speed” for instructing room device 125 , that includes a fan, to change its fan speed to a high speed or a low speed.
- field 640 - m may store a specific temperature value for instructing room device 125 , that includes an air conditioning unit, to change its temperature setting to the temperature value indicated in field 640 - m.
- each controlled device parameter field 640 may additionally be paired with a room device identifier (ID) field that identifies a particular room device 125 in room environment 115 whose operational parameter(s) identified in the corresponding filed 640 is to be controlled.
- ID room device identifier
- FIG. 7 is a flow diagram that illustrates an exemplary process for controlling operational parameters associated with devices 125 in a room environment 115 based on the content of media delivered to a display device via a cast device.
- the exemplary process of FIG. 7 may be implemented by mobile device 110 .
- the exemplary process of FIG. 7 is described below with reference to FIGS. 1-3 .
- the exemplary process of FIG. 7 may be implemented with a delay between the analysis of the media, and the streaming of the media for playback by cast device 105 and display device 120 .
- the delay permits the performance of blocks 730 , 740 and 750 prior to the streaming of the media for playback at display device 120 .
- the exemplary process may include mobile device 110 requesting selected media (block 700 ).
- Mobile device 110 may request media from a media source (e.g., content server) connected to network 130 .
- a media source e.g., content server
- One of alternative blocks 710 , 715 or 720 may then be performed based on a particular one of the implementations of FIGS. 1-3 being implemented.
- mobile device 110 may receive the delivered media from the content server and may send the media to the cast device (block 710 ).
- media 140 may be delivered (e.g., streamed) from the content server via network 130 and wireless network 135 , and received at mobile device 110 .
- Mobile device 110 may, in turn, stream media 140 to cast device 105 .
- mobile device 110 may receive the delivered media from the media source, and may send an address associated with the media to the cast device (block 715 ).
- media 140 may be delivered (e.g., streamed) from the media source via network 130 and wireless network 135 , and mobile device 110 may send an address (e.g., a link at the content server) to cast device 105 such that cast device 105 may obtain the media from the media source.
- the media delivered from the content server may additionally include an address at the media source at which the media may be obtained from cast device 105 .
- mobile device 110 may send an address associated with the media to the cast device, and may receive media data from the cast device (block 720 ).
- the content server may deliver (e.g., stream) media 140 to cast device 105 based on an address (e.g., link) received from mobile device 110 .
- Cast device 105 may extract relevant characteristics from the obtained media and send the extracted characteristics as media data 160 to mobile device 110 .
- Mobile device 110 may perform an analysis of the content of the media, or of the media data received from cast device 105 (block 730 ). Mobile device 110 may perform an analysis that identifies movement (e.g., an individual running) in the scene if the media is video; identifies one or more colors in the scene, or a brightness of the scene, if the media is video or an image(s); or identifies a sound volume if the media is video or audio. In some implementations, mobile device 110 may employ more sophisticated analysis algorithms that can perform image/video analysis to, for example, identify actions occurring in the scene (e.g., a quarterback passing a football, a car crashing, etc.). In other implementations, mobile device 110 may employ speech analysis algorithms to recognize the content of speech (i.e., what is being said) when the media is audio or video.
- movement e.g., an individual running
- mobile device 110 may employ more sophisticated analysis algorithms that can perform image/video analysis to, for example, identify actions occurring in the scene (e.g., a quarterback
- Mobile device 110 may determine parameter(s) of a selected room device(s) to change based on the performed analysis (block 740 ). Mobile device 110 may select more or more room devices 125 in room environment 115 and may determine which parameter(s) of the selected devices are to be changed. For example, mobile device 110 may identify room devices 125 - 1 through 125 - n as including a light, an air conditioning unit, and a set of speakers connected to display device 120 , and may select the light for the changing of parameters. With the light being selected, mobile device 110 may change one or more various operational parameters of the light: 1) on/off; 2) intensity of light (dimness or brightness); or 3) a strobe effect. As another example, mobile device 110 may select the air conditioning unit for the changing of parameters.
- mobile device 110 may change one or more operational parameters of the AC unit: 1) on/off; 2) fan speed (high or low); or 3) temperature (cold or hot).
- mobile device 110 may index data structure 600 for the item of media with the current playback time (or time range) and an analyzed media attribute to identify an entry 610 having a same time or time range value in time field 620 and a same analyzed attribute value in field 630 .
- Mobile device 110 may then retrieve the values from fields 640 - 1 through 640 - m for the identified entry 610 to identify the room devices 125 , and the respective operational parameters for each of the identified room devices, that are to be changed.
- Mobile device 110 may send control signal(s) to the selected room device(s) to implement a change(s) in the determine parameter(s) (block 750 ).
- Mobile device 110 may send an appropriate control signal 155 to a selected room device 125 to cause the room device 125 to change the selected operational parameter.
- mobile device 110 may wirelessly transmit (e.g., via Bluetooth or Wi-Fi) a control signal 155 to a room device 125 that includes a set of speakers.
- the control signal 155 may increase the volume of the set of speakers.
- Blocks 710 - 750 may be selectively repeated until the media finishes and is no longer being played back at display device 120 . Therefore, the operational parameters of room devices 125 - 1 through 125 - n in room environment 115 may change throughout media playback based on the analyzed content of the media.
- This logic or unit may include hardware, such as one or more processors, microprocessors, application specific integrated circuits, or field programmable gate arrays, software, or a combination of hardware and software.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Automation & Control Theory (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
A mobile device analyzes data associated with media handled by a cast device connected to a display device. The mobile device causes control signals to be sent, via the one or more communication interfaces, to one of multiple different devices in a room to change an operational parameter associated with the one of the multiple different devices.
Description
- Cast devices, such as Chromecast or Airplay devices, typically plug into a port of a television (TV). A mobile application executed on a mobile device, such as a smartphone, tablet, or laptop, sends a user's favorite TV shows, movies, music and other media content to the TV via the cast device. While the media content is streaming to the TV via the cast device, the user can continue to use the mobile device as a second screen device for searching, browsing, or other user activity.
-
FIGS. 1-3 depict an exemplary network environment in which different implementations enable a mobile device to dynamically control a room environment based on media content being delivered to a display device by a cast device; -
FIG. 4 is a diagram that depicts exemplary components of a device that may correspond to the mobile device, the cast device, and/or the display device ofFIGS. 1-3 ; -
FIG. 5 depicts exemplary implementations for controlling parameters of a room device ofFIGS. 1-3 based on a media/media data analysis performed by the mobile device ofFIGS. 1-3 ; -
FIG. 6 depicts an exemplary data structure that may be stored in a memory or storage device of the mobile device or the cast device ofFIGS. 1-3 ; and -
FIG. 7 is a flow diagram that illustrates an exemplary process for controlling operational parameters associated with devices in a room environment based on the content of media delivered to a display device via a cast device. - The following detailed description refers to the accompanying drawings. The same reference numbers in different drawings may identify the same or similar elements. The following detailed description does not limit the invention.
-
FIGS. 1-3 depict different implementations of anexemplary network environment 100 in which a mobile device dynamically controls a room environment based on media content being delivered by a cast device to a display device.Network environment 100 may include acast device 105, amobile device 110, aroom environment 115, anetwork 130, and awireless network 135. As further shown inFIG. 1 ,room environment 115 may include adisplay device 120 and one or more room devices 125-1 through 125-n. -
Cast device 105 may include a device, such as a Chromecast or Airplay device, that plugs into a port ofdisplay device 120 and which plays digital media (e.g., streamed audio, video or image content) ondisplay device 120.Cast device 105 may receive media content, or an address (e.g., link) to retrieve the media content, frommobile device 110 so thatcast device 105 may stream the media content to displaydevice 120. The media content may include, for example, television (TV) shows, movies, music and/or other video, audio or image media content.Cast device 105 may include wired or wireless communication interfaces for communicating withdisplay device 120,mobile device 110,network 130 and/orwireless network 135. In alternative embodiments,cast device 105 may be omitted fromnetwork environment 100, and, instead,display device 120 may include a SmartTV that performs functions described herein as being performed bycast device 105. In still further alternative embodiments,cast device 105 may also be omitted fromnetwork environment 100 and, instead, the functions described herein as being performed bycast device 105 may be performed by a set-top box (STB) (connected todisplay device 120 and further connected to network 130), or by a dongle connected todisplay device 120. In these alternative embodiments,display device 120 andmobile device 110 may be connected within a same Wi-Fi network. -
Mobile device 110 may include a portable electronic device, having wireless communication capabilities, that may communicate withwireless network 135,network 130,cast device 105 and/or room devices 125-1 through 125-n.Mobile device 110 may include, for example, a laptop, palmtop or tablet computer having wireless capability; a cellular telephone (e.g., a “smart” phone); or a personal digital assistant (PDA) having wireless capability.Mobile device 110 may be carried and operated by auser 150, who may be located within, or outside of, room environment 115 (shown outside inFIGS. 1-3 ).User 150 may usemobile device 110 for additional functions other than control of operational parameters associated withroom devices 125 ofroom environment 115. For example,user 150 may usemobile device 110 for web browsing.Mobile device 110 may execute a room environment application that implements the room device control process ofFIG. 7 (below). The room environment application may be downloaded from a source innetwork 130. -
Display device 120 may include a device having audio, video and image displaying capabilities.Display device 120 may include, for example, a TV or monitor.Display device 120 may include a port for connecting tocast device 105. In some implementations,display device 120 may additionally, or alternatively, include a sound system device that connects to one ormore room devices 125 that each includes a speaker. - Room devices 125-1 through 125-n may include devices located within
room environment 115. Each of room devices 125-1 through 125-n may have an internal device control unit, or an external device control unit, to whichmobile device 110 can send respective control signals 155-1 through 155-n via, for example, Wi-Fi or BlueTooth, to control operational parameters of room devices 125-1 through 125-n. Though not depicted inFIGS. 1-3 , one or more of room devices 125-1 through 125-n may connect tonetwork 130 and/orwireless network 135. Room devices 125-1 through 125-n may include, for example, an air conditioning unit, a fan, an audio speaker, a light, or a hot tub. -
Network 130 may include one or more different types of networks including, for example, a Public Switched Telephone Network (PSTN), a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), an intranet, the Internet, or a cable network (e.g., an optical cable network).Wireless network 135 may include a satellite network, a Public Land Mobile Network (PLMN), or a wireless LAN or WAN (e.g., Wi-Fi). In one implementation,wireless network 135 may be replaced by a wireless network access point (e.g., a wireless router) that connects tonetwork 130, andmobile device 110 may communicate directly withnetwork 130 via the wireless network access point, avoiding the use ofwireless network 135. - The configuration of network components of
network environment 100 illustrated inFIG. 1 (andFIGS. 2-3 below) is for illustrative purposes. Other configurations may be implemented. Therefore,network environment 100 may include additional, fewer and/or different components that may be configured in a different arrangement than those depicted inFIGS. 1-3 . For example,network environment 100 may include any number ofmobile devices 110,room environments 115,display devices 120, and/orcast devices 105. Though not shown inFIGS. 1-3 , participants, other thanuser 150, may be present inroom environment 115 during playback of media atcast device 105 anddisplay device 120. Each of the participants may, or may not, have amobile device 110 of their own for controlling one ormore room devices 125 inroom environment 115. - In the implementation depicted in
FIG. 1 ,mobile device 110 may receivecontent media 140 from a media source innetwork 130 and may then forward thecontent media 140 to castdevice 105 for streaming to displaydevice 120. As shown inFIG. 1 ,content media 140 may be delivered tomobile device 110 vianetwork 130 andwireless network 135. Upon receipt ofcontent media 140,mobile device 110 may perform amedia analysis 145 upon thecontent media 140, and may furtherforward content media 140 to castdevice 105 via, for example, a wireless connection. Upon receipt,cast device 105 may streamcontent media 140 to displaydevice 120. Based on the results of themedia analysis 145,mobile device 110 may send one or more control signals 155-1 through 155-n to respective ones of room devices 125-1 through 125-n inroom environment 115 to change operational parameters associated with theroom devices 125. For example, if aroom device 125 includes a light,mobile device 110 may send a control signal toroom device 125 that increases or decreases the intensity of the light based on the media content analyzed atmobile device 110. - In the implementation depicted in
FIG. 2 ,content media 140 may be delivered vianetwork 130 tomobile device 110 and to castdevice 105, without any intervening forwarding ofcontent media 140 viamobile device 110 to castdevice 105 as in the implementation ofFIG. 1 . In the implementation ofFIG. 2 ,mobile device 110 may provide a link to media to castdevice 105, and castdevice 105, using the link, may obtaincontent media 140 from a media source (e.g., a content provider) vianetwork 130.Mobile device 110 may also obtain thesame content media 140 from the media source vianetwork 130 andwireless network 135. Upon receipt ofcontent media 140 vianetwork 130,cast device 105 may streamcontent media 140 to displaydevice 120. - As shown in
FIG. 2 , upon receipt ofcontent media 140,mobile device 110 may perform amedia analysis 145 upon thecontent media 140. Based on the results of themedia analysis 145,mobile device 110 may send one or more control signals 155-1 through 155-n to respective ones of room devices 125-1 through 125-n inroom environment 115 to change operational parameters associated with theroom devices 125. For example, if aroom device 125 includes an air conditioning or heating unit,mobile device 110 may send a control signal toroom device 125 that increases or decreases the temperature of the air circulated throughroom device 125. - In the implementation depicted in
FIG. 3 ,cast device 105 ordisplay device 120 may, based oncontent media 140 streamed vianetwork 130, providemedia data 160 tomobile device 110. Themedia data 160 may include data that identifies particular characteristics ofcontent media 140 thatmobile device 110 may use in an analysis.Mobile device 110 may provide an address (e.g., a link) for the media to castdevice 105, and castdevice 105, using the link, may obtaincontent media 140 from acontent provider 130 vianetwork 130. - Upon receipt of
content media 140 vianetwork 130,cast device 105 may streamcontent media 140 to displaydevice 120.Cast device 105 may additionally extract specific characteristics fromcontent media 140 and provide those characteristics asmedia data 160 tomobile device 110. Alternatively, upon receipt ofcontent media 140 fromcast device 105,display device 120 may extract the specific characteristics fromcontent media 140 and provide those characteristics asmedia data 160 tomobile device 110. - Upon receipt of
media data 160,mobile device 110 may perform amedia data analysis 165 upon themedia data 160. Based on the results of themedia data analysis 165,mobile device 110 may send one or more control signals 155-1 through 155-n to respective ones of room devices 125-1 through 125-n inroom environment 115 to change operational parameters associated with theroom devices 125. For example, if aroom device 125 includes audio speakers,mobile device 110 may send a control signal toroom device 125 that increases or decreases the volume of the audio generated by the speakers. -
FIG. 4 is a diagram that depicts exemplary components of adevice 400.Mobile device 110, castdevice 105 anddisplay device 120 may each have the same or similar components in a same or similar configuration to that shown inFIG. 4 .Device 400 may include abus 410, aprocessing unit 420, amain memory 430, a read only memory (ROM) 440, astorage device 450, an input device(s) 460, an output device(s) 470, and a communication interface(s) 480.Bus 410 may include a path that permits communication among the elements ofdevice 400. -
Processing unit 420 may include one or more processors or microprocessors, or processing logic, which may interpret and execute instructions.Main memory 430 may include a random access memory (RAM) or another type of dynamic storage device that may store information and instructions for execution by processingunit 420.ROM 440 may include a ROM device or another type of static storage device that may store static information and instructions for use by processingunit 420.Storage device 450 may include a magnetic and/or optical recording medium.Main memory 430,ROM 440 andstorage device 450 may each be referred to herein as a “tangible non-transitory computer-readable medium.” -
Input device 460 may include one or more mechanisms that permit an operator (or user) to input information todevice 400, such as, for example, a keypad or a keyboard, a display with a touch sensitive panel, voice recognition and/or biometric mechanisms, etc.Output device 470 may include one or more mechanisms that output information to the operator, including a display, a speaker, etc. Communication interface(s) 480 may include a transceiver that enablesdevice 400 to communicate with other devices and/or systems. For example, communication interface(s) 480 may include wired or wireless transceivers for communicating via 130 or 135. Communication interface(s) 480 may include a cellular network transceiver, a BlueTooth transceiver, and/or a Wi-Fi transceiver.networks - The configuration of components of
device 400 illustrated inFIG. 4 is for illustrative purposes only. Other configurations may be implemented. Therefore,device 400 may include additional, fewer and/or different components, or differently arranged components, than those depicted inFIG. 4 . -
FIG. 5 depicts exemplary implementations for controlling parameters of aroom device 125 based on a media/media data analysis performed bymobile device 110. As depicted inFIG. 5 ,room device 125 may include an internaldevice control unit 500, an externaldevice control unit 510 connected externally and directly to room device 125 (e.g., via a port such as a Universal Serial Bus (USB) port), and/or an externaldevice control unit 520 connected externally and via apower cord 530 to apower outlet 540. As described with respect toFIGS. 1-3 above,mobile device 110 may perform ananalysis 145 of media or media data and, based on the analysis, may generate one ormore control signals 155 for controlling operational parameters associated withroom device 125. Ifroom device 125 includes internaldevice control unit 500,mobile device 110 may send one or more control signals to controlunit 500 and, based on the one or more control signals,control unit 500 may control instructed operational parameters ofroom device 125. Ifroom device 125 includes externaldevice control unit 510,mobile device 110 may send one or more control signals to controlunit 510 and, based on the one or more control signals,control unit 510 may send instruction signals via an input port toroom device 125 to control one or more operational parameters. Ifroom device 125 has apower cord 530 that connects topower outlet 540 via externaldevice control unit 520, thenmobile device 110 may send one or more control signals to controlunit 520 and, based on the one or more control signals,control unit 520 may control the power supplied toroom device 125 frompower outlet 540. For example,control unit 520 may decrease the power supplied toroom device 125, or turn off the supply of power frompower outlet 540 entirely. -
FIG. 6 depicts anexemplary data structure 600 that may be stored inmemory 430 orstorage device 450 ofmobile device 110 or castdevice 105.Data structure 600 may includemultiple entries 610, each of which may include atime field 620, an analyzed media attribute(s) field(s) 630, and controlled device parameter fields 640-1 through 640-m (where m is an integer greater than or equal to 1).Data structure 600 may be associated with an item of media (e.g., a video). Each item of media analyzed bymobile device 110 may have itsown data structure 600. The values stored in the fields of eachentry 610 ofdata structure 600 may be manually entered, automatically pre-loaded, or populated based on the analysis performed bymobile device 110. -
Time field 620 may store a time stamp, or a range of time, associated with the media corresponding todata structure 600. For example,mobile device 110 may perform an analysis of the media over a period of time of 3 minutes, running from five minutes (00:05:00) from the start of the media to eight minutes (00:08:00) from the start of the media. - Analyzed media attribute(s) field(s) 630 may comprise one or more fields that each stores data indicating a value for an attribute for the media associated with
data structure 600. For example, ifmobile device 110 analyzes the color of the media, then field(s) 630 may store a determined color RGB value (e.g., red, green, blue) for the media. - Controlled device parameter fields 640-1 through 640-m may each store a target value for controlling a respective operational parameter of a
room device 125. For example, field 640-1 may store a value indicating “high speed” or “low speed” for instructingroom device 125, that includes a fan, to change its fan speed to a high speed or a low speed. As another example, field 640-m may store a specific temperature value for instructingroom device 125, that includes an air conditioning unit, to change its temperature setting to the temperature value indicated in field 640-m. - The number, types, and content of the entries and/or fields in
data structure 600 inFIG. 6 are for illustrative purposes. Other types of data structures having different numbers of, types of and/or content of, the entries and/or the fields may be implemented. Therefore,data structure 600 may include additional, fewer and/or different entries and/or fields than those depicted inFIG. 6 . For example, each controlleddevice parameter field 640 may additionally be paired with a room device identifier (ID) field that identifies aparticular room device 125 inroom environment 115 whose operational parameter(s) identified in the corresponding filed 640 is to be controlled. -
FIG. 7 is a flow diagram that illustrates an exemplary process for controlling operational parameters associated withdevices 125 in aroom environment 115 based on the content of media delivered to a display device via a cast device. The exemplary process ofFIG. 7 may be implemented bymobile device 110. The exemplary process ofFIG. 7 is described below with reference toFIGS. 1-3 . In one embodiment, the exemplary process ofFIG. 7 may be implemented with a delay between the analysis of the media, and the streaming of the media for playback bycast device 105 anddisplay device 120. The delay permits the performance of 730, 740 and 750 prior to the streaming of the media for playback atblocks display device 120. - The exemplary process may include
mobile device 110 requesting selected media (block 700).Mobile device 110 may request media from a media source (e.g., content server) connected to network 130. One of 710, 715 or 720 may then be performed based on a particular one of the implementations ofalternative blocks FIGS. 1-3 being implemented. In the implementation ofFIG. 1 ,mobile device 110 may receive the delivered media from the content server and may send the media to the cast device (block 710). Referring toFIG. 1 ,media 140 may be delivered (e.g., streamed) from the content server vianetwork 130 andwireless network 135, and received atmobile device 110.Mobile device 110 may, in turn,stream media 140 to castdevice 105. - In the implementation of
FIG. 2 ,mobile device 110 may receive the delivered media from the media source, and may send an address associated with the media to the cast device (block 715). Referring toFIG. 2 ,media 140 may be delivered (e.g., streamed) from the media source vianetwork 130 andwireless network 135, andmobile device 110 may send an address (e.g., a link at the content server) to castdevice 105 such that castdevice 105 may obtain the media from the media source. The media delivered from the content server may additionally include an address at the media source at which the media may be obtained fromcast device 105. - In the implementation of
FIG. 3 ,mobile device 110 may send an address associated with the media to the cast device, and may receive media data from the cast device (block 720). Referring toFIG. 3 , the content server may deliver (e.g., stream)media 140 to castdevice 105 based on an address (e.g., link) received frommobile device 110.Cast device 105 may extract relevant characteristics from the obtained media and send the extracted characteristics asmedia data 160 tomobile device 110. -
Mobile device 110 may perform an analysis of the content of the media, or of the media data received from cast device 105 (block 730).Mobile device 110 may perform an analysis that identifies movement (e.g., an individual running) in the scene if the media is video; identifies one or more colors in the scene, or a brightness of the scene, if the media is video or an image(s); or identifies a sound volume if the media is video or audio. In some implementations,mobile device 110 may employ more sophisticated analysis algorithms that can perform image/video analysis to, for example, identify actions occurring in the scene (e.g., a quarterback passing a football, a car crashing, etc.). In other implementations,mobile device 110 may employ speech analysis algorithms to recognize the content of speech (i.e., what is being said) when the media is audio or video. -
Mobile device 110 may determine parameter(s) of a selected room device(s) to change based on the performed analysis (block 740).Mobile device 110 may select more ormore room devices 125 inroom environment 115 and may determine which parameter(s) of the selected devices are to be changed. For example,mobile device 110 may identify room devices 125-1 through 125-n as including a light, an air conditioning unit, and a set of speakers connected to displaydevice 120, and may select the light for the changing of parameters. With the light being selected,mobile device 110 may change one or more various operational parameters of the light: 1) on/off; 2) intensity of light (dimness or brightness); or 3) a strobe effect. As another example,mobile device 110 may select the air conditioning unit for the changing of parameters. With the air conditioning unit being selected,mobile device 110 may change one or more operational parameters of the AC unit: 1) on/off; 2) fan speed (high or low); or 3) temperature (cold or hot). In one embodiment,mobile device 110 may indexdata structure 600 for the item of media with the current playback time (or time range) and an analyzed media attribute to identify anentry 610 having a same time or time range value intime field 620 and a same analyzed attribute value infield 630.Mobile device 110 may then retrieve the values from fields 640-1 through 640-m for the identifiedentry 610 to identify theroom devices 125, and the respective operational parameters for each of the identified room devices, that are to be changed. -
Mobile device 110 may send control signal(s) to the selected room device(s) to implement a change(s) in the determine parameter(s) (block 750).Mobile device 110 may send anappropriate control signal 155 to a selectedroom device 125 to cause theroom device 125 to change the selected operational parameter. For example,mobile device 110 may wirelessly transmit (e.g., via Bluetooth or Wi-Fi) acontrol signal 155 to aroom device 125 that includes a set of speakers. Thecontrol signal 155 may increase the volume of the set of speakers. - Blocks 710-750, for an item of requested media, may be selectively repeated until the media finishes and is no longer being played back at
display device 120. Therefore, the operational parameters of room devices 125-1 through 125-n inroom environment 115 may change throughout media playback based on the analyzed content of the media. - The foregoing description of implementations provides illustration and description, but is not intended to be exhaustive or to limit the invention to the precise form disclosed. Modifications and variations are possible in light of the above teachings or may be acquired from practice of the invention. For example, while a series of blocks has been described with respect to
FIG. 7 , the order of the blocks may be varied in other implementations. Moreover, non-dependent blocks may be performed in parallel. - Certain features described above may be implemented as “logic” or a “unit” that performs one or more functions. This logic or unit may include hardware, such as one or more processors, microprocessors, application specific integrated circuits, or field programmable gate arrays, software, or a combination of hardware and software.
- No element, act, or instruction used in the description of the present application should be construed as critical or essential to the invention unless explicitly described as such. Also, as used herein, the article “a” is intended to include one or more items. Further, the phrase “based on” is intended to mean “based, at least in part, on” unless explicitly stated otherwise.
- In the preceding specification, various preferred embodiments have been described with reference to the accompanying drawings. It will, however, be evident that various modifications and changes may be made thereto, and additional embodiments may be implemented, without departing from the broader scope of the invention as set forth in the claims that follow. The specification and drawings are accordingly to be regarded in an illustrative rather than restrictive sense.
Claims (25)
1. A method, comprising:
receiving, at a mobile device, data associated with certain media;
analyzing, by the mobile device, the data associated with the certain media, wherein the certain media comprises audio or video media and wherein analyzing the data comprises
recognizing a content of speech within the audio or video media;
determining, by the mobile device, at least one parameter associated with one or more devices in a room environment to change based on the analysis; and
sending, from the mobile device, control signals to the one or more devices to cause the at least one parameter to be changed.
2. The method of claim 1 , wherein the data associated with the certain media comprises the certain media in streaming form and further comprising:
streaming, from the mobile device to a cast device, the certain media for media playback.
3. The method of claim 1 , wherein the data associated with the certain media comprises an address associated with the certain media and the certain media in streaming form and further comprising:
sending, from the mobile device to a cast device, the address for retrieval and playback of the certain media by the cast device.
4. The method of claim 1 , wherein the data associated with certain media comprises the certain media in streaming form.
5. The method of claim 1 , wherein the data identifies one or more characteristics of the certain media determined by a cast device.
6. (canceled)
7. The method of claim 1 , further comprising:
selecting, by the mobile device, the one or more devices from among a plurality of room devices in the room environment,
wherein determining the at least one parameter associated with the one or more devices to change comprises:
selecting the at least one parameter associated with the one or more devices based on results of the analysis.
8. The method of claim 1 , wherein the control signals to the one or more devices comprise at least one of:
control signals to increase or decrease a brightness of a device comprising a light;
control signals to change a color of a device comprising a light;
control signals to change air temperature of a device comprising an air conditioning unit; and
control signals to change a volume or quality of sound of a device comprising a speaker.
9. A portable electronic device, comprising:
a first wireless communication interface configured to:
download, via a source in an external network, a room environment application,
send a request to receive media from a network media source in the external network, and
receive, responsive to the request, data associated with the requested media, wherein the requested media is streamed from the network media source subsequent to receiving the request;
a second wireless communication interface configured to communicate via a wireless local area network (LAN) or a wireless personal area network (PAN); and
a processing unit configured to execute the downloaded room environment application to:
analyze, subsequent to sending the request to receive the media from the network media source and subsequent to the requested media being streamed from the network media source, the data associated with the requested media, wherein the requested media comprises audio or video media and wherein analyzing the data associated with the requested media comprises:
identifying actions occurring within a scene of the video media,
identifying movement within a scene contained in the video media, or
recognizing a content of speech within the audio or video media, and
cause control signals to be sent, via the second wireless communication interface, to one of multiple different room devices within a room environment to change an operational parameter associated with the one of the multiple different room devices based on the analysis of the data associated with the requested media.
10. (canceled)
11. The portable electronic device of claim 9 , wherein the data associated with the requested media comprises the requested media in streaming form and wherein the processing unit is further configured to execute the room environment application to:
receive, via the first wireless communication interface, the requested media from the network media source, and
stream, from the portable electronic device to a cast device, the requested media for media playback.
12. The portable electronic device of claim 9 , wherein the processing unit is further configured to execute the room environment application to:
send, via the first or second wireless interface, to a cast device, an address for retrieval and playback of the requested media by the cast device.
13. The portable electronic device of claim 9 , wherein the data associated with the requested media comprises the requested media in streaming form.
14. The portable electronic device of claim 9 , wherein the data identifies one or more characteristics of the requested media determined by a cast device.
15. The portable electronic device of claim 9 , wherein the processing unit is further configured to execute the room environment application to:
select the one of the multiple different room devices from among a plurality of room devices currently residing in the room environment,
wherein the processing unit is further configured to execute the room environment application to:
select the operational parameter associated with the one of the multiple different room devices based on results of the analysis.
16. The portable electronic device of claim 9 , wherein the control signals to the one of the multiple different room devices comprise at least one of:
control signals to increase or decrease a brightness of a device comprising a light;
control signals to change a color of a device comprising a light;
control signals to change air temperature of a device comprising an air conditioning unit; or
control signals to change a volume or quality of sound of a device comprising a speaker.
17. A non-transitory computer-readable medium containing instructions executable by at least one processor, the computer-readable medium comprising:
one or more instructions for receiving data associated with certain media;
one or more instructions for analyzing the data associated with the certain media, wherein the certain media comprises audio or video media:
one or more instructions for identifying room devices currently residing in a room environment;
one or more instructions for selecting one or more current room devices from the identified current room devices based on the analysis;
one or more instructions for selecting parameters of the selected one or more current room devices to be controlled based on the analysis;
one or more instructions for determining target values for the selected parameters of the selected one or more current room devices based on the analysis;
one or more instructions for populating a database with the determined target values for the selected parameters of the selected one or more current room devices; and
one or more instructions for retrieving the determined target values for the selected parameters of the selected one or more current room devices from the database and causing control signals to be sent to the selected one or more current room devices to cause the selected parameter to be changed based on the determined target values.
18. The non-transitory computer-readable medium of claim 17 , wherein the data associated with the certain media comprises the certain media in streaming form and further comprising:
one or more instructions for causing the certain media to be streamed to a cast device for media playback.
19-20. (canceled)
21. The non-transitory computer-readable medium of claim 17 , wherein the control signals to be sent to the selected one or more current room devices comprise at least one of:
control signals to increase or decrease a brightness of a device comprising a light;
control signals to change a color of a device comprising a light;
control signals to change air temperature of a device comprising an air conditioning unit; or
control signals to change a volume or quality of sound of a device comprising a speaker.
22. The non-transitory computer-readable medium of claim 17 , wherein the data associated with the certain media comprises an address associated with the certain media and the certain media in streaming form and further comprising:
one or more instructions for cause the address to be sent to a cast device for retrieval and playback of the certain media by the cast device.
23. The method of claim 1 , wherein the mobile device comprises one of a computer having wireless capability, a cellular telephone, or a personal digital assistant (PDA) having wireless capability.
24. The portable electronic device of claim 9 , wherein the first wireless communication interface and the second wireless communication interface are different communication interfaces.
25. The portable electronic device of claim 9 , wherein the portable electronic device comprises one of a computer having wireless capability, a cellular telephone, or a personal digital assistant (PDA) having wireless capability.
26. The portable electronic device of claim 9 , wherein the received data, associated with the requested media, does not include control or instructional data associated with controlling the operational parameter of the one of the multiple different room devices.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US14/259,834 US20150312648A1 (en) | 2014-04-23 | 2014-04-23 | Mobile device controlled dynamic room environment using a cast device |
| US15/351,589 US10390078B2 (en) | 2014-04-23 | 2016-11-15 | Mobile device controlled dynamic room environment using a cast device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US14/259,834 US20150312648A1 (en) | 2014-04-23 | 2014-04-23 | Mobile device controlled dynamic room environment using a cast device |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US15/351,589 Continuation US10390078B2 (en) | 2014-04-23 | 2016-11-15 | Mobile device controlled dynamic room environment using a cast device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| US20150312648A1 true US20150312648A1 (en) | 2015-10-29 |
Family
ID=54336038
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US14/259,834 Abandoned US20150312648A1 (en) | 2014-04-23 | 2014-04-23 | Mobile device controlled dynamic room environment using a cast device |
| US15/351,589 Active 2034-08-24 US10390078B2 (en) | 2014-04-23 | 2016-11-15 | Mobile device controlled dynamic room environment using a cast device |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US15/351,589 Active 2034-08-24 US10390078B2 (en) | 2014-04-23 | 2016-11-15 | Mobile device controlled dynamic room environment using a cast device |
Country Status (1)
| Country | Link |
|---|---|
| US (2) | US20150312648A1 (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160226999A1 (en) * | 2015-02-03 | 2016-08-04 | Google Inc. | Interoperability of discovery and connection protocols between client devices and first screen devices |
| US20170171496A1 (en) * | 2015-12-15 | 2017-06-15 | Le Holdings (Beijing) Co., Ltd. | Method and Electronic Device for Screen Projection |
| US10999331B1 (en) | 2016-07-06 | 2021-05-04 | Google Llc | Reverse discovery and pairing of client devices to a media device |
| US20210258635A1 (en) * | 2020-02-14 | 2021-08-19 | Intel Corporation | Move stream content from point to point over the existing IP Gateway |
| US11115449B2 (en) * | 2018-11-19 | 2021-09-07 | AIRMONT DataCast SAS | Data casting |
| US11184364B2 (en) * | 2018-01-09 | 2021-11-23 | Cisco Technology, Inc. | Localized, proximity-based media streaming |
| US11550527B2 (en) * | 2019-03-28 | 2023-01-10 | Hisense Visual Technology Co., Ltd. | Media file processing method for display device and display device |
| US11695982B2 (en) * | 2018-12-04 | 2023-07-04 | Samsung Electronics Co., Ltd | Content casting method and electronic device therefor |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3448046A1 (en) * | 2017-08-23 | 2019-02-27 | Vestel Elektronik Sanayi ve Ticaret A.S. | Method for controlling of external devices in dependency of video and/or audio content |
| US12295081B2 (en) | 2022-01-06 | 2025-05-06 | Comcast Cable Communications, Llc | Video display environmental lighting |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100071535A1 (en) * | 2006-10-31 | 2010-03-25 | Koninklijke Philips Electronics N.V. | Control of light in response to an audio signal |
| US20140267906A1 (en) * | 2013-03-13 | 2014-09-18 | Echostar Technologies L.L.C. | Enhanced experience from standard program content |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2003089100A1 (en) * | 2002-04-22 | 2003-10-30 | Intellocity Usa, Inc. | Method and apparatus for data receiver and controller |
| GB0211898D0 (en) * | 2002-05-23 | 2002-07-03 | Koninkl Philips Electronics Nv | Controlling ambient light |
| US20070061725A1 (en) * | 2005-03-17 | 2007-03-15 | Isaac Emad S | System and method for managing content between devices having different capabilities |
| EP2005801A1 (en) * | 2006-03-31 | 2008-12-24 | Koninklijke Philips Electronics N.V. | Combined video and audio based ambient lighting control |
| US8035320B2 (en) * | 2007-04-20 | 2011-10-11 | Sibert W Olin | Illumination control network |
| TW200935972A (en) * | 2007-11-06 | 2009-08-16 | Koninkl Philips Electronics Nv | Light management system with automatic identification of light effects available for a home entertainment system |
| EP2297944A2 (en) * | 2008-06-04 | 2011-03-23 | Koninklijke Philips Electronics N.V. | Ambient illumination system, display device and method of generating an illumination variation and method of providing a data service |
| WO2010007988A1 (en) * | 2008-07-15 | 2010-01-21 | シャープ株式会社 | Data transmission device, method for transmitting data, audio-visual environment control device, audio-visual environment control system, and method for controlling audio-visual environment |
| US20130198786A1 (en) * | 2011-12-07 | 2013-08-01 | Comcast Cable Communications, LLC. | Immersive Environment User Experience |
| US8928811B2 (en) * | 2012-10-17 | 2015-01-06 | Sony Corporation | Methods and systems for generating ambient light effects based on video content |
-
2014
- 2014-04-23 US US14/259,834 patent/US20150312648A1/en not_active Abandoned
-
2016
- 2016-11-15 US US15/351,589 patent/US10390078B2/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100071535A1 (en) * | 2006-10-31 | 2010-03-25 | Koninklijke Philips Electronics N.V. | Control of light in response to an audio signal |
| US20140267906A1 (en) * | 2013-03-13 | 2014-09-18 | Echostar Technologies L.L.C. | Enhanced experience from standard program content |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160226999A1 (en) * | 2015-02-03 | 2016-08-04 | Google Inc. | Interoperability of discovery and connection protocols between client devices and first screen devices |
| US9992307B2 (en) * | 2015-02-03 | 2018-06-05 | Google Llc | Interoperability of discovery and connection protocols between client devices and first screen devices |
| US20180288193A1 (en) * | 2015-02-03 | 2018-10-04 | Google Llc | Interoperability of discovery and connection protocols between client devices and first screen devices |
| US10771592B2 (en) * | 2015-02-03 | 2020-09-08 | Google Llc | Interoperability of discovery and connection protocols between client devices and first screen devices |
| US20170171496A1 (en) * | 2015-12-15 | 2017-06-15 | Le Holdings (Beijing) Co., Ltd. | Method and Electronic Device for Screen Projection |
| US10999331B1 (en) | 2016-07-06 | 2021-05-04 | Google Llc | Reverse discovery and pairing of client devices to a media device |
| US11991221B1 (en) | 2016-07-06 | 2024-05-21 | Google Llc | Reverse discovery and pairing of client devices to a media device |
| US11368500B1 (en) | 2016-07-06 | 2022-06-21 | Google Llc | Reverse discovery and pairing of client devices to a media device |
| US11184364B2 (en) * | 2018-01-09 | 2021-11-23 | Cisco Technology, Inc. | Localized, proximity-based media streaming |
| US11115449B2 (en) * | 2018-11-19 | 2021-09-07 | AIRMONT DataCast SAS | Data casting |
| US11695982B2 (en) * | 2018-12-04 | 2023-07-04 | Samsung Electronics Co., Ltd | Content casting method and electronic device therefor |
| US11550527B2 (en) * | 2019-03-28 | 2023-01-10 | Hisense Visual Technology Co., Ltd. | Media file processing method for display device and display device |
| US11917237B2 (en) * | 2020-02-14 | 2024-02-27 | Intel Corporation | Move stream content from point to point over the existing IP gateway |
| US20210258635A1 (en) * | 2020-02-14 | 2021-08-19 | Intel Corporation | Move stream content from point to point over the existing IP Gateway |
| US20240171813A1 (en) * | 2020-02-14 | 2024-05-23 | Intel Corporation | Move stream content from point to point over the existing IP Gateway |
| US12301928B2 (en) * | 2020-02-14 | 2025-05-13 | Intel Corporation | Move stream content from point to point over the existing IP gateway |
Also Published As
| Publication number | Publication date |
|---|---|
| US20170064381A1 (en) | 2017-03-02 |
| US10390078B2 (en) | 2019-08-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10390078B2 (en) | Mobile device controlled dynamic room environment using a cast device | |
| US20240323639A1 (en) | Dynamic positional audio | |
| US11489748B2 (en) | Generating playback configurations based on aggregated crowd-sourced statistics | |
| KR102154800B1 (en) | Data streaming method of electronic apparatus and electronic apparatus thereof | |
| US20190327526A1 (en) | Device setting adjustment based on content recognition | |
| EP3955584A1 (en) | Digital media system | |
| KR102354952B1 (en) | System and method for output display generation based on ambient conditions | |
| US20160110414A1 (en) | Information searching apparatus and control method thereof | |
| CN113950687A (en) | Media presentation device control based on trained network model | |
| CN103929662A (en) | Electronic Apparatus And Method Of Controlling The Same | |
| US20220303735A1 (en) | Providing a summary of media content to a communication device | |
| WO2020135499A1 (en) | Image quality adjustment method, television set, and readable storage medium | |
| CN105280160A (en) | Method for adjusting the screen luminance of terminal, and terminal equipment | |
| US9875694B2 (en) | Smoothing brightness transition during channel change | |
| EP4274387B1 (en) | Selecting entertainment lighting devices based on dynamicity of video content | |
| KR102550435B1 (en) | Auto set picture mode for each media | |
| CN103731649A (en) | Image color temperature adjusting device and method and smart television | |
| US20180285358A1 (en) | Media recommendations based on media presentation attributes | |
| US12067955B2 (en) | Personalized color temperature adaptation for consumer display devices | |
| WO2020144196A1 (en) | Determining a light effect based on a light effect parameter specified by a user for other content taking place at a similar location | |
| US20150074274A1 (en) | Multiple devices and a method for accessing content using the same | |
| Schäer et al. | Picking Best Suited Smart Device to Provide Response to a Query |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: VERIZON PATENT AND LICENSING INC., NEW JERSEY Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ZHANG, GONG;HUANG, JIAN;MEHTA, GAURAV D.;AND OTHERS;REEL/FRAME:032740/0179 Effective date: 20140423 |
|
| STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |