JP2011010084A - Home network system and communication method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain a home network system, capable of performing overlay display of information regarding the state and the operation of electronic apparatus which is connected to the home network for broadcasting the content, in a video display device.SOLUTION: The home network system 1 is provided with a communications network 3; a home gateway 4 connected to the communications network 3; television sets 5A, 5B connected to the communications network 3, and capable of displaying the broadcast content and data described in a predetermined markup language; and a plurality of pieces of electronic apparatus connected to the communications network 3. The home gateway 4 acquires electronic apparatus information on the state and/or the operation of the electronic apparatus, and transmits the data described in the predetermined markup language including the electronic apparatus information to the television sets 5A, 5B via the communications network 3. The television sets 5A, 5B perform overlay display of the data received from the home gateway 4 to the broadcast content.

Description

  The present invention relates to a home network system and a communication method thereof.

  With the development of communication technology in recent years, services such as IP broadcasting, IP retransmission, or VOD (Video On Demand), which distribute broadcast content (including video content; the same applies below) via an IP network, have become widespread. It's getting on. In order to use the service, a set-top box is installed on a television in order to receive and decode a broadcast content stream from an IP broadcast station, an IP retransmission station, or a video transmission device such as a VOD server. Connected. It is also possible to display various information distributed by data broadcasting or the like on the broadcast content decoded by the set top box.

  Patent Document 1 listed below discloses a technique related to a digital broadcast retransmission apparatus via an IP network.

  In addition, with the development of network technology in recent years, home network systems for connecting a plurality of network devices such as personal computers and IP phones to each other in homes and offices are becoming widespread. A home gateway device (hereinafter abbreviated as “home gateway”) is connected to the home network system as an interface for connecting a home network and an external network. The home gateway performs transmission / reception of signals between the home network and the external network, protocol conversion, routing, and the like, and also manages and controls various electronic devices connected to the home network.

JP 2007-166409 A

  Consider a case in which information on the state and operation of an electronic device connected to a home network is displayed on a broadcast content as an OSD (On Screen Display) screen. In this case, it is necessary to synthesize the broadcast content and the OSD screen in the set top box after decoding the broadcast content and the signal related to the electronic device information received from the home gateway by the set top box. Therefore, in a home where a plurality of televisions are installed, in order to perform overlay display similar to the above on the plurality of televisions, it is necessary to install a plurality of set-top boxes according to the number of televisions. As a result, the user's economic burden increases.

  The present invention has been made in view of such circumstances, and states and operations of electronic devices connected to a home network even when a set-top box is not connected to each of a plurality of video display devices. It is an object of the present invention to obtain a home network system and a communication method thereof capable of overlaying information on the broadcast content on each video display device.

A home network system according to a first aspect of the present invention includes a communication network, a home gateway connected to the communication network, a broadcast content connected to the communication network, and data described in a predetermined markup language. And a plurality of electronic devices connected to the communication network, the home gateway acquires electronic device information relating to the state and / or operation of the electronic device, and the electronic device Data described in the predetermined markup language including information is transmitted to the video display device via the communication network, and the video display device overlays the data received from the home gateway on the broadcast content. It is characterized by displaying.

  According to the home network system according to the first aspect, the home gateway acquires electronic device information related to the state and / or operation of the electronic device, and includes a predetermined mark that can be displayed by the video display device, including the electronic device information. The data described in the up language is transmitted to the video display device via the communication network. Then, the video display device overlay-displays the data received from the home gateway on the broadcast content. As described above, the data including the electronic device information relating to the state and / or operation of the electronic device is described from the home gateway in the predetermined markup language that can be displayed by the video display device and transmitted. As a result, even when a set-top box is not connected to each of the plurality of video display devices, data including electronic device information relating to the state and / or operation of the electronic device is broadcast to each video display device. Overlay display is possible.

  The home network system according to a second aspect of the present invention is the home network system according to the first aspect, and in particular, the plurality of electronic devices includes an IP phone, and the home gateway receives an incoming call to the IP phone. Obtaining information, and transmitting data described in the predetermined markup language including incoming call notification information to the video display device via the communication network, the video display device received from the home gateway The incoming call notification information is displayed as an overlay on the broadcast content.

  According to the home network system according to the second aspect, the home gateway acquires the incoming information to the IP phone and includes the incoming call notification information, which is described in a predetermined markup language that can be displayed by the video display device. Is transmitted to the video display device via the communication network. Then, the video display device overlay-displays the incoming call notification information received from the home gateway on the broadcast content. As described above, the incoming call notification information related to the IP phone is displayed on the broadcast content in the video display device in an overlay manner, so that the convenience of the user can be improved.

  The home network system according to the third aspect of the present invention is the home network system according to the second aspect, in particular, the IP phone has a videophone function, and the home gateway transmits from a communication partner terminal. The communication partner's video that has been transmitted is acquired, the video of the communication partner is described in the predetermined markup language, and transmitted to the video display device via the communication network. The video of the communication partner received from the gateway is displayed as an overlay on the broadcast content.

  According to the home network system according to the third aspect, the home gateway acquires the image of the communication partner transmitted from the communication partner terminal, and the video display device can display the video of the communication partner. It is described in a markup language and transmitted to the video display device via the communication network. The video display device overlay-displays the video of the communication partner received from the home gateway on the broadcast content. As described above, the user's convenience can be improved by overlaying the video of the communication partner on the broadcast content on the video display device.

  A home network system according to a fourth aspect of the present invention is the home network system according to the first aspect, in particular, the plurality of electronic devices include doorphones, and the home gateway is a call switch of the doorphone. The press information is acquired, and the data described in the predetermined markup language including the visitor notification information is transmitted to the video display device via the communication network, and the video display device receives from the home gateway The visitor notification information is displayed as an overlay on the broadcast content.

  According to the home network system of the fourth aspect, the home gateway is described in a predetermined markup language that can be displayed by the video display device, including information on pressing the call switch of the door phone and including visitor notification information. The transmitted data is transmitted to the video display device via the communication network. Then, the video display device displays the visitor notification information received from the home gateway in an overlay manner on the broadcast content. As described above, by displaying the visitor notification information on the broadcast content in the video display device, the convenience of the user can be improved.

  The home network system according to a fifth aspect of the present invention is the home network system according to the fourth aspect, in particular, the doorphone has a photographing function for photographing a visitor, and the home gateway is connected to the doorphone. The video of the visitor that has been transmitted is acquired, the video of the visitor is described in the predetermined markup language, and transmitted to the video display device via the communication network. The video of the visitor received from the home gateway is overlaid on the broadcast content.

  According to the home network system according to the fifth aspect, the home gateway acquires the video of the visitor transmitted from the door phone, and the predetermined markup language in which the video display device can display the video of the visitor. And transmitted to the video display device via the communication network. Then, the video display device overlays the video of the visitor received from the home gateway on the broadcast content. As described above, the user's convenience can be improved by overlaying the video of the visitor on the broadcast content on the video display device.

  The home network system according to a sixth aspect of the present invention is the home network system according to the first aspect, in particular, the plurality of electronic devices include sensor devices, and the home gateway is an abnormality from the sensor devices. The detection information is acquired, the data described in the predetermined markup language including the abnormality notification information is transmitted to the video display device via the communication network, and the video display device is received from the home gateway. The abnormality notification information is displayed as an overlay on the broadcast content.

  According to the home network system according to the sixth aspect, the home gateway acquires the abnormality detection information from the sensor device, and is described in a predetermined markup language that can be displayed by the video display device, including the abnormality notification information. Data is transmitted to the video display device via the communication network. Then, the video display device overlay-displays the abnormality notification information received from the home gateway on the broadcast content. As described above, by displaying the abnormality notification information on the broadcast content on the video display device, the convenience of the user can be improved.

A communication method according to a seventh aspect of the present invention includes a communication network, a home gateway connected to the communication network, broadcast content connected to the communication network, and data described in a predetermined markup language, Is a communication method in a home network system having a video display device capable of displaying an image and a plurality of electronic devices connected to the communication network, wherein (A) electronic device information relating to the state and / or operation of the electronic device is displayed. (B) acquiring the data described in the predetermined markup language including the electronic device information acquired in the step (A) from the home gateway via the communication network; Transmitting to the video display device; (C) in the video display device; And it is characterized in that it comprises a step of overlaying displays the data received in the broadcast content from the home gateway.

  According to the communication method according to the seventh aspect, in step (A), the home gateway acquires electronic device information related to the state and / or operation of the electronic device, and in step (B), the home gateway acquires the electronic device information. The data described in a predetermined markup language that can be displayed by the video display device is transmitted to the video display device via the communication network. In step (C), the video display device overlay-displays the data including the electronic device information received from the home gateway on the broadcast content. As described above, the data including the electronic device information relating to the state and / or operation of the electronic device is described from the home gateway in the predetermined markup language that can be displayed by the video display device and transmitted. As a result, even when a set-top box is not connected to each of the plurality of video display devices, data including electronic device information relating to the state and / or operation of the electronic device is broadcast to each video display device. Overlay display is possible.

  According to the present invention, even when a set-top box is not connected to each of a plurality of video display devices, information regarding the state and operation of an electronic device connected to the home network is stored in each video display device. It is possible to display an overlay on broadcast content.

It is a figure which shows the structure of the home network system which concerns on embodiment of this invention. It is a figure which shows the function structure of a home gateway. It is a figure which shows the other structure of the home network system which concerns on embodiment of this invention. It is a front view which shows the external appearance of a television. It is a figure which shows an example of a start menu. It is a figure which shows an example of a start menu. It is a front view which shows the external appearance of a television. It is a figure which shows an example of a start menu. It is a front view which shows the external appearance of a television. It is a figure which shows an example of a start menu. It is a front view which shows the external appearance of a television.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, the element which attached | subjected the same code | symbol in different drawing shall show the same or corresponding element.

FIG. 1 is a diagram showing a configuration of a home network system 1 according to an embodiment of the present invention. A communication network 3 such as a wired LAN (Local Area Network) is laid in the user's house 2. However, the communication network 3 may be a wireless LAN. In the example shown in FIG. 1, the communication network 3 includes a home gateway 4, televisions 5A and 5B, camera / microphone units 6A and 6B, an IP (Internet Protocol) telephone 7A, a door phone 7B with a camera, a security sensor 7C, and A personal computer 7D is connected. The camera / microphone units 6A and 6B are installed corresponding to the televisions 5A and 5B, respectively. The televisions 5A and 5B are Web-compatible digital televisions. In addition to broadcast signals in a predetermined compression encoding format (for example, MPEG-2), BML (Broadcast Markup Language) and / or HTML (Hyper Text Markup Language) marks Can process data written in up-language. In the house 2, a mobile phone 8 used by the user is located. When the mobile phone 8 is capable of wireless communication with the home gateway 4 and the mobile phone 8 is located within the communication range of the home gateway 4 (when the mobile phone 8 is generally located within the house 2), the mobile phone 8 The telephone 8 can be used as a handset of the IP telephone 7A. The mobile phone 8 may be a portable handset of the IP phone 7A.

  The home gateway 4 is connected to a communication network 9 such as an IP network laid outside the house 2. An IP broadcast station 15 and an IP phone 16 of another user are connected to the communication network 9. The IP broadcast station 15 may be an IP retransmission transmission station, a VOD (Video On Demand) server, or the like.

  FIG. 2 is a diagram illustrating a functional configuration of the home gateway 4. The home gateway 4 includes a processing unit 20, a reception unit 21, a transmission unit 22, and a storage unit 23. The receiving unit 21 includes a wireless receiving unit 40 and a wired receiving unit 41. The processing unit 20 includes a broadcast signal processing unit 30, a BML / HTML server 31, a SIP (Session Initiation Protocol) server 32, an IP telephone processing unit 33, a door phone processing unit 34, and a sensor processing unit 35. The transmission unit 22 includes a wireless transmission unit 50 and a wired transmission unit 51. However, the SIP server 32 does not necessarily have to be installed in the home gateway 4 and may be connected to the communication network 3 as a separate device from the home gateway 4 as shown in the modification of FIG. . Alternatively, the SIP server 32 may be connected to the communication network 9 outside the house 2.

  Hereinafter, the operation of the home network system 1 according to the present embodiment will be described.

  First, processing when viewing a broadcast program on the televisions 5A and 5B will be described. The wired receiving unit 41 receives video and audio content (hereinafter referred to as “broadcast content”) related to a broadcast program transmitted from the IP broadcast station 15 via the communication network 9. The home gateway 4 is preliminarily taught with information on the compression encoding method that can be processed by the televisions 5A and 5B and information on the screen resolution of the televisions 5A and 5B, and the information is stored in the storage unit 23. Yes. The broadcast signal processing unit 30 converts the compression encoding method (for example, H.264) and the screen resolution of the broadcast content input from the wired reception unit 41 into a compression encoding method (for example, MPEG-2) corresponding to each television 5A, 5B. ) And screen resolution. The wired transmission unit 51 transmits the broadcast content input from the broadcast signal processing unit 30 to the televisions 5A and 5B via the communication network 3. By decoding the broadcast content received from the home gateway 4 by the televisions 5A and 5B, the user can view the broadcast program. Since the home gateway 4 has a plurality of sets of broadcast signal processing units 30, different broadcast contents can be simultaneously viewed on different televisions 5A and 5B.

<Processing related to acquisition of start menu>
FIG. 4 is a front view showing the appearance of the television 5A. The television 5A has a screen 60 and a speaker 6
1. A camera / microphone unit 6A is mounted on the housing of the television 5A. However, the camera / microphone unit 6A may be installed away from the television 5A. On the screen 60, a video (broadcast video) of the broadcast content currently being viewed by the user is displayed. Although not shown, the appearance of the television 5B is the same as that in FIG.

  Identification information (URL or IP address) indicating the location is set in the home gateway 4, and the identification information of the home gateway 4 is taught in advance to the televisions 5A and 5B. The televisions 5A and 5B acquire the start menu from the home gateway 4 by accessing the home gateway 4 periodically (for example, at intervals of several seconds). Specifically, a start menu transmission request from the televisions 5A and 5B is input to the BML / HTML server 31 via the communication network 3 as a signal described in BML or HTML. In the storage unit 23, start menu data described in BML or HTML is stored in advance. The BML / HTML server 31 reads start menu data from the storage unit 23 and transmits the data to the televisions 5 </ b> A and 5 </ b> B via the communication network 3.

  When the TV 5A, 5B receives the start menu data from the home gateway 4, the TV 5A, 5B decodes it if necessary, and then synthesizes it at a predetermined location on the broadcast video, thereby converting the start menu into the broadcast content as an OSD screen. Display an overlay. Each time the televisions 5A and 5B acquire new start menu data from the home gateway 4 by regular access, the start menu displayed on the screen 60 is also updated. The start menu is always displayed at a predetermined location on the screen 60 (lower right corner in the example of FIG. 4). However, instead of always displaying, a pop-up may be displayed when a predetermined event such as an incoming IP phone call occurs.

  FIG. 5 is a diagram illustrating an example of the start menu 70. The start menu 70 displays arbitrary information (electronic device information) such as characters and figures indicating the operation and state of each of the telephone, door phone, and security sensor. In the example shown in FIG. 5, an icon simulating a telephone with a handset, an icon simulating a closed door, and a sine wave waveform corresponding to each of the telephone, door phone, and security sensor. Each icon is displayed. Further, in the start menu 70, detailed buttons are displayed corresponding to each of the telephone, the door phone, and the security sensor. When the user presses the detail button by operating the remote control (or the main body switch; the same applies hereinafter) of the televisions 5A and 5B, the detailed information and operation menu of the corresponding electronic device can be displayed. The image data for displaying the detailed information and the operation menu may be stored in the storage unit 23 of the home gateway 4 or the SIP server 32, the door phone 7B, It is also possible to store the information in the security sensor 7C and transfer it to the televisions 5A and 5B via the home gateway 4.

<Processing related to IP phone>
Next, processing when an incoming IP phone call is received while the user is viewing broadcast content on the television 5A will be described. The wired receiving unit 41 receives the connection request signal transmitted from the IP phone 16 via the communication network 9. When a connection request signal is input from the wired receiver 41, the SIP server 32 transmits a response request signal from the wired transmitter 51 to the IP phone 7A via the communication network 3, thereby generating a ring tone for the IP phone 7A. Sound. In addition, the SIP server 32 sounds a ringtone of the mobile phone 8 by transmitting a response request signal from the wireless transmission unit 51 to the mobile phone 8 in the house 2.

When a connection request signal is input from the wired receiving unit 41, the BML / HTML server 31 stores data of the start menu 70A including predetermined incoming call notification information for notifying the user of an incoming IP phone call. 23. This incoming call notification information is arbitrary information (one of the electronic device information) described in a markup language (in this example, BML or HTML) that can be displayed on the televisions 5A and 5B, such as characters and graphics. When the home gateway 4 next receives a start menu transmission request from the television 5A, the wired transmission unit 51 receives data of the start menu 70A (that is, the start menu including incoming call notification information) input from the BML / HTML server 31. The data is transmitted to the television 5A via the communication network 3. Accordingly, the start menu 70A is displayed on the screen 60 of the television 5A instead of the start menu 70.

  FIG. 6 is a diagram illustrating an example of the start menu 70A. In the start menu 70A, an icon simulating an incoming call (or busy) phone is displayed as incoming call notification information. In the start menu 70A, a response button is displayed next to the incoming call notification information.

  The user can respond to an incoming call (off-hook) by pressing a response button by remote control operation of the television 5A. In this case, the voice of the communication partner is output from the speaker 61 of the television 5A, and the user's own voice is input to the microphone of the camera / microphone unit 6A. Specifically, the wired receiver 41 receives the communication partner's voice signal transmitted from the IP phone 16 via the communication network 9. When an audio signal is input from the wired receiving unit 41, the IP telephone processing unit 33 transmits the audio signal from the wired transmission unit 51 to the television 5 </ b> A via the communication network 3. As a result, the voice of the communication partner is output from the speaker 61. The wired receiving unit 41 receives the user's own audio signal transmitted from the camera / microphone unit 6 </ b> A via the communication network 3. When an audio signal is input from the wired receiving unit 41, the IP telephone processing unit 33 transmits the audio signal from the wired transmission unit 51 to the IP phone 16 via the communication network 9. As a result, the user's own voice is output from the speaker of the IP phone 16.

  Since the audio of the broadcast content is also output from the speaker 61 of the television 5A, the audio of the broadcast content may be input to the microphone of the camera / microphone unit 6A and oscillate. Therefore, the IP telephone processing unit 33 acquires the audio signal of the broadcast content being viewed on the television 5A from the broadcast signal processing unit 30, and obtains the audio signal obtained by multiplying the audio signal of the broadcast content by a predetermined weight value. Then, the obtained audio signal is subtracted from the audio signal input from the microphone of the camera / microphone unit 6A. Thereby, a so-called echo canceller is realized. Here, when determining the weighting value, the IP telephone processing unit 33 inserts a pilot signal having a frequency that cannot be sensed by human hearing into the audio signal of the broadcast content and transmits it. The IP telephone processing unit 33 receives an audio signal input from the microphone of the camera / microphone unit 6A and detects a pilot signal included therein. Then, the weighting value is determined based on the ratio between the level of the transmitted pilot signal and the level of the received pilot signal.

Further, the user can respond to an incoming call (off-hook) with the IP phone 7A, and can also respond to the incoming call with the mobile phone 8. In this case, the voice of the communication partner is output from the speaker of the mobile phone 8, and the user's own voice is input to the microphone of the mobile phone 8. Specifically, the wired receiver 41 receives the communication partner's voice signal transmitted from the IP phone 16 via the communication network 9. When an audio signal is input from the wired reception unit 41, the IP telephone processing unit 33 transmits the audio signal from the wireless transmission unit 50 to the mobile phone 8. As a result, the voice of the communication partner is output from the speaker of the mobile phone 8. Further, the wireless receiving unit 40 receives the user's own voice signal transmitted from the mobile phone 8. When an audio signal is input from the wireless reception unit 40, the IP phone processing unit 33 transmits the audio signal from the wired transmission unit 51 to the IP phone 16 via the communication network 9. As a result, the user's own voice is output from the speaker of the IP phone 16. Even when the mobile phone 8 responds to the incoming call, the voice of the communication partner may be output from the speaker 61 of the television 5A. In this case, the IP telephone processing unit 33 may execute an echo canceller similar to the above based on the audio signal of the broadcast content and the audio signal received from the mobile phone 8.

  When the video of the communication partner (hereinafter referred to as “partner station video”) is transmitted by the videophone function, the user presses the telephone detail button in the start menu 70A by operating the remote control of the TV 5A. Then, by turning on the display of the partner station video in the displayed operation menu, the partner station video can be displayed on the screen 60 of the television 5A. The wired receiver 41 receives the partner station video transmitted from the IP phone 16 via the communication network 9. When the partner station video is input from the wired receiver 41, the BML / HTML server 31 describes the partner station video in a markup language (BML or HTML in this example) that can be displayed on the televisions 5A and 5B. For example, by embedding a script, the partner station video can be described as dynamic content. The wired transmission unit 51 transmits the partner station video described in BML or HTML to the television 5 </ b> A via the communication network 3.

  FIG. 7 is a front view showing the appearance of the television 5A. When receiving the partner station video from the home gateway 4, the television 5 </ b> A overlays the partner station video on the broadcast content as an OSD screen 71 by synthesizing the partner station video at a predetermined location on the broadcast video.

  Furthermore, in the videophone function, the user presses the detail button of the telephone in the start menu 70A by operating the remote control of the TV 5A, and the user's own video (hereinafter referred to as “own station video”) in the displayed operation menu. ) Is set to ON, the local station video can be transmitted to the IP telephone 16 of the communication partner. In this case, by turning on the display of the local station video in the displayed operation menu, not only the local station video but also the local station video can be displayed on the screen 60 of the television 5A. . The local station video is taken by the camera of the camera / microphone unit 6A. The wired receiver 41 receives the local station video transmitted from the camera / microphone unit 6 </ b> A via the communication network 3. When the local station video is input from the wired receiver 41, the BML / HTML server 31 describes the local station video in a markup language (in this example, BML or HTML) that can be displayed on the televisions 5A and 5B. Similar to the counterpart station video, for example, by embedding a script, the local station video can be described as dynamic content. The wired transmission unit 51 transmits the local station video described in BML or HTML to the television 5 </ b> A via the communication network 3.

  Referring to FIG. 7, when receiving the local station video from home gateway 4, television 5 </ b> A synthesizes the local station video at a predetermined location on the broadcast video, and thereby displays the local station video as broadcast content on OSD screen 72. Display an overlay.

When the partner station video and / or own station video is displayed on the television 5A, the following processing is performed when the user wants to switch to the display on the television 5B by moving the room or the like. The user operates the remote control of the television 5A to display the telephone operation menu, and then inputs a password, and stops the display on the television 5A and puts it in a temporary hold state. The password is transmitted from the television 5 </ b> A to the home gateway 4 via the communication network 3 and then stored in the storage unit 23. After moving the room, the user operates the remote control of the television 5B to display the telephone operation menu, and then re-enters the password that was previously input. The password is transmitted from the television 5B to the home gateway 4 via the communication network 3. The IP telephone processing unit 33 compares the password received from the television 5B with the password stored in the storage unit 23, and if the two match, the other station image displayed on the television 5A is determined to be successful. And / or the own station image is displayed on the television 5B. When the communication partner's voice is output from the speaker 61 of the television 5A, the output is switched to the output from the speaker 61 of the television 5B. In addition, switching from the camera / microphone unit 6A to the camera / microphone unit 6B is also performed.

  Next, a description will be given of processing when an IP phone is transmitted (called) while the user is viewing broadcast content on the television 5A.

  The user presses the telephone detail button in the start menu 70 by operating the remote control of the television 5A, presses the call start button in the displayed operation menu, and calls the communication partner (IP phone 16 in the following example). By entering a number or the like, an IP phone call can be made. The wired receiver 41 receives the connection request signal transmitted from the television 5 </ b> A via the communication network 3. When a connection request signal is input from the wired receiver 41, the SIP server 32 transmits a response request signal from the wired transmitter 51 to the IP phone 16 via the communication network 9. Audio signal transmission / reception (including the echo canceller function) after the IP telephone 16 responds and completes the call connection is the same as the process at the time of the incoming call, and thus the repeated description is omitted.

  In addition, the user can make an IP phone call not only by the IP phone 7A but also by the mobile phone 8. When making a call from the mobile phone 8, the telephone number of the communication partner (IP phone 16) can be input using the operation buttons of the mobile phone 8. However, by accessing the home gateway 4 using the browser function of the mobile phone 8, the start menu 70 is displayed on the screen of the mobile phone 8. You may perform input operations such as telephone numbers. The wireless receiving unit 40 receives a connection request signal transmitted from the mobile phone 8. When a connection request signal is input from the wireless reception unit 40, the SIP server 32 transmits a response request signal from the wired transmission unit 51 to the IP phone 16 via the communication network 9. Audio signal transmission / reception (including the echo canceller function) after the IP telephone 16 responds and completes the call connection is the same as the process at the time of the incoming call, and thus the repeated description is omitted.

  Further, the user can transmit the video of the local station to the communication partner (IP phone 16) by operating the remote control of the television 5A. Since the correspondence between each television 5A, 5B and each camera / microphone unit 6A, 6B is previously taught to the home gateway 4 and stored in the storage unit 23, in the case of outgoing from the television 5A, the own station The camera / microphone unit 6A is automatically selected to shoot a video. In the case of a call from the mobile phone 8, one of the camera / microphone units 6 </ b> A and 6 </ b> B can be arbitrarily selected by setting input from the mobile phone 8.

  The wired receiver 41 receives the local station video transmitted from the camera / microphone units 6 </ b> A and 6 </ b> B via the communication network 3. Further, the wired transmission unit 51 transmits the local station video to the IP phone 16 via the communication network 9.

  If the camera / microphone units 6A and 6B do not have a video encoding function, a predetermined compression encoding method (for example, suitable for the communication network 9) is used by using the encoding function of the IP telephone processing unit 33. H.264) may encode the local station video. Similarly to the processing at the time of incoming call, when the partner station image and / or the own station image is displayed on the television 5A, when the user wants to switch to the display on the television 5B by moving the room or the like, The TV and the camera / microphone unit can be switched by the temporary hold process in which the password is set.

<Processing related to door phone>
Next, a process when the call switch of the door phone 7B is pressed by the visitor while the user is viewing the broadcast content on the television 5A will be described. A call switch pressing signal is transmitted from the door phone 7B to the home gateway 4 via the communication network 3. The wired receiving unit 41 receives the press signal transmitted from the door phone 7 </ b> B via the communication network 3. When a pressing signal is input from the wired reception unit 41, the door phone processing unit 34 sounds a predetermined ringing tone from a speaker (not shown) installed in the house 2.

  Further, when a pressing signal is input from the wired receiving unit 41, the BML / HTML server 31 reads from the storage unit 23 data of the start menu 70 </ b> B including predetermined visitor notification information for notifying the user of the visitor. This visitor notification information is arbitrary information (one of the electronic device information) described in a markup language (BML or HTML in this example) that can be displayed on the televisions 5A and 5B, such as characters and figures. When the home gateway 4 next receives a start menu transmission request from the television 5A, the wired transmission unit 51 receives the data of the start menu 70B (that is, the start menu including the visitor notification information) input from the BML / HTML server 31. The data is transmitted to the television 5A via the communication network 3. As a result, the start menu 70B is displayed instead of the start menu 70 on the screen 60 of the television 5A.

  FIG. 8 is a diagram illustrating an example of the start menu 70B. In the start menu 70B, an icon simulating an opened door is displayed as visitor notification information. In the start menu 70B, an answer button is displayed next to the incoming call notification information.

  The user can respond to the visitor by pressing the response button by operating the remote control of the television 5A. In this case, the visitor's voice is output from the speaker 61 of the television 5A, and the user's own voice is input to the microphone of the camera / microphone unit 6A. Specifically, the wired receiving unit 41 receives the visitor's voice signal transmitted from the door phone 7 </ b> B via the communication network 3. When an audio signal is input from the wired reception unit 41, the door phone processing unit 34 transmits the audio signal from the wired transmission unit 51 to the television 5 </ b> A via the communication network 3. Thereby, the voice of the visitor is output from the speaker 61. The wired receiving unit 41 receives the user's own audio signal transmitted from the camera / microphone unit 6 </ b> A via the communication network 3. When an audio signal is input from the wired receiving unit 41, the door phone processing unit 34 transmits the audio signal from the wired transmission unit 51 to the door phone 7 </ b> B via the communication network 3. Thereby, the user's own voice is output from the speaker of the door phone 7B.

  In addition, the user presses the detail button of the doorphone in the start menu 70B by operating the remote controller of the television 5A, and turns on the display of the visitor's video in the displayed operation menu, whereby the camera of the doorphone 7B is turned on. Can be displayed on the screen 60 of the television 5A. The wired receiving unit 41 receives a visitor's image transmitted from the door phone 7 </ b> B via the communication network 3. When a visitor's video is input from the wired receiver 41, the BML / HTML server 31 describes the visitor's video in a markup language (BML or HTML in this example) that can be displayed on the televisions 5A and 5B. . For example, by embedding a script, it is possible to describe a visitor's video as dynamic content. The wired transmission unit 51 transmits the visitor video described in BML or HTML to the television 5A via the communication network 3.

  FIG. 9 is a front view showing the appearance of the television 5A. When receiving the visitor's video from the home gateway 4, the television 5 </ b> A overlays the visitor's video on the broadcast content as an OSD screen 80 by synthesizing the visitor's video at a predetermined location on the broadcast video.

Note that the above echo canceller may be executed for a door phone as well as an IP phone. Further, when the user is absent in the house 2 due to going out or the like, the user sets the absence (and the transfer destination mobile phone 8) in the home gateway 4. When there is a visitor in the absence of the user, the door phone processing unit 34 transmits the visitor's audio signal and video signal received from the door phone 7B to the communication network 9 and a mobile phone base station (illustrated). No) is transferred to the mobile phone 8. As a result, the user can respond to the visitor from the outside using the mobile phone 8.

<Processing related to security sensors>
Next, processing when the security sensor 7C detects an abnormality while the user is viewing the broadcast content on the television 5A will be described. The abnormality detection signal from the security sensor 7C is transmitted from the security sensor 7C to the home gateway 4 via the communication network 3. The wired receiver 41 receives the abnormality detection signal transmitted from the security sensor 7C via the communication network 3. When an abnormality detection signal is input from the wired receiving unit 41, the sensor processing unit 35 sounds a predetermined alarm sound from a speaker (not shown) installed in the house 2.

  When an abnormality detection signal is input from the wired receiver 41, the BML / HTML server 31 stores data of the start menu 70C including predetermined abnormality notification information for notifying the user of the occurrence of abnormality. Read from. This abnormality notification information is arbitrary information (one of the electronic device information) described in a markup language (in this example, BML or HTML) that can be displayed on the televisions 5A and 5B, such as characters and graphics. When the home gateway 4 next receives a start menu transmission request from the television 5A, the wired transmission unit 51 receives the data of the start menu 70C (that is, the start menu including abnormality notification information) input from the BML / HTML server 31. The data is transmitted to the television 5A via the communication network 3. Thereby, instead of the start menu 70, the start menu 70C is displayed on the screen 60 of the television 5A.

  FIG. 10 is a diagram illustrating an example of the start menu 70C. The start menu 70C displays an icon including an asterisk and an exclamation mark as abnormality notification information.

  When the security sensor 7C has a camera, the user presses the detail button of the security sensor in the start menu 70C by operating the remote control of the television 5A, and the monitoring area is displayed in the displayed operation menu. By setting the video display to ON, the video of the monitoring area (for example, the entrance) taken by the camera of the security sensor 7C can be displayed on the screen 60 of the television 5A. The wired receiver 41 receives the video of the monitoring area transmitted from the security sensor 7C via the communication network 3. When the video of the monitoring area is input from the wired receiver 41, the BML / HTML server 31 describes the video of the monitoring area in a markup language (in this example, BML or HTML) that can be displayed on the televisions 5A and 5B. . For example, by embedding a script, the video in the monitoring area can be described as dynamic content. The wired transmission unit 51 transmits the video in the monitoring area described in BML or HTML to the television 5A via the communication network 3.

  FIG. 11 is a front view showing the appearance of the television 5A. When the television 5A receives the video in the monitoring area from the home gateway 4, the television 5A overlays the video in the monitoring area on the broadcast content as an OSD screen 90 by synthesizing the video in the monitoring area at a predetermined location on the broadcast video.

Further, when the user is absent in the house 2 due to going out or the like, the user sets the absence (and the transfer destination mobile phone 8) in the home gateway 4. When the security sensor 7C detects an abnormality in the absence of the user, the sensor processing unit 35 displays the abnormality notification information and the video of the monitoring area on the communication network 9 and a mobile phone base station (not shown). ) To the mobile phone 8. Thereby, the user can know the occurrence of an abnormality on the go.

  Not only the security sensor 7C but also a sensor (hereinafter referred to as “monitoring sensor”) for detecting the fall of a resident in a bathroom, toilet, or the like, the same processing as described above can be performed. When the monitor sensor is equipped with a microphone and a speaker, the user can talk with the resident through the monitor sensor by operating the remote control of the television 5A. In this case, the resident's voice is output from the speaker 61 of the television 5A, and the user's own voice is input to the microphone of the camera / microphone unit 6A. Specifically, the wired receiving unit 41 receives the occupant's audio signal transmitted from the monitoring sensor via the communication network 3. When an audio signal is input from the wired receiving unit 41, the sensor processing unit 35 transmits the audio signal from the wired transmission unit 51 to the television 5A via the communication network 3. Thereby, the voice of the resident is output from the speaker 61. The wired receiving unit 41 receives the user's own audio signal transmitted from the camera / microphone unit 6 </ b> A via the communication network 3. When an audio signal is input from the wired reception unit 41, the sensor processing unit 35 transmits the audio signal from the wired transmission unit 51 to the watching sensor via the communication network 3. Thereby, the user's own voice is output from the speaker of the watching sensor.

  Note that the echo canceller may be executed for the monitoring sensor as in the case of the IP phone. Further, when the user is absent in the house 2 due to going out or the like, the user sets the absence (and the transfer destination mobile phone 8) in the home gateway 4. When the monitoring sensor detects an abnormality in the absence of the user, the sensor processing unit 35 carries the abnormality notification information via the communication network 9 and a mobile phone base station (not shown) connected thereto. Transfer to phone 8. Thereby, the user can know the occurrence of an abnormality on the go. Moreover, it is good also as a structure by which a user can talk with a resident using the mobile telephone 8 on the go by transmitting / receiving an audio | voice signal between the mobile telephone 8 and a monitoring sensor via the sensor process part 35.

<PC-related processing>
The wired receiving unit 41 receives an image displayed on the screen of the personal computer 7D from the personal computer 7D via the communication network 3. When the image of the personal computer 7D is input from the wired receiving unit 41, the BML / HTML server 31 describes the image of the personal computer 7D in a markup language (in this example, BML or HTML) that can be displayed on the televisions 5A and 5B. . The wired transmission unit 51 transmits the image of the personal computer 7D described in BML or HTML to the televisions 5A and 5B (hereinafter referred to as the television 5A) designated by the user via the communication network 3. When the television 5A receives the image of the personal computer 7D from the home gateway 4, the television 5A overlays the image of the personal computer 7D on the broadcast content as an OSD screen by synthesizing the image of the personal computer 7D at a predetermined location on the broadcast video. The user operates the remote controller of the television 5A while referring to the image of the personal computer 7D displayed on the television 5A, or operates the input device such as a mouse or a keyboard that can be connected to the television 5A. 7D can be remotely operated. Data input from the remote controller or the like of the television 5A is transmitted from the television 5A to the personal computer 7D via the communication network 3 and the home gateway 4.
<Summary>

According to the home network system 1 according to the present embodiment, the home gateway 4 acquires electronic device information related to the state and / or operation of electronic devices such as the IP phone 7A, the door phone 7B, the security sensor 7C, and the personal computer 7D. The data described in a predetermined markup language (BML or THML in the above example) that can be displayed on the televisions 5A and 5B, including the electronic device information, is transmitted to the televisions 5A and 5B via the communication network 3. . Then, the televisions 5A and 5B overlay display the data including the electronic device information received from the home gateway 4 on the broadcast content. As described above, data including electronic device information related to the state and / or operation of the electronic device is described from the home gateway 4 and transmitted to the televisions 5A and 5B in a predetermined markup language that can be displayed on the televisions 5A and 5B. Is done. As a result, even when the set-top box is not connected to each of the plurality of televisions 5A and 5B, data including electronic device information relating to the state and / or operation of the electronic device is broadcast on each television 5A and 5B. It is possible to display an overlay on the content.

  Moreover, according to the home network system 1 according to the present embodiment, the home gateway 4 acquires the incoming call information to the IP phone 7A, and includes a predetermined markup that can be displayed on the televisions 5A and 5B including the incoming call notification information. Data described in the language (that is, data of the start menu 70A) is transmitted to the televisions 5A and 5B via the communication network 3. Then, the televisions 5A and 5B overlay display the incoming call notification information received from the home gateway 4 (strictly speaking, the start menu 70A including the incoming call notification information) on the broadcast content. As described above, the incoming call notification information related to the IP telephone 7A is displayed on the broadcast content on the televisions 5A and 5B, so that the convenience of the user can be improved.

  Moreover, according to the home network system 1 according to the present embodiment, the home gateway 4 acquires the partner station video transmitted from the IP telephone 16 of the communication partner, and the TV 5A, 5B receives the partner station video. It is described in a predetermined markup language that can be displayed and transmitted to the televisions 5A and 5B via the communication network 3. Then, the televisions 5A and 5B display the partner station video received from the home gateway 4 as an overlay on the broadcast content. In this manner, the convenience of the user can be improved by displaying the partner station video on the broadcast content on the televisions 5A and 5B.

  Moreover, according to the home network system 1 according to the present embodiment, the home gateway 4 acquires information on pressing of the call switch of the door phone 7B, and the predetermined information that can be displayed on the televisions 5A and 5B including the visitor notification information. Data described in the markup language (that is, data of the start menu 70B) is transmitted to the televisions 5A and 5B via the communication network 3. Then, the televisions 5A and 5B display the visitor notification information received from the home gateway 4 (strictly speaking, the start menu 70B including the visitor notification information) over the broadcast content. As described above, by displaying the guest notification information on the broadcast content on the televisions 5A and 5B in an overlay manner, the convenience of the user can be improved.

  Further, according to the home network system 1 according to the present embodiment, the home gateway 3 can acquire the visitor's video transmitted from the door phone 7B, and the television 5A and 5B can display the visitor's video. The program is described in a predetermined markup language and transmitted to the televisions 5A and 5B via the communication network 3. Then, the televisions 5A and 5B display the video of the visitor received from the home gateway 3 as an overlay on the broadcast content. As described above, the user's convenience can be improved by overlaying the video of the visitor on the broadcast content on the televisions 5A and 5B.

Moreover, according to the home network system 1 according to the present embodiment, the home gateway 4 acquires the abnormality detection information from the crime prevention sensor 7C, and includes the predetermined marks that can be displayed on the televisions 5A and 5B, including the abnormality notification information. Data described in the up language (that is, data of the start menu 70C) is transmitted to the televisions 5A and 5B via the communication network 3. Then, the televisions 5A and 5B overlay display the abnormality notification information (strictly speaking, the start menu 70C including the abnormality notification information) received from the home gateway 4 on the broadcast content. As described above, by displaying the abnormality notification information on the broadcast content on the televisions 5A and 5B in an overlay manner, the convenience of the user can be improved.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined not by the above-mentioned meaning but by the scope of claims for patent, and is intended to include all modifications within the scope and meaning equivalent to the scope of claims for patent.

DESCRIPTION OF SYMBOLS 1 Home network system 3,9 Communication network 4 Home gateway 5A, 5B Television 7A IP telephone 7B Door phone 7C Security sensor 30 Broadcast signal processing part 31 BML / HTML server 32 SIP server 33 IP telephone processing part 34 Door phone processing part 35 Sensor processing part 70, 70A-70C Start menu 71, 72, 80, 90 OSD screen

Claims (7)

A communication network;
A home gateway connected to the communication network;
A video display device connected to the communication network and capable of displaying broadcast content and data described in a predetermined markup language;
A plurality of electronic devices connected to the communication network,
The home gateway acquires electronic device information related to the state and / or operation of the electronic device, and displays the video data including the electronic device information in the predetermined markup language via the communication network. To the device,
The video display device is a home network system in which the data received from the home gateway is displayed as an overlay on the broadcast content. The plurality of electronic devices includes an IP (Internet Protocol) phone,
The home gateway acquires incoming information to the IP phone, transmits data described in the predetermined markup language including incoming notification information to the video display device via the communication network,
The home network system according to claim 1, wherein the video display device displays the incoming call notification information received from the home gateway in an overlay manner on the broadcast content. The IP phone has a videophone function,
The home gateway acquires a communication partner image transmitted from a communication partner terminal, describes the communication partner image in the predetermined markup language, and transmits the communication partner image to the video display device via the communication network. Send
The home network system according to claim 2, wherein the video display device displays the video of the communication partner received from the home gateway as an overlay on the broadcast content. The plurality of electronic devices include a door phone,
The home gateway acquires information on pressing a call switch of the door phone, and transmits data described in the predetermined markup language including visitor notification information to the video display device via the communication network,
The home network system according to claim 1, wherein the video display device displays the visitor notification information received from the home gateway in an overlay manner on the broadcast content. The door phone has a photographing function for photographing a visitor,
The home gateway acquires the visitor's video transmitted from the door phone, describes the visitor's video in the predetermined markup language, and transmits the video to the video display device via the communication network. ,
The home network system according to claim 4, wherein the video display device displays the video of the visitor received from the home gateway as an overlay on the broadcast content. The plurality of electronic devices include sensor devices,
The home gateway acquires abnormality detection information from the sensor device, transmits data described in the predetermined markup language including abnormality notification information to the video display device via the communication network,
The home network system according to claim 1, wherein the video display device displays the abnormality notification information received from the home gateway in an overlay manner on the broadcast content. A communication network;
A home gateway connected to the communication network;
A video display device connected to the communication network and capable of displaying broadcast content and data described in a predetermined markup language;
A communication method in a home network system having a plurality of electronic devices connected to the communication network,
(A) the home gateway acquiring electronic device information relating to the state and / or operation of the electronic device;
(B) transmitting data described in the predetermined markup language including the electronic device information acquired in the step (A) from the home gateway to the video display device via the communication network;
(C) In the video display device, a method of overlaying the data received from the home gateway on the broadcast content.

Images