JP2004343619A - Communication system, terminal equipment and communication method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a communication system, terminal equipment and a communication method for performing communication in consideration of partner's convenience by grasping a state of the partner to be called and capable of relieving a burden of a server. <P>SOLUTION: A center server 10 manages IP addresses of client equipment (codes 12 to 18) connected to a network 20 and provides the IP addresses to each client equipment connected to the network 20. Peer-to-peer (P2P) connection is established between pieces of the client equipment 14 and 16 based on information on the IP address and an image of a user 62 imaged by an imaging means 50 is transmitted to the client equipment 14 as status information by a client 16. The status of the user 62 displayed on a display device 44 is confirmed by the client equipment 14 and a user 60 learn the partner's status before calling the user 62. The status information is transferred by the P2P connection and the burden of the server is relieved. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a data communication method and system and a terminal device, and more particularly to a data communication technique suitable for data communication between terminal devices connected to a network.
[0002]
[Prior art]
With the development of high-speed communication networks such as optical fiber networks and the spread of high-speed communication technology, the information transmission mode has changed from information transmission by telephone or facsimile to information transmission using the Internet or e-mail. It is now possible to send large volumes of data such as moving images instantly. In addition, with the advancement of image processing technology and the increase in device speed and capacity, it has become possible to view moving images taken at remote locations using the high-speed communication network described above in real time. Videophones that can be transmitted almost simultaneously are now available.
[0003]
The answering machine video telephone disclosed in Patent Document 1 includes an answering machine setting means that can be connected to a voice line and a data line and can set only video or video and voice on the receiving side. If only video is set, the voice line connection rejection status is sent to the other party. When the other party receives the voice line connection rejection status, the reason code attached to the voice line connection rejection status is determined. Controls sending data line call settings to the other party.
[0004]
[Patent Document 1]
JP-A-6-197338
[0005]
[Problems to be solved by the invention]
However, with videophones, the current situation is that the other party is suddenly called, so the status of the other party to be called cannot be known, and it was not possible to know whether or not to make the call.
[0006]
The answering machine videophone disclosed in Patent Document 1 returns the voice connection refusal status and the data line call setting to the other party when the setting on the receiving side is video only (voice incoming call rejection). If the setting is only video, the voice line is not connected and it is possible to reflect the setting on the called side, but the status on the called side cannot be known before calling the called side.
[0007]
In addition, in data communication performed over a network, when system control and data management are performed by a network server, the processing load on the network server increases, and problems such as system control instability and communication speed decrease occur. May occur.
[0008]
The present invention has been made in view of such circumstances, and provides a communication system, a terminal device, and a communication method capable of grasping the situation of a calling party, enabling communication in consideration of the other party's convenience, and reducing the load on the server The purpose is to provide.
[0009]
[Means for Solving the Problems]
In order to achieve the above object, a data communication system according to the present invention includes a server connected to a network, and a plurality of terminals including a first terminal device and a second terminal device connected to the server via the network. A communication system comprising: a terminal device, wherein the server includes a location information management unit that manages location information indicating a location of the terminal device connected to the network on the network, and the location information management unit. Position information providing means for providing the managed location information to a terminal device connected to the network, wherein the first terminal device displays an image serving as status information of the first terminal device. Data communication between imaging means for imaging, connection control means for controlling to establish connection to the network, and the second terminal device First peer-to-peer connection control means for controlling to establish a peer-to-peer connection for performing the status information of the first terminal device including an image captured by the imaging means, Status information sending means for sending to the second terminal device by a peer-to-peer connection established by the connection means, and the second terminal device performs control for establishing a connection to the network. On the basis of the position information acquired by the position information acquisition means, the position information acquisition means for acquiring the position information of the terminal device on the network provided by the position information providing means of the server, and the position information acquisition means A second peer-to-peer connection for controlling to establish a peer-to-peer connection for data communication with the first terminal device Control means, status information acquisition means for acquiring the status information transmitted by the status information transmission means of the first terminal device, and display means for displaying the status information acquired by the status information acquisition means. It is characterized by that.
[0010]
According to the present invention, the server manages the position information indicating the position on the network of the terminal device connected to the network by the position information management means, and the terminal connected to the network by the position information providing means. Provide to equipment. The first terminal device acquires the location information from the server by location information acquisition means, establishes a peer-to-peer connection with the second terminal device by peer-to-peer connection control means, The status information of the first terminal device including the image captured using the imaging means provided in the terminal device is sent to the second terminal device by the status information sending means. In the second terminal device, the status information sent from the first terminal device is acquired by the status information acquisition means, and the status information is displayed on the display device provided in the second terminal device. Therefore, the second terminal device can grasp the situation of the person who uses the terminal device based on the status information of the first terminal device, and exchanges the status information through peer-to-peer connection. Can be reduced. If the status information is an image, it is convenient to see the other party at a glance.
[0011]
As the location information, an IP address or a Mac address uniquely assigned to a device connected to an IP (Internet protocol) network may be applied, or any information that can identify the terminal device on the network is arbitrary. Other information such as the user ID may be applied.
[0012]
For example, a compression format such as JPEG format or GIF format is applied to the image. Of course, other compression formats may be used.
[0013]
When the terminal device disconnects from the network, the location information allocated to the terminal device is deleted from the server, and when the terminal device is connected to the network again, new location information is allocated and managed by the server. The terminal device information may be allocated in advance to each terminal device, and the server may manage this.
[0014]
The peer-to-peer connection is a mode in which data communication is performed between at least two terminal devices without going through a server, and the server processing burden is imposed on data communication on the network and data sharing on the network. Often used for lightening.
[0015]
The mode of sharing data on the network may be a mode in which a data search system or the like is placed on a server and only the data is placed in a terminal device, or a mode in which the data search system or the like and data are placed in a terminal device may be used.
[0016]
The status information may be a still image or a moving image. An intermittent image or a frame rate (frame update cycle) may be long. Moreover, it may be displayed by a character, a code, a symbol, etc., and may be audio information.
[0017]
It indicates that the network is connected so that information communication can be performed between a plurality of devices including the Internet and a LAN. Network communication forms include wired, wireless, and infrared, and communication protocols include TCP / IP and UDP / IP. Other network forms and other communication protocols may be applied.
[0018]
The server may be composed of a single computer or a plurality of computers.
[0019]
In order to achieve the above object, a terminal device according to the present invention is a terminal device connectable to a network, and includes an imaging unit that captures an image serving as status information of the terminal device, and a connection to the network. Connection control means for performing control to be established, position information acquisition means for acquiring position information of other terminal devices connected to the network from a server on the network, and position information acquired by the position information acquisition means And a peer-to-peer connection control means for controlling to establish a peer-to-peer connection with other terminal devices on the network, and a self-terminal including an image captured by the imaging means Status information sending means for sending device status information to another terminal device connected in the peer-to-peer connection; and Status information acquisition means for acquiring status information of other terminal devices transmitted from other terminal devices connected by peer-to-peer connection by the peer connection control means, and status information acquired by the status information acquisition means are displayed. And a display means.
[0020]
According to the present invention, when the connection to the network is established by the connection control means, the position information indicating the position of the terminal device connected to the network on the network is obtained from the server by the position information obtaining means. The peer-to-peer connection control means establishes a peer-to-peer connection with other terminal equipment connected to the network, and status information including an image captured by the imaging means Can be sent to terminal equipment. In addition, status information of other terminal devices transmitted from other terminal devices can be acquired by the status information acquisition means, and the status information can be displayed on the display means.
[0021]
In a network system provided with at least two servers and terminal devices, status information including images can be exchanged between a plurality of terminal devices.
[0022]
A mode provided with status information control means for performing control to periodically update status information displayed on the display device is preferable. The mode in which status information is updated may be a mode in which status information is updated each time status information is sent from another terminal device, or a mode in which status information is updated when a user performs an update operation of status information by an operation unit. But you can.
[0023]
The imaging unit and the terminal device may be configured to be separable. The image generated by the imaging means may be color or black and white. If the image generated by the imaging means is black and white, the image processing at the terminal device becomes faster and the data capacity can be reduced, so the communication speed and processing at each terminal device are less affected.
[0024]
According to an aspect of the present invention, when the status information sending unit does not send the image captured by the imaging unit, the status information sending unit sends status information instead of the image to a terminal device connected in a peer-to-peer connection. It is characterized by doing.
[0025]
According to this aspect, when the image picked up by the image pickup means is not sent, such as when the setting to stop sending the image is made, other information can be sent instead of the image. The information in place of the image captured by the imaging unit may be a still image or a moving image prepared in advance, text information such as a message, or voice information.
[0026]
According to another aspect of the present invention, there is provided a telephone call means capable of transmitting a call signal for calling a desired party, making a telephone call connection when the call partner responds to the call signal, and making a voice call. It is characterized by that.
[0027]
After confirming the state of the other party by the status information, it becomes possible to make a voice call by means of a telephone call means.
[0028]
Furthermore, according to another aspect of the present invention, the network includes a telephone line network, and the status information of the calling party displayed on the display means can be confirmed before the telephone call connection is made.
[0029]
In the case of a hybrid line that cannot simultaneously perform data communication over a network and a telephone line network, data communication may be temporarily stopped and the call established. In addition, it is preferable to perform control so that connection processing to the network is performed so that the data communication can be automatically resumed when the call ends.
[0030]
The hybrid line includes a communication line that integrates telephone, facsimile, data communication, etc. and connects to a single communication network. A mode in which a part of the line is integrated or all lines are integrated. But you can.
[0031]
The telephone line may include a fixed telephone line or a public telephone line, or may include a wireless telephone network or a mobile telephone network.
[0032]
In order to solve the above object, a communication method according to the present invention is a communication method in a communication system comprising a server connected to a network and a plurality of terminal devices connected to the server via the network. An imaging step of capturing an image serving as status information of the first terminal device by an imaging unit provided in the first terminal device, and the first terminal device establishing a connection to the network A location information providing step of providing location information indicating a location on the network of the first terminal device connected to the network by the connection step from the server to the second terminal device; A location information acquisition step in which the second terminal device acquires the location information of the first terminal device provided by the location information providing step; When the second terminal device acquires the position information of the first terminal device in the position information acquisition step, the second terminal device is based on the position information of the first terminal device. A peer-to-peer connection step for establishing a peer-to-peer connection with a device, and a peer-to-peer connection between the first terminal device and the second terminal device in the peer-to-peer connection step When the connection is established, the status information sending step for sending an image as the status information of the first terminal device from the first terminal device to the second terminal device and the status information sending step are sent. In addition, the second terminal device obtains an image that is status information of the first terminal device by the second terminal device, and the second terminal device performs the status information obtaining step. And status information display step of displaying give the image a status information of the first terminal device to a display device provided in the second terminal device is characterized in that it comprises a.
[0033]
It is preferable that the server classifies terminal devices connected to the network into groups, and manages position information and networks for each group.
[0034]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.
[0035]
FIG. 1 is a block diagram of a data communication system according to an embodiment of the present invention.
[0036]
The center server 10 and the client devices 12, 14, 16 and 18 are connected to the network 20.
[0037]
TCP / IP is applied to the communication protocol of the network 20, and the line of the network 20 is constituted by a high-speed communication line network such as an optical fiber. The network 20 may be configured such that at least a part thereof is configured by a telephone line network or a hybrid line that is also used as a telephone line network.
[0038]
In addition to TCP / IP, other protocols such as UDP / IP may be applied as the communication protocol.
[0039]
The center server 10 includes a user database that manages information of clients connected to the network 20 and a storage 22 that stores various data shared on the network 20.
[0040]
When each client device is connected to the network 20, an IP address is issued by the center server 10. In the aspect in which the center server 10 issues an IP address to the client device, the client device issues an IP address (private IP address) every time the client device is connected to the network 20 and the client device disconnects from the network 20. There is a mode in which an IP address allocated and issued to the client device is deleted, and a mode in which a fixed IP address (global IP address) is issued for each client device, and either mode may be applied.
[0041]
In the present embodiment, an example in which an IP address is issued each time a client device is connected to the network 20 is illustrated. The private IP address functions as an IP address in an area managed by the center server 10 (for example, in the network 20).
[0042]
The client devices 12, 14, and 16 are TV telephones, and the client device 18 is a notebook computer. A CCD camera unit 26 is connected to the notebook computer 18 via a digital communication cable 24. Digital image data (through image) of the subject imaged by the CCD camera unit 26 can be displayed on the display unit 28 of the notebook computer 18 and is captured at predetermined intervals as image data of a still image that is disclosed to the network 20. These are stored in a memory (temporary recording area) in the notebook computer 18. The memory updates the stored image data each time new still image data is fetched. Note that a notebook computer with a camera in which a CCD camera unit is integrated may be applied to the notebook computer 18. The image sensor of the camera unit connected to the notebook computer 18 is not limited to the CCD solid-state image sensor, and a CMOS solid-state image sensor or another image sensor may be used.
[0043]
The telephone 12 with a TV includes a telephone main body 30, a display 32, a CCD camera 34, a telephone line connection terminal, a network connection terminal (Ethernet terminal), and a power supply terminal (not shown in FIG. 1). The telephone main body 30 includes a receiver 36 and an operation unit 38 including a numeric keypad.
The TV phone 14 and the TV phone 16 have the same configuration as the TV phone 12,
The telephone main body units 40 and 42, display units 44 and 46, and CCD cameras 48 and 50 are provided. The telephone main body units 40 and 42 include receivers 52 and 54 and operation units 56 and 58, respectively.
[0044]
FIG. 1 shows a user 60 of a television phone 14 and a user 62 of a television phone 16.
[0045]
The telephones with televisions 12, 14, 16 can be connected to a telephone line network, each has a unique telephone number, and can be connected to the network 20 via a network connection terminal. Is established, the center server 10 issues an IP address.
[0046]
The IP address indicates the position (address) of the client device on the network 20, and is composed of a numeric string configured according to a predetermined rule such as 192.168.2.2.38. As described above, each numeric string is delimited by periods. ing. When an IP address is issued to the client device, it becomes possible to share data on the network 20 and perform data communication according to a predetermined rule.
[0047]
In the network 20, data communication can be performed by a peer-to-peer (P2P) connection in which a client device can perform data communication with other client devices without going through the center server 10.
[0048]
In the data communication by the P2P connection of this embodiment, the search for shared data is performed by the center server 10, and the shared data is recorded in a predetermined recording area of each client device. Recording means such as a hard disk, an MO drive, or a memory card is applied to the predetermined recording area.
[0049]
By providing the center server 10 with a data search function, it is possible to reduce the processing load on the center server 10 while preventing an increase in the amount of communication between client devices. Depending on the processing capability of the client device, a mode in which each client device has a data search function is also possible.
[0050]
The center server 10 performs group management of client devices, discloses IP addresses within client devices belonging to the same group, and permits data communication by P2P connection. Data communication with client devices outside the group is configured to be performed via the center server 10.
[0051]
The white arrow lines 70A and 70B in FIG. 1 indicate the flow of communication during the IP address and data search performed between the center server 10 and the TV telephones 14 and 16, and the black line arrow 74 indicates the TV telephone. 14 shows a flow of data communication of shared data performed between the telephone 14 and the telephone 16 with TV.
[0052]
Although not shown in FIG. 1, the IP address issuance, data retrieval and data communication described above are of course also used for data communication in the TV telephone 12, the notebook computer 18 and other client devices connected to the network 20. Applicable.
[0053]
FIG. 2 is a block diagram of a telephone with a television according to an embodiment of the present invention. The TV telephones 12, 14, and 16 have the same configuration, and the description will be made using the TV telephone 12.
[0054]
The main body 30 of the television telephone 12 is provided with a camera unit 100, a telephone unit 102, a display unit 32 including a display, and an operation unit 38. The operation unit 38 includes various operation means such as a dial button, a call button, a call disconnecting power button, a cross button, an execution button and the like (not shown). The operation unit 38 is not limited to a push-type switch member, and may be configured as a dial member, a lever switch, or the like, and a user interface for selecting a desired item from a menu screen displayed on the display unit 32. There is also a possibility.
[0055]
The telephone 12 with a TV includes a control unit 104 having a central processing unit (CPU) and a memory 106, a voice processing unit 108, a communication unit 110 having a telephone line network connection unit and a network connection unit, and an earpiece. Components necessary for realizing a normal telephone function such as the speaker 112 and the microphone 114 of the mouthpiece are provided.
[0056]
The control unit 104 functions as a control device that controls the operation of the entire TV telephone 12 according to a predetermined program, and also functions as a calculation device that performs various calculations. That is, the control unit 104 controls each circuit in the television telephone 12 based on a command signal input from the operation unit 38, and performs communication control, shooting operation control, image processing control, display control of the display unit 32, memory 106 performs read / write control and capacity management (including detection of free capacity).
[0057]
The control unit 104 is connected to the memory 106 via the bus 116. The memory 106 is a non-volatile memory (ROM) area that stores a program executed by the control unit 104 and various data necessary for control, a volatilization area used as a program development area and a calculation work area of the control unit 104. And a random memory (RAM) area. The ROM area is used as a data storage area for a telephone directory and a call history, and is also used as a storage area for voice and images. The RAM area is also used as a temporary storage area for image data.
[0058]
The audio processing unit 108 is a unit that processes or converts an audio signal in cooperation with the control unit 104, and performs a decoding process of data received from the communication unit 110 and an encoding process of data transmitted through the communication unit 110. In addition, output signal generation processing to the speaker 112, encoding processing of an input audio signal from the microphone 114, and the like are performed.
[0059]
In a call mode (a mode in which a telephone function is used), when communication connection with a communication partner is established, sound input from the microphone 114 is converted into an electric signal and sent to the sound processing unit 108. The audio processing unit 108 converts the audio signal input from the microphone 114 into a digital signal (A / D conversion), and then performs necessary signal processing to convert it into audio data of a predetermined format. The voice data (data for transmission) processed by the voice processing unit 108 is sent to the communication unit 110 via the bus 116, converted into a predetermined transmission signal format, and then sent to the telephone line network.
[0060]
Also, a voice (reception) signal acquired from the telephone line network via the communication unit 110 is demodulated by a demodulation circuit in the communication unit 110 and sent to the voice processing unit 108. The audio processing unit 108 converts the audio signal received from the demodulation circuit into audio data in a predetermined format. The audio data (received data) generated by the audio processing unit 108 is converted into an analog audio signal (D / A conversion) and then sent to the speaker 112. In this way, the voice of the other party is audibly output from the speaker 112.
[0061]
The camera unit 100 includes a photographing lens 120 and a CCD image sensor (hereinafter referred to as a CCD) 122, an analog processing unit 124 for processing an image signal obtained from the CCD 122, an A / D converter 126, a signal. A processing unit 128 and a compression / decompression unit 130 are provided. In this example, a CCD is used as the image pickup element. However, the device is not limited to the CCD type, and other types of devices such as a CMOS type may be used.
[0062]
The light passing through the photographing lens 120 is focused on the light receiving surface of the CCD 122. A large number of photosensors (light receiving elements) are arranged in a plane on the light receiving surface of the CCD 122, and red (R), green (G), and blue (B) primary color filters are arranged in a predetermined arrangement corresponding to each photosensor. Arranged in structure. A color filter such as CMY can be used instead of the RGB color filter.
[0063]
The subject image formed on the light receiving surface of the CCD 122 is converted into a signal charge corresponding to the amount of incident light by each photosensor. The CCD 122 has an electronic shutter function that controls the charge accumulation time (shutter speed) of each photosensor according to the timing of the shutter gate pulse.
[0064]
The signal charges accumulated in the respective photosensors of the CCD 122 are converted into signal charges based on pulses (horizontal drive pulse φH, vertical drive pulse φV, overflow drain pulse) given from the timing generator (TG) 132 in accordance with a command from the control unit 104. Corresponding voltage signals (image signals) are sequentially read out. The image signal output from the CCD 122 is sent to the analog processing unit 124, subjected to necessary processing such as correlated double sampling (CDS) processing and gain adjustment, and then converted into a digital signal by the A / D converter 45. Is done. The digitized image data is sent to the signal processing unit 128.
[0065]
The signal processing unit 128 includes a synchronization circuit (a processing circuit that calculates the color of each point by interpolating a spatial shift of the color signal associated with the color filter array of the single-plate CCD), a luminance / color difference signal generation circuit, and a gamma correction. A digital image signal processing unit including a circuit, a contour correction circuit, a white balance correction circuit, and the like, and processes an image signal using the memory 106 in accordance with a command from the control unit 104.
[0066]
The signal processing unit 128 is generated by performing predetermined processing such as white balance adjustment processing, gamma conversion processing, conversion processing to luminance signals (Y signals) and color difference signals (Cr, Cb signals) (YC processing). The image data is temporarily stored in the memory 106. Here, in the case where the image being shot is displayed on the display 134 of the display unit 32, the contents of the memory 106 are read out and sent to the display circuit 136, converted into a display signal format by the display circuit 136, and then displayed. 134. As a result, a real-time video (through image) captured by the CCD 122 is displayed on the display 134.
[0067]
An LCD monitor may be applied to the display 134, or another monitor such as an organic EL or CRT monitor may be applied.
[0068]
Further, the telephone 12 with a TV has a shooting function, and issues a shooting execution command by the control unit 104 at a predetermined time interval (for example, every 5 seconds), and executes a shooting operation for recording accordingly. As a mode for performing shooting, there is a mode in which when the shooting button (for example, the execution button is also used) of the operation unit 38 is pressed, the control unit 104 detects this and executes a shooting operation for recording. These embodiments can be used in combination.
[0069]
The captured image data for recording is subjected to luminance / color difference signal conversion processing (YC processing) and other predetermined signal processing in the signal processing unit 128, and then sent to the compression / expansion unit 130, where a predetermined compression format ( For example, it is compressed according to the JPEG format. The compressed image data is stored in the image storage area of the memory 106.
[0070]
The TV telephone 12 has a moving image shooting function. When the moving image shooting mode is selected, the recording operation starts when the shooting button is pressed. Stop. Note that the recording operation may be performed while the shooting button is continuously pressed, and the recording may be stopped by releasing the pressing.
[0071]
The sound at the time of moving image shooting is detected by a microphone (not shown), and the detection signal (audio signal) is converted into a predetermined signal format by the audio processing unit 108. The audio data is recorded together with the image data in the memory 106 after being compressed in the compression / decompression unit 130 according to a predetermined compression format (for example, MP4 format).
[0072]
It is convenient to configure the imaging function parts such as the taking lens 120 and the CCD 122 in the camera unit 100 so as to be detachable from the telephone main body 30 with a TV.
[0073]
The CCD camera unit 26 connected to the notebook computer 18 shown in FIG. 1 has the same configuration as the camera function of the above-described TV-equipped telephone 12 and has the same camera imaging function. The through image captured by the CCD camera unit 26 can be displayed on the display unit 28, and the photographed image is recorded as a still image in recording means (internal memory, memory card, etc.) of the notebook computer 18 at predetermined time intervals. Is done.
[0074]
Furthermore, the telephone 12 with a TV is provided with an electronic mail function, an Internet browser function, and the like, and various data such as image data, document data, and program data can be transmitted and received using these functions.
[0075]
In the data communication system described above, the user of the client device can be photographed by the imaging function provided in the client device, and this image can be sent to other terminal devices connected in P2P as status information of each client device. The image transmission destination terminal device that is status information can acquire and display this image.
[0076]
In addition, each client device has an address book function, and can communicate data with other client devices recorded in the address book by P2P connection. Device status information can be acquired.
[0077]
For example, the user 60 of the TV phone 14 shown in FIG. 1 confirms the state of the user 62 displayed on the display unit 44 when making a call to the user of the TV phone 16, and as shown in FIG. If the user 62 seems to be able to receive a call, such as reading a message, he / she makes a call. On the other hand, if the user 62 cannot receive a call, or if the user 62 rejects an incoming call, the status information When is displayed, it can be determined not to make a call. The status information is preferably configured to be updated periodically.
[0078]
In the data communication system configured as described above, the center server 10 is provided with a user database for managing information on the IP address of the client device, and when the client device is connected to the network 20, an IP address is issued to the client. I do. The client device that has established the connection to the network 20 acquires the IP address information of the other client device from the center server 10, and based on this IP address information, data communication can be performed with other client devices by P2P connection. . An image of a user of each device captured using a camera unit that is an imaging unit provided in each client device is transmitted to other client devices as status information of the client device. In addition, a display is provided so that an image sent from another client device can be displayed. Therefore, the status of the other client device users can be seen at a glance from the status information, and further, the status of the other client device users can be known in real time if the status information is updated periodically. The image serving as status information may be a still image or a moving image.
[0079]
On the other hand, data communication between client devices can be performed without intervention of the center server 10, so that data sharing within the network 20 is possible and the processing load on the center server 10 can be reduced. If the data search is performed by the center server 10, an increase in processing load on the client device can be prevented.
[0080]
If the center server 10 sorts client devices connected to the network 20 into groups, and manages so that data communication by P2P connection between the client devices is restricted to client devices (group members) belonging to the same group, more information than necessary. Is not distributed to the network 20, and the traffic of the network 20 can be suppressed. Further, it is preferable that the center server 10 performs authentication (login) as a group member when the client device connects to the network 20.
[0081]
Next, a videophone system to which the above-described data communication system is applied will be described. As shown in FIG. 1, the TV phones 12, 14, 16 and the notebook computer 18 are provided with an imaging function. Using the imaging function, the user of the client device is photographed and each user is photographed. The image (video) is released on the network 20 as status information of each client device.
[0082]
The party to whom status information is disclosed may be a user or group member registered in a telephone book (address book) or the like, or may be an aspect in which a user selects a user to be disclosed.
[0083]
The user can see the other client images displayed on the display device of each client device and know the other party's status before making a call, which leads to prevention of a call when absent.
[0084]
In addition, when a telephone call cannot be received such as when the user is absent or during a meal, or when it is desired to reject a telephone call for the reason of the receiver side, the incoming call can be set to be rejected by a device on the receiving side. In the client device in which the incoming call rejection is set, an image or a message indicating the incoming call rejection is sent as status information to another client device connected to the network 20 instead of the image. Note that not only image information but also audio information may be provided.
[0085]
FIG. 3 shows an example of status information of each client device displayed on the display device of the client device. In FIG. 3, the client device will be described by using the TV phone 14.
[0086]
On the display unit 44, status information 200, 202, 204, 206, 208, 210 of user A, user B, user C, user D, user E, and user F managed as users belonging to group 1 are displayed. Yes. In FIG. 3, the user C becomes the user 62 of the television telephone 16 in FIG.
[0087]
The user database possessed by the center server 10 can be managed in groups, and shared data can be managed separately for each group.
[0088]
Each status information displayed on the display unit 44 is updated each time updated status information is sent from each client device. Note that the status information may be automatically updated periodically, or may be updated according to an update operation performed by operating the operation unit 56.
[0089]
The status information of the user A, the user B, and the user C is an image transmitted from each client device, and it can be understood that the user A, the user B, and the user C may make a call.
[0090]
The status information 206 of the user D displays an arbitrary still image (flower image) indicating call rejection and a message (going out) indicating the reason for call rejection. In this manner, a preset image and message are released from the client device that rejects the incoming call. The JPEG format may be applied to the image indicating the incoming call rejection, or the GIF format or another compression format may be applied. Of course, a moving image may be applied to an image indicating call rejection. Moreover, the aspect which displays nothing may be sufficient.
[0091]
In the status information 208 of the user E, a message indicating that the status information is not disclosed (not disclosed) is displayed. When the setting is made so that the status information is not disclosed on the sending client device, the message indicating that the setting is not disclosed is displayed on the display device of the receiving client device as described above. You may apply the mode which does not display anything at the time of non-public setting.
[0092]
Further, the status information of the user F is not displayed. Thus, status information of users who are not connected to the network 20 is not displayed.
[0093]
In the present embodiment, a mode in which a plurality of status information is displayed on the display unit 44 is exemplified, but the mode in which the status information is displayed is not limited to this. There are various display modes such as a mode for displaying status information selected by the selection unit, and any display mode may be applied. Moreover, the aspect which displays status information and a message may be sufficient.
[0094]
It may be an aspect of a reception-only machine that does not include an imaging unit and does not send status information to other client devices.
[0095]
FIG. 4 is a flowchart showing a control flow of the above-described telephone system with a TV. Here, a call between the telephone 14 with TV and the telephone 16 with TV will be described as an example.
[0096]
When the control of the telephone system with a TV is started (Step S10, Step S12, Step S14), the center server 10 responds to a connection request (Step S16) from the telephone with a TV 14 to the network 20 (Step S16). The IP address is issued (allocated) to (step S18), and the connection of the TV-equipped telephone 14 to the network 20 is established (step S20).
[0097]
Further, the center server 10 issues an IP address to the TV phone 16 in response to a connection request to the network 20 from the TV phone 16 (step S24) (step S26), and the network 20 of the TV phone 16 is connected. A connection to is established (step S28).
[0098]
The center server 10 provides information (IP information) of the IP address connected to the network 20 to client devices (here, the TV phone 14 and the TV phone 16) connected to the network 20 (step S30).
[0099]
The TV phone 16 acquires the IP information of the TV phone 14 (step S32), and the TV phone 14 acquires the IP information of the TV phone 16 (step S34).
[0100]
The telephone 14 with television and the telephone 16 with television establish a P2P connection based on the IP information acquired in step S32 and step S34, respectively (step S36, step S38).
[0101]
When the P2P connection with the TV phone 14 is established, the TV phone 16 transmits the image of the user 62 taken by the CCD camera 50 to the TV phone 14 as status information of the TV phone 16 (step S40). .
[0102]
When the status information (image) transmitted from the TV phone 16 is acquired in the TV phone 14 (step S42), the status information transmitted from the TV phone 16 is displayed on the display unit 44 (step S44).
[0103]
The user 60 of the television phone 14 can know the state of the user 62 before calling the user 62 of the television phone 16 by viewing the status information of the television phone 16 displayed on the display unit 44. . In other words, it is possible to inform the other party of his / her status by performing a hybrid connection to the network while waiting for a call.
[0104]
When the user 60 makes a call to the user 62, a call signal, which is a call request, is sent from the TV phone 14 to the TV phone 16 (step S46), and at the same time, from the TV phone 14 to the center server 10 to the network 20 A cutting process is requested (step S48).
[0105]
In response to the disconnection request, the center server 10 executes disconnection processing between the TV phone 14 and the network 20 (step S50), and deletes the IP address assigned to the TV phone 14 from the IP information of the network 20. Processing is performed (step S52).
[0106]
On the other hand, when the TV phone 16 receives the calling signal transmitted from the TV phone 14 (step S54), the center server 10 requests the center server 10 to disconnect the network 20 (step S56). Accordingly, the disconnection process between the TV phone 16 and the network 20 is executed (step S58), and the IP address assigned to the TV phone 16 is deleted from the IP information of the network 20 (step S60). .
[0107]
When the disconnection process between the TV phone 14 and the TV phone 16 and the network 20 is normally completed and the TV phone 16 responds to the calling signal sent from the TV phone 14 (step S62), the fixed telephone line connection is established. Then, a telephone call can be made between the TV phone 14 and the TV phone 16 (steps S64 and S66).
[0108]
When a telephone call is made between the telephone 14 with video and the telephone 16 with video, and the telephone call 16 is terminated (step S68), the connection with the fixed telephone line is disconnected (step S68). S70).
[0109]
After the connection with the fixed telephone line is disconnected, reconnection to the network 20 is performed (step S72), and the process returns to step S14 (step S74).
[0110]
On the other hand, in the telephone 14 with television, when the call termination process is performed (step S76), the connection with the fixed telephone network is disconnected (step S78), and the reconnection process to the network 20 is performed (step S80). The process returns to step S14 (step S82).
[0111]
In the center server 10, when the disconnection processing of the TV phone 14 and the TV phone 16 with the network 20 is normally completed, the process returns to step S10 (step S84).
[0112]
FIG. 5 is a flowchart showing the flow of control of the TV telephones 12, 14, and 16. During the telephone standby (step S100), the operation of the camera unit is started according to the operation start process of the camera unit (step S102).
[0113]
When the center server 10 is requested to connect to the network 20, an IP address is issued from the center server 10 to the telephone with television, and the television telephone is connected to the network 20 (step S104).
[0114]
When the connection of the telephone with a TV to the network 20 is established, IP addresses of client devices (group members) belonging to the same group among the client devices connected to the network 20 are acquired (step S106). Based on the P2P connection request from the group member, the P2P connection is established.
[0115]
When the P2P connection with another client device is established, it is set whether or not the status information is to be disclosed (step S108). The image and the message indicating are displayed, and the process proceeds to step S116. In the mode in which the status information is not disclosed, in addition to the non-public setting, a setting for rejecting incoming calls can be performed. Further, another message image may be transmitted only to a party to whom a message is to be sent (for example, a party who wants to make a call).
[0116]
In step S116, a call reception is waited. If there is no call reception (NO determination), the process proceeds to step S106 to periodically check the IP information of the group members.
[0117]
If there is an incoming call in step S116 (YES determination), the center server 10 is requested to disconnect from the network 20, and the center server 10 performs disconnection processing from the network 20 (step S118).
[0118]
Furthermore, when the telephone line connection with the other party is established (step S120), the call becomes possible (step S122), and when the call ends, a predetermined call end process is performed (step S124). After the call ends, the process proceeds to step S104 to reconnect to the network 20. The IP address assigned when reconnecting to the network 20 may be different from the IP address originally assigned.
[0119]
On the other hand, when the setting for disclosing the status information is performed in step S108 (YES determination), the user image taken by the camera unit is disclosed to the client devices belonging to the same group (step S112). In the camera unit, image recording is performed every 5 seconds, and when the latest image is recorded, the image recorded so far is deleted from the memory, and the latest image is transmitted to the P2P connected group member. Is performed (step S114).
[0120]
It is also possible to apply an IP telephone (Internet telephone) that makes a telephone call using the Internet network instead of the fixed telephone network to the above-described telephone system with a television.
[0121]
An IP telephone is a telephone system that makes a telephone call using the TCP / IP protocol, and is a voice telephone system that is provided by using IP network technology in part or all of a network. Applications such as WWW (World Wide Web) are used. Internet telephones that use the same IP network (Internet) that are used in the Internet may be included.
[0122]
In the IP telephone, a telephone connection can be established without disconnecting the connection with the network 20, and the process of disconnecting the connection with the network 20 when the telephone connection is established can be omitted.
[0123]
That is, step S118 in FIG. 5 can be omitted, and after the call termination process, the process can proceed to step S116 to wait for an incoming call.
[0124]
In the telephone system with a TV configured as described above, status information of other client devices is displayed on a display device provided in each client device, and a call is made after confirming status information of a client device that desires a call. be able to. Therefore, it is possible to prevent making calls to absentees and making calls to other parties that are difficult to answer. It is also possible to send a message including a message to the person you want to call.
[0125]
In the present embodiment, a telephone with a TV is illustrated. However, the notebook computer 18 and the desktop computer shown in FIG. 1 are provided with imaging means such as a CCD camera unit 26, and a microphone, speaker, and control application that can realize a telephone function. It can also be realized in devices equipped with software.
[0126]
【The invention's effect】
According to the present invention, position information of a terminal device connected to a network is managed by a server, and a peer-to-peer connection with a desired counterpart terminal device (first terminal device) is performed based on the position information acquired from the server. The status information including the image that is established and imaged using the imaging means provided in the partner terminal device is acquired by the terminal device (second terminal device), and the information is provided in the terminal device. Since it is configured to be displayed on the display device, the state of the other party can be known. In addition, since status information is acquired from the other terminal device by peer-to-peer connection, the server is not burdened.
[0127]
Also, for hybrid lines where data communication over the network and telephone line network cannot be performed simultaneously, data communication is temporarily suspended during a call, the call is established, and data communication is automatically resumed when the call ends. It is preferable to perform control so that connection processing to a network is performed.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration of a data communication system according to an embodiment of the present invention.
FIG. 2 is a block diagram showing a configuration of a television telephone according to an embodiment of the present invention.
FIG. 3 is a diagram showing a display device for a TV telephone that displays status information.
FIG. 4 is a flowchart showing the flow of control of a telephone system with a TV.
FIG. 5 is a flowchart showing the flow of control of a telephone with a TV.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 10 ... Center server, 12, 14, 16 ... Telephone with television, 20 ... Network, 22 ... Storage, 28, 32, 44, 46, 134 ... Display device, 100 ... Camera part, 102 ... Telephone part, 104 ... Control part , 110 ... communication unit, 120 ... photographing lens, 122 ... CCD, 126 ... A / D converter

Claims (6)

A communication system comprising: a server connected to a network; and a plurality of terminal devices including a first terminal device and a second terminal device connected to the server via the network,
The server includes position information management means for managing position information indicating a position of the terminal device connected to the network on the network;
Position information providing means for providing the position information managed by the position information managing means to a terminal device connected to the network;
With
The first terminal device includes an imaging unit that captures an image serving as status information of the first terminal device;
Connection control means for performing control to establish connection to the network;
First peer-to-peer connection control means for controlling to establish a peer-to-peer connection for performing data communication with the second terminal device;
Status information sending means for sending the status information of the first terminal device including an image taken by the imaging means to the second terminal device by peer-to-peer connection established by the connection means; ,
With
The second terminal device has connection control means for performing control for establishing connection to the network;
Position information acquisition means for acquiring position information of a terminal device on the network provided by the position information providing means of the server;
Second peer-to-peer connection for performing control to establish a peer-to-peer connection for performing data communication with the first terminal device based on the position information acquired by the position information acquisition means Control means;
Status information acquisition means for acquiring the status information transmitted by the status information transmission means of the first terminal device;
Display means for displaying status information acquired by the status information acquisition means;
A communication system comprising: A terminal device that can be connected to a network,
Imaging means for imaging an image that is status information of the terminal device;
Connection control means for performing control to establish connection to the network;
Position information acquisition means for acquiring position information of other terminal devices connected to the network from a server on the network;
Peer-to-peer connection control means for performing control to establish a peer-to-peer connection with other terminal devices on the network based on the position information acquired by the position information acquisition means;
Status information sending means for sending status information of its own terminal device including an image picked up by the image pickup means to another terminal device connected by the peer-to-peer;
Status information acquisition means for acquiring status information of other terminal devices transmitted from other terminal devices peer-to-peer connected by the peer-to-peer connection control means;
Display means for displaying status information acquired by the status information acquisition means;
A terminal device comprising: The status information sending means sends status information in place of the image to a terminal device connected in a peer-to-peer manner when the image taken by the imaging means is not sent. The terminal device described. 4. A telephone call means capable of sending a call signal for calling a desired party, making a telephone call connection when the call partner responds to the call signal, and making a voice call. The terminal device described. 5. The terminal device according to claim 4, wherein the network includes a telephone line network, and status information of a call partner displayed on the display means can be confirmed before the telephone call connection is made. A communication method in a communication system comprising a server connected to a network and a plurality of terminal devices connected to the server via the network,
An imaging step of imaging an image serving as status information of the first terminal device by an imaging means provided in the first terminal device;
A connection step in which the first terminal device establishes a connection to the network;
A location information providing step of providing location information indicating a location on the network of the first terminal device connected to the network by the connection step from the server to the second terminal device;
A location information acquisition step in which the second terminal device acquires the location information of the first terminal device provided by the location information providing step;
When the second terminal device acquires the position information of the first terminal device in the position information acquisition step, the second terminal device is based on the position information of the first terminal device. A peer-to-peer connection process for establishing a peer-to-peer connection with the device;
When a peer-to-peer connection between the first terminal device and the second terminal device is established in the peer-to-peer connection step, an image that is status information of the first terminal device is A status information sending step for sending from the first terminal device to the second terminal device;
A status information acquisition step in which the second terminal device acquires an image that is status information of the first terminal device transmitted in the status information transmission step;
A status information display step of displaying an image, which is status information of the first terminal device acquired by the second terminal device in the status information acquisition step, on a display device provided in the second terminal device;
A data communication method comprising:

Images