JP2000308034A - Video conference system, video conference system control method, and storage medium storing program for controlling video conference system - Google Patents

Abstract

(57) [Problem] There is a problem of a huge data processing load on a network and a client to which a TV conference system is connected. SOLUTION: Input means for inputting audio data to a microphone of a transmission source client, the transmission source client comprising:
The voice data determining means for determining whether the input voice data is a user voice or environmental noise, and when the voice data determining means determines that the voice data is a user voice, the voice data is transmitted to the server. Transmitting means for transmitting, receiving the audio data transmitted to the server,
The transmitting means for transmitting an image request command for requesting image data from the server to the transmission source client; and receiving the image request command for requesting image data from the server, transmitting the image data input from the transmission source client to the server. And a transmission means for transmitting the audio data and the image data transmitted from the transmission source client to the transmission destination client by the server.
Conference system.

Description

DETAILED DESCRIPTION OF THE INVENTION

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a TV conference system, and more particularly to a TV conference system having a client / server system configuration, a method of controlling the TV conference system, and storage for storing a program for controlling the TV conference system. Media related.

2. Description of the Related Art A conventional technique will be described below with reference to FIGS. In the conventional one-to-one TV conference system, each client terminal (hereinafter, referred to as a client) A or B connected to a network has a microphone, a camera, a speaker, and the like, and audio data input from the microphone and the camera. The image data and the image data are transmitted as they are or after compression-encoding and transmitted to other clients participating in the TV conference, and the voices and images of the clients A and B are mutually exchanged via a network for communication. At this time, of course, each client has a TV
Conference software is installed, and each of the video conference software controls the video conference system. The processing of compressing and encoding an image and decoding the compressed image data used at this time has a heavy processing load on the network and the client. When the application software for a PC (personal computer) using the TV conference software as a client is considered, since the load of image processing is high, the application for the TV conference occupies the processing capability of the PC. There is a problem that the processing ability cannot keep up and other applications do not operate properly. On a PC with low processing capacity,
There was also a problem that the TV conference system application itself could not be executed due to insufficient processing capacity. Further, even if the image data used in the TV conference system is compressed and coded, the amount of information is larger than that of voice and the like, and since image data is always transmitted and a large amount of data flows through the network, Is occupied. Also, in a TV conference, the displayed screen content is the upper body of the other party, and is often close to a still image unless there is a large change such as the user leaving the camera or the like. In this TV conference system, since fixed image data is always transmitted, wasteful image data that does not change at all is transmitted, and image data transmission and image data processing are performed efficiently. There are no problems. Next, with reference to FIG. 22, a description will be given of a multipoint TV conference system that connects the multipoints. As shown in FIG. 22, in a multipoint TV conference system, it is assumed that clients A to D are connected to a network. For example, considering client A, it is possible to reduce the processing load of image processing in the TV conference system. For this reason, it is often the case that only the images of the speakers are displayed without limiting the images of the users of all the clients participating in the conference, or the number of displayed users is limited, so that the images of all the users cannot be viewed. (Because the processing capability of the client PC cannot be maintained until the image of the user is displayed). Further, in the multipoint TV conference system, even if the number of users displayed on one client is limited, the image data is represented by (the number of clients participating in the conference-1) * (the number of users displayed by one client). There is a problem that minute image data flows through the network, which places a heavy load on the network.

As described above, in the conventional TV conference system, the data load on the network to which the TV conference system is connected increases, and the client connected to the network has a large data load. Has to process a huge amount of data, and there is a problem of a huge amount of data in the TV conference system. SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and has as its object to eliminate a useless data transfer and to reduce a processing load on a client and a load on a network as compared with a conventional TV system. It is an object of the present invention to provide a conference system, a control method of the TV conference system, and a storage medium storing a program for controlling the TV conference system.

[MEANS FOR SOLVING THE PROBLEMS] To achieve the above object
In the present invention, the source client and the destination client
Client, the source client and the destination client
Client / server with a server to connect clients
In a TV conference system having a system configuration,
The source client inputs voice data from the voice input device.
Input means for inputting, and the source client inputs an image.
Input means for inputting image data from a device, and the transmission source
The client converts the input voice data to the user's
The client for determining whether it is voice or environmental noise;
Audio data determination means provided in the audio data,
If it is determined by the data determination means that the voice of the user,
Transmitting means for transmitting the audio data to the server;
Receiving the voice data transmitted to the server,
Server sends an image request command to request image data
The transmission means for transmitting to the client and the server
Receiving an image request command requesting these image data,
The image data input by the source client is
Transmitting means for transmitting to the server;
The audio data transmitted from the former client and the image
Transmission means for transmitting image data to the destination client
TV conference system characterized by comprising:
You. Also, the source client, destination client,
Connect the source client and the destination client
Client-server system having a server connected
In the TV conference system having the configuration of
The client inputs voice data from the voice input device.
Input means and the source client from the image input device
Input means for inputting image data, and the input audio data;
Transmitting means for transmitting data to the server;
If the transmitted voice data is the user's voice or
A sound data provided in the server to determine whether the sound is sound.
Data determination means and the sound data determination means
If it is determined to be a voice, the source client
To send an image request command requesting image data to
Communication means and the image request command from the server.
When the source client receives the message, the source client
Client sends the input image data to the server
Transmitting means for transmitting, and the server
The audio data and the image data transmitted from the
Transmission means for transmitting to the destination client
This is a TV conference system characterized in that: Also send
Source client, destination client, source client
Server connecting the client to the destination client
T having a client-server system configuration
In the V conference system, the image of the source client is displayed.
A first image data corresponding to a first time point from the image input device;
Corresponding to a second point in time different from the first image data.
Image input means for inputting the second image data,
The first image data provided in the client device
Comparing and comparing the second image data with the second image data;
As a result of the comparison, the first image data and the second image data
If there is a predetermined change with the image data, the source
Client sends an image change notification command to the server.
Transmitting means, and the image change notification transmitted to the server.
Upon receiving a command, the server requests image data
Sending an image request command to the source client
Transmitting means; and the image data transmitted to the client.
Receiving the image request command requesting the
Image input by the client by the image input means
Transmission means for transmitting the transmission to the server, and the server
The client transmits the image data from the source client
Transmission means for transmitting to the client
This is a TV conference system. Also, the sending client,
The destination client, the source client and the destination
A client with a server that connects the trusted clients
Video conferencing system that has the configuration of
In the above, from the image input device of the source client,
First image data corresponding to a first time point,
Second image data corresponding to a second time point different from the image data
Image input means for inputting data, and the input first image
Sending the data and the second image data to a server
Means and the server is adapted to transmit the first image
Comparison determining means for comparing data with the second image data
And the result of the comparison, the first image data and the second
When there is a predetermined change between the image data of
Sends an image change notification command to the source client
Transmitting means for transmitting, and the source client
The image data input by the image input means to the server
Transmitting means for transmitting, and the server comprising:
Client sends the image data to the destination client
TV conference system, comprising:
Stem. Also, the source client, destination client
Client, the source client and the destination client
Client server with server to connect clients
In a TV conference system that takes the configuration of
The source client sends voice data from the voice input device.
Input means for inputting, and the source client
Input means for inputting image data from an input device;
The former client sends the input audio data to the user
The client to determine whether the sound is ambient noise or environmental noise.
An audio data determination means provided in the client;
Data is determined to be the user's voice by the data determination means.
Transmitting means for transmitting the audio data to the server
And receiving the audio data transmitted to the server,
The server issues an image request command requesting image data.
The transmitting means for transmitting to the transmission source client;
Receives an image request command requesting image data from the
The image data input by the source client.
Transmitting means for transmitting data to the server;
From the client's image input device to the first point in time
First image data that differs from the first image data
Image for inputting second image data corresponding to a second time point
An input means, provided in the source client,
Comparing the first image data with the second image data;
Comparing and judging the first image data as a result of the comparison.
A predetermined change between the data and the second image data.
The source client sends an image change notification command.
Transmitting means for transmitting to the server; transmitting means for transmitting to the server;
Receiving the image change notification command, the server
Source client sends an image request command to request image data
Sending means for sending to the client, and sending means to the client.
Received an image request command requesting the received image data.
Then, the transmission source client is operated by the image input means.
Transmission means for transmitting the image input to the server
The server sent from the source client.
Sending the audio data and the image data to the destination client
And a transmitting means for transmitting to the TV
It is a conference system. Also, send client, send
Destination client, source client and destination
A client with a server that connects the client
・ In a TV conference system with a server system configuration
The source client sends a voice
Input means for inputting data, and
Input means for inputting image data from an image input device;
Transmitting means for transmitting the input voice data to the server
And the voice data transmitted to the server
The server determines whether it is voice or environmental noise.
Provided voice data determination means, and the voice data determination means
If it is determined by the means that the voice is the user's voice,
Image request frame that requests image data from the originating client
Transmitting means for transmitting a command, and the image from the server.
When the request command is received by the source client
If the source client inputs the image data
Transmitting means for transmitting to the server, and the transmission source
From the client's image input device,
First image data, and a first image data different from the first image data.
Image input for inputting the second image data corresponding to the time point 2
Force means, provided in the source client,
Comparing the first image data with the second image data
Comparing and judging the first image data as a result of the comparison;
There is a predetermined change between the data and the second image data.
If the sending client sends an image change notification command before
Transmitting means for transmitting to the server, and transmitting to the server
Upon receiving the image change notification command, the server
Source client sends image request command to request data
Transmitting means to the client and transmitting to the client
Received the image request command requesting the image data
The source client is operated by the image input means.
Transmitting means for transmitting the input image to the server,
A server transmits the voice data from the source client;
And transmitting the image data to a destination client
TV conference system characterized by comprising means
is there. Also, the source client and destination client
, The source client and the destination client
Client / server system having a server for connecting
In a TV conference system having a system configuration,
Former client inputs voice data from voice input device
Input means, and the source client is an image input device.
Input means for inputting image data from the
Client inputs the input voice data into the user's voice.
The client for determining whether the noise is environmental noise
Voice data determination means provided in the
If it is determined by the determination means that the voice of the user,
Transmitting means for transmitting voice data to the server;
Receiving the audio data transmitted to the server,
Sends an image request command requesting image data to the source
The transmitting means for transmitting to the client,
Upon receiving an image request command requesting image data,
The image data input by the transmission source client is
Transmitting means for transmitting to the client,
From the image input device of the
Image data, a second time point different from the first image data
Input means for inputting the second image data corresponding to the image
And the input first image data and the second image data.
Transmitting means for transmitting data to a server; and
The transmitted first image data and the second image data
Comparison determination means for comparing the data with the
The location between the first image data and the second image data.
If there is a certain change, the server sends an image change notification command
Transmitting means for transmitting to the transmission source client,
The source client inputs the image using the image input unit.
Transmitting means for transmitting the image data to a server,
A server transmits the voice data from the source client;
And transmitting the image data to a destination client
TV conference system characterized by comprising means
is there. Also, the source client and destination client
, The source client and the destination client
Client / server system having a server for connecting
In a TV conference system having a system configuration,
Former client inputs voice data from voice input device
Input means, and the source client is an image input device.
Input means for inputting image data from the
Transmitting means for transmitting voice data to the server;
The audio data sent to the server
Sound provided on the server to determine whether the noise is ambient noise
Voice data determination means; and
If it is determined that the voice is
Send an image request command to request
Transmitting means, and the image request command from the server
Is received by the source client, the source
Client sends the input image data to the server
Sending means for sending, and the sending client
A first image data corresponding to a first point in time is input from the image input device.
Data, corresponding to a second time point different from the first image data
Image input means for inputting the obtained second image data;
The input first image data and the second image data are supported.
Transmitting means for transmitting to the server, and the server
The obtained first image data and the second image data
Comparing means for comparing, the result of the comparison, the first
A predetermined change between image data and the second image data
The server sends the image change notification command
Transmitting means for transmitting to the source client;
The image input by the client through the image input means.
Transmitting means for transmitting image data to a server, and the server
However, the voice data and the
Transmitting means for transmitting image data to a destination client;
A TV conference system comprising:
In addition, the source client, the destination client,
Connect the source client and the destination client
Of a client / server system having a server
In the method for controlling a TV conference system,
Input voice data to the voice input device of the client
The image data is input to the image input device of the transmission source client.
Data, and the source client inputs the
Whether the audio data is user's voice or environmental noise
Is determined, and if it is determined that the voice is the voice of the user,
The audio data to the server and send it to the server.
The server receives the transmitted audio data and the server
Client that sends an image request command to request data
To send image data from the server
Upon receiving the request command, the source client inputs
Transmitting the image data to the server,
Is the audio data transmitted from the source client.
Data and the image data to the destination client.
A method for controlling a TV conference system, comprising:
You. Also, the source client, destination client,
Connect the source client and the destination client
Client-server system having a server connected
In the control method of the TV conference system having the configuration of
Enter voice data into the voice input device of the sending client.
To the image input device of the source client.
Data and send the input voice data to the server
The voice data transmitted to the server is
Determining whether the sound is voice or environmental noise;
If the determination unit determines that the voice is the user's voice, the
Image request to request image data from the sending client
A command, and transmits the image request frame from the server.
If the sending client receives the
The originating client transmits the input image data to the server.
Server, and the server is the source client
The audio data and the image data transmitted from the
TV conference characterized by sending to a trusted client
This is a system control method. Also, the source client
Client, the destination client, the source client and the
A client that has a server that connects the destination client
TV conference system with client / server system configuration
In the method for controlling the system, the image of the source client
The first image data corresponding to the first time point is input from the input device.
Corresponding to a second point in time different from the first image data.
The second client inputs the second image data
, The first image data and the second image
Data, and as a result of the comparison, the first image data
A predetermined change between the data and the second image data.
The source client sends an image change notification command.
Transmitting the image modification transmitted to the server;
Server receives image data, the server requests image data.
Send the image request command to the sending client
Requesting the image data transmitted to the client
Receiving the image request command to
The server inputs an image input by the image input means to a server.
To the server, the server from the source client
Transmitting the image data to a destination client;
A method for controlling a TV conference system. Also, the sender
Client, destination client, source client
Server that connects the client to the destination client.
TV with client / server system configuration
In the method for controlling a conference system, the source client
From the image input device of the
Image data, a second time point different from the first image data
And input the second image data corresponding to
Sending the first image data and the second image data to the server
The server transmits the first image data
Data is compared with the second image data.
As a result, the first image data and the second image data
If there is a predetermined change during the period, the server
Command to the source client, and the source
The client input by the image input means
Sending the image data to a server, wherein the server
The source client sends the image data to the destination client
This is a control method of the TV conference system for transmitting to the TV conference system. Ma
Source client, destination client,
Connect the source client and the destination client
Configuration of client-server system with server
The method of controlling a TV conference system, comprising:
Input voice data into the voice input device of the former client,
Image data to the image input device of the source client
Input, and the source client inputs the input voice
Determine whether data is user voice or environmental noise
If it is determined that the voice is the user's voice,
The voice data is transmitted to the server, and transmitted to the server.
Receiving the audio data, the server
Send the requested image request command to the sending client
And an image request code for requesting image data from the server.
Command before the source client has entered it
Transmitting the image data to the server;
From the client's image input device,
First image data, and a first image data different from the first image data.
2, the second image data corresponding to the time point
The first image data provided in the client device
And the second image data, and as a result of the comparison,
Between the first image data and the second image data
If there is a predetermined change, the source client
Sends the activation notification command to the server and sends it to the server.
Receiving the image change notification command
Sends an image request command requesting image data to the source
Sent to the client and sent to the client.
Upon receiving an image request command requesting image data,
The client is input by the image input means.
Transmits the image to the server, and the server
The audio data and the image data transmitted from the client.
T to the destination client.
This is a control method of the V conference system. Also, the source client
Client, destination client, source client
And a server connecting the destination client,
TV conference system with client / server system configuration
In the method for controlling the system, the transmission source client
Voice data is input to a voice input device, and
Input image data into the image input device of Ant
Transmitted to the server, and transmitted to the server.
The captured audio data as the user's voice or environmental noise.
And it was determined that the voice was the user's voice.
Requesting image data from the source client
Send an image request command and send the image from the server
When the request command is received by the source client
If the source client inputs the image data
To the server, and the source client
A first image corresponding to a first point in time
Data at a second point in time different from the first image data
Input the second image data corresponding to the
The first image data and the second image data
Comparing the image data with the first image.
A predetermined change between the image data and the second image data
If there is, the source client sends an image change notification command.
The image transmitted to the server.
Upon receiving the image change notification command, the server
Sends an image request command requesting
The image data transmitted to the client.
Receiving the image request command
The image input by the image input means.
Server, and the server is the source client
From the destination client to the audio data and the image data.
Control of a TV conference system characterized by transmitting to a TV conference system
Is the way. Also, the source client and destination client
Client, the source client and the destination client
Client / server with a server to connect clients
In the control method of the TV conference system taking the system configuration
And the voice input device of the source client
Data input to the image input device of the source client.
Enter the image data in the
If the input voice data is the user's voice or
The sound data determination means determines whether the sound is a sound.
If the audio data is determined to be
The voice data transmitted to the server and transmitted to the server.
Receiving the image request from the server
Sends a command to the sending client and sends it to the server
Receiving an image request command requesting these image data,
The image data input by the source client is
To the server, and
A first image data corresponding to a first time point from the image input device;
Corresponding to a second point in time different from the first image data.
Input second image data, and the input first image
Transmitting the data and the second image data to a server,
A server configured to transmit the first image data and
Comparing with the second image data, and as a result of the comparison,
A predetermined distance between the first image data and the second image data;
If there is a change, the server sends an image change notification command before
To the source client, the source client
The image data input by the image input means
To the server, and the server communicates with the source client.
Client sends the audio data and the image data to the destination
TV conference system for transmitting to a client
Is a control method. Also, the source client, destination
Client, the source client and the destination client
Client / server with server to connect clients
How to control a TV conference system with a server system configuration
In the method, the voice input device of the source client
Enter the audio data and enter the image of the source client.
Input image data to the input device, and the input audio data
To the server, the audio data transmitted to the server
Is determined to be the user's voice or environmental noise,
The voice data determination means determines that the voice is a user voice
Request, image data is required to the source client.
Send an image request command to request from the server
The source client receives the image request command.
The image data that the source client inputs.
Data to the server and the source client
From the image input device of the
Image data, a second time point different from the first image data
And input the second image data corresponding to
Sending the first image data and the second image data to the server
The server transmits the first image data
Data is compared with the second image data.
As a result, the first image data and the second image data
If there is a predetermined change during the period, the server
Command to the source client, and the source
The client input by the image input means
Sending the image data to a server, wherein the server
The audio data and the image data from the original client
TV meeting characterized by sending to the destination client
This is a control method of the conference system. In addition, the source client
The image data transmitted from the ant to the server is based on the source
The image data input from the client
Difference data between image data at different points in time using image compression
17. The method according to claim 9, wherein
The control method of the TV conference system according to any one of the above,
You. In addition, the TV conference system of the client / server system
System, the client of the TV conference system
A storage medium storing a program for controlling the
The input voice data is the user's voice or environmental noise
The audio data is stored in the server.
To send data to the server and image data from the server.
Receiving the image request command
Procedure for transmitting the input image data to the server
And the audio data and the image data from the server.
Receiving a TV conference system.
Stored a program that controls the system's client
It is a storage medium. Client / server system
The TV conference system,
Storage medium storing the program that controls the client
Transmitting the input voice data to the server.
Requesting image data sent from the server
Receiving an image request command to perform
Receiving the image request command from the
The ant sends the input image data to the server.
The audio data and the image from the server
Receiving the data.
A program that controls the client of the V conference system
This is the storage medium in which the data is stored. Also client / server
The TV conference used in the TV conference system of the system.
Stores programs that control system clients
The first image data and the second image data
Comparing the image data with the image data of
The location between the first image data and the second image data.
If there is a certain change, the image change notification command
Server and the image data from the server.
Receiving a requested image request command;
Image request frame for requesting the image data received from the
Receiving the command, the image input by the image input means.
Transmitting the image to the server; and transmitting the image from the server.
Receiving the image data.
A program that controls the client of the V conference system
This is the storage medium in which the data is stored. Also client / server
The TV conference used in the TV conference system of the system.
Stores programs that control system clients
A storage medium, wherein the input first image data and the
Transmitting the second image data to the server;
Receiving an image change notification command from the server;
The image data input by the image input means is stored in a server
And transmitting the image data from the server.
Receiving a TV conference system.
Stored a program that controls the system's client
It is a storage medium. Client / server system
The TV conference system,
Storage medium storing a program for controlling the server
Means for receiving voice data from the client
Order and source of image request command to request image data
Sending to the client, the source client
Receiving the image data from the
Transmit the audio data and the image data from the client
Sending to the destination client
To control the server of the TV conference system
Is a storage medium in which is stored. In addition, client services
Used in the TV conference system of the
Of the program that controls the server of the conference system
A storage medium for storing audio data from the client.
Receiving, and transmitting the voice data in a user's voice.
And whether the noise is environmental noise.
If the source voice is determined to be
Sends an image request command to the client to request image data.
And the image data from the source client.
And receiving from the source client.
Destination audio data and the image data
And transmitting to the client.
Stored a program to control the conference system server
It is a storage medium. Client / server system
The TV conference system,
Storage medium storing a program for controlling the server
Therefore, the input first number provided in the transmission source client
Comparing the first image data with the second image data;
Receives image change notification command from source client
And an image request command to request image data.
Sending to the source client;
Image input from the client by the image input procedure.
Receiving an image and receiving from the source client
Transmitting the image data to the destination client
And a video conference system.
A storage medium storing a program for controlling the server.
In addition, the TV conference system of the client / server system
To control the server of the TV conference system.
Storage medium that stores programs
The first image data input from the client and the second image data.
Receiving image data; and receiving the received first data.
Procedure for comparing image data with the second image data
And sends an image change notification command to the source client.
The transmitting procedure and the image data from the source client
Receiving the data from the source client.
Sending the received image data to a destination client
And a TV conference system.
A storage medium storing a program for controlling the server.
You. TV conference system having the above configuration, and TV conference
System control method and TV conference system control
According to the storage medium storing the program, the user
Input screen when the user is
Only when there is a change in the image, the image
Data is transmitted and received, and image data is transmitted
By transmitting only necessary image data, the conventional T
Processing load of client rather than video communication method of V conference
Thus, the load on the network can be reduced.

BRIEF DESCRIPTION OF THE DRAWINGS FIG.
This will be described with reference to FIG. In addition, common to all drawings
Parts are assigned the same reference numerals. [First Embodiment] FIG. 1 shows a first embodiment of the present invention.
It is such a schematic diagram. FIG. 2 shows a first embodiment of the present invention.
FIG. 3 is a diagram showing a sequence of such audio / video communication. Ma
FIG. 17 shows a client according to the first embodiment of the present invention.
Client, which is a configuration diagram of a remote server system
(Client A 1102, client B 1103
Or client C1104), destination client
(When client A 1102 is the source client
Has client B1103 or client C1
104, and the client B 1103
At the time of the client, the client A 1102 or the client
Client C1104, and client C1104
For the source client, client A 110
2 or client B 1103), the source client
Server that connects the client to the destination client.
TV with client / server system configuration
The conference system will be described.
Input voice data to the voice input device (microphone) of the client
Enter the image on the image input device of the source client
Enter the data. Next, the source client
If the input voice data is the user's voice or
Sound provided to the client to determine whether the sound is sound
Voice data, and the voice data determination means
If it is determined that the audio data is audio, the audio data is
Send to the bus. Further, the sound transmitted to the server
Upon receiving voice data, the server requests image data
Send an image request command to the source client, and
An image request command for requesting image data from the server
Receiving the image data input by the source client.
Data to the server. Next, the server
The voice data transmitted from the source client and
The image data is transmitted to the destination client. Sa
In more detail, each client as shown in FIG.
(1101 to 1104)
Interface, microphone, speaker, microphone and speaker.
Sound interface for inputting and outputting analog audio signals
Gaps that input images from cameras, cameras, and cameras
With audio and voice data from a microphone.
Input means to input image data from the camera.
Receiving the transmitted audio data and sending it to the speaker
Means for outputting, receiving the image data to be transmitted, and monitoring
(PC) or Works with means for outputting to
Clients such as WS (WS)
Client, have a network interface, and
Receives audio data and image data transmitted by the client
And send to participating clients other than the sender
Data communication client such as PC or WS with transmission means
One-to-one or multipoint TV with server as server
The meeting system is connected to the client / server system.
The TV conference system has a system configuration. FIG.
TV conference system with client server system configuration
The system is shown in more detail. As shown in FIG.
The client is connected to a network
A network interface unit;
Image data codec
Unit, audio data codec unit and control command processing unit
It is connected. Further, the audio data codec section
Is connected to the audio data analysis unit, and
Codec section, audio data codec section, control command
Client that controls the voice processing unit and voice data analysis unit
A function control unit is provided. Further, the image data
The codec section has a camera via the image data input / output section.
And a monitor are connected to the audio data codec.
Microphone and microphone via the audio data input / output unit.
A peaker is connected. In addition, the client
Is provided with a device control unit for controlling all the parts. Ma
The server has a network connected to the network.
A work interface unit;
The image data distribution processing unit and the audio data
Data distribution processing unit and control command processing unit are connected.
The image data distribution processing unit and the audio data distribution processing unit
And a server function control unit that controls the control command processing unit
is set up. As shown in FIG. 1, the source client
(Client A 1102 or client B 11
03), a voice input device (My
Input the voice data to the client
Whether the input voice data is the voice of the user
Determine whether the noise is environmental noise
Is transmitted, the voice data is transmitted to the server.
You. Receiving the audio data transmitted to the server,
Send image request command to request image data from server
The image data is transmitted from the server to the client
Receiving the image request command requesting
The image data input from the client is transmitted to the server. Sa
Further, the server is transmitted from the source client.
The audio data and image data
If the original client is client A 1102,
Client B 1103 and the source client is
In the case of client B 1103, client A1
102), and the sender client
The image data transmitted from the client to the server
This is image data input from the client. Further details
More specifically, as shown in FIG. 1 and FIG.
In one embodiment, a server 1
101, client A1102, client B1
One-to-one TV in an environment where 103 is connected via a network
The client that is having a meeting
Is client A1102, client A11
02 is the audio data input from the microphone
Input voice data instead of sending
Client A decides whether it is the voice of the
1102 determines. Then, the input audio data is
If the voice data is determined to be
Is transmitted to the server 1101. The determination means at this time includes:
For example, using the conventional silence compression technology, etc.
Can be determined. As a result, the client A 1102
Only sends voice data to the server 11 when the user speaks.
Send to 01. The server 1101 receives the received audio data.
The destination client to the client B110.
If the number is 3, the data is transmitted to the client B 1103. This
At this time, the server 1101
An image request to send an image to
Send request command. And the image request command
A1102, which has received the
The transmitted image data is transmitted to the server 1101,
The server 1101 that has received the data
The data is transmitted (distributed) to the transmission destination client B 1103. This
As a result, the image other than the case where the user
However, the screen content displayed in the TV conference is
Unless you are the upper body of the opponent and there are no significant changes, still images
In many cases, even if the image becomes a still image,
There is little concern on the user side. Also, when speaking,
Since the image data is transferred to the connection destination, the user's mouth movement
Is transmitted to the connection destination. This allows image data to be used for efficient fishing.
Data communication, processing load on the client side, network
Work load can be reduced. [Second Embodiment] FIG. 3 shows a second embodiment of the present invention.
It is such a schematic diagram. FIG. 4 shows a second embodiment of the present invention.
FIG. 3 is a diagram showing a sequence of such audio / video communication. Departure
Client-server system according to the second embodiment of the present invention
FIG. 18 shows a TV conference system having a system configuration.
However, the difference from the first embodiment of the present invention is that the client
The audio data analysis system installed on the ant side,
In the second embodiment of the present invention, the server is installed on the server side.
It is a point. More specifically, FIG. 4 and FIG.
As described above, the second embodiment of the present invention
05, the server 1301, the client A 1302,
Client B 1303 and client C 1304
Hold a TV conference between three locations in an environment connected by networks
It is an embodiment of the case. Client A 1302
The audio data input from the microphone is sent to the server as it is
I do. The server 1301 converts the received audio data as it is.
Client B1303, client C1304
Instead of sending to the user, the received audio data
It is determined whether the sound is voice or environmental noise (first actual
As in the embodiment, for example, in the determination of the audio data,
Using silence compression technology). Then, the received audio data
If the data is determined to be the user's voice data,
Client B 1303 and Client C 1304 receive
Transmit the audio data. This allows the user to speak
Only when the audio data is
It is distributed to client C1304. And received
If it is determined that the audio data is the user's voice,
Sends an image to client A1302 with voice data
Send an image request command requesting that the image be transmitted.
Client A 1302 that has received the image request command
Transmits image data input from the camera to the server 1301
Server 1301 that has transmitted the image data and received the image data,
The received image data is transmitted to the
Send to client C1304. As a result, the user
Except when you speak, the image will be a still image,
In, the displayed image content is
Unless there is a major change, it is almost a still image
In many cases, even if the screen becomes a still image,
It is rare. When speaking, the image data
Because the call is forwarded to the destination, the user's mouth movements are transmitted to the destination.
available. This allows efficient transmission and reception of image data
Yes, processing load on the client side, network load
Can be reduced. In addition, the client
Reduced on a single client
It is also possible to display images of all users participating in the conference.
You. [Third Embodiment] FIG. 5 shows a third embodiment of the present invention.
It is such a schematic diagram. FIG. 6 shows a third embodiment of the present invention.
FIG. 3 is a diagram showing a sequence of such audio / video communication. Departure
Client-server system according to the third embodiment of the present invention
In a TV conference system having a system configuration, FIG.
Although shown, the difference from the first and second embodiments of the present invention is shown.
Is an image transmitted and received in the TV conference system.
The image data difference value analysis unit that analyzes the data difference value
This is a point provided on the client side. Source Cry
Ant (Client A 1502, Client B15
03 or client C1504), destination client
Client (client A 1502 is the client
Sometimes client B1503 or client
C1504, and the client B1503
For clients, client A1502 or
The client C1504 and the client C150
4 is the source client, the client A1
502 or client B 1503), the source
Server connecting the client and the destination client
Take the configuration of a client-server system with
The TV conference system will be described first.
From the client's image input device to the first point in time
First image data that differs from the first image data
The second image data corresponding to the second time point is input. Next
The first client provided in the transmission source client;
A comparison between the image data and the second image data is performed.
As a result of the comparison, the first image data and the second
If there is a predetermined change with the image data of
Client sends an image change notification command to the server
I believe. Further, the image change notification transmitted to the server is transmitted.
Receiving the information command, the server requests image data.
Sends an image request command to the sending client
An image requesting the image data transmitted to the client.
Upon receiving the image request command, the source client
Send the image input by the image input means to the server
I do. Finally, the server is the source client
Transmits the image data to the destination client.
More specifically, as shown in FIGS. 5 and 6,
The third embodiment of the present invention relates to a network 1504
Server 1501, client A 1502, client
In an environment where Ant B1503 is connected via a network, 1
This is an embodiment in which a one-to-one TV conference is held. Cry
Ant A1502 converts the audio data input from the microphone
The data is transmitted to the server 1501 as it is. Server 1501
Sends the received audio data to client B 1501.
Send. Client B1502 also enters from the microphone.
The input voice data is transmitted to the server 1501 as it is,
The server 1501 converts the received audio data into client data.
To the client A 1502,
Voice communication is performed between the clients B1503. Client
In A1502, if the user moves greatly, the camera
Is the image data input last time
Will change greatly. Client A 1502
Determines that the change in the image is large (image data
For example, to determine that the
Server 150).
Requests image data indicating that the user has moved significantly to 1.
To send an image request command. Request image data
Server 1501 having received the image request command
Sends an image request command to former client A 1502
You. Client A1 that has received the image request command
Reference numeral 502 denotes a server 1 which stores image data input from a camera.
Server 1501 that has transmitted image data to server 501
Transmits the received image data to the destination client B15.
02. This allows the user to
Transfer the minimum required image data, such as when you leave
Image data can be communicated efficiently, processing on the client side
Load and network load can be reduced. [Fourth Embodiment] FIG. 7 shows a fourth embodiment of the present invention.
It is such a schematic diagram. FIG. 8 shows a fourth embodiment of the present invention.
FIG. 3 is a diagram showing a sequence of such audio / video communication. Departure
Client-server system according to the fourth embodiment of the present invention
In a TV conference system having a system configuration, FIG.
However, the difference from the third embodiment of the present invention is that
Image data difference value analysis unit installed on the client side
However, in the fourth embodiment of the present invention, it is installed on the server side.
That is the point. More specifically, FIG. 7 and FIG.
As described above, the fourth embodiment of the present invention
1704, a server 1701, a client A 170
2. Client B 1703 is connected via network
This is an embodiment in which a one-to-one TV conference is held in an environment.
You. Client A 1702 receives the sound input from the microphone
The voice data is transmitted to the server 1701 as it is. server
1701 transmits the received audio data to the client B1.
703. In client B1703, my
To the server 1701 as is
The server 1701 transmits the received audio data
It is distributed to client A 1702 and client A 17
02 and the client B 1703 perform voice communication. K
Client A 1702 stores the image data input from the camera.
Data difference between the image data and the previously input image data
The server 1 measures the minute value and calculates the difference value of the measured image data.
701 (the difference value of this image data is
Difference data created by compression technology may be used.
The analysis result by the vector may be used). On the server 1701
Is the image data transmitted from the client A 1702
Of the received image data,
The degree of change of the image is measured. Next, the degree of change
Is greater than or equal to a predetermined amount of change,
Image request frame to client A 1702 of difference value
Send a command. Thereby, the client A 1702
If a large number of users move (when the difference value is large),
An image request frame from the server 1701 is sent to the ant A 1702.
Command is transmitted and the client A 170 receives it.
2 stores the image data input from the camera in the server 170
Send to 1. Server 1701 that has received image data
Transmits the received image data to the destination client B 170
Send to 3. As described above, the user leaves from the camera
Transfer the minimum required image data,
Image data can be communicated to the
Load and network load can be reduced. [Fifth Embodiment] FIG. 9 shows a fifth embodiment of the present invention.
It is such a schematic diagram. FIG. 10 shows a fifth embodiment of the present invention.
It is a figure which shows the sequence of the audio / video communication concerning. Sending
Sender client (client A1902, client
Client B 1903 or client C 1904), transmission
Destination client (client A 1902 sends
Client B1903 or client
Client C 1904 and Client B 1903
Is the source client, the client A19
02 or client C1904 and the client
When C1904 is the source client, the client
Ant A1902 or Client B1903), before
Connect the source client and the destination client
Of a client / server system having a server
The following describes a TV conference system having a configuration.
The voice input device (microphone) of the source client
Data input to the image input device of the source client.
Input the image data into. Next, the source client
The input voice data is the voice of the user.
Provided to the client to determine whether the noise is environmental noise
The voice data determination means, and
If it is determined that the voice is the user's voice in
Data to the server. Then, sent to the server
Receiving the audio data, the server
Sends an image request command requesting
I believe. Next, request image data from the server
Upon receiving the image request command, the source client
The input image data is transmitted to the server. Ma
In addition, from the image input device of the transmission source client, the first
The first image data corresponding to the time point
Data corresponding to a second time point different from the
Input and provided in the source client.
The first image data is compared with the second image data.
Next, as a result of the comparison, the first image data and the second
When there is a predetermined change between the image data and the second image data,
Former client sends image change notification command to the server
Transmitting the image change notification command transmitted to the server
Receiving the password, the server requests image data.
Request command to the sending client. further,
Request the image data transmitted to the client
Upon receiving the image request command, the source client
Sending the image input by the image input means to the server;
The server sends the
The audio data and the image data obtained
Send to client. More specifically, FIG. 9 and FIG.
As shown in FIG. 10 and FIG.
Network 1904, server 1901, client
A 1902 and client B 1903 are on the network
Implementation of one-on-one TV conference in an environment connected by
It is a form of. Client A1902 is
To send the input audio data to the server as it is
The input voice data is the user's voice,
It is determined whether the noise is boundary noise (for example,
The determination can be made by using a silent compression technique.)
Next, it is determined that the received voice data is the voice of the user.
The input voice data to the server 1901
However, if it is determined to be environmental noise, no operation is performed. This
As a result, audio data is only supported when the user speaks.
Server 190 which has been transmitted to
1 sends the received audio data to the client B 1903
Send. At this time, the server 1901 transmits the audio data.
It is necessary to send an image to the originating client A1902.
Send the image request command to request. The image request frame
Client A 1902 receives the command from the camera.
The input image data is transmitted to the server 1901,
The server 1901 that has received the data transmits the received image data.
Data to the destination client B 1903 (distribution).
You. Then, in the client A1902, the user
Image data input from the camera
It changes greatly from the input image data. client
If A1902 determines that the change is large, the server
Image data indicating that the user has largely moved to 1901
Is transmitted. The image data
Server 190 that has received an image request command requesting data
1 is an image request command to the source client A 1902
Send voice. Further, when the image request command is received,
Client A 1902 is the user input from the camera
Is transmitted to the server 1901 and the image data is
The received server 1901 transmits the received image data.
This is transmitted to the destination client B 1903. This allows you to
When the user speaks or when the user exits from the camera
Transfer the minimum required image data,
Image data can be communicated, processing load on the client side,
Network load can be reduced. [Sixth Embodiment] FIG. 11 shows a sixth embodiment of the present invention.
FIG. FIG. 12 shows a sixth embodiment of the present invention.
FIG. 4 is a diagram showing a sequence of audio / video communication according to the embodiment.
Difference between the sixth embodiment of the present invention and the fifth embodiment
The point is that the audio data analysis unit of the input audio data
In the sixth embodiment of the present invention, it is installed on the server side.
Is a point. More specifically, FIG. 11 and FIG.
As shown in FIG.
Server 2101 and client A 21
02, Client B2103 is connected via network
In a case where a one-to-one TV conference is held in an environment
is there. Client A2102 input from microphone
The server 210 which transmits the audio data to the server as it is.
1 is a client that receives the audio data as it is
Received audio data instead of transmitting to B2103
Is the user's voice or environmental noise
(Similar to the first embodiment, for example, the audio data
The silence compression technology is used for the determination). Then, received
If it is determined that the voice data is the voice of the user,
The received audio data is transmitted to the client B2103.
Thus, only when the user speaks, the audio data is
It is distributed to the client B2103. In addition, receive
When it is determined that the voice data that has been input is the voice data of the user
Is a server 2101 that is a client of a voice data transmission source.
A2102 is an image request code requesting that an image be transmitted.
Send the command. When the image request command is received,
Client A 2102 is a client for the image data input from the camera.
Data to the server 2101 and receive the image data
The server 2101 that has received the received image data
Transmit to client B2103. In addition, the client
If the user moves greatly in A2102, the camera
Image data input from the
It changes greatly. Client A2102 changes
If the user is determined to be
Image request frame for requesting image data
Send a command. Image request command to request image data
Server 2101 that has received the
An image request command is transmitted to 2102. Next,
The client A 2102, which has received the image request command,
The image data of the user input from the camera is stored in the server 21
01 which has transmitted the image data to the server 2101
Transmits the received image data to the destination client B210.
Send to 3. As a result, when the user speaks,
When the user leaves the camera,
Transfer image data and communicate image data efficiently,
Reduce processing load and network load on client side
FIG. 13 shows a seventh embodiment of the present invention.
FIG. FIG. 14 shows a seventh embodiment of the present invention.
FIG. 4 is a diagram showing a sequence of audio / video communication according to the embodiment.
Difference between the seventh embodiment of the present invention and the fifth embodiment
The points are calculated by the image data analyzer of the input image data.
In the seventh embodiment of the present invention, it is installed on the server side.
Is a point. Source client (client A230
2. Client B 2303 or Client C23
04), destination client (client A 2302)
Is the source client, the client B23
03 or client C2304 and the client
When client B 2303 is the source client, the client
Client A 2302 or Client C 2304
Client C2304 is the sender client
Client A 2302 or Client B
2303), the source client and the destination client
Client server with a server to connect clients
Of a TV conference system that uses a server system
I will tell. First, the voice input device of the source client
(Microphone) and input the audio data
The image data is input to the image input device of the client. Next, before
The transmission source client uses the input audio data
The user's voice or environmental noise
Perform voice data determination provided in the client, the
The voice data determining means determines that the voice was the user's voice.
If so, the voice data is transmitted to the server. further,
Receiving the audio data transmitted to the server,
Server sends image request command to request image data
Image data sent from the server to the former client
Receiving the image request command requesting the
Sending the image data input by the client to the server
I do. In addition, if the image input device of the source client is
The first image data corresponding to the first time point;
Image corresponding to a second time point different from the image data of the second
Data, and input the first image data and the
The second image data is transmitted to the server. Next, the server
The first image data transmitted and the second image data
Is compared with the image data of
The location between the first image data and the second image data.
If there is a certain change, the server sends an image change notification command
To the source client. Finally, the transmission
Originating client input by the image input means
Sending the image data to a server, wherein the server
The audio data and the image data are transmitted from the transmission source client.
Data to the destination client. Further explanation
Then, as shown in FIG. 13 and FIG.
In the embodiment, the server 23 is connected to the network 2304.
01, client A 2302, client B 230
3 in a networked environment, one-on-one TV conference
This is an embodiment in the case of performing. Client A230
2 is the server that receives the voice data input from the microphone
Instead of sending it to
It is determined whether the sound is audio or environmental noise (for example,
This audio data is judged using silence compression technology.
Can be determined.) Next, the received audio data is
If the input voice data is determined to be
Is transmitted to the server 2301 and nothing is determined when the
No action is taken. As a result, when the user speaks,
Audio data is transmitted to the server 2301 and received.
The server 2301 that received the message
It transmits to Ant B 2303. At this time, the server 2301
Sends the audio data to the source client A 2302
Send an image request command requesting to send
You. Client A2 receiving the image request command
Reference numeral 302 denotes a server 2 which stores image data input from a camera.
Server 2301 that has transmitted to 301 and received the image data
Transmits the received image data to the destination client B230.
3 (distribution). And client A230
2 is the image data input from the camera and the last input
Measure the difference value of the image data with the image data and measure
The difference value of the obtained image data is transmitted to the server 2301.
(The difference value of this image data is created by the conventional compression technology.
Difference data or analysis using motion vectors
May be the result). In server 2301, client A
Receiving the difference value of the image data transmitted from 2302,
From the difference value of the received image data,
measure. Next, the degree of the change is equal to or less than a predetermined amount of change.
If it is above, the source class of the difference value of the image data
An image request command is transmitted to the client A 2302. This
As a result, the user of the client A 2302 greatly moves.
(When the difference value is large), the client A 2302
Sends an image request command from the server 2301,
The client A 2302 that has received the
The input image data is transmitted to the server 2301. image
The server 2301 that has received the data transmits the received image data.
Data to the destination client B 2302. to this
The user is speaking, or if the user is in front of the camera
Transfer the minimum required image data,
Image data can be communicated efficiently and processing on the client side
Management load and network load can be reduced.
You. [Eighth Embodiment] FIG. 15 shows an eighth embodiment of the present invention.
FIG. FIG. 16 shows an eighth embodiment of the present invention.
FIG. 4 is a diagram showing a sequence of audio / video communication according to the embodiment.
Difference between the eighth embodiment of the present invention and the seventh embodiment
The point is a voice data analysis system for input voice data.
However, in the eighth embodiment of the present invention,
That is the point. More specifically, FIG. 15 and FIG.
As shown in FIG. 16, the eighth embodiment of the present invention
Network 2504, server 2501, client
A2502, Client B2503 on the network
Implementation of one-on-one TV conference in a connected environment
It is a form. Client A 2502 enters from the microphone
Server that sends the input audio data to the server as it is
Reference numeral 2501 designates the received audio data as a client
Received audio instead of sending to Ant B2503
Determine whether the data is user voice or environmental noise
(For example, as in the first embodiment,
For the determination of data, use the silence compression technology). Next,
If the received voice data is determined to be the user's voice
The received voice data to the client B2503.
I believe. This allows the audio to be heard only when the user speaks.
The data is distributed to client B 2503. Soshi
Client A 2502 is input from the camera
Image data between the image data and the previously input image data
The difference value of the image data is measured, and the difference value of the measured image data is
(The difference value of the image data is
Difference data created by conventional compression technology may be used,
An analysis result using a motion vector may be used). Server 250
1, the image data transmitted from the client A 2502
Data difference value and the received image data difference value
Then, the degree of change of the image is measured. Next, the degree of the change
If the match is equal to or greater than the specified amount of change, the image data
An image request to the client A2502 of the transmission source of the difference value of data
Send a command. Thereby, the client A25
If the user 02 moves significantly (when the difference value is large),
Client A 2502 requests image from server 2501
Command A2 is sent and received by client A2
Reference numeral 502 denotes a server 2 which stores image data input from a camera.
501. Server 250 that has received the image data
1 indicates that the received image data is to be transmitted to the destination client B25.
02. As a result, when the user speaks
Necessary amount, such as when the user leaves from the front of the camera, etc.
Transfer of limited image data and efficient communication of image data
Processing load and network load on the client side
It becomes possible to reduce. Finally, from the first of the present invention
When the embodiments up to the eighth are arranged, the second embodiment of the present invention is described.
In one embodiment, the client side determines
The regular processing is being performed. In the second embodiment of the present invention,
The server judges the voice. Third of the present invention
In the embodiment, the client uses the difference value.
To determine the image. Fourth embodiment of the present invention
In the embodiment, the server uses the difference value to
Is determined. In the fifth embodiment of the present invention
The client side to determine the audio and further the image
ing. In the sixth embodiment of the present invention, the client
The client determines the image, and the server determines the sound.
Is going. In the seventh embodiment of the present invention,
The client determines the audio and the server determines the image.
ing. In an eighth embodiment of the present invention, a server
The image is determined on the side of the computer. On the server side, voice
Is determined. It should be noted that this is used in the embodiment of the present invention.
Network is an intranet such as a LAN, or
Internet using extranet and IP network
-Clients and servers
Is a network that can exchange data
Is not a question. As described above, the present invention relates to the first to eighth embodiments.
Although the embodiments have been described, the present invention relates to first to eighth embodiments.
The scope is not limited to the form and does not deviate from the gist.
It can be variously deformed by surroundings. For example, with the above embodiment,
In a one-to-one TV conference system, many-to-many, one-to-many, etc.
In a TV conference system, implementation is performed in a similar manner.
It is possible.

As described above, according to the present invention, the image data is transferred when the user speaks or the user moves greatly, and the image data is not transmitted otherwise. Therefore, a TV conference system and a TV conference system which can communicate only necessary image data, omit useless data transfer, and reduce the processing load on the client and the load on the network as compared with the conventional TV system. An object of the present invention is to provide a control method and a storage medium storing a program for controlling a TV conference system.

[Brief description of the drawings]

FIG. 1 is an exemplary view schematically showing a TV conference system according to a first embodiment of the present invention.

FIG. 2 is a diagram showing a sequence of audio data and image data according to the first embodiment of the present invention.

FIG. 3 is a diagram schematically showing a TV conference system according to a second embodiment of the present invention.

FIG. 4 is a diagram showing a sequence of audio data and image data according to a second embodiment of the present invention.

FIG. 5 is a diagram schematically showing a TV conference system according to a third embodiment of the present invention.

FIG. 6 is a diagram showing a sequence of audio data and image data according to a third embodiment of the present invention.

FIG. 7 is a diagram schematically illustrating a TV conference system according to a fourth embodiment of the present invention.

FIG. 8 is a diagram showing a sequence of audio data and image data according to a fourth embodiment of the present invention.

FIG. 9 is a diagram schematically showing a TV conference system according to a fifth embodiment of the present invention.

FIG. 10 is a diagram showing a sequence of audio data and image data according to a fifth embodiment of the present invention.

FIG. 11 is a view schematically showing a TV conference system according to a sixth embodiment of the present invention.

FIG. 12 is a diagram showing a sequence of audio data and image data according to a sixth embodiment of the present invention.

FIG. 13 is a view schematically showing a TV conference system according to a seventh embodiment of the present invention.

FIG. 14 is a diagram showing a sequence of audio data and image data according to a seventh embodiment of the present invention.

FIG. 15 is a view schematically showing a TV conference system according to an eighth embodiment of the present invention.

FIG. 16 is a diagram showing a sequence of audio data and image data according to the eighth embodiment of the present invention.

FIG. 17 is an exemplary view schematically showing a TV conference system which employs a client-server system according to the first embodiment of the present invention.

FIG. 18 is a diagram showing an outline of a TV conference system using a client-server system according to a second embodiment of the present invention.

FIG. 19 is a diagram showing an outline of a TV conference system using a client-server system according to a third embodiment of the present invention.

FIG. 20 is an exemplary view schematically showing a TV conference system using a client-server system according to a third embodiment of the present invention.

FIG. 21 is a schematic diagram illustrating a TV conference system according to a conventional technique.

FIG. 22 is a schematic diagram illustrating a TV conference system according to a conventional technique.

[Explanation of symbols]

1101, 1301, 1501, 1701, 1901,
2101, 2301, 2501 ... server 1102, 1302, 1502, 1702, 1902,
2102, 2302, 2502... Client A 1103, 1303, 1503, 1703, 1903,
2103, 2303, 2503 ... Client B 1304, 1904, 2304 ... Client C 1104, 1305, 1504, 1704, 1905,
2104, 2305, 2504 ... Intranet / IP
network

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5B089 GA11 GA21 GB03 JA16 JB03 JB05 JB10 KA06 KA07 KH28 LB10 5C064 AA02 AC02 AC06 AC13 AC16 AC20 AD06

Claims (25)

[Claims] 1. A TV conference system having a configuration of a client-server system, comprising a source client, a destination client, and a server connecting the source client and the destination client, wherein the source client is a voice input device. Input means for inputting audio data from the input device; input means for inputting image data from the image input device by the transmission source client; and the transmission source client indicating whether the input audio data is a user's voice or environmental noise. Voice data determining means provided in the client for determining whether or not the voice data determining means determines that the voice is a user's voice; transmitting means for transmitting the voice data to the server; transmitting to the server The server receives the audio data and transmits the image data to the server. A transmission unit for transmitting an image request command to the transmission source client to request transmission of the image data input by the transmission source client to the server in response to an image request command for requesting image data from the server. T, the server comprising: a transmitting unit configured to transmit the audio data and the image data transmitted from the source client to the destination client.
V conference system. 2. A TV conference system having a configuration of a client-server system, comprising a source client, a destination client, and a server connecting the source client and the destination client, wherein the source client is a voice input device. Input means for inputting audio data from an input device; input means for inputting image data from the image input device by the transmission source client; transmission means for transmitting the input audio data to the server; and audio transmitted to the server Determining whether the data is a user's voice or environmental noise; a voice data determining unit provided in the server; and if the voice data determining unit determines that the data is a user's voice, the source client Transmitting means for transmitting an image request command requesting image data to Transmitting means for transmitting the input image data to the server when the source client receives the image request command from the server, wherein the server is transmitted from the source client; A TV conference system comprising: a transmission unit that transmits the audio data and the image data to the destination client. 3. A video conference system having a client-server system configuration comprising a source client, a destination client, and a server connecting the source client and the destination client, wherein the image input device of the source client is provided. Image input means for inputting first image data corresponding to a first time point, second image data corresponding to a second time point different from the first image data, and Comparing means for comparing the first image data with the second image data; and, as a result of the comparison, a predetermined change between the first image data and the second image data. And transmitting means for transmitting an image change notification command from the client to the server, the image change notification transmitted to the server. Receiving means for receiving an information command, the server transmitting an image request command requesting image data to a transmission source client, and receiving the image request command requesting the image data transmitted to the client, A transmission unit that transmits an image input by the client to the server; and a transmission unit that transmits the image data from the transmission source client to a transmission destination client. TV conference system. 4. A video conference system having a client-server system configuration comprising a source client, a destination client, and a server connecting the source client and the destination client, wherein the image input device of the source client is provided. Image input means for inputting first image data corresponding to a first time point, second image data corresponding to a second time point different from the first image data, and the input first image A transmitting unit that transmits data and the second image data to a server; a comparison determining unit that compares the first image data and the second image data transmitted by the server; As a result, when there is a predetermined change between the first image data and the second image data, the server sends the image change notification command to the server. Transmitting means for transmitting the image data input by the image inputting means to the server, transmitting means for transmitting to the server, the server transmitting the image data from the source client to the destination client A TV conference system comprising: a transmitting unit that transmits a video signal to the TV conference system. 5. A TV conference system having a configuration of a client server system having a source client, a destination client, and a server connecting the source client and the destination client, wherein the source client is a voice input device. Input means for inputting voice data; input means for the source client to input image data from an image input device; and whether the source client is the input voice data as a user's voice or environmental noise. A voice data determining unit provided in the client, a transmitting unit that transmits the voice data to the server when the voice data determining unit determines that the voice is a user's voice, Receiving the audio data, the server requests image data. Transmitting means for transmitting an image request command to be transmitted to a transmission source client, and transmitting means for receiving the image request command requesting image data from the server and transmitting the image data input by the transmission source client to the server. And inputting first image data corresponding to a first time point and second image data corresponding to a second time point different from the first image data from the image input device of the transmission source client. Image input means, comparison determination means provided in the transmission source client for comparing the first image data and the second image data, and the result of the comparison, the first image data and the second Transmitting means for transmitting an image change notification command to the server when a predetermined change has occurred between the server and the server; The transmitting means for receiving the image change notification command transmitted to the client, the server transmitting an image request command requesting image data to a transmission source client; and an image request command requesting the image data transmitted to the client. Receiving means for transmitting the image input by the image inputting means to the server by the transmission source client; and the server transmits the audio data and the image data transmitted from the transmission source client to the transmission destination client. Transmission means for transmitting to T
V conference system. 6. A TV conference system having a configuration of a client-server system, comprising a source client, a destination client, and a server connecting the source client and the destination client, wherein the source client is a voice input device. Input means for inputting audio data from the input device; input means for inputting image data from the image input device by the source client; transmitting means for transmitting the input audio data to the server; and audio transmitted to the server Determining whether the data is user's voice or environmental noise; voice data determining means provided in the server; if the voice data determining means determines that the user's voice, the transmission source client Transmitting means for transmitting an image request command requesting image data to When the transmission source client receives the image request command from the server, the transmission unit transmits the input image data to the server, and from the image input device of the transmission client, Image input means for inputting first image data corresponding to a first time point, second image data corresponding to a second time point different from the first image data, and provided in the transmission source client; Comparing and judging means for comparing the first image data with the second image data; and as a result of the comparison, a predetermined change has occurred between the first image data and the second image data. A transmitting unit that transmits an image change notification command to the server by the transmission source client; and the server that receives the image change notification command transmitted to the server. Transmitting means for transmitting an image request command requesting image data to a transmission source client, receiving the image request command requesting the image data transmitted to the client, and inputting the image by the transmission source client by the image input means A video conference system, comprising: a transmission unit that transmits the selected image to a server; and a transmission unit that transmits the audio data and the image data from the transmission source client to the transmission destination client. 7. A TV conference system having a configuration of a client-server system, comprising a source client, a destination client, and a server connecting the source client and the destination client, wherein the source client is a voice input device. Input means for inputting audio data from the input device; input means for inputting image data from the image input device by the transmission source client; and the transmission source client converting the input audio data to a user's voice or environmental noise. Voice data determining means provided in the client for determining whether or not the voice data determining means determines that the voice is a user voice; transmitting means for transmitting the voice data to the server; transmitting to the server The server receives the audio data and transmits the image data to the server. A transmission unit for transmitting an image request command to the transmission source client to request transmission of the image data input by the transmission source client to the server in response to an image request command for requesting image data from the server. Means, inputting first image data corresponding to a first time point, and second image data corresponding to a second time point different from the first image data, from an image input device of the transmission source client; Image transmitting means for transmitting the input first image data and the second image data to a server, wherein the server transmits the first image data and the second image A comparison determining unit that compares data with the first image data and the second image data when a predetermined change occurs between the first image data and the second image data as a result of the comparison; A transmitting unit that transmits an image change notification command to the transmission source client; a transmission unit that transmits the image data input by the transmission source client by the image input unit to a server; A TV conference system comprising: a transmission unit that transmits audio data and the image data to a transmission destination client. 8. A TV conference system having a client-server system configuration comprising a source client, a destination client, and a server connecting the source client and the destination client, wherein the source client is a voice input device. Input means for inputting audio data from the input device; input means for inputting image data from the image input device by the source client; transmitting means for transmitting the input audio data to the server; and audio transmitted to the server Determining whether the data is user's voice or environmental noise; voice data determining means provided in the server; if the voice data determining means determines that the user's voice, the transmission source client Transmitting means for transmitting an image request command requesting image data to When the transmission source client receives the image request command from the server, the transmission unit transmits the input image data to the server, and from the image input device of the transmission client, Image input means for inputting first image data corresponding to a first time point, and second image data corresponding to a second time point different from the first image data; A transmitting unit that transmits the second image data to a server, a comparison determining unit that compares the transmitted first image data and the second image data, and a result of the comparison; When a predetermined change occurs between the first image data and the second image data, the server transmits an image change notification command to the transmission source client. Means, transmission means for transmitting the image data input by the transmission source client by the image input means to a server, and the server transmitting the audio data and the image data from the transmission source client to a transmission destination client A TV conference system comprising: a transmission unit. 9. A control method for a TV conference system having a client-server system configuration, comprising: a source client, a destination client, and a server connecting the source client and the destination client. Voice data is input to a voice input device, image data is input to an image input device of the transmission source client, and the transmission source client determines whether the input voice data is a user's voice or environmental noise. When it is determined that the voice is the user's voice, the voice data is transmitted to a server. Upon receiving the voice data transmitted to the server, the server transmits an image request command requesting image data to the server. An image request command that transmits to a client and requests image data from the server Receiving the image data, the image data input by the transmission source client is transmitted to the server, and the server transmits the audio data and the image data transmitted from the transmission source client to the transmission destination client. Control method of the TV conference system. 10. A method for controlling a TV conference system having a client-server system, comprising: a source client, a destination client, and a server connecting the source client and the destination client, wherein: Voice data is input to a voice input device, image data is input to an image input device of the transmission source client, the input voice data is transmitted to a server, and voice data transmitted to the server is a user voice. Or whether it is environmental noise, if the voice data determination means is determined to be a user's voice, transmits an image request command requesting image data to the source client, the image from the server If the requesting command is received by the source client, the source client And transmitting the input image data to the server and the server transmitting the audio data and the image data transmitted from the transmission source client to the transmission destination client. Method. 11. A method for controlling a TV conference system having a client-server system configuration, comprising: a source client, a destination client, and a server connecting the source client and the destination client. First image data corresponding to a first point in time and second image data corresponding to a second point in time different from the first image data are input from an image input device, and provided in the source client. Comparing the first image data with the second image data, and, if the result of the comparison indicates that there is a predetermined change between the first image data and the second image data, transmitting The former client transmits an image change notification command to the server, and upon receiving the image change notification command transmitted to the server, the server An image request command for requesting image data is transmitted to a transmission source client, and an image request command for requesting the image data transmitted to the client is received, and the transmission source client transmits an image input by the image input unit to a server. And transmitting the image data from the transmission source client to the transmission destination client. 12. A control method for a TV conference system having a client-server system, comprising: a source client; a destination client; and a server connecting the source client and the destination client. First image data corresponding to a first time point, second image data corresponding to a second time point different from the first image data are input from an image input device, and the input first image data is input. And the second image data are transmitted to the server. The server compares the transmitted first image data and the second image data. As a result of the comparison, the first image data And when there is a predetermined change between the second image data and the second image data, the server transmits an image change notification command to the source client, Xinyuan client sends the image data input by said image input unit to the server, the server, the control method of the TV conference system for transmitting from the source client of the image data to the destination client. 13. A method for controlling a TV conference system having a client-server system, comprising: a source client, a destination client, and a server connecting the source client and the destination client. Voice data is input to a voice input device, and image data is input to an image input device of the transmission source client. The transmission source client determines whether the input voice data is a user voice or environmental noise. When it is determined that the voice is the user's voice, the voice data is transmitted to a server, and upon receiving the voice data transmitted to the server, the server transmits an image request command requesting image data to the transmission source. An image request frame for transmitting to the client and requesting image data from the server Receiving the image data, transmitting the image data input by the transmission source client to the server; and transmitting, from the image input device of the transmission source client, first image data corresponding to a first time, Inputting second image data corresponding to a second point in time different from the image data of the above, comparing the first image data and the second image data provided in the transmission source client, As a result, when there is a predetermined change between the first image data and the second image data, the transmission source client transmits an image change notification command to the server, and the image transmitted to the server Upon receiving the change notification command, the server transmits an image request command requesting image data to a transmission source client, and requests the image data transmitted to the client. Receiving the image request command, the transmission source client transmits an image input by the image input means to a server, and the server transmits the audio data and the image data transmitted from the transmission source client to the transmission destination client. A method for controlling a TV conference system, wherein the method is transmitted to a client. 14. A method for controlling a TV conference system having a client-server system, comprising: a source client, a destination client, and a server connecting the source client and the destination client. Voice data is input to a voice input device, image data is input to an image input device of the transmission source client, the input voice data is transmitted to a server, and voice data transmitted to the server is a user voice. Or an environmental noise, and if it is determined that the voice is the user's voice, an image request command for requesting image data is transmitted to the transmission source client, and the image request command from the server is transmitted. If the source client receives the message, the source client Transmitting image data to the server; and transmitting, from the image input device of the transmission source client, first image data corresponding to a first time point, and second image data corresponding to a second time point different from the first image data. And comparing the first image data and the second image data provided in the transmission source client. As a result of the comparison, the first image data and the second image data are compared. When there is a predetermined change between the image data and the image data, the transmission source client transmits an image change notification command to the server, and upon receiving the image change notification command transmitted to the server, the server requests the image data. An image request command requesting the image data transmitted to the client; Sends said image input by the image input unit to the server, the server, the control method of the TV conference system, characterized by transmitting from the source client of the image data and the voice data to the destination client. 15. A control method for a TV conference system having a client-server system, comprising: a source client; a destination client; and a server connecting the source client and the destination client. Voice data is input to a voice input device, image data is input to an image input device of the transmission source client, and the transmission source client determines whether the input voice data is a user's voice or environmental noise. When the voice data determination unit determines that the voice is a user voice, the voice data is transmitted to a server, and the server receives the voice data transmitted to the server, and the server requests image data. Sends a request command to the sending client, and sends the image data from the server Receiving the requested image request command and transmitting the image data input by the transmission source client to the server; and transmitting, from the image input device of the transmission source client, first image data corresponding to a first time point Inputting second image data corresponding to a second point of time different from the first image data, transmitting the input first image data and the input second image data to a server, Comparing the transmitted first image data with the second image data, and as a result of the comparison, there is a predetermined change between the first image data and the second image data The server transmits an image change notification command to the transmission source client; the transmission source client transmits the image data input by the image input unit to the server; The control method of the TV conference system, characterized by transmitting from the source client of the image data and the voice data to the destination client 16. A method for controlling a TV conference system having a client-server system, comprising a source client, a destination client, and a server connecting the source client and the destination client, wherein: Voice data is input to a voice input device, image data is input to an image input device of the transmission source client, the input voice data is transmitted to a server, and voice data transmitted to the server is a user voice. Or whether it is environmental noise, if the voice data determination means is determined to be a user's voice, transmits an image request command requesting image data to the source client, the image from the server If the requesting command is received by the source client, the source client The client transmits the input image data to the server; and, from an image input device of the transmission source client, a first image data corresponding to a first time, a second time different from the first image data Inputting the second image data corresponding to the first image data and transmitting the input first image data and the second image data to a server, wherein the server transmits the first image data and the second image data And if the result of the comparison indicates that there is a predetermined change between the first image data and the second image data, the server sends an image change notification command to the source client. To the server, transmitting the image data input by the transmission source client by the image input unit to a server, the server, from the transmission source client, the audio data and the image A method for controlling a TV conference system, comprising transmitting image data to a destination client. 17. The image data transmitted from the transmission source client to the server is image data input from the transmission source client and is difference data based on an image compression method from image data input at a different time. The control method for a TV conference system according to any one of claims 9 to 16, wherein: 18. A storage medium for use in a TV conference system of a client / server system, in which a program for controlling a client of the TV conference system is stored, wherein input audio data is a user's voice or environmental noise. A step of determining whether or not the image data is present; a step of transmitting the audio data to the server; and receiving an image request command requesting image data from the server, transmitting the image data input by the client to the server. A storage medium storing a program for controlling a client of a TV conference system, comprising: a procedure; and a step of receiving the audio data and the image data from the server. 19. A storage medium used in a TV conference system of a client / server system and storing a program for controlling a client of the TV conference system, wherein a step of transmitting input audio data to the server; A step of receiving an image request command requesting image data transmitted from a server, and a step of transmitting the input image data to the server by the client when receiving the image request command from the server; A storage medium storing a program for controlling a client of a TV conference system, comprising: a step of receiving the audio data and the image data from a server. 20. A storage medium for use in a TV conference system of a client / server system, in which a program for controlling a client of the TV conference system is stored, wherein the input first image data and second image data are And a step of transmitting an image change notification command to the server when a predetermined change has occurred between the first image data and the second image data as a result of the comparison. A step of receiving an image request command requesting image data from a server, a step of receiving an image request command requesting the image data received from the server, and transmitting an image input by the image input unit to the server And a step of receiving the image data from the server. A storage medium storing a program to be controlled. 21. A storage medium used for a TV conference system of a client / server system and storing a program for controlling a client of the TV conference system, wherein the first image data and the second image data are inputted. Transmitting to the server, receiving the image change notification command from the server, transmitting the image data input by the image input unit to the server, and receiving the image data from the server. A storage medium storing a program for controlling a client of a TV conference system, comprising: 22. A storage medium used in a TV conference system of a client-server system and storing a program for controlling a server of the TV conference system, comprising: a step of receiving audio data from the client; Transmitting an image request command requesting image data to a transmission source client; receiving image data from the transmission source client; transmitting the audio data and the image data from the transmission source client to a transmission destination client. And a storage medium storing a program for controlling a server of the TV conference system. 23. A storage medium for use in a TV conference system of a client-server system, in which a program for controlling a server of the TV conference system is stored, wherein a step of receiving voice data from the client; By the procedure for determining whether the data is the voice of the user or the environmental noise, the procedure for transmitting an image request command for requesting image data to the transmission source client when it is determined that the data is the voice of the user, A server for a TV conference system, comprising: a step of receiving image data from the source client; and a step of transmitting the audio data and the image data received from the source client to a destination client. Storage medium storing a program for controlling the computer. 24. A storage medium which is used in a TV conference system of a client / server system and stores a program for controlling a server of the TV conference system, wherein the input first image is provided in a transmission source client. Comparing the data with the second image data, receiving an image change notification command from the transmission source client, transmitting an image request command requesting image data to the transmission source client, A server for a TV conference system, comprising: a step of receiving an image input by the image input procedure from a client; and a step of transmitting the image data received from the source client to a destination client. Storage medium storing a program for controlling the computer. 25. A storage medium for use in a TV conference system of a client / server system, in which a program for controlling a server of the TV conference system is stored, wherein the first image data input from a source client and the first image data are stored in the storage medium. Receiving the second image data, comparing the received first image data with the second image data, transmitting an image change notification command to the transmission source client, A program for controlling a server of a TV conference system, comprising: a step of receiving image data from a source client; and a step of transmitting the image data received from the source client to a destination client. The storage medium in which it was stored.