JP2003339035A - Multi-point communication system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a multi-point communication system wherein each communication terminal can sort out and record data to be distributed from a base station to each of communication terminals. <P>SOLUTION: The multi-point communication system comprises: a plurality of the communication terminals T1 to Tn placed at a plurality of points on a network NW; and the base station Bs for relaying data among the communication terminals T1 to Tn. The base station Bs is provided with a relay processing section for sorting out data transmitted from each of the communication terminals T1 to Tn in response to a recording request from the communication terminals T1 to Tn via the network NW. Each of the communication terminals T1 to Tn records the data distributed from the data station Bs via the network NT. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multipoint communication system for exchanging video and audio between multiple points via a communication network such as a computer network.

[0002]

2. Description of the Related Art Conventionally, there has been a multipoint communication system for transmitting and receiving video and audio between multiple points via a network such as the Internet. In this type of multipoint communication system, video data and audio data transmitted from each communication terminal such as a PC (personal computer) and a portable information terminal are once aggregated in a base station (server) via a network. . Next, the base station executes a process of delivering the aggregated video data and audio data to each communication terminal. In a multipoint communication system such as a video conference system, video / audio distributed by a base station (server) can be recorded by each communication terminal as a meeting minutes or a call record.

[0003]

However, in the conventional multipoint communication system, the communication terminal side cannot select the contents of video / audio distributed from the base station to each communication terminal.
There is a problem that desired data cannot be selectively recorded. For example, when performing one-to-one communication in a videophone system, the video / audio received by the communication terminal from the base station generally includes only the video / audio of the other party, and does not include the video / audio of its own. . Therefore, each communication terminal cannot easily record its own video / audio.

Further, in the case of a video conference system, there may be a large number of participants in the video conference. It was difficult for the video conference participants to record only their own video / audio or only the video / audio of a specific participant from a plurality of participants.

In view of the above problems and the like, an object of the present invention is to provide a multipoint communication system in which a communication terminal can select and record data distributed from a base station to each communication terminal. It is in.

[0006]

In order to solve the above problems, the invention according to claim 1 relays data between a plurality of communication terminals arranged at a plurality of points in a communication network and between the plurality of communication terminals. A multipoint communication system configured with a base station, wherein the base station selects data transmitted from each communication terminal in response to a recording request transmitted from the communication terminal via the communication network. And a relay processing unit that uses the communication terminal that has issued the recording request as a relay destination of the data, and the communication terminal stores the data distributed from the base station via the communication network in a storage device. It is characterized in that a control means for controlling to record is provided.

The invention according to claim 2 is the multipoint communication system according to claim 1, wherein the data relayed between the communication terminals is divided into packets having a predetermined data length or less and transmitted. The relay processing unit includes a packet configuration unit that selects the data transmitted from each of the communication terminals in units of packets in accordance with the recording request and configures a packet corresponding to each of the relay destinations. is there.

The invention according to claim 3 is the invention according to claim 1 or 2.
A multipoint communication system according to claim 1, wherein the communication terminal is
It has a control means for recording the data distributed from the base station and the data transmitted from the communication terminal to the base station in the storage device in association with each other.

[0009]

FIG. 1 is an overall configuration diagram showing a multipoint communication system according to an embodiment of the present invention.

The multipoint communication system is composed of a plurality of communication terminals T1, T2, T3, ..., Tn arranged at a plurality of points in a network (communication network) NW, NW, and a base station Bs. The communication terminals T1 to Tn have the same basic configuration. Further, in the present embodiment, the network NW is the Internet, an intranet using the Internet technology, or a LAN (Local Area Net).
work) and VPN (Virtual Private Network). The communication terminals T1 to Tn and the base station Bs have a function of performing bidirectional IP (Internet Protocol) communication according to a predetermined communication protocol group.

FIG. 2 is a schematic configuration diagram showing the communication terminal Tk (k = 1 to n). This communication terminal Tk executes various interfaces 1, 2 and 13 corresponding to peripheral devices, an encoder 3 that performs format conversion and compression encoding of video signals and audio signals, and decompression decoding and format conversion. Decoder 10, storage device 8 such as a hard disk, recording buffer 7, bidirectional IP
It is configured to include a transmission processing unit 6 and a reception processing unit 9 that realize a communication function.

Of the various interfaces mounted on the communication terminal Tk, the peripheral interface 1 is connected to the microphone 20 and the camera 21, and receives audio signals and video signals output from these peripheral devices 20 and 21. It has a function of supplying to the encoder 3. Further, the operator interface 2 is connected to an operator 22 such as a mouse, a key input device, or a stylus, and has a function of converting an input signal from the operator 22 into an internal signal. Further, the peripheral interface 13 is a monitor 24.
And the speaker 23, and has a function of transferring the video signal and the audio signal output from the decoder 10 to the monitor 24 and the speaker 23, respectively.

Although not shown for the sake of convenience of explanation, the communication terminal Tk includes these units 1, 2, 3, 6, 7, 8, 9,
A CPU for controlling the CPUs 10, 13 and a ROM (Read Only Memory) for storing software executed by the CPU are mounted inside. Further, as the communication terminal Tk, specifically, a network compatible personal computer, a set top box (home communication terminal), a mobile phone, a PHS (Personal Handyphone Syst) are used.
em) or PDA (personal digital assistant; PersonalDigita)
l Assistants).

FIG. 3 is a schematic block diagram showing the base station Bs. The base station Bs includes a transmission processing unit 33 and a reception processing unit 32 that realize a bidirectional IP communication function for the network NW, a connection control unit 30 that controls the reception processing unit 32 and the transmission processing unit 33, and Communication terminal T1
To a relay processing unit 31 that relays data transmitted from Tn.

Further, the base station Bs has communication terminals T1 to T
, #n for temporarily storing received data received from n, a packet configuration unit 34 for selecting received data in packet units, and each communication terminal T.
1 to Tn, and a transmission buffer 35 for temporarily storing distribution data.

An operation example when the multipoint communication system having the above configuration is used as a video conference system will be described in detail below.

As shown in FIG. 2, in the communication terminal Tk participating in the video conference, the camera 21 and the microphone 2 are used.
0 acquires the video signal and audio signal of the user of the communication terminal Tk (participant of the video conference) and the background. The video signal and the audio signal are input to the encoder 3 via the peripheral interface 1. The video encoder 5 and the audio encoder 4 apply MPEG (Moving Picture Experts Group) to the input video signal and audio signal.
A signal obtained by performing compression coding, error correction coding, etc. according to the format is output to the transmission processing unit 6. Then, the transmission processing unit 6 converts the signal input from the encoder 3 into a packet according to the communication protocol of the network NW, and sends the packet to the base station Bs.

As shown in FIG. 3, in the base station Bs, the reception processing section 32 receives the video data and the audio data transmitted from all the communication terminals T1 to Tn participating in the video conference. The relay processing unit 31 performs relay processing on the received data to generate distribution data for each of the communication terminals T1 to Tn, and outputs the distribution data to the transmission processing unit 33. Then, the transmission processing unit 33 uses the distribution data output from the relay processing unit 31 for each of the communication terminals T1 to T on the network NW.
to n.

Next, as shown in FIG. 2, the communication terminal Tk
Then, the reception processing unit 9 receives the packets distributed from the base station Bs, combines the packets, and outputs the combined packets to the decoder 10. The video decoder 12 and the audio decoder 11 of the decoder 10 are
The encoded data input from the reception processing unit 9 is expanded / decoded to generate a video signal and an audio signal, which are supplied to the monitor 24 and the speaker 23 via the peripheral interface 13. As a result, on the monitor 24 and the speaker 23, the communication terminal T1 participating in the video conference is
~ The video and audio of the participants of Tn and their background are reproduced.

When it is desired to record the data distributed by the base station Bs in the communication terminal Tk, the control means (not shown) incorporated in the communication terminal Tk uses the video data and audio received by the reception processing unit 9. The data can be controlled to be recorded in the storage device 8 after being buffered in the recording buffer 7. Since the data recorded in the storage device 8 is the data before being input to the decoder 10, the data can be recorded at high speed. Further, the control means reads the data recorded in the storage device 8 and causes the decoder 10 to input the data to the speaker 23 and the monitor 24.
Can be played with. Further, the control means can control to store the video data transmitted from the communication terminal Tk in the storage device 8 via the recording buffer 7.

Further, in the multipoint communication system according to the present embodiment, the communication terminal Tk issues a record request command RQT to the base station Bs, and the record request command RQT.
According to the above, it is possible to perform a process of receiving, from the base station Bs, data selected and sorted into a format suitable for recording. The details of this processing will be described below.

The video conference participant inputs data to the operator 22 of the communication terminal Tk shown in FIG. 2, whereby the operator interface 2 issues a recording request command RQT,
The transmission processing unit 6 causes the base station Bs to make a call. A plurality of types of commands are prepared for the recording request command RQT,
The video conference participant can select a desired recording request command from the list displayed on the monitor 24.

Next, when receiving the recording request command RQT, the reception processing unit 32 of the base station Bs outputs the recording request command RQT and the relay destination information Ds to the packet forming unit 34 of the relay processing unit 31. On the other hand, the reception processing unit 32
Receives video data and audio data from the communication terminals T1 to Tn and outputs them to the relay processing unit 31. The received data are buffered by the relay buffers # 1 to #n assigned to the communication terminals T1 to Tn, respectively, and then output to the packet configuration unit 34. Then, the packet composing unit 34 selects the received data in packet units according to the type of the recording request command RQT issued by the communication terminal Tk, and forms a packet corresponding to the relay destination communication terminal Tk. -Perform packing processing. The packet generated by the packet configuration unit 34 is sent to the network NW via the transmission buffer 35 and the transmission processing unit 33.

FIG. 4 and FIG. 5 are explanatory views showing an example of packet packing processing of audio data. As the audio data in this example, "S0: Chairman's voice" transmitted from the terminal used by the chairperson who holds the video conference, and "S1: Participants transmitted from the terminals used by the four participants of the video conference. 1 voice ”,“ S2: participant 2 voice ”,“ S3: participant 3 voice ”and“ S4: participant 4 voice ”are assumed. To the prefix portion of the name of each of these audio data, reference numerals S0, S1, S2, S3 and S4 indicating the source of the packet are attached.

As shown in FIG. 4, which communication terminal T1
When Tn has not issued the recording request command RQT, the packet configuration unit 34 packs the data transmitted from the communication terminals other than the relay destination communication terminals to the relay destinations of the communication terminals T1 to Tn ( Mixing) and generate a packet. Specifically, the voice packet IP: S0 to be transmitted to the chairperson terminal is a packet obtained by packing the packets S1, S2, S3 and S4 transmitted from the communication terminals other than the chairperson terminal, and the voice packet IP to be transmitted to the participant 1 terminal. : S
1 is a packet packed with packets S0, S2, S3 and S4 sent from a communication terminal other than the participant 1 terminal, and a voice packet IP: S2 to be transmitted to the participant 2 terminal is a communication terminal other than the participant 2 terminal. Packet S0 originated from
The packed packet of S1, S3 and S4 and the voice packet IP: S3 to be transmitted to the participant 3 terminals are packets S0, S1 and S transmitted from communication terminals other than the participant 3 terminals.
2 and S4 are packed, and the voice packet IP: S4 to be transmitted to the participant 4 terminals is a packet S0, S1, S sent from a communication terminal other than the participant 4 terminals.
2 and S3 are packed.

Next, FIG. 5 is an explanatory diagram showing an outline of the packet packing processing when the participant 1 terminal issues the above-mentioned recording request command RQT. In this example, by the recording request command RQT, the voice exchanged between the chairman terminal and the participant 1 terminal is not transmitted to the other participants 2 terminals, participant 3 terminals and participant 4 terminals. To be done. Specifically, as shown in FIG. 5, only packets surrounded by solid lines are packed. That is, the voice packet IP: S0 transmitted to the chairman terminal is the participant 1
The voice packet IP: S1 composed of only the packet S1 transmitted from the terminal and transmitted to the participant 1 terminal is the packets S0 and S1 transmitted from the chairman terminal and the participant 1 terminal.
The voice packet IP: S2, which is composed of only the participant 2 terminal and is transmitted to the participant 2 terminal, includes the participant 2 terminal, the chairman terminal and the participant 1
Packets S3 and S4 transmitted from communication terminals other than terminals
The voice packet IP: S3, which is composed of only the participant 3 terminal and is transmitted to the participant 3 terminal, includes the participant 3 terminal, the chairman terminal and the participant 1
Packets S2 and S4 transmitted from communication terminals other than terminals
The voice packet IP: S4 which is composed of only the packet and is transmitted to the participant 4 terminals is a packet S sent from communication terminals other than the participant 4 terminals, the chairman terminal and the participant 1 terminal.
2, S3 only.

If the packet enclosed by the broken line shown in FIG. 5 is further packed, a video conference is held between the chairman terminal and all communication terminals, and only the talk between the chairman terminal and the participant 1 terminal is possible. Can perform processing.

The packets generated by the above packet packing processing are transmitted to the communication terminals T1 to Tn. As shown in FIG. 2, when the reception processing unit 9 of the communication terminal Tk receives a packet from the base station Bs via the network NW, the reception processing unit 9 divides the packet into a plurality of original packets before packet packing processing, combines them, and Generates and outputs data and voice data.

Next, a method of recording data in the communication terminal Tk assuming a video conference system will be described. FIG. 6 is a schematic diagram showing an example of a recording method of data distributed from the base station Bs. As shown in the figure, in the communication terminal Tk, the reception processing unit 9 outputs the reception data (video data and audio data) received from the base station Bs. The received data is output to the recording buffer 7 and buffered. In the recording buffer 7, the image of the other party (hereinafter referred to as the other party image) transmitted from the other communication terminal Ts (s ≠ k) and audio data synchronized with the other party image (hereinafter referred to as the other party's voice). .) And voice data of the user of the communication terminal Tk and its background (hereinafter,
Call it self-voice. ) And are buffered,
Video data transmitted from the communication terminal Tk (hereinafter referred to as self-portrait) is buffered. In this example, the partner image, the partner voice, and the self-voice are obtained from the received data, while the self-image is the base station Bs.
It was obtained from the data before it was sent to. The self image is buffered in the recording buffer 7 in synchronization with the self sound. Then, the data buffered in the recording buffer 7 is output to and recorded in the storage device 8. In this way, the communication terminal Tk can easily and conveniently record the data transmitted by itself in association with (synchronized with) the data distributed from the base station Bs.

Further, as shown in FIG. 7, the self-image 40A
8 and the partner image 40B may be recorded in the storage device 8 in independent file formats, and the self voice and the partner voice may be mixed and added to the partner image 40B and recorded in the storage device 8, or shown in FIG. As described above, the composite image 40 in which the self image 40A and the partner image 40B are integrated may be recorded in the storage device 8 together with the self voice and the partner voice.

According to the above multipoint communication system, the communication terminals T1 to Tn issue the recording request command RQ issued by themselves.
For T, since the selected data distribution can be received from the base station Bs and recorded in the storage device, a highly convenient distribution service can be efficiently realized. Therefore, in a field such as a videophone system, it is possible to selectively and easily record the video and audio of the self and the other party, which are exchanged for consulting work or entertainment use, in the communication terminal of the self.

In the base station Bs, the communication terminal T1
Since the recording request command RQT issued by ~ Tn can be grasped as the history information, it is possible to perform the charging process according to the processing content of the recording request command RQT.

[0033]

As described above, according to the multipoint communication system according to the first aspect of the present invention, the relay processing unit in the base station transmits data from each communication terminal to the base in response to the recording request transmitted from the communication terminal. You can select the data transmitted to the station.
Also, the selected data is delivered to the communication terminal. Therefore, the communication terminal can receive the selected data distribution from the base station and record it in the storage device in response to the recording request issued by itself, so that a highly convenient distribution service can be realized.

According to the second aspect, in the relay processing unit of the base station, the packet configuration unit can efficiently select the data transmitted from each communication terminal in packet units.

According to claim 3, the communication terminal is
The data transmitted by itself can be easily and conveniently recorded by associating it with the data delivered from the base station.

[Brief description of drawings]

FIG. 1 is an overall configuration diagram showing a multipoint communication system according to an embodiment of the present invention.

FIG. 2 is a schematic configuration diagram showing a communication terminal of the multipoint communication system according to the present embodiment.

FIG. 3 is a schematic configuration diagram showing a base station of the multipoint communication system according to the present embodiment.

FIG. 4 is a diagram for explaining packet packing processing.

FIG. 5 is a diagram for explaining packet packing processing.

FIG. 6 is a schematic diagram for explaining an example of a data recording method.

FIG. 7 is a schematic diagram showing an example of a data recording method.

FIG. 8 is a schematic diagram showing an example of a data recording method.

[Explanation of symbols]

1 peripheral interface 2 Operator interface 3 encoder 6 Transmission processing unit 7 Recording buffer 8 storage devices 9 Reception processing unit 10 decoder 13 peripheral interface 20 microphones 21 camera 22 Operator 23 speakers 24 monitors

Claims (3)

[Claims] 1. A multipoint communication system comprising a plurality of communication terminals arranged at a plurality of points in a communication network and a base station for relaying data between the plurality of communication terminals, wherein the base station is In response to a recording request transmitted from the communication terminal via the communication network, the data transmitted from each of the communication terminals is selected and the communication terminal issuing the recording request is set as a relay destination of the data. And a relay processing unit, wherein the communication terminal includes a control unit that controls to record data distributed from the base station via the communication network in a storage device. system. 2. The multipoint communication system according to claim 1, wherein the data relayed between the communication terminals is transmitted by being divided into packets having a predetermined data length or less, and the relay processing unit. A multipoint communication system comprising a packet configuration unit that selects the data transmitted from each of the communication terminals in packet units according to the recording request and configures a packet corresponding to each of the relay destinations. 3. The multipoint communication system according to claim 1, wherein the communication terminal includes data distributed from the base station,
A multipoint communication system having a control unit that records the data transmitted from the communication terminal to the base station in the storage device in association with each other.