JP2010118715A - Conference system and data processing method - Google Patents

Abstract

A conference system is provided that reduces a load on a relay server.
In accordance with a routing instruction from a conference management server, video data and audio data transmitted from a plurality of client terminals are transferred from a video router to another client terminal, and the transferred client terminals are transmitted. At 150, a plurality of video data and audio data are synthesized.
[Selection] Figure 1

Description

  The present invention relates to a technique in which a plurality of client terminals conduct a conference via a relay device.

  In a conventional video conference system, for example, as in the technique described in Patent Document 1, a terminal is installed in a room where a video conference is performed, and video and audio obtained from a plurality of terminals are synthesized by a relay server and relayed. The video is distributed from the server to each terminal, and the video and audio synthesized by the terminal receiving the distribution are output.

Japanese Patent Laid-Open No. 2001-313915

  As in the technology described in Patent Document 1, in a conventional video conference system, video and audio obtained from a plurality of terminals are synthesized by a relay server and distributed to each terminal, and therefore participate in the conference. When the number of terminals increases or the number of meetings to be held increases, the burden on the relay server increases, and the video and audio to be distributed may be delayed.

  Accordingly, an object of the present invention is to provide a conference system that reduces the load on the relay server.

  In order to solve the above problems, the present invention transfers video data and audio data transmitted from a plurality of client terminals from a relay device to another client terminal, and the transferred client terminals receive a plurality of video data and audio data. Performs speech data synthesis.

  For example, the present invention is a conference system having a plurality of client terminals and a relay device, wherein the control unit of the client terminal receives the video data captured by the imaging unit and the audio data collected by the audio collecting unit. A process of transmitting the address of the relay device as a destination is performed, and the control unit of the relay device has been transmitted from one client terminal participating in the conference from another client terminal participating in the conference. When the video data and audio data are received from the plurality of other client terminals, the control unit of the one client terminal performs a process of transmitting the received video data and audio data. Combine with video data and output to video output unit, combine multiple received audio data into one audio data and output to audio output unit Process be carried out, characterized by.

  As described above, according to the present invention, it is possible to provide a conference system that reduces the load on the relay server.

  FIG. 1 is a schematic diagram of a conference system 100 according to an embodiment of the present invention.

  As shown in the figure, the conference system 100 includes a conference management server 110, a video router 130 as a relay device, a gateway (hereinafter referred to as GW) 140, and client terminals 150A to 150C (hereinafter referred to as “not distinguishing each”). Client terminal 150), PBX (Private Branch eXchange) 170 as an exchange, IP telephone terminals 180A to 180B (hereinafter referred to as IP telephone terminal 180 if not distinguished from each other), and analog telephone terminals 190A to 190B ( In the following, the analog telephone terminal 190 is referred to in the case where they are not distinguished from each other.

  The conference management server 110, the video router 130, the GW 140, and the client terminal 150 can exchange information with each other via a LAN (Local Area Network) 200. The GW 140 and the PBX 170 are connected to the WAN ( Wide Area Network) 201 (for example, IP-VPN, wide area Ethernet, Internet VPN, and a composite network thereof) can exchange information with each other, and PBX 170 and IP telephone terminal 180 are connected to LAN 202. It is possible to send and receive information to and from each other.

  FIG. 2 is a schematic diagram of the conference management server 110. As illustrated, the conference management server 110 includes a storage unit 111, a control unit 117, an input unit 122, an output unit 123, and a communication unit 124.

  The storage unit 111 includes a client information storage area 112, a telephone number information storage area 113, a conference holding information storage area 114, and a conference setting information storage area 115.

  The client information storage area 112 stores information for specifying the communication address of the client terminal 150 used for conducting the conference. For example, in this embodiment, a client information table 112a as shown in FIG. 3 (schematic diagram of the client information table 112a) is stored.

  The client information table 112a has a client ID column 112b and an address column 112c.

  Information for identifying each client terminal 150 is stored in the client ID column 112b. Here, the client ID assigned to each client terminal 150 for identifying the client terminal 150 is stored as information for specifying the client terminal 150.

  The address column 112c stores information for specifying the communication address (IP address or the like) of the client terminal 150 specified by the client ID column 112b.

  Returning to FIG. 2, the telephone number information storage area 113 stores information for specifying a telephone number and a communication address allocated to terminals (IP telephone terminal 180 and analog telephone terminal 190) connected via the WAN 201. The For example, in this embodiment, a telephone number information table 113a as shown in FIG. 4 (schematic diagram of the telephone number information table 113a) is stored.

  The telephone number information table 113a has a telephone number column 113b and an address column 113c.

  The telephone number column 113b stores information for specifying a telephone number allocated to the IP telephone terminal 180 or the analog telephone terminal 190 connected via the WAN 201.

  The address field 113c stores information for specifying a communication address assigned to the IP telephone terminal 180 or the analog telephone terminal 190 specified in the telephone number field 113b. In the present embodiment, the communication address assigned to the IP telephone terminal 180 is assigned to the IP telephone terminal 180, and the communication assigned to the PBX 170 in which the analog telephone terminal 190 is accommodated for the analog telephone terminal 190. Address.

  Returning to FIG. 2, the conference holding information storage area 114 stores information that identifies the terminal participating in the conference set via the conference management server 110 and the data type of data transmitted and received by the terminal. Is done. For example, in the present embodiment, a conference holding information table 114a as shown in FIG. 5 (schematic diagram of the conference holding information table 114a) is stored.

  The conference holding information table 114a has a conference number column 114b, a terminal ID column 114c, an address column 114d, and a data type column 114e.

  In the conference number column 114b, information for specifying a conference telephone number allocated to each conference set through the conference management server 110 is stored. Note that the telephone numbers assigned to each conference are assigned so as not to be the same as the numbers already assigned to the conferences from a plurality of telephone numbers acquired in advance (stored in the storage unit 111 in advance). Just shake it.

  The terminal ID column 114c stores information for specifying terminals (client terminal 150, IP telephone terminal 180, and analog telephone terminal 190) participating in the conference specified by the conference number column 114b.

  Here, as information for identifying the terminal, for the client terminal 150, the client ID assigned to each client terminal 150, and for the IP telephone terminal 180 and the analog telephone terminal 190, each IP telephone terminal 180 and the analog telephone A telephone number assigned to the terminal 190 is stored.

  The address column 114d stores information for specifying a communication address allocated to the terminal specified in the terminal ID column 114c.

  The data type column 114e stores information for specifying the data type of data transmitted and received by the terminal specified in the terminal ID column 114c. Here, information specifying either “video and audio” or “audio” is stored as information specifying the data type.

  Returning to FIG. 2, in the conference setting information storage area 115, identification for setting a conference by selecting the client terminal 150 connected to the LAN 200 side from the terminals connected to the WAN 201 side of the conference management server 110. Information is stored. For example, in the present embodiment, a conference setting information table 115a as shown in FIG. 6 (schematic diagram of the conference setting information table 115a) is stored.

  The conference setting information table 115a has a telephone number column 115b and a conference partner column 115c.

  The telephone number column 115b stores information for specifying a setting telephone number used for setting a conference with the client terminal 150 specified in the conference partner column 115c described later.

  In the conference partner column 115c, information for specifying the client terminal 150 called as a partner to be conferenced in the setting telephone number specified in the phone number column 115b is stored. Here, as information for identifying the client terminal 150, a client ID assigned to each client terminal 150 is stored.

  In the present embodiment, it is assumed that setting telephone numbers are allocated to all client terminals 150 connected to the LAN 200 and all combinations of the client terminals 150 connected to the LAN 200.

  Returning to FIG. 2, the control unit 117 includes an overall control unit 118, a call control unit 119, and a conference management unit 120.

  The overall control unit 118 controls the entire processing in the conference management server 110.

  For example, in the present embodiment, information is stored and updated in the client information storage area 112 and the telephone number information storage area 113.

  Specifically, the overall control unit 118 accepts input of the client ID and communication address of the client terminal 150 via the input unit 122, and stores the received information in the corresponding column of the client information table 112a. Do.

  Further, the overall control unit 118 accepts a registration request having information specifying the telephone number and communication address allocated to the IP telephone terminal 180 or the analog telephone terminal 190 from the WAN 201 side via the communication unit 124. Information for specifying the telephone number and the communication address is stored in the corresponding column of the telephone number information table 113a.

  The call control unit 119 performs call control for setting a conference.

  For example, when the call control unit 119 receives a call (conference setting request) message specifying the client ID or communication address of another client terminal 150 from the client terminal 150 via the communication unit 124, the call control unit 119 is specified. A process of transmitting a call message corresponding to a predetermined protocol to a communication address specified by the client ID or a designated communication address is performed.

  When the call control unit 119 receives a response message for responding to the conference in response to such a call message, the call control unit 119 allocates the conference telephone number and the terminal that participates in the conference specified by the conference telephone number. The client ID being assigned, the communication address assigned to the terminal participating in the conference specified by the conference telephone number, and the data type transmitted and received by the terminal participating in the conference specified by the conference telephone number , And a conference is set by issuing a routing processing command to the conference management unit 120 described later.

  In addition, when a call is made from the IP telephone terminal 180 or the analog telephone terminal 190 connected to the WAN 201 side using the setting telephone number for setting a conference, the call control unit 119 uses the setting telephone number. A process for transmitting a call message to the identified client terminal 150 is performed by identifying the identified client terminal 150 from the conference setting information table 115a.

  When a response message for responding to the conference is received in response to such a call message, the call control unit 119 allocates the conference telephone number and the terminals participating in the conference specified by the conference telephone number. A client ID or a telephone number, a communication address allocated to a terminal that participates in the conference specified by the conference telephone number, and a data type transmitted and received by the terminal that participates in the conference telephone number, A conference is set by specifying a routing processing command to the conference management unit 120 described later.

  Further, when a call is made from the client terminal 150, the IP telephone terminal 180, or the analog telephone terminal 190 using the conference telephone number assigned to the conference that has already been held, the call control unit 119 In addition to performing connection processing with the terminal that has made a call with a number, the conference telephone number, the client ID or telephone number assigned to the terminal that has made a call with the conference telephone number, and the A conference management unit 120, which will be described later, identifies a communication address assigned to a terminal that has made a call using the conference telephone number and a data type transmitted and received by the terminal that has made the call using the conference telephone number. By performing the routing processing command, the terminal that has made a call with the conference telephone number is allowed to participate in the conference already held.

  When the call control unit 119 receives a cancellation notification specifying the communication addresses assigned to these terminals from the client terminal 150, the IP phone terminal 180, or the analog phone terminal 190, the call control unit 119 specifies the communication address, By issuing a routing cancellation processing command to the conference management unit 120, processing for canceling participation of the terminal that has issued the cancellation notification from the already held conference is performed.

  The conference management unit 120 performs processing for managing a conference set via the conference management server 110.

  For example, when the conference management unit 120 receives a routing processing command from the call control unit 119, the conference telephone number specified by the routing processing command is already stored in the conference number column 114b of the conference holding information table 114a. If not, a new record is added to the conference holding information table 114a, a conference telephone number specified by the routing processing command, a client ID or telephone number allocated to the terminal, The video router 130 stores the communication address and data type, and the routing instruction specifying the conference telephone number and the communication address and data type of the terminal specified by the routing processing command via the communication unit 124. Process to send to.

  When the conference management unit 120 receives a routing processing command from the call control unit 119, the conference telephone number specified by the routing processing command is already stored in the conference number column 114b of the conference holding information table 114a. In the case where the conference telephone number is stored in the conference number column 114b, a new line is added to the client ID or telephone allocated to the terminal specified by the routing processing command. The number, the communication address, and the data type are stored, and the routing instruction specifying the conference telephone number, the communication address and the data type of the terminal specified by the routing processing command is videoed via the communication unit 124. Processing to transmit to the router 130 is performed.

  When the conference management unit 120 receives a routing cancellation processing command from the call control unit 119, the communication address specified by the routing cancellation processing command is stored in the address field 114d of the conference holding information table 114a. Delete line information. In addition, when the information of all the lines matched with the conference telephone number is deleted, the record of the conference telephone number is deleted.

  Then, the conference management unit 120 transmits a routing cancellation instruction including information specifying the communication address included in the routing cancellation processing instruction to the video router 130 via the communication unit 124.

  The input unit 122 receives input of information.

  The output unit 123 outputs information.

  The communication unit 124 transmits and receives information via the LAN 200.

  The conference management server 110 described above includes, for example, an external storage device such as a CPU (Central Processing Unit) 901, a memory 902, and an HDD (Hard Disk Drive) as shown in FIG. 7 (schematic diagram of the computer 900). 903, a reading device 905 that reads and writes information to and from a portable storage medium 904 such as a CD-ROM (Compact Disk Read Only Memory) and a DVD-ROM (Digital Versatile Disk Read Only Memory), a keyboard, This can be realized by a general computer 900 including an input device 906 such as a mouse, an output device 907 such as a display, and a communication device 908 such as a NIC (Network Interface Card) for connecting to a communication network.

  For example, the storage unit 111 can be realized by the CPU 901 using the memory 902 or the external storage device 903, and the control unit 117 loads a predetermined program stored in the external storage device 903 into the memory 902. The input unit 122 can be realized by the CPU 901 using the input device 906, and the output unit 123 can be realized by the CPU 901 using the output device 907. The communication unit 124 can be realized by the CPU 901 using the communication device 908.

  The predetermined program is downloaded from the storage medium 904 via the reading device 905 or from the network via the communication device 908 to the external storage device 903, and then loaded onto the memory 902 and executed by the CPU 901. You may do it. Alternatively, the program may be directly loaded on the memory 902 from the storage medium 904 via the reading device 905 or from the network via the communication device 908 and executed by the CPU 901.

  FIG. 8 is a schematic diagram of the video router 130. As illustrated, the video router 130 includes a storage unit 131, a control unit 134, and a communication unit 138.

  The storage unit 131 includes a routing information storage area 132.

  The routing information storage area 132 stores information for specifying a communication address for transferring information received from the terminal. For example, in the present embodiment, a routing information table 132a as shown in FIG. 9 (schematic diagram of the routing information table 132a) is stored.

  The routing information table 132a includes a conference number column 132b, an address column 132c, and a data type column 132d.

  In the conference number column 132b, information for specifying a conference telephone number allocated for each conference is stored.

  The address field 132c stores information for specifying a communication address allocated to a terminal (client terminal 150, IP telephone terminal 180, or analog telephone terminal 190) participating in the conference specified by the conference number field 132b. .

  The data type column 132d stores information for specifying a data type that is a type of data transmitted and received by the terminal to which the communication address specified in the address column 132c is assigned.

  Returning to FIG. 8, the control unit 134 includes an overall control unit 135 and a conference information management unit 136.

  The overall control unit 135 controls the entire processing in the video router 130. For example, in this embodiment, routing processing according to the routing information table 132a is performed.

  Specifically, the overall control unit 135 identifies the address of the transmission source of the video data or audio data received from the communication unit 138, and the row in which the identified address is included in the address field 132c of the routing information table 132a is included. The record (information) of the associated conference number field 132b is specified. Then, the overall control unit 135 sets the type specified in the data type column 132d to a communication address other than the source communication address among the communication addresses stored in the address column 132c included in the specified record. Transfer data.

  The conference information management unit 136 manages the routing information table 132.

  For example, when the conference information management unit 136 receives a routing instruction from the conference management server 110, the conference telephone number specified by the routing instruction is not stored in the conference number column 132b of the routing information table 132a. In this case, a new record is added to the routing information table 132a, and the conference telephone number, communication address, and data type specified by the routing instruction are stored in the added record.

  When the conference information management unit 136 receives a routing instruction from the conference management server 110, the conference telephone number specified by the routing instruction is already stored in the conference number 132b of the routing information table 132a. In this case, a new line is added to the record in which the conference telephone number is stored in the conference number column 132b, and the communication address and data type specified by the routing instruction are stored.

  When the conference information management unit 136 receives a routing cancellation instruction from the conference management server 110, the communication address specified by the routing cancellation instruction is information on the row stored in the address column 132c of the routing information table 132a. Is deleted. In addition, when the information of all the lines matched with the conference telephone number is deleted, the record of the conference telephone number is deleted.

  The video router 130 described above can be realized by a general computer 900 as shown in FIG.

  For example, the storage unit 131 can be realized by the CPU 901 using the memory 902 or the external storage device 903, and the control unit 134 loads a predetermined program stored in the external storage device 903 into the memory 902. The communication unit 138 can be realized by the CPU 901 using the communication device 908.

  The predetermined program is downloaded from the storage medium 904 via the reading device 905 or from the network via the communication device 908 to the external storage device 903, and then loaded onto the memory 902 and executed by the CPU 901. You may do it. Alternatively, the program may be directly loaded on the memory 902 from the storage medium 904 via the reading device 905 or from the network via the communication device 908 and executed by the CPU 901.

  FIG. 10 is a schematic diagram of the GW 140. As illustrated, the GW 140 includes a storage unit 141, a control unit 143, a first IF unit 148, and a second IF unit 149.

  The storage unit 141 stores information necessary when processing is performed by the GW 140.

  The control unit 143 includes an overall control unit 144, a protocol conversion unit 145, and a voice synthesis unit 146.

  The overall control unit 144 controls the entire processing in the GW 140.

  For example, in the present embodiment, the overall control unit 144 performs a process of transmitting a message that has been subjected to protocol conversion by a protocol conversion unit 145 described later via the first IF unit 148 or the second IF unit 149. . Further, the overall control unit 144 performs processing for transmitting the voice data synthesized by the voice synthesis unit 146 via the second IF unit 149.

  The protocol conversion unit 145 performs mutual conversion between the LAN 200 side protocol and the WAN 201 side protocol. Here, in the present embodiment, the LAN 200 side performs call control according to a unique protocol, and the WAN side performs call control according to SIP (Session Initiation Protocol). The unit 145 converts a message used for call control according to a conversion table (not shown) stored in the storage unit 141, for example.

  In the present embodiment, call control is performed according to a unique protocol on the LAN 200 side. However, the present invention is not limited to this mode. An existing protocol such as H.323 may be used, and even in such a case, the protocol conversion unit 145 may perform protocol conversion.

  When the voice synthesizing unit 146 receives voice data to be transmitted from different transmission source communication addresses to the same transmission destination communication address, the voice synthesis unit 146 synthesizes these voice data.

  For example, the voice synthesizer 146 extracts the source address and destination address of the RTP packet received by the first IF unit 148, and there is voice data transmitted from the different source address to the same destination address. In this case, the storage unit 141 is buffered, audio data is reproduced from the RTP packet, and the reproduced audio data is synthesized. Here, as a technique for synthesizing audio data, an existing technique may be used, and a detailed description thereof will be omitted.

  The first IF unit 148 transmits and receives information via the LAN 200.

  The second IF unit 149 transmits and receives information via the WAN 201.

  The GW 140 described above can be realized by, for example, a general computer 900 as shown in FIG.

  For example, the storage unit 141 can be realized by the CPU 901 using the memory 902 or the external storage device 903, and the control unit 143 loads a predetermined program stored in the external storage device 903 into the memory 902. The first IF unit 148 and the second IF unit 149 can be realized by the CPU 901 using a plurality of communication devices 908.

  The predetermined program is downloaded from the storage medium 904 via the reading device 905 or from the network via the communication device 908 to the external storage device 903, and then loaded onto the memory 902 and executed by the CPU 901. You may do it. Alternatively, the program may be directly loaded on the memory 902 from the storage medium 904 via the reading device 905 or from the network via the communication device 908 and executed by the CPU 901.

  FIG. 11 is a schematic diagram of the client terminal 150. As illustrated, the client terminal 150 includes a storage unit 151, a control unit 153, an imaging unit 159, a sound collection unit 160, an input unit 161, a video output unit 162, an audio output unit 163, and a communication unit. 164.

  The storage unit 151 stores information necessary for processing at the client terminal 150. For example, in the present embodiment, at least one of video data and audio data transmitted / received to / from the video router 130, the communication address of the conference management server 110, and the like are stored.

  The control unit 153 includes an overall control unit 154, a communication control unit 155, a video synthesis unit 156, and a voice synthesis unit 157.

  The overall control unit 154 controls the entire processing at the client terminal 150.

  For example, in the present embodiment, the overall control unit 154 receives the client ID assigned to the client terminal 150 that sets the conference by the operator of the client terminal 150 or the IP telephone terminal via the input unit 161 described later. When the input of the conference setting instruction specifying 180 or the telephone number of the analog telephone terminal 190 is received, a call message including the input client ID or the telephone terminal is generated, and the communication control unit 155 and the communication unit 164 are set. Then, a process of transmitting the generated call message to the conference management server 110 is performed.

  In addition, when receiving a call message for setting a conference, the overall control unit 154 notifies the operator of the client terminal 150 that there has been an incoming call for setting the conference. Then, when the control unit 154 receives an input of an intention indicating that the conference is to be performed via the input unit 161, the overall control unit 154 transmits a response message to the conference management server 110 via the communication control unit 155 and the communication unit 164. Process.

  Here, notification that there has been an incoming call is performed by, for example, displaying a predetermined incoming call message on a video output unit 162 (to be described later) or outputting a ring tone from an audio output unit 163 (to be described later). Good.

  Further, in the present embodiment, the overall control unit 154 performs processing for outputting video data and audio data obtained via an imaging unit 159 and a sound collection unit 160 described later to the communication control unit 155.

  Further, the overall control unit 154 performs a process of outputting the video or audio synthesized by the video synthesis unit 156 or the audio synthesis 157 to the video output unit 162 or the audio output unit 163.

  The communication control unit 155 transmits and receives information via the communication unit 164.

  In addition, the communication control unit 155 outputs video data transmitted from different transmission sources to the video synthesis unit 156 and outputs audio data transmitted from different transmission sources to the audio synthesis unit 157.

  In the present embodiment, the communication control unit 155 transmits the video data and audio data output from the overall control unit 154 to the video router 130 as separate transmission data.

  The video composition unit 156 synthesizes the video data obtained from the communication control unit 155. Video data can be synthesized by dividing one screen into specific areas and inserting video data transmitted from a specific transmission source into a predetermined area. However, the present invention is not limited to this mode. For example, a part or all of a plurality of video data may be overlapped.

  The voice synthesis unit 157 synthesizes voice data obtained from the communication control unit 155. Here, as a technique for synthesizing audio data, an existing technique may be used, and a detailed description thereof will be omitted.

  The imaging unit 159 captures an image. The captured video is output to the overall control unit 154 as video data.

  The sound collection unit 160 collects sound. The collected sound is output to the overall control unit 154 as sound data.

  The input unit 161 receives input of information.

  The video output unit 162 outputs video data.

  The audio output unit 163 outputs audio data.

  The communication unit 164 transmits and receives information via the LAN 200.

  The client terminal 150 described above includes, for example, a general computer 900 as shown in FIG. 7, an imaging device (not shown) such as a video camera device, a sound collecting device (not shown) such as a microphone, a speaker, and the like. This can be realized by providing an audio output device (not shown).

  For example, the storage unit 141 can be realized by the CPU 901 using the memory 902 or the external storage device 903, and the control unit 143 loads a predetermined program stored in the external storage device 903 into the memory 902. The image capturing unit 159 can be realized by using the image capturing apparatus by the CPU 901, and the sound collecting unit 160 can be realized by using the sound collecting apparatus by the CPU 901. The input unit 161 can be realized by using the input device 906 by the CPU 901, the video output unit 162 can be realized by using the output device 907 by the CPU 901, and the audio output unit 163 can be realized by the CPU 901. The communication unit 164 can be realized by using an audio output device. It can be realized by using the communication device 908.

  The predetermined program is downloaded from the storage medium 904 via the reading device 905 or from the network via the communication device 908 to the external storage device 903, and then loaded onto the memory 902 and executed by the CPU 901. You may do it. Alternatively, the program may be directly loaded on the memory 902 from the storage medium 904 via the reading device 905 or from the network via the communication device 908 and executed by the CPU 901.

  FIG. 12 is a schematic diagram of the PBX 170. As illustrated, the PBX 170 includes a storage unit 171, a control unit 172, a WANIF unit 173, a LANIF unit 174, and an analog IF unit 175.

  The storage unit 171 stores information necessary for processing performed by the PBX 170.

  The control unit 172 controls processing at the PBX 170. For example, in the present embodiment, switching control among the WANIF unit 173, the LANIF unit 174, and the analog IF unit 175 is performed.

  In addition, the control unit 172 performs processing of digitizing an analog signal from the analog telephone terminal 190 from the analog IF unit 175, generating communication data corresponding to a protocol used in the WAN 201, and communicating via the WAN 201.

  The WANIF unit 173 transmits and receives information via the WAN 201.

  The LANIF unit 174 transmits and receives information via the LAN 202.

  The analog IF unit 175 transmits / receives information to / from the analog telephone terminal 190.

  The PBX 170 described above can be realized by a general computer 900 as shown in FIG.

  For example, the storage unit 171 can be realized by the CPU 901 using the memory 902 or the external storage device 903, and the control unit 172 loads a predetermined program stored in the external storage device 903 into the memory 902. It can be realized by executing it by the CPU 901, and the WANIF unit 173, the LANIF unit 174, and the analog IF unit 175 can be realized by the CPU 901 using the communication device 908 corresponding to each standard.

  The predetermined program is downloaded from the storage medium 904 via the reading device 905 or from the network via the communication device 908 to the external storage device 903, and then loaded onto the memory 902 and executed by the CPU 901. You may do it. Alternatively, the program may be directly loaded on the memory 902 from the storage medium 904 via the reading device 905 or from the network via the communication device 908 and executed by the CPU 901.

  The IP telephone terminal 180 is a telephone terminal that performs a voice call using IP (Internet Protocol).

  The analog telephone terminal 190 is a telephone terminal that performs a voice call using an analog line.

  FIG. 13 is a sequence diagram illustrating processing when a conference is performed in the conference system 100.

  Here, FIG. 13 shows processing when a call is set from the client terminal 150A to the client terminals 150B and 150C to set a conference, but the present invention is not limited to such a mode.

  First, the overall control unit 154 of the client terminal 150A receives a conference setting instruction specifying the client ID assigned to the client terminals 150B and 150C for setting the conference from the operator of the client terminal 150A via the input unit 161. When receiving the input, the communication control unit 155 generates a call message including the input client ID and instructs the communication control unit 155 to transmit to the conference management server 110, so that the communication control unit 155 transmits the call message to the communication control unit 155. It transmits to the conference management server 110 via the unit 163 (S10).

  In the conference management server 110 that has received such a call message, the call control unit 119 extracts the communication address corresponding to the client ID included in the call message from the address field 112c of the client information table 112a, and extracts the extracted communication. The call message is transferred to the address via the communication unit 124 (S11, S12). The call control unit 119 includes the address of the video router 130 in the call message transmitted to the client terminals 150B and 150C.

  In the client terminal 150B that has received such a call message, whether the overall control unit 154 displays a predetermined incoming call message on the video output unit 162 or outputs a ring tone from the audio output unit 163, for example. When the operator of the client terminal 150B is notified that a call for setting the conference has been made, and the input of the intention display indicating the conference is received via the input unit 161, the communication unit 164 is Then, a response message is transmitted to the conference management server 110 (S13).

  Similarly, in the client terminal 150 </ b> C that has received such a call message, the overall control unit 154 displays a predetermined incoming message on the video output unit 162 or receives a ring tone from the audio output unit 163. Or the operator of the client terminal 150C is notified that there has been a call for setting the conference, and via the input unit 161, an input of an intention display indicating that the conference is to be performed is received. A response message is transmitted to the conference management server 110 via the communication unit 164 (S14).

  In the conference management server 110 that has received such a response message, the conference management unit 120 uses the phone number of the conference held by the client terminals 150A, 150B, and 150C for the conference from the preset phone numbers. Assigned as a telephone number, creates a new record in the conference information table 114a, assigns the conference telephone number, client ID and communication address of the client terminals 150A, 150B, and 150C, and data transmitted and received by the client terminals 150A, 150B, and 150C The type (here, “video and audio”) is stored in the corresponding column of the generated record, the allocated conference telephone number, the communication address of the client terminals 150A, 150B, and 150C, and the client terminals 150A, 150B, and 150C Send and receive Data type (in this case, "video and audio") for the routing instructions to identify, and transmits to the video router 130 via the communication unit 124 (S15).

  In the conference management server 110 that has received such a response message, the call control unit 119 transfers the response message to the client terminal 150A via the communication unit 124 (S16). The call control unit 119 includes the communication address of the video router 130 and the assigned conference telephone number in the response message to be transferred.

  Upon receiving such a routing instruction, the conference information management unit 130 of the video router 130 adds a new record to the routing information table 132a, and the conference telephone number, communication address, data type ( Here, “video and audio”) is stored in the corresponding column, and the overall control unit 135 performs routing processing according to such a record.

  For example, video data and audio data are received from the first client terminal 150A (S17), video data and audio data are received from the client terminal 150B (S18), and video data and audio data are received from the client terminal 150C (S18). In the case of S19), the overall control unit 135 of the video router 130 transmits video data and audio data sent from the client terminal 150B (S20) to the client terminal 150A, and sent from the client terminal 150C. The video data and audio data are transmitted (S21).

  Then, in the client terminal 150A that receives the video data and audio data from the client terminal 150B and the video data and audio data from the client terminal 150C, the video synthesis unit 156 synthesizes the video data, and the audio synthesis unit 157 Synthesizes the audio data (S23), and outputs them to the video output unit 162 and the audio output unit 163, respectively.

  Further, the overall control unit 135 of the video router 130 transmits the video data and audio data transmitted from the client terminal 150A (S23) to the client terminal 150B, and the video data and audio transmitted from the client terminal 150C. Data transmission (S24) is performed.

  Then, in the client terminal 150B that has received the video data and audio data from the client terminal 150A and the video data and audio data from the client terminal 150C, the video synthesis unit 156 synthesizes the video data, and the audio synthesis unit 157 Synthesizes the audio data (S25), and outputs them to the video output unit 162 and the audio output unit 163, respectively.

  Further, the overall control unit 135 of the video router 130 transmits the video data and audio data sent from the client terminal 150A to the client terminal 150C (S26), and the video data and audio sent from the client terminal 150B. Data transmission (S27) is performed.

  Then, in the client terminal 150C that receives the video data and audio data from the client terminal 150A and the video data and audio data from the client terminal 150B, the video synthesis unit 156 synthesizes the video data, and the audio synthesis unit 157 Synthesizes the audio data (S28), and outputs them to the video output unit 162 and the audio output unit 163, respectively.

  In the sequence of FIG. 13, the process for setting a conference between the client terminals 150 connected to the LAN 200 has been described. For example, the IP telephone terminal 180 or the analog telephone terminal 190 on the WAN 201 side is added to the conference. In step S10, an input of the telephone number of the IP telephone terminal 180 or the analog telephone terminal 190 to participate in the conference is accepted, and a call message including the input telephone number is transmitted to the conference management server 110.

  Then, the call control unit 119 of the conference management server 110 may extract the communication address corresponding to the telephone number included in the outgoing call message from the telephone number information table 113a and transfer the outgoing call message to the extracted address.

  Such a call message is converted into a SIP INVITE message by the protocol conversion unit 145 of the GW 140, and thereafter the call control by SIP is performed by the overall control unit 144 of the GW 140 and the IP telephone terminal 180 or the analog telephone terminal 190 (PBX 170). When the GW 140 receives the ACK message when the call connection is completed from the IP telephone terminal 180 or the analog telephone terminal 190 (PBX 170), the protocol conversion unit 145 of the GW 140 causes the conference management server 110 to perform steps S13 or S14. A response message similar to that described above may be transmitted, and the processing after step S15 may be performed.

  FIG. 14 is a sequence diagram illustrating processing when a terminal on the WAN 201 side participates in a conference already held in the conference system 100.

  Note that FIG. 14 shows processing when joining from the IP telephone terminal 180A on the WAN 201 side to the conference held between the client terminal 150A and the client terminal 150B, but is not limited to such a mode. In addition, additional participation from the analog telephone terminal 190 and other client terminals 150 accommodated in the PBX 170 is also possible.

  Further, the operator of the client terminals 150A and 150B, for example, communicates the conference telephone number included in the response message transferred in step S16 of FIG. 13 to the operator of the IP telephone terminal 180A that permits participation. By notifying by this means, it becomes possible to participate in the conference using the conference telephone number obtained by the IP telephone terminal 180A.

  First, the operator of the IP telephone terminal 180A obtains the conference telephone number allocated for each conference by communication from the operator of the client terminal 150A that has set the conference, and makes a call to the acquired conference telephone number. Thus, IP telephone terminal 180A transmits a SIP INVITE message to PBX 170 (S30). This INVITE message includes information for specifying the data type (here, “voice”) transmitted and received by IP telephone terminal 180A.

  In the PBX 170 that has received such an INVITE message, the control unit 172 transfers the INVITE message to the WAN 201 via the WANIF unit 173. Note that the WAN 201 is provided with a SIP server (not shown), and the INVITE message is transferred to the conference management server 110 via the SIP server (S31).

  The INVITE message transferred to the conference management server 110 is converted by the protocol conversion unit 145 of the GW 140 into a call message of a protocol supported by the conference management server 110 via the first IF unit 148. It is transferred to the conference management server 110 (S32).

  The overall control unit 144 of the GW 140 returns a 180 RINGING message that is a response message to the INVITE message (S33), and the control unit 172 of the PBX 170 transfers the received 180 RINGING message to the IP telephone terminal 180A (S34).

  In the conference management server 110 that has received the call message transferred in step S32, the call control unit 119 returns a response message (S35). Note that this response message includes information for specifying the communication address of the video router 130.

  In the GW 140 that has received such a response message, the protocol conversion unit 145 converts the response message into a SIP 200 OK message and transmits it to the WAN 201 (S36), and the PBX 170 forwards it to the IP telephone terminal 180A (S37). ).

  The IP telephone terminal 180A that has received the 200 OK message transmits an ACK message to the PBX 170 (S38), and the control unit 172 of the PBX 170 transfers it to the conference management server 110 via the WANIF unit 173 (S39).

  In the GW 140 that has received such an ACK message, the protocol conversion unit 145 converts the ACK message from SIP into a response message of a protocol supported by the conference management server 110, and passes through the first IF unit 148. Transfer to the conference management server 110 (S40).

  In the conference management server 110 that has received such a response message, the conference management unit 120 records that the conference telephone number that has been called in step S32 is stored in the conference number column 114b of the conference holding information table 114a. And a new line is added to the specified record, the telephone number of the IP telephone terminal 180A, the communication address assigned to the IP telephone terminal 180A, the data type transmitted and received by the IP telephone terminal 180A (in this case, “ ”)” Is stored in the corresponding field of the generated record, the conference telephone number, the communication address assigned to the IP phone terminal 180A, and the data type transmitted and received by the IP phone terminal 180A (here, “voice”) Are transmitted to the video router 130 (S41).

  The conference information management unit 130 of the video router 130 that has received such a routing instruction stores a record of the routing information table 132 in which the conference telephone number included in the received routing instruction is stored in the conference number column 132b. Identify and add a new line to the identified record, store the address and data type (here, “voice”) included in the routing instruction in the corresponding column, and the overall control unit 135 Routing process is performed according to the record.

  For example, the overall control unit 135 of the video router 130 performs transmission / reception of video data and audio data between the client terminal 150A and the client terminal 150B, similarly to the processing shown in steps S17 to S28 in FIG. When voice data is received from IP telephone terminal 180A (S42), the voice data is transferred to client terminals 150A and 150B included in the record of the conference telephone number that is the same as the transmission source address according to routing information table 132 ( S43, S44).

  When the video controller 130 receives video data and audio data from the client terminal 150A (S45), the general control unit 135 of the video router 130 transfers the audio data to the IP telephone terminal 180A according to the data type column 132d of the routing information table 132. (S46).

  Further, when receiving the video data and the audio data from the client terminal 150B (S47), the overall control unit 135 of the video router 130 transfers the audio data to the IP telephone terminal 180A according to the data type column 132d of the routing information table 132. (S48).

  In the GW 140 that has received the voice data from the client terminal 150A and the client terminal 150B, the voice synthesizer 146 combines the received voice data into one voice data (S49) and transfers the voice data to the IP telephone terminal 180A (S50). .

  FIG. 15 is a sequence diagram illustrating processing when setting a conference from a terminal on the WAN 201 side in the conference system 100.

  FIG. 15 shows processing when a conference is set from the analog telephone terminal 190A to the client terminal 150A and the client terminal 150B. However, the present invention is not limited to this mode, and the IP telephone terminal 180 is not limited thereto. It is also possible to set up a conference from

  Also, the analog telephone terminal 190A has already set the telephone number for setting the conference for the client terminals 150A and 150B stored in the conference setting information table 115 from the conference management server 110 by means of communication or the like. It shall be acquired.

  First, the operator of the analog telephone terminal 190A calls the setting telephone number for setting the conference with the client terminals 150A and 150B that want to set the conference, so that the analog telephone number identifies the setting telephone number. A call signal (selection signal) that can be transmitted is transmitted to the PBX 170 (S60).

  In the PBX 170 that has received such a call signal, the control unit 172 generates a SIP INVITE message and transfers the INVITE message to the WAN 201 via the WANIF unit 173. Note that the WAN 201 is provided with a SIP server (not shown), and the INVITE message is transferred to the conference management server 110 via the SIP server (S61). The INVITE message includes information for specifying the data type (here, “voice”) transmitted / received by the analog telephone terminal 190A.

  The INVITE message transferred to the conference management server 110 is converted by the protocol conversion unit 145 of the GW 140 into a call message of a protocol supported by the conference management server 110 via the first IF unit 148. It is transferred to the conference management server 110 (S62).

  Further, the overall control unit 144 of the GW 140 returns a 180 RINGING message that is a response message to the INVITE message (S63), and when the control unit 172 of the PBX 170 receives the 180 RINGING message, the ringing signal (RBT: Ring Back Tone) is analogized. Transfer to the telephone terminal 190A (S64).

  When the conference management server 110 receives the call message, the call control unit 119 specifies a record in the conference setting information table 115a in which the setting telephone number specified by the call message is stored in the telephone number column 115b. Then, the client IDs of the client terminals 150A and 150B that are conference partners are acquired from the conference partner column 115c of the specified record.

  Next, the call control unit 119 identifies the record of the client information table 112a in which the acquired client ID is stored in the client ID column 112b, and the communication address of the client terminals 150A and 150B from the address column 112c of the identified record. To get.

  Then, the call control unit 119 of the conference management server 110 transmits a call message to the acquired communication address via the communication unit 124 (S65, S66). The call control unit 119 includes the communication address of the video router 130 in the call message transmitted to the client terminals 150B and 150C.

  In the client terminal 150A that has received such a call message, the overall control unit 154 displays, for example, a predetermined incoming call message on the video output unit 162 or outputs a ring tone from the audio output unit 163. When the operator of the client terminal 150A notifies the operator that there is an incoming call for setting the conference, and receives an input of an intention display indicating that the conference is to be performed via the input unit 161, the communication unit 163 is Then, a response message is transmitted to the conference management server 110 (S67).

  Similarly, in the client terminal 150B that has received such a call message, the general control unit 154 displays a predetermined incoming call message on the video output unit 162 or receives a ring tone from the audio output unit 163, for example. Or the operator of the client terminal 150B is notified that there has been an incoming call for setting the conference, and via the input unit 161, the input of the intention display indicating the conference is received. A response message is transmitted to the conference management server 110 via the communication unit 163 (S68).

  Upon receiving the response message from the client terminals 150A and 150B, the conference management server 110 transmits a response message to the conference setting request to the analog telephone terminal 190A (S69). Note that this response message includes information for specifying the communication address of the video router 130.

  In the GW 140 that has received such a response message, the protocol conversion unit 145 converts the response message into a SIP 200 OK message and transmits it to the PBX 170 (S70).

  Then, in the PBX 170 that has received such a 200 OK message, the control unit 172 switches the line of the analog telephone terminal 190A to connect the line of the analog telephone terminal 190A (S71) and sends an ACK message to the conference management server 110. A reply is made (S72). The control unit 172 of the PBX 170 extracts information specifying the communication address of the video router 130 included in the 200 OK message, stores the communication address in the storage unit 171, and is transmitted from the analog telephone terminal 190 A. Set to send incoming voice data to the stored communication address.

  In the GW 140 that has received the ACK message, the protocol conversion unit 145 converts the SIP ACK message into a response message supported by the conference management server 110 and forwards the response message to the conference management server 110 (S73).

  In the conference management server 110 that has received such a response message, the conference management unit 120 assigns the conference conference phone number as a conference phone number from among the preset phone numbers, and provides conference information. A new record is generated in the table 114a, and the assigned conference telephone number, the telephone number of the analog telephone terminal 190A and the client IDs of the client terminals 150A and 150B, the communication address assigned to the analog telephone terminal 190A and the client terminal 150A, Correspondence of records that generate a communication address of 150B, a data type transmitted and received by the analog telephone terminal 190A (here, “audio”) and a data type transmitted and received by the client terminals 150A and 150B (here “video and audio”) And store it in the A routing instruction specifying the assigned conference telephone number, the addresses of the analog telephone terminal 190A and the client terminals 150A and 150B, and the data types transmitted and received by the analog telephone terminal and the client terminals 150A and 150B is transmitted to the video router 130 (S74). ).

  Upon receiving such a routing instruction, the conference information management unit 130 of the video router 130 adds a new record to the routing information table 132a, and the conference telephone number, address, and data type (here) included in the routing instruction. Then, “video and audio”) is stored in the corresponding column, and the overall control unit 135 performs routing processing according to such a record, thereby setting the conference (S75).

  As described above, in this embodiment, the video router 130 does not have to perform heavy processing such as transferring video data and audio data according to the routing information table 132a and synthesizing video and audio. Data can be transferred more quickly and stably.

  Further, for example, like the client terminal 250 shown in FIG. 16 (schematic diagram of the client terminal 250), an output setting unit 258 for setting the output form of the video data and the audio data is provided in the control unit 253, thereby outputting The video synthesis unit 256 and the audio synthesis unit 257 can synthesize video data and audio data so that the output form set by the setting unit 258 is obtained.

  For example, the output setting unit 258 selects, via the input unit 161 and the video output unit 162, a position (horizontal position on the screen) for displaying video data sent from each destination on the video output unit 162. Accept and set the video composition unit 256 so that the video is displayed at the selected position, and stereo audio data from the audio data sent from each destination so that the sound image is localized at the selected position. Settings can be made in the speech synthesizer 257 to synthesize.

  Then, the video data and the audio data are synthesized according to the settings made by the video synthesis unit 256 and the voice synthesis unit 257, and output to the video output unit 162 and the audio output unit 163 via the overall control unit 154. A video and audio conference with a sense of reality can be held.

  Further, as in the case of the conference management server 210 shown in FIG. 17 (schematic diagram of the conference management server 210), in order to set a conference telephone number or a conference for participating in the held conference in the control unit 217. By providing the notification processing unit 221 that generates the notification information for specifying the setting telephone number, it is possible to smoothly participate in the conference or set the conference.

  For example, the notification processing unit 221 processes the information stored in the conference number column 114b, the terminal ID column 114c, and the address column 114d of the conference holding information table 114a into a predetermined display format. And disclosed as a document on the WWW (World Wide Web) or forwarded by e-mail in response to a disclosure request from a computer connected to the WAN 201.

  Further, the notification processing unit 221 can also publish only those for which the disclosure of the conference telephone number has been approved from the terminal that has set the conference. For example, a reply message indicating whether or not to disclose the conference telephone number is received from the operator of the client terminal 150A that has received the response message in step S16 in FIG. The conference telephone number of the conference set via the client terminal 150A is disclosed.

  The notification processing unit 221 combines the information stored in the conference number column 114b, the terminal ID column 114c, and the address column 114d of the conference holding information table 114a with the data prepared in advance. Data may be transmitted to a terminal connected with a specific telephone number (disclosure telephone number).

  Further, the notification processing unit 221 processes the information stored in the telephone number column 115b and the conference partner column 115c of the conference setting information table 115a into a predetermined display format, and performs WWW (World Wide Web). The document is disclosed as a document in (1) or is transferred by e-mail in response to a disclosure request from a computer connected to the WAN 201.

  Note that the notification processing unit 221 uses the information stored in the telephone number column 115b and the conference partner column 115c of the conference setting information table 115a as voice data by combining data prepared in advance, so that a specific telephone You may make it transmit to the terminal connected with the number (telephone number for disclosure).

  Furthermore, in the embodiment described above, a call message specifying the client ID of the client terminal 150 of the other party of the conference is transmitted in step S10 of FIG. 13, but the present invention is limited to such an aspect. Instead, for example, a call message specifying a setting telephone number in the conference setting information table 115a may be transmitted.

  In the embodiment described above, one video router 130 is provided. However, the present invention is not limited to such a mode, and a plurality of video routers 130 may be provided to perform load distribution. Even in such a case, in the present embodiment, since the communication address of the video router 130 to be used after a call is made from the terminal is notified to the terminal participating in the conference, each video router 130 is notified. Load distribution can be performed efficiently according to the number of conferences allocated to the number of terminals, the number of terminals communicating with each video router 130, and the like.

  For example, when there is a new call for setting a conference, the video router 130 starts with the least number of conferences already allocated, or the number of terminals participating in the already allocated conference is small. By selecting and conducting a conference in order from the video router 130, load distribution can be performed efficiently.

  In the embodiment described above, a routing instruction is given to the video router 130 using a conference telephone number as an identifier for identifying each conference set in the conference management server 110. The present invention is not limited to this mode, and each conference may be identified by using an identification ID assigned to each conference separately from the conference telephone number.

Schematic diagram of a conference system. Schematic diagram of a conference management server. Schematic diagram of a client information table. Schematic of a telephone number information table. Schematic of a meeting holding information table. Schematic diagram of a conference setting information table. Schematic diagram of a computer. Schematic diagram of a video router. Schematic diagram of a routing information table. Schematic of GW. Schematic of a client terminal. Schematic of PBX. The sequence diagram which shows the process at the time of conducting a meeting in a conference system. The sequence diagram which shows the process at the time of the terminal of the WAN side participating in the meeting already held in the conference system. The sequence diagram which shows the process at the time of setting a meeting from the terminal by the side of WAN in a conference system. Schematic of a client terminal. Schematic diagram of a conference management server.

Explanation of symbols

100 Conference system 110 Conference management server 111 Storage unit 112 Client information storage region 113 Telephone number information storage region 114 Conference holding information storage region 115 Conference setting information storage region 117 Control unit 118 Overall control unit 119 Call control unit 120 Conference management unit 130 Video Router 131 Storage unit 132 Routing information storage area 134 Control unit 135 Overall control unit 136 Conference information management unit 140 GW
141 Storage Unit 143 Control Unit 144 Overall Control Unit 145 Protocol Conversion Unit 146 Speech Synthesis Unit 150 Client Terminal 151 Storage Unit 153 Control Unit 154 Overall Control Unit 155 Communication Control Unit 156 Video Synthesis Unit 157 Speech Synthesis Unit 159 Imaging Unit 160 Sound Collection Unit 162 Video output unit 163 Audio output unit 170 PBX
171 Storage unit 172 Control unit 180 IP telephone terminal 190 Analog telephone terminal

Claims (9)

A conference system having a plurality of client terminals and a relay device,
The control unit of the client terminal performs processing of transmitting the video data captured by the imaging unit and the audio data collected by the audio collecting unit with the address of the relay device as a destination,
The control unit of the relay device performs processing of transmitting video data and audio data transmitted from another client terminal participating in the conference to one client terminal participating in the conference, respectively. ,
When the control unit of the one client terminal receives the video data and the audio data from the plurality of other client terminals, the control unit synthesizes the received plurality of video data into one video data and outputs it to the video output unit. Performing a process of synthesizing a plurality of audio data into one audio data and outputting it to the audio output unit;
A conference system characterized by The conference system according to claim 1,
A conference management server;
The storage unit of the conference management server stores client information having information for specifying the client terminal and information for specifying the address of the client terminal,
The control unit of the conference management server
When receiving a call message having information identifying a client terminal participating in a conference from the client terminal, a process of extracting an address of the client terminal participating in the conference from the client information;
A process of transmitting a routing instruction including the extracted address and the address of the client terminal that has transmitted the call message to the relay device;
The control unit of the relay device specifies the video data and audio data received from the client terminal specified by one address included in the routing instruction, by another address included in the routing instruction. Process to send to the client terminal,
A conference system characterized by The conference system according to claim 2,
A phone terminal,
In the storage unit of the conference management server, telephone number information having information for specifying a telephone number of the telephone terminal and information for specifying an address allocated to the telephone terminal is stored.
The control unit of the conference management server
When receiving a calling message having information for identifying a telephone number participating in the conference from the client terminal, a process of extracting the address of the telephone terminal participating in the conference from the telephone number information;
A process of transmitting a routing instruction including the extracted address and the address of the client terminal that has transmitted the call message to the relay device;
The control unit of the relay device
Processing for transmitting video data and audio data received from a client terminal specified by one address included in the routing instruction to a client terminal specified by another address included in the routing instruction;
Processing for transmitting voice data received from a client terminal specified by one address included in the routing instruction to a telephone terminal specified by another address included in the routing instruction;
Processing for transmitting voice data received from a telephone terminal specified by one address included in the routing instruction to a client terminal specified by another address included in the routing instruction;
Performing at least one process of
A conference system characterized by The conference system according to claim 2,
A phone terminal,
In the storage unit of the conference management server, information for specifying at least one client terminal participating in the conference, information for specifying a setting telephone number for setting a conference with the client terminal, Conference setting information is stored,
The control unit of the conference management server
When a call message in which the setting telephone number is selected is received from the telephone terminal, the client terminal that participates in the conference with the setting telephone number is identified from the conference setting information, and the address of the identified client terminal is Processing to extract from client information;
A process of transmitting a routing instruction including the extracted address and an address assigned to the telephone terminal that has transmitted the call message to the relay device, and
The control unit of the relay device
Processing for transmitting video data and audio data received from a client terminal specified by one address included in the routing instruction to a client terminal specified by another address included in the routing instruction;
Processing for transmitting voice data received from a client terminal specified by one address included in the routing instruction to a telephone terminal specified by another address included in the routing instruction;
Processing for transmitting voice data received from a telephone terminal specified by one address included in the routing instruction to a client terminal specified by another address included in the routing instruction;
Performing at least one process of
A conference system characterized by The conference system according to claim 1,
A conference management server and a telephone terminal;
In the storage unit of the conference management server,
Client information having information for specifying the client terminal and information for specifying the address of the client terminal;
Telephone number information having information for identifying a telephone number of the telephone terminal and information for identifying an address allocated to the telephone terminal;
Is remembered,
The control unit of the conference management server
When a call message having at least one of information specifying a client terminal participating in a conference and information specifying a telephone terminal participating in the conference is received from the client terminal or the telephone terminal, the client information or the phone A process of extracting the address of the client terminal or telephone number participating in the conference from the number information;
A process of allocating a conference telephone number to be used for participating in the conference from predetermined telephone numbers;
Information identifying the conference telephone number allocated to the conference, information identifying at least one of the client terminal and the telephone terminal participating in the conference, and identifying the address of the client terminal or the telephone terminal Storing the conference holding information having information in the storage unit of the conference management server;
A process for transmitting a routing instruction including information for identifying an address of a client terminal or a telephone terminal participating in the conference and information for identifying a conference telephone number allocated to the conference to the relay device. ,
The control unit of the relay device
Information specifying the address of the client terminal or telephone terminal participating in the conference included in the routing instruction and information specifying the conference telephone number allocated to the conference are associated with each other as routing information. Processing stored in the storage unit of the relay device;
In the routing information, the video data and audio data received from the client terminal specified by the one address associated with one conference telephone number are associated with the one conference telephone number. Processing to send to the client terminal specified by the address of
In the routing information, the voice data received from the client terminal specified by one address associated with one conference telephone number is transmitted to another address associated with the one conference telephone number. Process to send to the identified phone terminal,
In the routing information, the voice data received from the telephone terminal specified by one address associated with one conference telephone number is transmitted to another address associated with the one conference telephone number. Processing to be sent to the identified client terminal,
In the routing information, the voice data received from the telephone terminal specified by one address associated with one conference telephone number is transmitted to another address associated with the one conference telephone number. One or more of at least one of the processes to send to the identified telephone terminal;
To do the
A conference system characterized by The conference system according to claim 5,
The control unit of the conference management server
When a call message in which the conference telephone number is selected is received from the telephone terminal, information specifying the conference telephone number included in the call message and the telephone terminal that has transmitted the call message A process for transmitting a routing instruction including information specifying an allocated address to the relay device;
The control unit of the relay device includes information specifying the address included in the received routing instruction in the routing information corresponding to the conference telephone number included in the received routing instruction, and Performing processing to be stored in the storage unit;
A conference system characterized by The conference system according to any one of claims 3 to 6,
A gateway between the relay device and the telephone terminal;
When there are a plurality of voice data to be transmitted to one telephone terminal, the control unit of the gateway performs a process of combining a plurality of voice data into one voice data and transmitting the voice data to the exchange.
A conference system characterized by The conference system according to any one of claims 1 to 7,
The control unit of the client terminal receives selection of a position for displaying video data sent from each destination on the video output unit via the input unit and the video output unit, and the video selected at the selected position. Performing a process of combining a plurality of video data into one video data so that the data is displayed;
A conference system characterized by A data processing method performed in a conference system having a plurality of client terminals and a relay device,
A process in which the control unit of the client terminal performs a process of transmitting the video data captured by the imaging unit and the audio data collected by the audio collecting unit with the address of the relay device as a destination;
The control unit of the relay device performs a process of transmitting video data and audio data transmitted from another client terminal participating in the conference to one client terminal participating in the conference, respectively. Process,
When the control unit of the one client terminal receives video data and audio data from a plurality of other client terminals, the received plurality of video data are combined into one video data and output to the video output unit. Performing a process of synthesizing a plurality of audio data into one audio data and outputting it to the audio output unit,
A data processing method characterized by the above.

Images