WO2024100920A1 - Information processing device, information processing method, and program for information processing - Google Patents

Abstract

The purpose of the present invention is to provide an information processing device and the like which make it possible to grasp who else are participating in an electronic meeting without viewing a screen showing participants during the electronic meeting.　An information processing device for providing an electronic meeting in which a plurality of users participate each using a terminal device connected to a communication line generates background sound data by synthesizing, among different sound data assigned to the respective users, sound data assigned to users participating in the electronic meeting, and transmits the background sound data to terminal devices used by the users participating in the electronic meeting.

Description

Information processing device, information processing method, and information processing program

This application relates to the technical field of information processing devices and the like that provide electronic conferences in which multiple users participate using terminal devices each connected to a communication line.

As teleworking spreads with the development of information and communication technology, opportunities for electronic conferences using terminal devices such as PCs are increasing. Patent Document 1 discloses technology related to electronic conferences, and facial images of participants taking part in an electronic conference are displayed on the screen of a terminal device shown in Figure 18 of Patent Document 1. This allows participants to see at a glance who else is taking part in the electronic conference besides themselves.

JP 2022-74159 A

However, the example in FIG. 18 of Patent Document 1 has the problem that it is difficult to know who else is participating in the electronic conference unless you look at the screen showing the participants during the electronic conference.

In view of this, the present invention aims to provide an information processing device or the like that allows a user to know who is participating in an electronic conference other than himself/herself, without having to look at a screen showing the participants during the electronic conference.

The invention described in claim 1 is an information processing device that provides an electronic conference in which multiple users participate using terminal devices connected to a communication line, and is characterized by comprising: background sound data generating means that generates background sound data by synthesizing sound data assigned to the users participating in the electronic conference from among the different sound data assigned to each of the users; and transmission means that transmits the background sound data to the terminal devices used by each of the multiple users participating in the electronic conference.

The invention described in claim 8 is an information processing method by an information processing device that provides an electronic conference in which multiple users participate using terminal devices connected to a communication line, and is characterized by including a background sound data generation step of generating background sound data by synthesizing sound data assigned to the users participating in the electronic conference from among the different sound data assigned to each of the users, and a transmission step of transmitting the background sound data to the terminal devices used by each of the multiple users participating in the electronic conference.

The invention described in claim 9 is characterized in that a computer included in an information processing device that provides an electronic conference in which multiple users participate using terminal devices connected to a communication line functions as background sound data generating means that generates background sound data by synthesizing the sound data assigned to the users participating in the electronic conference from among the different sound data assigned to each of the users, and transmitting means that transmits the background sound data to the terminal devices used by each of the multiple users participating in the electronic conference.

1 is a block diagram showing an example of a configuration of an information processing device 10 according to an embodiment. 1 is a schematic diagram showing an electronic conference system S in an embodiment. FIG. 2 is a block diagram showing a configuration example of an electronic conference server 100 according to an embodiment. FIG. 2 is a block diagram showing an example of the configuration of a terminal device 200 according to an embodiment. 4 is a flowchart showing an example of a background sound generation process performed by the electronic conference server 100 in the embodiment. 13 is a schematic diagram showing the relationship between the distance between users and the volume of sounds contained in the background sound in a modified example. FIG. 13 is a flowchart showing an example of a sound image localization data generation process performed by the electronic conference server 100 in a modified example. 10 is a flowchart showing an example of a volume control data generation process performed by the electronic conference server 100 in a modified example. FIG. 13 is a diagram showing an example of a sound data table in a modified example.

The embodiment of the present invention will be explained with reference to FIG. 1.

As shown in FIG. 1, the information processing device 10 is an information processing device that provides an electronic conference in which multiple users participate using terminal devices each connected to a communication line, and includes a background sound data generating means 11 and a transmitting means 12.

The background sound data generating means 11 generates background sound data by synthesizing the sound data assigned to the users participating in the electronic conference from among the different sound data assigned to each of the users.

The transmission means 12 transmits the background sound data to the terminal devices used by each of the multiple users participating in the electronic conference.

With the information processing device 10, you can tell who else is participating in the electronic conference from the sounds contained in the background sound, without having to look at the screen.

The following example will be explained using Figures 2 to 5.

[1. Overview of the electronic conference system S]
First, an overview of the electronic conference system S will be described with reference to Fig. 2. In the example of Fig. 2, four users A, C, F, and I among users A to I are participants in the electronic conference.

The electronic conference system S includes an electronic conference server 100 and multiple terminal devices 200, and the electronic conference server 100 and each terminal device 200 are connected via a network (not shown). The network is formed by communication lines such as wireless LAN, wired LAN, communication carrier lines, optical fiber lines, and telephone lines, as well as communication devices such as routers, switching hubs, firewalls, wireless antennas, optical relay devices, and cables that connect them.

The electronic conference server 100 provides an electronic conference venue for users A, C, F, and I who are participating in the electronic conference. For example, when the electronic conference server 100 receives a new request to provide an electronic conference from the terminal device 200 used by user A, it generates an electronic conference link that users A, C, F, and I access when joining the electronic conference, and transmits it to user A's terminal device 200. User A, who receives the electronic conference link, transfers the electronic conference link to the terminal devices 200 of users C, F, and I.

When users A, C, F, and I access the electronic conference server 100 via the electronic conference link using their respective terminal devices 200, the electronic conference server 100 connects each terminal device 200 and provides a venue for the electronic conference.

The electronic conference server 100 also stores in advance sound data assigned to each of users A-I who may participate in the electronic conference. In this embodiment, as an example, each of users A-I is assigned the sound of each instrument in classical music (user A: violin, user B: cello, user C: clarinet, user D: flute, user E: trumpet, user F: horn, user G: trombone, user H: timpani, user I: marimba).

The electronic conference server 100 generates background sound data "BGM.mp3" by synthesizing the sound data "aaa.mp3", "ccc.mp3", "fff.mp3", and "iii.mp3" assigned to the terminal devices 200 users A, C, F, and I who have accessed the electronic conference to participate in the electronic conference, and transmits the data to the terminal devices 200 of users A, C, F, and I. Each terminal device 200 then plays "BGM.mp3" during the electronic conference and outputs the background sound from the speakers. As the background sound includes the sounds of a violin, clarinet, horn, and marimba, users A, C, F, and I can thus know who else is participating in the electronic conference besides themselves. It is preferable to inform each user in advance which instrument has been assigned to each user.

2. Configuration of the electronic conference server 100
The configuration of the electronic conference server 100 will be described with reference to Fig. 3. Fig. 3 is a block diagram showing an example of the configuration of the electronic conference server 100.

The electronic conference server 100 comprises a control unit 111, a memory unit 112 consisting of a hard disk drive (HDD) or a solid state drive (SSD), a communication unit 113, a display unit 114, and an interface (I/F) unit 115, and a display unit 116 and an operation unit 117 are connected via the I/F unit 115.

The control unit 111 is composed of a CPU 111a that controls the entire control unit 111, a ROM 111b in which control programs and the like that control the control unit 111 are prestored, and a RAM 111c that temporarily stores various data. The control unit 111 or the CPU 111a corresponds to a "computer."

The control unit 111 executes various processes (including background sound generation process described below) to provide an electronic conference venue for multiple terminal devices 200 connected via a network.

The storage unit 112 stores various programs such as an OS (Operating System) and application programs, as well as data and information used by the various programs. The storage unit 112 stores a program that causes the control unit 111 to synthesize sound data assigned to users participating in the electronic conference to generate background sound data, and transmit the data to the terminal device 200 of the user participating in the electronic conference. Note that the various programs may be obtained, for example, from a server device or the like via a network, or may be read from a recording medium such as a USB memory.

The storage unit 112 stores the sound data assigned to users A-I. The sound data is managed in a sound data table. Sound data is assigned to users by the electronic conference server 100, for example, when the users register to use an electronic conference provided by the electronic conference server 100. Users who wish to use an electronic conference are required to register as users with the electronic conference server 100 in advance, and at this time the electronic conference server 100 assigns sound data to the users along with their accounts and passwords.

The communication unit 113 has a communication device, etc., and communicates with the terminal device 200 to send and receive data to and from the terminal device 200.

The display unit 114 is configured with a graphics controller 114a and a buffer memory 114b consisting of a memory such as a VRAM (Video RAM). In this configuration, the graphics controller 114a controls the display unit 114 and the display section 116 based on control information sent from the control section 111. The buffer memory 114b also temporarily stores image data that can be displayed immediately on the display section 116. An image is then displayed on the display section 116 based on the image data output from the graphics controller 114a.

The I/F unit 115 has the necessary structure and functions to connect the electronic conference server 100 to external devices such as the display unit 116 and the operation unit 117, and performs data conversion between the two as necessary.

The display unit 116 is a liquid crystal display or the like, and displays an image based on the image data received from the display unit 114.

The operation unit 117 detects the operation of the operator and transmits operation data indicating the operation content, etc. to the control unit 111. The control unit 111 determines which operation has been performed based on the operation data and performs processing according to the operation content.

3. Configuration of terminal device 200
The configuration of the terminal device 200 will be described with reference to Fig. 4. Fig. 4 is a block diagram showing an example of the configuration of the terminal device 200.

The terminal device 200 includes a control unit 211, a memory unit 212 consisting of a HDD, SSD, etc., a communication unit 213, a display unit 214, and an interface (I/F) unit 215, and is connected to a microphone 216, a speaker 217, a camera 218, a display unit 219, and an operation unit 220 via the I/F unit 215.

The control unit 211 is composed of a CPU 211a that controls the entire control unit 211, a ROM 211b in which control programs and the like that control the control unit 211 are stored in advance, and a RAM 211c that temporarily stores various data. The control unit 211 or the CPU 211a corresponds to a "computer."

The control unit 211 executes various processes for participating in an electronic conference provided by the electronic conference server 100.

The storage unit 212 stores various programs such as an OS and application programs, as well as data and information used by the various programs. The storage unit 212 stores a program that enables the control unit 211 to participate in an electronic conference. Note that the various programs may be obtained, for example, from a server device or the like via a network, or may be read from a recording medium such as a USB memory.

The communication unit 213 has a communication device, etc., and communicates with the electronic conference server 100 and other terminal devices 200 to send and receive data to and from each other.

The display unit 214 is configured with a graphics controller 214a and a buffer memory 214b consisting of a memory such as a VRAM. In this configuration, the graphics controller 214a controls the display unit 214 and the display section 219 based on control information sent from the control section 211. The buffer memory 214b also temporarily stores image data that can be displayed immediately on the display section 219. Then, an image is displayed on the display section 219 based on the image data output from the graphics controller 214a.

The I/F unit 215 has the necessary structure and functions to connect the terminal device 200 to external devices such as the microphone 216, speaker 217, camera 218, display unit 219, and operation unit 220, and performs data conversion between the two as necessary.

The microphone 216 converts the voice (sound) of the user, etc. into an electrical signal. The electrical signal is sent to the control unit 211 via the I/F unit 215.

The speaker 217 outputs sound data (electrical signals) as sound according to the control of the control unit 211. In this embodiment, the speaker 217 outputs background sound based on background sound data received from the electronic conference server 100.

The camera 218 transmits image data captured through the lens to the control unit 211 via the I/F unit 215.

The display unit 219 is a liquid crystal display or the like, and displays an image based on the image data received from the display unit 214.

Note that while FIG. 4 shows an example in which the terminal device 200 is a desktop PC, the terminal device 200 may also be a notebook PC, a smartphone, a tablet terminal, etc., and in these cases, the control unit 211, memory unit 212, communication unit 213, display unit 214, interface (I/F) unit 215, microphone 216, speaker 217, camera 218, display unit 219, and operation unit 220 may be integrated.

The operation unit 220 detects user operations and transmits operation data indicating the operation content, etc. to the control unit 211. The control unit 211 determines which operation has been performed based on the operation data and performs processing according to the operation content.

[4. Background Sound Generation Process by the Electronic Conference Server 100]
Next, the background sound generation process by the electronic conference server 100 will be described with reference to the flowchart shown in Fig. 5. Fig. 5 is a flowchart showing an example of the background sound generation process by the electronic conference server 100. Also, before the flowchart shown in Fig. 5 starts, it is assumed that an electronic conference link is distributed to the terminal devices 200 of the users participating in the electronic conference, and the electronic conference server 100 and each terminal device 200 are connected via a login process using an account and a password.

First, the control unit 111 (CPU 111a) identifies users participating in the electronic conference (step S101). Specifically, the control unit 111 identifies the terminal device 200 that has connected to the electronic conference server 100 via the electronic conference link based on the account used during the login process, etc.

Next, the control unit 111 retrieves from the storage unit 112 the sound data assigned to each user (terminal device 200) identified in the processing of step S101 (step S102).

Next, the control unit 111 synthesizes the sound data acquired in the processing of step S102 to generate background sound data (step S103). At this time, the control unit 111 synthesizes the sound data so that the sound of each piece of sound data is included in the background sound, that is, so that the sound assigned to each user participating in the electronic conference can be heard from the background sound.

Then, the control unit 111 transmits the background sound data generated in the process of step S103 to the terminal device 200 of each user participating in the electronic conference (each terminal device 200 identified in the process of step S101) (step S104). Note that, although not shown in FIG. 5, the control unit 211 of each terminal device 200 that receives the background sound data outputs background sound based on the background sound data from the speaker 217.

Then, the control unit 111 determines whether the electronic conference has ended (step S105). At this time, if the control unit 111 determines that the electronic conference has ended (step S105: YES), the control unit 111 ends the background sound generation process. On the other hand, if the control unit 111 determines that the electronic conference has not ended (step S105: NO), the control unit 111 proceeds to the process of step S106.

Next, the control unit 111 determines whether there has been a change in the users participating in the electronic conference (step S106). Changes in the users participating in the electronic conference include cases where a new user joins the electronic conference and cases where a user participating in the electronic conference leaves the electronic conference. At this time, if the control unit 111 determines that there has been no change in the users participating in the electronic conference (step S106: NO), it proceeds to the process of step S105. That is, unless the electronic conference ends or there is a change in the users participating in the electronic conference, the processes of steps S105 and S106 are repeated. On the other hand, if the control unit 111 determines that there has been a change in the users participating in the electronic conference (step S106: YES), it proceeds to the process of step S101, identifies the users participating in the electronic conference at that time, generates background sound data again, and transmits it to each terminal device 200 of the users participating in the electronic conference. As a result, background sound based on the background sound data generated from the sound data assigned to each user participating in the electronic conference at that time is always output from the speaker 217 of the terminal device 200 of each user.

As described above, the electronic conference server 100 in this embodiment provides an electronic conference in which multiple users participate using terminal devices 200 each connected to a communication line, and the control unit 111 (an example of a "background sound data generating means" and "transmitting means") generates background sound data by synthesizing the sound data assigned to the users participating in the electronic conference from the different sound data assigned to each user, and transmits the background sound data to the terminal devices 200 used by each of the multiple users participating in the electronic conference.

Therefore, according to the electronic conference server 100, background sounds based on background sound data generated from sound data assigned to each user participating in the electronic conference are output from the speaker 217 of each user's terminal device 200, so that each user can tell who else is participating in the electronic conference besides themselves from the sounds contained in the background sound, without having to look at the screen.

In other words, even if the user is participating in the electronic conference using a terminal device that does not have the display unit 219, the user can know who is participating in the electronic conference. Also, even if materials related to the electronic conference are displayed on the entire surface of the display unit 219 and information indicating the participants in the electronic conference is not displayed on the display unit 219, the user can know who is participating in the electronic conference.

In addition, in this embodiment, the control unit 111 of the electronic conference server 100 regenerates background sound data when a user participating in the electronic conference joins (joining midway) or leaves (leaving midway) during the electronic conference, and transmits the regenerated background sound data to the terminal devices 200 used by each of the multiple users participating in the electronic conference. As a result, even if a user participating in the electronic conference changes during the electronic conference, background sound corresponding to the user participating in the electronic conference is output from the speaker 217 of each terminal device 200 as appropriate, so that the user can know that there has been a change in the participants based on the change in background sound, and further, who has joined or left midway.

5. Modifications
Next, modified examples of this embodiment will be described. Note that the modified examples described below can be combined as appropriate.

[5.1. Modification 1]
The electronic conference server 100 receives location information (latitude, longitude, altitude information, etc.) from each terminal device 200, and the control unit 111 may determine how to output the sound included in the background sound assigned to each user participating in the electronic conference according to the location of the terminal device 200 used by each user based on the location information received from each terminal device 200. Each terminal device 200 may acquire location information by any means. For example, the terminal device 200 may be provided with a GPS receiving unit and acquire location information based on a GPS signal received by the GPS receiving unit, or the user may input location information.

[5.1.1. Modification 1-1]
6 is an example diagram showing the positions of users C, F, and I relative to user A. In variant example 1-1, the sound image localization of the sound data included in the background sound output from the terminal device 200 of user A and assigned to users C, F, and I is set to the positions of the terminal devices 200 used by users C, F, and I to which the sound data that is the basis of the sound is assigned, based on the position of the terminal device 200 used by user A.

Specifically, the control unit 111 of the electronic conference server 100 (an example of a "position information acquisition means" and "sound image localization data generation means") acquires position information of the terminal device 200 used by each user participating in the electronic conference, and generates sound image localization data that localizes the sound image of the sound data assigned to each user other than one user, among the sounds included in the background sound based on the background sound data transmitted to the terminal device 200 used by one user participating in the electronic conference, to the position of the terminal device 200 used by the user to which the sound data that is the basis of the sound is assigned, based on the position of the terminal device 200 used by the one user. In addition, the control unit 111 generates sound image localization data for the terminal device 200 used by each user participating in the electronic conference, with each user participating in the electronic conference as the one user, and further transmits the sound image localization data generated for the terminal device 200 to the terminal device 200 used by each user participating in the electronic conference.

For example, in the example of FIG. 6, the control unit 111 acquires position information of the terminal device 200 used by each of the users A, C, F, and I participating in the electronic conference, and generates sound image localization data that sets the sound image localization of the sound of the sound data assigned to each of the users C, F, and I other than user A, among the sounds included in the background sound based on the background sound data transmitted to the terminal device 200 used by user A participating in the electronic conference, to the position of the terminal device 200 used by each of the users C, F, and I to which the sound data that is the basis of the sound, based on the position of the terminal device 200 used by user A, and further transmits the data to the terminal device 200 used by user A. The control unit 111 also performs this process on the terminal devices 200 used by users C, F, and I other than user A. Then, based on the background sound data and sound image localization data received from the electronic conference server 100, the control unit 211 of the terminal device 200 outputs the background sound from the speaker 217, with the sound image localization of each sound included in the background sound set to the position of the user corresponding to the sound. This allows, for example, user A to ascertain the location of each user participating in the electronic conference from the direction of each sound contained in the background sound (user C is in the west direction, user F is in the north direction, and user I is in the southeast direction). In this case, it is assumed that speaker 217 has specifications and settings that allow for sound image localization.

[Sound image localization data generation process by the electronic conference server 100]
Next, a sound image localization data generation process by the electronic conference server 100 will be described with reference to the flowchart shown in Fig. 7. Fig. 7 is a flowchart showing an example of a sound image localization data generation process by the electronic conference server 100 in a modified example. Here, the example shown in Fig. 6 (when four users A, C, F, and I participate in the electronic conference) will be described.

First, the control unit 111 (CPU 111a) acquires the location information of all users participating in the electronic conference (step S201). For example, the control unit 111 acquires the location information (latitude, longitude, altitude information, etc.) received in advance from the terminal device 200 used by each user participating in the electronic conference.

Next, the control unit 111 selects one user to participate in the electronic conference (step S202).

Next, the control unit 111 selects one user from among the users participating in the electronic conference other than the user selected in the process of step S202 (step S203). For example, if the control unit 111 selects user A in the process of step S202, it selects one of users C, F, or I.

Next, the control unit 111 uses the position of the terminal device 200 used by the user selected in the processing of step S202 as a reference, and determines the position (e.g., the direction and distance from the reference) of the terminal device 200 used by the user selected in the processing of step S203 (step S204).

Next, the control unit 111 stores the sound image position of the sound data assigned to the user selected in the process of step S203 among the sounds included in the background sound based on the background sound data (i.e., the background sound data generated in the background sound generation process) transmitted to the terminal device 200 used by each user participating in the electronic conference, in association with the position identified in the process of step S204 (step S205).

Next, the control unit 111 determines whether or not all other users other than the user selected in step S202 have been selected in the process of step S203 (step S206). For example, if the control unit 111 has selected user A in the process of step S202, the control unit 111 determines whether or not all users C, F, and I have been selected in the process of step S203. If the control unit 111 determines that all other users have not been selected (step S206: NO), it proceeds to the process of step S203 and selects other users that have not been selected up to that point. On the other hand, if the control unit 111 determines that all other users have been selected (step S206: YES), it then generates sound image localization data indicating the correspondence between the sound and sound image localization stored in the process of step S205 for all other users (step S207). For example, if user A is selected in the processing of step S202, the control unit 111 generates sound image localization data in which the sound image localization of the sound data assigned to users C, F, and I is the position of the terminal device 200 used by users C, F, and I, using the terminal device 200 used by user A as the reference position.

Next, the control unit 111 transmits the sound image localization data generated in the processing of step S207 to the terminal device 200 used by the user selected in the processing of step S202 (step S208).

Next, the control unit 111 determines whether or not all users participating in the electronic conference have been selected in the process of step S202 (step S209). That is, the control unit 111 determines whether or not the four users A, C, F, and I have been selected in the process of step S202. If the control unit 111 determines that all users participating in the electronic conference have not been selected (step S209: NO), it proceeds to the process of step S202 and repeats the processes of steps S202 to S208 for each remaining user. On the other hand, if the control unit 111 determines that all users participating in the electronic conference have been selected (step S209: YES), it ends the sound image localization data generation process.

The control unit 111 may combine the sound image localization data with the background sound data and transmit it, or may transmit it separately from the background sound data.

[5.1.2. Modification 1-2]
As shown in Fig. 6, in variant example 1-2, the volume of the sound of the sound data respectively assigned to users C, F, and I, which is included in the background sound output from the terminal device 200 of user A, is set to a volume according to the distance between the position of the terminal device 200 used by users C, F, and I to which the sound data that is the basis of the sound is assigned, and the position of the terminal device 200 used by user A. Note that in Fig. 6, the thickness of the arrows extending from users C, F, and I to user A indicates the volume (the thicker the arrow, the louder the volume).

Specifically, the control unit 111 (an example of a "distance calculation means" and "volume control data generation means") of the electronic conference server 100 acquires position information of the terminal device 200 used by each user participating in the electronic conference, and generates volume control data for adjusting the volume of the sound of sound data assigned to each user other than one user, among sounds included in the background sound based on the background sound data transmitted to the terminal device 200 used by one user participating in the electronic conference, according to the distance between the position of the terminal device 200 used by the user to which the sound data that is the basis of the sound is assigned, and the position of the terminal device 200 used by the one user. In addition, the control unit 111 generates volume control data for the terminal device 200 used by each user participating in the electronic conference, with each user participating in the electronic conference as the one user, and further transmits the volume control data generated for the terminal device to the terminal device 200 used by each user participating in the electronic conference.

For example, in the example of FIG. 6, the control unit 111 acquires location information of the terminal devices 200 used by each of the users A, C, F, and I participating in the electronic conference, and generates volume control data for adjusting the volume of the sound of the sound data assigned to each of the users C, F, and I other than user A among the sounds included in the background sound based on the background sound data to be transmitted to the terminal device 200 used by the user A participating in the electronic conference, according to the distance between the location of the terminal device 200 used by each of the users C, F, and I to which the sound data that is the basis of the sound is assigned and the location of the terminal device 200 used by user A, and further transmits the data to the terminal device 200 used by user A. The control unit 111 also performs this process on the terminal devices 200 used by the users C, F, and I other than user A. The control unit 211 of each of the terminal devices 200 of the users A, C, F, and I controls the volume of each sound included in the background sound based on the background sound data and volume control data received from the electronic conference server 100, and outputs the background sound from the speaker 217. This allows, for example, user A to determine the distance between him and each user participating in the electronic conference (user I is the closest, user F is the second closest, and user C is the third closest (farthest)) based on the difference in volume of each sound contained in the background sound.

[Volume Control Data Generation Process by the Electronic Conference Server 100]
Next, a volume control data generation process by the electronic conference server 100 will be described with reference to the flowchart shown in Fig. 8. Fig. 8 is a flowchart showing an example of a volume control data generation process by the electronic conference server 100 in a modified example. The example shown in Fig. 6 (when four users A, C, F, and I participate in the electronic conference) will be described here.

First, the control unit 111 (CPU 111a) acquires the location information of all users participating in the electronic conference (step S301). For example, the control unit 111 acquires the location information (latitude, longitude, altitude information, etc.) received in advance from the terminal device 200 used by each user participating in the electronic conference.

Next, the control unit 111 selects one user to participate in the electronic conference (step S302).

Next, the control unit 111 calculates the distance between the terminal device 200 of each user participating in the electronic conference other than the user selected in the processing of step S302 and the terminal device 200 used by the user selected in the processing of step S302 (step S303). For example, if the control unit 111 selects user A in the processing of step S302, it calculates the distance between the terminal device 200 used by user A and the terminal devices 200 used by users C, F, and I.

Next, the control unit 111 determines the volume of the sound data assigned to each user other than the user selected in the process of step S302, among the sounds included in the background sound based on the background sound data (i.e., the background sound data generated in the background sound generation process) transmitted to the terminal device 200 used by each user participating in the electronic conference, according to the distance calculated in the process of step S303 (step S304).

Then, the control unit 111 generates volume control data indicating the volume of the sound data assigned to each of the other users determined in the process of step S304 (step S305). For example, if user A is selected in the process of step S302, the control unit 111 generates volume control data in which the sound of user I is the loudest, the sound of user F is the second loudest, and the sound of user C is the third loudest (lowest) volume.

Next, the control unit 111 transmits the volume control data generated in the processing of step S305 to the terminal device 200 used by the user selected in the processing of step S302 (step S306).

Next, the control unit 111 determines whether or not all users participating in the electronic conference have been selected in the process of step S302 (step S307). For example, the control unit 111 determines whether or not four users A, C, F, and I have been selected in the process of step S302. If the control unit 111 determines that all users participating in the electronic conference have not been selected (step S307: NO), it proceeds to the process of step S302 and repeats the processes of steps S302 to S306 for each remaining user. On the other hand, if the control unit 111 determines that all users participating in the electronic conference have been selected (step S307: YES), it ends the volume control data generation process.

The control unit 111 may combine the volume control data with the background sound data and transmit it, or may transmit it separately from the background sound data.

Modification 1-1 and Modification 1-2 may be combined. In this case, in the example shown in FIG. 6, the sound assigned to user I is output from the speaker 217 of user A's terminal device 200 at the loudest volume from the southeast direction, the sound assigned to user F at the second loudest volume from the north direction, and the sound assigned to user C at the third loudest (lowest) volume from the west direction. This allows user A to know the direction in which users C, F, and I are located and the distance to them in comparison with other users.

[5.2. Modification 2]
The control unit 111 of the electronic conference server 100 may generate background sound data by synthesizing sound data with the same BPM (Beats Per Minute). By synthesizing sound data with the same BPM, it is possible to generate background sound that is comfortable for the user (not harsh to the ears).

9, a plurality of pieces of sound data with different BPMs may be assigned to each user and stored in the storage unit 112 of the electronic conference server 100, and the control unit 111 may generate background sound data by synthesizing sound data with the same BPM among the sound data assigned to the users participating in the electronic conference. For example, sound data with a BPM of "70" (user A's "aaa70.mp3", user C's "ccc70.mp3", user F's "fff70.mp3", and user I's "iii70.mp3") may be synthesized. In this case, the sound data with a BPM of "70", "80", or "90" to be synthesized may be selected randomly. This allows background sounds with different BPMs to be created, preventing the BPM from becoming monotonous. In the example of FIG. 9, sound data with BPMs of "70," "80," and "90" are assigned to each user, but sound data with other BPMs may be assigned to each user, and the control unit 111 may synthesize sound data with a BPM that is commonly assigned to all users participating in the electronic conference.

Furthermore, sound data of natural sounds (such as babbling brooks and bird calls) may be assigned to at least some users, and the control unit 111 may generate background sound data by synthesizing multiple pieces of sound data including the sound data of natural sounds. In this case, the control unit 111 may synthesize only the sound data of natural sounds. Furthermore, the control unit 111 may synthesize multiple pieces of sound data by adding the sound data of natural sounds to multiple pieces of sound data with the same BPM. Since natural sounds are unlikely to interfere with other sounds (for example, sounds with different BPMs), it is possible to generate background sounds that are comfortable (not harsh) for the user.

[5.3. Modification 3]
The electronic conference provided by the electronic conference server 100 includes not only video or audio electronic conferences, but also text electronic conferences (e.g., chat). For example, when multiple users are chatting, a server device providing a chat service may generate background sound data by synthesizing sound data assigned to the users participating in the chat, transmit the data to the terminal device of each user, and output background sound based on the background sound data received by each terminal device. This allows the user to know which users are participating in the chat from the sounds included in the background sound. Note that an electronic conference is a place where multiple users participate using terminal devices connected to a communication line, and communicate with each other using video, audio, and text, regardless of the purpose, and may include, for example, everyday conversations and conversations while playing a game such as a communication game with multiple people.

10: Information processing device 11: Background sound data generating means 12: Transmission means 100: Teleconference server 111: Control unit 111a: CPU
111b: ROM
111c: RAM
112: storage unit 113: communication unit 114: display unit 114a: graphics controller 114b: buffer memory 115: I/F unit 116: display unit 117: operation unit 200: terminal device 211: control unit 211a: CPU
211b: ROM
211c: RAM
212: Storage unit 213: Communication unit 214: Display unit 214a: Graphics controller 214b: Buffer memory 215: I/F unit 216: Microphone 217: Speaker 218: Camera 219: Display unit 220: Operation unit A-I: User S: Electronic conference system

Claims (9)

An information processing device that provides an electronic conference in which a plurality of users participate using terminal devices each connected to a communication line,
a background sound data generating means for generating background sound data by synthesizing the sound data assigned to the users participating in the electronic conference from among the different sound data assigned to each of the users;
a transmission means for transmitting the background sound data to the terminal devices used by each of the users participating in the electronic conference;
An information processing device comprising: 2. The information processing device according to claim 1,
the background sound data generating means regenerates the background sound data when a change occurs in a user joining or leaving the electronic conference during the electronic conference;
The information processing apparatus, wherein the transmitting means transmits the regenerated background sound data to the terminal devices used by the plurality of users participating in the electronic conference. 3. The information processing device according to claim 1,
a location information acquiring means for acquiring location information of the terminal device used by each of the users participating in the electronic conference;
a sound image localization data generating means for generating sound image localization data for localizing the sound of the sound data assigned to each of the users other than the one user among the sounds included in the background sound based on the background sound data to be transmitted to the terminal device used by the one user participating in the electronic conference, based on the position of the terminal device used by the one user, to the position of the terminal device used by the user to which the sound data that is the source of the sound is assigned, using the position of the terminal device used by the one user as a reference;
Further comprising:
The sound image localization data generating means generates the sound image localization data for the terminal devices used by the users participating in the electronic conference, with each of the users participating in the electronic conference as one user;
The information processing device characterized in that the transmission means further transmits the sound image localization data generated by the sound image localization data generation means for each terminal device used by each of the users participating in the electronic conference. 3. The information processing device according to claim 1,
a location information acquiring means for acquiring location information of the terminal device used by each of the users participating in the electronic conference;
a volume control data generating means for generating volume control data for controlling the volume of the sound of the sound data assigned to each of the users other than the one user among the sounds included in the background sound based on the background sound data to be transmitted to the terminal device used by one of the users participating in the electronic conference to correspond to the distance between the position of the terminal device used by the user to which the sound data that is the source of the sound is assigned and the position of the terminal device used by the one user;
Further comprising:
the volume control data generating means generates the volume control data for the terminal devices used by the users participating in the electronic conference, with each of the users participating in the electronic conference as one user;
The information processing apparatus, wherein the transmitting means further transmits the volume control data generated by the volume control data generating means for each terminal device to the terminal device used by each of the users participating in the electronic conference. 2. The information processing device according to claim 1,
The information processing apparatus, wherein the background sound data generating means generates the background sound data by synthesizing the sound data having the same BPM (Beats Per Minute). 6. The information processing device according to claim 5,
Each user is assigned a plurality of sound data with different BPM (Beats Per Minute),
The information processing device is characterized in that the background sound data generation means generates the background sound data by synthesizing sound data having the same BPM (Beats Per Minute) among sound data assigned to the users participating in the electronic conference. 7. The information processing device according to claim 1, 5 or 6,
At least one of the users is assigned the sound data indicating natural sounds,
The information processing apparatus, wherein the background sound data generating means generates the background sound data by synthesizing a plurality of pieces of sound data including the sound data representing the natural sound. An information processing method for providing an electronic conference in which a plurality of users participate using terminal devices each connected to a communication line, comprising:
a background sound data generating step of generating background sound data by synthesizing the sound data assigned to the users participating in the electronic conference from among the different sound data assigned to each of the users;
a transmission step of transmitting the background sound data to the terminal devices used by each of the users participating in the electronic conference;
13. An information processing method comprising: A computer included in an information processing device that provides an electronic conference in which a plurality of users participate using terminal devices each connected to a communication line,
a background sound data generating means for generating background sound data by synthesizing the sound data assigned to the users participating in the electronic conference from among the different sound data assigned to each of the users;
a transmission means for transmitting the background sound data to the terminal devices used by each of the users participating in the electronic conference;
An information processing program characterized by causing the information processing program to function as:

Images