Information processing device, information processing method, and program for information processing

Abstract

The purpose of the present invention is to provide an information processing device and the like which make it possible to grasp who else are participating in an electronic meeting without viewing a screen showing participants during the electronic meeting.　An information processing device for providing an electronic meeting in which a plurality of users participate each using a terminal device connected to a communication line generates background sound data by synthesizing, among different sound data assigned to the respective users, sound data assigned to users participating in the electronic meeting, and transmits the background sound data to terminal devices used by the users participating in the electronic meeting.

Description

Information processing device, information processing method, and information processing program

[0001] The present application relates to the technical field of information processing devices and the like that provide an electronic conference in which a plurality of users participate using terminal devices each connected to a communication line.

[0002] As teleworking becomes more widespread with the development of information and communication technology, opportunities for holding electronic conferences using terminal devices such as PCs are increasing. Patent Document 1 discloses a technology related to electronic conferences, and the screen of a terminal device shown in Figure 18 of Patent Document 1 displays facial images of participants in the electronic conference. This allows participants to see at a glance who else is participating in the electronic conference besides themselves.

[0003] Japanese Patent Application Laid-Open No. 2022-74159

[0004] However, the example of FIG. 18 in Patent Document 1 has a problem in that it is difficult to know who else is participating in the electronic conference unless one looks at the screen showing the participants during the electronic conference.

[0005] Therefore, in consideration of one example of such a problem, the present invention aims to provide an information processing device or the like that allows a user to know who else is participating in an electronic conference without having to look at a screen showing the participants during the electronic conference.

[0006] The invention described in claim 1 is an information processing device that provides an electronic conference in which multiple users participate using terminal devices connected to a communication line, and is characterized by comprising: background sound data generation means that generates background sound data by synthesizing sound data assigned to users participating in the electronic conference from among different sound data assigned to each of the users; and transmission means that transmits the background sound data to the terminal devices used by each of the multiple users participating in the electronic conference.

[0007] The invention described in claim 8 is an information processing method by an information processing device that provides an electronic conference in which multiple users participate using terminal devices connected to a communication line, and is characterized by including a background sound data generation step of generating background sound data by synthesizing sound data assigned to the users participating in the electronic conference from among the different sound data assigned to each of the users, and a transmission step of transmitting the background sound data to the terminal devices used by each of the multiple users participating in the electronic conference.

[0008] The invention described in claim 9 is characterized in that a computer included in an information processing device that provides an electronic conference in which multiple users participate using terminal devices connected to a communication line functions as: background sound data generation means that generates background sound data by synthesizing sound data assigned to the users participating in the electronic conference from among the different sound data assigned to each of the users; and transmission means that transmits the background sound data to the terminal devices used by each of the multiple users participating in the electronic conference.

[0009] 1 is a block diagram showing an example of the configuration of an information processing device 10 in an embodiment. FIG. 2 is a schematic diagram showing an example of the configuration of an electronic conference system S in an embodiment. FIG. 3 is a block diagram showing an example of the configuration of an electronic conference server 100 in an embodiment. FIG. 4 is a block diagram showing an example of the configuration of a terminal device 200 in an embodiment. FIG. 5 is a flowchart showing an example of background sound generation processing by the electronic conference server 100 in an embodiment. FIG. 6 is a schematic diagram showing the relationship between the distance between users and the volume of sounds included in background sound in a modified example. FIG. 7 is a flowchart showing an example of sound image localization data generation processing by the electronic conference server 100 in a modified example. FIG. 8 is a flowchart showing an example of volume control data generation processing by the electronic conference server 100 in a modified example. FIG. 9 is a diagram showing an example of a sound data table in a modified example.

[0010] An embodiment of the present invention will be described with reference to FIG.

[0011] As shown in FIG. 1 , the information processing device 10 is an information processing device that provides an electronic conference in which multiple users participate using terminal devices each connected to a communication line, and includes a background sound data generating means 11 and a transmitting means 12.

[0012] The background sound data generating means 11 generates background sound data by synthesizing the sound data assigned to the users participating in the electronic conference from among the different sound data assigned to each of the users.

[0013] The transmitting means 12 transmits the background sound data to the terminal devices used by the plurality of users participating in the electronic conference.

[0014] According to the information processing device 10, it is possible to know who else is participating in the electronic conference, from the sounds included in the background sound, without looking at the screen.

[0015] The embodiment will be described with reference to FIGS.

[0016] [1. Overview of the Electronic Conference System S] First, an overview of the electronic conference system S will be described with reference to Fig. 2. In the example of Fig. 2, four users A, C, F, and I among users A to I are participants in the electronic conference.

[0017] The electronic conference system S includes an electronic conference server 100 and multiple terminal devices 200. The electronic conference server 100 and the terminal devices 200 are connected via a network (not shown). The network is formed by communication lines such as a wireless LAN, a wired LAN, a communication carrier line, an optical fiber line, and a telephone line, as well as communication devices such as routers, switching hubs, firewalls, wireless antennas, optical relay devices, and cables connecting them.

[0018] The electronic conference server 100 provides an electronic conference venue for users A, C, F, and I who will participate in the electronic conference. For example, when the electronic conference server 100 receives a new request to provide an electronic conference from the terminal device 200 used by user A, the electronic conference server 100 generates an electronic conference link that users A, C, F, and I can access when joining the electronic conference, and transmits the link to user A's terminal device 200. User A, who has received the electronic conference link, transfers the electronic conference link to the terminal devices 200 of users C, F, and I.

[0019] When users A, C, F, and I access the electronic conference server 100 via the electronic conference link using their respective terminal devices 200, the electronic conference server 100 connects each terminal device 200 and provides a venue for the electronic conference.

[0020] The teleconference server 100 also stores in advance sound data assigned to each of users A to I who may participate in the teleconference. In this embodiment, as an example, each user A to I is assigned the sound of an instrument from a classical piece of music (user A: violin, user B: cello, user C: clarinet, user D: flute, user E: trumpet, user F: horn, user G: trombone, user H: timpani, user I: marimba).

[0021] The teleconference server 100 generates background sound data "BGM.mp3" by synthesizing the sound data "aaa.mp3," "ccc.mp3," "fff.mp3," and "iii.mp3" assigned to users A, C, F, and I of the terminal devices 200 that access the teleconference. The background sound data "BGM.mp3" is then transmitted to each of the terminal devices 200 of users A, C, F, and I. Each terminal device 200 then plays "BGM.mp3" during the teleconference and outputs the background sound from its speaker. Since the background sound includes the sounds of a violin, clarinet, horn, and marimba, users A, C, F, and I can easily identify who else is participating in the teleconference. It is preferable to inform each user in advance of the instruments assigned to each user.

[0022] 2. Configuration of the electronic conference server 100 The configuration of the electronic conference server 100 will be described with reference to Fig. 3. Fig. 3 is a block diagram showing an example of the configuration of the electronic conference server 100.

[0023] The electronic conference server 100 includes a control unit 111, a memory unit 112 consisting of a hard disk drive (HDD) or a solid state drive (SSD), a communication unit 113, a display unit 114, and an interface (I / F) unit 115, and a display unit 116 and an operation unit 117 are connected via the I / F unit 115.

[0024] The control unit 111 is made up of a CPU 111a that controls the entire control unit 111, a ROM 111b in which control programs and the like that control the control unit 111 are pre-stored, and a RAM 111c that temporarily stores various data. The control unit 111 or the CPU 111a corresponds to a "computer."

[0025] The control unit 111 executes various processes (including background sound generation process, which will be described later) for providing a place for an electronic conference for a plurality of terminal devices 200 connected via a network.

[0026] The storage unit 112 stores various programs such as an OS (Operating System) and application programs, as well as data and information used by the various programs. The storage unit 112 also stores a program that the control unit 111 uses to generate background sound data by synthesizing sound data assigned to users participating in the electronic conference and transmit the background sound data to the terminal devices 200 of the users participating in the electronic conference. Note that the various programs may be obtained, for example, from a server device or the like via a network, or may be read from a recording medium such as a USB memory.

[0027] The storage unit 112 stores sound data assigned to users A-I. The sound data is managed in a sound data table. Sound data is assigned to users by the electronic conference server 100, for example, when the users register to use an electronic conference provided by the electronic conference server 100. Users who wish to use an electronic conference are required to register with the electronic conference server 100 in advance, and at this time, the electronic conference server 100 assigns sound data to the users along with their accounts and passwords.

[0028] The communication unit 113 has a communication device or the like, and communicates with the terminal device 200 to mutually transmit and receive data.

[0029] The display unit 114 is configured to include a graphics controller 114a and a buffer memory 114b made up of a memory such as a VRAM (Video RAM). In this configuration, the graphics controller 114a controls the display unit 114 and the display unit 116 based on control information sent from the control unit 111. The buffer memory 114b also temporarily stores image data that can be immediately displayed on the display unit 116. Images are then displayed on the display unit 116 based on the image data output from the graphics controller 114a.

[0030] The I / F unit 115 has the structure and functions necessary to connect the electronic conference server 100 to external devices such as the display unit 116 and the operation unit 117, and performs data conversion between them as necessary.

[0031] The display unit 116 is a liquid crystal display or the like, and displays an image based on the image data received from the display unit 114 .

[0032] The operation unit 117 detects an operation by the operator and transmits operation data indicating the operation content, etc. to the control unit 111. The control unit 111 determines which operation has been performed based on the operation data and performs processing according to the operation content.

[0033] 3. Configuration of Terminal Device 200 The configuration of the terminal device 200 will be described with reference to Fig. 4. Fig. 4 is a block diagram showing an example of the configuration of the terminal device 200.

[0034] The terminal device 200 comprises a control unit 211, a memory unit 212 consisting of an HDD, SSD, etc., a communication unit 213, a display unit 214, and an interface (I / F) unit 215, and is connected to a microphone 216, a speaker 217, a camera 218, a display unit 219, and an operation unit 220 via the I / F unit 215.

[0035] The control unit 211 is made up of a CPU 211a that controls the entire control unit 211, a ROM 211b in which control programs and the like that control the control unit 211 are pre-stored, and a RAM 211c that temporarily stores various data. The control unit 211 or the CPU 211a corresponds to a "computer."

[0036] The control unit 211 executes various processes for participating in an electronic conference provided by the electronic conference server 100 .

[0037] The storage unit 212 stores various programs such as an OS and application programs, as well as data and information used by the various programs. The storage unit 212 also stores a program that enables the control unit 211 to participate in an electronic conference. Note that the various programs may be obtained, for example, from a server device or the like via a network, or may be read from a recording medium such as a USB memory.

[0038] The communication unit 213 includes a communication device and the like, and communicates with the electronic conference server 100 and other terminal devices 200 to mutually transmit and receive data.

[0039] The display unit 214 is configured to include a graphics controller 214a and a buffer memory 214b made up of a memory such as a VRAM. In this configuration, the graphics controller 214a controls the display unit 214 and the display section 219 based on control information sent from the control section 211. The buffer memory 214b also temporarily stores image data that can be immediately displayed on the display section 219. Images are then displayed on the display section 219 based on the image data output from the graphics controller 214a.

[0040] The I / F unit 215 has the structure and functions necessary to connect the terminal device 200 to external devices such as a microphone 216, a speaker 217, a camera 218, a display unit 219, and an operation unit 220, and performs data conversion between the two as necessary.

[0041] The microphone 216 converts the voice (sound) of the user or the like into an electrical signal, which is transmitted to the control unit 211 via the I / F unit 215.

[0042] The speaker 217 outputs sound data (electrical signals) as sound under the control of the control unit 211. In this embodiment, the speaker 217 outputs background sound based on background sound data received from the electronic conference server 100.

[0043] The camera 218 transmits image data captured through a lens to the control unit 211 via the I / F unit 215 .

[0044] The display unit 219 is a liquid crystal display or the like, and displays an image based on the image data received from the display unit 214 .

[0045] Note that while Figure 4 shows an example in which the terminal device 200 is a desktop PC, the terminal device 200 may also be a notebook PC, a smartphone, a tablet terminal, etc., and in these cases, the control unit 211, memory unit 212, communication unit 213, display unit 214, interface (I / F) unit 215, microphone 216, speaker 217, camera 218, display unit 219, and operation unit 220 may be integrated into one unit.

[0046] The operation unit 220 detects a user operation and transmits operation data indicating the operation content, etc. to the control unit 211. The control unit 211 determines which operation has been performed based on the operation data and performs processing according to the operation content.

[0047] [4. Background Sound Generation Processing by the Electronic Conference Server 100] Next, the background sound generation processing by the electronic conference server 100 will be described using the flowchart shown in Fig. 5. Fig. 5 is a flowchart showing an example of the background sound generation processing by the electronic conference server 100. Before the flowchart shown in Fig. 5 starts, it is assumed that an electronic conference link has been distributed to the terminal devices 200 of the users participating in the electronic conference, and that the electronic conference server 100 and each terminal device 200 have been connected via login processing using an account and a password.

[0048] First, the control unit 111 (CPU 111a) identifies users participating in the electronic conference (step S101). Specifically, the control unit 111 identifies the terminal device 200 that has connected to the electronic conference server 100 via the electronic conference link based on the account used during login processing.

[0049] Next, the control unit 111 acquires, from the storage unit 112, sound data assigned to each user (terminal device 200) identified in the process of step S101 (step S102).

[0050] Next, the control unit 111 synthesizes the sound data acquired in the process of step S102 to generate background sound data (step S103). At this time, the control unit 111 synthesizes the sound data so that the sound of each piece of sound data is included in the background sound, that is, so that the sound assigned to each user participating in the electronic conference can be heard from the background sound.

[0051] Next, the control unit 111 transmits the background sound data generated in the process of step S103 to the terminal device 200 of each user participating in the electronic conference (each terminal device 200 identified in the process of step S101) (step S104). Note that, although not shown in Fig. 5, the control unit 211 of each terminal device 200 that has received the background sound data outputs background sound based on the background sound data from the speaker 217.

[0052] Next, the control unit 111 determines whether the electronic conference has ended (step S105). If the control unit 111 determines that the electronic conference has ended (step S105: YES), the control unit 111 ends the background sound generation process. On the other hand, if the control unit 111 determines that the electronic conference has not ended (step S105: NO), the control unit 111 proceeds to the process of step S106.

[0053] Next, the control unit 111 determines whether there has been a change in the users participating in the electronic conference (step S106). Changes in the users participating in the electronic conference include when a new user joins the electronic conference and when a user currently participating in the electronic conference leaves the electronic conference. If the control unit 111 determines that there has been no change in the users participating in the electronic conference (step S106: NO), the control unit 111 proceeds to step S105. That is, steps S105 and S106 are repeated until the electronic conference ends or until there is a change in the users currently participating in the electronic conference. On the other hand, if the control unit 111 determines that there has been a change in the users participating in the electronic conference (step S106: YES), the control unit 111 proceeds to step S101, identifies the users currently participating in the electronic conference, regenerates background sound data, and transmits it to each terminal device 200 of the users currently participating in the electronic conference. As a result, background sound based on background sound data generated from sound data assigned to each user currently participating in the electronic conference is constantly output from the speaker 217 of each user's terminal device 200.

[0054] As described above, the electronic conference server 100 in this embodiment provides an electronic conference in which multiple users participate using terminal devices 200 each connected to a communication line, and the control unit 111 (an example of a "background sound data generating means" and "transmitting means") generates background sound data by synthesizing the sound data assigned to the users participating in the electronic conference from the different sound data assigned to each user, and transmits the background sound data to the terminal devices 200 used by each of the multiple users participating in the electronic conference.

[0055] Therefore, according to the electronic conference server 100, background sounds based on background sound data generated from sound data assigned to each user participating in the electronic conference are output from the speaker 217 of each user's terminal device 200, so that each user can know who else is participating in the electronic conference from the sounds contained in the background sound without having to look at the screen.

[0056] That is, the user can know who is participating in the electronic conference even when participating in the electronic conference using a terminal device that does not have the display unit 219. Furthermore, the user can know who is participating in the electronic conference even when materials related to the electronic conference are displayed on the entire surface of the display unit 219 and information indicating the participants of the electronic conference is not displayed on the display unit 219.

[0057] Furthermore, in the present embodiment, when a change occurs in the users participating in the electronic conference, such as joining (joining midway) or leaving (leaving midway), the control unit 111 of the electronic conference server 100 regenerates background sound data and transmits the regenerated background sound data to the terminal devices 200 used by each of the multiple users participating in the electronic conference. As a result, even if a change occurs in the users participating in the electronic conference during the electronic conference, background sounds corresponding to the users participating in the electronic conference are output from the speakers 217 of each terminal device 200 as appropriate, so that the users can understand that a change has occurred in the participants and, further, who has joined or left midway based on the change in background sound.

[0058] [5. Modifications] Next, modifications of the present embodiment will be described. The modifications described below can be combined as appropriate.

[0059] [5.1. Variation 1] The teleconference server 100 receives location information (latitude, longitude, altitude information, etc.) from each terminal device 200, and the control unit 111 may determine how to output the sounds included in the background sound assigned to each user participating in the teleconference based on the location information received from each terminal device 200 and in accordance with the location of the terminal device 200 used by each user. Note that each terminal device 200 can acquire location information by any means. For example, the terminal device 200 may be provided with a GPS receiver and acquire location information based on a GPS signal received by the GPS receiver, or the user may input location information.

[0060] 6 is an example diagram showing the positions of users C, F, and I relative to user A. In variation 1-1, the sound image localization of the sound of the sound data assigned to each of users C, F, and I, which is included in the background sound output from the terminal device 200 of user A, is set to the positions of the terminal devices 200 used by users C, F, and I to which the sound data that is the source of the sound is assigned, using the position of the terminal device 200 used by user A as the reference.

[0061] Specifically, the control unit 111 (an example of a "position information acquisition means" or "sound image localization data generation means") of the electronic conference server 100 acquires position information of the terminal device 200 used by each user participating in the electronic conference, and generates sound image localization data that localizes the sound image of sound data assigned to each user other than one user, among sounds included in background sound based on background sound data transmitted to the terminal device 200 used by that one user, to the position of the terminal device 200 used by the user to which the sound data that is the basis of the sound, using the position of the terminal device 200 used by that one user as a reference. Furthermore, the control unit 111 generates sound image localization data for the terminal devices 200 used by each user participating in the electronic conference, treating each user participating in the electronic conference as that user, and further transmits the sound image localization data generated for that terminal device 200 to the terminal device 200 used by each user participating in the electronic conference.

[0062] 6 , the control unit 111 acquires position information of the terminal devices 200 used by each of the users A, C, F, and I participating in the electronic conference, and generates sound image localization data that determines, based on the position of the terminal device 200 used by user A, the sound image localization of the sounds included in the background sound, which is based on the background sound data transmitted to the terminal device 200 used by user A participating in the electronic conference, the sound image localization of the sounds included in the background sound, which is assigned to each of the users C, F, and I other than user A, based on the position of the terminal device 200 used by user A, to the positions of the terminal devices 200 used by users C, F, and I to which the sound data that is the basis of the sounds is assigned, and further transmits the generated sound image localization data to the terminal device 200 used by user A. The control unit 111 also performs this process on the terminal devices 200 used by users C, F, and I other than user A. Then, based on the background sound data and sound image localization data received from the electronic conference server 100, the control unit 211 of the terminal device 200 determines the sound image localization of each sound included in the background sound to the position of the user corresponding to the sound, and outputs the background sound from the speaker 217. This allows, for example, user A to ascertain the location of each user participating in the electronic conference from the direction of each sound included in the background sound (user C is in the west direction, user F is in the north direction, and user I is in the southeast direction). In this case, it is assumed that the speaker 217 has specifications and settings that allow sound image localization.

[0063] [Sound image localization data generation process by the electronic conference server 100] Next, the sound image localization data generation process by the electronic conference server 100 will be described with reference to the flowchart shown in Fig. 7. Fig. 7 is a flowchart showing an example of the sound image localization data generation process by the electronic conference server 100 in a modified example. Here, the example of Fig. 6 (when four users A, C, F, and I participate in the electronic conference) will be described.

[0064] First, the control unit 111 (CPU 111 a) acquires location information of all users participating in the electronic conference (step S201). For example, the control unit 111 acquires location information (such as latitude, longitude, and altitude information) received in advance from the terminal device 200 used by each user participating in the electronic conference.

[0065] Next, the control unit 111 selects one user to participate in the electronic conference (step S202).

[0066] Next, the control unit 111 selects one user from among the users participating in the electronic conference other than the user selected in step S202 (step S203). For example, if the control unit 111 selects user A in step S202, the control unit 111 selects one of users C, F, or I.

[0067] Next, the control unit 111 determines the position (e.g., direction and distance from the reference) of the terminal device 200 used by the user selected in the processing of step S203, using the position of the terminal device 200 used by the user selected in the processing of step S202 as a reference (step S204).

[0068] Next, the control unit 111 stores the sound image position of the sound data assigned to the user selected in the processing of step S203, among the sounds included in the background sound based on the background sound data (i.e., the background sound data generated in the background sound generation processing) transmitted to the terminal device 200 used by each user participating in the electronic conference, in association with the position identified in the processing of step S204 (step S205).

[0069] Next, in the process of step S203, the control unit 111 determines whether all other users other than the user selected in the process of step S202 have been selected (step S206). For example, if the control unit 111 has selected user A in the process of step S202, the control unit 111 determines whether all of users C, F, and I have been selected in the process of step S203. If the control unit 111 determines that all other users have not been selected (step S206: NO), the control unit 111 proceeds to the process of step S203 and selects other users that have not been selected so far. On the other hand, if the control unit 111 determines that all other users have been selected (step S206: YES), the control unit 111 then generates sound image localization data indicating the correspondence between the sound and sound image localization stored in the process of step S205 for all other users (step S207). For example, if the control unit 111 selects user A in the processing of step S202, the control unit 111 generates sound image localization data in which the sound image localization of the sound data assigned to users C, F, and I is the position of the terminal device 200 used by users C, F, and I, respectively, using the terminal device 200 used by user A as the reference position.

[0070] Next, the control unit 111 transmits the sound image localization data generated in the process of step S207 to the terminal device 200 used by the user selected in the process of step S202 (step S208).

[0071] Next, the control unit 111 determines whether or not all users participating in the electronic conference have been selected in the process of step S202 (step S209). That is, the control unit 111 determines whether or not the four users A, C, F, and I have been selected in the process of step S202. If the control unit 111 determines that all users participating in the electronic conference have not been selected (step S209: NO), the control unit 111 proceeds to the process of step S202 and repeats the processes of steps S202 to S208 for each remaining user. On the other hand, if the control unit 111 determines that all users participating in the electronic conference have been selected (step S209: YES), the sound image localization data generation process ends.

[0072] The control unit 111 may combine the sound image localization data with the background sound data and transmit the combined data, or may transmit the combined data separately from the background sound data.

[0073] [5.1.2. Modification 1-2] As shown in Fig. 6, modification 1-2 sets the volume of the sound of the sound data assigned to each of users C, F, and I, which is included in the background sound output from the terminal device 200 of user A, to a volume that corresponds to the distance between the positions of the terminal devices 200 used by users C, F, and I to which the sound data that is the basis of the sound is assigned, and the position of the terminal device 200 used by user A. Note that in Fig. 6, the thickness of the arrows extending from users C, F, and I to user A indicates the volume (the thicker the arrow, the louder the volume).

[0074] Specifically, the control unit 111 (an example of a "distance calculation means" or "volume control data generation means") of the electronic conference server 100 acquires location information of the terminal device 200 used by each user participating in the electronic conference, and generates volume control data that adjusts the volume of sound data assigned to each user other than one user, among sounds included in the background sound based on background sound data transmitted to the terminal device 200 used by one user participating in the electronic conference, according to the distance between the location of the terminal device 200 used by the user to which the sound data that is the basis of the sound is assigned, and the location of the terminal device 200 used by the one user. Furthermore, the control unit 111 generates volume control data for the terminal devices 200 used by each user participating in the electronic conference, treating each user participating in the electronic conference as that user, and further transmits the volume control data generated for that terminal device to the terminal device 200 used by each user participating in the electronic conference.

[0075] 6 , the control unit 111 acquires location information of the terminal devices 200 used by each of the users A, C, F, and I participating in the teleconference, and generates volume control data for adjusting the volume of each of the sounds included in the background sound based on the background sound data to be transmitted to the terminal device 200 used by user A participating in the teleconference, the volume of each of the sounds included in the background sound based on the background sound data to be transmitted to the terminal device 200 used by user A, the volume of each of the sounds included in the background sound being transmitted to the terminal device 200 used by user A, the volume control data being generated based on the distance between the location of the terminal device 200 used by each of users C, F, and I to which the sound data that is the basis of the sounds is assigned, and the location of the terminal device 200 used by user A. The control unit 111 also performs this process on the terminal devices 200 used by users C, F, and I other than user A. The control unit 211 of each of the terminal devices 200 of users A, C, F, and I controls the volume of each of the sounds included in the background sound based on the background sound data and volume control data received from the teleconference server 100, and outputs the background sound from the speaker 217. This allows, for example, user A to determine the distance between him and each user participating in the electronic conference (user I is closest, user F is second closest, and user C is third closest (farthest)) from the difference in volume of each sound contained in the background sound.

[0076] [Volume Control Data Generation Process by the Teleconference Server 100] Next, the volume control data generation process by the teleconference server 100 will be described with reference to the flowchart shown in Fig. 8. Fig. 8 is a flowchart showing an example of the volume control data generation process by the teleconference server 100 in a modified example. The example shown in Fig. 6 (where four users A, C, F, and I participate in the teleconference) will be described.

[0077] First, the control unit 111 (CPU 111 a) acquires location information of all users participating in the electronic conference (step S301). For example, the control unit 111 acquires location information (such as latitude, longitude, and altitude information) received in advance from the terminal device 200 used by each user participating in the electronic conference.

[0078] Next, the control unit 111 selects one user to participate in the electronic conference (step S302).

[0079] Next, the control unit 111 calculates the distance between the terminal device 200 of each user other than the user selected in step S302 among the users participating in the electronic conference and the terminal device 200 used by the user selected in step S302 (step S303). For example, if user A is selected in step S302, the control unit 111 calculates the distance between the terminal device 200 used by user A and the terminal devices 200 used by users C, F, and I.

[0080] Next, the control unit 111 determines the volume of the sound data included in the background sound based on the background sound data (i.e., the background sound data generated in the background sound generation process) transmitted to the terminal device 200 used by each user participating in the electronic conference, and that is assigned to each user other than the user selected in the process of step S302, in accordance with the distance calculated in the process of step S303 (step S304).

[0081] Next, the control unit 111 generates volume control data indicating the volume of the sound data assigned to each of the other users determined in the process of step S304 (step S305). For example, if user A is selected in the process of step S302, the control unit 111 generates volume control data in which the volume of the sound of user I is the highest, the volume of the sound of user F is the second highest, and the volume of the sound of user C is the third highest (lowest).

[0082] Next, the control unit 111 transmits the volume control data generated in the process of step S305 to the terminal device 200 used by the user selected in the process of step S302 (step S306).

[0083] Next, the control unit 111 determines whether all users participating in the electronic conference have been selected in the process of step S302 (step S307). For example, the control unit 111 determines whether four users A, C, F, and I have been selected in the process of step S302. If the control unit 111 determines that all users participating in the electronic conference have not been selected (step S307: NO), the control unit 111 proceeds to the process of step S302 and repeats the processes of steps S302 to S306 for each remaining user. On the other hand, if the control unit 111 determines that all users participating in the electronic conference have been selected (step S307: YES), the control unit 111 ends the volume control data generation process.

[0084] The control unit 111 may combine the volume control data with the background sound data and transmit the combined data, or may transmit the combined data separately from the background sound data.

[0085] Note that Modification 1-1 and Modification 1-2 may be combined. In this case, in the example shown in Fig. 6, the speaker 217 of the terminal device 200 of user A outputs the sound assigned to user I at the highest volume from the southeast direction, the sound assigned to user F at the second highest volume from the north direction, and the sound assigned to user C at the third highest (lowest) volume from the west direction. This allows user A to understand the directions in which users C, F, and I are located and the distances there to them in comparison with other users.

[0086] [5.2. Modification 2] The control unit 111 of the electronic conference server 100 may generate background sound data by synthesizing sound data with the same BPM (Beats Per Minute). By synthesizing sound data with the same BPM, it is possible to generate background sound that is pleasant to the user (not harsh to the ears).

[0087] 9, the storage unit 112 of the teleconference server 100 may be configured to store multiple pieces of sound data with different BPMs for each user, and the control unit 111 may generate background sound data by synthesizing sound data with the same BPM among the sound data assigned to the users participating in the teleconference. For example, sound data with a BPM of "70" (user A's "aaa70.mp3," user C's "ccc70.mp3," user F's "fff70.mp3," and user I's "iii70.mp3") may be synthesized. In this case, the sound data with a BPM of "70," "80," or "90" to be synthesized may be randomly selected. This allows background sounds with different BPMs to be created, preventing BPMs from becoming monotonous. In the example of Figure 9, sound data with BPMs of "70," "80," and "90" are assigned to each user, but sound data with a BPM other than these may be assigned to each user, and the control unit 111 may synthesize sound data with a BPM that is assigned in common to all users participating in the electronic conference.

[0088] Furthermore, sound data of natural sounds (such as the sound of a babbling brook or birdsong) may be assigned to at least some users, and the control unit 111 may generate background sound data by synthesizing multiple pieces of sound data including the sound data of natural sounds. In this case, the control unit 111 may synthesize only the sound data of natural sounds. Alternatively, the control unit 111 may synthesize multiple pieces of sound data by adding the sound data of natural sounds to multiple pieces of sound data having the same BPM. Since natural sounds are unlikely to interfere with other sounds (for example, sounds with different BPMs), it is possible to generate background sounds that are comfortable (not harsh) for the user.

[0089] [5.3. Variation 3] The teleconferences provided by the teleconference server 100 include not only video or audio teleconferences but also text teleconferences (e.g., chat). For example, when multiple users are chatting, a server device providing a chat service may generate background sound data by synthesizing sound data assigned to the users participating in the chat, transmit the data to each user's terminal device, and cause each terminal device to output background sound based on the received background sound data. This allows users to identify which users are participating in the chat from the sounds contained in the background sound. Note that a teleconference is a forum for multiple users to communicate using video, audio, and text, each using a terminal device connected to a communication line. Its purpose may be any, including everyday conversations and conversations while playing a game such as an online game.

[0090] 10: Information processing device 11: Background sound data generating means 12: Transmission means 100: Teleconference server 111: Control unit 111a: CPU 111b: ROM 111c: RAM 112: Storage unit 113: Communication unit 114: Display unit 114a: Graphics controller 114b: Buffer memory 115: I / F unit 116: Display unit 117: Operation unit 200: Terminal device 211: Control unit 211a: CPU 211b: ROM 211c: RAM 212: Storage unit 213: Communication unit 214: Display unit 214a: Graphics controller 214b: Buffer memory 215: I / F unit 216: Microphone 217: Speaker 218 : Camera 219 : Display unit 220 : Operation unit AI : User S : Electronic conference system

Claims

1. An information processing apparatus that provides an electronic conference in which a plurality of users participate using terminal devices each connected to a communication line, background sound data generation means for generating background sound data by synthesizing sound data assigned to all the users participating in the electronic conference among the different sound data assigned to each of the users; transmission means for transmitting the background sound data to the terminal devices used by the plurality of users participating in the electronic conference; An information processing apparatus comprising the above.

2. The information processing apparatus according to claim 1, wherein the background sound data generation means regenerates the background sound data when a change in joining or leaving occurs for a user participating in the electronic conference during the electronic conference, and the transmission means transmits the regenerated background sound data to the terminal devices used by the plurality of users participating in the electronic conference. An information processing apparatus characterized by this.

3. The information processing apparatus according to claim 1 or 2, position information acquisition means for acquiring the position information of the terminal devices used by each of the users participating in the electronic conference; Among the sounds included in the background sound based on the background sound data transmitted to the terminal device used by one of the users participating in the electronic conference, the sound image localization of the sound of the sound data assigned to each of the other users other than the one user is based on the position of the terminal device used by the one user, and the sound image localization data is generated so that it is the position of the terminal device used by the user to whom the sound data that is the basis of the sound is assigned; further comprising, the sound image localization data generation means generates the sound image localization data for each of the users participating in the electronic conference with each of the users participating in the electronic conference as the one user for the terminal devices used by each of the users participating in the electronic conference, and the transmission means further transmits the sound image localization data generated by the sound image localization data generation means for the terminal device to the terminal devices used by each of the users participating in the electronic conference. An information processing apparatus characterized by this.

4. The information processing apparatus according to claim 1 or 2, position information acquisition means for acquiring the position information of the terminal devices used by each of the users participating in the electronic conference; Among the sounds included in the background sound based on the background sound data transmitted to the terminal device used by one of the users participating in the electronic conference, the volume of the sound of the sound data assigned to each of the other users other than the one user is adjusted to a volume corresponding to the distance between the position of the terminal device used by the user to whom the sound data, which is the basis of the sound, is assigned and the position of the terminal device used by the one user. A volume control data generation means for generating volume control data; further comprising; The volume control data generation means generates the volume control data for each of the users participating in the electronic conference with each of the users participating in the electronic conference as the one user, The transmission means further transmits the volume control data generated by the volume control data generation means for the terminal device to the terminal device used by each of the users participating in the electronic conference. An information processing apparatus characterized by the above.

5. An information processing apparatus according to claim 1, The background sound data generation means generates the background sound data by synthesizing the sound data having the same BPM (Beats Per Minute). An information processing apparatus characterized by the above.

6. An information processing apparatus according to claim 5, A plurality of pieces of sound data having different BPMs (Beats Per Minute) are assigned to each of the users, The background sound data generation means generates the background sound data by synthesizing the sound data having the same BPM (Beats Per Minute) among the sound data assigned to the users participating in the electronic conference. An information processing apparatus characterized by the above.

7. An information processing apparatus according to claim 1, 5 or 6, At least one of the users is assigned the sound data indicating natural sounds, The background sound data generation means generates the background sound data by synthesizing a plurality of pieces of the sound data including the sound data indicating the natural sounds. An information processing apparatus characterized by the above.

8. An information processing method by an information processing apparatus that provides an electronic conference in which a plurality of users participate using terminal devices respectively connected to a communication line, A background sound data generation step of generating background sound data by synthesizing the sound data assigned to all of the users participating in the electronic conference among the different sound data assigned to each of the users; a transmission step of transmitting the background sound data to the terminal devices respectively used by the plurality of users participating in the electronic conference; An information processing method characterized by including the above.

9. A computer included in an information processing apparatus that provides an electronic conference in which a plurality of users participate using terminal devices respectively connected to a communication line, background sound data generation means for generating background sound data by synthesizing the sound data assigned to all the users participating in the electronic conference among the different sound data assigned to each of the users; transmission means for transmitting the background sound data to the terminal devices respectively used by the plurality of users participating in the electronic conference; An information processing program characterized by functioning as the above.