Server device, information processing method and information processing program

Abstract

The purpose of the present invention is to provide an information processing device and the like which make it possible to grasp who else are participating in an electronic meeting without viewing a screen showing participants during the electronic meeting.　An information processing device for providing an electronic meeting in which a plurality of users participate each using a terminal device connected to a communication line generates background sound data by synthesizing, among different sound data assigned to the respective users, sound data assigned to users participating in the electronic meeting, and transmits the background sound data to terminal devices used by the users participating in the electronic meeting.

Description

[Technical Field]

[0001] The present application relates to the technical field of information processing devices and the like that provide an electronic conference in which a plurality of users participate using terminal devices each connected to a communication line. [Background technology]

[0002] As teleworking becomes more widespread with the development of information and communication technology, opportunities for holding electronic conferences using terminal devices such as PCs are increasing. Patent Document 1 discloses technology related to electronic conferences, and the screen of a terminal device shown in FIG. 18 of Patent Document 1 displays facial images of participants in an electronic conference. This allows participants to see at a glance who else is participating in the electronic conference besides themselves. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-74159 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the example of FIG. 18 in Patent Document 1 has a problem in that it is difficult to know who else is participating in the electronic conference other than oneself unless one looks at the screen showing the participants during the electronic conference.

[0005] Therefore, in consideration of one example of such a problem, the present invention aims to provide an information processing device or the like that allows a user to know who else is participating in an electronic conference without having to look at a screen showing the participants during the electronic conference. [Means for solving the problem]

[0006] The invention described in claim 1 provides an electronic conference in which a plurality of users participate using terminal devices connected to a communication line. server 1. An apparatus comprising: All participants in the electronic conference Each user is assigned a different sound data. All the The electronic conference system is characterized by comprising a background sound data generation means for synthesizing and generating background sound data, and a transmission means for transmitting the background sound data to the terminal devices used by each of the plurality of users participating in the electronic conference.

[0007] The invention described in claim 8 provides an electronic conference in which a plurality of users participate using terminal devices connected to a communication line. server An information processing method by an apparatus, comprising: All participants in the electronic conference Each user is assigned a different sound data. All the The method is characterized by including a background sound data generation step of synthesizing the background sound data to generate background sound data, and a transmission step of transmitting the background sound data to the terminal devices used by each of the multiple users participating in the electronic conference.

[0008] The invention described in claim 9 provides an electronic conference in which a plurality of users participate using terminal devices connected to a communication line. server The computer included in the device All participants in the electronic conference Each user is assigned a different sound data. All the The electronic conference system is characterized in that it functions as a background sound data generating means for synthesizing the background sound data to generate background sound data, and a transmitting means for transmitting the background sound data to the terminal devices used by each of the plurality of users participating in the electronic conference. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a block diagram showing an example of the configuration of an information processing device 10 according to an embodiment. [Figure 2] 1 is a schematic diagram showing an electronic conference system S according to an embodiment. [Figure 3] 1 is a block diagram showing an example of the configuration of an electronic conference server 100 according to an embodiment. [Figure 4] FIG. 2 is a block diagram showing an example of the configuration of a terminal device 200 in the embodiment. [Figure 5]10 is a flowchart showing an example of background sound generation processing by the electronic conference server 100 in the embodiment. [Figure 6] FIG. 10 is a schematic diagram showing the relationship between the distance between users and the volume of sounds included in background sounds in a modified example. [Figure 7] 10 is a flowchart showing an example of a sound image localization data generation process performed by the electronic conference server 100 in a modified example. [Figure 8] 10 is a flowchart showing an example of a volume control data generation process performed by the electronic conference server 100 in a modified example. [Figure 9] FIG. 10 is a diagram showing an example of a sound data table in a modified example. DETAILED DESCRIPTION OF THE INVENTION

[0010] An embodiment of the present invention will be described with reference to FIG.

[0011] As shown in FIG. 1, the information processing device 10 is an information processing device that provides an electronic conference in which multiple users participate using terminal devices each connected to a communication line, and includes a background sound data generating means 11 and a transmitting means 12.

[0012] The background sound data generating means 11 generates background sound data by synthesizing the sound data assigned to the users participating in the electronic conference from among the different sound data assigned to each of the users.

[0013] The transmitting means 12 transmits the background sound data to the terminal devices used by the plurality of users participating in the electronic conference.

[0014] According to the information processing device 10, it is possible to know who else is participating in the electronic conference, from the sounds included in the background sound, without looking at the screen. [Example]

[0015] The embodiment will be described with reference to FIGS.

[0016] [1. Overview of Electronic Conference System S] First, an overview of the electronic conference system S will be explained using Fig. 2. In the example of Fig. 2, four users A, C, F, and I of user AI are participants in the electronic conference.

[0017] The electronic conference system S includes an electronic conference server 100 and multiple terminal devices 200, and the electronic conference server 100 and each terminal device 200 are connected via a network (not shown). The network is formed by communication lines such as wireless LAN, wired LAN, communication carrier lines, optical fiber lines, and telephone lines, as well as communication devices such as routers, switching hubs, firewalls, wireless antennas, optical relay devices, and cables connecting them.

[0018] The electronic conference server 100 provides an electronic conference venue for users A, C, F, and I who will participate in the electronic conference. For example, when the electronic conference server 100 receives a new request to provide an electronic conference from the terminal device 200 used by user A, the electronic conference server 100 generates an electronic conference link that users A, C, F, and I can access when joining the electronic conference, and transmits the link to user A's terminal device 200. User A, who has received the electronic conference link, transfers the electronic conference link to the terminal devices 200 of users C, F, and I.

[0019] When users A, C, F, and I access the electronic conference server 100 via the electronic conference link using their respective terminal devices 200, the electronic conference server 100 connects each of the terminal devices 200 and provides a venue for the electronic conference.

[0020] The electronic conference server 100 also stores in advance sound data assigned to each user AI who may participate in the electronic conference. In this embodiment, as an example, each user AI is assigned the sound of each instrument in a classical piece of music (user A: violin, user B: cello, user C: clarinet, user D: flute, user E: trumpet, user F: horn, user G: trombone, user H: timpani, user I: marimba).

[0021] The teleconference server 100 generates background sound data "BGM.mp3" by synthesizing the sound data "aaa.mp3," "ccc.mp3," "fff.mp3," and "iii.mp3" assigned to users A, C, F, and I of the terminal devices 200 that have accessed the teleconference to participate. The background sound data "BGM.mp3" is then transmitted to each of the terminal devices 200 of users A, C, F, and I. Each terminal device 200 then plays "BGM.mp3" during the teleconference and outputs the background sound from its speaker. Since the background sound includes the sounds of a violin, clarinet, horn, and marimba, users A, C, F, and I can thus grasp who else is participating in the teleconference. It is preferable to inform each user in advance of the instruments assigned to each user.

[0022] [2. Configuration of the electronic conference server 100] The configuration of the electronic conference server 100 will be described with reference to Fig. 3. Fig. 3 is a block diagram showing an example of the configuration of the electronic conference server 100.

[0023] The electronic conference server 100 includes a control unit 111, a memory unit 112 consisting of an HDD (Hard Disk Drive) or SSD (Solid State Drive), a communication unit 113, a display unit 114, and an interface (I / F) unit 115, and a display unit 116 and an operation unit 117 are connected via the I / F unit 115.

[0024] The control unit 111 is made up of a CPU 111a that controls the entire control unit 111, a ROM 111b in which a control program for controlling the control unit 111 and the like is stored in advance, and a RAM 111c that temporarily stores various data. The control unit 111 or the CPU 111a corresponds to a "computer."

[0025] The control unit 111 executes various processes (including background sound generation process, which will be described later) for providing a place for an electronic conference for a plurality of terminal devices 200 connected via a network.

[0026] The storage unit 112 stores various programs such as an OS (Operating System) and application programs, as well as data and information used by the various programs. The storage unit 112 stores a program that causes the control unit 111 to synthesize sound data assigned to users participating in the electronic conference to generate background sound data and transmit the background sound data to the terminal devices 200 of the users participating in the electronic conference. Note that the various programs may be obtained, for example, from a server device or the like via a network, or may be read from a recording medium such as a USB memory.

[0027] The storage unit 112 stores sound data assigned to user AI. The sound data is managed in a sound data table. Sound data is assigned to a user by the electronic conference server 100, for example, when the user registers for use of an electronic conference provided by the electronic conference server 100. A user who will use an electronic conference is required to register with the electronic conference server 100 in advance, and at this time, the electronic conference server 100 assigns sound data to the user along with an account and password.

[0028] The communication unit 113 has a communication device or the like, and communicates with the terminal device 200 to transmit and receive data to and from the terminal device 200.

[0029] The display unit 114 is configured to include a graphics controller 114a and a buffer memory 114b made up of a memory such as a VRAM (Video RAM). In this configuration, the graphics controller 114a controls the display unit 114 and the display unit 116 based on control information sent from the control unit 111. The buffer memory 114b also temporarily stores image data that can be immediately displayed on the display unit 116. An image is then displayed on the display unit 116 based on the image data output from the graphics controller 114a.

[0030] The I / F unit 115 has the structure and functions necessary to connect the electronic conference server 100 to external devices such as the display unit 116 and the operation unit 117, and performs data conversion between them as necessary.

[0031] The display unit 116 is a liquid crystal display or the like, and displays an image based on the image data received from the display unit 114 .

[0032] The operation unit 117 detects an operation by the operator and transmits operation data indicating the operation content, etc. to the control unit 111. The control unit 111 determines which operation has been performed based on the operation data and performs processing according to the operation content.

[0033] 3. Configuration of Terminal Device 200 The configuration of the terminal device 200 will be described with reference to Fig. 4. Fig. 4 is a block diagram showing an example of the configuration of the terminal device 200.

[0034] The terminal device 200 includes a control unit 211, a memory unit 212 consisting of an HDD, SSD, etc., a communication unit 213, a display unit 214, and an interface (I / F) unit 215, and is connected to a microphone 216, a speaker 217, a camera 218, a display unit 219, and an operation unit 220 via the I / F unit 215.

[0035] The control unit 211 is made up of a CPU 211a that controls the entire control unit 211, a ROM 211b in which a control program for controlling the control unit 211 and the like is stored in advance, and a RAM 211c that temporarily stores various data. The control unit 211 or the CPU 211a corresponds to a "computer."

[0036] The control unit 211 executes various processes for participating in an electronic conference provided by the electronic conference server 100 .

[0037] The storage unit 212 stores various programs such as an OS and application programs, as well as data and information used by the various programs. The storage unit 212 also stores a program that enables the control unit 211 to participate in an electronic conference. Note that the various programs may be acquired, for example, from a server device or the like via a network, or may be read from a recording medium such as a USB memory.

[0038] The communication unit 213 includes a communication device and the like, and communicates with the electronic conference server 100 and other terminal devices 200 to mutually transmit and receive data.

[0039] The display unit 214 is configured to include a graphics controller 214a and a buffer memory 214b made up of a memory such as a VRAM. In this configuration, the graphics controller 214a controls the display unit 214 and the display unit 219 based on control information sent from the control unit 211. The buffer memory 214b also temporarily stores image data that can be immediately displayed on the display unit 219. Images are then displayed on the display unit 219 based on the image data output from the graphics controller 214a.

[0040] The I / F unit 215 has the structure and functions necessary to connect the terminal device 200 to external devices such as a microphone 216, a speaker 217, a camera 218, a display unit 219, and an operation unit 220, and performs data conversion between the two as necessary.

[0041] The microphone 216 converts the voice (sound) of the user or the like into an electrical signal. The electrical signal is transmitted to the control unit 211 via the I / F unit 215.

[0042] The speaker 217 outputs sound data (electrical signals) as sound under the control of the control unit 211. In this embodiment, the speaker 217 outputs background sound based on background sound data received from the electronic conference server 100.

[0043] The camera 218 transmits image data captured through a lens to the control unit 211 via the I / F unit 215 .

[0044] The display unit 219 is a liquid crystal display or the like, and displays an image based on the image data received from the display unit 214 .

[0045] Although Figure 4 shows an example in which the terminal device 200 is a desktop PC, the terminal device 200 may also be a notebook PC, a smartphone, a tablet terminal, etc., and in these cases, the control unit 211, the memory unit 212, the communication unit 213, the display unit 214, the interface (I / F) unit 215, the microphone 216, the speaker 217, the camera 218, the display unit 219, and the operation unit 220 may be integrated into one unit.

[0046] The operation unit 220 detects a user operation and transmits operation data indicating the operation content, etc. to the control unit 211. The control unit 211 determines which operation has been performed based on the operation data and performs processing according to the operation content.

[0047] [4. Background Sound Generation Process by the Teleconference Server 100] Next, the background sound generation process by the electronic conference server 100 will be described using the flowchart shown in Fig. 5. Fig. 5 is a flowchart showing an example of the background sound generation process by the electronic conference server 100. Before the flowchart shown in Fig. 5 starts, it is assumed that an electronic conference link has been distributed to the terminal devices 200 of the users participating in the electronic conference, and that the electronic conference server 100 and each terminal device 200 have been connected via login process using an account and a password.

[0048] First, the control unit 111 (CPU 111a) identifies users participating in the electronic conference (step S101). Specifically, the control unit 111 identifies the terminal device 200 that has connected to the electronic conference server 100 via the electronic conference link based on the account used during the login process.

[0049] Next, the control unit 111 acquires, from the storage unit 112, sound data assigned to each user (terminal device 200) identified in the process of step S101 (step S102).

[0050] Next, the control unit 111 synthesizes the sound data acquired in the process of step S102 to generate background sound data (step S103). At this time, the control unit 111 synthesizes the sound data so that the sound of each piece of sound data is included in the background sound, that is, so that the sound assigned to each user participating in the electronic conference can be heard from the background sound.

[0051] Next, the control unit 111 transmits the background sound data generated in the process of step S103 to the terminal device 200 of each user participating in the electronic conference (each terminal device 200 identified in the process of step S101) (step S104). Although not shown in Fig. 5, the control unit 211 of each terminal device 200 that has received the background sound data outputs background sound based on the background sound data from the speaker 217.

[0052] Next, the control unit 111 determines whether the electronic conference has ended (step S105). If the control unit 111 determines that the electronic conference has ended (step S105: YES), the control unit 111 ends the background sound generation process. On the other hand, if the control unit 111 determines that the electronic conference has not ended (step S105: NO), the control unit 111 proceeds to the process of step S106.

[0053] Next, the control unit 111 determines whether there has been a change in the users participating in the electronic conference (step S106). A change in the users participating in the electronic conference includes a case where a new user joins the electronic conference and a case where a user currently participating in the electronic conference leaves the electronic conference. At this time, if the control unit 111 determines that there has been no change in the users participating in the electronic conference (step S106: NO), the control unit 111 proceeds to the processing of step S105. That is, the processing of steps S105 and S106 is repeated unless the electronic conference ends or there is a change in the users currently participating in the electronic conference. On the other hand, if the control unit 111 determines that there has been a change in the users participating in the electronic conference (step S106: YES), the control unit 111 proceeds to the processing of step S101, identifies the users currently participating in the electronic conference, generates background sound data again, and transmits it to each terminal device 200 of the users currently participating in the electronic conference. As a result, background sound based on the background sound data generated from the sound data assigned to each user currently participating in the electronic conference is constantly output from the speaker 217 of the terminal device 200 of each user.

[0054] As described above, the electronic conference server 100 in this embodiment provides an electronic conference in which multiple users participate using terminal devices 200 each connected to a communication line, and the control unit 111 (an example of a "background sound data generating means" and "transmitting means") generates background sound data by synthesizing the sound data assigned to the users participating in the electronic conference from the different sound data assigned to each user, and transmits the background sound data to the terminal devices 200 used by each of the multiple users participating in the electronic conference.

[0055] Therefore, according to the electronic conference server 100, background sounds based on background sound data generated from sound data assigned to each user participating in the electronic conference are output from the speaker 217 of each user's terminal device 200, so that each user can know who is participating in the electronic conference besides him / her from each sound included in the background sound without looking at the screen.

[0056] That is, the user can know who is participating in the electronic conference even when participating in the electronic conference using a terminal device that does not have the display unit 219. Furthermore, the user can know who is participating in the electronic conference even when materials related to the electronic conference are displayed on the entire surface of the display unit 219 and information indicating the participants of the electronic conference is not displayed on the display unit 219.

[0057] Furthermore, in the present embodiment, when a change occurs in the users participating in the electronic conference, such as joining (joining midway) or leaving (leaving midway), the control unit 111 of the electronic conference server 100 regenerates background sound data and transmits the regenerated background sound data to the terminal devices 200 used by each of the multiple users participating in the electronic conference. As a result, even if a change occurs in the users participating in the electronic conference during the electronic conference, background sounds corresponding to the users participating in the electronic conference are output from the speakers 217 of the respective terminal devices 200 as appropriate, so that the users can understand that a change has occurred in the participants and further who has joined or left midway based on the change in background sound.

[0058] [5. Modifications] Next, modifications of this embodiment will be described. The modifications described below can be combined as appropriate.

[0059] [5.1. Variation 1] The teleconference server 100 receives location information (such as latitude, longitude, and altitude information) from each terminal device 200, and the control unit 111 may determine how to output the sounds included in the background sound assigned to each user participating in the teleconference based on the location information received from each terminal device 200 and in accordance with the location of the terminal device 200 used by each user. Each terminal device 200 can acquire location information by any means. For example, the terminal device 200 may be provided with a GPS receiver and acquire location information based on a GPS signal received by the GPS receiver, or the user may input location information.

[0060] [5.1.1. Variation 1-1] 6 is an example diagram showing the positions of users C, F, and I relative to user A. In variant example 1-1, the sound image localization of the sound of the sound data assigned to each of users C, F, and I, which is included in the background sound output from the terminal device 200 of user A, is set to the positions of the terminal devices 200 used by users C, F, and I to which the sound data that is the source of the sound is assigned, relative to the position of the terminal device 200 used by user A.

[0061] Specifically, the control unit 111 (an example of "position information acquisition means" and "sound image localization data generation means") of the electronic conference server 100 acquires position information of the terminal device 200 used by each user participating in the electronic conference, and generates sound image localization data that localizes the sound image of sound data assigned to each user other than one user, among sounds included in background sound based on background sound data transmitted to the terminal device 200 used by that one user, to the position of the terminal device 200 used by the user to which the sound data that is the basis of the sound, using the position of the terminal device 200 used by that one user as a reference. Furthermore, the control unit 111 generates sound image localization data for the terminal devices 200 used by each user participating in the electronic conference, with each user participating in the electronic conference as the user, and further transmits the sound image localization data generated for that terminal device 200 to the terminal device 200 used by each user participating in the electronic conference.

[0062] 6 , the control unit 111 acquires position information of the terminal devices 200 used by each of the users A, C, F, and I participating in the teleconference, and generates sound image localization data for localizing the sound of the sound data assigned to each of the users C, F, and I other than user A, among the sounds included in the background sound based on the background sound data transmitted to the terminal device 200 used by user A participating in the teleconference, based on the position of the terminal device 200 used by user A, as the position of the terminal device 200 used by user A. The control unit 111 also performs this process on the terminal devices 200 used by users C, F, and I other than user A. Then, based on the background sound data and sound image localization data received from the teleconference server 100, the control unit 211 of the terminal device 200 localizes the sound image of each sound included in the background sound to the position of the user corresponding to that sound, and outputs the background sound from the speaker 217. This allows, for example, user A to ascertain the location of each user participating in the electronic conference from the direction of each sound included in the background sound (user C is in the west direction, user F is in the north direction, and user I is in the southeast direction). In this case, it is assumed that the speaker 217 has specifications and settings that allow sound image localization.

[0063] [Sound image localization data generation process by the electronic conference server 100] Next, the sound image localization data generation process by the electronic conference server 100 will be described with reference to the flowchart shown in Fig. 7. Fig. 7 is a flowchart showing an example of the sound image localization data generation process by the electronic conference server 100 in a modified example. Here, the example of Fig. 6 (when four users A, C, F, and I participate in the electronic conference) will be described.

[0064] First, the control unit 111 (CPU 111a) acquires location information of all users participating in the electronic conference (step S201). For example, the control unit 111 acquires location information (such as latitude, longitude, and altitude information) received in advance from the terminal device 200 used by each user participating in the electronic conference.

[0065] Next, the control unit 111 selects one user to participate in the electronic conference (step S202).

[0066] Next, the control unit 111 selects one user from among the users participating in the electronic conference other than the user selected in the process of step S202 (step S203). For example, if the control unit 111 selects user A in the process of step S202, the control unit 111 selects one of users C, F, or I.

[0067] Next, the control unit 111 determines the position (e.g., direction and distance from the reference) of the terminal device 200 used by the user selected in the processing of step S203, using the position of the terminal device 200 used by the user selected in the processing of step S202 as the reference (step S204).

[0068] Next, the control unit 111 stores the sound image localization of the sound data assigned to the user selected in the processing of step S203, among the sounds included in the background sound based on the background sound data (i.e., the background sound data generated in the background sound generation processing) transmitted to the terminal device 200 used by each user participating in the electronic conference, in association with the position identified in the processing of step S204 (step S205).

[0069] Next, the control unit 111 determines in the process of step S203 whether all other users other than the user selected in the process of step S202 have been selected (step S206). For example, if the control unit 111 has selected user A in the process of step S202, the control unit 111 determines in the process of step S203 whether all of users C, F, and I have been selected. If the control unit 111 determines that all other users have not been selected (step S206: NO), the control unit 111 proceeds to the process of step S203 and selects other users that have not been selected so far. On the other hand, if the control unit 111 determines that all other users have been selected (step S206: YES), the control unit 111 then generates sound image localization data indicating the correspondence between the sound and sound image localization stored in the process of step S205 for all other users (step S207). For example, if the control unit 111 selects user A in the processing of step S202, the control unit 111 generates sound image localization data in which the sound image localization of the sound data assigned to users C, F, and I is the position of the terminal device 200 used by users C, F, and I, respectively, using the terminal device 200 used by user A as the reference position.

[0070] Next, the control unit 111 transmits the sound image localization data generated in the process of step S207 to the terminal device 200 used by the user selected in the process of step S202 (step S208).

[0071] Next, the control unit 111 determines whether or not all users participating in the electronic conference have been selected in the process of step S202 (step S209). That is, the control unit 111 determines whether or not four users A, C, F, and I have been selected in the process of step S202. If the control unit 111 determines that all users participating in the electronic conference have not been selected (step S209: NO), the control unit 111 proceeds to the process of step S202 and repeats the processes of steps S202 to S208 for each remaining user. On the other hand, if the control unit 111 determines that all users participating in the electronic conference have been selected (step S209: YES), the sound image localization data generation process ends.

[0072] The control unit 111 may combine the sound image localization data with the background sound data and transmit the combined data, or may transmit the combined data separately from the background sound data.

[0073] [5.1.2. Variation 1-2] As shown in Fig. 6, in Modification 1-2, the volume of the sound of the sound data respectively assigned to users C, F, and I, which is included in the background sound output from the terminal device 200 of user A, is set to a volume according to the distance between the positions of the terminal devices 200 used by users C, F, and I to which the sound data that is the basis of the sound is assigned, and the position of the terminal device 200 used by user A. Note that in Fig. 6, the thickness of the arrows extending from users C, F, and I to user A indicates the volume (the thicker the arrow, the louder the volume).

[0074] Specifically, the control unit 111 (an example of a "distance calculation means" and "volume control data generation means") of the electronic conference server 100 acquires location information of the terminal device 200 used by each user participating in the electronic conference, and generates volume control data for adjusting the volume of sound data assigned to each user other than one user, among sounds included in the background sound based on background sound data to be transmitted to the terminal device 200 used by one user participating in the electronic conference, according to the distance between the location of the terminal device 200 used by the user to which the sound data that is the basis of the sound is assigned, and the location of the terminal device 200 used by the one user. Furthermore, the control unit 111 generates volume control data for the terminal devices 200 used by each user participating in the electronic conference, treating each user participating in the electronic conference as the one user, and further transmits the volume control data generated for the terminal device to the terminal device 200 used by each user participating in the electronic conference.

[0075] 6 , the control unit 111 acquires location information of the terminal devices 200 used by each of the users A, C, F, and I participating in the teleconference, and generates volume control data for adjusting the volume of each of the sounds included in the background sound based on the background sound data to be transmitted to the terminal device 200 used by the user A participating in the teleconference, the volume of each of the sounds included in the background sound based on the background sound data to be transmitted to the terminal device 200 used by the user A, the volume of each of the sounds included in the background sound being transmitted to the terminal device 200 used by the user A, the volume control data being generated according to the distance between the location of the terminal device 200 used by the user C, F, and I to which the sound data that is the basis of the sound is assigned and the location of the terminal device 200 used by the user A. The control unit 111 also performs this process on the terminal devices 200 used by the users C, F, and I other than the user A. The control unit 211 of each of the terminal devices 200 of the users A, C, F, and I controls the volume of each of the sounds included in the background sound based on the background sound data and the volume control data received from the teleconference server 100, and outputs the background sound from the speaker 217. This allows, for example, user A to determine the distance between him and each user participating in the electronic conference (user I is the closest, user F is the second closest, and user C is the third closest (farthest)) from the difference in volume of each sound contained in the background sound.

[0076] [Volume Control Data Generation Process by the Teleconference Server 100] Next, the volume control data generation process by the electronic conference server 100 will be described using the flowchart shown in Fig. 8. Fig. 8 is a flowchart showing an example of the volume control data generation process by the electronic conference server 100 in a modified example. Here, the example of Fig. 6 (when four users A, C, F, and I participate in the electronic conference) will be described.

[0077] First, the control unit 111 (CPU 111a) acquires location information of all users participating in the electronic conference (step S301). For example, the control unit 111 acquires location information (such as latitude, longitude, and altitude information) received in advance from the terminal device 200 used by each user participating in the electronic conference.

[0078] Next, the control unit 111 selects one user to participate in the electronic conference (step S302).

[0079] Next, the control unit 111 calculates the distance between the terminal device 200 of each user other than the user selected in the processing of step S302 among the users participating in the electronic conference and the terminal device 200 used by the user selected in the processing of step S302 (step S303). For example, when user A is selected in the processing of step S302, the control unit 111 calculates the distance between the terminal device 200 used by user A and the terminal devices 200 used by users C, F, and I.

[0080] Next, the control unit 111 determines the volume of the sound data assigned to each user other than the user selected in the processing of step S302, among the sounds included in the background sound based on the background sound data (i.e., the background sound data generated in the background sound generation processing) transmitted to the terminal device 200 used by each user participating in the electronic conference, in accordance with the distance calculated in the processing of step S303 (step S304).

[0081] Next, the control unit 111 generates volume control data indicating the volume of the sound of the sound data assigned to each of the other users determined in the process of step S304 (step S305). For example, if user A is selected in the process of step S302, the control unit 111 generates volume control data that sets the volume of the sound of user I to the highest, the volume of the sound of user F to the second highest, and the volume of the sound of user C to the third highest (lowest).

[0082] Next, the control unit 111 transmits the volume control data generated in the process of step S305 to the terminal device 200 used by the user selected in the process of step S302 (step S306).

[0083] Next, the control unit 111 determines whether all users participating in the electronic conference have been selected in the process of step S302 (step S307). For example, the control unit 111 determines whether four users A, C, F, and I have been selected in the process of step S302. If the control unit 111 determines that all users participating in the electronic conference have not been selected (step S307: NO), the control unit 111 proceeds to the process of step S302 and repeats the processes of steps S302 to S306 for each remaining user. On the other hand, if the control unit 111 determines that all users participating in the electronic conference have been selected (step S307: YES), the volume control data generation process ends.

[0084] Note that the control unit 111 may combine the volume control data with the background sound data and transmit it, or may transmit it separately from the background sound data.

[0085] Note that Modification 1-1 and Modification 1-2 may be combined. In this case, in the example shown in Fig. 6, the speaker 217 of the terminal device 200 of user A outputs the sound assigned to user I at the loudest volume from the southeast direction, the sound assigned to user F at the second loudest volume from the north direction, and the sound assigned to user C at the third loudest (lowest) volume from the west direction. This allows user A to grasp the directions in which users C, F, and I are located and the distances there to them in comparison with other users.

[0086] [5.2. Variation 2] The control unit 111 of the electronic conference server 100 may generate background sound data by synthesizing sound data with the same BPM (Beats Per Minute). By synthesizing sound data with the same BPM, it is possible to generate background sound that is comfortable for the user (not harsh to the ears).

[0087] 9, the storage unit 112 of the teleconference server 100 may be configured to assign and store multiple pieces of sound data with different BPMs for each user, and the control unit 111 may generate background sound data by synthesizing sound data with the same BPM among the sound data assigned to the users participating in the teleconference. For example, sound data with a BPM of "70" ("aaa70.mp3" for user A, "ccc70.mp3" for user C, "fff70.mp3" for user F, and "iii70.mp3" for user I) may be synthesized. In this case, the sound data with a BPM of "70," "80," or "90" to be synthesized may be selected randomly. This allows background sounds with different BPMs to be created, preventing BPMs from becoming monotonous. In the example of Figure 9, sound data with BPMs of "70", "80", and "90" are assigned to each user, but sound data with a BPM other than these may be assigned to each user, and the control unit 111 may synthesize sound data with a BPM that is assigned in common to all users participating in the electronic conference.

[0088] Furthermore, sound data of natural sounds (such as the sound of a babbling brook or birdsong) may be assigned to at least some users, and the control unit 111 may generate background sound data by synthesizing a plurality of sound data including the sound data of natural sounds. In this case, the control unit 111 may synthesize only the sound data of natural sounds. Furthermore, the control unit 111 may synthesize a plurality of sound data by adding the sound data of natural sounds to a plurality of sound data having the same BPM. Since natural sounds are unlikely to interfere with other sounds (for example, sounds having different BPMs), it is possible to generate background sounds that are comfortable (not harsh) for the user.

[0089] [5.3. Variation 3] The teleconference provided by the teleconference server 100 includes not only video or audio teleconferences but also text teleconferences (e.g., chat). For example, when multiple users are chatting, a server device providing a chat service may generate background sound data by synthesizing sound data assigned to the users participating in the chat, transmit the data to each user's terminal device, and cause each terminal device to output background sound based on the received background sound data. This allows users to identify users participating in the chat from the sounds contained in the background sound. Note that a teleconference is a forum for multiple users to communicate using video, audio, and text, each using a terminal device connected to a communication line, regardless of purpose, and may include, for example, everyday conversation or conversations while playing a game such as an online game with multiple users. [Explanation of symbols]

[0090] 10: Information processing device 11: Background sound data generation means 12: Transmission method 100: Electronic conference server 111: Control unit 111a: CPU 111b :ROM 111c:RAM 112: Storage section 113: Communications Department 114: Display unit 114a: Graphics controller 114b: Buffer memory 115:I / F section 116:Display section 117:Operation unit 200: Terminal device 211: Control unit 211a: CPU 211b :ROM 211c:RAM 212: Storage section 213: Communications Department 214: Display unit 214a: Graphics controller 214b: Buffer memory 215:I / F section 216:Mike 217: Speaker 218: Camera 219:Display section 220:Operation unit AI:User S: Electronic conference system

Claims

1. A server device that provides an electronic conference in which a plurality of users participate using terminal devices each connected to a communication line, a background sound data generating means for generating background sound data by synthesizing all of the different sound data assigned to all of the users participating in the electronic conference; a transmitting means for transmitting the background sound data to the terminal devices used by each of the plurality of users participating in the electronic conference; A server device comprising:

2. 2. The server device according to claim 1, the background sound data generating means regenerates the background sound data when a change occurs in the joining or leaving of users participating in the electronic conference during the electronic conference; The server device is characterized in that the transmitting means transmits the regenerated background sound data to the terminal devices used by the plurality of users participating in the electronic conference.

3. 3. The server device according to claim 1, a location information acquisition means for acquiring location information of the terminal devices used by each of the users participating in the electronic conference; a sound image localization data generating means for generating sound image localization data for localizing the sound of the sound data assigned to each of the users other than the one user among the sounds included in the background sound based on the background sound data transmitted to the terminal device used by one of the users participating in the electronic conference, to the position of the terminal device used by the one user to which the sound data that is the source of the sound is assigned, based on the position of the terminal device used by the one user; Further provided with the sound image localization data generating means generates the sound image localization data for the terminal devices used by the users participating in the electronic conference, with each of the users participating in the electronic conference as one user; The server device is characterized in that the transmitting means further transmits the sound image localization data generated by the sound image localization data generating means for each terminal device used by each user participating in the electronic conference.

4. 3. The server device according to claim 1, a location information acquisition means for acquiring location information of the terminal devices used by each of the users participating in the electronic conference; a volume control data generating means for generating volume control data for controlling the volume of the sound of the sound data assigned to each of the users other than the one user among the sounds included in the background sound based on the background sound data to be transmitted to the terminal device used by one of the users participating in the electronic conference, according to the distance between the location of the terminal device used by the one user to which the sound data that is the source of the sound is assigned and the location of the terminal device used by the one user; Further provided with the volume control data generating means generates the volume control data for the terminal devices used by the users participating in the electronic conference, treating each of the users participating in the electronic conference as one user; The server device is characterized in that the transmitting means further transmits the volume control data generated by the volume control data generating means for each terminal device used by each user participating in the electronic conference.

5. 2. The server device according to claim 1, The server device is characterized in that the background sound data generating means generates the background sound data by synthesizing the sound data having the same BPM (Beats Per Minute).

6. 6. The server device according to claim 5, Each user is assigned a plurality of sound data with different BPM (Beats Per Minute), The background sound data generating means generates the background sound data by synthesizing sound data with the same BPM (Beats Per Minute) from among the sound data assigned to the users participating in the electronic conference.

7. 7. The server device according to claim 1, 5 or 6, At least one of the users is assigned the sound data indicating natural sounds, The server device is characterized in that the background sound data generating means generates the background sound data by synthesizing a plurality of pieces of sound data including the sound data representing the natural sound.

8. 1. An information processing method using a server device that provides an electronic conference in which a plurality of users participate using terminal devices each connected to a communication line, comprising: a background sound data generating step of generating background sound data by synthesizing all of the different sound data assigned to all of the users participating in the electronic conference; a transmitting step of transmitting the background sound data to the terminal devices used by each of the plurality of users participating in the electronic conference; An information processing method comprising:

9. A computer included in a server device that provides an electronic conference in which a plurality of users participate using terminal devices connected to a communication line, a background sound data generating means for generating background sound data by synthesizing all of the different sound data assigned to all of the users participating in the electronic conference; a transmitting means for transmitting the background sound data to the terminal devices used by each of the plurality of users participating in the electronic conference; An information processing program characterized by causing the program to function as:

Images