Information processing device, voice system, voice processing method, and voice processing program

Abstract

The objective is to provide a new method for controlling microphone audio when multiple voice chat systems coexist. [Solution] The information processing device comprises an audio system, a microphone sound acquisition unit that acquires microphone sound, and a second voice chat system that provides a voice chat function. The audio system comprises a first audio provision unit that provides first audio data corresponding to microphone sound or second audio data corresponding to silence, and a second audio provision unit that provides third audio data corresponding to microphone sound. When the second voice chat system is running, the audio system causes the first audio provision unit to provide second audio data and the second audio provision unit to provide third audio data.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, a voice system, a voice processing method, and a voice processing program.

Background Art

[0002] Patent Document 1 (Japanese Patent Application Laid-Open No. 2022-41345) discloses a game application equipped with a voice chat function and an application that provides a voice chat function.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When executing a plurality of voice chat functions, there is room for improvement in which voice chat function to use for microphone output. For example, when a voice chat function implemented in a game application and a voice chat function implemented in an information processing apparatus that executes the game application coexist, there was room for improvement in the input method of microphone voice.

Means for Solving the Problems

[0005] (Configuration 1) The system in this embodiment is an information processing device capable of executing a game application that implements a first voice chat system. The information processing device comprises an audio system, a microphone sound acquisition unit that acquires microphone sound from a microphone, and a second voice chat system that provides a voice chat function. The audio system comprises a first audio provision unit that provides the first voice chat system with first audio data corresponding to microphone sound or second audio data corresponding to silence, and a second audio provision unit that provides the second voice chat system with third audio data corresponding to microphone sound. When the second voice chat system is running, the audio system causes the first audio provision unit to provide second audio data and the second audio provision unit to provide third audio data.

[0006] (Configuration 2) In Configuration 1, the audio system causes the first audio provider to provide first audio data when the second voice chat system is not running and the first voice chat system is running.

[0007] (Configuration 3) In Configuration 1 or Configuration 2, the audio system further comprises a third audio provider unit that provides a fourth audio data corresponding to microphone sound to the game application. The audio system causes the third audio provider unit to provide the fourth audio data in response to a request from the game application.

[0008] (Configuration 4) In Configuration 3, the audio system further includes an adjustment unit that performs at least one of the following processes: active noise cancellation processing, active echo cancellation processing, and automatic gain control processing. The adjustment unit adjusts the microphone sound input to at least one of the first audio provider, the second audio provider, and the third audio provider.

[0009] (Configuration 5) In Configuration 1 or Configuration 2, the audio system further includes an adjustment unit that performs at least one of the following processes: active noise cancellation processing, active echo cancellation processing, and automatic gain control processing. The adjustment unit adjusts the microphone sound input to at least one of the first audio providing unit and the second audio providing unit.

[0010] (Configuration 6) In any of Configurations 1 to 3, the audio system further comprises an adjustment unit that performs at least one of the following processes: active noise cancellation processing, active echo cancellation processing, and automatic gain control, and a fourth audio providing unit that provides fifth audio data to the game application. The fifth audio data corresponds to microphone sound acquired by a microphone sound acquisition unit that is not adjusted by the adjustment unit, and the audio system causes the fourth audio providing unit to provide the fifth audio data in response to a request from the game application.

[0011] (Configuration 7) In any of Configurations 1 to 6, the information processing device further includes a microphone.

[0012] (Configuration 8) The audio system in one embodiment is an audio system implemented in an information processing device capable of executing a game application that implements a first voice chat system. The information processing device includes a microphone sound acquisition unit that acquires microphone sound from a microphone, and a second voice chat system that provides a voice chat function. The audio system includes a first audio provision unit that provides the first voice chat system with first audio data corresponding to microphone sound or second audio data corresponding to silence, and a second audio provision unit that provides the second voice chat system with third audio data corresponding to microphone sound. When the second voice chat system is running, the first audio provision unit provides second audio data, and the second audio provision unit provides third audio data.

[0013] (Configuration 9) The audio processing method in one embodiment is an audio processing method used in an information processing device that implements an audio system and is capable of executing a game application that implements a first voice chat system. The information processing device includes a microphone sound acquisition unit that acquires microphone sound from a microphone, and a second voice chat system that provides a voice chat function. The audio system includes a first audio provision unit that provides the first voice chat system with first audio data corresponding to microphone sound or second audio data corresponding to silence, and a second audio provision unit that provides the second voice chat system with third audio data corresponding to microphone sound. The audio processing method includes, as a process to be executed by the audio system, the steps of causing the first audio provision unit to provide second audio data and causing the second audio provision unit to provide third audio data while the second voice chat system is running.

[0014] (Configuration 10) The voice processing program in one embodiment is a voice processing program that can execute a game application implementing a first voice chat system and is used in an information processing device on which the voice system is implemented. The information processing device includes a microphone sound acquisition unit that acquires microphone sound from a microphone and a second voice chat system that provides a voice chat function. The voice system includes a first voice provision unit that provides the first voice chat system with first voice data corresponding to microphone sound or second voice data corresponding to silence, and a second voice provision unit that provides the second voice chat system with third voice data corresponding to microphone sound. The voice processing program causes the voice system to perform the steps of causing the first voice provision unit to provide second voice data and the second voice provision unit to provide third voice data while the second voice chat system is running. [Effects of the Invention]

[0015] According to this disclosure, a new method for controlling microphone audio can be provided when multiple voice chat systems coexist. [Brief explanation of the drawing]

[0016] [Figure 1] This is a schematic diagram showing an example of a system according to this embodiment. [Figure 2] This is a schematic diagram showing an example of the hardware configuration of a game terminal according to this embodiment. [Figure 3] This is a diagram for explaining an example of the audio system in this embodiment. [Figure 4] This is a diagram showing an example of the output of audio data when the game chat program is in an execution state and the system chat program is not in an execution state. [Figure 5] This is a diagram showing an example of the output of audio data when the game chat program is not in an execution state and the system chat program is in an execution state. [Figure 6] This is a diagram showing an example of the output of audio data when both the game chat program and the system chat program are in an execution state.

Embodiment for Carrying Out the Invention

[0017] This embodiment will be described in detail with reference to the drawings. For the same or corresponding parts in the drawings, the same reference numerals are given and their descriptions will not be repeated.

[0018] <Embodiment> [A. Overview] A configuration example of the system 100 according to this embodiment will be described. FIG. 1 is a schematic diagram showing an example of the system 100 according to this embodiment. The system 100 is a system that provides services to game terminals 30A and 30B and other information processing devices (not shown) using, for example, servers Sr1 and Sr2.

[0019] As an example, the system 100 includes servers Sr1 and Sr2 and game terminals 30A and 30B. Each component included in the system 100 can be connected to each other via a network NW. The network NW may be, for example, the Internet.

[0020] Each of the game terminals 30A and 30B can be, for example, a dedicated information processing device for providing games to users. Hereinafter, the game terminals 30A and 30B will be collectively referred to as "game terminal 30" without distinction. The game terminal 30 includes, for example, a system program 361 and a game application 362. The system program 361 is a program for operating the game terminal 30 and includes, for example, an OS, firmware, and a system chat program Sv2.

[0021] The game application 362 is an application for executing specific game content. The game application 362 can be stored in the game terminal 30, for example, by being downloaded from a distribution server (not shown) to the game terminal 30 or by inserting a cartridge (not shown) into the game terminal 30. The game terminal 30 may be capable of storing a plurality of game applications that each provide different game content. That is, the game application 362 has a configuration independent of the game terminal 30 and can be newly added to the game terminal 30 or deleted from the game application 362 stored in the game terminal 30. In the example of FIG. 1, the game terminals 30A and 30B store a game application 362 that provides common game content.

[0022] In the present embodiment, a system chat program Sv2 is implemented in the system program 361. The system chat program Sv2 is a program for providing a voice chat function to the user operating the game terminal 30. The server Sr1 is a server that executes various processes for providing a voice chat service between a plurality of game terminals 30 that execute the system chat program Sv2.

[0023] As a specific example, server Sr1 receives chat information, including at least the voice of the user of game terminal 30A, from game terminal 30A, which is running the system chat program Sv2, via the network NW. The chat information may include, for example, the game execution screen, a video displaying the user, etc. Server Sr1 sends the chat information obtained from game terminal 30A to game terminal 30B. Game terminal 30B runs the system chat program Sv2 and displays the chat information obtained from game terminal 30A to the user of game terminal 30B. This makes it possible for the user of game terminal 30B to recognize, for example, the voice spoken by the user of game terminal 30A using game terminal 30B.

[0024] Furthermore, chat information including at least the voice of the user of game terminal 30B may be transmitted from game terminal 30B to game terminal 30A. In this case, system 100 can provide a two-way conversational communication service to the users of game terminals 30A and 30B.

[0025] The system chat program Sv2 may provide voice chat functionality while game content is running on the game terminal 30, or it may provide voice chat functionality to the game terminal 30 when game content is not running. For example, voice chat functionality may be provided when the same game application 362 is running on game terminals 30A and 30B, or voice chat functionality may be provided when different game applications 362 are running on game terminals 30A and 30B. This allows users of game terminals 30A and 30B to communicate while playing the game running on their respective game terminals 30.

[0026] In this embodiment, Server Sr2 is a server that provides services related to the execution of game content. Server Sr2 can provide services such as competitive games or cooperative games. For example, Server Sr2 obtains operation information from each of the game terminals 30A and 30B that run the game application 362, and proceeds with the competitive game or cooperative game, etc., according to the operation information.

[0027] Furthermore, in this embodiment, the server Sr2 can provide a service that allows voice chat while running a competitive game or a cooperative game, for example, as a function implemented in the game application 362. The game terminal 30 activates the voice chat function by executing the game chat program Gv1 implemented in the game application 362. Thus, in the system 100 of this embodiment, the system chat program Sv2 implemented as part of the system of the game terminal 30 and the game chat program Gv1 implemented in the game application 362, which is detachable from the game terminal 30, coexist.

[0028] In the following, the mechanism that provides voice chat functionality using the system chat program Sv2 may be referred to as "system voice chat," and the mechanism that provides voice chat functionality using the game chat program Gv1 may be referred to as "game voice chat." Game voice chat cannot be started unless the game application 362 is running. On the other hand, even if the game application 362 is not running, system voice chat can be started if the system of the game terminal 30A is running. Furthermore, game voice chat may be started even if no game such as the aforementioned competitive game or cooperative game is running, as long as the game application 362 is running. The game terminal 30 in this embodiment is capable of running the system chat program Sv2 and the game chat program Gv1 simultaneously.

[0029] [B. Hardware Configuration Example] In the following section, an example of the hardware configuration of a game terminal 30 that constitutes the system 100 according to this embodiment will be described using Figure 2.

[0030] Figure 2 is a schematic diagram showing an example of the hardware configuration of a game terminal 30 according to this embodiment. Referring to Figure 2, the game terminal 30 includes, for example, a display 31, an operation unit 32, a communication unit 33, one or more processors 34, memory 35, storage 36, a camera Cm, a speaker Sp, and a microphone Mc1. These components are connected to each other via a bus 37 so as to be able to communicate data.

[0031] The display 31 displays an image generated as a result of information processing performed by the processor 34. The display 31 may include multiple displays. The operation unit 32 receives input from the user operating the game terminal 30. The operation unit 32 may include, for example, push buttons, analog sticks, touch panels, mice, keyboards, etc.

[0032] The communication unit 33 communicates with other information processing terminals included in the system 100 via a network NW. The communication unit 33 may have at least one of the hardware necessary for wired communication and the hardware necessary for wireless communication. In addition, all or part of the processing of the communication unit 33 may be implemented by the processor 34.

[0033] The processor 34 is a processing unit for executing the processing provided by the game terminal 30. In this disclosure, the term "processor" means, for example, a processing circuit such as a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or a GPU (Graphics Processing Unit). The term "processor" includes processing circuits that execute processing according to instruction codes written in a program, processing circuits that integrate multiple functions such as a SoC (System on Chip), and hardwired circuits.

[0034] The memory 35 is a volatile storage device accessible by the processor 34, and may include, for example, DRAM (Dynamic Random Access Memory) or SRAM (Static Random Access Memory). The storage 36 is a non-volatile storage device accessible by the processor 34, and may include, for example, a hard disk or flash memory. The storage 36 may also be a storage medium that can be attached to or removed from the game terminal 30, such as an optical disc or cartridge.

[0035] In this embodiment, the storage 36 stores a system program 361 and a game application 362. The processor 34, for example, reads the system program 361 and the game application 362, loads them into memory 35, and executes them. In this specification, the term “memory” includes at least both volatile memory and non-volatile storage.

[0036] The microphone Mc1, camera Cm, and speaker Sp can be used for the voice chat function described above. The microphone Mc1 is, for example, a built-in microphone of the game terminal 30, and collects sounds generated around the microphone, such as the user's speech. Similarly, the camera Cm is a built-in camera that can capture images of the user playing the game terminal 30. The speaker Sp can output music and sound effects associated with the game, and during voice chat, it can output audio indicating the content of other users' speech.

[0037] Furthermore, various components such as the display 31, control unit 32, microphone Mc1, camera Cm, and speaker Sp do not necessarily have to be included within the game terminal 30. For example, at least one of the display 31, control unit 32, microphone Mc1, camera Cm, and speaker Sp may be an external device separate from the game terminal 30 that can be connected to the game terminal 30 by wire or wireless connection.

[0038] [C. An example of a voice system] Figure 3 is a diagram illustrating an example of the audio system 10 in this embodiment. Figure 3 shows a conceptual diagram illustrating the handling of audio data within a single game terminal 30. The audio system 10 is implemented by the execution of a system program 361 by the processor 34 and is responsible for passing audio data acquired by the microphone to various programs.

[0039] The audio system 10 includes a microphone Mc1, pins P1 to P5, amplifier Amp1, switching unit Ds1, amplifier Amp2, adjustment unit Nz1, voice provision units Vs1 to Vs6, and a system chat program Sv2. Each component included in the audio system 10 is controlled by the processor 34. Figure 3 shows components other than the audio system 10, namely a game application 362 and an external microphone Mc2 connected to the game terminal 30. Hereafter, microphones Mc1 and Mc2 may be collectively referred to as "microphone Mc" without distinction, and voice provision units Vs1 to Vs6 may be collectively referred to as "voice provision unit Vs" without distinction.

[0040] Pins P1 to P5 are audio input / output terminals that receive microphone sound input to their respective microphones (Mc). Pins P2 to P5 may also be, for example, an earphone jack, a USB (Universal Serial Bus) terminal, etc. Figure 3 shows an example where microphone Mc2 is connected to pin P2. Pins P2 to P5 may be provided in locations other than the main body of the game terminal 30. For example, if the control unit 32 is a controller that can be removed from the game terminal 30, pin P2 may be provided on the main body of the game terminal 30, while pin P3 may be provided on the control unit 32.

[0041] Each microphone sound received by pins P1 to P5 is processed as audio data by the audio system 10. The audio data input from pins P1 to P5 is amplified by a predetermined amount by amplifier Amp1 to adjust the sound pickup sensitivity of microphone Mc. The audio data includes both the analog electrical signal received from microphone Mc and the digital signal after conversion by an A / D converter (not shown).

[0042] Each of the pins P1 to P5 is connected to the switching unit Ds1. The switching unit Ds1 determines, according to instructions from the processor 34, which microphone Mc among the pins P1 to P5 will output its microphone sound to the audio supply units Vs1 to Vs4. In the example in Figure 3, the audio data input from pin P2 is controlled to be output to the audio supply units Vs1 to Vs4. Pins P4 and P5 are connected to the audio supply units Vs5 and Vs6, respectively, without going through the switching unit Ds1.

[0043] The audio data output from the switching unit Ds1 is amplified again by the amplifier Amp2, and the sensitivity of the microphone Mc is readjusted. The audio data output from the amplifier Amp2 is then output to the adjustment unit Nz1 and the audio supply unit Vs4.

[0044] The adjustment unit Nz1 includes, for example, at least one of the first adjustment unit N1, the second adjustment unit E1, and the third adjustment unit G1. The first adjustment unit N1 performs active noise cancellation processing. Active noise cancellation processing is a process that detects noise contained in audio data and reduces noise contained in audio data by outputting a cancellation sound with the opposite phase to the detected noise together with the audio data.

[0045] The second adjustment unit E1 performs active echo cancellation processing. Active echo cancellation processing predicts acoustic echo components that leak from the speaker to the microphone and cancels the echo by subtracting them from the audio data. The third adjustment unit G1 performs automatic gain control processing. Automatic gain control processing adjusts the gain to be within an appropriate range relative to the input signal level by feeding back the peak signal level in the audio data. The audio data, whose noise has been adjusted by the adjustment unit Nz1, is output to at least one of the audio supply units Vs1 to Vs3.

[0046] The voice provision units Vs1 to Vs6 are functions of the voice system 10 that provide the corresponding voice data shown in Figure 3 to other programs. The voice provision units Vs1 to Vs6 are configured so that their respective functions are realized, for example, by executing reusable code included in the library of the system program 361. Specifically, a program such as a game application 362 can obtain voice data that has been adjusted by the adjustment unit Nz1 by calling the voice provision unit Vs1 by referring to the library of the system program 361. Similarly, a program such as a game application 362 can obtain voice data that has not been adjusted by the adjustment unit Nz1 by calling the voice provision unit Vs4 by referring to the library of the system program 361.

[0047] The voice provider unit Vs2 is prepared to be called by the system chat program Sv2. By being called by the system chat program Sv2, the voice provider unit Vs2 provides the system chat program Sv2 with voice data adjusted by the adjustment unit Nz1. The system chat program Sv2 sends the voice data acquired by its own game terminal 30 to other game terminals 30 via the server Sr1. This allows the system chat program Sv2 to provide system voice chat to the user.

[0048] The voice provider units Vs1, Vs3 to Vs6 are provided for calling by the game chat program Gv1. Voice provider unit Vs1 provides the game chat program Gv1 with voice data adjusted by the adjustment unit Nz1. The game chat program Gv1 transmits the voice data acquired by its own game terminal 30 to other game terminals 30 via the server Sr2. This allows the game chat program Gv1 to provide game voice chat to the user. In this embodiment, as an example, voice provider units Vs1 and Vs2 output the same voice data. This allows the system 100 to suppress variations in the voice data output between system voice chat and game voice chat.

[0049] The audio provider unit Vs3 provides the game application 362 with audio data adjusted by the adjustment unit Nz1. This allows the game application 362 to play the game using the audio data collected by the microphone Mc. Furthermore, in system 100, since the adjustment unit Nz1 adjusts the noise of the audio data input to each of the audio provider units Vs1 to Vs3, it is not necessary to have multiple adjustment units to adjust the noise for each of the audio provider units Vs1 to Vs3. The audio provider unit Vs4 provides the game application 362 with audio data that has not been adjusted by the adjustment unit Nz1. This allows the game application 362 to arbitrarily decide whether to use audio data that has not been adjusted by the adjustment unit Nz1 or audio data that has been adjusted. In other words, system 100 can provide audio data that is tailored to the game application 362. For example, if the game application 362 uses audio data other than speech that is not desirable to be adjusted by the adjustment unit Nz1, system 100 can provide audio data that has not been adjusted by the adjustment unit Nz1. In other words, the game application 362 can select whether the audio necessary for the progression of the game is audio data that has been adjusted by the adjustment unit Nz1 or audio data that has not been adjusted.

[0050] In the example described above, the game application 362 acquired non-speech audio via the voice provider unit Vs4. However, the game application 362 may also acquire user speech via the voice provider unit Vs4. For example, the game application 362 may have its own unique audio adjustment function. In this case, if the game application 362 acquires adjusted audio data via the voice provider unit Vs4, the audio data adjustment process will be performed twice by both the game application 362 and the audio system 10. In the game application 362 to which the audio system 10 of this embodiment is applied, it is possible to select whether to acquire user speech data via either the voice provider unit Vs3 or the voice provider unit Vs4. This makes it possible to suppress the double adjustment process of audio data including user speech by both the audio system 10 and the game application 362 in this embodiment.

[0051] The audio providers Vs5 and Vs6 provide audio data input from pins P4 and P5, respectively, to the game application 362. In this way, the game application 362 can, for example, utilize the audio data corresponding to the audio providers Vs3 to Vs6 during the game's progression.

[0052] [D. Examples of outputting audio data to each chat program] Below, we will explain examples of inputting voice data into each chat program using Figures 4 to 6. Figures 4 to 6 show the system chat program Sv2 and the game chat program Gv1.

[0053] Figure 4 shows an example of audio data output when the game chat program Gv1 is running and the system chat program Sv2 is not running. In the examples in Figures 4 to 6, the processor 34 controls the switching unit Ds1 to output audio data corresponding to the microphone sound collected by the microphone Mc2 connected to pin P2 to the audio supply units Vs1 to Vs4, similar to Figure 3. Also, Figure 4 shows an example where game terminals 30A and 30B each run the game chat program Gv1 to perform game voice chat. In the example in Figure 4, the game chat program Gv1 is running on game terminal 30A, while the system chat program Sv2 is not running.

[0054] As shown in Figure 4, the audio data corresponding to the microphone sound input to microphone Mc2 is adjusted by adjustment unit Nz1 and then stored in an area accessible to audio provider Vs1. The game chat program Gv1 retrieves the audio data corresponding to the microphone sound by calling audio provider Vs1. The game chat program Gv1 transmits the retrieved audio data to game terminal 30B via server Sr2. This allows the user of game terminal 30B to hear the speech of the user of game terminal 30A through the speaker Sp of game terminal 30B.

[0055] Figure 5 shows an example of audio data output when the game chat program Gv1 is not running, but the system chat program Sv2 is running. In Figure 5, an example is shown where game terminal 30A and game terminal 30B each run the system chat program Sv2 to perform system voice chat with each other. In the example in Figure 5, the system chat program Sv2 is running on game terminal 30A, while the game chat program Gv1 is not running.

[0056] The audio data corresponding to the microphone sound input to microphone Mc2 is adjusted by adjustment unit Nz1 and then stored in an area accessible to audio provider unit Vs2. The system chat program Sv2 retrieves the audio data corresponding to the microphone sound by calling audio provider unit Vs2. The system chat program Sv2 sends the retrieved audio data to game terminal 30B via server Sr1. As a result, the user of game terminal 30B who is using system voice chat can hear the speech of the user of game terminal 30A through the speaker Sp of game terminal 30B.

[0057] Figure 6 shows an example of audio data output when both the game chat program Gv1 and the system chat program Sv2 are running. As described above, the game terminal 30 of this embodiment is capable of running the system chat program Sv2 and the game chat program Gv1 simultaneously. In Figure 6, game terminals 30A and 30B each run the system chat program Sv2 to perform system voice chat with each other. At the same time, game terminals 30A and 30C each run the game chat program Gv1 to perform game voice chat with each other.

[0058] In this embodiment, system 100 is configured to perform mutual exclusion control, prioritizing system chat program Sv2 over game chat program Gv1 when system chat program Sv2 and game chat program Gv1 are running simultaneously. Figure 6 shows that, similar to Figure 5, voice data acquired by system chat program Sv2 is transmitted to game terminal 30B via server Sr1.

[0059] The game chat program Gv1 calls the audio provider Vs1 to request audio data because game voice chat is running. In this embodiment, if the system chat program Sv2 is running, the processor 34 changes the audio data provided by the audio provider Vs1 from microphone sound from microphone Mc2 to audio data indicating silence. As a result, the audio provider Vs1 in Figure 6 provides the game chat program Gv1 with audio data indicating silence. The audio data indicating silence is not limited to audio data with a waveform that has virtually zero amplitude, but can be any wavelength outside the range of general human hearing. As a result, the user of the game terminal 30C performing game voice chat will not be able to hear the speech of the user of the game terminal 30A from the speaker Sp.

[0060] As described above, in the system 100 of this embodiment, when the system chat program Sv2 is running, the voice provider Vs2 is made to provide voice data corresponding to microphone sound, and the voice provider Vs1 is made to provide voice data corresponding to silence. Therefore, when system voice chat and game voice chat are running simultaneously, voice data corresponding to the user's speech is output only to the game terminal 30, which is the other party in the system voice chat. This prevents the system 100 from sending voice data corresponding to the user's speech to both the other party in the system voice chat and the other party in the game voice chat, thus preventing communication confusion. Furthermore, the game application 362 applied to the system 100 does not need to include a program that specifies not to output microphone audio data to the game chat program Gv1 when the system chat program Sv2 is started while the game chat program Gv1 is running. Therefore, the system 100 can improve the development efficiency of the game application 362. Furthermore, in system 100, there is no need to provide hardware or software switches in the game terminal 30 to switch between the game chat program Gv1 and the system chat program Sv2 as the output destination for microphone audio, thus reducing costs.

[0061] Furthermore, in this embodiment, while voice providers Vs3 to Vs6 are provided as voice providers Vs mainly used by the game application 362 for the purpose of game progression, voice provider Vs1 is provided as a voice provider Vs used by the game chat program Gv1. In other words, the developer of the game chat program Gv1 only needs to specify voice provider Vs1 as the source of voice data used by the game chat program Gv1. As a result, the developer of the game chat program Gv1 can suppress the transmission of voice data to both the system voice chat partner and the game voice chat partner simply by specifying voice provider Vs1, without having to program while considering the state with the system chat program Sv2.

[0062] To give a more concrete example, the developer of the game chat program Gv1 does not need to write code to prevent audio data from being sent to both the system voice chat recipient and the game voice chat recipient based on the fact that the system chat program Sv2 is started while the game chat program Gv1 is running. Therefore, in this embodiment, bugs that may occur due to the complexity of the code can be suppressed, and the processing load when the system chat program Sv2 is repeatedly started and stopped while the game chat program Gv1 is running can be reduced. Furthermore, since it is not necessary to implement a program in the game application 362 that includes logic defining the mutual exclusion relationship between system voice chat and game voice chat, it can be easily ported to any game application 362 that already supports game voice chat, thereby reducing costs.

[0063] [E. Other variations] In the example described above, when the system chat program Sv2 and the game chat program Gv1 are running simultaneously, an example of mutual exclusion control that prioritizes the system chat program Sv2 over the game chat program Gv1 was explained. However, in system 100, mutual exclusion control that prioritizes the game chat program Gv1 over the system chat program Sv2 may also be implemented. Alternatively, the processor 34 may control both the system chat program Sv2 and the game chat program Gv1 to output silence.

[0064] Furthermore, in the example described above, the adjustment unit Nz1 performed noise adjustment on the audio data input to the audio supply units Vs1 to Vs3. However, the target of noise adjustment by the adjustment unit Nz1 is not limited to these units; it may also be limited to only the audio supply units Vs1 and Vs2.

[0065] In the example described above, the adjustment unit Nz1 performed active noise cancellation processing, active echo cancellation processing, and automatic gain control processing. However, the processing performed by the adjustment unit Nz1 is not limited to these; it may perform other noise adjustment processing, or at least one of these.

[0066] Furthermore, Figure 3 illustrates an example in which each of the voice providers Vs1 and Vs2 provides audio data adjusted by the adjustment unit Nz1. However, the data provided by each of the voice providers Vs1 and Vs2 does not have to be the same audio data. For example, voice provider Vs1 may perform some processing on the audio data it provides to apply it to game voice chat. Similarly, voice provider Vs2 may perform some processing on the audio data it provides to apply it to system voice chat.

[0067] In this embodiment, the processor 34 changes the audio data provided by the audio provider Vs1 to audio data indicating silence, provided that the system chat program Sv2 is running. However, the condition for changing the audio data provided by the audio provider Vs1 to audio data indicating silence is not limited to the system chat program Sv2 being running; for example, it may also be the case that both the system chat program Sv2 and the game chat program Gv1 are running.

[0068] The embodiments disclosed herein should be considered in all respects to be illustrative and not restrictive. The scope of the present invention is indicated by the claims rather than by the foregoing description, and all modifications within the meaning and scope equivalent to the claims are intended. [Explanation of Symbols]

[0069] 10 Audio system, 30, 30A~30C Game terminal, 31 Display, 32 Control unit, 33 Communication unit, 34 Processor, 35 Memory, 36 Storage, 37 Bus, 100 System, 361 System program, 362 Game application, Amp1, Amp2 Amplifier, Cm Camera, Ds1 Switching unit, E1 Second adjustment unit, G1 Third adjustment unit, Gv1 Game chat program, Mc, Mc1, Mc2 Microphone, N1 First adjustment unit, NW Network, Nz1 Adjustment unit, Sp Speaker, Sr1, Sr2 Server, Sv2 System chat program, Vs, Vs1~Vs6 Voice provider unit.

Claims

1. An information processing device capable of executing a game application that implements a first voice chat system, The aforementioned information processing device is Voice system and, A microphone sound acquisition unit that acquires microphone sound from the microphone, It includes a second voice chat system that provides voice chat functionality, The aforementioned voice system A first audio provider unit provides the first voice chat system with first audio data corresponding to the microphone sound, or second audio data corresponding to silence. The system comprises a second voice providing unit that provides third voice data corresponding to the microphone sound to the second voice chat system, The aforementioned audio system, when the second voice chat system is running, The first audio provider is instructed to provide the second audio data, An information processing device that causes the second voice provisioning unit to provide the third voice data.

2. The aforementioned voice system operates when the second voice chat system is not running and the first voice chat system is running. The information processing apparatus according to claim 1, wherein the first voice providing unit provides the first voice data.

3. The audio system further comprises a third audio providing unit that provides the game application with fourth audio data corresponding to the microphone sound. The information processing apparatus according to claim 1 or 2, wherein the voice system causes the third voice provision unit to provide the fourth voice data in response to a request from the game application.

4. The audio system further includes an adjustment unit that performs at least one of the following processes: active noise cancellation processing, active echo cancellation processing, and automatic gain control processing. The information processing apparatus according to claim 3, wherein the adjustment unit adjusts the microphone sound input to at least one of the first sound providing unit, the second sound providing unit, and the third sound providing unit.

5. The audio system further includes an adjustment unit that performs at least one of the following processes: active noise cancellation processing, active echo cancellation processing, and automatic gain control processing. The information processing apparatus according to claim 1 or 2, wherein the adjustment unit adjusts the microphone sound input to at least one of the first sound providing unit and the second sound providing unit.

6. The aforementioned voice system An adjustment unit that performs at least one of the following processes: active noise cancellation, active echo cancellation, and automatic gain control. The system further comprises a fourth audio providing unit that provides fifth audio data to the aforementioned game application, The fifth audio data corresponds to the microphone sound acquired by the microphone sound acquisition unit, which is not adjusted by the adjustment unit. The information processing apparatus according to claim 1 or 2, wherein the voice system causes the fourth voice provision unit to provide the fifth voice data in response to a request from the game application.

7. The information processing apparatus according to claim 1 or claim 2, further comprising the aforementioned microphone.

8. A voice system implemented in an information processing device capable of executing a game application that implements a first voice chat system, The aforementioned information processing device is A microphone sound acquisition unit that acquires microphone sound from the microphone, It includes a second voice chat system that provides voice chat functionality, The aforementioned voice system A first audio provider unit provides the first voice chat system with first audio data corresponding to the microphone sound, or second audio data corresponding to silence. The system comprises a second voice providing unit that provides third voice data corresponding to the microphone sound to the second voice chat system, While the second voice chat system is running, The first voice provisioning unit provides the second voice data, The second voice provisioning unit is a voice system that provides the third voice data.

9. A voice processing method used in an information processing device that is capable of running a game application implementing a first voice chat system and has a voice system implemented, The aforementioned information processing device is A microphone sound acquisition unit that acquires microphone sound from the microphone, It includes a second voice chat system that provides voice chat functionality, The aforementioned voice system A first audio provider unit provides the first voice chat system with first audio data corresponding to the microphone sound, or second audio data corresponding to silence. The system comprises a second voice providing unit that provides third voice data corresponding to the microphone sound to the second voice chat system, The aforementioned audio processing method includes the following processes to be performed by the audio system: While the second voice chat system is running, The steps include: causing the first voice provisioning unit to provide the second voice data, A voice processing method comprising the step of causing the second voice supply unit to provide the third voice data.

10. A voice processing program used in an information processing device that implements a voice system and is capable of running a game application that implements a first voice chat system, The aforementioned information processing device is A microphone sound acquisition unit that acquires microphone sound from the microphone, It includes a second voice chat system that provides voice chat functionality, The aforementioned voice system A first audio provider unit provides the first voice chat system with first audio data corresponding to the microphone sound, or second audio data corresponding to silence. The system comprises a second voice providing unit that provides third voice data corresponding to the microphone sound to the second voice chat system, The aforementioned audio processing program, the aforementioned audio system, While the second voice chat system is running, The steps include: causing the first voice provisioning unit to provide the second voice data, A voice processing program that performs the step of causing the second voice supply unit to provide the third voice data.

Images