Audio playback program and audio playback device
The audio playback program and device adapt audio playback to playback device performance, enhancing user interest through tailored pronunciation and processing, ensuring consistent and engaging audio experiences.
Patent Information
- Application Number
- JP2021023383
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-02-17
- Publication Date
- 2025-05-21
- Estimated Expiration
- 2041-02-17
AI Technical Summary
Audio playback devices vary in performance, leading to inconsistent audio playback experiences for users, which can diminish user interest.
An audio playback program and device that determine the number of pronunciations and acoustic processing to be applied based on the playback device's type, ensuring optimal audio reproduction according to its capabilities.
Enhances user interest by providing tailored audio experiences that match the playback device's performance, improving audio accuracy and realism.
Smart Images

Figure 0007680668000001 
Figure 0007680668000002 
Figure 0007680668000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an audio playback program and an audio playback device. [Background technology]
[0002] Conventionally, there have been three-dimensional game devices that change the game sounds that a user hears related to a moving object based on the relationship between the user's viewpoint and the moving object moving within an object space in order to improve the sense of realism and presence felt by the user (see Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2002-346210 A Summary of the Invention [Problem to be solved by the invention]
[0004] Meanwhile, devices such as game devices and PCs play audio data from an externally connected playback device (such as an external speaker) or a built-in playback device (built-in speaker). Since the audio that can be played back differs depending on the performance of the playback device, the audio played back by each playback device may differ even for the same audio data. For this reason, a configuration in which the same audio data is played back regardless of the performance of the playback device may lack interest for the user.
[0005] An object of the present invention is to provide an audio playback program and an audio playback device that enhance the user's interest. [Means for solving the problem]
[0006] A first invention relates to a computer comprising: a playback unit that plays back audio data; a determination unit that determines the audio data to be reproduced by the reproduction unit; and make it work. the voice data is configured to produce a plurality of pronunciations; The determination unit is an audio playback program that determines the number of pronunciations to be reproduced by the playback unit from the audio data based on the playback device that reproduces the audio data, or determines the content of acoustic processing to be applied to the audio data.
[0007] In the first aspect, the determination unit may determine the pronunciation to be reproduced by the reproduction unit in accordance with priorities set for the plurality of pronunciations.
[0008] In the first aspect, the determination section may determine the pronunciation to be reproduced by the reproduction section, based on a volume level set for the pronunciation.
[0009] In the first aspect of the present invention, the reproduction section may emphasize a predetermined frequency band when the determination section has determined the number of voices.
[0010] A second aspect of the present invention is a method for controlling a voice reproduction program according to the first aspect of the present invention, comprising: a control unit that executes the audio playback program; The present invention is an audio playback device comprising: Effect of the Invention
[0011] According to the present invention, an audio playback program and an audio playback device that enhance the user's interest are provided. [Brief description of the drawings]
[0012] [Figure 1] FIG. 1 is a block diagram showing the configuration of a game device. [Diagram 2] 3 is a conceptual diagram of pronunciation included in the voice data according to the first embodiment. [Diagram 3] 5 is a flowchart showing the operation of the game device in the first embodiment. [Figure 4]8A to 8C are diagrams for explaining the content of reverb processing in the second embodiment. [Diagram 5] 10 is a flowchart showing the operation of a game device according to a second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] Hereinafter, a game program and a game device according to an embodiment of the present invention will be described with reference to the drawings. The sound reproducing program of the present invention is implemented as one function of the game program. The sound reproducing device is realized as the game device.
[0014] The game program described in this embodiment is executed on a game device such as a personal computer, PlayStation (registered trademark), XBox (registered trademark), or PlayStation Vita (registered trademark).
[0015] In a game based on this game program, a user character is caused to act in a three-dimensional virtual game space (hereinafter simply referred to as virtual space) in response to a user's operation, and various actions are performed on the user character's companions.
[0016] In this game, a sound is played when a predetermined trigger condition is met during the movement or action of a user character, etc. The predetermined trigger condition is, for example, the movement of a user character to a predetermined location, the appearance of an enemy character, the discovery of an item after defeating an enemy character, etc.
[0017] When the game device that executes this game is externally connected to a playback device such as a speaker, it causes the playback device to play back the audio data. When the game device is not connected to an external playback device, it causes the game device to play back the audio data through a built-in speaker. In particular, this game device changes the audio data to be played back depending on the type of playback device that plays back the audio data.
[0018] (Embodiment 1) <Game Device Configuration> 1 is a block diagram showing the configuration of a game device 5 according to this embodiment. The game device 5 executes a predetermined game based on a user's operation. A display 61, a speaker 62 (playback device), and a controller 63 are externally connected or built into the game device 5. In the game device 5, the game progresses based on the installed game program and game data.
[0019] The game device 5 has a network interface 51, a graphics processing unit 52, an audio processing unit 53, an operation unit 54, a storage unit 55, and a control unit 56. The network interface 51, the graphics processing unit 52, the audio processing unit 53, the operation unit 54, and the storage unit 55 are electrically connected to the control unit 56 via a bus 59.
[0020] The network interface 51 is communicatively connected to the communication network in order to transmit and receive various data to and from the game device 5 and an external server device (not shown), for example.
[0021] The graphics processing unit 52 renders game images including the user character and various objects related to the game space in a moving image format in accordance with game image information output from the control unit 56. The graphics processing unit 52 is connected to a display 61, and the game images rendered in a moving image format are displayed on the display 61 as a game screen.
[0022] The audio processing unit 53 reproduces and synthesizes digital game sounds according to instructions from the control unit 56. The audio processing unit 53 is connected to a speaker 62, and the reproduced and synthesized game sounds are output from the speaker 62.
[0023] As described above, the speaker 62 is externally connected to or built into the game device 5. Examples of the speaker 62 externally connected to the game device 5 include speakers configured with multiple speaker units such as those used in home theaters (hereinafter also referred to as "home theater speakers") and speakers built into a TV (hereinafter also referred to as "TV speakers"). In general, the performance increases in the order of speakers built into the game device 5 (hereinafter also referred to as "built-in speakers"), TV speakers, and home theater speakers.
[0024] The operation unit 54 is connected to the controller 63, and transmits and receives data related to operation inputs to and from the controller 63. For example, a user inputs an operation signal to the game device 5 by operating an operator (not shown) such as a button provided on the controller 63.
[0025] The storage unit 55 is composed of a HDD, a RAM, a ROM, etc. The storage unit 55 can store game programs and game data. The storage unit 55 also stores other account information received from other game devices 5, etc.
[0026] The control unit 56 is composed of a microcomputer including a CPU and a semiconductor memory, and controls the operation of the game device 5 itself. For example, the control unit 56 operates the graphics processing unit 52 and the audio processing unit 53 by executing the game program.
[0027] <Functional configuration of the control unit> The control unit 56 executes the game program, and thereby functions as a communication unit 561, a game progression unit 562, a judgment unit 563, a determination unit 564, and a reproduction unit 565.
[0028] The communication unit 561 has a function of communicating with other game devices 5 via the network interface 51. The communication unit 561 transmits to the other game devices 5 various operation signals that the operation unit 54 receives from the controller 63.
[0029] In response to user operations, the game progression unit 562 executes the game program and generates two-dimensional or three-dimensional game image information using data such as game space objects and textures included in the game data read from the storage unit 55. As the game image information is processed by the graphics processing unit 52, the processed game images are successively displayed on the display 61.
[0030] Furthermore, the game progression unit 562 causes a character operated by a user to move in a virtual space in response to an operation by the user. For example, the game progression unit 562 causes the character to move in response to an operation signal from the controller 63.
[0031] The determination unit 563 determines the type of the speaker 62 that reproduces the audio data. For example, when the speaker 62 is externally connected to the game device 5, the determination unit 563 detects a signal from the speaker 62 and determines the type of the speaker 62 (for example, a TV speaker, a home theater speaker, etc.). On the other hand, when the speaker 62 is not externally connected to the game device 5, the determination unit 563 determines that the type of the speaker 62 is a built-in speaker.
[0032] The determination unit 564 determines the number of sounds to be reproduced by the speaker 62 based on the type of the speaker 62 determined by the determination unit 563 .
[0033] 2 is a conceptual diagram of pronunciation included in the voice data in the embodiment 1. For example, suppose that a monster C1, which is a large enemy character, a monster C2, which is a medium-sized enemy character, and a monster C3, which is a small enemy character, are placed in a virtual space. Also, suppose that sound_1 to sound_3 are set as sounds to be emitted by the monsters C1 to C3, respectively, and that the priorities are set as high to low, respectively.
[0034] In this case, when the speaker 62 is a home theater speaker, the determination unit 564 determines that all of the pronunciations of sound_1 to sound_3 are to be reproduced by the reproduction unit 565. Since home theater speakers are generally high performance, even if multiple pronunciations are reproduced simultaneously, each pronunciation can be reproduced accurately. In other words, when the speaker 62 is a home theater speaker, the determination unit 564 determines that all of the pronunciations are to be reproduced by the reproduction unit 565.
[0035] Furthermore, when the speaker 62 is a TV speaker, the determination unit 564 determines sound_1 and sound_2, excluding sound_3, which is a pronunciation with a low priority, as the pronunciations to be reproduced by the reproduction unit 565. When a large number of pronunciations are reproduced simultaneously by a TV speaker, some pronunciations may overlap with other pronunciations, making it impossible to reproduce each pronunciation accurately. For this reason, when the speaker 62 is a TV speaker, the determination unit 564 determines other pronunciations, excluding the pronunciations with a low priority, from the audio data as the pronunciations to be reproduced by the reproduction unit 565.
[0036] Furthermore, when the speaker 62 is a built-in speaker, the determination unit 564 determines that only the pronunciation with high priority, sound_1, is to be reproduced by the reproduction unit 565. Built-in speakers generally have low performance and often can only produce a small number of pronunciations at the same time. For this reason, when the speaker 62 is a built-in speaker, the determination unit 564 determines that only the pronunciation with high priority is to be reproduced by the reproduction unit 565 from the voice data.
[0037] The reproducing unit 565 reproduces the voice data based on the pronunciation (number of pronunciations) determined by the determining unit 564.
[0038] (Game device operation) A series of operational flows in the game device will be described with reference to Figures 1 to 3. Figure 3 is a flow chart showing the operation of the game device 5.
[0039] First, the determination unit 563 determines the type of the speaker 62 that reproduces the audio data (step S1). Specifically, when the speaker 62 is externally connected to the game device 5, the determination unit 563 communicates with the speaker 62 and determines the type of the speaker 62 (for example, a TV speaker, a home theater speaker, etc.). On the other hand, when the speaker 62 is not externally connected to the game device 5, the determination unit 563 determines that the type of the speaker 62 is a built-in speaker.
[0040] The determination unit 564 determines the number of sounds to be reproduced by the speaker 62 based on the type of the speaker 62 determined by the determination unit 563 (step S2).
[0041] 2, when the speaker 62 is a home theater speaker, the determination unit 564 determines all of the pronunciations sound_1 to sound_3 as the pronunciations to be reproduced by the playback unit 565. When the speaker 62 is a TV speaker, the determination unit 564 determines sound_1 and sound_2, excluding sound_3 which is a pronunciation with a low priority, as the pronunciations to be reproduced by the playback unit 565. When the speaker 62 is a built-in speaker, the determination unit 564 determines only sound_1 which is a pronunciation with a high priority as the pronunciation to be reproduced by the playback unit 565.
[0042] The reproducing unit 565 reproduces the voice data based on the pronunciation determined by the determining unit 564 (step S3).
[0043] To summarize the above, the game program of this embodiment causes the game device 5 (computer) to function as a playback unit 565 that plays back audio data and a determination unit 564 that determines the audio data to be played by the playback unit 565, the audio data being configured to produce a plurality of pronunciations sound_1 to sound_3, and the determination unit 564 determines the number of pronunciations to be played by the playback unit 565 from the audio data based on the speaker 62 (playback device) that plays back the audio data.
[0044] <Effects of the Invention> As described above, the determination unit 564 determines the number of pronunciations to be reproduced by the reproduction unit 565 from the audio data based on the speaker 62 that reproduces the audio data. For example, if the performance of the speaker 62 is low, the determination unit 564 determines the number of pronunciations to be reproduced so as to reduce the number of pronunciations, thereby allowing the speaker 62 to accurately reproduce sounds. This can improve the user's interest.
[0045] Furthermore, the determination unit 564 determines the pronunciation to be reproduced by the reproduction unit 565 according to the priorities set for the multiple pronunciations sound_1 to sound_3. By setting a high priority to a pronunciation that is important for game play (for example, the sound of a boss monster), it is possible to increase the user's interest.
[0046] (Embodiment 2) In the first embodiment, the determination unit 564 determines the number of sounds to be reproduced by the speaker 62 based on the type of the speaker 62, but in the second embodiment, the determination unit 564 determines the content of the acoustic processing to be performed on the audio data based on the type of the speaker 62. Note that in this embodiment, a case in which reverberation processing is performed based on the type of the speaker 62 will be described as an example.
[0047] Fig. 4 is a diagram for explaining acoustic processing applied to audio data. Fig. 4(a) to (c) show the state of audio data reproduced based on the type of speaker 62. Fig. 4(a) to (c) show the cases where the speaker 62 is a home theater speaker, a TV speaker, and a built-in speaker, respectively.
[0048] As shown in FIG. 4(a), when the speaker 62 is a home theater speaker, the audio data to which impact-emphasizing bass, which is an audio for emphasizing bass, has been added is subjected to home theater reverb processing (processing load: high), and then the audio data is played from the speaker 62.
[0049] Since the home theater speaker has multiple speaker units, it is possible to reproduce different sounds from each speaker unit. Therefore, the determination unit 564 determines to perform reverb processing (home theater reverb processing) with a high processing load on the audio data reproduced from each speaker unit. This makes it possible to provide the user with a realistic sound.
[0050] 4(b), when the speaker 62 is a TV speaker, standard reverb processing (processing load: medium) is applied to the audio data, and then the audio data is reproduced from the speaker 62. That is, when the speaker 62 is a TV speaker, the determination unit 564 determines to apply standard reverb processing (standard reverb processing) to the audio data.
[0051] As shown in FIG. 4(c), when the speaker 62 is a built-in speaker, the audio data is subjected to treble emphasis effect processing and built-in speaker reverb processing (processing load: low) before being played back from the speaker 62.
[0052] For example, built-in speakers have inferior performance to home theater speakers and TV speakers, so the audio that can be accurately reproduced is limited. Therefore, the determination unit 564 performs effect processing that emphasizes the high-frequency range (high-frequency emphasis effect processing) on the audio data, and then determines to perform reverb processing (reverb processing for built-in speakers) with a low processing load according to the characteristics of the built-in speakers. This makes it possible to reproduce audio data suitable for the built-in speakers.
[0053] (Game device operation) Fig. 5 is a flow chart showing the operation of the game device 5 in this embodiment. In Fig. 5, compared to Fig. 3, step S4 is performed instead of step S2.
[0054] In step S 4 , the determination unit 564 determines the content of the reverb processing to be performed on the audio data based on the type of the speaker 62 .
[0055] In Fig. 4, when the speaker 62 is a home theater speaker, the determination unit 564 determines to perform home theater reverb processing (processing load: high) on the audio data to which the impact emphasis bass has been added. When the speaker 62 is a TV speaker, the determination unit 564 determines to perform standard reverb processing (processing load: medium) on the audio data. The determination unit 564 determines to perform treble emphasis effect processing and built-in speaker reverb processing (processing load: low) on the audio data.
[0056] To summarize the above, the game program of this embodiment causes the game device 5 (computer) to function as a playback unit 565 that plays back audio data and a determination unit 564 that determines the audio data to be played by the playback unit 565, the audio data being configured to produce multiple pronunciations, and the determination unit 564 determines the content of reverb processing (acoustic processing) to be applied to the audio data.
[0057] <Effects of the Invention> As described above, the determination unit 564 determines the content of the reverb processing to be applied to the audio data based on the speaker 62 that reproduces the audio data. For example, by applying reverb processing to the audio data according to the characteristics of the speaker 62, the audio data can be reproduced according to the characteristics of the speaker. This can improve the user's interest.
[0058] [Other embodiments] In the first embodiment, the determination unit 564 determines the pronunciation to be reproduced based on the priority set for each pronunciation, but is not limited to this. For example, the determination unit 564 may determine the pronunciation to be reproduced by the reproduction unit 565 based on the volume set for the pronunciation.
[0059] Specifically, the determination unit 564 determines a pronunciation with a high volume as the pronunciation to be reproduced by the reproduction unit 565 with priority. For example, large monsters are often boss monsters, and a high volume is set for the pronunciation of large monsters. This allows pronunciations important to game play (such as the voice of a boss monster) to be reproduced with priority, thereby improving the interest of the user. Note that the volume set for a pronunciation may change depending on the state (anger, sleep, etc.) of the monster (character) that emits the pronunciation.
[0060] Furthermore, when the determination unit 564 determines the number of sounds to be generated, the reproduction unit 565 may emphasize a predetermined frequency band. For example, when the speaker 62 is a home theater speaker, the reproduction unit 565 emphasizes the low frequency range. This makes it possible to obtain a powerful sound effect. This can improve the user's interest.
[0061] In the second embodiment, the acoustic processing is reverberation processing, but the present invention is not limited to this. The acoustic processing may be, for example, reverberation processing, a process for emphasizing or attenuating a specific frequency band, a process for distorting audio, or other effect processing.
[0062] In the above embodiment, the speaker 62 is a home theater speaker, a TV speaker, or a built-in speaker, but the present invention is not limited to this. The speaker 62 may be any type that is externally connected to or built into the game device 5, and the determination unit 564 may determine the number of sounds to be generated and the content of the sound processing according to the characteristics of the speaker 62.
[0063] Moreover, the speaker 62 does not necessarily have to be built into the game device 5, but may be externally connected to the game device 5.
[0064] Furthermore, when a plurality of speakers 62 are connected to the game device 5, the playback unit 565 (or the determination unit 564) may select the speaker 62 that will play back the audio data in accordance with a predetermined priority. This priority may be set by the user or may be set in advance. Furthermore, when the priority of the built-in speaker is set higher than that of the externally connected speaker, the playback unit 565 (or the determination unit 564) preferentially plays back the audio data from the built-in speaker.
[0065] Furthermore, the game executed by the game device 5 may be of any genre, such as an adventure game, an action game, an FPS (First Person Shooter), a racing game, a sports game, an RPG (Role Playing Game), or a shooting game.
[0066] The game program may be implemented as a game program for a so-called online game. When the game program is for an online game, the processing performed by the control unit 56 may be performed by the server side instead, or may be shared between the server side and the client (game device 5). In this case, an authentication server and a matching server may be provided in the game system including the game device 5, and user matching may be performed in response to a request from the game device 5.
[0067] In the above embodiment, the game device 5 is a personal computer, a PlayStation, or the like, but the type of the game device 5 is not limited to this. For example, the game device 5 may be a smartphone, a tablet, or an arcade game cabinet provided in a game center.
[0068] Furthermore, the game device 5 of the above embodiment can be applied to a playback device that plays video content such as movies, animations, etc. In this case, the determination unit 564 may determine the number of sounds to be played back or the content of the acoustic processing to be applied to the audio data according to the type of the playback device.
[0069] Even when these other embodiments are adopted, the effects of the present invention are exhibited. In addition, this embodiment can be appropriately combined with other embodiments, and other embodiments can be appropriately combined with each other. It is. [Explanation of symbols]
[0070] 5. Gaming Devices 53 Audio Processing Unit 55 Storage section 56 Control section 561 Communications Department 562 Game Progression Department 563 Judgment section 564 Decision Section 565 Playback Department 62 Speaker
Claims
1. Computer, a playback unit that plays back audio data; a determination unit that determines the audio data to be reproduced by the reproduction unit; a determination unit for determining a type of speaker that reproduces the audio data; and make it work. the audio data is configured to simultaneously reproduce a plurality of pronunciations; When the determination unit determines that the type of the speaker is a high-performance speaker, the determination unit causes the playback unit to play back all pronunciations of the voice data, or processes the voice data so as to increase the processing load on the speaker. When the determination unit determines that the type of the speaker is a low-performance speaker, the determination unit causes the playback unit to play back only a portion of the pronunciations of the voice data, or processes the voice data so as to reduce the processing load on the speaker. The determination unit determines whether the type of the speaker is a high-performance speaker or a low-performance speaker based on the number of sounds that can be simultaneously reproduced by the speaker.
2. In claim 1, The determination unit determines the pronunciation to be reproduced by the reproduction unit in accordance with priorities set for the multiple pronunciations.
3. In claim 1 or 2, The determination unit determines the pronunciation to be reproduced by the reproduction unit based on a volume set for the pronunciation.
4. In any one of claims 1 to 3, An audio playback program, wherein the playback unit plays back the audio data to emphasize low-frequency sounds when the determination unit determines that the speaker type is a high-performance speaker, and plays back the audio data to emphasize high-frequency sounds when the determination unit determines that the speaker type is a low-performance speaker.
5. A storage unit that stores the audio playback program according to any one of claims 1 to 4; a control unit that executes the audio playback program; An audio playback device comprising:
Citation Information
Patent Citations
Binaural Signal Synthesis, Head-Related Transfer Functions and Their Applications
JP1998500809A
View position switching and sound change in game machine
JP2002346210A
Game sound control program, game sound control method, and game device
JP2004195210A
Game device, control method of computer and program
JP2005046270A
Sound output system, sound output method, and program
JP2007037728A