Game sound effect production system, method, medium, terminal device and audio production end

Abstract

The present disclosure relates to a game sound effect production system, method, medium, terminal device and audio production terminal, and relates to the technical field of audio, which generates game sound effects on the audio production terminal, and sends the game sound effects in the original audio format to the terminal device. The terminal device receives the game sound effects in the original audio format sent by the audio production terminal, can directly play the game sound effects with the original audio format of the panorama sound on the terminal device, does not need to package the game sound effects for multiple times, greatly shortens the production period of the game sound effects of the panorama sound. Moreover, by transmitting the game sound effects in the original audio format, the original quality of the game sound effects of the panorama sound can be maintained, so that the real playing effect of the game sound effects can be perfectly presented in the terminal device.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the field of audio technology, in particular to a game sound effect production system, method, medium, terminal device and audio production end. BACKGROUND

[0002] The ambisonics can be combined with the game picture to present a dynamic sound effect, more realistically create a sound effect from far to near, and show more sound details to improve the game experience of the game player. With the game sound effect of ambisonics being applied to the game scene more and more, how to quickly produce suitable ambisonics game sound effect becomes a technical problem to be solved. SUMMARY

[0003] This summary is provided to introduce a selection of concepts, which are further described below in the detailed description. This summary is not intended to identify key or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.

[0004] In a first aspect, the embodiments of the present disclosure provide a game sound effect production system, comprising:

[0005] An audio production end configured to generate a game sound effect of ambisonics, and send the game sound effect in an original audio format to a terminal device, wherein the original audio format is an audio format of ambisonics without encoding;

[0006] The audio production end is further configured to receive feedback information, and adjust the game sound effect according to the feedback information.

[0007] The terminal device is configured to receive the game sound effect sent by the audio production end, and play the game sound effect, so as to determine the feedback information according to the playing effect of the game sound effect and send the feedback information to the audio production end.

[0008] In a second aspect, the embodiments of the present disclosure provide a game sound effect production method, comprising:

[0009] Controlling an audio production end to generate a game sound effect of ambisonics, and sending the game sound effect in an original audio format to a terminal device, wherein the original audio format is an audio format of ambisonics without encoding;

[0010] Controlling the terminal device to receive the game sound effect sent by the audio production end, and play the game sound effect, so as to determine feedback information according to the playing effect of the game sound effect.

[0011] Controlling the audio production end to adjust the game sound effect according to the feedback information.

[0012] In a third aspect, the embodiments of the present disclosure provide a game sound effect production method applied to a terminal device, and the method comprises the following steps:

[0013] receiving a game sound effect in an original audio format sent by an audio production end, wherein the original audio format is an audio format of unencoded ambisonics;

[0014] playing the game sound effect to determine feedback information according to a playing effect of the game sound effect, wherein the feedback information is used to make the audio production end adjust the game sound effect according to the feedback information.

[0015] In a fourth aspect, the embodiments of the present disclosure provide a game sound effect production method applied to an audio production end, and the method comprises the following steps:

[0016] generating a game sound effect of ambisonics;

[0017] sending the game sound effect in an original audio format to a terminal device, wherein the game sound effect is used to be played on the terminal device to make the terminal device determine feedback information according to a playing effect of the game sound effect, and the feedback information is used to make the audio production end adjust the game sound effect according to the feedback information, and the original audio format is an audio format of unencoded ambisonics.

[0018] In a fifth aspect, the present disclosure provides a computer-readable storage medium having a computer program stored thereon, and the program is executed by a processing device to implement the method in the third aspect or the method in the fourth aspect.

[0019] In a sixth aspect, the embodiments of the present disclosure provide a terminal device, and the terminal device comprises the following steps:

[0020] a storage device having a computer program stored thereon;

[0021] a processing device configured to execute the computer program in the storage device to implement the method in the third aspect.

[0022] In a seventh aspect, the present disclosure provides an audio production end, and the audio production end comprises the following steps:

[0023] a storage device having a computer program stored thereon;

[0024] a processing device configured to execute the computer program in the storage device to implement the method in the fourth aspect.

[0025] Based on the above technical solution, the audio production end sends the game sound effects in the original audio format to the terminal device, and the terminal device receives the game sound effects in the original audio format sent by the audio production end. This can directly play the panoramic sound game sound effects in the original audio format on the terminal device, eliminating the need to package the game sound effects multiple times, greatly shortening the production cycle of panoramic sound game sound effects. Moreover, by transmitting the game sound effects in the original audio format, the original quality of the panoramic sound game sound effects can be maintained, so that the terminal device can perfectly present the realistic playback effect of the game sound effects.

[0026] Other features and advantages of the present disclosure will be described in detail in the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The above and other features, advantages and aspects of the various embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that the originals and elements are not necessarily drawn to scale. In the drawings:

[0028] Figure 1 1 is a schematic diagram of the structure of a game sound effect production system according to some embodiments.

[0029] Figure 2 2 is a schematic diagram of the structure of a game sound effect production system according to other embodiments.

[0030] Figure 3 The present invention is a schematic diagram showing a process of producing game sound effects according to some embodiments.

[0031] Figure 4 is a flowchart of a method for producing game sound effects according to some embodiments.

[0032] Figure 5 is a flowchart of a method for producing game sound effects according to other embodiments.

[0033] Figure 6 is a flowchart of a method for producing game sound effects according to some further embodiments.

[0034] Figure 7 This is a schematic diagram of module connections of a game sound effect production device according to some embodiments.

[0035] Figure 8 2 is a schematic diagram of module connections of a game sound effect production device according to other embodiments.

[0036] Figure 9 is a schematic structural diagram of an electronic device according to some embodiments. DETAILED DESCRIPTION

[0037] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be embodied in various forms and should not be interpreted as being limited to the embodiments set forth herein; rather, these embodiments are provided so that the present disclosure can be more thoroughly and completely understood.

[0038] It should be understood that each of the steps recited in the method embodiments of the present disclosure can be performed in different orders and / or in parallel. In addition, the method embodiments can include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0039] The term “comprising” and variations thereof as used herein are open-ended, that is, “comprising but not limited to.” The term “based on” means “based, at least in part, on.” The term “one embodiment” means “at least one embodiment.” The term “another embodiment” means “at least one additional embodiment.” The term “some embodiments” means “at least some embodiments.” Related definitions are given below.

[0040] It should be noted that the terms “first”, “second”, and the like in the present disclosure are merely used to distinguish different devices, modules or units, and do not imply the order or interdependence of the functions performed by these devices, modules or units.

[0041] It should be noted that the terms “one”, “multiple” in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that “one or more” should be understood unless otherwise explicitly stated in the context.

[0042] The names of the messages or information exchanged between the devices in the embodiments of the present disclosure are merely for illustrative purposes, and are not intended to limit the scope of the messages or information.

[0043] When the game sound effects of the ambisonics are played on different platforms and different types of terminal devices, different virtual loudspeaker algorithms and binaural stereo algorithms are used, resulting in the game sound effects of the ambisonics played on the terminal devices being inconsistent with the effects of the game sound effects when produced.

[0044] In the related art, the process of producing panoramic sound game sound effects is generally to produce panoramic sound game sound effects in the software, and export the produced panoramic sound game sound effects to form an audio file. Then, the audio file is imported into the audio middleware of the game for packaging to form an audio package file, and the audio package file is input into the game engine for re-packaging to form a game package file. Finally, the game package file is sent to different terminal devices, and the game sound effects are played on different terminal devices to determine whether the game sound effects in the software need to be modified based on the playback effect. It can be seen that when producing panoramic sound game sound effects, the audio files need to be packaged multiple times, which makes the entire production process of panoramic sound game sound effects very lengthy, reducing production efficiency.

[0045] It is precisely in response to the above-mentioned technical problems that the present disclosure proposes a game sound effect production system, method, medium, terminal device and audio production end, which generates panoramic sound game sound effects in the audio production end and sends the game sound effects in the original audio format to the terminal device. The terminal device receives the game sound effects in the original audio format sent by the audio production end and plays the game sound effects. According to the playback effect of the game sound effects, feedback information is determined, and the feedback information is sent to the audio production end, so that the audio production end adjusts the game sound effects in the audio production end according to the feedback information. Based on the game audio production system proposed in the present disclosure, the audio production end can directly send the game sound effects in the original audio format to the terminal device without multiple packaging, which greatly shortens the production cycle of the panoramic sound game sound effects. Moreover, by transmitting the panoramic sound game sound effects in the original audio format to the terminal device, the most original panoramic sound format can be retained, so that when the game sound effects are played on the terminal device, the real effect of the game sound effects produced in the audio production end can be displayed.

[0046] Figure 1 FIG. 1 is a schematic diagram of a system for producing game sound effects according to some embodiments. Figure 1 As shown, the game sound effect production system proposed in the embodiment of the present disclosure includes an audio production terminal 110 and a terminal device 120.

[0047] The audio production end 110 is configured to generate panoramic sound game sound effects and send the game sound effects in original audio format to the terminal device 120, wherein the original audio format is an unencoded panoramic sound audio format.

[0048] The terminal device 120 is configured to receive the game sound effects sent by the audio production terminal 110 and play the game sound effects, so as to determine feedback information based on the playing effect of the game sound effects and send it to the audio production terminal 110.

[0049] The audio production terminal 110 is further configured to receive the feedback information sent by the terminal device 120, and adjust the game sound effect according to the feedback information.

[0050] Here, the audio production terminal 110 can refer to a device for producing the game sound effect of the ambisonics, and the terminal device 120 can refer to a terminal for running the game. When producing the game sound effect, in order to test the playing effect of the produced game sound effect on the terminal device 120, after the audio production terminal 110 generates the game sound effect of the ambisonics, the audio production terminal 110 sends the game sound effect in the original audio format to the terminal device 120.

[0051] It should be noted that the original audio format refers to the audio format of the ambisonics that has not been encoded. The original audio format is the format of the game sound effect of the ambisonics produced on the audio production terminal 110, rather than the game sound effect of the ambisonics encoded and output by the audio production terminal 110.

[0052] For example, taking a digital audio workstation (DAW) as an example, the game sound effect of “7.1.4 channel format, 12 tracks” is produced in the digital audio workstation, and the game sound effect of “7.1.4 channel format, 12 tracks” is the original audio format of the game sound effect. However, when the digital audio workstation outputs the game sound effect, the game sound effect of “7.1.4 channel format, 12 tracks” is encoded into an audio file for output. For example, the game sound effect of “7.1.4 channel format, 12 tracks” is encoded into an audio file in a Dolby encoding manner. At this time, the audio file output by the audio production terminal 110 is no longer the original audio format of “7.1.4 channel format, 12 tracks”. For the audio file, when the terminal device 120 decodes the audio file, the audio file will be decoded into 2-track stereo sound, rather than the sound of “7.1.4 channel format, 12 tracks”.

[0053] The digital audio workstation can include Pro Tools, Logic Pro, Reaper, and the like.

[0054] In the embodiment of the present disclosure, the audio production terminal 110 sends the game sound effect in the original audio format to the terminal device 120. For example, the original audio format of the game sound effect of the ambisonics produced on the audio production terminal 110 is “7.1.4 channel format, 12 tracks”, and the audio production terminal 110 sends the game sound effect of “7.1.4 channel format, 12 tracks” to the terminal device 120. It should be understood that the ambisonics involved in the embodiment of the present disclosure can be Dolby ambisonics.

[0055] The terminal device 120 receives the game sound effect in the original audio format sent by the audio production end 110, plays the game sound effect, and determines feedback information according to a playing effect. The terminal device 120 sends the feedback information to the audio production end 110, so that the audio production end 110 adjusts the game sound effect in the audio production end 110 according to the feedback information, and obtains a produced game sound effect. It should be understood that the produced game audio is used to be deployed in the terminal device 120 to provide the best game sound effect experience for the game running on the terminal device 120.

[0056] The terminal device 120 actually plays the game sound effect by playing back the game sound effect. The game sound effect produced in the audio production end 110 is sent to the terminal device 120 by the audio production end 110 in the original audio format. The terminal device 120 receives the game sound effect in the original audio format and plays back the game sound effect to realize the playing of the game sound effect.

[0057] It should be noted that the terminal device 120 can receive the game sound effect in the original audio format sent by the audio production end 110 through a communication connection between the terminal device 120 and the audio production end 110. For example, the communication connection can be a local area network communication connection.

[0058] Therefore, the audio production end 110 sends the game sound effect in the original audio format to the terminal device 120, and the terminal device 120 receives the game sound effect in the original audio format sent by the audio production end 110, so that the game sound effect with the original audio format can be directly played on the terminal device 120 without multiple packaging of the game sound effect, which greatly shortens the production cycle of the game sound effect with the original audio format. Moreover, by transmitting the game sound effect in the original audio format, the original quality of the game sound effect with the original audio format can be maintained to perfectly present the real playing effect of the game sound effect in the terminal device 120.

[0059] In some implementable embodiments, the audio production end is configured to send the game sound effect in the original audio format to the terminal device in the form of an audio stream.

[0060] The terminal device is configured to receive the game sound effect in the original audio format sent by the audio production end in the form of an audio stream.

[0061] Here, the audio production end is configured to send the game sound effect in the original audio format to the terminal device in the form of an audio stream, and the terminal device receives the game sound effect in the original audio format sent by the audio production end in the form of an audio stream.

[0062] The terminal device receives the game sound effects in the form of audio stream transmitted by the audio production end, so that the audio production end can transmit the game sound effects in the original audio format to the terminal device without encoding the game sound effects produced on the audio production end into an audio file.

[0063] For example, when the audio production end includes a digital audio workstation, the ambisonic game sound effects in the format of "7.1.4 channels and 12 tracks" are produced in the digital audio workstation, and the ambisonic game sound effects in the format of "7.1.4 channels and 12 tracks" are transmitted to the terminal device in the form of audio stream, so that the transmitted ambisonic game sound effects can always maintain the original audio format of "7.1.4 channels and 12 tracks".

[0064] It is worth noting that the form of audio stream can be a local area network audio stream, that is, the terminal device and the audio production end are connected through a local area network, and the audio production end transmits the game sound effects in the original audio format to the terminal device in the form of audio stream through the local area network.

[0065] Therefore, by transmitting the game sound effects to the terminal device in the form of audio stream, the terminal device can directly obtain the game sound effects produced on the audio production end and maintaining the original audio format.

[0066] Figure 2 is a structural schematic diagram of a game sound effect production system according to another embodiment. As Figure 2 shown, the game sound effect production system proposed by the embodiment of the present disclosure includes an audio production end 210 and a terminal device 220. The audio production end 210 includes a digital audio workstation 211, a monitoring plug-in 212, and a first communication module 213. The digital audio workstation 211 is configured to generate game sound effects in the original audio format and convert the game sound effects into a first audio stream. The monitoring plug-in 212 is configured to sample the first audio stream in the original audio format and obtain a sampling signal. The first communication module 213 is configured to convert the sampling signal into a communication signal and output the communication signal. The terminal device 220 includes a second communication module 221, a sound source plug-in 222, an audio middleware 2231, and an ambisonic game plug-in 2232. The second communication module 221 is configured to receive the communication signal sent by the first communication module 213. The sound source plug-in 222 is configured to convert the communication signal into a second audio stream. The playback module 223 is configured to play the second audio stream.

[0067] Here, the audio parameter setting of the game sound effect of the ambisonics can be configured in the digital audio workstation 211 to generate the game sound effect in the original audio format. Then, the digital audio workstation 211 plays the game sound effect to form a first audio stream. The first audio stream is the data before reaching the sound card of the audio production end 210. Since the first audio stream has not been played back by the sound card, the first audio stream can still maintain the original audio format, such as maintaining the original audio format of 7.1.4 ambisonics.

[0068] The monitor plugin 212 is configured to sample the first audio stream in the original audio format, which means that the monitor plugin 212 can record the audio signal output by the digital audio workstation 211 according to the preset audio format to form a sample signal. In use, the monitor plugin 212 can be configured to sample the audio stream in a certain channel and / or track order. In the monitor plugin 212, the channel of the sampled audio stream can be defined as 7.1.4 or 5.1.2, etc. For example, the track arrangement order can be defined as LCR or LRC, etc. It should be noted that by sampling the first audio stream through the monitor plugin 212, the audio format of the sample signal obtained can be consistent with the original audio format of the game sound effect, so that the audio production end 210 can directly output the game sound effect in the original audio format. For example, if the original audio format of the game sound effect produced in the digital audio workstation 211 is “7.1.4 channels, 12 tracks”, the monitor plugin 212 is configured to sample the first audio stream in the audio format of “7.1.4 channels, 12 tracks”, and the sample signal obtained can also maintain the audio format of “7.1.4 channels, 12 tracks”.

[0069] It should be understood that in the audio production end 210, if the monitor plugin 212 is not used to sample the first audio stream, the first audio stream enters the sound card of the audio production end 210 and is played back by the sound card, and then played on the audio production end 210. By using the monitor plugin 212 to sample the first audio stream, the original audio format of the game sound effect is actually outputted by the monitor plugin 212, rather than being played back by the sound card of the audio production end 210.

[0070] In some embodiments, the monitor plugin 212 can be a plugin of the digital audio workstation 211, and the monitor plugin 212 can include VST, VST3, AU, AAX, etc. plugin formats.

[0071] After the monitoring plug-in 212 samples the first audio stream to obtain a sampled signal, the monitoring plug-in 212 outputs the sampled signal to the first communication module 213. The first communication module 213 performs communication encoding on the sampled signal to obtain a communication signal and transmits the communication signal to an external device.

[0072] The terminal device 220 receives the communication signal sent by the audio production end 210 through the first communication module 213 through the second communication module 221, and sends the communication signal to the sound source plug-in 222 (Source Plugin). The sound source plug-in 222 converts the received communication signal into a second audio stream and transmits the second audio stream to the playback module 223. The playback module 223 then plays the second audio stream to realize the playback of the panoramic sound game sound effects produced on the audio production end 210 on the terminal device 220.

[0073] The audio source plug-in 222 actually uses the received communication signal as a signal source and plays the signal source to generate a second audio stream. It should be understood that the audio format of the second audio stream is consistent with the audio format of the first audio stream, and both are the original audio formats corresponding to the panoramic sound game sound effects produced on the audio production terminal 210.

[0074] Therefore, through the monitoring plug-in 212 and the sound source plug-in 222, the game sound effects on the audio production end 210 can be maintained in their original audio format and sent to the terminal device 220, so that the game sound effects in the original audio format can be played on the terminal device 220 without packaging the game sound effects on the audio production end 210 into an audio file, and the game sound effects produced on the audio production end 210 can be played in real time on the terminal device 220.

[0075] like Figure 2 As shown, in some feasible implementations, the playback module 223 may include an audio middleware 2231, which is configured to receive a second audio stream sent by the sound source plug-in 222 and play the second audio stream through the panoramic sound game plug-in 2232.

[0076] Here, after the terminal device 220 receives the communication signal sent by the audio production end 210 through the second communication module 221, the sound source plug-in 222 restores the communication signal to a second audio stream, and passes the second audio stream to the audio middleware 2231, and controls the audio middleware 2231 to call the panoramic sound game plug-in 2232 to play the second audio stream, so as to realize the playback of the game sound effects produced on the audio production end 210 on the terminal device 220.

[0077] Among them, the audio middleware 2231 is used to control the playback logic of the sound and / or perform mixing operations on the sound. Through the audio middleware 2231, the playback effect of the panoramic sound game sound effects in the game environment can be simulated without the need to build the game sound effects into the complete game file for playback. In some embodiments, the audio middleware 2231 can be Wwise (an audio engine). The panoramic sound game plug-in 2232 is used to play the second audio stream of the panoramic sound. The panoramic sound game plug-in 2232 can be a Dolby Atmos game plug-in 2232. Through the Dolby Atmos game plug-in 2232, game sound effects with Dolby Atmos effects can be broadcast on the terminal device 220.

[0078] It is worth noting that the sound source plug-in 222, the audio middleware 2231 and the panoramic sound game plug-in 2232 can be set as a specific software module, which can support running on different platforms.

[0079] Therefore, through the audio middleware 2231 and the panoramic sound game plug-in 2232, the game environment can be simulated on the terminal device 220, and the panoramic sound game sound effects produced on the audio production end 210 can be played in the simulated game environment. According to the playback effect of the panoramic sound game sound effects, the game sound effects on the audio production end 210 can be adjusted, thereby realizing the rapid production of panoramic sound game sound effects.

[0080] The following is combined with Figure 3 The above embodiments are described in detail.

[0081] Figure 3 FIG. 1 is a flow chart showing a process of producing game sound effects according to some embodiments. Figure 3 As shown, audio parameter settings for panoramic game sound effects can be configured in the digital audio workstation 311 of the audio production terminal 310 to generate game sound effects in the original audio format. The digital audio workstation 311 then plays the generated game sound effects and outputs a first audio stream. The monitoring plug-in 312 samples the first audio stream in the original audio format to form a sampled signal, and transmits the sampled signal to the first communication module 313. The first communication module 313 converts the sampled signal into a communication signal and transmits it to the terminal device 320. The terminal device 320 receives the communication signal sent by the first communication module 313 via the second communication module 321 and transmits the communication signal received by the second communication module 313 to the sound source plug-in 322. The sound source plug-in 322 converts the communication signal into a second audio stream and transmits the second audio stream to the audio middleware 3231 in the playback module 323. The audio middleware 3231 calls the panoramic game plug-in to play the second audio stream, enabling the panoramic game sound effects produced by the audio production terminal 310 in the original audio format to be played on the terminal device 320.

[0082] In the process that the playing module 323 plays the game sound effect, the terminal device 320 determines feedback information according to the playing effect of the game sound effect through the determining module 324, and transmits the feedback information to the audio production end 310, so that the audio production end 310 adjusts the ambisonic game sound effect produced in the digital audio workstation according to the feedback information until the effect of the game sound effect played on the terminal device 320 meets the preset condition, and the production of the ambisonic game sound effect is completed.

[0083] It should be noted that the determining module 324 can record the game sound effect played by the playing module 323, obtain the recorded audio, and then determine the feedback information according to the sound characteristic information of the recorded audio. The sound characteristic information includes time domain characteristics and spectrum characteristics of the recorded audio, etc. The feedback information can be sound characteristic information, or audio parameter settings obtained according to the sound characteristic information. Through the feedback information, the audio parameter settings of the game sound effect in the digital audio workstation 311 can be adjusted, so that the sound characteristic information obtained by the determining module 324 when the adjusted game sound effect is played in the terminal device 320 can meet the preset condition.

[0084] In addition, it should be understood that the feedback information can be sent to the audio production end 310 through the second communication module 321, or can be directly sent to the audio production end 310 through other ways, for example, the feedback information is directly input in the audio production end 310.

[0085] Figure 4 The flowchart shown in FIG. 4 is a game sound effect production method according to some embodiments. As shown in FIG. 4, the game sound effect production method is applied to the game sound effect production system shown in FIG. 3, and the method can include the following steps. Figure 4 Figure 1

[0086] Step 410, controlling the audio production end to generate an ambisonic game sound effect, and sending the game sound effect in an original audio format to a terminal device, wherein the original audio format is an audio format of the ambisonic game sound effect without being encoded;

[0087] Step 420, controlling the terminal device to receive the game sound effect sent by the audio production end, and playing the game sound effect, so as to determine feedback information according to the playing effect of the game sound effect;

[0088] Step 430, controlling the audio production end to adjust the game sound effect according to the feedback information.

[0089] Optionally, the step of sending the game sound effect in the original audio format to the terminal device includes:

[0090] ​​controlling the audio production end to send the game sound effect in the original audio format to the terminal device in the form of an audio stream;

[0091] The receiving the game sound effect sent by the audio production end comprises:

[0092] controlling the terminal device to receive the game sound effect in the original audio format sent by the audio production end in the form of an audio stream.

[0093] Optionally, the method comprises:

[0094] controlling a digital audio workstation of the audio production end to generate the game sound effect in the original audio format and convert the game sound effect into a first audio stream;

[0095] controlling a monitoring plug-in of the audio production end to sample the first audio stream in the original audio format to obtain a sampling signal;

[0096] controlling a first communication module of the audio production end to convert the sampling signal into a communication signal and output the communication signal;

[0097] controlling a second communication module of the terminal device to receive the communication signal sent by the first communication module;

[0098] controlling a sound source plug-in of the terminal device to convert the communication signal into a second audio stream;

[0099] controlling a playing module of the terminal device to play back the second audio stream.

[0100] Optionally, the controlling the playing module of the terminal device to play back the second audio stream comprises:

[0101] controlling an audio middleware of the terminal device to receive the second audio stream sent by the sound source plug-in and play back the second audio stream through a surround sound game plug-in.

[0102] As to the method in the above-mentioned embodiments, the specific implementation of each step has been described in detail in the embodiments of the game sound effect production system, and thus will not be described in detail here.

[0103] Figure 5 is a flowchart of a game sound effect production method according to some other embodiments. As shown in Figure 5 The present disclosure provides a game sound effect production method, which can be executed by a terminal device, specifically, by a game sound effect production apparatus, which can be implemented in software and / or hardware and configured in the terminal device. As shown in Figure 5 The method can comprise the following steps.

[0104] Step 510: Receive the game sound effects in the original audio format sent by the audio production end, wherein the original audio format is an unencoded panoramic sound audio format.

[0105] Step 520: Play the game sound effect to determine feedback information based on the playing effect of the game sound effect, wherein the feedback information is used to enable the audio production end to adjust the game sound effect according to the feedback information.

[0106] Optionally, receiving the game sound effect in the original audio format sent by the audio production end includes:

[0107] Receive the game sound effect in the original audio format sent by the audio production end in the form of an audio stream.

[0108] Optionally, the receiving the game sound effect in the original audio format sent by the audio production end in the form of an audio stream includes:

[0109] Receive a communication signal sent by the audio production end, and convert the communication signal into a second audio stream through a sound source plug-in, wherein the communication signal is obtained by the audio production end based on a sampling signal obtained by a monitoring plug-in, and the sampling information is obtained by the monitoring plug-in sampling a first audio stream of a game sound effect output by a digital audio workstation in an original audio format.

[0110] Optionally, playing the game sound effect includes:

[0111] Sending the second audio stream to the audio middleware;

[0112] The audio middleware is controlled to call the panoramic sound game plug-in to play the second audio stream.

[0113] Regarding the method in the above embodiment, the specific implementation of each step has been described in detail in the embodiment of the game sound effect production system, and will not be elaborated here.

[0114] Figure 6 Flowchart of a method for producing game sound effects according to some other embodiments. Figure 6 As shown, the embodiment of the present disclosure provides a method for producing game sound effects, which can be executed by an audio production terminal, specifically by a game sound effect production device, which can be implemented by software and / or hardware and configured in the audio production terminal. Figure 6 As shown, the method may include the following steps.

[0115] Step 610: Generate panoramic sound effects for gaming.

[0116] In step 620, the game sound effect in the original audio format is sent to the terminal device, wherein the game sound effect is used to play on the terminal device, so that the terminal device determines feedback information according to the playing effect of the game sound effect, and the feedback information is used to adjust the game sound effect according to the feedback information by the audio production end, and the original audio format is an audio format of ambisonics without encoding.

[0117] Optionally, the sending of the game sound effect in the original audio format to the terminal device comprises:

[0118] The game sound effect in the original audio format is sent to the terminal device in the form of an audio stream.

[0119] Optionally, the generating of the game sound effect of ambisonics comprises:

[0120] The game sound effect of ambisonics is generated by a digital audio workstation;

[0121] The sending of the game sound effect in the original audio format to the terminal device in the form of an audio stream comprises:

[0122] The digital audio workstation is controlled to convert the game sound effect into a first audio stream;

[0123] The first audio stream is sampled in the original audio format by a monitoring plug-in to obtain a sampling signal;

[0124] The sampling signal is converted into a communication signal, and the communication signal is sent to the terminal device, wherein the communication signal is used to make the terminal device convert the communication signal into a second audio stream and play the second audio stream.

[0125] As to the method in the above embodiments, the specific implementation of each step has been described in detail in the embodiments of the game sound effect production system, and will not be described in detail here.

[0126] Figure 7 Fig. 7 is a schematic diagram of module connection of a game sound effect production device according to some embodiments. As shown in Fig. 7, the disclosure embodiments propose a game sound effect production device applied to a terminal device, and the device 700 comprises: Figure 7

[0127] The receiving module 701 is configured to receive the game sound effect in the original audio format sent by the audio production end, wherein the original audio format is an audio format of ambisonics without encoding;

[0128] ​The playback module 702 is configured to play the game sound effect to determine feedback information based on the playback effect of the game sound effect, wherein the feedback information is used to enable the audio production end to adjust the game sound effect according to the feedback information.

[0129] Optionally, the receiving module 701 is specifically configured as follows:

[0130] Receive the game sound effect in the original audio format sent by the audio production end in the form of an audio stream.

[0131] Optionally, the receiving module 701 is specifically configured as follows:

[0132] Receive a communication signal sent by the audio production end, and convert the communication signal into a second audio stream through a sound source plug-in, wherein the communication signal is obtained by the audio production end based on a sampling signal obtained by a monitoring plug-in, and the sampling information is obtained by the monitoring plug-in sampling a first audio stream of a game sound effect output by a digital audio workstation in an original audio format.

[0133] Optionally, the playing module 702 includes:

[0134] an audio effect sending unit, configured to send the second audio stream to the audio middleware;

[0135] The control unit is configured to control the audio middleware to call the panoramic sound game plug-in to play the second audio stream.

[0136] Regarding the device 700 in the above embodiment, the specific manner of the operations performed by each module therein has been described in detail in the embodiment of the game sound effect production system, and will not be elaborated here.

[0137] Figure 8 FIG. 1 is a schematic diagram showing module connections of a game sound effect production device according to other embodiments. Figure 8 As shown, the embodiment of the present disclosure provides a game sound effect production device, which is applied to an audio production end. The device 800 includes:

[0138] A generating module 801 is configured to generate panoramic sound game sound effects;

[0139] The sending module 802 is configured to send the game sound effect in the original audio format to the terminal device, wherein the game sound effect is used to be played on the terminal device, so that the terminal device determines feedback information based on the playback effect of the game sound effect, and the feedback information is used to enable the audio production end to adjust the game sound effect according to the feedback information. The original audio format is an unencoded panoramic sound audio format.

[0140] Optionally, the sending module 802 is specifically configured to:

[0141] send the game sound effect in the original audio format to the terminal device in the form of an audio stream.

[0142] Optionally, the generating module 801 is specifically configured to:

[0143] generate the game sound effect in the ambisonics format through a digital audio workstation;

[0144] the sending module 802 is specifically configured to:

[0145] control the digital audio workstation to convert the game sound effect into a first audio stream;

[0146] sample the first audio stream in the original audio format through a monitoring plug-in to obtain a sampling signal;

[0147] convert the sampling signal into a communication signal, and send the communication signal to a terminal device, wherein the communication signal is used to make the terminal device convert the communication signal into a second audio stream and play the second audio stream.

[0148] As to the apparatus 800 in the above-mentioned embodiments, the specific manners in which the various modules perform operations have been described in detail in the embodiments related to the game sound effect production system, and thus will not be described in detail here.

[0149] Reference will be made to Figure 9 which shows a structural schematic diagram of an electronic device (such as the audio production end or the terminal device in the above-mentioned embodiments) 900 suitable for being used to implement the embodiments of the present disclosure. The electronic device in the embodiments of the present disclosure can include but is not limited to mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), and the like, and fixed terminals such as digital TVs, desktop computers, and the like. Figure 9 The electronic device shown is merely an example, and should not bring any limitation to the functions and use range of the embodiments of the present disclosure.

[0150] As Figure 9As shown, the electronic device 900 can include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 901 that can perform various appropriate actions and processes according to programs stored in a read-only memory (ROM) 902 or loaded into a random access memory (RAM) 903 from a storage device 908. Various programs and data required for the operation of the electronic device 900 are also stored in the RAM 903. The processing device 901, the ROM 902, and the RAM 903 are connected to each other through a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0151] In general, the following devices can be connected to the I / O interface 905: input devices 906 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 907 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 908 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 909. The communication devices 909 can allow the electronic device 900 to communicate wirelessly or wired with other devices to exchange data. Although Figure 9 The electronic device 900 is shown with various devices, but it should be understood that not all of the shown devices are required to be implemented or present. More or fewer devices can alternatively be implemented or present.

[0152] In particular, the processes described above with reference to the flowcharts can be implemented as a computer software program according to embodiments of the present disclosure. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable storage medium, the computer program containing program code for performing the methods illustrated by the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network through the communication devices 909, or installed from the storage devices 908, or installed from the ROM 902. When the computer program is executed by the processing device 901, the above-described functions defined in the methods of embodiments of the present disclosure are performed.

[0153] It should be noted that the computer-readable storage medium described above in the present disclosure can be a computer-readable signal medium or a computer-readable storage medium or any combination thereof. The computer-readable storage medium may, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any suitable combination thereof. More specific examples of the computer-readable storage medium can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, the computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, the computer-readable signal medium can include a data signal propagated in a baseband or as a carrier wave in a propagated data signal, which bears computer-readable program code. Such a propagated data signal can take many forms, including but not limited to, an electromagnetic signal, an optical signal, or any suitable combination thereof. The computer-readable signal medium can also be any computer-readable storage medium that is not a computer-readable storage medium, which can transmit, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained in the computer-readable storage medium can be transmitted by any suitable medium, including but not limited to, a wire, an optical fiber, an RF (radio frequency) or the like, or any suitable combination thereof.

[0154] In some embodiments, the terminal device and the audio production end can communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with digital data communication of any form or medium (e.g., a communication network). Examples of the communication network include a local area network (“LAN”), a wide area network (“WAN”), an internetwork (e.g., the Internet), and an end-to-end network (e.g., an ad hoc end-to-end network), as well as any currently known or future developed network.

[0155] The computer-readable storage medium described above can be included in the electronic device described above; or can exist separately from the electronic device and not be assembled into the electronic device.

[0156] The computer readable storage medium described above carries one or more programs, when the one or more programs are executed by the electronic device, the electronic device is caused to: receive a game sound effect in an original audio format sent by an audio production end, wherein the original audio format is an audio format of ambisonics without encoding; and play the game sound effect to determine feedback information according to a playing effect of the game sound effect, wherein the feedback information is used to make the audio production end adjust the game sound effect according to the feedback information.

[0157] Alternatively, the computer readable storage medium described above carries one or more programs, when the one or more programs are executed by the electronic device, the electronic device is caused to: generate a game sound effect of ambisonics; and send the game sound effect in an original audio format to a terminal device, wherein the game sound effect is used to be played on the terminal device to make the terminal device determine feedback information according to a playing effect of the game sound effect, and the feedback information is used to make the audio production end adjust the game sound effect according to the feedback information, and the original audio format is an audio format of ambisonics without encoding.

[0158] Computer program code for carrying out operations of the present disclosure can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0159] The computer program product of the first aspect can include one or more non-transitory computer-readable media storing instructions that, when executed, cause one or more processors to perform the operations of the first aspect. The one or more non-transitory computer-readable media can include, for example, magnetic media such as one or more magnetic disks, magnetic tapes or cassettes; optical media such as one or more compact discs, optical discs or Blu-ray discs; magneto-optical media such as one or more floptical discs; solid state media such as one or more solid state drives or other flash memory arrays; or any suitable combination of these. The one or more non-transitory computer-readable media can be encoded with instructions that, when executed, cause one or more processors to perform the operations of the first aspect.

[0160] The modules involved in the embodiments of the present disclosure can be implemented in the form of software, or can be implemented in the form of hardware. In some cases, the name of the module does not constitute a limitation on the module itself.

[0161] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, and without limitation, example types of hardware logic components that can be used include Field-programmable Gate Arrays (FPGAs), Application-specific Integrated Circuits (ASICs), Application-specific Standard Products (ASSPs), System-on-a-chip systems (SOCs), Complex Programmable Logic Devices (CPLDs), etc.

[0162] In the context of the present disclosure, a machine-readable storage medium can be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable storage medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable storage medium can include, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the above. More specific examples of a machine-readable storage medium can include, but not limited to, an electrical connection based on one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0163] According to some embodiments of the present disclosure, a game sound production system is provided, comprising the terminal device described in the above embodiments and the audio production terminal described in the above embodiments, wherein the terminal device is connected with the audio production terminal.

[0164] It should be understood that the detailed principles of the game sound production system have been described in detail in the above embodiments, and will not be described here.

[0165] The above description is merely preferred embodiments of the present disclosure and a description of the principles of the technology applied. Those skilled in the art should understand that the disclosed range of the present disclosure is not limited to the technical solutions formed by the specific combinations of the above technical features, and should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the technical solutions formed by replacing the above features with the technical features disclosed in the present disclosure (but not limited to) having similar functions.

[0166] In addition, although each operation is described in a specific order, this should not be understood as requiring the operations to be performed in the specific order or in a sequential order. In certain circumstances, multitasking and parallel processing can be advantageous. Similarly, although several implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Certain features described in the context of separate embodiments can also be combined in a single embodiment. Conversely, various features described in the context of a single embodiment can also be separated and implemented in multiple embodiments.

[0167] Although the subject matter has been described in language specific to structural features and / or methodological acts, it is to be understood that the subject defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely illustrative of the example forms of implementing the claims. As to the devices in the above embodiments, the specific manner in which the various modules perform operations has been described in detail in the embodiments related to the method, and will not be described here in detail.

Claims

1. A game sound effect production system, characterized in that: include: An audio production end is configured to generate panoramic sound game sound effects and send the game sound effects in an original audio format to a terminal device, wherein the original audio format is an unencoded panoramic sound audio format; The audio production end is further configured to receive feedback information and adjust the game sound effects according to the feedback information; The terminal device is configured to receive the game sound effect sent by the audio production end, play the game sound effect, and determine the feedback information based on the playing effect of the game sound effect and send it to the audio production end; The audio production end is configured as follows: Sending the game sound effect in the original audio format to the terminal device in the form of an audio stream; the audio stream is formed by the audio production end playing the game sound effect, and the audio stream is not played back by the audio production end; The terminal device is configured as follows: Receive the game sound effect in the original audio format sent by the audio production end in the form of an audio stream.

2. The system according to claim 1, wherein: The audio production end includes: a digital audio workstation configured to generate the game sound effect in the original audio format and convert the game sound effect into a first audio stream; a monitoring plug-in configured to sample the first audio stream in the original audio format to obtain a sampled signal; A first communication module is configured to convert the sampling signal into a communication signal and output the communication signal; The terminal device includes: a second communication module, configured to receive the communication signal sent by the first communication module; an audio source plug-in configured to convert the communication signal into a second audio stream; The playing module is configured to play back the second audio stream.

3. The system according to claim 2, characterized in that The playback module includes: The audio middleware is configured to receive the second audio stream sent by the audio source plug-in and play the second audio stream through the panoramic sound game plug-in.

4. A method for producing game sound effects, characterized in that: include: Controlling the audio production end to generate panoramic sound game sound effects and sending the game sound effects in an original audio format to the terminal device, wherein the original audio format is an unencoded panoramic sound audio format; controlling the terminal device to receive the game sound effect sent by the audio production end, and play the game sound effect, so as to determine feedback information according to the playing effect of the game sound effect; Controlling the audio production end to adjust the game sound effects according to the feedback information; The sending of the game sound effect in the original audio format to the terminal device comprises: Controlling the audio production end to send the game sound effect in the original audio format to the terminal device in the form of an audio stream; the audio stream is formed by the audio production end playing the game sound effect, and the audio stream is not played back by the audio production end; The receiving the game sound effect sent by the audio production end includes: The terminal device is controlled to receive the game sound effect in the original audio format sent by the audio production end in the form of an audio stream.

5. A method for producing game sound effects, characterized in that: Applied to terminal equipment, including: Receive game sound effects in an original audio format sent by an audio production end, wherein the original audio format is an unencoded panoramic sound audio format; Playing the game sound effect to determine feedback information based on the playing effect of the game sound effect, wherein the feedback information is used to enable the audio production end to adjust the game sound effect according to the feedback information; The receiving of the game sound effects in the original audio format sent by the audio production end includes: Receive the game sound effect in the original audio format sent by the audio production end in the form of an audio stream; the audio stream is formed by the audio production end playing the game sound effect, and the audio stream is not played back by the audio production end.

6. A method for producing game sound effects, characterized in that: Applied to audio production, including: Generate panoramic game sound effects; Sending the game sound effect in an original audio format to a terminal device, wherein the game sound effect is used to be played on the terminal device, so that the terminal device determines feedback information based on the playback effect of the game sound effect, and the feedback information is used to enable the audio production end to adjust the game sound effect based on the feedback information, wherein the original audio format is an unencoded panoramic sound audio format; The sending of the game sound effect in the original audio format to the terminal device comprises: The game sound effects in the original audio format are sent to the terminal device in the form of an audio stream; the audio stream is formed by the audio production end playing the game sound effects, and the audio stream is not played back by the audio production end.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processing device, the method according to claim 5 is implemented, or the method according to claim 6 is implemented.

8. A terminal device, characterized in that: include: a storage device having a computer program stored thereon; A processing device is used to execute the computer program in the storage device to implement the method according to claim 5.

9. An audio production terminal, characterized in that: include: a storage device having a computer program stored thereon; A processing device is used to execute the computer program in the storage device to implement the method according to claim 6.

Images