Virtual concert sound processing method, storage medium, and electronic device

Abstract

The present invention discloses a method for processing the sound sense of a virtual concert, a storage medium, and an electronic device. The method comprises: receiving a selection instruction, and determining a target position in the virtual concert according to the selection instruction; determining the first audience transmission audio transmitted to the target position; obtaining the sound position of the sound in the virtual concert, and determining the sound audio, and determining the sound transmission audio transmitted to the target position according to the target position and the sound position; mixing the first audience transmission audio and the sound transmission audio to obtain the mixed audio transmitted to the target position. According to the target position selected by the user in the virtual concert, the first audience transmission audio and the sound transmission audio transmitted to the target position are determined, and the first audience transmission audio and the sound transmission audio transmitted to the target position are mixed, so that the user at the target position can feel the atmosphere at the corresponding position in the real concert, making the user feel as if they are in the concert.

Description

Technical Field

[0001] The present invention relates to the technical field of virtual concert sound processing, and in particular to a virtual concert sound processing method, storage medium, and electronic equipment. Background Art

[0002] With the development of virtual reality, virtual scenes such as virtual concerts or virtual football games have emerged. The related virtual concert sound processing solutions lack realism and poor interactivity, and cannot enable users in the virtual scene to experience the atmosphere of a real concert. Summary of the invention

[0003] The present invention aims to solve at least one of the technical problems in the related art to a certain extent. To this end, one purpose of the present invention is to propose a sound processing method for a virtual concert, increase interactivity, enhance the realism of the concert, and allow users to experience the atmosphere at the corresponding position of the real concert, making the users feel as if they are there.

[0004] A second object of the present invention is to provide a computer-readable storage medium.

[0005] A third objective of the present invention is to provide an electronic device.

[0006] To achieve the above-mentioned purpose, the first aspect of the present invention proposes a sound processing method for a virtual concert, the method comprising: receiving a selection instruction, and determining a target position in the virtual concert according to the selection instruction; determining a first audience transmission audio transmitted to the target position; obtaining the sound position of the sound in the virtual concert, and determining the sound audio, and determining the sound transmission audio of the sound audio transmitted to the target position according to the target position and the sound position; mixing the first audience transmission audio and the sound transmission audio to obtain a mixed audio transmitted to the target position.

[0007] In addition, the sound processing method for a virtual concert proposed in the above embodiment of the present invention may also have the following additional technical features:

[0008] According to one embodiment of the present invention, determining the first audience transmission audio transmitted to the target position includes: determining the first audience within a first preset range of the target position; obtaining the first position of each of the first audience members and the first audience audio collected from the microphone of each of the first audience members; determining the first audience transmission audio of each of the first audience audios transmitted to the target position according to the target position and each of the first positions; and mixing the first audience transmission audios to obtain the first audience transmission audio.

[0009] According to one embodiment of the present invention, determining sound audio includes: obtaining the singer position of the singer in the virtual concert and the earphone audio of the singer; determining second audience members within a second preset range of the singer's position; obtaining the second position of each of the second audience members and second audience audio collected from a microphone of each of the second audience members; determining the second audience propagation audio of each of the second audience members' audio propagating to the singer's position based on the singer's position and each of the second positions; and mixing the earphone audio and all of the second audience audios to obtain the sound audio.

[0010] According to one embodiment of the present invention, the second audience propagation audio of each second audience audio propagated to the singer's position is determined based on the singer's position and each second position, including: calculating the distance between each second audience and the singer based on the singer's position and each second position; attenuating the corresponding second audience audio according to each distance to obtain the corresponding second audience attenuated audio; mixing all the second audience attenuated audios to obtain the second audience propagation audio.

[0011] According to an embodiment of the present invention, attenuating each corresponding second audience audio according to each distance further includes: acquiring the frequency of each second audience audio; and attenuating the corresponding second audience audio according to each distance and each frequency.

[0012] According to one embodiment of the present invention, all the second audience attenuated audios are mixed to obtain the second audience transmitted audio, including: calculating the audio delay time between each of the second audience and the target singer according to each of the distances; delaying each of the second audience attenuated audios according to each of the audio delay times to obtain each of the second audience delayed audios; and mixing each of the second audience delayed audios to obtain the second audience transmitted audio.

[0013] According to one embodiment of the present invention, the target position includes a target head orientation, and the first position includes a first head orientation; determining the first audience propagation audio of each first audience audio when it propagates to the target position based on the target position and the first position of each first audience, including: determining the directional angle between each first position and the target position based on the target head orientation and each first head orientation; determining the first audience propagation audio of each first audience audio when it propagates to the target position based on all the directional angles.

[0014] According to one embodiment of the present invention, before receiving a selection instruction and determining a target location in a virtual concert according to the selection instruction, the method further includes: acquiring a network delay status and providing a location range according to the network delay status.

[0015] To achieve the above objectives, the second aspect of the present invention proposes a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the sound processing method for a virtual concert proposed in the first aspect of the present invention is implemented.

[0016] To achieve the above-mentioned purpose, the third aspect of the present invention proposes an electronic device, including a memory and a processor, wherein the memory stores a computer program, and when the computer program is executed by the processor, the sound processing method for a virtual concert proposed in the first aspect of the present invention is implemented.

[0017] According to the sound processing method of a virtual concert in an embodiment of the present invention, the first audience transmission audio transmitted by the first audience around the target position in the virtual concert to the target position, and the sound transmission audio transmitted by the speaker in the virtual concert to the target position are obtained, and the first audience transmission audio and the sound transmission audio are mixed to increase interactivity and enhance the realism of the concert, so that the user at the target position can feel the atmosphere at the corresponding position in the real concert, making the user feel as if they are in the scene.

[0018] According to the sound processing method for a virtual concert in an embodiment of the present invention, the first audience audio collected by the first audience's microphone is attenuated according to the propagation distance and the head orientation to obtain the first audience transmission audio transmitted to the target position, thereby increasing the interactivity with the first audience and improving the realism of the concert.

[0019] According to the sound processing method of a virtual concert in an embodiment of the present invention, by collecting the singer's earphone audio and the second audience audio of the second audience around the singer, after collecting the second audience audio, the second audience audio is attenuated according to the propagation distance, propagation delay, and frequency of the second audience audio, and it is determined that the second audience audio is propagated to the singer, the second audience propagated audio and the earphone audio are mixed, and the audio audio played by the audio is determined, thereby increasing the interactivity between the singer and the surrounding second audience and enhancing the realism of the concert.

[0020] According to the sound processing method of a virtual concert according to an embodiment of the present invention, a selectable position range is provided for the user. When the user determines the target position, an audio effect at the corresponding position is generated according to the selected target position, so that the user can experience the atmosphere at the corresponding position of a real concert and feel as if they are there. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 is a flow chart of a method for processing sound perception of a virtual concert according to an embodiment of the present invention;

[0022] Figure 2A schematic diagram showing the positions of singers, stage, and virtual audiences according to an embodiment of the present invention;

[0023] Figure 3 is a flowchart of determining the first viewer transmitting audio according to a specific embodiment of the present invention;

[0024] Figure 4 is a flow chart of determining sound audio according to an embodiment of the present invention;

[0025] Figure 5 is a flow chart of determining the second audience propagation audio according to a specific embodiment of the present invention;

[0026] Figure 6 is a flowchart of determining the second audience propagation audio according to another specific embodiment of the present invention;

[0027] Figure 7 is a schematic diagram of different audio attenuation levels according to an embodiment of the present invention;

[0028] Figure 8 is a flow chart of a second audience transmitting audio according to another specific embodiment of the present invention;

[0029] Fig. 9 is a flowchart of determining the first viewer transmitting audio according to another specific embodiment of the present invention;

[0030] Fig.10 is a schematic diagram showing the effect of different head orientations on sound propagation according to an embodiment of the present invention;

[0031] Fig.11 It is a structural block diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0032] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present invention, and should not be construed as limiting the present invention.

[0033] The following is attached to the instruction manual Figure 1-11 And the specific implementation method of the virtual concert sound processing method, storage medium, and electronic device of the embodiment of the present invention are described in detail.

[0034] Figure 1 It is a flow chart of a method for processing sound sensations in a virtual concert according to an embodiment of the present invention. Figure 2 FIG. 1 is a schematic diagram showing the positions of singers, stage, and virtual audiences according to an embodiment of the present invention. Figure 1 As shown, the sound processing method for a virtual concert may include:

[0035] S1, receiving a selection instruction, and determining a target position in the virtual concert according to the selection instruction.

[0036] Specifically, when experiencing a virtual concert, the user can send a selection instruction through the virtual concert system to select his position in the virtual concert. When the target user enters the virtual concert, the virtual concert system provides a position range for the target audience and determines the target position of the target user in the virtual concert according to the selection instruction sent by the target user.

[0037] S2, determining the first viewer transmission audio to be transmitted to the target location.

[0038] In order to simulate the real sound effect of a concert more realistically, in addition to acquiring the sound emitted by the speakers that can be heard by the target audience at the target location, the embodiment of the present invention also transmits the sound emitted by the audience around the target location.

[0039] The embodiment of the present invention obtains audio emitted by audiences around the target location, processes the audio emitted by audiences around the target location, and determines the first audience transmission audio transmitted to the target location.

[0040] S3, obtaining the sound position of the sound in the virtual concert, and determining the sound audio, and determining the sound transmission audio of the sound transmission to the target position according to the target position and the sound position.

[0041] Specifically, the audio played by the speaker (the singer's headset audio is played through the speaker) is determined, the audio played by the speaker is processed according to the target position and the speaker position, and the audio transmitted to the target position is determined.

[0042] S4, mixing the audio transmitted by the first audience and the audio transmitted by the sound system to obtain mixed audio transmitted to the target location.

[0043] The embodiment of the present invention mixes the first audience transmitted audio and the sound transmitted audio transmitted to the target location, determines the mixed audio transmitted to the target location, and plays the mixed audio, so that the audience can experience the concert without leaving home, making the user feel as if they are there.

[0044] In an embodiment of the present invention, the weight w1 of the first audience's audio transmission and the weight w2 of the audio transmission by the sound system can be adaptively set by the virtual concert system. The target audience can also set the weight w1 of the first audience's audio transmission and the weight w2 of the audio transmission by the sound system according to their own needs.

[0045] In one embodiment of the present invention, Figure 3 As shown, determining the first viewer transmission audio transmitted to the target location may include:

[0046] S21, determining a first audience member within a first preset range of the target location;

[0047] S22, obtaining a first position of each first viewer and first viewer audio collected from a microphone of each first viewer;

[0048] S23, determining, according to the target position and each first position, that each first viewer audio is propagated to each first viewer propagated audio at the target position;

[0049] S24, mixing the audios transmitted by the first viewers to obtain the first viewer transmitted audios.

[0050] Since sound will attenuate during propagation, the sound from the audience far away from the target position may not be transmitted to the target position, and the sound from the audience close to the target position can be transmitted to the target position, but the corresponding audio will also be weakened. In order to further simulate the real concert environment, the first audience audio of each first audience within the first preset range of the target position is attenuated.

[0051] Specifically, the first preset range can be determined according to the audio decibel propagation attenuation, and the first audience within the first preset range of the target position can be determined according to the target position. The first position of each first audience and the first audience audio of each first audience collected from the microphone of each first audience are obtained. The audio of each first audience is attenuated according to the target position and each first position, and the propagated audio of each first audience (the audio of each first audience after attenuation processing) transmitted to the target position by each first audience audio is determined, and the propagated audio of each first audience (the audio of each first audience after attenuation processing) is mixed to obtain the first audience transmission audio.

[0052] As a specific example, when performing attenuation processing on the audio of each first audience member according to the target position and each first position, reference may be made to GB / T 17247.1-2000 Acoustic Outdoor Sound Propagation Attenuation to perform attenuation processing on the audio of each first audience member.

[0053] As another specific example, when attenuation processing is performed on each first audience audio according to the target position and each first position, attenuation processing may also be performed on each first audience audio according to the following audio propagation attenuation formula.

[0054] The propagation attenuation formula of audio: Wherein, ΔL represents the decibel attenuation value, and r represents the distance between the target position and the corresponding first position.

[0055] By using the above formula, the attenuation value of each first audience audio is calculated, and the first audience transmission audio can be determined according to each first audience audio and the corresponding attenuation value.

[0056] Since it takes time for sound to be transmitted from the source to the target location, there will be a certain delay in the sound transmitted from different locations to the target location. In order to more realistically simulate the sound of the surrounding audience (first audience) heard at the target location, in addition to attenuating the decibel of the first audience audio, the first audience audio can also be delayed to obtain more realistic first audience transmitted audio.

[0057] It should be noted that, in addition to obtaining the first audience audio of the first audience within the first preset range of the target location, the present invention can also obtain the audio of other audiences outside the first preset range of the target location. Specifically, to determine whether the audio decibels of other audiences outside the first preset range of the target location can be transmitted to the target location, the audio of other audiences outside the first preset range that can be transmitted to the target location can be attenuated and delayed, and mixed with the audio transmitted by the first audience to obtain the audio transmitted by the first audience.

[0058] In one embodiment of the present invention, Figure 4 As shown, determining the acoustic audio may include:

[0059] S31, obtaining the singer position and the singer's headset audio in the virtual concert;

[0060] S32, determining a second audience member within a second preset range of the singer's position;

[0061] S33, obtaining the second position of each second viewer and the second viewer audio collected from the microphone of each second viewer;

[0062] S34, determining, according to the singer's position and each second position, that each second audience audio is propagated to the second audience propagation audio at the singer's position;

[0063] S35, mixing the headset audio and all the second audience audios to obtain sound audio.

[0064] Affected by the singer's headset, the headset not only receives the audio emitted by the singer, but also the audio emitted by the audience around the singer. In the embodiment of the present invention, the singer's headset audio and the audio emitted by the audience around the singer are mixed to determine the audio played by the speaker, so that the audience can be in a real concert.

[0065] Specifically, the singer position of the target singer in the virtual concert and the earphone audio of the target singer are obtained, and the second audience within the second preset range of the singer's position is determined according to the singer's position, wherein the second preset range can be determined according to the audio decibel propagation attenuation. The second position of each second audience and the second audience audio collected from the microphone of each second audience are obtained. The second audience audio emitted by each second audience will also be attenuated when it propagates to the singer's position. According to the singer's position and each second position, the second audience audio emitted by each second audience is attenuated to determine the second audience propagation audio of each second audience audio propagated to the singer's position. The earphone audio and all second audience audio are mixed to obtain sound audio.

[0066] In one embodiment of the present invention, Figure 5 As shown, the second audience propagation audio is determined to be propagated to the singer's position according to the singer's position and the second positions, including:

[0067] S36, calculating the distance between each second audience member and the singer according to the singer's position and each second position;

[0068] S37, performing attenuation processing on the corresponding second audience audio according to each distance to obtain the corresponding second audience attenuated audio;

[0069] S38, mixing all the second audience attenuated audios to obtain the second audience transmitted audios.

[0070] Specifically, when determining the second audience transmitting the audio, the distance between each second audience and the singer is calculated based on the acquired singer position and each second position. And the transmission attenuation method as described above can be used, such as using the transmission attenuation formula: The attenuation value of the second viewer audio of each second viewer is calculated, and the corresponding second viewer attenuated audio is determined according to the second viewer audio of each second viewer and the corresponding attenuation value. All the second viewer attenuated audios (attenuated second viewer audios) are mixed to obtain the second viewer propagation audio.

[0071] In one embodiment of the present invention, Figure 6 As shown, attenuation processing is performed on each corresponding second audience audio according to each distance, and further includes:

[0072] S371, obtaining the frequency of each second audience audio;

[0073] S372: Perform attenuation processing on the corresponding second audience audio according to each distance and each frequency.

[0074] Since high frequencies decay quickly and low frequencies decay slowly, in order to further enable the audience to experience a real concert, the frequency of each second audience audio is obtained, and the corresponding second audience audio is attenuated according to each distance and each frequency. Figure 7 Different audio attenuation levels are shown.

[0075] In one embodiment of the present invention, Figure 8 As shown, mixing all second audience attenuated audios to obtain second audience propagation audios may include:

[0076] S381, calculating the audio delay time between each second audience member and the target singer according to each distance;

[0077] S382, delaying each second viewer attenuated audio according to each audio delay time to obtain each second viewer delayed audio;

[0078] S383, mixing the delayed audios of the second viewers to obtain the second viewer transmitted audios.

[0079] Since a concert is a relatively large scene, it takes time for the sound to be transmitted from the source to the singer, and there will be a delay when the second audience audio is transmitted to the singer's position. Assuming that the room temperature is 25 degrees, the propagation speed of sound is 346m / s. Then, for the sound emitted by a certain audience (X3, Y3) to reach the target singer (X4, Y4), it takes Therefore, while the decibel of the second audience audio is attenuated, the second audience audio can also be further delayed to further enable the user to experience a real concert.

[0080] Specifically, according to the distance between each second audience and the target singer, the audio delay time between each second audience and the target singer is calculated, that is, the time required for the second audience audio collected by each second audience to be transmitted to the target singer. According to each audio delay time, each second audience attenuated audio is delayed to obtain each second audience delayed audio, and each second audience delayed audio is mixed to obtain the second audience transmitted audio.

[0081] Considering the network delay, when determining the position of each audience, users with high delay are placed in the back row, and users with low delay are placed in the front row. Assuming the delay is ts, subtract the delay when calculating the second audience audio transmission to the singer's position, that is:

[0082]

[0083] The formula needs to satisfy Greater than t, that is, the time it takes for the second audience audio to be transmitted from the second audience to the singer must be greater than the delay. Therefore, when users enter the virtual concert, different position options are provided for different users based on the average delay.

[0084] In one embodiment of the present invention, before receiving the selection instruction and determining the target position in the virtual concert according to the selection instruction, the method for processing the sound sense of the virtual concert may further include:

[0085] Get the network delay status and provide a location range based on the network delay status.

[0086] Specifically, before receiving the selection instruction issued by the user, the virtual concert system obtains the user's network delay status and provides a location range based on the network delay status. If the user's network delay status is good and the network speed is greater than a preset threshold, the provided location range is a location close to the singer. If the user's network delay status is poor and the network speed is less than a preset threshold, the provided location range is a location far away from the singer. Thus, the user issues a selection instruction based on the provided location range.

[0087] In one embodiment of the present invention, determining the audio transmission of the audio to the target location according to the target location and the audio location includes:

[0088] According to the target position and the sound position, the distance between the target position and the sound position is calculated;

[0089] The sound audio is attenuated according to the distance between the target position and each sound position to obtain the sound transmission audio transmitted to the target position.

[0090] It should be noted that the number of speakers in the embodiment of the present invention may be one or more (greater than or equal to two).

[0091] When determining the audio transmission audio to be transmitted to the target position according to the target position and the audio position, the distance between the target position and each audio position is calculated according to the target position and the audio position, and each of the audios is attenuated according to the distance between the target position and each audio position to obtain the audio transmission audio transmitted to the target position, and each of the audio transmission audios and the first audience transmission audio are mixed.

[0092] In an embodiment of the present invention, the sound audio is attenuated according to the distance between the target position and each sound position, including attenuating the decibel of the sound audio according to the distance between the target position and each sound position, attenuating the frequency of the sound audio, and delaying each sound audio according to the delay time of each sound audio.

[0093] It should be noted that the principles of attenuating the decibel of the audio, attenuating the frequency of the audio, and the delay time of each audio are the same as those of the second audience audio, and will not be repeated here.

[0094] In the embodiment of the present invention, the sound of the target user can be collected through the target user microphone, and the sound of the target user can be mixed with the audio transmitted by the first audience and the audio transmitted by the speakers, so as to enhance the interaction between the user and the first audience, the second audience and the singer.

[0095] In one embodiment of the present invention, Fig. 9 As shown, the target position includes the target head orientation, and the first position includes the first head orientation; and determining the first audience propagation audio when the audio of each first audience propagates to the target position according to the target position and the first position of each first audience includes:

[0096] S231, determining a direction angle between each first position and the target position according to the target head orientation and each first head orientation;

[0097] S232: Determine the first audience propagation audio when each first audience audio is propagated to the target position according to all directional angles.

[0098] See also Fig.10 , since there are two users A and B, namely Fig.10 For audience A and audience B, if audience B speaks to audience A, the decibel is relatively large, and if audience B speaks with his back to audience A, the decibel will be lower. In order to further determine the first audience propagation audio when each first audience audio is propagated to the target position. When a user wears VR glasses or headphones with a gyroscope, the user's head orientation can be obtained (centered on the target viewing device, such as a mobile phone, computer, TV and other devices). That is, when determining the target position of the target user in the virtual concert and the first position of the first audience in the virtual concert, the head orientation corresponding to the target user and the first audience is further obtained, that is, the spatial coordinates (X, Y, Z). Among them, (X, Y,) represents the position coordinates in the virtual concert, and Z represents the head orientation.

[0099] The directional angle between each first position and the target position can be determined based on the target head orientation and each first head orientation, and an attenuation threshold U can be preset to simulate this situation. The first audience heard by the final target user is equal to U*BETA, where BETA is the decibel of the first audience audio. The value of U can be set according to the angle of the target user relative to the first audience (other users within the first preset range of the target position). For example, if face to face is 0 degrees, then -45-45 degrees, the value of U is u1, 45-90 is u2, and so on.

[0100] According to the distance between the target position and each first position, and the corresponding direction angle, attenuation processing is performed on each first audience audio to determine the first audience propagation audio when it propagates to the target position.

[0101] The sound processing method for a virtual concert in an embodiment of the present invention determines the first audience transmission audio and the sound transmission audio transmitted to the target position according to the target position selected by the user in the virtual concert, and mixes the first audience transmission audio and the sound transmission audio transmitted to the target position, so that the user at the target position can feel the atmosphere at the corresponding position in the real concert, making the user feel as if he is in the scene.

[0102] The present invention provides a computer-readable storage medium.

[0103] In this embodiment, a computer program is stored on a computer-readable storage medium. When the computer program is executed by a processor, the sound processing method for a virtual concert as described above is implemented.

[0104] The present invention provides an electronic device.

[0105] In this embodiment, the electronic device 500 includes a memory 503 and a processor 501. The memory 503 stores a computer program. When the computer program is executed by the processor 501, the sound processing method for the virtual concert as described above is implemented.

[0106] Fig.11 is a structural block diagram of an electronic device according to an embodiment of the present invention. Fig.11 As shown, the electronic device 500 includes: a processor 501 and a memory 503. The processor 501 and the memory 503 are connected, such as through a bus 502. Optionally, the electronic device 500 may also include a transceiver 504. It should be noted that in actual applications, the transceiver 504 is not limited to one, and the structure of the electronic device 500 does not constitute a limitation on the embodiments of the present invention.

[0107] Processor 501 may be a CPU (Central Processing Unit), a general purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It may implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of the present invention. Processor 501 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0108] The bus 502 may include a path to transmit information between the above components. The bus 502 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The bus 502 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig.11 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0109] The memory 503 is used to store a computer program corresponding to the method for processing the sound sense of a virtual concert of the above embodiment of the present invention, and the computer program is controlled and executed by the processor 501. The processor 501 is used to execute the computer program stored in the memory 503 to implement the contents shown in the above method embodiment.

[0110] Among them, the electronic device 500 includes but is not limited to: mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Fig.11 The electronic device 500 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0111] The computer-readable storage medium and electronic device of the embodiments of the present invention utilize the above-mentioned sound processing method of the virtual concert to determine the first audience transmission audio and the sound transmission audio transmitted to the target location, and mix the first audience transmission audio and the sound transmission audio transmitted to the target location, determine the mixed audio transmitted to the target location, and play the mixed audio, so that the audience can experience the concert without leaving home, making the users feel as if they are on the scene.

[0112] It should be noted that the logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purposes of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection portion with one or more wirings (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0113] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0114] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0115] In the description of the present invention, it is to be understood that the terms “center”, “longitudinal”, “lateral”, “length”, “width”, “thickness”, “up”, “down”, “front”, “back”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “inside”, “outside”, “clockwise”, “counterclockwise”, “axial”, “radial”, “circumferential”, etc., indicating orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.

[0116] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present invention, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0117] In the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements, unless otherwise clearly defined. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0118] In the present invention, unless otherwise clearly specified and limited, a first feature being "above" or "below" a second feature may mean that the first and second features are in direct contact, or the first and second features are in indirect contact through an intermediate medium. Moreover, a first feature being "above", "above" or "above" a second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature. A first feature being "below", "below" or "below" a second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is lower in level than the second feature.

[0119] Although the embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and are not to be construed as limitations of the present invention. A person skilled in the art may change, modify, replace and vary the above embodiments within the scope of the present invention.

Claims

1. A method for processing sound perception of a virtual concert, characterized in that: The method comprises: Receiving a selection instruction sent by a target user, and determining a target position of the target user in the virtual concert according to the selection instruction; Collecting user audio emitted by the target user, and determining first viewer transmission audio transmitted to the target location; Acquire the sound position of the sound in the virtual concert, determine the sound audio, and determine the sound transmission audio of the sound audio transmitted to the target position according to the target position and the sound position; Mixing the user audio, the first audience transmitted audio and the audio transmitted by the speaker to obtain mixed audio transmitted to the target location; Wherein, determining the first viewer transmission audio transmitted to the target location includes: Determining a first audience member within a first preset range of the target location; Acquire a first position of each of the first viewers and first viewer audio collected from a microphone of each of the first viewers; Determine, according to the target position and each of the first positions, that each of the first audience audios is propagated to the first audience propagated audio of the target position; Mixing the audios transmitted by the first viewers to obtain the audios transmitted by the first viewers; Among them, determining the sound audio includes: Obtaining the singer position of the singer in the virtual concert and the singer's headset audio; Determine a second audience member within a second preset range of the singer's position; Acquire a second position of each second viewer and second viewer audio collected from a microphone of each second viewer; Determine, according to the singer's position and each of the second positions, that each of the second audience audios is propagated to the second audience propagated audio at the singer's position; The headset audio and all the second audience audios are mixed to obtain the sound audio.

2. The method for processing the sound perception of a virtual concert according to claim 1, characterized in that: Determining, according to the singer's position and each of the second positions, that each of the second audience audio is propagated to the second audience propagated audio at the singer's position includes: Calculating the distance between each of the second audience members and the singer according to the singer's position and each of the second positions; Attenuating the corresponding second audience audio according to each of the distances to obtain the corresponding second audience attenuated audio; All the second audience attenuated audios are mixed to obtain the second audience propagation audios.

3. The method for processing the sound perception of a virtual concert according to claim 2, characterized in that: Attenuating each corresponding second audience audio according to each distance, further comprising: Obtain the frequency of each of the second audience audios; The corresponding second audience audio is attenuated according to the distances and the frequencies.

4. The method for processing the sound of a virtual concert according to claim 2, characterized in that: Mixing all the second audience attenuated audios to obtain the second audience propagation audios, including: Calculating the audio delay time between each of the second audience members and the singer according to each of the distances; Delaying each second audience attenuated audio according to each audio delay time to obtain each second audience delayed audio; The second audience delayed audios are mixed to obtain the second audience transmitted audios.

5. The method for processing the sound of a virtual concert according to claim 1, characterized in that: The target position includes a target head orientation, and the first position includes a first head orientation; determining the first audience propagation audio when each of the first audience audios propagates to the target position according to the target position and the first position of each of the first audiences, includes: Determining a direction angle between each of the first positions and the target position according to the target head orientation and each of the first head orientations; The first audience propagated audio when each of the first audience audios propagates to the target position is determined according to all the directional angles.

6. The method for processing the sound perception of a virtual concert according to claim 1, characterized in that: Before receiving the selection instruction and determining the target position in the virtual concert according to the selection instruction, the method further includes: A network delay status is obtained, and a location range is provided according to the network delay status.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method for processing the sound of a virtual concert as described in any one of claims 1 to 6 is implemented.

8. An electronic device comprising a memory and a processor, wherein a computer program is stored in the memory, wherein: When the computer program is executed by the processor, the method for processing the sound of a virtual concert as described in any one of claims 1-6 is implemented.

Images