Audio listening method and system and wireless audio equipment

Abstract

The invention discloses an audio listening method and system and wireless audio equipment, and the method comprises the steps: carrying out the pairing of a sound pickup and an audio listener, and building a transmission channel; a sound pickup is used for pickup to obtain first audio data, and the sound pickup is further used for transmitting the first audio data; acquiring first audio data transmitted by the sound pickup, and acquiring second audio data of the equipment end; transmitting the first audio data and / or the second audio data to an audio listener; wherein the transmission channel comprises an instruction transmission link and an audio transmission link. According to the technical scheme provided by the invention, the technical problem that an audio user needs to spend more time in audio collection in the prior art can be solved.

Description

Technical Field

[0001] This application relates to the field of communication technologies, and in particular, to an audio listening method, system, and wireless audio device. Background Art

[0002] With the development of the Internet, especially the explosive growth of short videos, audio users have a greater need for high-quality audio content, which includes sounds emitted by audio users themselves, sounds emitted by devices, etc. After collecting these audios, audio users can produce them by means such as editing.

[0003] However, audio users can only know the quality of the audio during the production process. If the audio quality does not meet the requirements, audio users need to collect the audio again, which makes audio users spend more time on audio collection. Summary of the Invention

[0004] This application provides an audio listening method, system, and wireless audio device, aiming to effectively solve the technical problem that audio users need to spend more time on audio collection in the prior art.

[0005] According to the first aspect of this application, this application provides an audio listening method, including: pairing a pickup and an audio receiver to establish a transmission channel; using the pickup to pick up sound to obtain first audio data, and the pickup is also used to transmit the first audio data; obtaining the first audio data transmitted by the pickup and obtaining second audio data at the device end; transmitting the first audio data and / or the second audio data to the audio receiver; wherein, the transmission channel includes an instruction transmission link and an audio transmission link.

[0006] In a possible design, at least one audio receiver is used to listen to at least one pickup, including using M audio receivers to listen to N pickups, where M is 1 and N is greater than or equal to 2; or M is greater than or equal to 2 and N is 1;

[0007] The step of transmitting the first audio data and / or the second audio data to the audio receiver includes: mixing the first audio data and the second audio data to obtain mixed audio data; transmitting at least one of the first audio data, the second audio data, and the mixed audio data to the audio receiver through the audio transmission link.

[0008] In a possible design, the audio listening method further includes: transmitting at least one of the first audio data, the second audio data, and the mixed audio data to the device end through the audio transmission link.

[0009] In a possible design, at least one audio listener is used to listen to at least one pickup, including using M audio listeners to listen to N pickups, where M is 1 and N is greater than or equal to 2; or M is greater than or equal to 2 and N is 1.

[0010] The steps of transmitting the first audio data and / or the second audio data to the audio listener include: transmitting the first audio data from the pickup to the audio listener, or / and, transmitting the second audio data to the audio listener through the audio transmission link.

[0011] In a possible design, the steps of transmitting the first audio data and / or the second audio data to the audio listener further include: mixing the first audio data of at least one pickup or / and the second audio data of at least one device end to obtain mixed audio data, and transmitting the mixed audio data to the device end through the audio transmission link; obtaining the third audio data of the device end, where the third audio data includes at least one of the mixed audio data and the second audio data of the device end; transmitting the third audio data to the audio listener through the audio transmission link.

[0012] In a possible design, the audio listening method further includes: connecting to the pickup through multicast and connecting to the audio listener through multicast.

[0013] In a possible design, the audio listening method further includes: connecting to the pickup through the first transmission channel and connecting to the audio listener through the second transmission channel; transmitting control instructions to the pickup through the instruction transmission link of the first transmission channel to control the pickup, and transmitting control instructions to the audio listener through the instruction transmission link of the second transmission channel to control the audio listener.

[0014] In a possible design, the audio listening method further includes: storing the first audio data from different pickups in partitions and storing the second audio data from different device ends in partitions.

[0015] In a possible design, the audio listening method further includes: obtaining the number of listening channels of the audio listener; transmitting the first audio data and / or the second audio data to the audio listener through a predetermined number of channels, where the predetermined number is less than or equal to the number of listening channels.

[0016] In a possible design, the pickup emits the first audio data periodically, and the transmission of the first audio data and / or the second audio data is periodic.

[0017] In a possible design, the audio listening method performs data transmission based on a wireless communication protocol, and the wireless communication protocol includes the Bluetooth protocol and the WiFi protocol.

[0018] In a possible design, the duration for the pickup to pick up sound is a first duration, the transmission duration for obtaining the first audio data transmitted by the pickup is a second duration, and the transmission duration for transmitting the first audio data and / or the second audio data to the audio listener is a third duration, where the sum of the second duration and the third duration is less than or equal to the first duration.

[0019] In a possible design, the audio listening method further includes: encoding the first audio data after obtaining the first audio data of the pickup; decoding the first audio data before mixing the first audio data and the second audio data; encoding the mixed audio data after mixing the first audio data and the second audio data; and decoding the mixed audio data after transmitting the mixed audio data to the audio listener.

[0020] In a possible design, the audio listening method further includes: encoding the first audio data after obtaining the first audio data of the pickup, and decoding the first audio data after transmitting the first audio data from the pickup to the audio listener; decoding the first audio data after obtaining the first audio data of the pickup; encoding the second audio data before transmitting the second audio data to the audio listener, and decoding the second audio data after transmitting the second audio data to the audio listener.

[0021] According to a second aspect of the present application, the present application further provides an audio listening system, including: a pickup for picking up sound to obtain first audio data and further for transmitting the first audio data; an audio listener for listening to the audio data; and a controller for pairing the pickup and the audio listener, establishing a transmission channel, obtaining the first audio data transmitted by the pickup, obtaining second audio data of the device side, and transmitting the first audio data and / or the second audio data to the audio listener, where the transmission channel includes an instruction transmission link and an audio transmission link.

[0022] According to a third aspect of the present application, the present application further provides a wireless audio device including the above audio listening system.

[0023] Through one embodiment or multiple embodiments of the above embodiments in the present application, at least the following technical effects can be achieved:

[0024] In the technical solution disclosed in the present application, the first audio data of the audio user himself can be obtained through a pick-up, and the second audio data of the device end can be acquired. After transmitting the first audio data and / or the second audio data to the audio receiver, the first audio data and / or the second audio data can be listened to on the audio receiver, so that the first audio data and / or the second audio data can be heard by the video user in real time and the quality of the audio can be judged. If the quality of the audio is unqualified, it can be re-recorded, without having to wait until the audio is produced to know the quality of the audio and re-collect the audio, thereby reducing the time spent by the audio user on audio collection. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The following will, with reference to the accompanying drawings, clearly and completely describe the technical solutions in the embodiments of the present application through detailed descriptions of the specific embodiments of the present application, making the technical solutions and other beneficial effects of the present application obvious.

[0026] Figure 1 It is a flowchart of the audio listening method provided by the embodiment of the present application;

[0027] Figure 2 It is a schematic diagram of an audio receiver listening to multiple pick-ups in the audio listening method provided by the embodiment of the present application;

[0028] Figure 3 It is a schematic diagram of multiple audio receivers listening to one pick-up in the audio listening method provided by the embodiment of the present application;

[0029] Figure 4 It is a schematic block diagram of the structure of the audio listening system provided by the embodiment of the present application;

[0030] Figure 5 It is a schematic diagram of an audio receiver listening to three pick-ups provided by the present application;

[0031] Figure 6 It is a schematic diagram of three audio receivers listening to one pick-up provided by the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0032] The following will, with reference to the accompanying drawings in the embodiments of the present application, clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative efforts fall within the scope of protection of the present application.

[0033] In the description of the present application, it should be noted that unless otherwise clearly specified and defined, the term "and / or" in this text is merely a correlation relationship describing associated objects, indicating that there can be three relationships. For example, A and / or B can represent three situations: A exists alone, A and B exist simultaneously, and B exists alone. In addition, the character " / " in this text generally represents an "or" relationship between the associated objects before and after without special explanation.

[0034] With the development of the Internet, especially the explosive growth of short videos, it is driving the arrival of the era of all-media self-media, making everyone a creator. Audio users need higher-quality audio content to improve the quality of short videos. These audio contents include the sounds emitted by audio users themselves, the sounds emitted by devices, etc. After collecting these audios, audio users can produce them in ways such as editing.

[0035] Currently, when audio users collect the sounds they emit themselves, they generally use wireless microphones. For example, they speak into the wireless microphone. However, traditional wireless microphones have a pain point: the quality of the recording can only be confirmed after the recording is completed, which undoubtedly increases the uncertainty of creation and the risk of rework. This makes audio users spend more time on audio collection.

[0036] Existing live broadcast systems cannot listen to audio in real time, and there may be problems such as audio jitter, out-of-sync, and unclear sound quality in audio transmission, resulting in poor live broadcast effects.

[0037] And after the recording is completed or during the live broadcast, if you want to listen to the audio content before production, it depends on connecting a wired headset through the headphone jack on the device side. This limits the activity range of audio creators and makes it difficult to control the audio quality in real time and flexibly.

[0038] Figure 1 The following shows the audio listening method provided by the embodiment of the present application, including:

[0039] S101. Pair the pickup and the audio receiver to establish a transmission channel, where the transmission channel includes an instruction transmission link and an audio transmission link.

[0040] Taking the controller as a dongle device, the pickup as a microphone, and the audio receiver as a headset as an example, after the dongle device is powered on, it starts wireless timed broadcasting, broadcasting pairing information and listening information. After the microphone and the headset are powered on, they search for the broadcast. If they search for the matching pairing information, they execute the pairing and connection process with the dongle device.

[0041] During the pairing process, the device group hopping sequence in the broadcast information is used for matching. The device group refers to all wireless microphones, all headphones, headphones that only listen to audio but are not connected to the dongle, and the dongle device connected to the Dongle, which together form a device group. The Dongle uniformly assigns the hopping sequence of each device and information such as the time slice allocation for external broadcasting of each connected device in the broadcast information.

[0042] S102. Use a pickup to pick up sound and obtain first audio data. The pickup is also used to transmit the first audio data.

[0043] In this embodiment, after the microphone is powered on, it can start picking up sound and generating first audio data. The microphone can send the first audio data to the dongle device or directly send the first audio data to the headphones.

[0044] S103. Obtain the first audio data transmitted by the pickup and obtain the second audio data at the device end.

[0045] In this embodiment, the Dongle device receives the first audio data according to the channel hopping sequence and period in its own broadcast information; and picks up the second audio data from a PC / mobile phone / camera / video camera through a wired connection such as a USB cable or an audio cable.

[0046] If the microphone and the dongle device are successfully connected, the picked-up second audio data will be transmitted periodically according to the device group channel hopping sequence in the pairing broadcast information and on a given time slice.

[0047] S104. Transmit the first audio data and / or the second audio data to an audio listener.

[0048] In this embodiment, after the headphones are powered on, they search for broadcasts. If they search for a matching pairing broadcast information, they start connecting to the dongle. If the connection is successful, they start receiving the audio data broadcast by the Dongle and select one or two channels to output sound together.

[0049] In other embodiments, after the headphone device is powered on, it searches for broadcasts. If it searches for a matching pairing broadcast information, but the user selects the listen-only mode, the headphones will enter the pure listening mode and only receive several mixed audio data broadcast by the dongle according to the hopping sequence information in the pairing broadcast, and select one or two channels to output sound together.

[0050] In the above embodiments, when the Dongle broadcasts audio data, it can output sound through one channel or through two channels simultaneously. Generally, the headphones that receive the audio data broadcast by the Dongle have two channels, which enables the sound of one or two channels to be transmitted into the headphone channels, so that the headphones can receive all the sounds.

[0051] When the headphones receive the audio data broadcast by the Dongle, they can also choose one or two channels. For example, if the Dongle broadcasts the audio data through two channels, the headphones can choose to receive one or both of them.

[0052] In this embodiment, the pickup is used to pick up the sound of the audio user, and it can be a microphone device (including wireless and wired), a recording device, etc.

[0053] The audio receiver is used to receive the sound from the pickup and the device end, and it can be headphones (including wireless and wired), an audio playback device, etc.

[0054] The device end can be an electronic device that can generate sound, such as a computer, a tablet computer, a mobile phone, a camera, a video camera, etc.

[0055] Therefore, the audio listening method provided in this embodiment can obtain the first audio data of the audio user himself through the pickup, and can also obtain the second audio data of the device end. After transmitting the first audio data and / or the second audio data to the audio receiver, the first audio data and / or the second audio data can be listened to on the audio receiver, so that the first audio data and / or the second audio data can be heard by the video user in real time and the quality of the audio can be judged. If the quality of the audio is unqualified, it can be re-recorded directly, without having to wait until the audio is produced to know the quality of the audio and then re-collect the audio, thus reducing the time spent by the audio user in audio collection.

[0056] When both the first audio data and the second audio data are sent to the audio receiver, the audio receiver can receive both the first audio data and the second audio data simultaneously, so as to judge the quality of the individual first audio data or the second audio data, and can also judge the quality of the mixed audio data formed when the first audio data and the second audio data exist simultaneously. When the purpose of the audio creator is to synthesize the first audio data and the second audio data, the quality of the synthesized audio can be judged through the mixed audio data before the first audio data and the second audio data are synthesized. If the quality is unqualified, the audio can be re-collected directly, without having to wait until the production to find that the quality of the synthesized audio is unqualified and then re-record and produce the audio, thus reducing the time spent by the audio user in audio collection.

[0057] The following describes the audio listening method provided in this embodiment in combination with two actual application scenarios, where the two actual application scenarios are interview recording and live program respectively.

[0058] In the scenario of interview recording, the interviewer wears a first microphone, the interviewee wears a second microphone, and the interviewer, the interviewee or / and the backstage staff wear headphones.

[0059] After the first microphone, the second microphone and the headphones are powered on, first pair the first microphone, the second microphone with the headphones to establish a transmission channel.

[0060] When the interviewer speaks, pick up the sound with the first microphone to obtain the first audio data. When the interviewee speaks, pick up the sound with the second microphone to obtain the first audio data.

[0061] At this time, the Dongle obtains the first audio data, and the Dongle obtains the second audio data on the device side. Among them, the second audio data can be the background music, the voice of the person's background introduction, etc. when the recording needs to be played.

[0062] Subsequently, the Dongle can transmit the first audio data or / and the second audio data to the headphones.

[0063] The interviewer, the interviewee or / and the backstage staff wearing the headphones can listen to the first audio data or / and the second audio data at any time. Especially for the backstage staff, they can judge the quality of the single first audio data or the second audio data, and can also judge the quality of the mixed audio data formed when the first audio data and the second audio data exist at the same time. When the purpose of the backstage staff is to synthesize the first audio data and the second audio data to form the recorded audio, they can judge the quality after the two are synthesized through the mixed audio data before the first audio data and the second audio data are synthesized. If the quality is unqualified, they can just collect the audio again, without having to find that the quality after the two are synthesized is unqualified during the production and then resample, record and produce the audio again, thus reducing the time spent on audio collection in the recorded interview.

[0064] In the scenario of a live program, the host in the live broadcast room wears a microphone and a first pair of headphones. If the live broadcast room has a backstage team, such as a sound mixer, a director, a producer, etc., the personnel of the backstage team can also wear a second pair of headphones. It should be noted that there can be multiple second pairs of headphones.

[0065] After the microphone and the headphones are powered on, pair the host's microphone with the first pair of headphones and the second pair of headphones to establish a transmission channel.

[0066] When the host speaks, sings or makes other sounds, a microphone is used for sound pickup to obtain first audio data.

[0067] At this time, the Dongle obtains the first audio data, and the Dongle also obtains second audio data on the device side. The second audio data can be the background music, dubbing, etc. played in the live broadcast room on the live broadcast device.

[0068] Subsequently, the Dongle can transmit the first audio data or / and the second audio data to the host's first earphone and to the second earphone of the backstage team.

[0069] The host can listen to the first audio data or / and the second audio data at any time through the earphone. If the first audio data or / and the second audio data is inappropriate, for example, there are problems such as audio stuttering, out-of-sync, unclear sound quality, etc., the host can quickly notice, and thus change the first audio data of himself, or switch the second audio data, or change the rhythm of the first audio data or the second audio data to make them synchronized, etc., all of which can improve the live broadcast effect.

[0070] Compared with the host, the backstage team can more attentively distinguish the quality of the first audio data or / and the second audio data. Therefore, after the backstage team listens to the first audio data or / and the second audio data at any time through the second earphone, if there are problems with the quality of the audio data that need to be improved, such as audio stuttering, out-of-sync, unclear sound quality, etc., the backstage team can notice more quickly, and thus remind the host to change the first audio data, or switch the second audio data, or change the rhythm of the second audio data to make them synchronized, etc., all of which can improve the live broadcast effect.

[0071] In some embodiments, the duration of sound pickup by the sound pickup device is the first duration, the transmission duration of obtaining the first audio data transmitted by the sound pickup device is the second duration, and the transmission duration of transmitting the first audio data and / or the second audio data to the audio receiver is the third duration. Among them, the sum of the second duration and the third duration is less than or equal to the first duration.

[0072] In some embodiments, the sound pickup device emits the first audio data periodically, and the transmission of the first audio data and / or the second audio data is periodic.

[0073] Through periodic transmission, one audio collection can be divided into several times, so as to realize real-time listening to the audio.

[0074] In some embodiments, at least one audio receiver is used to listen to at least one sound pickup device, including using M audio receivers to listen to N sound pickup devices, where M is 1 and N is greater than or equal to 2; or M is greater than or equal to 2 and N is 1.

[0075] For example, please refer to Figure 2 , use an audio receiver to listen to multiple pickups, and use a controller to execute the audio listening method, so that an audio receiver can be used to listen to the audio of multiple pickups simultaneously, thereby improving the efficiency of audio collection.

[0076] For another example, please refer to Figure 3 , use multiple audio receivers to listen to one pickup, so that multiple audio users can simultaneously receive the audio data obtained by one pickup, thereby facilitating multiple people to simultaneously judge the quality of the audio data obtained by the pickup and improving the efficiency of audio data quality judgment.

[0077] In some embodiments, step 104, transmitting the first audio data and / or the second audio data to the audio receiver includes: mixing the first audio data and the second audio data to obtain mixed audio data; transmitting at least one of the first audio data, the second audio data, and the mixed audio data to the audio receiver through an audio transmission link.

[0078] In this embodiment, the Dongle device mixes the wireless audio track from the microphone and the wired audio track from the wired device in various permutations and combinations according to user requirements, finally forms several mixed audio data, the channel hopping sequence of the device group, and periodically broadcasts them to the headphones on a given time slice.

[0079] Among them, when the Dongle broadcasts the first audio data, the second audio data, and / or the mixed audio data to the headphones, it can select the audio data to be broadcast to the headphones from the Dongle. For example, the Dongle has the first audio data, the second audio data, and the mixed audio data, and the Dongle only broadcasts the mixed audio data to the headphones, and only receives the mixed audio data at the headphones.

[0080] When the Dongle broadcasts the first audio data, the second audio data, and / or the mixed audio data to the headphones, it can also select the audio to be received from the headphones. For example, the Dongle broadcasts the first audio data, the second audio data, and the mixed audio data to the headphones. If the mixed audio data is selected from the headphones, only the mixed audio data is received at the headphones.

[0081] When the Dongle broadcasts the first audio data, the second audio data, and / or the mixed audio data to the headphones, it can also select the audio received at the headphones from the microphone. For example, at the microphone, control the Dongle to only transmit the mixed audio data to the headphones, then only the mixed audio data is received at the headphones. For another example, select the audio that the headphones need to receive at the microphone, and for the first audio data, the second audio data, and the mixed audio data transmitted by the Dongle to the headphones, only control the headphones to receive the mixed audio data, then only the mixed audio data can be received at the headphones.

[0082] This embodiment can transmit at least one of the first audio data, the second audio data, and the mixed audio data to the audio receiver. For example, it can transmit the first audio data to the audio receiver, or transmit the second audio data to the audio receiver, or transmit the mixed audio data to the audio receiver. Therefore, when recording audio, the audio user can hear any one of the first audio data, the second audio data, and the mixed audio data on the audio receiver, so as to judge in real time whether the audio data meets the quality requirements.

[0083] For another example, it can transmit the first audio data and the second audio data to the audio receiver, or transmit the first audio data and the mixed audio data to the audio receiver, or transmit the second audio data and the mixed audio data to the audio receiver. Therefore, when recording audio, the audio user can hear any two of the first audio data, the second audio data, and the mixed audio data on the audio receiver, so as to judge in real time whether the audio data meets the quality requirements.

[0084] For another example, it can transmit all of the first audio data, the second audio data, and the mixed audio data to the audio receiver. The audio user can hear the first audio data, the second audio data, and the mixed audio data on the audio receiver when recording audio, so as to judge in real time whether the audio data meets the quality requirements.

[0085] In this embodiment, the audio listening method further includes: transmitting at least one of the first audio data, the second audio data, and the mixed audio data to the device side.

[0086] In this embodiment, the Dongle device mixes the wireless track from the microphone and the wired track from the wired device in various permutations and combinations according to the user's needs, and finally forms several mixed or independent audio track data, and uploads all the finally formed track data to the PC / mobile phone / camera / camera device by means of USB or other wired means.

[0087] This embodiment can listen to at least one of the first audio data, the second audio data, and the mixed audio data on the device side, so as to facilitate the audio user to listen to and produce the audio data on the device side.

[0088] Among them, the Dongle can be connected to the device side through a wireless communication protocol. In this embodiment, the wireless communication protocol is the Bluetooth protocol. In other embodiments, the wireless communication protocol can also be a cellular protocol, a WiFi protocol, etc.

[0089] In this embodiment, when the Dongle transmits the first audio data, the second audio data, and / or the mixed audio data to the device side, it can select the audio data to be transmitted to the device side from the Dongle. For example, if the Dongle has the first audio data, the second audio data, and the mixed audio data, and the Dongle only broadcasts the mixed audio data to the device side, then only the mixed audio data is received at the device side.

[0090] In other embodiments, when the Dongle transmits the first audio data, the second audio data, and / or the mixed audio data to the device side, it can select the audio to be received from the device side. For example, if the Dongle sends the first audio data, the second audio data, and the mixed audio data to the device side, and the device side only receives the mixed audio data, then only the mixed audio data is received at the device side. Among them, the device side can select the audio to be received through an APP, a web page, etc.

[0091] In this embodiment, the audio listening method further includes: encoding the first audio data after obtaining the first audio data of the pickup; decoding the first audio data before mixing the first audio data and the second audio data; encoding the mixed audio data after mixing the first audio data and the second audio data; and decoding the mixed audio data after transmitting the mixed audio data to the audio listener.

[0092] During the entire process of listening to the audio, the time required includes the above-mentioned first duration, second duration, and third duration, and also includes the encoding and decoding times in this embodiment. These times are all in milliseconds. For example, if the first duration of sound pickup is 5 ms, then the time of the entire process will not exceed 20 ms, so that the listening delay of the audio is less than 20 ms, having a relatively low delay.

[0093] In other embodiments, step 104, transmitting the first audio data and / or the second audio data to the audio listener includes: transmitting the first audio data from the pickup to the audio listener, or / and, transmitting the second audio data to the audio listener through an audio transmission link.

[0094] In this embodiment, the first audio data can be directly transmitted from the pickup to the audio listener, thereby reducing the transmission time of the first audio data and reducing the delay of the entire audio listening process.

[0095] In this embodiment, step 104 of transmitting the first audio data and / or the second audio data to the audio receiver further includes: mixing the first audio data of at least one pickup or / and the second audio data of at least one device end to obtain mixed audio data, and transmitting the mixed audio data to the device end through an audio transmission link; obtaining third audio data of the device end, where the third audio data includes at least one of the mixed audio data and the second audio data of the device end; and transmitting the third audio data to the audio receiver through the audio transmission link.

[0096] In this embodiment, the Dongle device mixes the wireless audio track from the microphone and the wired audio track from the wired device in various permutations and combinations according to user needs, and finally forms several mixed or independent audio track data, and uploads all the finally formed track data to the PC / mobile phone / camera / video camera device by USB or other wired means.

[0097] Subsequently, the Dongle device mixes the audio data from the PC / mobile phone / camera / video camera in various permutations and combinations according to user needs, and finally forms several mixed or independent audio track data, and broadcasts them to the headphones periodically on a given time slice according to the channel hopping sequence of the device group.

[0098] During the whole process of listening to the audio, the time required includes the above-mentioned first duration, second duration, and third duration, and also includes the encoding and decoding time of this embodiment. These times are all in milliseconds. For example, if the first duration of sound pickup is 5 ms, then the time of the whole process will not exceed 20 ms. Further, in this embodiment, the pickup directly transmits the first audio data to the audio receiver. In the transmission of the first audio, there is no need for the Dongle to receive the first audio data, then decode, store, encode, and send it to the audio receiver. Therefore, the 5 ms time required for the transmission of the first audio can be reduced, so that the whole process of the audio listening method will not exceed 15 ms, having a lower latency.

[0099] This embodiment can not only directly transmit the first audio data from the pickup to the audio receiver, but also obtain the third audio data from the device end, thereby expanding the audio range listened to by the audio receiver.

[0100] In step 104, after transmitting the first audio data and / or the second audio data to the audio receiver, after the headphone device is powered on, it searches for the Dongle broadcast. If a matching pairing broadcast message is found, it starts to connect to the Dongle. If the connection is successful, it starts to receive several audio data from the microphone and the Dongle in the device group, and mixes and plays all the received audio tracks in one or two ways according to user needs.

[0101] Alternatively, after the headphone device is powered on, it searches for the dongle broadcast. If a matching pairing broadcast message is found, but the user selects the listen-only mode, the headphones will enter the pure listening mode. Only according to the frequency hopping sequence information in the pairing broadcast, the headphones will receive several audio data from the microphones and the Dongle in the device group, and arrange and mix all the received audio tracks as required into one or two channels and then play them out.

[0102] In this embodiment, the audio listening method further includes: after obtaining the first audio data of the pickup, encoding the first audio data, and transmitting the first audio data from the pickup to the audio listener and then decoding the first audio data; after obtaining the first audio data of the pickup, decoding the first audio data; encoding the second audio data before transmitting the second audio data to the audio listener, and decoding the second audio data after transmitting the second audio data to the audio listener.

[0103] During the whole process of listening to the audio, the time required includes the above-mentioned first duration, second duration, and third duration, as well as the encoding and decoding time in this embodiment. Since the pickup directly transmits the first audio data to the audio listener in this embodiment without going through a transfer, the audio listening delay can be further reduced.

[0104] In some embodiments, the audio listening method further includes: connecting to the pickup through multicast and connecting to the audio listener through multicast.

[0105] For example, multicast includes broadcast. Connect to the pickup in the way of broadcast and connect to the audio listener in the way of multicast. Such a connection is a one-way connection for audio transmission to realize the audio listening function. Another example is that multicast can also be multicast. The specific implementation manner of multicast is not limited in the embodiments of the present application.

[0106] In other embodiments, the audio listening method further includes: connecting to the pickup through a first transmission channel and connecting to the audio listener through a second transmission channel; transmitting a control instruction to the pickup through the instruction transmission link of the first transmission channel to control the pickup, and transmitting a control instruction to the audio listener through the instruction transmission link of the second transmission channel to control the audio listener.

[0107] In this embodiment, the connection with the pickup is a two-way connection, and the connection with the audio listener is also a two-way connection. In addition to being able to perform audio transmission, it can also transmit control instructions to the pickup and the audio listener to control the pickup and the audio listener.

[0108] In some embodiments, the audio listening method further includes: storing the first audio data from different pickups in partitions and storing the second audio data from different device ends in partitions.

[0109] In this embodiment, the Dongle device receives audio data according to the channel hopping sequence and period in its own broadcast information, and stores the received multiple microphone audio data in different track memories. Moreover, the Dongle device picks up audio data from a PC / mobile phone / camera / video camera through a wired connection such as a USB cable or an audio cable, and stores it in different track memories.

[0110] This embodiment can store the first audio data of different pickups in partitions, and can also store the second audio data of different device terminals in partitions, which can prevent data crosstalk between different first audio data, different second audio data, and between the first audio data and the second audio data.

[0111] In some embodiments, the audio listening method further includes: obtaining the number of listening channels of the audio listener; transmitting the first audio data and / or the second audio data to the audio listener through a predetermined number of channels, where the predetermined number is less than or equal to the number of listening channels.

[0112] In this embodiment, since the number of listening channels of the audio listener is limited. For example, when using a pair of headphones to listen to audio, there are two listening channels; when using two pairs of headphones to listen to audio, there are four listening channels. Therefore, when the number of listening channels is limited, the number of channels for transmitting audio data cannot exceed the number of listening channels to prevent errors in audio listening.

[0113] In some embodiments, the audio listening method performs data transmission based on a wireless communication protocol.

[0114] In this embodiment, the wireless communication protocol used is the Bluetooth protocol. It should be noted that the Bluetooth protocol is only one implementation method provided in this embodiment, and other wireless communication protocols are still applicable to this embodiment. For example, other wireless communication protocols are the WiFi protocol, the cellular protocol, etc.

[0115] Please refer to Figure 4 , this application embodiment also provides an audio listening system, including: a pickup 13, an audio listener 11, and a controller 12; the pickup 13 is used for picking up sound to obtain the first audio data and is also used for transmitting the first audio data; the audio listener 11 is used for listening to the audio data; the controller 12 is used for obtaining the first audio data transmitted by the pickup 13, obtaining the second audio data of the device terminal, and transmitting the first audio data and / or the second audio data to the audio listener 11.

[0116] In this embodiment, the controller 12 can be a wireless adapter, the pickup 13 is a wireless microphone, the audio receiver 11 is a wireless earphone, the number of pickups 13 is M, and the number of audio receivers 11 is N, where M is greater than or equal to 1 and N is greater than or equal to 1.

[0117] For example, please refer to Figure 2 , when M is 1, one audio receiver 11 can be used to listen to multiple pickups 13, and the controller 12 is used to execute the audio listening method. In this way, one audio receiver 11 can simultaneously listen to the audio of multiple pickups 13, thereby improving the efficiency of audio collection.

[0118] For another example, please refer to Figure 3 , when N is 1, multiple audio receivers 11 can also be used to listen to one pickup 13. In this way, multiple audio users can simultaneously hear the audio data obtained by one pickup 13, thereby facilitating multiple people to simultaneously judge the quality of the audio data obtained by the pickup 13 and improving the efficiency of audio data quality judgment.

[0119] The audio listening system provided in this embodiment can obtain the first audio data of the audio user himself through the pickup 13, and can obtain the second audio data of the device end through the controller 12. After the controller 12 transmits the first audio data and / or the second audio data to the audio receiver 11, the first audio data and / or the second audio data can be listened to on the audio receiver 11, so that the first audio data and / or the second audio data can be heard by the video user in real time and the quality of the audio can be judged. If the quality of the audio is unqualified, it can be re-recorded directly, without having to wait until the audio is produced to know the quality of the audio and then re-collect the audio, thereby reducing the time spent by the audio user in audio collection.

[0120] In some embodiments, the step of the controller 12 transmitting the first audio data and / or the second audio data to the audio receiver 11 includes: mixing the first audio data and the second audio data to obtain mixed audio data; transmitting at least one of the first audio data, the second audio data, and the mixed audio data to the audio receiver 11.

[0121] In some embodiments, the controller 12 is further configured to transmit at least one of the first audio data, the second audio data, and the mixed audio data to the device end.

[0122] In some embodiments, the step of the controller 12 transmitting the first audio data and / or the second audio data to the audio receiver 11 includes: transmitting the second audio data to the audio receiver 11.

[0123] And in this embodiment, the pickup 13 directly transmits the first audio data to the audio receiver 11.

[0124] In this embodiment, the step in which the controller 12 transmits the first audio data and / or the second audio data to the audio receiver 11 further includes: mixing the first audio data of at least one pickup 13 or / and the second audio data of at least one device end to obtain mixed audio data, and transmitting the mixed audio data to the device end; obtaining the third audio data of the device end, where the third audio data includes at least one of the mixed audio data and the second audio data of the device end; and transmitting the third audio data to the audio receiver 11.

[0125] In some embodiments, the controller 12 is wirelessly connected to the pickup 13 through multicast, and the controller 12 is wirelessly connected to the audio receiver 11 through multicast.

[0126] In this embodiment, multicast includes broadcast.

[0127] In some embodiments, the controller 12 is connected to the pickup 13 through a first transmission channel, and the controller 12 is connected to the audio receiver 11 through a second transmission channel; the controller 12 is further configured to transmit a control instruction to the pickup 13 through the first transmission channel to control the pickup 13, and transmit a control instruction to the audio receiver 11 through the second transmission channel to control the audio receiver 11.

[0128] In some embodiments, the controller 12 is further configured to store the first audio data from different pickups 13 in partitions, and store the second audio data from different device ends in partitions.

[0129] In some embodiments, the controller 12 is further configured to obtain the number of listening channels of the audio receiver 11; transmit the first audio data and / or the second audio data to the audio receiver 11 through a predetermined number of channels, where the predetermined number is less than or equal to the number of listening channels.

[0130] In some embodiments, the first audio data transmitted by the pickup 13 is periodic, and the transmission of the first audio data and / or the second audio data by the controller 12 is periodic.

[0131] In some embodiments, data is transmitted between the pickup 13, the controller 12, and the audio receiver 11 through a wireless communication protocol, where the wireless communication protocol includes a Bluetooth protocol and a WiFi protocol.

[0132] In some embodiments, the duration of sound pickup by the pickup 13 is a first duration, the transmission duration of the first audio data transmitted by the controller 12 and obtained from the pickup 13 is a second duration, and the transmission duration of the first audio data and / or the second audio data transmitted by the controller 12 to the audio receiver 11 is a third duration, where the sum of the second duration and the third duration is less than or equal to the first duration.

[0133] In some embodiments, after the pickup 13 picks up sound to obtain first audio data, the first audio data is encoded; before the controller 12 mixes the first audio data and the second audio data, the first audio data is decoded; after the controller 12 mixes the first audio data and the second audio data, the mixed audio data is encoded; after the mixed audio data is transmitted to the audio receiver 11, the audio receiver 11 decodes the mixed audio data.

[0134] In some embodiments, after the pickup 13 picks up sound to obtain first audio data, the first audio data is encoded, and after the first audio data is transmitted from the pickup 13 to the audio receiver 11, the audio receiver 11 decodes the first audio data; after the controller 12 obtains the first audio data of the pickup 13, the first audio data is decoded; before the controller 12 transmits the second audio data to the audio receiver 11, the second audio data is encoded, and after the second audio data is transmitted to the audio receiver 11, the audio receiver 11 decodes the second audio data.

[0135] An embodiment of the present application further provides a wireless audio device, including the audio listening system in any of the above embodiments. In this embodiment, the wireless audio device may be a wireless microphone. In other embodiments, the wireless audio device may also be a headphone device, etc.

[0136] The technical solutions provided by the embodiments of the present application will be described below in conjunction with specific embodiments.

[0137] Embodiment 1:

[0138] This embodiment provides an audio listening method for using one audio receiver to listen to three pickups. The audio listening method includes:

[0139] S111. Pair three pickups and one audio receiver.

[0140] S112. Use the three pickups to pick up sound to obtain three first audio data, and the pickups are also used to transmit the corresponding first audio data.

[0141] S113. Obtain the first audio data transmitted by the pickups and obtain the second audio data at the device end.

[0142] S114. Transmit the three first audio data and / or the second audio data to the audio receiver.

[0143] In this embodiment, step S114 of transmitting the three first audio data and / or second audio data to the audio receiver includes: mixing at least one of the first audio data and the second audio data to obtain mixed audio data; transmitting at least one of the first audio data, the second audio data, and the mixed audio data to the audio receiver.

[0144] Please refer to Figure 5 , the audio listening method provided in this embodiment can obtain the first audio data of three audio users themselves through three pickups, and can obtain the second audio data of the device side. After transmitting the first audio data and / or the second audio data to the audio receiver, the three first audio data and / or the second audio data and / or the mixed audio data can be listened to on one audio receiver, so that the three first audio data and / or the second audio data and / or the mixed audio data can be heard by the audio user in real time and the quality of the audio can be judged. If the quality of the audio is unqualified, it can be re-recorded without waiting until the audio is produced to know the quality of the audio and re-collect the audio, thereby reducing the time spent by the audio user on audio collection.

[0145] Embodiment Two:

[0146] This embodiment provides an audio listening method for using three audio receivers to listen to one pickup. The audio listening method includes:

[0147] S121. Pair one pickup with three audio receivers.

[0148] S122. Use the pickup to pick up sound to obtain the first audio data, and the pickup is also used to transmit the corresponding first audio data.

[0149] S123. Obtain the first audio data transmitted by the pickup, and obtain the second audio data of the device side.

[0150] S124. Transmit the first audio data and / or the second audio data to the three audio receivers.

[0151] In this embodiment, step S124 of transmitting the first audio data and / or the second audio data to the three audio receivers includes: mixing the first audio data and the second audio data to obtain mixed audio data; transmitting at least one of the first audio data, the second audio data, and the mixed audio data to the three audio receivers.

[0152] Please refer to Figure 6, the audio listening method provided in this embodiment can obtain the first audio data of the audio user himself through a pickup, and can obtain the second audio data of the device end. After transmitting the first audio data and / or the second audio data to three audio listeners, the first audio data and / or the second audio data and / or the mixed audio data can be listened to on the three audio listeners, so that the first audio data and / or the second audio data and / or the mixed audio data can be heard by three audio users in real time and the quality of the audio can be judged. If the quality of the audio is unqualified, it can be re-recorded, without having to wait until the audio is produced to know the quality of the audio and re-collect the audio, thus reducing the time spent by the audio user in audio collection.

[0153] Embodiment 3:

[0154] This embodiment provides an audio listening system for using one audio listener to listen to three pickups. The audio listening system includes:

[0155] Pickups, three in number, for picking up sound to obtain the first audio data, and also for transmitting the first audio data. Each pickup corresponds to one first audio data;

[0156] Audio listeners, for listening to audio data;

[0157] A controller, for obtaining the first audio data transmitted by the pickup, and obtaining the second audio data of the device end, and transmitting the first audio data and / or the second audio data to the audio listener.

[0158] In this embodiment, the controller transmitting the three first audio data and / or the second audio data to the audio listener includes: mixing at least one first audio data and the second audio data to obtain mixed audio data; transmitting at least one of the first audio data, the second audio data, and the mixed audio data to the audio listener.

[0159] Please refer to Figure 5 , the audio listening system provided in this embodiment can obtain the first audio data of three audio users themselves through three pickups, and can obtain the second audio data of the device end. After transmitting the first audio data and / or the second audio data to the audio listener, the three first audio data and / or the second audio data and / or the mixed audio data can be listened to on one audio listener, so that the three first audio data and / or the second audio data and / or the mixed audio data can be heard by the audio user in real time and the quality of the audio can be judged. If the quality of the audio is unqualified, it can be re-recorded, without having to wait until the audio is produced to know the quality of the audio and re-collect the audio, thus reducing the time spent by the audio user in audio collection.

[0160] Embodiment 4:

[0161] This embodiment provides an audio listening system for listening to a pickup using three audio listeners. The audio listening system includes:

[0162] A pickup for picking up sound to obtain first audio data and also for transmitting the first audio data;

[0163] Three audio listeners for listening to the audio data;

[0164] A controller for obtaining the first audio data transmitted by the pickup, obtaining second audio data of the device end, and transmitting the first audio data and / or the second audio data to the three audio listeners.

[0165] In this embodiment, the controller transmitting the first audio data and / or the second audio data to the three audio listeners includes: mixing the first audio data and the second audio data to obtain mixed audio data; transmitting at least one of the first audio data, the second audio data, and the mixed audio data to the three audio listeners.

[0166] Please refer to Figure 6 , the audio listening system provided in this embodiment can obtain the first audio data of the audio user himself through a pickup, and can obtain the second audio data of the device end. After transmitting the first audio data and / or the second audio data to the three audio listeners, the first audio data and / or the second audio data and / or the mixed audio data can be listened to on the three audio listeners, so that the first audio data and / or the second audio data and / or the mixed audio data can be heard by three audio users in real time and the quality of the audio can be judged. If the quality of the audio is unqualified, it can be re-recorded without waiting until the audio is produced to know the quality of the audio and re-collect the audio, thus reducing the time spent by the audio user in audio collection.

[0167] It should be noted that for the foregoing method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations. However, those skilled in the art should know that the present invention is not limited by the described action sequence, because according to the present invention, certain steps can be in other sequences or performed simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to the present invention.

[0168] In the above embodiments, the descriptions of the respective embodiments have their own emphases. For the parts not detailed in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0169] In summary, although the present application has been disclosed above with preferred embodiments, the above preferred embodiments are not intended to limit the present application. Those of ordinary skill in the art can make various changes and modifications without departing from the spirit and scope of the present application. Therefore, the protection scope of the present application shall be subject to the scope defined by the claims.

Claims

1. An audio listening method, characterized in that, Including: Pair the pickup and the audio listener to establish a transmission channel; Use the pickup to pick up sound to obtain first audio data, and the pickup is also used to transmit the first audio data; Obtain the first audio data transmitted by the pickup and obtain second audio data at the device end; Transmit the first audio data and / or the second audio data to the audio listener; Wherein, the transmission channel includes an instruction transmission link and an audio transmission link.

2. The audio listening method according to claim 1, wherein At least one audio listener is used to listen to at least one pickup, including using M audio listeners to listen to N pickups, where M is 1 and N is greater than or equal to 2; or M is greater than or equal to 2 and N is 1; The step of transmitting the first audio data and / or the second audio data to the audio listener includes: Mix the first audio data and the second audio data to obtain mixed audio data; Transmit at least one of the first audio data, the second audio data, and the mixed audio data to the audio listener through the audio transmission link.

3. The audio listening method according to claim 2, wherein The method further includes: transmitting at least one of the first audio data, the second audio data, and the mixed audio data to the device end through the audio transmission link.

4. The audio listening method according to claim 1, wherein At least one audio listener is used to listen to at least one pickup, including using M audio listeners to listen to N pickups, where M is 1 and N is greater than or equal to 2; or M is greater than or equal to 2 and N is 1; The step of transmitting the first audio data and / or the second audio data to the audio listener includes: Transmit the first audio data from the pickup to the audio listener, or / and transmit the second audio data to the audio listener through the audio transmission link.

5. The audio listening method according to claim 4, wherein The step of transmitting the first audio data and / or the second audio data to the audio listener further includes: Mix at least one of the first audio data of at least one of the pickups and / or the second audio data of at least one of the device ends to obtain mixed audio data, and transmit the mixed audio data to the device end through the audio transmission link; Obtain third audio data at the device end, where the third audio data includes at least one of the mixed audio data and the second audio data at the device end; Transmit the third audio data to the audio listener through the audio transmission link.

6. The audio listening method according to claim 1, wherein The method further includes: connecting to the pickup through multicast and connecting to the audio listener through multicast.

7. The audio listening method according to claim 1, wherein The method further includes: connecting to the pickup through a first transmission channel and connecting to the audio listener through a second transmission channel; Transmit control instructions to the pickup through the instruction transmission link of the first transmission channel to control the pickup, and transmit control instructions to the audio receiver through the instruction transmission link of the second transmission channel to control the audio receiver.

8. The audio listening method according to claim 1, wherein the method further comprises: storing the first audio data from different pickups in partitions, and storing the second audio data from different device terminals in partitions.

9. The audio listening method according to claim 1, wherein the method further comprises: obtaining the number of listening channels of the audio receiver; transmitting the first audio data and / or the second audio data to the audio receiver through a predetermined number of channels, wherein the predetermined number is less than or equal to the number of listening channels.

10. The audio listening method according to claim 1, wherein the pickup transmits the first audio data periodically, and transmits the first audio data and / or the second audio data periodically.

11. The audio listening method according to any one of claims 1-10, wherein the audio listening method performs data transmission based on a wireless communication protocol, and the wireless communication protocol includes a Bluetooth protocol and a WIFI protocol.

12. The audio listening method according to claim 1, wherein the duration of the pickup for picking up sound is a first duration, the transmission duration of obtaining the first audio data transmitted by the pickup is a second duration, and the transmission duration of transmitting the first audio data and / or the second audio data to the audio receiver is a third duration, wherein the sum of the second duration and the third duration is less than or equal to the first duration.

13. The audio listening method according to claim 2, wherein the method further comprises: encoding the first audio data after picking up the first audio data by using a pickup; decoding the first audio data before mixing the first audio data and the second audio data; encoding the mixed audio data after mixing the first audio data and the second audio data; decoding the mixed audio data after transmitting the mixed audio data to the audio receiver.

14. The audio listening method according to claim 5, wherein the method further comprises: encoding the first audio data after obtaining the first audio data of the pickup, and decoding the first audio data after transmitting the first audio data from the pickup to the audio receiver; decoding the first audio data after obtaining the first audio data of the pickup; encoding the second audio data before transmitting the second audio data to the audio receiver, and decoding the second audio data after transmitting the second audio data to the audio receiver.

15. An audio listening system, characterized in that, Comprising: A pickup, configured to pick up sound to obtain first audio data, and further configured to transmit the first audio data; An audio receiver, configured to listen to audio data; A controller, configured to pair a pickup and an audio receiver, establish a transmission channel, obtain first audio data transmitted by the pickup, obtain second audio data of a device end, and transmit the first audio data and / or the second audio data to the audio receiver; wherein, the transmission channel includes an instruction transmission link and an audio transmission link.

16. A wireless audio device, characterized in that, An audio listening system includes the one described in claim 15.

Images