Audio playing method and device

Abstract

The invention discloses an audio playing method and device. The audio playing method comprises the following steps that: broadcasting equipment acquires to-be-played audio transmitted by source equipment through a unicast link; and when the source device indicates that the application pairing mode is applied to play the audio to be played, the broadcasting device takes itself as a broadcasting media transmitter and broadcasts the audio to be played to the playing device so as to synchronously play the audio to be played through at least one playing device, therefore, the device only supporting the traditional unicast function can play the audio by using the pairwise mode.

Description

Technical Field

[0001] The present application relates to the field of audio playback technology, and in particular to an audio playback method and device thereof. Background Art

[0002] Party mode refers to a scenario in which at least two speakers play the same audio content synchronously, and is currently a hot selling point in the speaker market.

[0003] One of the sound sources in party mode comes from terminal devices such as mobile phones / laptops, such as Figure 1 As shown, for mobile phones that support LE audio broadcast media transmitter BMS (Broadcast Media Sender) and speakers that support broadcast media receiver (Broadcast Media Receiver, BMR), party mode can be implemented through BMS-BMR.

[0004] However, most terminal devices on the market currently only support traditional unicast functions (such as A2DP functions) and cannot support party mode. Therefore, for Bluetooth speakers that only support unicast functions or only support BMR, when using mobile phones / computers, users cannot use the party mode function through their unicast functions. Summary of the invention

[0005] The present application provides an audio playback method and device thereof, which can enable a device that only supports the traditional unicast function to play audio using the party mode.

[0006] To achieve the above object, the present application provides an audio playback method, the method comprising:

[0007] The broadcast device obtains the audio to be played transmitted by the source device through the unicast link;

[0008] When the source device instructs the application party mode to play the audio to be played, the broadcasting device uses itself as a broadcast media transmitter to broadcast the audio to be played to the playback device, so as to synchronously play the audio to be played through at least one playback device.

[0009] To achieve the above-mentioned purpose, the present application also provides a broadcasting device, including a memory and a processor, wherein the memory and the processor are coupled to each other, and the processor is used to execute program instructions stored in the memory to implement the above-mentioned method.

[0010] To achieve the above objectives, the present application also provides a computer-readable storage medium, which is used to store instructions / program data, and the instructions / program data can be executed to implement the above method.

[0011] The present application integrates the unicast data receiving function and the BMS function in the broadcasting device, receives the audio data transmitted by the source device in a unicast link through the unicast data receiving function, and then broadcasts the audio data through the BMS to realize the data conversion between the unicast mode and the broadcast mode. In this way, the party mode is realized between the broadcasting device and the playback device receiving the broadcast data through BMS-BMR, so that terminals such as mobile phones / laptops that only support traditional unicast functions can also use the party mode function of the playback device. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0013] Figure 1 is a schematic diagram of an audio playback method of the related art;

[0014] Figure 2 is a schematic diagram of the audio playback method of the present application;

[0015] Figure 3 It is a flowchart of an implementation method of an audio playback method of the present application;

[0016] Figure 4 This is a schematic diagram of data flow in an audio playback method of the present application;

[0017] Figure 5 is a schematic diagram of the playback delay time agreed upon in an implementation manner of the audio playback method of the present application;

[0018] Figure 6 It is a structural schematic diagram of an implementation mode of a broadcasting device of the present application;

[0019] Figure 7 It is a structural schematic diagram of an implementation method of a computer-readable storage medium of the present application. DETAILED DESCRIPTION

[0020] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without making creative work are within the scope of protection of the present application. In addition, unless otherwise specified (for example, "or in addition" or "or in an alternative"), the term "or" as used herein refers to a non-exclusive "or" (that is, "and / or"). Moreover, the various embodiments described herein are not necessarily mutually exclusive, because some embodiments can be combined with one or more other embodiments to form new embodiments.

[0021] Based on this, Figure 2 As shown, the present application proposes a method of integrating a unicast data receiving function and a BMS function in a broadcasting device, receiving the audio data transmitted by the source device in a unicast link through the unicast data receiving function (such as A2DP sink), and then broadcasting the audio data through the BMS (i.e., for example, A2DP sink to BMS), so that the party mode is implemented between the broadcasting device and the playback device receiving the broadcast data through BMS-BMR, so that terminal users such as mobile phones / laptops that support traditional unicast functions can also use the party mode function of the playback device.

[0022] like Figure 3 As shown, the audio playback method of the present application includes the following steps. Optionally, the audio playback method of the present application can be applied to a broadcasting device. Among them, the broadcasting device may include playback devices such as mobile phones, portable devices, headphones or speakers. In other embodiments, the broadcasting device may also be a non-playback device, and the non-playback device applied by the playback method only needs to have the function of responding to an instruction to play the audio to be played in the application party mode, and broadcasting the audio to be played transmitted by the unicast link to the playback device through the BMS application (broadcast media audio application). It should be noted that the following step numbers are only used to simplify the description and are not intended to limit the execution order of the steps. The execution order of each step of this embodiment can be arbitrarily changed without violating the technical idea of ​​the present application.

[0023] S101: A broadcast device obtains audio to be played that is transmitted by a source device via a unicast link.

[0024] Optionally, the audio to be played transmitted by the source device through the unicast link can be obtained first, so that when an instruction is received from the source device to play the audio to be played in the application party mode, the audio to be played transmitted by the unicast link can be broadcast to the playback device through its broadcast media audio function (i.e., BMS function), so that the audio to be played is played synchronously by itself and / or at least one of its broadcast playback devices, thereby realizing the function of playing the audio to be played through the party mode.

[0025] Optionally, the source device may be a device that does not have the broadcast media audio function, that is, the source device itself may not be able to broadcast audio through the broadcast media audio function. In this case, the source device can make use of a device with the function of "converting unicast link audio to broadcast link transmission" to broadcast the audio to be played through the device with the function of converting unicast link audio to broadcast link transmission, thereby achieving the purpose of playing the audio to be played through the party mode.

[0026] Of course, in some embodiments, the source device may also be a device with a broadcast media audio function; although the source device has the broadcast media audio function; however, in a playback mode of the source device, the source device does not broadcast audio through its own broadcast media audio function, but broadcasts the audio to be played through a device with a function of transferring unicast link audio to broadcast link transmission, thereby achieving the purpose of playing the audio to be played through the party mode.

[0027] The source device may be a mobile terminal such as a mobile phone or a notebook, and is not limited here.

[0028] The source device may send the audio to be played to the broadcast device via any unicast link. For example, the source device may send the audio to be played to the broadcast device via a Bluetooth unicast link (eg, an A2DP link), wifi, USB, or AirPlay.

[0029] When the source device sends the audio to be played or the first frame of audio to be played, it can issue an instruction to the broadcasting device to apply the party mode to play the audio to be played, so that the broadcasting device responds to the instruction and broadcasts the audio to be played transmitted by the unicast link to the playback device through the broadcast media audio function (i.e., BMS function).

[0030] In some implementation scenarios, if the actual purpose of the broadcasting device is to transfer the unicast link audio to the broadcast link for transmission, that is, the broadcasting device itself is a broadcaster for other devices to play audio in party mode, when the source device sends the audio to be played or the first frame of the audio to be played, it is also possible not to issue an instruction to the broadcasting device to play the audio to be played in party mode, that is, in this implementation scenario, if the broadcasting device receives the audio to be played, the broadcasting device will automatically broadcast the audio to be played transmitted by the unicast link to the playback device through the broadcast media audio function. That is, when the broadcasting device receives the audio to be played, it is equivalent to receiving an instruction to play the audio to be played in party mode.

[0031] S102: When the source device instructs the application of party mode to play the audio to be played, the source device uses itself as a broadcast media transmitter to broadcast the audio to be played to the playback device, so as to synchronously play the audio to be played through at least one playback device.

[0032] After obtaining the audio to be played transmitted by the source device through the unicast link, upon receiving an instruction from the source device to play the audio to be played in the application party mode, the audio to be played transmitted by the unicast link can be broadcast to the playback device through its broadcast media audio function (i.e., BMS function), so that the audio to be played is played synchronously by itself and / or at least one playback device broadcasted by it, thereby realizing the function of playing the audio to be played through the party mode.

[0033] Optionally, after the broadcasting device obtains the audio to be played, it can transfer the audio to be played from the unicast communication module to the audio distribution module (Audio dispatcher module), and then transfer the audio to be played from the audio distribution module to the broadcast communication module, so that the broadcast communication module broadcasts the audio to be played to at least one playback device through the broadcast media audio function (i.e., the BMS function). Among them, the unicast communication module and the broadcast communication module can be two submodules of the same communication module (e.g., a Bluetooth communication module). For example, when the unicast communication link in step S101 is a Bluetooth A2DP link, the unicast communication module is the A2DP module in the Bluetooth communication module, and the broadcast communication module is the BMS module in the Bluetooth communication module. Of course, in some embodiments, the unicast communication module and the broadcast communication module can also be different communication modules.

[0034] Specifically, Figure 4As shown, transmitting the audio to be played from the unicast communication module to the audio distribution module may include: transmitting the audio to be played from the unicast communication module and sequentially through the hardware components corresponding to the unicast link and the recording and playback components to the audio distribution module. For example, when the unicast link is an A2DP (Advanced Audio Distribution Profile, Bluetooth audio transmission model protocol) link, the audio to be played can be sent to the audio distribution module through the hardware components corresponding to the unicast link and the recording and playback components through the Bluetooth communication module host. Transmitting the audio to be played from the audio distribution module to the broadcast communication module may include: transmitting the audio to be played from the audio distribution module to the broadcast communication module via the audio hardware module, so as to broadcast the audio to be played through the broadcast communication module, so that at least one playback device (i.e., a broadcast media receiver) can receive the audio to be played. Further, the audio hardware module can send the audio to be played to the communication module controller through the Bluetooth communication module host, so that the communication module controller broadcasts the audio to be played.

[0035] In other implementations, the audio to be played can be transmitted directly from the unicast communication module to the broadcast communication module, so that the broadcast communication module can broadcast the audio to be played to at least one playback device through the broadcast media audio function. In this way, there is no need to transmit the audio to be played to the audio distribution module and transit it in order to broadcast the audio to be played.

[0036] In an optional implementation, the broadcasting device can broadcast the audio to be played to at least two playback devices so that the audio to be played can be played synchronously by the at least two playback devices. That is, in this implementation, the broadcasting device itself does not make any sound, and the audio to be played is played by at least two playback devices that receive the broadcast audio.

[0037] At least two of the playback devices will pre-agree on the same playback delay time, so that after the broadcasting device broadcasts the audio to be played, the at least two playback devices that receive the broadcasted audio to be played will take the time when the broadcasting device starts broadcasting the audio to be played as the starting point, and play the audio to be played after a preset time period, and the preset time period is equal to the playback delay time agreed upon by the at least two playback devices that receive the broadcast audio. Therefore, based on the previously agreed playback delay time, the at least two playback devices that receive the audio to be played will synchronously play the audio to be played, thereby achieving the purpose of synchronously playing the audio to be played through the party mode.

[0038] Specifically, Figure 5As shown, at least two playback devices can agree on the longest receiving delay (Sync delay) and the longest audio processing delay (Presentation delay), so that the playback delay time agreed upon by at least two playback devices that receive the broadcast audio is the sum of the longest receiving delay and the longest audio processing delay, that is, after the broadcasting device broadcasts the audio to be played, at least two playback devices that receive the broadcasted audio to be played will take the time when the broadcasting device starts broadcasting the audio to be played as the starting point, and play the audio to be played after the "sum of the longest receiving delay and the longest audio processing delay", so that the playback time point (i.e., PTS) of the audio to be played can be equal to the sum of the start broadcast time point of the audio to be played, the longest receiving delay and the longest audio processing delay.

[0039] Optionally, the broadcast device and / or the at least two playback devices may have agreed on the playback delay time before leaving the factory. Of course, in some embodiments, the broadcast device and / or the at least two playback devices may have agreed on the playback delay time after leaving the factory and before step S102.

[0040] It can be understood that, regardless of whether the broadcasting device has the function of playing audio, the broadcasting device can use this implementation to achieve the purpose of playing the audio to be played through the party mode.

[0041] In another optional implementation, the broadcasting device can broadcast the audio to be played to at least one playback device, and the broadcasting device itself will play the audio to be played synchronously with the at least one playback device. That is, in this implementation, the broadcasting device itself also makes a sound, that is, the broadcasting device and at least one playback device that receives the broadcast audio jointly play the audio to be played.

[0042] In order to facilitate the broadcasting device and at least one playback device that receives the audio to be played to synchronously play the audio to be played, before playing the audio to be played, the broadcasting device can first transfer the audio to be played to the playback buffer area so that the audio to be played can be played at the corresponding time, thereby achieving the purpose of synchronously playing the audio to be played through the party mode.

[0043] Preferably, in the implementation process of the broadcasting device transmitting the audio to be played to the broadcasting communication module through the audio distribution module, after the audio distribution module receives the audio to be played, the audio distribution module can first cache the audio to be played in the playback buffer area, and then copy a copy of the audio to be played and transmit it to the broadcasting communication module. The playback buffer area can be a buffer area in the audio distribution module, or the playback buffer area can also be outside the audio distribution module.

[0044] In this implementation, certain measures may be taken to allow the broadcasting device and at least one playback device that receives the broadcast audio to play the audio to be played together.

[0045] Optionally, the broadcasting device may agree on the same playback delay time with at least one playback device that receives the broadcast audio. In this way, after the broadcasting device broadcasts the audio to be played, the broadcasting device and the at least one playback device that receives the broadcast audio to be played will take the time when the broadcasting device starts broadcasting the audio to be played as the starting point, and play the audio to be played after a preset time period. The preset time period is the playback delay time agreed upon by the broadcasting device and the at least one playback device that receives the broadcast audio, that is, the actual playback time PTS of the audio to be played is determined based on the original PTS and the preset time period. Therefore, based on the previously agreed playback delay time, the broadcasting device and the at least one playback device that receives the audio to be played will synchronously play the audio to be played, thereby achieving the purpose of playing the audio to be played through the party mode.

[0046] Specifically, the broadcasting device and at least one playback device may agree on a maximum reception delay and a maximum audio processing delay, so that the playback delay time agreed upon by the broadcasting device and at least one playback device that receives the broadcast audio is the sum of the maximum reception delay and the maximum audio processing delay.

[0047] In this implementation, when the broadcasting device broadcasts the audio to be played through its broadcasting communication module, the broadcasting device can determine the playback time point of the audio to be played (i.e., the actual PTS) based on the time when the broadcasting starts (i.e., the original PTS) and the playback delay time information, and then the broadcasting device can set the playback time point of the audio to be played to the audio distribution module, so that the audio distribution module can know when to play the audio to be played through the playback time point of the audio to be played.

[0048] When the broadcasting device sets the playback time point of the audio to be played to the audio distribution module, it can also inform the audio distribution module of the serial number of the audio to be played, so that the audio distribution module can send the audio to be played to the playback module in time based on the serial number and the playback time point.

[0049] Among them, the controller of the broadcast communication module (i.e., BT Controller) can determine the playback time point of the audio to be played based on the time when the broadcast starts and the agreed playback delay time, and then the controller of the broadcast communication module will send the playback time point of the audio to be played to the audio distribution module via the host of the broadcast communication module (i.e., Bluetooth communication module) and the program of the broadcast communication module (i.e., BT App). Specifically, the playback time point of the audio to be played fed back by the host of the broadcast communication module can be set to the audio distribution module through the program of the broadcast communication module.

[0050] Specifically, the controller of the broadcast communication module can determine the playback time point of the audio to be played through an LE audio standard (LE audio spec) algorithm.

[0051] In the case where there are multiple frames of audio to be played, the broadcasting device can determine the playback time point of the first frame of audio to be played in the multiple frames of audio to be played based on the time when the broadcast of the first frame of audio to be played in the multiple frames of audio to be played and the playback delay time information, and then the broadcasting device can set the playback time point of the first frame of audio to be played in the multiple frames of audio to be played to the audio distribution module, so that the audio distribution module can know when to play the first frame of audio to be played in the multiple frames of audio to be played through the playback time point of the first frame of audio to be played in the multiple frames of audio to be played, and then the audio distribution module controls the playback module to play the first frame of audio to be played at the corresponding playback time point, and the subsequent playback modules will play the non-first frame of audio to be played in the multiple frames of audio to be played in sequence, thereby achieving synchronization of the playback of the multiple frames of audio to be played on the broadcasting device and at least one playback device that receives the audio to be played.

[0052] In this embodiment, the unicast data receiving function and the BMS function are integrated in the broadcasting device. The unicast data receiving function receives the audio data transmitted by the source device in a unicast link, and then the audio data is broadcasted through the BMS. In this way, the party mode is implemented between the broadcasting device and the playback device receiving the broadcast data through BMS-BMR, so that terminals such as mobile phones / laptops that only support traditional unicast functions can also use the party mode function of the playback device and maintain synchronous audio playback.

[0053] See also Figure 6 , Figure 6 1 is a schematic diagram of a structure of an embodiment of a broadcasting device of the present application. The broadcasting device 10 includes a processor 12, and the processor 12 is used to execute instructions to implement the above audio playback method. For the specific implementation process, please refer to the description of the above embodiment, which will not be repeated here.

[0054] The processor 12 may also be referred to as a CPU (Central Processing Unit). The processor 12 may be an integrated circuit chip having signal processing capabilities. The processor 12 may also be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. A general-purpose processor may be a microprocessor or the processor 12 may also be any conventional processor, etc.

[0055] The broadcasting device 10 may further include a memory 11 for storing instructions and data required for the processor 12 to run.

[0056] The processor 12 is used to execute instructions to implement the method provided by any embodiment of the prediction method and video encoding method of the present application and any non-conflicting combination.

[0057] See also Figure 7 , Figure 7 It is a structural diagram of a computer-readable storage medium in an embodiment of the present application. The computer-readable storage medium 30 of the embodiment of the present application stores instructions / program data 31, and when the instructions / program data 31 are executed, the method provided by any embodiment of the audio playback method of the present application and any non-conflicting combination is implemented. Among them, the instructions / program data 31 can form a program file and be stored in the above-mentioned storage medium 30 in the form of a software product, so that a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor (processor) executes all or part of the steps of each implementation method of the present application. The aforementioned storage medium 30 includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, or a terminal device such as a computer, a server, a mobile phone, and a tablet.

[0058] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0059] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0060] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0061] The above are only implementation methods of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. An audio playback method, characterized in that: The playing method comprises: The broadcast device obtains the audio to be played transmitted by the source device through the unicast link; When the source device instructs the application party mode to play the audio to be played, the broadcasting device uses itself as a broadcast media transmitter to broadcast the audio to be played to the playback device, so as to synchronously play the audio to be played through at least one playback device.

2. The audio playback method according to claim 1, characterized in that: The broadcasting device uses itself as a broadcast media transmitter to broadcast the audio to be played to the playback device, so as to synchronously play the audio to be played through at least one playback device, including: The broadcasting device broadcasts the audio to be played to at least one playback device by itself as a broadcast media transmitter, so that the audio to be played is synchronously played by the broadcasting device and the at least one playback device.

3. The audio playback method according to claim 2, characterized in that: The step of the broadcasting device broadcasting the audio to be played to at least one playback device by itself as a broadcast media transmitter, so as to synchronously play the audio to be played by the broadcasting device and the at least one playback device, comprises: The broadcasting device and the at least one playing device take the time of broadcasting the audio to be played as a starting point, and play the audio to be played after a preset time period; The preset time period is a playback delay time pre-agreed between the broadcasting device and the at least one playback device.

4. The audio playback method according to claim 3, characterized in that: The broadcasting device comprises a unicast communication module and an audio distribution module, wherein the broadcasting device uses itself as a broadcast media transmitter to broadcast the audio to be played to at least one playback device, so as to synchronously play the audio to be played by the broadcasting device and the at least one playback device, comprising: The unicast communication module sends the received audio to be played to the audio distribution module; The audio distribution module caches the audio to be played so as to play the audio to be played after a preset time period starting from the time when the audio to be played is broadcast.

5. The audio playback method according to claim 4, characterized in that: The broadcasting device includes a playing module, wherein the broadcasting device uses itself as a broadcast media transmitter to broadcast the audio to be played to the playing device, so as to synchronously play the audio to be played through at least one playing device, comprising: The broadcasting device determines, based on the starting point and the playback delay time, a playback time point of the audio to be played on the at least one playback device; The broadcasting device sets the playing time point to the audio distribution module, so that the audio distribution module controls the playing module to play the audio to be played at the playing time point.

6. The audio playback method according to claim 4, characterized in that: The broadcasting device includes a broadcast communication module, wherein after the unicast communication module sends the received audio to be played to the audio distribution module, it further includes: The audio distribution module copies the audio to be played and sends it to the broadcast communication module, so that the broadcast communication module broadcasts the audio to be played to the at least one playback device.

7. The audio playback method according to claim 1, characterized in that: The broadcasting device includes a Bluetooth communication module, and the Bluetooth communication module includes a broadcast communication module and a unicast communication module; The step of the broadcast device acquiring the audio to be played transmitted by the source device via the unicast link comprises: The unicast communication module obtains the audio to be played through the unicast link; The step of, when the source device instructs the application of party mode to play the audio to be played, the broadcasting device uses itself as a broadcast media transmitter to broadcast the audio to be played to the playback device, so as to synchronously play the audio to be played through at least one playback device, includes: In the Bluetooth communication module, the unicast communication module sends the audio to be played to the broadcast communication module, so that the broadcast communication module broadcasts the audio to be played to the at least one playback device using a broadcast media sending function.

8. The audio playing method according to claim 7, characterized in that: The unicast link is an A2DP link.

9. The audio playing method according to claim 1, characterized in that: The broadcasting device uses itself as a broadcast media transmitter to broadcast the audio to be played to the playback device, so as to synchronously play the audio to be played through at least one playback device, comprising: The broadcasting device uses itself as a broadcast media transmitter to broadcast the audio to be played to at least two playback devices, and the audio to be played is synchronously played only through the at least two playback devices.

10. A broadcasting device, characterized in that: The invention comprises a memory and a processor, wherein the memory and the processor are coupled to each other, and the processor is used to execute program instructions stored in the memory to implement the method according to any one of claims 1 to 9.

11. A computer-readable storage medium having instructions / program data stored thereon, characterized in that: When the instructions / program data are executed, the steps of the method according to any one of claims 1 to 10 are implemented.

Images