Wireless multichannel audio data transmission method, device, central equipment and system
By establishing non-overlapping broadcast isochronous stream links in the BLE audio architecture and employing joint time-division multiplexing and frequency-division multiplexing techniques, the bandwidth and reliability issues in wireless multi-channel audio data transmission are solved, achieving more efficient audio data transmission.
Patent Information
- Application Number
- CN202510998589.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-07-18
- Publication Date
- 2025-11-04
AI Technical Summary
The existing BLE audio architecture suffers from bandwidth limitations, insufficient reliability, and high latency in wireless multi-channel audio data transmission, making it difficult to support high-resolution wireless multi-channel broadcast audio transmission with more than four channels.
By establishing a broadcast isochronous group in which multiple broadcast isochronous stream links do not overlap on time slots or frequency channels, and at least two broadcast isochronous stream links overlap on time slots but not on frequency channels, multi-channel audio data is transmitted using a combination of time division multiplexing and frequency division multiplexing, and auxiliary synchronization data packets are used for link information transmission and a collision avoidance mechanism to handle frequency channel conflicts.
It improves the transmission bandwidth and reliability of wireless multi-channel audio data, significantly reduces latency, and provides a smoother audio experience.
Smart Images

Figure CN120897271A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] Embodiments of the present application relate to the technical field of wireless communication, and in particular to a wireless multi-channel audio data transmission method and device, a central device and a system. BACKGROUND
[0002] With the rapid development of wireless audio technology, Bluetooth Low Energy (BLE) audio technology is gradually becoming an important choice for wireless audio services due to its low power consumption, low cost, low latency and high quality. BLE audio technology adopts a synchronous isochronous channel (Isochronous Channels) protocol, supports connected isochronous stream (CIS) for single-point to single-point communication and broadcast isochronous stream (BIS) for single-point to multi-point communication, and implements efficient audio transmission through connected isochronous group (CIG) and broadcast isochronous group (BIG). The application of this technology enables the implementation of wireless broadcast audio (WBA) functions, providing users with a more rich audio experience.
[0003] However, the existing BIG link protocol has limitations on the physical layer (PHY) transmission rate, with a maximum of only 2 Mbps, and in the case of multiple BIS link time division multiplexing, it is difficult to achieve low latency and high reliability transmission of wireless multi-channel broadcast audio (WMCBA) with more than two channels. Although the new generation of BLE specification introduces a higher data throughput (HDT) physical layer, providing transmission rates of 4 Mbps, 6 Mbps and 7.5 Mbps, it is still difficult to support high-resolution (High Resolution) WMCBA with no less than four channels in actual applications.
[0004] In summary, the main problem faced by the current technology is how to simply and effectively improve the transmission bandwidth, reliability, or reduce the delay of wireless multi-channel audio data in the existing BLE audio architecture. SUMMARY
[0005] Embodiments of the present application provide a solution to the technical problem of how to simply and effectively improve the transmission bandwidth, reliability, or reduce the delay of wireless multi-channel audio data in the existing BLE audio architecture.
[0006] To solve the above technical problems, the embodiments of the present application provide the following aspects:
[0007] In a first aspect, the embodiments of the present application provide a wireless multi-channel audio data transmission method, which is applied to a center device, and the method comprises:
[0008] establishing one broadcast isochronous group, wherein the one broadcast isochronous group comprises a plurality of broadcast isochronous stream links, the plurality of broadcast isochronous stream links do not overlap each other in time slots or frequency channels, and at least two of the plurality of broadcast isochronous stream links overlap each other in time slots and do not overlap each other in frequency channels;
[0009] sending multi-channel audio data through the one broadcast isochronous group.
[0010] Optionally, it further comprises:
[0011] sending an auxiliary synchronization data packet through an advertising channel, wherein the auxiliary synchronization data packet comprises link information of the broadcast isochronous group, and the link information comprises a carrier number indication parameter, and a peripheral device receives the multi-channel audio data sent by the center device through the link information of the broadcast isochronous group.
[0012] Optionally, sending an auxiliary synchronization data packet through an advertising channel comprises:
[0013] sending an extended advertising protocol data packet through a primary advertising channel, sending an auxiliary advertising protocol data packet through a secondary advertising channel, and sending an auxiliary synchronization protocol data packet through a periodic advertising channel.
[0014] Optionally, the carriers of the broadcast isochronous stream links that do not overlap in frequency channels are different frequency hopping sequences generated according to a frequency hopping algorithm defined in the BLE specification.
[0015] Optionally, when there is frequency channel overlap in the different frequency hopping sequences generated by the plurality of broadcast isochronous stream links according to the frequency hopping algorithm defined in the BLE specification, sending broadcast audio data through the one broadcast isochronous group comprises:
[0016] determining a currently evaded broadcast isochronous stream link through a turn-by-turn evasion mechanism;
[0017] suspending sending of the broadcast audio data on the currently evaded broadcast isochronous stream link.
[0018] Optionally, the one broadcast isochronous group adopts a time slot structure of joint time division multiplexing and frequency division multiplexing, wherein all broadcast isochronous stream links contained in the one broadcast isochronous group are divided into at least two frequency division multiplexing groups, and the number of frequency division multiplexing groups is equal to the number of carriers.
[0019] The sending of the multi-channel audio data through the one broadcast isochronous group comprises sending the multi-channel audio data through the multiple broadcast isochronous stream links, wherein each broadcast isochronous stream link sends audio data of one channel; or at least one broadcast isochronous stream link independently sends the multi-channel audio data.
[0020] In a second aspect, an embodiment of the present application provides a central device, comprising: an application and main processor, a multi-radio frequency controller or an extensible controller;
[0021] The application and main processor is configured to process broadcast audio data and communicate with the multi-radio frequency controller or the extensible controller through a host controller interface;
[0022] The multi-radio frequency controller or the extensible controller is configured to establish one broadcast isochronous group and send the multi-channel audio data through the one broadcast isochronous group;
[0023] The one broadcast isochronous group comprises multiple broadcast isochronous stream links, the multiple broadcast isochronous stream links do not overlap each other in time slots or frequency channels, and at least two of the multiple broadcast isochronous stream links overlap each other in time slots and do not overlap each other in frequency channels.
[0024] Optionally, the multi-radio frequency controller comprises one main radio frequency unit and main antenna, and at least one sub-radio frequency unit and sub-antenna.
[0025] The extensible controller comprises one main controller and at least one sub-controller, and the main controller and the at least one sub-controller are connected through a cascading mode.
[0026] Optionally, the application and main processor is further configured to compress and encode the multi-channel broadcast audio data and package the multi-channel broadcast audio data into service data units; and further configured to configure the multi-radio frequency controller or the extensible controller to establish the one broadcast isochronous group according to link information of the one broadcast isochronous group.
[0027] The multi-radio frequency controller or the extensible controller is configured to package the service data units into protocol data units and send the protocol data units through the multiple broadcast isochronous stream links.
[0028] In a third aspect, an embodiment of the present application provides a wireless multi-channel audio data transmission method, which is applied to a peripheral device, and the method comprises:
[0029] receiving multi-channel audio data transmitted from a center device through one broadcast isochronous group, wherein the one broadcast isochronous group is established by the center device and comprises a plurality of broadcast isochronous stream links, the plurality of broadcast isochronous stream links do not overlap with each other in time slots or frequency channels, and at least two of the plurality of broadcast isochronous stream links overlap with each other in time slots and do not overlap with each other in frequency channels.
[0030] Optionally, before receiving the multi-channel audio data transmitted from the center device through the one broadcast isochronous group, the method further comprises:
[0031] receiving an auxiliary synchronization data packet through an advertising channel, wherein the auxiliary synchronization data packet comprises link information of the broadcast isochronous group, and the link information comprises a carrier number indication parameter;
[0032] receiving the multi-channel audio data transmitted from the center device through the one broadcast isochronous group comprises:
[0033] receiving the multi-channel audio data transmitted from the center device through the link information of the broadcast isochronous group.
[0034] Optionally, the peripheral device is composed of a plurality of independent monaural peripheral devices, and each monaural peripheral device receives monaural audio data of one broadcast isochronous stream link.
[0035] In a fourth aspect, an embodiment of the present application provides a wireless multi-channel audio data transmission device, which is applied to a center device, and the device comprises:
[0036] a establishing module, configured to establish one broadcast isochronous group, wherein the one broadcast isochronous group comprises a plurality of broadcast isochronous stream links, the plurality of broadcast isochronous stream links do not overlap with each other in time slots or frequency channels, and at least two of the plurality of broadcast isochronous stream links overlap with each other in time slots and do not overlap with each other in frequency channels;
[0037] a first executing module, configured to transmit multi-channel audio data through the one broadcast isochronous group.
[0038] In a fifth aspect, an embodiment of the present application provides a wireless multi-channel audio data transmission device, which is applied to a peripheral device, and the device comprises:
[0039] a receiving module, configured to receive multi-channel audio data transmitted from a center device through one broadcast isochronous group, wherein the one broadcast isochronous group is established by the center device and comprises a plurality of broadcast isochronous stream links, the plurality of broadcast isochronous stream links do not overlap with each other in time slots or frequency channels, and at least two of the plurality of broadcast isochronous stream links overlap with each other in time slots and do not overlap with each other in frequency channels.
[0040] In a sixth aspect, the embodiments of the present application provide a wireless multi-channel audio data transmission system, the system comprising:
[0041] a central device configured to perform the wireless multi-channel audio data transmission method according to any one of the first aspect;
[0042] at least one peripheral device configured to perform the wireless multi-channel audio data transmission method according to any one of the third aspect.
[0043] In a seventh aspect, the present application provides a server, comprising a processor, a memory, and a program stored in the memory and executable in the processor, and when the program is executed by the processor, the steps of the wireless multi-channel audio data transmission method according to the first aspect or the third aspect are implemented.
[0044] In an eighth aspect, the present application provides a computer readable storage medium, and the computer readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the wireless multi-channel audio data transmission method according to the first aspect or the third aspect are implemented.
[0045] In a ninth aspect, the present application provides a computer program product, comprising computer instructions, and when the computer instructions are executed by a processor, the steps of the wireless multi-channel audio data transmission method according to the first aspect or the third aspect are implemented.
[0046] The wireless multi-channel audio data transmission method provided by the present application can effectively increase the transmission bandwidth of wireless multi-channel audio data, thereby improving the reliability of audio data transmission, and can also significantly reduce the delay of audio data transmission, thereby providing users with a smoother audio experience. BRIEF DESCRIPTION OF DRAWINGS
[0047] Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The accompanying drawings are included to provide a description of the preferred embodiments, and are not intended to limit the scope of the present application. Moreover, the same reference numerals are used throughout the drawings to represent similar components. In the drawings:
[0048] Figure 1 A flowchart of a wireless multi-channel audio data transmission method provided by the embodiments of the present application;
[0049] Figure 2 A structural block diagram of a wireless multi-channel audio data transmission system provided for an embodiment of the present application is shown;
[0050] Figure 3 A time slot structure diagram of a broadcast isochronous stream link provided for an embodiment of the present application is shown;
[0051] Figure 4 A structural block diagram of a center device provided for an embodiment of the present application is shown;
[0052] Figure 5 A structural block diagram of a center device provided for an embodiment of the present application is shown;
[0053] Figure 6 A structural block diagram of a center device provided for an embodiment of the present application is shown;
[0054] Figure 7 A flow chart of a wireless multi-channel audio transmission method provided for an embodiment of the present application is shown;
[0055] Figure 8 A structural block diagram of a wireless multi-channel audio transmission device provided for an embodiment of the present application is shown;
[0056] Figure 9 A structural block diagram of a wireless multi-channel audio transmission device provided for an embodiment of the present application is shown;
[0057] Figure 10 A structural block diagram of an electronic device provided for an embodiment of the present application is shown. DETAILED DESCRIPTION
[0058] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of protection of the present application.
[0059] Figure 1 A wireless multi-channel audio data transmission method is shown, the method is applied to a center device, and the method comprises:
[0060] Step S101, establishing a broadcast isochronous group;
[0061] One of the broadcast isochronous groups comprises a plurality of broadcast isochronous stream links, the plurality of broadcast isochronous stream links do not overlap each other on time slots or frequency channels, and at least two of the plurality of broadcast isochronous stream links overlap each other on time slots and do not overlap each other on frequency channels;
[0062] Step S102, transmitting the multi-channel audio data through an augmented broadcast isochronous group.
[0063] It should be noted that, first, an augmented broadcast isochronous group needs to be established, which is composed of multiple augmented broadcast isochronous stream links. These augmented broadcast isochronous stream links are designed to be non-overlapping with each other in time slots or frequency channels, that is, they independently occupy time slots or frequency resources, avoiding interference. And at least two of the multiple augmented broadcast isochronous stream links overlap each other in time slots and do not overlap each other in frequency channels. Based on this architecture, the entire augmented broadcast isochronous group is used to transmit multi-channel audio data, and the data of each channel can be transmitted through different augmented broadcast isochronous stream links.
[0064] Figure 1 The method shown can be applied to Figure 2 The wireless multi-channel audio data transmission system (also referred to as WMCBA system) shown, such as Figure 2 As shown, the WMCBA is composed of a WMCBA sending device and at least one WMCBA receiving device (N≥1, N is a positive integer). The WMCBA sending device and the WMCBA receiving device transmit the WMCBA by using an augmented broadcast isochronous group (ABIG). The WMCBA sending device can also be referred to as a WMCBA central device (Central), and can also be referred to as an ABIG central device. The WMCBA receiving device is a WMCBA peripheral device (Peripheral), and can also be referred to as an ABIG peripheral device. The ABIG peripheral device can be composed of multiple independent single-channel peripheral devices. The ABIG link is composed of at least two (M≥2, M is a positive integer) augmented broadcast isochronous stream (ABIS) links that are frequency division multiplexed by using different frequency hopping sequences, that is, the WMCBA sending device uses different frequency channels or carriers to simultaneously transmit the WMCBA in time domain. The frequency division multiplexing or multi-carrier technology by using different frequency hopping sequences is referred to as muti-carrier-hopping (MCH) technology in the embodiments of the present application.
[0065] In a possible implementation, the method further includes: sending an auxiliary synchronization data packet through the advertising channel, the auxiliary synchronization data packet including link information of the broadcast isochronous group, the link information including a carrier number indication parameter, and the peripheral device receiving the multi-channel audio data sent by the central device through the link information of the broadcast isochronous group. The sending of the auxiliary synchronization data packet through the advertising channel includes: sending an extended advertising protocol data packet through the primary advertising channel, sending an auxiliary advertising protocol data packet through the secondary advertising channel, and sending an auxiliary synchronization protocol data packet through the periodic advertising channel.
[0066] In a possible implementation, one broadcast isochronous group adopts a time slot structure of joint time division multiplexing and frequency division multiplexing, all broadcast isochronous stream links included in one broadcast isochronous group are divided into at least two frequency division multiplexing groups, the number of the frequency division multiplexing groups is equal to the carrier number, and the sending of the multi-channel audio data through one broadcast isochronous group includes: sending the multi-channel audio data through a plurality of broadcast isochronous stream links, each of which sends audio data of one channel; or at least one broadcast isochronous stream link independently sends the multi-channel audio data.
[0067] It should be noted that the specific process of sending the auxiliary synchronization data packet through the advertising channel includes: sending an extended advertising protocol data packet through the primary advertising channel, sending an auxiliary advertising protocol data packet through the secondary advertising channel, and sending an auxiliary synchronization protocol data packet through the periodic advertising channel to complete the transmission of the auxiliary synchronization data packet. The auxiliary synchronization data packet includes the link information of the broadcast isochronous group, and an indication parameter of the carrier number is explicitly provided. The peripheral device can accurately identify and access the broadcast isochronous group established by the central device by using the link information, and then stably receive the multi-channel audio data transmitted by the central device through the broadcast isochronous group.
[0068] Further, the BIG link of the existing BLE specification does not support frequency division multiplexing or multi-carrier, and the BIG link information (BIGInfo) carried by the auxiliary synchronization (AUX_SYNC_IND) protocol data unit (PDU) does not provide frequency division multiplexing information. Therefore, the embodiment of the present application defines an ABIG link information (ABIGInfo) on the basis of the BIGInfo. The ABIGInfo uses part of the original 7-bit reserved field (Reserved for Future Use, RFU) to define the number of carriers (Number of Carriers, Num_CA) of the agile multi-carrier on the basis of the BIGInfo. For example, 2 bits are used to define the number of carriers, Num_CA equal to 0 represents the number of carriers is 1, Num_CA equal to 1 represents the number of carriers is 2, Num_CA equal to 2 represents the number of carriers is 3, and Num_CA equal to 3 represents the number of carriers is 4. The definitions of other parameters of the ABIGInfo are the same as those of the BIGInfo. When Num_CA is greater than 0, i.e., the number of carriers is greater than 1, the number of ABISs for each carrier (Number of ABIS for Each Carrier) is equal to Num_BIS divided by (Num_CA+1) in the ABIGInfo. Without loss of generality, it can be assumed that Num_BIS is an integer multiple of the number of carriers.
[0069] According to the BLE specification, the existing BIG peripheral device synchronizes the BIG central device and obtains the BIGInfo through the extended advertising (ADV_EXT_IND) protocol data unit sent by the BIG central device on the primary advertising (Primary Advertising) channel, the auxiliary advertising (AUX_ADV_IND) PDU sent by the BIG central device on the secondary advertising (Secondary Advertising) channel, and the AUX_SYNC_IND PDU sent by the BIG central device on the periodic advertising (Periodic Advertising) channel, so as to receive the audio data carried by the BIS PDU. Similarly, the ABIG peripheral device also synchronizes the ABIG central device by searching the extended advertising (ADV_EXT_IND) PDU sent by the ABIG central device on the primary advertising channel, receiving the auxiliary advertising (AUX_ADV_IND) PDU sent by the ABIG central device on the secondary advertising channel, and then receiving the AUX_SYNC_IND PDU sent by the ABIG central device on the periodic advertising channel, and obtains the ABIGInfo of the ABIG link, so as to know the number of carriers used by the ABIG central device according to Num_CA, and receive the audio data carried by the ABIS PDU of the ABIS link on each carrier.
[0070] And correspondingly, the ABIG peripheral device first searches the ADV_EXT_IND PDU, then receives the AUX_ADV_IND PDU, and receives the AUX_SYNC_IND PDU according to the synchronization information of the AUX_ADV_IND PDU, and then establishes the joint time and frequency division multiplexing ABIS link to receive the audio data according to the ABIGInfo and Num_CA parameters provided by the AUX_SYNC_IND PDU. Generally, each ABIG peripheral device can be composed of multiple independent single-channel peripheral devices, each of which only receives audio data of one channel, and thus only receives ABIS PDU of one ABIS link in the ABIG and audio data carried thereby. It is also not excluded that the ABIG peripheral device is composed of multiple independent dual-channel peripheral devices, or is composed of multiple independent multi-channel peripheral devices with a number of channels less than the total number of channels provided by the ABIG.
[0071] In addition, the ABIG central device can also simultaneously send the same single-channel audio data on multiple ABIS links of frequency division multiplexing, and the ABIG peripheral device improves the reliability of audio transmission by simultaneously receiving the audio data sent on multiple ABIS links of frequency division multiplexing.
[0072] Now, the time slot structure of the ABIG will be specifically introduced. It needs to be understood that the ABIG is composed of at least two ABIS links of frequency division multiplexing using different frequency hopping sequences, and thus the joint time and frequency division multiplexing coexists between the ABIS links. The joint time and frequency division multiplexing is that they do not overlap each other on the time slot or frequency channel respectively. Figure 2 The ABIG central device is composed of a multi-radio controller (Multi-Radio Controller) and an application and host processor (APP & Host Processor), or is composed of a scalable controller (Scalable Controller) and an application and host processor (APP & Host Processor).
[0073] The time slot structure of the joint time and frequency division multiplexing coexisting between the ABIS links is as follows: Figure 3ABIS link number (Num_BIS) is an integer multiple of the number of carriers (M = Num_CA + 1, M ≥ 2), the number of radio frequency units of the multi-radio frequency controller or the number of controllers of the scalable controller (D + 1 ≥ M). When D + 1 > M, the number of radio frequency units or controllers with the best link quality is selected from D + 1 radio frequency units or controllers, and the number of radio frequency units or controllers is M, which is used to establish the frequency division multiplexing BIS link. All ABIS links are divided into M groups of frequency division multiplexing groups. For example, each group of frequency division multiplexing groups contains K time division multiplexing ABIS links (K = Num_BIS / M). It should be noted that the number of ABIS links in each frequency division multiplexing group can also be different.
[0074] As shown in FIG. 6, similar to the BIG link of the BLE specification, the communication time of the ABIG link is divided into equal time intervals with a length of ABIG ISO Interval. In the same ABIG ISO Interval equal time interval, the ABIG link is divided into M groups of frequency division multiplexing ABIS links using different frequency hopping sequences. Figure 3 The ABIG Offset values of the ABIS links in each group of frequency division multiplexing are the same, and the ABIG Offset is defined in the same way as the BIG Offset. In one ABIG ISO Interval, by default, the ADV_EXT_IND PDU (denoted by EA) sent on the main advertising channel, the AUX_ADV_IND PDU (denoted by AA) sent on the secondary advertising channel, and the AUX_SYNC_IND PDU (denoted by PA) sent on the periodic advertising channel by the main radio frequency unit or the main controller are used for ABIG peripheral device synchronization. Figure 3 The ADV_EXT_IND PDU, AUX_ADV_IND PDU, and AUX_SYNC_IND PDU can also be sent by other radio frequency units or controllers. Figure 3 Figure 3 Specifically, as shown in FIG. 7, the ABIS link of the ABIG link is divided into M groups of frequency division multiplexing ABIS links using different frequency hopping sequences.
[0075] Specifically, as shown in FIG. 7, the ABIS link of the ABIG link is divided into M groups of frequency division multiplexing ABIS links using different frequency hopping sequences. Figure 3 As shown, the solid box with 11 represents the ABIS PDU transmitted by the ABIS link with time domain number 1 (ABIS11) in the ABIS group with carrier sequence number 1; the solid box with 12 represents the ABIS PDU transmitted by the ABIS link with time domain number 2 (ABIS12) in the ABIS group with carrier sequence number 1; and so on. The solid box with 1K represents the ABIS PDU transmitted by the ABIS link with time domain number K (ABIS 1K) in the ABIS group with carrier sequence number 1. The dashed box with C represents the ABIG control PDU transmitted by the ABIG link. The dashed line indicates that transmission may or may not occur within the current equal time interval. The definition of the ABIG control PDU is the same as that of the BIG control PDU. By default, the ABIG control PDU is transmitted through the main radio unit or the main controller, but it can also be transmitted through other radio units or controllers.
[0076] Specifically, such as Figure 3 As shown, the solid box with 21 represents the ABIS PDU transmitted by the ABIS link with time domain number 1 (ABIS21) in the frequency division multiplexing ABIS group with carrier number 2, the solid box with 22 represents the ABIS PDU transmitted by the ABIS link with time domain number 2 (ABIS22) in the frequency division multiplexing ABIS group with carrier number 2, and so on. The solid box with 2K represents the ABIS PDU transmitted by the ABIS link with time domain number K (ABIS 2K) in the frequency division multiplexing ABIS group with carrier number 2.
[0077] Specifically, such as Figure 3 As shown, the solid box with M1 represents the ABIS PDU transmitted by the ABIS link with time domain number 1 (ABIS M1) in the frequency division multiplexing ABIS group with carrier sequence number M; the solid box with M2 represents the ABIS PDU transmitted by the ABIS link with time domain number 2 (ABIS M2) in the frequency division multiplexing ABIS group with carrier sequence number M, and so on. The solid box with MK represents the ABIS PDU transmitted by the ABIS link with time domain number K (ABIS MK) in the frequency division multiplexing ABIS group with carrier sequence number M. Specifically, as... Figure 3 As shown, solid-line boxes with the same labels, such as 11, 1K, M1, and MK, represent retransmissions.
[0078] In one possible implementation, the carriers of the broadcast isochronous stream links with non-overlapping frequency channels are different frequency hopping sequences generated according to the frequency hopping algorithm defined in the BLE specification.
[0079] In one possible implementation, when there is frequency channel overlap among the different frequency hopping sequences generated by multiple broadcast isochronous stream links according to the frequency hopping algorithm defined in the BLE specification, transmitting broadcast audio data through a broadcast isochronous group includes: determining the broadcast isochronous stream link to be avoided through a round-robin avoidance mechanism; and pausing the transmission of broadcast audio data on the currently avoided broadcast isochronous stream link.
[0080] It should be noted that different ABIS links generate different frequency hopping sequences according to the frequency hopping algorithm defined in the BLE specification. Therefore, most frequency channels between frequency division multiplexing (FDM) ABIS links do not overlap. When a few frequency channels overlap, an ABIS link take turns avoiding each other. The ABIS link that avoids the overlap suspends transmission on the conflicting frequency channel to avoid mutual interference. The multicarrier technology that uses different frequency hopping sequences can be called agile multicarrier technology.
[0081] Therefore, the differentiated frequency hopping sequence generated by the frequency hopping algorithm can reduce the risk of frequency conflicts between multiple broadcast isochronous stream links from a probabilistic perspective. When rare frequency channel overlap occurs, the audio data transmission task of the conflicting broadcast isochronous stream link can be temporarily suspended through a round-robin avoidance mechanism, ensuring that other links continue to operate without conflict. This dynamic avoidance strategy effectively avoids signal interference caused by frequency channel overlap, ensures the integrity and synchronization of multi-channel audio data within the broadcast isochronous group, and maintains the stability of the overall audio transmission system.
[0082] The WMCBA transmission method using the ABIG link will now be illustrated using a cinema bilingual wireless multi-channel audio broadcasting application as an example. Figure 2 The WMCBA system architecture shown depicts a WMCBA transmitting device (a cinema playback device) and a WMCBA receiving device (True Wireless Stereo, TWS) earphones. The cinema playback device transmits audio through four channels. The ABIG link between the cinema playback device and the TWS earphones consists of four ABIS links with a frequency domain carrier count of two. The cinema playback device uses the ABIG Info carried in the AUX_SYNC_IND PDU to indicate that Num_CA equals 1, i.e., the carrier count is two. Specifically, ABIS links coded 1 and 2 transmit Chinese dual-channel audio, while ABIS links coded 3 and 4 transmit English dual-channel audio. Some TWS earphones receive Chinese dual-channel audio, while others receive English dual-channel audio. The left and right earphones of the TWS earphones each receive audio data from one channel transmitted by one ABIS link.
[0083] like Figure 3The ABIG link coexists with the time slot structure of time division multiplexing and frequency division multiplexing. The ABIS link coded as 1 and 2 and the ABIS link coded as 3 and 4 avoid frequency channel conflicts in frequency division multiplexing by using different frequency hopping sequences. The ABIG ISO Interval is equal to 10 ms, and the multi-channel audio of the cinema playback device uses the Low Complexity Communication Codec (LC3) specified in the BLE Audio protocol.
[0084] The ABIG central device used by the cinema playback device as the WMCBA sending device is composed of an application processor and an extensible controller, and the extensible controller is composed of a main controller and a secondary controller.
[0085] The main parameters of the ABIG link include: the frame length of the dual-channel audio with a sampling rate of 48 kHz using LC3 encoding is 10 ms, the encoding rate of each channel is 96 kbps, the size of each channel service data unit is 120 bytes, the number of ABIS links is 4, each ABIS link transmits the audio data of one channel, the number of sub-events (NSE) is equal to 5, the burst number (BN) is equal to 1, the immediate repetition count (IRC) is equal to 5, and the pre-transmission offset (PTO) value is equal to 0. The load size of the ABIS PDU is 120 bytes, containing one SDU of one channel. Transmission is performed using the BLE 2 Mbps physical layer, and each ABIS PDU occupies an air time slot of 540 us, the time of minimum slot space (T_MSS) between ABIS PDUs is 160 us, and a total of 700 us is occupied for transmitting each ABIS PDU. The ABIS link coded as 1 and 2 transmits a total of 10 ABIS PDUs in one ABIG ISO Interval, occupying a total of 7 ms. The ABIS link coded as 3 and 4 transmits a total of 10 ABIS PDUs in one ABIG ISO Interval, also occupying 7 ms. The interval for transmitting the AUX_SYNC_IND PDU on the periodic advertising channel is 60 ms, and the offset value (ABIG Offset) of the start point of transmitting the AUX_SYNC_IND PDU from the ABIG start point is 1.23 ms.
[0086] Therefore, the ABIG link can make the cinema playing device support four multi-channel wireless broadcast audio, wherein the audio data of each channel can be repeatedly transmitted five times, so as to improve the anti-fading performance and anti-interference performance, or improve the transmission reliability. If only the time division multiplexing mode is used, and the audio data of four channels is simultaneously and highly reliably transmitted, there is a problem of insufficient bandwidth. The wireless multi-channel audio data transmission method described in the embodiments of the present application solves the bandwidth limitation problem of multi-channel transmission, can increase the effective bandwidth of wireless multi-channel audio data transmission, improve the transmission reliability of wireless multi-channel audio data, and reduce the transmission delay of wireless multi-channel audio data.
[0087] Figure 4 A central device is shown, comprising: an application and main processor, a multi-radio controller or an extensible controller;
[0088] The application and main processor are used for processing broadcast audio data, and are in communication connection with the multi-radio controller or the extensible controller through a host controller interface;
[0089] The multi-radio controller or the extensible controller is used for establishing a broadcast isochronous group, and transmitting multi-channel audio data through the broadcast isochronous group;
[0090] The broadcast isochronous group comprises a plurality of broadcast isochronous stream links, the plurality of broadcast isochronous stream links do not overlap each other in time slots or frequency channels, and at least two of the plurality of broadcast isochronous stream links overlap each other in time slots and do not overlap each other in frequency channels.
[0091] In a possible implementation manner, as shown in Figure 5 The multi-radio controller comprises a main radio unit and a main antenna, and at least one sub-radio unit and a sub-antenna. As shown in Figure 6 The extensible controller comprises a main controller and at least one sub-controller, and the main controller and the at least one sub-controller are connected in a cascading manner.
[0092] In a possible implementation manner, the application and main processor are further used for compressively encoding the multi-channel broadcast audio data, and packaging the multi-channel broadcast audio data into service data units; and are further used for configuring the multi-radio controller or the extensible controller to establish a broadcast isochronous group according to the link information of the broadcast isochronous group; and the multi-radio controller or the extensible controller is used for packaging the service data units into protocol data units, and transmitting the protocol data units through the plurality of broadcast isochronous stream links.
[0093] It should be noted that, as Figure 5As shown, the center device can be composed of a Multi-Radio Controller and an Application & Host Processor, the Multi-Radio Controller contains a Primary Radio and a Primary Antenna, and at least one (D≥1) Secondary Radio and a Secondary Antenna. Alternatively, as shown, the center device can be composed of a Scalable Controller and an Application & Host Processor, the Scalable Controller contains a Primary Controller and at least one (D≥1) Secondary Controller. Figure 6 As shown, the center device can be composed of a Multi-Radio Controller and an Application & Host Processor, the Multi-Radio Controller contains a Primary Radio and a Primary Antenna, and at least one (D≥1) Secondary Radio and a Secondary Antenna. Alternatively, as shown, the center device can be composed of a Scalable Controller and an Application & Host Processor, the Scalable Controller contains a Primary Controller and at least one (D≥1) Secondary Controller.
[0094] The Application & Host Processor and the Primary Controller of the Scalable Controller use the Host Controller Interface (HCI) defined in the Bluetooth Core Specification. The physical interface of the HCI can be UART, USB or SDIO, etc. The Primary Controller and the Secondary Controller, and the Secondary Controller and the Secondary Controller use cascading connection, the physical interface can be UART, USB or SDIO, etc. The number of cascaded Secondary Controllers is equal to the number of required Secondary Controllers. The multiple controllers of the Scalable Controller can use independent antennas or share the same antenna. Without loss of generality, the controller is the controller defined in the Bluetooth Core Specification, containing Radio, Baseband, Link Controller, Link Manager or Link Layer, HCI interface and other functions. The Application & Host Processor is the collection of all functional modules of the WMCBA center device except the controller, in addition to executing the Host protocol defined in the Bluetooth Core Specification, it also executes Profiles protocol, application function, audio codec, audio algorithm and audio input and output, etc.
[0095] Likewise, the application and the master processor also adopt the master-slave interface defined in the BT core specification to communicate with the multi-radio controller. The multiple radio units in the multi-radio controller can use independent antennas or share the same antenna.
[0096] In addition, the master controller or the slave controller in the extensible controller can time-division multiplex one or more ABIS in the ABIG. The application and the master processor send the multi-channel audio data to the master controller through the HCI interface, and then send the multi-channel audio data to the slave controller. The master radio unit or the slave radio unit in the multi-radio controller can time-division multiplex one or more ABIS in the ABIG.
[0097] It should be noted that the application and the master processor of the ABIG center device compress and encode the multi-channel audio data into audio data streams suitable for ABIG transmission according to application requirements, and then encapsulate the audio data streams into corresponding service data units (SDUs) and send the SDUs to the multi-radio controller or the extensible controller through the HCI interface. Then, the application and the master processor configure the multi-radio controller or the extensible controller according to the ABIGInfo of the ABIG link to establish a joint time-division multiplexing and frequency-division multiplexing ABIG link, and then encapsulate the SDUs of each channel into ABIS PDUs of each ABIS link and send the corresponding ABIS PDUs through the joint time-division multiplexing and frequency-division multiplexing ABIS link.
[0098] Figure 7 A wireless multi-channel audio data transmission method is shown according to an embodiment of the application, as shown in Figure 7 As shown in the method, the method is applied to a peripheral device, and the method comprises the following steps:
[0099] Step S701, receiving multi-channel audio data sent from a center device through one broadcast isochronous group;
[0100] The one broadcast isochronous group is established by the center device and comprises multiple broadcast isochronous stream links. The multiple broadcast isochronous stream links do not overlap each other in time slots or frequency channels. At least two of the multiple broadcast isochronous stream links overlap each other in time slots and do not overlap each other in frequency channels.
[0101] In a possible implementation, before receiving the multi-channel audio data sent from the center device through the one broadcast isochronous group, the method further comprises the following steps: receiving an auxiliary synchronization data packet through an advertising channel, the auxiliary synchronization data packet comprising link information of the broadcast isochronous group, the link information comprising a carrier number indication parameter; and receiving the multi-channel audio data sent from the center device through the one broadcast isochronous group comprises receiving the multi-channel audio data sent from the center device through the link information of the broadcast isochronous group.
[0102] In a possible implementation, the peripheral device is composed of multiple independent single-channel peripheral devices, and each single-channel peripheral device receives single-channel audio data carried by one broadcast isochronous stream link.
[0103] It should be noted that the peripheral device receives multi-channel audio data through a broadcast isochronous group established by the central device. The broadcast isochronous group includes multiple broadcast isochronous stream links, which are designed to ensure that time slots or frequency channels do not overlap with each other, and at least two broadcast isochronous stream links overlap with each other in time slots and do not overlap with each other in frequency channels to avoid transmission conflicts. In a specific implementation, the peripheral device first receives an auxiliary synchronization data packet through an advertising channel, and the data packet carries link information (including a key parameter, a carrier number indication parameter) of the broadcast isochronous group, and then uses the link information to accurately lock the transmission resource of the broadcast isochronous group to receive multi-channel audio data. In addition, when the peripheral device is composed of multiple independent single-channel peripheral devices, each single-channel peripheral device can independently receive single-channel audio data carried by one broadcast isochronous stream link, to realize distributed processing of channel data. In this way, the transmission bandwidth of wireless multi-channel audio data can be effectively increased, thereby improving the reliability of audio data transmission, and significantly reducing the delay of audio data transmission, to provide users with a smoother audio experience.
[0104] Figure 8 A wireless multi-channel audio data transmission apparatus is shown, according to an embodiment of the present application. The apparatus 80 is applied to a central device, and the apparatus 80 includes:
[0105] The establishment module 801 is configured to establish a broadcast isochronous group, wherein one broadcast isochronous group includes multiple broadcast isochronous stream links, and the multiple broadcast isochronous stream links do not overlap with each other in time slots or frequency channels, and at least two broadcast isochronous stream links in the multiple broadcast isochronous stream links overlap with each other in time slots and do not overlap with each other in frequency channels.
[0106] The first execution module 802 is configured to send multi-channel audio data through one broadcast isochronous group.
[0107] In a possible implementation, the first execution module 802 is further configured to send an auxiliary synchronization data packet through an advertising channel, the auxiliary synchronization data packet includes link information of the broadcast isochronous group, and the link information includes a carrier number indication parameter. The peripheral device receives multi-channel audio data sent by the central device through the link information of the broadcast isochronous group.
[0108] In a possible implementation, the first execution module 802 is further configured to send the auxiliary synchronization data packet by sequentially sending an extended advertising protocol data packet through a main advertising channel, sending an auxiliary advertising protocol data packet through a secondary advertising channel, and sending an auxiliary synchronization protocol data packet through a periodic advertising channel.
[0109] In a possible implementation, the carriers of the broadcast isochronous stream links with non-overlapping frequency channels are different frequency hopping sequences generated according to a frequency hopping algorithm defined in the BLE specification.
[0110] In a possible implementation, when there is frequency channel overlap in the different frequency hopping sequences generated by the multiple broadcast isochronous stream links according to the frequency hopping algorithm defined in the BLE specification, the first execution module 802 is further configured to determine a currently evaded broadcast isochronous stream link through a turn-by-turn evasion mechanism, and pause sending broadcast audio data on the currently evaded broadcast isochronous stream link.
[0111] In a possible implementation, one broadcast isochronous group adopts a time slot structure of joint time division multiplexing and frequency division multiplexing, wherein all broadcast isochronous stream links contained in the broadcast isochronous group are divided into at least two frequency division multiplexing groups, and the number of the frequency division multiplexing groups is equal to the number of carriers; the first execution module 802 is further configured to send multi-channel audio data through the multiple broadcast isochronous stream links, wherein each broadcast isochronous stream link sends audio data of one channel, or at least one broadcast isochronous stream link independently sends multi-channel audio data.
[0112] Figure 9 A wireless multi-channel audio data transmission device is shown, which is provided by an embodiment of the present application. The device 90 is applied to a peripheral device, and the device 90 comprises:
[0113] The receiving module 901 is configured to receive multi-channel audio data sent from a center device through one broadcast isochronous group, wherein the broadcast isochronous group is established by the center device, includes multiple broadcast isochronous stream links, the multiple broadcast isochronous stream links do not overlap with each other in time slots or frequency channels, and at least two broadcast isochronous stream links in the multiple broadcast isochronous stream links overlap with each other in time slots and do not overlap with each other in frequency channels.
[0114] In a possible implementation, the device 90 further comprises a second execution module, which is configured to, before receiving the multi-channel audio data sent from the center device through the broadcast isochronous group, receive an auxiliary synchronization data packet through an advertising channel, the auxiliary synchronization data packet includes link information of the broadcast isochronous group, and the link information includes a carrier number indication parameter; and the receiving of the multi-channel audio data sent from the center device through the broadcast isochronous group comprises receiving the multi-channel audio data sent from the center device through the link information of the broadcast isochronous group.
[0115] In a possible implementation, the peripheral device is composed of multiple independent single-channel peripheral devices, and each single-channel peripheral device receives single-channel audio data of one broadcast isochronous stream link.
[0116] Thus, by establishing a broadcast isochronous group including a plurality of broadcast isochronous stream links, and the plurality of broadcast isochronous stream links do not overlap with each other in time slots or frequency channels, at least two of the plurality of broadcast isochronous stream links overlap with each other in time slots and do not overlap with each other in frequency channels, and the multi-channel audio data is transmitted through the broadcast isochronous group. The transmission bandwidth of the wireless multi-channel audio data can be effectively increased, thereby improving the reliability of the audio data transmission, and the delay of the audio data transmission can be significantly reduced, thereby providing a more smooth audio experience for the user.
[0117] The embodiment of the present application further provides an electronic device 100, as shown in the accompanying drawings, comprising a processor 1001, a memory 1002, and a program stored in the memory 1002 and executable on the processor 1001, and the program is executed by the processor to implement the steps of the wireless multi-channel audio data transmission method shown in the above embodiment. Figure 10
[0118] The embodiment of the present application further provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program, and the computer program is executed by the processor to implement the steps of the wireless multi-channel audio data transmission method shown in the above embodiment and can achieve the same technical effects, and details are not described herein again to avoid repetition. The computer readable storage medium includes a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, etc.
[0119] The embodiment of the present application further provides a computer program product, comprising computer instructions, and the computer instructions are executed to implement the steps of the wireless multi-channel audio data transmission method shown in the above embodiment and can achieve the same technical effects, and details are not described herein again to avoid repetition.
[0120] It should be noted that, in this document, the terms "comprising", "including", or any other variant thereof are intended to cover non-exclusive inclusions, so that the processes, methods, articles, or devices including a series of elements not only include those elements, but also include other elements not explicitly listed, or further include elements inherent to such processes, methods, articles, or devices. Without more limitations, the element defined by the statement "comprising a" does not exclude the presence of another identical element in the process, method, article, or device including the element.
[0121] Through the above description of the embodiments, those skilled in the art can clearly understand that the above-mentioned example methods can be realized by means of software and a necessary general hardware platform, and of course, can also be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a software product in essence or in the form of a part that contributes to the prior art. The computer software product is stored in a storage medium (such as a ROM / RAM, a magnetic disk, or an optical disk) and includes a plurality of instructions for causing a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in the various embodiments of the present application.
[0122] The embodiments of the present application are described above in combination with the drawings, but the present application is not limited to the above-mentioned specific embodiments, and the above-mentioned specific embodiments are only illustrative and not restrictive. Those skilled in the art can make many forms without departing from the scope of the present application under the inspiration of the present application, and all of them belong to the protection of the present application.
Claims
1. A wireless multi-channel audio data transmission method, characterized in that, The method is applied to a central device, and the method includes: A broadcast isochronous group is established, wherein the broadcast isochronous group includes multiple broadcast isochronous stream links, the multiple broadcast isochronous stream links do not overlap with each other in time slots or frequency channels, and at least two of the multiple broadcast isochronous stream links overlap with each other in time slots but do not overlap with each other in frequency channels; Multichannel audio data is transmitted via a broadcast isochronous group.
2. The method according to claim 1, characterized in that, It also includes: An auxiliary synchronization data packet is sent through an advertising channel. The auxiliary synchronization data packet includes the link information of the broadcast isochronous group. The link information includes a carrier number indication parameter. Peripheral devices receive the multi-channel audio data sent by the central device through the link information of the broadcast isochronous group.
3. The method according to claim 2, characterized in that, Sending auxiliary synchronization data packets via the advertising channel includes: The auxiliary synchronization data packet is sent sequentially through the main advertising channel, the secondary advertising channel, and the periodic advertising channel.
4. The method according to claim 1, characterized in that, The carriers of broadcast isochronous stream links with non-overlapping frequency channels are different frequency hopping sequences generated according to the frequency hopping algorithm defined in the BLE specification.
5. The method according to claim 1, characterized in that, When frequency channels overlap among the different frequency hopping sequences generated by the multiple broadcast isochronous stream links according to the frequency hopping algorithm defined in the BLE specification, transmitting broadcast audio data through the broadcast isochronous group includes: The broadcast isochronous stream link to be avoided is determined by a round-robin avoidance mechanism; On the currently avoided broadcast isochronous stream link, the transmission of the broadcast audio data is paused.
6. The method according to claim 2, characterized in that, The broadcast isochronous group adopts a time slot structure of joint time division multiplexing and frequency division multiplexing, wherein all broadcast isochronous stream links included in the broadcast isochronous group are divided into at least two frequency division multiplexing groups, wherein the number of frequency division multiplexing groups is equal to the number of carriers; Sending multi-channel audio data through a broadcast isochronous group includes sending multi-channel audio data through multiple broadcast isochronous stream links, wherein each broadcast isochronous stream link sends one channel of audio data; or, at least one broadcast isochronous stream link sends multi-channel audio data independently.
7. A central device, characterized in that, include: Applications include main processors, multi-RF controllers, or expandable controllers; The application and the main processor are used to process broadcast audio data and communicate with the multi-RF controller or the scalable controller through the host controller interface. The multi-RF controller or the scalable controller is configured to establish a broadcast isochronous group and transmit the multi-channel audio data through the broadcast isochronous group. The broadcast isochronous group includes multiple broadcast isochronous stream links, which do not overlap in time slots or frequency channels, and at least two of the multiple broadcast isochronous stream links overlap in time slots but do not overlap in frequency channels.
8. The central equipment according to claim 7, characterized in that, The multi-RF controller includes a main RF unit and a main antenna, and at least one secondary RF unit and a secondary antenna; The scalable controller includes a main controller and at least one secondary controller, which are connected in a cascaded manner.
9. The central equipment according to claim 7, characterized in that, The application and main processor are also used to compress and encode the multi-channel broadcast audio data and encapsulate it into a service data unit; and to configure the multi-RF controller or the scalable controller to establish the broadcast isochronous group according to the link information of the broadcast isochronous group. The multi-RF controller or the scalable controller is used to encapsulate the service data unit into a protocol data unit and transmit it through the multiple broadcast isochronous stream links.
10. A method for wireless multi-channel audio data transmission, characterized in that, The method is applied to peripheral devices, and the method includes: Multi-channel audio data is received from a central device through a broadcast isochronous group, wherein the broadcast isochronous group is established by the central device and includes multiple broadcast isochronous stream links, the multiple broadcast isochronous stream links do not overlap with each other in time slots or frequency channels, and at least two of the multiple broadcast isochronous stream links overlap with each other in time slots but do not overlap with each other in frequency channels.
11. The method according to claim 10, characterized in that, Before receiving multi-channel audio data transmitted from a central device via a broadcast isochronous group, the method further includes: The auxiliary synchronization data packet is received through the advertising channel. The auxiliary synchronization data packet includes the link information of the broadcast isochronous group. The link information includes the carrier number indication parameter. Received multi-channel audio data from a central device via a broadcast isochronous group, including: The multi-channel audio data sent by the central device is received through the link information of the broadcast isochronous group.
12. The method according to claim 10, characterized in that, The peripheral equipment consists of multiple independent mono peripheral devices, each of which receives mono audio data from a broadcast isochronous stream link.
13. A wireless multi-channel audio data transmission device, characterized in that, The device is applied to a central device, and the device includes: A module is established to establish a broadcast isochronous group, wherein a broadcast isochronous group includes multiple broadcast isochronous stream links, the multiple broadcast isochronous stream links do not overlap with each other in time slots or frequency channels, and at least two of the multiple broadcast isochronous stream links overlap with each other in time slots but do not overlap with each other in frequency channels; The first execution module is used to send multi-channel audio data through the broadcast isochronous group.
14. A wireless multi-channel audio data transmission device, characterized in that, The device is applied to peripheral equipment, and the device includes: A receiving module is configured to receive multi-channel audio data transmitted from a central device via a broadcast isochronous group, wherein the broadcast isochronous group is established by the central device and includes multiple broadcast isochronous stream links, the multiple broadcast isochronous stream links do not overlap with each other in time slots or frequency channels, and at least two of the multiple broadcast isochronous stream links overlap with each other in time slots but do not overlap with each other in frequency channels.
15. A wireless multi-channel audio data transmission system, characterized in that, The system includes: Central device, used to perform the wireless multi-channel audio data transmission method according to any one of claims 1-6; At least one peripheral device is used to perform the wireless multi-channel audio data transmission method according to any one of claims 10-12.
16. An electronic device, characterized in that, include: A processor, a memory, and a program stored in the memory and executable on the processor, wherein when the program is executed by the processor, it implements the steps of the wireless multi-channel audio data transmission method as claimed in any one of claims 1-6, or, when the program is executed by the processor, it implements the steps of the wireless multi-channel audio data transmission method as claimed in any one of claims 10-12.
17. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps of the wireless multi-channel audio data transmission method as described in any one of claims 1-6, or, when executed by the processor, implements the steps of the wireless multi-channel audio data transmission method as described in any one of claims 10-12.
18. A computer program product, characterized in that, The method includes computer instructions that, when executed by a processor, implement the steps of the wireless multi-channel audio data transmission method as described in any one of claims 1-6, or, when executed by the processor, the computer instructions implement the steps of the wireless multi-channel audio data transmission method as described in any one of claims 10-12.