Streaming media data transmission method, electronic device, communication system, and chip

Abstract

The present application relates to the technical field of communications, and provides a streaming media data transmission method, an electronic device, a communication system, and a chip. The method is applied to a first electronic device, and specifically comprises: acquiring streaming media data to be sent, wherein said streaming media data comprises a plurality of data frames; coding each data frame into a first coded frame and a second coded frame; and sending the first coded frame to a second electronic device via a first physical layer (PHY) link, and sending the second coded frame to the second electronic device via a second PHY link, wherein the bit rate of the first coded frame is lower than that of the second coded frame, and the reliability of the first PHY link is higher than that of the second PHY link. The technical solution provided by the present application can improve the anti-interference capability during streaming media data transmission and can improve the stability of data transmission.

Description

Streaming media data transmission methods, electronic devices, communication systems, and chips

[0001] This application claims priority to Chinese patent application filed on April 22, 2024, with application number 202410483655.2 and entitled "Method for transmitting streaming media data, electronic device, communication system and chip", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of communication technology, and in particular to a method for transmitting streaming media data, an electronic device, a communication system, and a chip. Background Technology

[0003] With the development of computer technology, electronic devices can now transmit various streaming media data, such as audio streams, via wireless communication links. However, due to the complexity of the wireless environment and the uncertainty of air interface transmission, wireless communication links between electronic devices are susceptible to interference factors, such as signal blockage and crosstalk. When these interference factors occur, the streaming media data sent from the transmitting end may not be delivered to the receiving end in a timely manner, leading to playback abnormalities due to data loss. For example, when a mobile phone sends audio stream data to a Bluetooth headset via a Bluetooth link, interference factors may prevent the audio stream data from being delivered to the Bluetooth headset in a timely manner, resulting in silent, intermittent, or stuttering audio playback from the Bluetooth headset. It can be seen that the above-mentioned streaming media data transmission process has poor anti-interference capabilities and unstable data transmission. Summary of the Invention

[0004] This application provides a streaming media data transmission method, electronic device, communication system, and chip to solve the problems of poor anti-interference ability and poor data transmission stability in the streaming media data transmission process.

[0005] To achieve the above objectives, this application adopts the following technical solution:

[0006] In a first aspect, embodiments of this application provide a method for transmitting streaming media data. The method is applied to a first electronic device and specifically includes: acquiring streaming media data to be sent, the streaming media data including multiple data frames; encoding each data frame into a first encoded frame and a second encoded frame; sending the first encoded frame to a second electronic device through a first physical layer PHY link, and sending the second encoded frame to the second electronic device through a second PHY link; wherein the bit rate of the first encoded frame is lower than the bit rate of the second encoded frame, and the reliability of the first PHY link is higher than the reliability of the second PHY link.

[0007] The method provided in this application embodiment allows the first electronic device to send both a low-bit-rate first encoded frame and a high-bit-rate second encoded frame to the second electronic device via a first PHY link, with the first PHY link offering higher reliability. In this configuration, even if interference occurs during communication, causing the high-bit-rate second encoded frame to be blocked in the buffer, the low-bit-rate first encoded frame can usually still be successfully sent, thus ensuring, to a certain extent, that the streaming media data can be played normally on the second electronic device. Therefore, the transmission process of streaming media data has stronger anti-interference capabilities and better stability.

[0008] In some embodiments, the reliability of the first PHY link is higher than that of the second PHY link, including:

[0009] The transmission rate of the first PHY link is lower than the transmission rate of the second PHY link; and / or,

[0010] The bandwidth of the first PHY link is lower than the bandwidth of the second PHY link; and / or,

[0011] The receiver sensitivity of the first PHY link is higher than that of the second PHY link; and / or,

[0012] The transmit power of the first PHY link is higher than that of the second PHY link.

[0013] In some embodiments, encoding each data frame into a first encoded frame and a second encoded frame includes: encoding each data frame into a first encoded frame using a first encoding method; and encoding each data frame into a second encoded frame using a second encoding method; wherein the encoding formats of the first encoding method and the second encoding method are the same or different, and the bitrate of the first encoding method is lower than the bitrate of the second encoding method.

[0014] In this embodiment, both the first and second encoded frames can be played independently. In other words, regardless of which encoded frame the second electronic device receives, it can play streaming media data, thereby improving the stability of data transmission.

[0015] In some embodiments, encoding each data frame into a first encoded frame and a second encoded frame includes: splitting each data frame into a first part and a second part, wherein the first part can be played independently, and the second part can be played after being merged with the first part; encoding the first part into a first encoded frame using a first encoding method; and encoding the second part into a second encoded frame using a second encoding method; wherein the encoding formats of the first encoding method and the second encoding method are the same or different, and the bitrate of the first encoding method is lower than the bitrate of the second encoding method.

[0016] In this embodiment, the first encoded frame and the second encoded frame are obtained by encoding two different parts of the same data frame. Therefore, there are no redundant parts between the first encoded frame and the second encoded frame, which can reduce the amount of data transmitted and improve data transmission efficiency.

[0017] In some embodiments, each data frame is encoded into a first encoded frame and a second encoded frame; and the first encoded frame is transmitted through a first physical layer PHY link, and the second encoded frame is transmitted through a second PHY link, including: detecting the air interface quality of the first electronic device; if the air interface quality meets a second preset condition, encoding each data frame into a first encoded frame and a second encoded frame; transmitting the first encoded frame through the first PHY link, and transmitting the second encoded frame through the second PHY link.

[0018] In this embodiment, the first electronic device only transmits encoded data through two PHY links simultaneously under specific conditions, namely when the air interface quality meets the second preset condition, which can reduce the occupation of electronic device resources to a certain extent.

[0019] In some embodiments, when each data frame is encoded into a first encoded frame using a first encoding method and each data frame is encoded into a second encoded frame using a second encoding method, the method further includes:

[0020] When the air interface quality meets the first preset condition, each data frame is encoded into a first encoded frame and transmitted through the first PHY link, without transmitting the second encoded frame through the second PHY link. This method not only improves the anti-interference capability of streaming media data transmission but also saves the transmission power consumption of the first electronic device and the reception power consumption of the second electronic device, reducing resource waste.

[0021] When the air interface quality meets the third preset condition, each data frame is encoded into a second encoded frame and transmitted through the second PHY link instead of the first encoded frame. This method not only ensures the quality of streaming media data but also saves the transmission power consumption of the first electronic device and the reception power consumption of the second electronic device, reducing resource waste.

[0022] In some embodiments, where each data frame is split into the first and second parts described above and then encoded to obtain a first encoded frame and a second encoded frame, the method further includes: if the air interface quality meets a first preset condition, encoding each data frame into a first encoded frame and transmitting the first encoded frame through a first PHY link instead of transmitting the second encoded frame through a second PHY link. This method improves the anti-interference capability of streaming media data transmission, saves the transmission power consumption of the first electronic device and the reception power consumption of the second electronic device, and reduces resource waste.

[0023] In the above process, the air interface quality corresponding to each preset condition gradually improves in the order of the first preset condition, the second preset condition, and the third preset condition. That is, when the air interface quality is poor, the first electronic device only sends the first coded frame to the second electronic device; when the air interface quality is moderate, the first electronic device sends both the first and second coded frames to the second electronic device; and when the air interface quality is good, the first electronic device only sends the second coded frame to the second electronic device.

[0024] In some embodiments, the maximum number of retransmissions M of the first coded frame is greater than the maximum number of retransmissions N of the second coded frame, so as to increase the probability of successful transmission of the first coded frame and further improve the anti-interference capability and stability of the data transmission process.

[0025] In some embodiments, the maximum number of retransmissions N for the second coded frame is 0. That is, the second coded frame is not retransmitted to reduce resource waste.

[0026] In some embodiments, the streaming media data includes at least one of audio stream data, video stream data, text stream data, image stream data, and animation stream data.

[0027] Secondly, embodiments of this application provide a method for transmitting streaming media data. This method is applied to a second electronic device and specifically includes: receiving a first encoded frame of streaming media data from a first electronic device through a first physical layer (PHY) link, and receiving a second encoded frame of the streaming media data from the first electronic device through a second PHY link; playing the streaming media data based on the received first and second encoded frames; wherein the streaming media data includes multiple data frames, each data frame is encoded into a first encoded frame and a second encoded frame, the bitrate of the first encoded frame is lower than the bitrate of the second encoded frame, and the reliability of the first PHY link is higher than the reliability of the second PHY link.

[0028] The method provided in this application embodiment allows the second electronic device to receive both low-bitrate first encoded frames from the first electronic device via the first PHY link and high-bitrate second encoded frames from the first electronic device via the second PHY link, with the first PHY link offering higher reliability. In this scenario, even if interference occurs and causes the high-bitrate second encoded frames to be blocked on the first electronic device side, the low-bitrate first encoded frames can usually still be successfully received, thus ensuring, to a certain extent, the normal playback of streaming media data on the second electronic device. Therefore, the transmission process of streaming media data has stronger anti-interference capabilities and better stability.

[0029] In some embodiments, the reliability of the first PHY link is higher than that of the second PHY link, including:

[0030] The transmission rate of the first PHY link is lower than the transmission rate of the second PHY link; and / or,

[0031] The bandwidth of the first PHY link is lower than the bandwidth of the second PHY link; and / or,

[0032] The receiver sensitivity of the first PHY link is higher than that of the second PHY link; and / or,

[0033] The transmit power of the first PHY link is higher than that of the second PHY link.

[0034] In some embodiments, the first encoded frame is obtained by encoding a data frame using a first encoding method; and the second encoded frame is obtained by encoding a data frame using a second encoding method; wherein the encoding formats of the first encoding method and the second encoding method are the same or different, and the bitrate of the first encoding method is lower than that of the second encoding method.

[0035] Based on this, the second electronic device plays streaming media data according to the received first encoded frame and second encoded frame, including: at a first moment, if the first encoded frame and second encoded frame of the first data frame have been received, then the first data frame is played according to the second encoded frame; at a first moment, if the first encoded frame of the first data frame has been received, but the second encoded frame of the first data frame has not been received, then the first data frame is played according to the first encoded frame; at a first moment, if the first encoded frame of the first data frame has been received, but the second encoded frame of the first data frame has not been received, then the first data frame is played according to the second encoded frame; wherein, the first data frame is any data frame in the streaming media data, and the first moment is the moment when the second electronic device needs to play the first data frame.

[0036] The method provided in this embodiment enables the second electronic device to balance the smoothness and quality of streaming media playback, resulting in a better user experience.

[0037] In other embodiments, each data frame includes a first part and a second part. The first part can be played independently, and the second part can be played after being merged with the first part. The first encoded frame is obtained by encoding the data frame using a first encoding method. The second encoded frame is obtained by encoding the data frame using a second encoding method. The encoding formats of the first encoding method and the second encoding method are the same or different, and the bitrate of the first encoding method is lower than that of the second encoding method.

[0038] Based on this, the second electronic device plays streaming media data according to the received first and second encoded frames, including: at a first moment, if the first and second encoded frames of the first data frame have been received, then the first and second encoded frames are merged and played to produce the first data frame; at a first moment, if the first encoded frame of the first data frame has been received but the second encoded frame has not been received, then the first data frame is played according to the first encoded frame. Wherein, the first data frame is any one of the multiple data frames of the streaming media data, and the first moment is the moment when the first data frame needs to be played.

[0039] The method provided in this embodiment enables the second electronic device to balance the smoothness and quality of streaming media playback, resulting in a better user experience.

[0040] In some embodiments, the streaming media data includes at least one of audio stream data, video stream data, text stream data, image stream data, and animation stream data.

[0041] In a second aspect, embodiments of this application provide an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the method shown in the first aspect above, or implements the method shown in the second aspect above.

[0042] Thirdly, embodiments of this application provide a communication system including a first electronic device and a second electronic device, the first electronic device and the second electronic device being wirelessly connected, the first electronic device being configured to perform the method shown in the first aspect above, or being configured to perform the method shown in the second aspect above.

[0043] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the method shown in the first aspect or the method shown in the second aspect.

[0044] Fifthly, embodiments of this application provide a computer program product comprising a computer program that, when executed by an electronic device, causes the electronic device to implement the method shown in the first aspect above, or the method shown in the second aspect above.

[0045] In a sixth aspect, embodiments of this application provide a chip including a processor and a memory, wherein the memory stores a computer program that, when executed by the processor, implements the method shown in the first aspect above, or the method shown in the second aspect above.

[0046] It is understood that the beneficial effects of the third to sixth aspects mentioned above can be found in the relevant descriptions in the first or second aspects mentioned above, and will not be repeated here. Attached Figure Description

[0047] Figure 1A is a schematic diagram of audio stream data transmission provided in an embodiment of this application;

[0048] Figure 1B is a schematic diagram of audio stream data transmission provided in another embodiment of this application;

[0049] Figure 2 is a schematic diagram of the communication system to which the streaming media data transmission method provided in the embodiments of this application is applicable;

[0050] Figure 3 is a schematic diagram of the audio stream data transmission process provided in an embodiment of this application;

[0051] Figure 4 is a schematic flowchart of the streaming media data transmission method provided in an embodiment of this application;

[0052] Figure 5 is a schematic diagram of the receiving sensitivity of different PHY links provided in the embodiments of this application;

[0053] Figure 6 is a schematic flowchart of a streaming media data transmission method provided in another embodiment of this application;

[0054] Figure 7 is a schematic diagram of the encoding and decoding process of streaming media data provided in an embodiment of this application;

[0055] Figure 8 is a schematic flowchart of an audio stream data transmission method provided in another embodiment of this application;

[0056] Figure 9 is a schematic diagram of the audio stream data encoding and decoding process provided in an embodiment of this application;

[0057] Figure 10 is a schematic flowchart of a streaming media data transmission method provided in another embodiment of this application;

[0058] Figure 11 is a schematic diagram of the encoding and decoding process of streaming media data provided in another embodiment of this application;

[0059] Figure 12 is a schematic flowchart of an audio stream data transmission method provided in another embodiment of this application;

[0060] Figure 13 is a schematic diagram of the encoding and decoding process of audio stream data provided in another embodiment of this application;

[0061] Figure 14 is a schematic diagram of the structure of a chip provided in an embodiment of this application. Detailed Implementation

[0062] The technical solutions provided in the embodiments of this application will be described below with reference to the accompanying drawings.

[0063] It should be understood that in the description of the embodiments of this application, unless otherwise stated, " / " means "or". For example, A / B can mean A or B. The "and / or" in this document is merely a description of the relationship between related objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist simultaneously, and B exists alone.

[0064] In this embodiment, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this embodiment, unless otherwise stated, "a plurality of" means two or more.

[0065] With the rapid development of computer technology, electronic devices now support communication via streaming media technology. Streaming media technology refers to the technology of compressing a series of multimedia data and then transmitting it in segments in real-time via wired or wireless connections. In streaming media technology, this segmented, real-time transmitted data is called streaming media data. For example, streaming media data includes audio stream data, video stream data, text stream data, image stream data, and animation stream data. Because streaming media data has strong real-time performance, users can start playing it at any time without waiting for the entire file to download, providing a better user experience, and therefore its application has become increasingly widespread in recent years.

[0066] In this embodiment, wireless connections include Wi-Fi, classic Bluetooth (BT), Bluetooth Low Energy (BLE), Sparklink-basic (SLB), Sparklink-low-energy (SLE), and cellular communication connections.

[0067] In this embodiment, the electronic device can be a mobile phone, tablet computer, desktop computer, laptop computer, handheld computer, notebook computer, ultra-mobile personal computer (UMPC), netbook, or a cellular phone, personal digital assistant (PDA), augmented reality (AR) device, virtual reality (VR) device, artificial intelligence (AI) device, wearable device (e.g., smart bracelet), Bluetooth headset, smart home device (e.g., smart speaker), in-vehicle device, and / or smart city device, etc. This application embodiment does not impose any special limitations on the specific type of electronic device.

[0068] In some embodiments, such as shown in Figure 1A, the mobile phone and Bluetooth headset are connected via a BT link, and the mobile phone sends audio stream data to the Bluetooth headset through this BT link. Accordingly, the Bluetooth headset receives and plays the audio stream data.

[0069] In other embodiments, such as shown in Figure 1B, the mobile phone and the smart speaker are connected via a Wi-Fi link, and the mobile phone sends audio streaming data to the smart speaker via this Wi-Fi link. Accordingly, the smart speaker receives and plays the audio streaming data.

[0070] The following example illustrates the method for transmitting streaming media data provided in this application embodiment, using the example of a first electronic device 100 sending audio stream data to a second electronic device 200 via a BT link.

[0071] In this embodiment, the audio stream data can be music, audio from call services, sound from video, game background music, incoming call alerts, message alerts, navigation voice broadcasts, intelligent broadcasts, alarm clock alerts, key presses, and other audio stream data. Call services include services related to voice data played for users in scenarios such as telephone calls (including incoming and outgoing calls), voice messages, games, or voice assistants. This embodiment does not limit the specific content of the audio stream data.

[0072] Figure 2 is a schematic diagram of the communication system to which the streaming media data transmission method provided in this application is applicable. The communication system includes a first electronic device 100 and a second electronic device 200, and the first electronic device 100 and the second electronic device 200 are connected via a BT link.

[0073] The first electronic device 100 is used to encode audio stream data and then send it to the second electronic device 200 for playback. It can also be referred to as a source or an encoder. For example, the first electronic device 100 can be an electronic device capable of sending audio stream data, such as a mobile phone, laptop, or tablet computer.

[0074] In this embodiment, the first electronic device 100 includes an application processor (AP) 110, a Bluetooth controller (BT Controller) 120, and a radio frequency antenna 130, wherein the AP 110 includes an application program 111 and a Bluetooth host (BT Host) 112.

[0075] Application 111 is located at the top layer of the entire audio system of the first electronic device 100, and includes various applications related to audio playback, such as telephone applications, music playback applications, video playback applications, navigation applications, chat applications, and game applications. It should be noted that the audio supported by these applications is usually analog signals, and their audio formats include Moving Picture Experts Group Audio Layer III (MP3), Windows Media Audio (WMA), and Waveform (WAV). Since analog signals do not support transmission via wireless communication links, when the first electronic device 100 sends audio stream data of a certain application to the second electronic device 200 via the BT link, it needs to first send the audio stream data to the BT Host 112 for processing.

[0076] BT Host 112 is a logical entity that includes, but is not limited to, the audio framework (audio FWK), the Bluetooth stack (BT stack), and the audio hardware abstraction layer (audio HAL). The audio FWK decodes audio stream data from the application using pulse code modulation (PCM) technology, converting it into a PCM bitstream. The PCM bitstream is a binary digital signal that supports transmission over wireless communication links. The BT stack encapsulates the PCM bitstream to generate data packets that conform to Bluetooth protocols, such as subband coding (SBC), advanced audio coding (AAC), low latency low complexity high resolution audio coding (L2HC), AptX, LDAC, and other encoding formats supported by Bluetooth protocols, for transmission over the BT link. The audio HAL buffers data packets to be sent.

[0077] It should be noted that, in this embodiment, data packets in the audio stream data can also be described in units of "frames." For example, the data packets encoded by Bluetooth are called encoded frames, such as the base frame, high-definition frame, and lossless frame mentioned below. The data packets corresponding to the encoded audio frames before encoding can be called audio frames.

[0078] The BT Controller 120 is also a logical entity, comprising a host controller interface (HCI), a link layer (LL layer), and a physical layer (PHY layer). The HCI serves as the interface between the BT Host 112 and the BT Controller 120. The LL layer is used for link management, such as creating, modifying, and releasing links. The PHY layer determines link parameters such as the radio frequency band, modulation / demodulation method, data transmission rate, and bandwidth used by the wireless communication link.

[0079] It should be noted that the PHY layer supports establishing different PHY links based on different link parameters, such as the first PHY link and the second PHY link shown below. In this embodiment, the link parameters include data transmission rate, bandwidth, and modulation / demodulation method. The data transmission rate of the PHY link can be understood as the speed at which the PHY layer sends data to the PHY link, such as 4Mbps (megabits per second), 8Mbps, 16Mbps, or 2.4GHz, 5GHz, etc. The higher the data transmission rate, the greater the amount of data transmitted per unit time. Bandwidth is used to represent the amount of data transmitted per second by the wireless communication link. Modulation / demodulation methods include: quadrature phase shift keying (QPSK), quadrature amplitude modulation (QAM), binary phase shift keying (BPSK), etc.

[0080] The radio frequency antenna 130 is used to transmit electromagnetic wave signals corresponding to audio stream data to the second electronic device 200. Each radio frequency antenna 130 can be used to cover one or more communication frequency bands.

[0081] The second electronic device 200 is used to receive audio stream data sent by the first electronic device 100, decode it, and play it. It can also be called a sink, decoder, or playback device. For example, the second electronic device 200 can be a true wireless stereo (TWS) headset, a regular wireless headset, a Bluetooth speaker, a smartwatch, smart glasses, or other electronic devices that can receive and play audio stream data.

[0082] In this embodiment, the second electronic device 200 includes a radio frequency antenna 210, a system on chip (SoC) 220, an audio codec 230, and a speaker 240.

[0083] Radio frequency antenna 210 is used to receive audio stream data sent by first electronic device 100 via electromagnetic wave signals. Each radio frequency antenna 210 can be used to cover one or more communication frequency bands.

[0084] SoC 220 includes BT Host 221, BT Controller 222, and audio digital signal processor (audio DSP) 223. The functions of BT Controller 222 are detailed in the description of the first electronic device 100 and will not be repeated here. BT Host 221 buffers received audio stream data, unpacks the audio stream data, and decodes the unpacked audio stream data from Bluetooth encoding formats such as SBC and AAC into a PCM stream. Audio DSP 223 performs a series of processing operations on the PCM stream, including acquisition, conversion, compression, filtering, enhancement, and decoding, which improves audio quality and provides a better listening experience to meet users' audio playback requirements for multimedia information such as music, games, and movies. Subsequently, BT Host 221 sends the processed audio stream data to audio codec 230 for further processing.

[0085] Audio codec 230 is a hybrid of an audio encoder and an audio decoder. The audio coder converts analog audio stream data into digital signals for wireless transmission. The audio decoder converts digital audio stream data into analog signals for playback by the speaker. In this embodiment, after receiving the PCM bitstream corresponding to the audio, audio codec 230 converts it into analog signals in formats such as MP3, WMA, and WAV, and sends them to speaker 240 for playback.

[0086] Speaker 240 is used to play audio stream data processed by audio codec 230.

[0087] In short, as shown in Figure 3, in the above communication system, the first electronic device 100 transmits audio stream data in formats such as MP3 via air interface after PCM encoding, Bluetooth encoding, and anti-shake buffering. Correspondingly, the second electronic device 200 plays the received audio stream data after anti-shake buffering, Bluetooth decoding, and PCM decoding.

[0088] However, due to the complexity of the wireless environment and the uncertainty of air interface transmission, the wireless communication link (e.g., a BT link) between the first electronic device 100 and the second electronic device 200 may be subject to some interference factors, such as signal blockage and signal crosstalk. When these interference factors occur, some audio stream data of the first electronic device 100 may be blocked in the buffer and cannot be sent to the second electronic device 200 in time. This can cause the second electronic device 200 to experience phenomena such as no sound, intermittent playback, or stuttering due to missing audio stream data. The audio transmission process has poor anti-interference capability and stability, resulting in a poor user experience.

[0089] To improve the anti-interference capability and stability of the audio transmission process, in some embodiments, as shown in Figure 3, the first electronic device 100 monitors the amount of data in the buffer in real time during the transmission of audio stream data. If the data amount exceeds a threshold, it notifies the Bluetooth encoder (BT stack in Figure 2) to reduce the Bluetooth encoding bitrate. Optionally, the Bluetooth encoder can reduce the bitrate by changing the encoding parameters without changing the encoding method, or it can choose other encoding methods with lower bitrates; this embodiment does not impose any restrictions on this. Bitrate, also known as bit rate, refers to the amount of data transmitted per unit time. It can be understood that since lower bitrate data requires less data transmission per unit time, reducing the bitrate can reduce the amount of data that needs to be transmitted over the air interface, thereby enabling the audio stream data to be sent to the second electronic device 200 in a timely manner. This alleviates the audio stream data congestion in the first electronic device 100 to some extent and improves the playback effect of the second electronic device 200.

[0090] However, in streaming media technology, the first electronic device 100 needs to send streaming media data in the order of encoding, that is, the data encoded first is sent first, and the data encoded later is sent later. Therefore, when the amount of data in the buffer of the first electronic device 100 is too large, even if the bitrate of subsequent audio stream data is reduced, the first electronic device 100 still needs to send all the high-bitrate audio stream data that is already blocked before it can send the low-bitrate audio stream data, thereby reducing the impact of interference on the audio transmission process. Therefore, the response time of this process is relatively long, and its anti-interference capability is limited. In some cases, the high-bitrate audio stream data blocked in the buffer cannot be sent to the second electronic device 200 in a timely manner, resulting in intermittent, silent, or stuttering audio playback on the second electronic device 200.

[0091] Therefore, this application provides a method for transmitting streaming media data. In this method, a first electronic device 100 transmits streaming media data (e.g., audio streaming data) with different bit rates to a second electronic device 200 simultaneously through PHY links with different reliability, thereby improving the anti-interference capability of the streaming media data transmission process.

[0092] Figure 4 is a schematic flowchart of a streaming media data transmission method provided in an embodiment of this application. Referring to Figure 4, the method specifically includes the following steps S401 to S405.

[0093] S401, the first electronic device 100 and the second electronic device 200 establish a first PHY link and a second PHY link based on a wireless connection, and the reliability of the first PHY link is higher than that of the second PHY link.

[0094] In this embodiment, the wireless connection between the first electronic device 100 and the second electronic device 200 can be a Bluetooth connection, a Wi-Fi connection, etc., and this embodiment does not impose any limitations on this. For example, in a scenario where a mobile phone sends audio stream data to a Bluetooth headset, the wireless connection is typically a Bluetooth connection.

[0095] Based on this wireless connection, the first electronic device 100 and the second electronic device 200 can establish multiple PHY links. The link parameters of a PHY link include transmission rate, bandwidth, and modulation / demodulation method. When the link parameters of a PHY link are different, its reliability typically varies.

[0096] In this embodiment, the reliability of the PHY link can be understood as the probability of successful data transmission via the PHY link. It can be understood that the higher the reliability of the PHY link, the higher the probability of successful data transmission, and the less likely the second electronic device 200 is to experience playback interruptions, silence, or stuttering.

[0097] In some implementations, the reliability of a PHY link can be reflected by its receiver sensitivity. Receiver sensitivity refers to the lowest signal strength that the receiver can receive and still function normally, measured in dBm (decibels per meter). Receiver sensitivity is typically a large negative dBm value, such as -80dBm or -90dBm. Generally, the higher the transmission rate and bandwidth of a PHY link, the lower its receiver sensitivity and the lower its reliability. Conversely, the lower the transmission rate and bandwidth of a PHY link, the higher its receiver sensitivity and the lower its reliability.

[0098] For example, as shown in Figure 5, for PHY links 1 to 3 (link parameters are shown in Table 1), as the transmission rate of the PHY links increases from 4 Mbps to 8 Mbps and 16 Mbps, and the bandwidth increases from 2 MHz to 4 MHz, the receiving sensitivity of the PHY links decreases from -102 dBm to -92 dBm, a decrease of 10 dBm, and the reliability of the PHY links gradually deteriorates.

[0099] Table 1

[0100] Therefore, in this embodiment, the higher reliability of the first PHY link than the second PHY link can be due to: the transmission rate of the first PHY link being lower than the transmission rate of the second PHY link; and / or, the bandwidth of the first PHY link being lower than the bandwidth of the second PHY link; and / or, the receiving sensitivity of the first PHY link being higher than the receiving sensitivity of the second PHY link.

[0101] Optionally, the reliability of the first PHY link can be higher than that of the second PHY link if the transmit power of the first PHY link is higher than that of the second PHY link. It can be understood that the higher the transmit power of a PHY link, the higher its reliability and the stronger its anti-interference capability.

[0102] S402, the first electronic device 100 acquires streaming media data to be sent, which includes multiple data frames.

[0103] In this embodiment, for example, when the streaming media data is audio streaming data, the data frame is an audio frame; when the streaming media data is video streaming data, the data frame is a video frame.

[0104] It should be noted that the first electronic device 100 typically adds consecutive and progressively increasing labels to each data frame in the streaming media data according to the order in which the streaming media data is sent, such as serial numbers (SN) 1, 2, 3, 4, etc. Each data frame's label is used to uniquely identify that data frame.

[0105] S403, the first electronic device 100 encodes each data frame into a first encoded frame and a second encoded frame, wherein the bit rate of the first encoded frame is lower than the bit rate of the second encoded frame.

[0106] For example, the first encoded frame has a bitrate of 256 kbps, and the second encoded frame has a bitrate of 960 kbps. Because lower bitrate data is easier to transmit, the first encoded frame has a higher success rate.

[0107] It should be noted that the bitrate can be expressed as the product of the data volume of the encoded frame and the frame rate. The data volume of the encoded frame can also be called the size of the encoded frame, and the frame rate refers to the number of encoded frames transmitted per unit time. Based on this, in this embodiment, the bitrate of the first encoded frame is lower than the bitrate of the second encoded frame, which can be any one of the following cases (1) to (3).

[0108] (1) The amount of data in the first coded frame is less than that in the second coded frame, but the frame rates of the first and second coded frames are the same.

[0109] (2) The amount of data in the first encoded frame is equal to that in the second encoded frame, but the frame rate of the first encoded frame is less than that of the second encoded frame.

[0110] (3) The amount of data in the first encoded frame is less than that in the second encoded frame, and the frame rate of the first encoded frame is less than that of the second encoded frame.

[0111] S404, the first electronic device 100 sends a first encoded frame to the second electronic device 200 through the first PHY link, and sends a second encoded frame to the second electronic device 200 through the second PHY link.

[0112] For example, since the first electronic device 100 has a limited air interface, such as only one, the first PHY link and the second PHY link of the first electronic device 100 can alternately use the air interface to transmit the first encoded frame and the second encoded frame. It can be understood that since the reliability of the first PHY link is higher than that of the second PHY link, and the bit rate of the first encoded frame is lower than that of the second encoded frame, the transmission success rate of the first encoded frame is higher.

[0113] S405, the second electronic device 200 plays streaming media data based on the received first and second encoded frames.

[0114] In this embodiment, on the one hand, the first electronic device 100 sends a low-bit-rate first encoded frame to the second electronic device 200 through a highly reliable first PHY link; on the other hand, the first electronic device 100 sends a high-bit-rate second encoded frame to the second electronic device 200 through a high-speed second PHY link. In this situation, even if interference occurs in the wireless communication link, causing the high-bit-rate second encoded frame to be blocked in the buffer, the low-bit-rate first encoded frame can usually be successfully transmitted, thus ensuring, to a certain extent, the normal playback of streaming media data in the second electronic device 200. In this embodiment, the transmission process of streaming media data has stronger anti-interference capabilities, and the data transmission has better stability.

[0115] In the above process, the first electronic device 100 can use different encoding strategies to encode each data frame of the streaming media data into a first encoded frame and a second encoded frame. For example, it can use two different bitrate encoding methods to encode the entire content of the same data frame to obtain the first encoded frame and the second encoded frame; or, it can divide the same data frame into two different parts, such as a basic part and an enhanced part, and use different bitrate encoding methods to encode these two parts to obtain the first encoded frame and the second encoded frame.

[0116] The following section provides a detailed explanation of the streaming media data transmission method provided in this embodiment, using the different encoding strategies of the first electronic device 100 for data frames.

[0117] Encoding Strategy 1: Use two different bitrate encoding methods to encode the entire content of the same data frame.

[0118] Figure 6 is a schematic flowchart of a streaming media data transmission method provided in another embodiment of this application. The method specifically includes the following steps S601 to S605.

[0119] S601, the first electronic device 100 and the second electronic device 200 establish a first PHY link and a second PHY link based on a wireless connection, and the reliability of the first PHY link is higher than that of the second PHY link.

[0120] For example, the link parameters of the first PHY link and the second PHY link are shown in Table 2. It can be seen that the transmission rate and bandwidth of the first PHY link are higher than those of the second PHY link. Therefore, the first PHY link has higher reliability than the second PHY link.

[0121] Table 2

[0122] In this embodiment, since the first PHY link has high reliability, it can also be called a high-reliability PHY link or a high-reliability link. Furthermore, since the second PHY link has a high transmission rate, it can also be called a high-speed PHY link or a high-speed link.

[0123] S602, the first electronic device 100 acquires streaming media data to be sent, the streaming media data including multiple data frames.

[0124] In this embodiment, taking audio stream data as an example, the data frames it includes are specifically audio frames. Similarly, taking video stream data as an example, the data frames it includes are specifically video frames.

[0125] S603, the first electronic device 100 uses a first encoding method to encode each data frame into a first encoded frame, and uses a second encoding method to encode each data frame into a second encoded frame, wherein the bit rate of the first encoded frame is lower than that of the second encoded frame.

[0126] For example, the first encoding method and the second encoding method are shown in Table 3. They have the same encoding type, but the bitrate of the first encoding method is lower than that of the second encoding method.

[0127] Table 3

[0128] Based on Table 3, the first electronic device 100 can encode the data frame using the first encoding method described above to obtain a first encoded frame with a low bit rate of 256kbps; similarly, it can encode the data frame using the second encoding method described above to obtain a second encoded frame with a high bit rate of 960kbps.

[0129] Furthermore, since the first and second encoded frames are obtained by encoding the entire content of the same data frame using different encoding methods, both the first and second encoded frames can be played independently. However, because the higher bitrate encoded frame carries more data, the second encoded frame provides a better playback effect on the second electronic device 200 compared to the first encoded frame, such as clearer video and higher sound quality.

[0130] For example, as shown in Figure 7, after acquiring streaming media data, the first electronic device 100 divides the streaming media data into multiple data frames. Taking data frames 1 to 5 as an example, the first electronic device 100 encodes data frames 1 to 5 into low-bitrate first encoded frames 1 to 5 and high-bitrate second encoded frames 1 to 5, respectively.

[0131] S604, the first electronic device 100 sends a first encoded frame to the second electronic device 200 through the first PHY link, and sends a second encoded frame to the second electronic device 200 through the second PHY link.

[0132] For example, the first electronic device 100 sends the aforementioned low-bit-rate first encoded frames 1 to 5 to the second electronic device 200 via the first PHY link, and sends the aforementioned high-bit-rate second encoded frames 1 to 5 to the second electronic device 200 via the second PHY link. Optionally, the first PHY link and the second PHY link time-division multiplex the air interface of the first electronic device 100.

[0133] During the process of the first electronic device 100 sending the first coded frame and the second coded frame to the second electronic device 200, if the second electronic device 200 has received the first coded frame and the second coded frame with SN=K, but has not received the first coded frame and / or the second coded frame with SN=K+1 within a preset time (such as within 20ms), then the second electronic device 200 may request the first electronic device 100 to retransmit the first coded frame and / or the second coded frame with SN=K+1.

[0134] In some embodiments, to avoid resource waste caused by the second electronic device 200 continuously requesting retransmission of encoded frames and the first electronic device 100 continuously responding to retransmission requests and performing retransmission operations, a maximum number of retransmissions can be set for the first and second encoded frames respectively. For example, the maximum number of retransmissions for the first encoded frame can be set to M, and the maximum number of retransmissions for the second encoded frame can be set to N. For example, M = 3, N = 3. Or, M = 5, N = 5.

[0135] In other embodiments, to increase the probability of successful transmission of the first coded frame and reduce the power consumption of the first electronic device 100 and the second electronic device 200, M > N can be set, for example, M = 5, N = 2; or M = 6, N = 3. That is, compared to the second coded frame, the first coded frame is allowed to be retransmitted several more times.

[0136] In other embodiments, since the first encoded frame can ensure the normal playback of streaming media data, the number of retransmissions N of the second encoded frame can be set to 0, that is, the second encoded frame is not retransmitted, so as to reduce the waste of resources of the first electronic device 100 and the second electronic device 200.

[0137] S605, the second electronic device 200 plays streaming media data based on the received first and second encoded frames.

[0138] As described above, after receiving the first and second encoded frames, the second electronic device 200 temporarily stores them in a buffer for playback. Since the first encoded frame is transmitted using a highly reliable first PHY link, the second electronic device 200 usually receives it. However, when interference occurs in the wireless communication link, the second encoded frame, transmitted via the high-speed second PHY link, may be blocked at the first electronic device 100 and fail to reach the second electronic device 200.

[0139] Depending on the received encoded frames, the second electronic device 200 can play streaming media data in different ways.

[0140] In some embodiments, when the second electronic device 200 plays a certain data frame (such as the first data frame), if the buffer simultaneously includes the first encoded frame and the second encoded frame corresponding to the first data frame, then the second electronic device 200 plays the high bitrate second encoded frame instead of the low bitrate first encoded frame, so as to ensure the high-quality playback effect of the streaming media data and provide users with a better audio-visual experience.

[0141] For example, as shown in Figure 7, when the second electronic device 200 needs to play data frame 1, since the second electronic device 200 has received both the low bit rate first encoded frame 1 and the high bit rate second encoded frame 1, the second electronic device 200 decodes the high bit rate second encoded frame 1 into data frame 1 and plays it to ensure the high-quality playback effect of the streaming media data.

[0142] In other embodiments, when the second electronic device 200 plays a certain data frame (such as the first data frame), if the buffer only caches the first encoded frame corresponding to the first data frame and does not include the corresponding second encoded frame, then the second electronic device 200 plays the first encoded frame to ensure the basic playback effect of the streaming media data, avoid playback stuttering and other problems, and provide users with a basic audio-visual experience.

[0143] For example, as shown in Figure 7, when the second electronic device 200 needs to play data frame 4, since the second electronic device 200 only received the low bit rate first encoded frame 4 and did not receive the high bit rate second encoded frame 4, the second electronic device 200 decodes the low bit rate first encoded frame 4 into data frame 1 and plays it to ensure that the audio stream data can be played without any stuttering or other issues.

[0144] In some other embodiments, if the buffer only caches the second encoded frame corresponding to the first data frame and does not include the first encoded frame corresponding to it, then the second electronic device 200 plays the second encoded frame when playing the first data frame.

[0145] In summary, the first electronic device 100 encodes the same data frame into a low-bit-rate first encoded frame and a high-bit-rate second encoded frame, and sends the first encoded frame using a high-reliability link and the second encoded frame using a high-speed link. This method can improve the probability of successful data frame transmission, enhance the anti-interference capability of streaming media data transmission, and improve the stability of data transmission.

[0146] In addition, since the first electronic device 100 sends both a low-bit-rate first encoded frame and a high-bit-rate second encoded frame to the second electronic device 200, this method can improve the anti-interference capability of streaming media data transmission and ensure the quality of streaming media data, thereby guaranteeing the user experience.

[0147] Taking audio stream data as an example, the specific implementation process of the audio stream data transmission method is shown in Figure 8, and includes the following steps S800 to S805.

[0148] S801, the first electronic device 100 and the second electronic device 200 establish a first PHY link and a second PHY link based on a wireless connection, and the reliability of the first PHY link is higher than that of the second PHY link.

[0149] S802, the first electronic device 100 acquires audio stream data to be sent, the audio stream data including multiple audio frames.

[0150] S803, the first electronic device 100 uses a first encoding method to encode each audio frame as a basic frame and a second encoding method to encode each data frame as a high-definition frame. The bit rate of the basic frame is lower than that of the high-definition frame.

[0151] In this embodiment, the first electronic device 100 encodes the audio frame to obtain the first encoded frame, which is the base frame, used to ensure the basic playback effect of the audio. In addition, the first electronic device 100 encodes the audio frame to obtain the second encoded frame, which is the high-definition frame, used to provide a higher quality audio playback effect.

[0152] For example, as shown in Figure 9, after acquiring the audio stream data, the first electronic device 100 divides the audio stream data into multiple audio frames. Taking audio frames 1 to 5 as an example, the first electronic device 100 encodes audio frames 1 to 5 into low-bitrate base frames 1 to 5 and high-bitrate high-definition frames 1 to 5, respectively.

[0153] S804, the first electronic device 100 sends a basic frame to the second electronic device 200 through the first PHY link, and sends a high-definition frame to the second electronic device 200 through the second PHY link.

[0154] For example, the first electronic device 100 sends the aforementioned low bit rate base frames 1 to 5 to the second electronic device 200 through the first PHY link, and sends the aforementioned high bit rate high-definition frames 1 to 5 to the second electronic device 200 through the second PHY link.

[0155] S805, the second electronic device 200 plays audio stream data based on the received first and second encoded frames.

[0156] For example, at the playback time of audio frame 1, the second electronic device 200 receives both the base frame 1 and its high-definition frame 1 of audio frame 1, and then plays the high-definition frame 1 to ensure the playback sound quality.

[0157] For example, during the playback of audio frame 4, due to interference in the BT link, the second electronic device 200 only receives the basic frame 4 of audio frame 4 and does not receive its high-definition frame 4. In this case, the second electronic device 200 plays the basic frame 4 to ensure the continuity of audio stream data playback and avoid stuttering.

[0158] (ii) Encode different parts of the same data frame using different bitrate encoding methods.

[0159] Figure 10 is a schematic flowchart of a streaming media data transmission method provided in another embodiment of this application. The method specifically includes the following steps S1001 to S1006.

[0160] S1001, the first electronic device 100 and the second electronic device 200 establish a first PHY link and a second PHY link based on a wireless connection, and the reliability of the first PHY link is higher than that of the second PHY link.

[0161] S1002, the first electronic device 100 acquires streaming media data to be sent, which includes multiple data frames.

[0162] In this embodiment, the specific contents of S1001 to S1002 are the same as those of S601 to 602, and will not be repeated here.

[0163] S1003, the first electronic device 100 splits each data frame into a first part and a second part.

[0164] In this embodiment, the first part, also known as the base part, is used to ensure the basic playback effect of the data frames and supports playback on its own. The second part is used to enhance the playback effect of the first part and is also called the enhancement part. The second part does not support playback on its own and must be integrated with the first part before playback can occur.

[0165] Optionally, the first electronic device 100 can split a data frame into a first part and a second part through layered processing. For example, for an audio frame, the first electronic device 100 can extract the data in the audio frame that represents the basic changes in sound and use it as the first part; while the other parts of the audio frame besides the first part are used as the second part to optimize the playback effect of the first part.

[0166] It should be noted that for a data frame, the amount of data in the first part is less than that in the second part. Taking a data frame of 100 bytes as an example, the first electronic device 100 can set the first part to 10 bytes and the second part to 90 bytes to ensure that the data in the first part can be sent to the second electronic device 200 in a timely manner after encoding.

[0167] S1004, the first electronic device 100 uses a first encoding method to encode the first part of each data frame into a first encoded frame, and uses a second encoding method to encode the second part of each data frame into a second encoded frame, wherein the bit rate of the first encoded frame is less than that of the second encoded frame.

[0168] In S1004, the first and second encoding methods are detailed above and will not be repeated here.

[0169] For example, as shown in Figure 11, after acquiring streaming media data, the first electronic device 100 divides the streaming media data into multiple data frames, including data frames 1 to 5. Taking data frame 1 as an example, the first electronic device 100 splits data frame 1 into a first part 1 and a second part 1, and uses a first encoding method to encode the first part 1 into a low-bitrate first encoded frame 1, and uses a second encoding method to encode the second part 1 into a high-bitrate second encoded frame 1.

[0170] It should be noted that since the first part is the basic part that supports playback independently, and the second part is an enhancement of the first part, the first encoded frame can be played independently, but the second encoded frame cannot be played independently, and the second encoded frame needs to be merged with the first encoded frame before it can be played.

[0171] S1005, the first electronic device 100 sends a first encoded frame to the second electronic device 200 through the first PHY link, and sends a second encoded frame to the second electronic device 200 through the second PHY link.

[0172] For example, the first PHY link and the second PHY link time-division multiplex the air interface of the first electronic device 100.

[0173] S1006, the second electronic device 200 plays streaming media data based on the received first and second encoded frames.

[0174] As described above, after receiving the first and second encoded frames, the second electronic device 200 temporarily stores them in a buffer for playback. Since the first encoded frame is transmitted using a highly reliable first PHY link, the second electronic device 200 usually receives it. However, when interference occurs in the wireless communication link, the second encoded frame, transmitted via the high-speed second PHY link, may be blocked at the first electronic device 100 and fail to reach the second electronic device 200.

[0175] Depending on the received encoded frames, the second electronic device 200 can play streaming media data in different ways.

[0176] In some embodiments, when the second electronic device 200 plays a data frame (such as a first data frame), if the buffer simultaneously includes a first encoded frame and a second encoded frame corresponding to the first data frame, the second electronic device 200 will merge the first encoded frame and the second encoded frame before playback to provide the user with a superior audiovisual experience. Compared to playing the first encoded frame alone, the playback effect after merging the first encoded frame and the second encoded frame is better, for example, the video picture is clearer and the sound quality is higher.

[0177] For example, as shown in Figure 11, when the second electronic device 200 needs to play data frame 1, since the second electronic device 200 has received both the low bit rate first encoded frame 1 and the high bit rate second encoded frame 1, the second electronic device 200 will merge the low bit rate first encoded frame 1 and the high bit rate second encoded frame 1 before playing them to ensure the playback sound quality of the audio stream data.

[0178] In some embodiments, when the second electronic device 200 plays a certain data frame (such as the first data frame), if the buffer only caches the first encoded frame corresponding to the first data frame and does not include the corresponding second encoded frame, then the second electronic device 200 plays the first encoded frame to provide the user with a basic audio-visual experience in order to avoid problems such as playback stuttering.

[0179] For example, as shown in Figure 11, when the second electronic device 200 needs to play data frame 4, since the second electronic device 200 only received the low bit rate first encoded frame 4 and did not receive the high bit rate second encoded frame 4, the second electronic device 200 decodes the low bit rate first encoded frame 4 into data frame 1 and plays it to ensure the basic effect of streaming media data and avoid playback stuttering and other issues.

[0180] It should be noted that when the second electronic device 200 plays the first data frame, if the buffer only caches the second encoded frame corresponding to the first data frame, but does not include the first encoded frame corresponding to it, then the second electronic device 200 cannot play the second encoded frame.

[0181] In summary, the first electronic device 100 divides the same data frame into a basic part and an enhanced part, encodes them into a low-bit-rate first encoded frame and a high-bit-rate second encoded frame, respectively, and sends the first encoded frame using a high-reliability link and the second encoded frame using a high-speed link. This method can improve the probability of successful data frame transmission and enhance the anti-interference capability of streaming media data transmission.

[0182] In addition, since the first electronic device 100 sends both a low-bit-rate first encoded frame and a high-bit-rate second encoded frame to the second electronic device 200, this method can improve the anti-interference capability of streaming media data transmission and ensure the quality of streaming media data, thereby guaranteeing the user experience.

[0183] Taking audio stream data as an example, the specific implementation process of the audio stream data transmission method is shown in Figure 12, and includes the following steps S1200 to S1206.

[0184] S1201, the first electronic device 100 and the second electronic device 200 establish a first PHY link and a second PHY link, and the reliability of the first PHY link is higher than that of the second PHY link.

[0185] S1202, the first electronic device 100 acquires audio stream data to be sent, the audio stream data including multiple audio frames.

[0186] S1203, the first electronic device 100 splits each audio frame into a basic part and a lossless part.

[0187] In this embodiment, the base part is the first part shown above, which supports playback independently. The lossless part is the second part shown above, which is used to enhance the base part. It does not support playback independently, but it supports playback after being integrated with the base part.

[0188] S1204, the first electronic device 100 uses a first encoding method to encode the basic part of each audio frame into a basic frame; and uses a second encoding method to encode the lossless part of each data frame into a lossless frame.

[0189] In this embodiment, the specific implementation process of S1203 to S1204 can be seen in Figure 13, and will not be described in detail here.

[0190] S1205, the first electronic device 100 sends a basic frame to the second electronic device 200 through the first PHY link, and sends a lossless frame to the second electronic device 200 through the second PHY link.

[0191] S1206, the second electronic device 200 plays audio stream data based on the received base frame and lossless frame.

[0192] For example, at the playback time of audio frame 1, if the second electronic device 200 receives both the base frame 1 and its lossless frame 1 of audio frame 1, then the second electronic device 200 will merge the base frame 1 and the lossless frame 1 before playback to provide the user with better sound quality.

[0193] For example, at the playback time of audio frame 4, if the second electronic device 200 only receives the basic frame 4 corresponding to audio frame 4 and does not receive the lossless frame 4 of the first audio frame due to interference factors in the BT link, then the second electronic device 200 plays the basic frame 4 to ensure the continuity of audio playback and avoid stuttering or other phenomena.

[0194] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0195] Since the transmission quality of streaming media data is affected by the air interface quality, the first electronic device 100 can detect the air interface quality before transmitting streaming media data, or detect the air interface quality in real time during the transmission of streaming media data, and determine the method of transmitting streaming media data based on the air interface quality.

[0196] In this embodiment, air interface quality refers to the quality status of the wireless channel in a mobile communication system, primarily used to evaluate the reliability and performance of wireless communication. Exemplarily, air interface quality includes factors such as radio signal strength (RSS), signal-to-noise ratio (SINR), bit error rate (SER), latency, jitter, and packet loss rate (PLR). Signal strength refers to the strength or power level of the wireless signal, typically measured by the received signal power in dBm. Higher signal strength indicates better signal coverage and transmission quality. Signal-to-noise ratio (SNR) is the ratio between the signal and background noise. A higher SNR indicates better signal quality and stronger anti-interference capability. Bit error rate (BER) refers to the rate of bit errors that occur during transmission. A lower BER indicates better transmission quality and reliability. Latency refers to the time required for a signal to travel from the transmitter to the receiver. Lower latency helps improve communication efficiency and real-time performance. Jitter refers to the variation or fluctuation in latency during signal transmission. Lower jitter indicates more stable signal transmission. Packet loss rate: refers to the proportion of data packets lost during transmission. A lower packet loss rate indicates better data transmission reliability.

[0197] When the air interface quality is poor, for example, when the air interface quality meets the first preset condition, the data transmission success rate of the low-reliability second PHY link is low. Therefore, the first electronic device 100 only encodes the data frames of the streaming media data to be transmitted into low-bit-rate first encoded frames and transmits the first encoded frames using the high-reliability first PHY link. The first electronic device 100 does not need to generate second encoded frames, or even if it does, it does not need to transmit them through the high-speed second PHY link. This method not only improves the anti-interference capability of streaming media data transmission but also saves the transmission power consumption of the first electronic device 100 and the reception power consumption of the second electronic device 200, reducing resource waste.

[0198] When the air interface quality is moderate, for example, when the air interface quality meets the second preset condition, the streaming media data transmission method shown in the above embodiments of the first electronic device 100, such as methods S401-S405, S601-S605, S801-S805, S1001-S1006, S1201-S1206, etc., shall ensure as much as possible that the streaming media data is sent to the second electronic device 200.

[0199] When the air interface quality is good, for example, when the air interface quality meets the third preset condition, it indicates that there are no interference factors or the interference factors have little impact on streaming media data transmission. Therefore, in the scenario where the first electronic device 100 adopts encoding strategy one, that is, in the scenario where two different bitrate encoding methods are used to encode the entire content of the same data frame, the first electronic device 100 can encode only the data frame of the streaming media data to be sent into a high bitrate second encoded frame, and use a high-speed second PHY link to send the second encoded frame. The first electronic device 100 does not need to generate the first encoded frame, or even if it generates the first encoded frame, it does not need to send the second encoded frame through the highly reliable first PHY link, thereby saving the transmission power consumption of the first electronic device 100 and the reception power consumption of the second electronic device 200, and reducing resource waste.

[0200] In some embodiments, the above-mentioned preset conditions are shown in Table 4:

[0201] The first preset condition is: RSS < RSS1, and / or, SINR < SINR1, and / or, SER > SER1, and / or, L > L1, and / or, J > J1, and / or, PLR > PLR1.

[0202] The second preset condition is: RSS1≤RSS≤RSS2, and / or, SINR1≤SINR≤SINR2, and / or, SER2≤SER≤SER1, and / or, L2≤L≤L1, and / or, J2≤J≤J1, and / or, PLR2≤PLR≤PLR1.

[0203] The third preset condition is: RSS > RSS2, and / or, SINR > SINR2, and / or, SER < SER2, and / or, L < L2, and / or, J < J2, and / or, PLR < PLR2.

[0204] Table 4

[0205] Wherein, RSS1 and RSS2 are different signal strength thresholds; SINR1 and SINR2 are different signal-to-noise ratio thresholds; SER1 and SER2 are different bit error rate thresholds; L1 and L2 are different delay thresholds; J1 and J2 are different jitter time thresholds; and PLR1 and PLR2 are different packet loss rate thresholds. For example, RSS1 = -90dBm, RSS2 = -65dBm; SINR1 = 18dB, SINR2 = 26dB; SER1 = 0.1%, SER2 = 0.01%; L1 = 50ms, L2 = 15ms; J1 = 10ms, J2 = 5ms; PLR1 = 10%, PLR2 = 2%.

[0206] Based on the same inventive concept, as an implementation of the above method, the embodiments of this application also provide the following technical solutions.

[0207] This application also provides a chip, as shown in FIG14, which includes a processor and a memory. The memory stores a computer program, which, when executed by the processor, implements the streaming media data transmission method executed by the first electronic device 100 or the second electronic device 200 in the above embodiments.

[0208] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the streaming media data transmission method performed by the first electronic device 100 or the second electronic device 200 in the above embodiments.

[0209] This application also provides a computer program product, which includes a computer program that, when run by an electronic device, enables the electronic device to implement the streaming media data transmission method executed by the first electronic device 100 or the second electronic device 200 in the above embodiments.

[0210] It should be understood that the processor mentioned in the embodiments of this application can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor.

[0211] It should also be understood that the memory mentioned in the embodiments of this application can be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous linked dynamic random access memory (SLDRAM), and direct rambus RAM (DRRAM).

[0212] In the embodiments provided in this application, the division of each framework or module is only a logical functional division. In actual implementation, there may be other division methods. For example, multiple frameworks or modules may be combined or integrated into another system, or some features may be ignored or not executed.

[0213] Furthermore, the functional modules in the various embodiments of this application can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The integrated modules described above can be implemented in hardware or as software functional modules.

[0214] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0215] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0216] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A method for transmitting streaming media data, characterized in that, Applied to a first electronic device, the method includes: Acquire streaming media data to be sent, the streaming media data including multiple data frames; Each of the data frames is encoded into a first encoded frame and a second encoded frame; The first encoded frame is sent to the second electronic device through the first physical layer PHY link, and the second encoded frame is sent to the second electronic device through the second PHY link; The bit rate of the first encoded frame is lower than that of the second encoded frame, and the reliability of the first PHY link is higher than that of the second PHY link.

2. The method according to claim 1, characterized in that, The reliability of the first PHY link is higher than that of the second PHY link, including: The transmission rate of the first PHY link is lower than the transmission rate of the second PHY link; and / or, The bandwidth of the first PHY link is lower than the bandwidth of the second PHY link; and / or, The receiving sensitivity of the first PHY link is higher than that of the second PHY link; and / or, The transmit power of the first PHY link is higher than that of the second PHY link.

3. The method according to claim 1 or 2, characterized in that, Encoding each of the data frames into a first encoded frame and a second encoded frame includes: Each of the data frames is encoded into a first encoded frame using a first encoding method; and, Each data frame is encoded into a second encoded frame using a second encoding method; Wherein, the encoding format of the first encoding method and the second encoding method are the same or different, and the bitrate of the first encoding method is lower than that of the second encoding method.

4. The method according to claim 1 or 2, characterized in that, Encoding each of the data frames into a first encoded frame and a second encoded frame includes: Each data frame is split into a first part and a second part, wherein the first part can be played independently, and the second part can be played after being merged with the first part. The first portion is encoded into the first encoded frame using a first encoding method; and, The second part is encoded into the second encoded frame using the second encoding method; Wherein, the encoding format of the first encoding method and the second encoding method are the same or different, and the bitrate of the first encoding method is lower than that of the second encoding method.

5. The method according to any one of claims 1 to 3, characterized in that, Each of the data frames is encoded into a first encoded frame and a second encoded frame; And, transmitting the first encoded frame via the first physical layer PHY link, and transmitting the second encoded frame via the second PHY link, including: Detect the air interface quality of the first electronic device; When the air interface quality meets the second preset condition, each data frame is encoded into a first encoded frame and a second encoded frame; the first encoded frame is transmitted using the first PHY link, and the second encoded frame is transmitted through the second PHY link.

6. The method according to claim 5, characterized in that, The method further includes: When the air interface quality meets a first preset condition, each data frame is encoded into the first encoded frame, and the first encoded frame is transmitted using the first PHY link, without using the second PHY link to transmit the second encoded frame; and / or, When the air interface quality meets the third preset condition, each data frame is encoded into the second encoded frame, and the second encoded frame is sent using the second PHY link instead of the first encoded frame. In this process, the air interface quality gradually improves according to the order of the first preset condition, the second preset condition, and the third preset condition.

7. The method according to claim 4, characterized in that, Each of the data frames is encoded into a first encoded frame and a second encoded frame; And, transmitting the first encoded frame via the first physical layer PHY link, and transmitting the second encoded frame via the second PHY link, including: Detect the air interface quality of the first electronic device; When the air interface quality meets the second preset condition, each data frame is encoded into a first encoded frame and a second encoded frame; the first encoded frame is transmitted using the first PHY link, and the second encoded frame is transmitted through the second PHY link.

8. The method according to claim 7, characterized in that, The method further includes: When the air interface quality meets the first preset condition, each data frame is encoded into the first encoded frame, and the first encoded frame is sent using the first PHY link instead of the second encoded frame. In this process, the air interface quality gradually improves according to the order of the first preset condition and the second preset condition.

9. The method according to any one of claims 1 to 8, characterized in that, The maximum number of retransmissions M for the first encoded frame is greater than the maximum number of retransmissions N for the second encoded frame.

10. The method according to claim 9, characterized in that, The maximum number of retransmissions for the second encoded frame is N = 0.

11. The method according to any one of claims 1 to 10, characterized in that, The streaming media data includes at least one of audio stream data, video stream data, text stream data, image stream data, and animation stream data.

12. A method for transmitting streaming media data, characterized in that, Applied to a second electronic device, the method includes: The system receives a first encoded frame of streaming media data from a first electronic device via a first physical layer PHY link, and a second encoded frame of the streaming media data from the first electronic device via a second PHY link. Play the streaming media data based on the received first encoded frame and second encoded frame; The streaming media data includes multiple data frames, each of which is encoded into a first encoded frame and a second encoded frame. The bitrate of the first encoded frame is lower than that of the second encoded frame, and the reliability of the first PHY link is higher than that of the second PHY link.

13. The method according to claim 12, characterized in that, The reliability of the first PHY link is higher than that of the second PHY link, including: The transmission rate of the first PHY link is lower than the transmission rate of the second PHY link; and / or, The bandwidth of the first PHY link is lower than the bandwidth of the second PHY link; and / or, The receiving sensitivity of the first PHY link is higher than that of the second PHY link; and / or, The transmit power of the first PHY link is higher than that of the second PHY link.

14. The method according to claim 12 or 13, characterized in that, The first encoded frame is obtained by encoding the data frame using a first encoding method; and, The second encoded frame is obtained by encoding the data frame using the second encoding method; Wherein, the encoding format of the first encoding method and the second encoding method are the same or different, and the bitrate of the first encoding method is lower than that of the second encoding method.

15. The method according to claim 12 or 13, characterized in that, Each data frame includes a first part and a second part. The first part can be played independently, and the second part can be played after being merged with the first part. The first encoded frame is obtained by encoding the data frame using the first encoding method; The second encoded frame is obtained by encoding the data frame using the second encoding method; Wherein, the encoding format of the first encoding method and the second encoding method are the same or different, and the bitrate of the first encoding method is lower than that of the second encoding method.

16. The method according to claim 14, characterized in that, Playing the streaming media data based on the received first encoded frame and second encoded frame includes: At the first moment, if the first encoded frame and the second encoded frame of the first data frame have been received, the first data frame is played according to the second encoded frame; At the first moment, if the first encoded frame of the first data frame has been received, but the second encoded frame of the first data frame has not been received, then the first data frame is played according to the first encoded frame; At the first moment, if the first encoded frame of the first data frame has been received, but the first encoded frame of the first data frame has not been received, then the first data frame is played according to the second encoded frame; Wherein, the first data frame is any one of the data frames in the streaming media data, and the first moment is the moment when the second electronic device needs to play the first data frame.

17. The method according to claim 15, characterized in that, Playing the streaming media data based on the received first encoded frame and second encoded frame includes: At the first moment, if the first encoded frame and the second encoded frame of the first data frame have been received, the first encoded frame and the second encoded frame are merged and then the first data frame is played. At the first moment, if the first encoded frame of the first data frame has been received, but the second encoded frame of the first data frame has not been received, then the first data frame is played according to the first encoded frame; Wherein, the first data frame is any one of the multiple data frames of the streaming media data, and the first moment is the moment when the first data frame needs to be played.

18. The method according to any one of claims 1 to 17, characterized in that, The streaming media data includes at least one of audio stream data, video stream data, text stream data, image stream data, and animation stream data.

19. An electronic device, characterized in that, It includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executing the computer program, implements the method as described in any one of claims 1 to 11, or the method as described in any one of claims 12 to 18.

20. A communication system, characterized in that, It includes a first electronic device and a second electronic device, the first electronic device and the second electronic device being wirelessly connected, the first electronic device being configured to perform the method as described in any one of claims 1 to 11, or the method as described in any one of claims 12 to 18.

21. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the method as described in any one of claims 1 to 11, or the method as described in any one of claims 12 to 18.

22. A chip, characterized in that, The chip includes a processor and a memory, the memory storing a computer program that, when executed by the processor, implements the method as described in any one of claims 1 to 11, or the method as described in any one of claims 12 to 18.

Images