Image data sending and receiving method, terminal, chip and storage medium

Abstract

The embodiment of the present application discloses a method for sending and receiving image data, a terminal, a chip and a storage medium. The first wireless terminal performs layered coding processing on the image data to obtain a first data component and a second data component; modulates the first data component according to a first modulation order to obtain first processed data; modulates the second data component according to a second modulation order to obtain second processed data; generates a data packet corresponding to the image data according to the first processed data and the second processed data, and sends the data packet to the second wireless terminal. The second wireless terminal demodulates the first processed data to obtain a first data component, verifies the first data component and obtains a verification result; if the verification result is a successful verification, demodulates the second processed data to obtain a second data component; and performs combined decoding processing on the first data component and the second data component to obtain image data.

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to a method, a terminal, a chip and a storage medium for sending and receiving image data. Background Art

[0002] Currently, in wireless communication systems, the wireless local area network technology (WLAN technology based on 802.11, Wi-Fi) screen projection solution is based on the traditional Wi-Fi Direct technology, and compresses the video data through a video encoding module.

[0003] However, the existing Wi-Fi screen projection technology has the disadvantage of large delay, so it can only be applied to scenarios that do not require real-time performance, such as playing movies, but cannot be applied to scenarios that require real-time performance, such as online mobile games.

[0004] It can be seen that how to reduce the delay of Wi-Fi screen projection technology, thereby improving the screen projection effect and expanding the application scenarios of screen projection has become an urgent problem to be solved. Summary of the invention

[0005] The embodiments of the present application provide a method, terminal, chip and storage medium for sending and receiving image data, which can greatly reduce transmission delay, thereby improving screen projection effects and effectively expanding screen projection application scenarios.

[0006] The technical solution of the embodiment of the present application is implemented as follows:

[0007] In a first aspect, an embodiment of the present application provides a method for sending image data in a first wireless terminal, the method comprising:

[0008] Performing layered coding processing on the image data to obtain a first data component and a second data component; wherein the first data component represents contour data in the image data; and the second data component represents detail data in the image data;

[0009] Modulating the first data component according to a first modulation order to obtain first processed data; modulating the second data component according to a second modulation order to obtain second processed data; wherein the first modulation order is smaller than the second modulation order;

[0010] A data packet corresponding to the image data is generated according to the first processed data and the second processed data, and the data packet is sent to a second wireless terminal.

[0011] In a second aspect, an embodiment of the present application provides a method for receiving image data in a second wireless terminal, the method being applied in the second wireless terminal, the method comprising:

[0012] receiving a data packet corresponding to the image data sent by a first wireless terminal; wherein the data packet includes first processed data and second processed data;

[0013] Demodulating the first processed data to obtain a first data component; wherein the first data component represents contour data in the image data;

[0014] Performing verification processing on the first data component to obtain a verification result;

[0015] If the verification result is successful, demodulating the second processed data to obtain a second data component; wherein the second data component represents detail data in the image data;

[0016] The first data component and the second data component are combined and decoded to obtain the image data.

[0017] In a third aspect, an embodiment of the present application provides a first wireless terminal, wherein the first wireless terminal includes: a coding unit, a modulation unit, a generation unit, and a sending unit.

[0018] The encoding unit is used to perform hierarchical encoding processing on the image data to obtain a first data component and a second data component; wherein the first data component represents contour data in the image data; and the second data component represents detail data in the image data;

[0019] The modulation unit is used to modulate the first data component according to a first modulation order to obtain first processed data; and modulate the second data component according to a second modulation order to obtain second processed data; wherein the first modulation order is smaller than the second modulation order;

[0020] The generating unit is configured to generate a data packet corresponding to the image data according to the first processed data and the second processed data;

[0021] The sending unit is used to send the data packet to the second wireless terminal.

[0022] In a fourth aspect, an embodiment of the present application provides a first wireless terminal, which includes a first processor and a first memory storing instructions executable by the first processor, and when the instructions are executed by the first processor, the method described in the first aspect is implemented.

[0023] In a fifth aspect, an embodiment of the present application provides a second wireless terminal, wherein the second wireless terminal includes: a receiving unit, a checking unit, a demodulation unit, and a decoding unit.

[0024] The receiving unit is used to receive a data packet corresponding to the image data sent by the first wireless terminal; wherein the data packet includes the first processed data and the second processed data;

[0025] The demodulation unit is used to demodulate the first processed data to obtain a first data component; wherein the first data component represents contour data in the image data;

[0026] The verification unit is used to perform verification processing on the first data component to obtain a verification result;

[0027] The demodulation unit is further configured to, if the verification result is successful, demodulate the second processed data to obtain a second data component; wherein the second data component represents detail data in the image data;

[0028] The decoding unit is used to perform combined decoding processing on the first data component and the second data component to obtain the image data.

[0029] In a sixth aspect, an embodiment of the present application provides a second wireless terminal, which includes a second processor and a second memory storing instructions executable by the second processor. When the instructions are executed by the second processor, the method described in the second aspect is implemented.

[0030] In a seventh aspect, an embodiment of the present application provides a chip, comprising a processor and an interface, wherein the processor obtains program instructions through the interface, and the processor is used to run the program instructions to execute the method described in the first aspect or the second aspect.

[0031] The embodiments of the present application provide a method, terminal, chip and storage medium for sending and receiving image data, wherein a first wireless terminal performs layered coding processing on the image data to obtain a first data component and a second data component; wherein the first data component represents contour data in the image data; and the second data component represents detail data in the image data; the first data component is modulated according to a first modulation order to obtain first processed data; the second data component is modulated according to a second modulation order to obtain second processed data; wherein the first modulation order is smaller than the second modulation order; and a data packet corresponding to the image data is generated according to the first processed data and the second processed data, and the data packet is sent to a second wireless terminal. The second wireless terminal receives a data packet corresponding to the image data sent by the first wireless terminal; wherein the data packet includes first processed data and second processed data; the first processed data is demodulated to obtain a first data component; wherein the first data component represents contour data in the image data; the first data component is verified to obtain a verification result; if the verification result is successful, the second processed data is demodulated to obtain a second data component; wherein the second data component represents detail data in the image data; the first data component and the second data component are combined and decoded to obtain image data. It can be seen that in the embodiments of the present application, the contour data and detail data in the image data are separated through layered coding processing, and the more important contour data is modulated using a low-order MCS, thereby improving the transmission robustness. At the same time, the resource units in the same OFDMA packet are used to transmit the contour data and the detail data, and only the first processed data corresponding to the contour data is checked by FCS. On the basis of effectively reducing the retransmission rate, the frequency of air interface contention can also be reduced. In other words, the image sending and receiving method proposed in the present application has high transmission robustness, low retransmission rate, and less air interface contention, which can greatly reduce the transmission delay, thereby improving the screen projection effect and effectively expanding the screen projection application scenarios. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 This is a schematic diagram of how to implement Wi-Fi screen projection;

[0033] Figure 2 Schematic diagram of the implementation process of the method for sending image data Figure 1 ;

[0034] Figure 3 Schematic diagram of the implementation process of the method for sending image data Figure 2 ;

[0035] Figure 4 Schematic diagram of the implementation process of the method for receiving image data Figure 1 ;

[0036] Figure 5 Schematic diagram of the implementation process of the method for receiving image data Figure 2 ;

[0037] Figure 6 A schematic diagram of the implementation flow of a method for sending and receiving image data;

[0038] Figure 7 A schematic diagram of a structure for performing screen projection processing of image data for a first wireless terminal;

[0039] Figure 8 A schematic diagram of a structure for performing screen projection processing of image data for a second wireless terminal;

[0040] Fig. 9 A schematic diagram of the verification process;

[0041] Fig.10 The structure diagram of the first wireless terminal is shown in FIG. Figure 1 ;

[0042] Fig.11 The structure diagram of the first wireless terminal is shown in FIG. Figure 2 ;

[0043] Fig.12 The structure diagram of the second wireless terminal is shown in FIG. Figure 1 ;

[0044] Fig.13 The structure diagram of the second wireless terminal is shown in FIG. Figure 2 . DETAILED DESCRIPTION

[0045] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. It is understood that the specific embodiments described herein are only used to explain the related applications, rather than to limit the applications. It should also be noted that, for ease of description, only the parts related to the related applications are shown in the drawings.

[0046] With the development of electronic technology, it is becoming more and more common to project data on one device to another device for display, such as projecting a video played on a mobile phone or tablet to a smart TV for display and playback.

[0047] The current wireless local area network technology (WLAN technology based on 802.11, Wi-Fi) screen projection solution is based on the traditional Wi-Fi Direct technology and compresses the video data through a video encoding module.

[0048] Miracast is a wireless display standard based on Wi-Fi Direct. 3C devices (communication products, computer products, consumer electronics products) that support this standard can share video images wirelessly. For example, a mobile phone can use Miracast to play videos or photos directly on a TV or other device without any connection cables or wireless hotspots (Access Point, AP).

[0049] Taking the Miracast standard developed by the Wi-Fi Alliance as an example, the data output from the signal source (Source) to the screen will be directly transmitted to the receiving end (Sink) through Wi-Fi peer-to-peer technology. Since video data usually requires a large throughput, the video or image data at the source end is usually compressed using a video encoder (H.264 or H.265) to reduce the throughput.

[0050] Figure 1 This is a schematic diagram of the implementation of Wi-Fi screen projection, such as Figure 1 As shown, taking the mobile phone as the signal source and the smart TV as the receiving end as an example, the mobile phone can play the video image data on the configured screen. At the same time, the video image data can be encoded by the encoder, and then the encoded data is sent to the Wi-Fi transmitter to be sent to the smart TV through the transmitting antenna. Correspondingly, the smart TV receives the encoded data sent by the mobile phone through the receiving antenna and the Wi-Fi receiver, and then sends the encoded data to the decoder, which decodes and obtains the corresponding video image data. The smart TV can display and play the video image data, thereby realizing Wi-Fi screen projection.

[0051] There are also some screen projection solutions that use the Joint Source-Channel Coding (JSCC) coding technology, but the wireless transmission technology is not built on Wi-Fi, but an incompatible dedicated physical layer is developed. For example, different modulation schemes (MCS) modulation technologies are used in different time slots for layered video transmission, and the JSCC technology built on the dedicated wireless physical layer cannot maximize the use of existing protocol standards and industrial supporting facilities, and the cost is high and difficult to promote. .

[0052] At present, Wi-Fi screen projection technology has the disadvantage of large delay. The delay mainly comes from two aspects: on the one hand, it is the coding delay and the retransmission delay of signal sending. Among them, the H.264 technology coding delay alone will cause a delay of more than 100 milliseconds; on the other hand, since Wi-Fi communication technology is based on Carrier Sense Multiple Access and Collision Avoidance (CSMA / CA) technology, each transmission needs to compete for the air interface. In particular, video data requires a high throughput rate and needs to be carried by high-order modulated Wi-Fi signals. However, high-order modulated signals have high requirements on the signal-to-noise ratio. Once there is interference or non-ideal characteristics in the communication environment, it is easy to cause error packets (Frame Check Sequence (FCS) check failure) and trigger retransmission, resulting in large delays.

[0053] Furthermore, the current Wi-Fi screen projection technology still has the problem of unstable image quality. The H.264 encoding technology required for screen projection encodes images into I frames, B frames, and P frames. Among them, I frames are key frames. Once an I frame is lost, the subsequent 29 frames will not be decoded (calculated based on the usual I frame interval of 30), resulting in video freezes, screen distortion, and other problems, poor screen projection effects, and serious impact on user experience.

[0054] It can be seen that due to the existence of problems such as large delays and video freezes, the current Wi-Fi screen projection technology can actually only be applied to scenarios that do not require real-time performance, such as playing movies, and cannot be applied to scenarios that require real-time performance, such as online mobile games.

[0055] In order to solve the problems of large delay, poor screen projection effect, and limited application scenarios in Wi-Fi screen projection technology, the image sending and receiving method proposed in this application combines Wi-Fi, OFDMA technology, and layered transmission of video images, which can take into account both the image clarity and real-time performance of the screen projection. Among them, the improvement of real-time performance mainly comes from: improving transmission robustness, reducing retransmissions, and reducing the frequency of air interface contention.

[0056] Specifically, in this application, in the conventional solution, a single Wi-Fi packet can only support a single MCS mode, so a high MCS mode is required for video projection. However, if a high MCS mode is used, the channel signal-to-noise ratio is required to be high, and retransmissions are usually increased. In this application, the retransmission rate of the system is equivalent to the retransmission rate of the low-order MCS mode corresponding to the profile data, thereby greatly reducing the retransmission rate.

[0057] Specifically, in the present application, in the conventional solution, the profile data and the detail data are sent in separate packets, and each must compete for the air interface. In the present application, the profile data and the detail data can be sent together in the same packet, and only need to compete for the air interface once; in addition, after the retransmission rate is reduced, the frequency of air interface competition is also effectively reduced.

[0058] In other words, the image sending and receiving method proposed in this application has high transmission robustness, low retransmission rate, and less air interface contention, which can greatly reduce transmission delay, thereby improving the screen projection effect and effectively expanding the application scenarios of screen projection.

[0059] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0060] An embodiment of the present application provides a method for sending an image, which can be applied to a first wireless terminal, wherein the first wireless terminal can be any terminal device configured with a display screen and supporting the Wi-Fi 6 protocol, such as: a tablet computer, a mobile phone, an e-reader, a personal computer (PC), a laptop computer, a vehicle-mounted device, an Internet TV, a wearable device, a personal digital assistant (PDA), a portable media player (PMP), a navigation device, etc.

[0061] Figure 2 The implementation process of the image sending method is shown in FIG. Figure 1 ,like Figure 2 As shown, in an embodiment of the present application, the method for the first wireless terminal to send image data may include the following steps:

[0062] Step 101: perform hierarchical coding processing on image data to obtain a first data component and a second data component; wherein the first data component represents contour data in the image data; and the second data component represents detail data in the image data.

[0063] In an embodiment of the present application, the first wireless terminal may perform layered coding processing on the image data, thereby obtaining a first data component and a second data component corresponding to the image data.

[0064] It should be noted that, in the present application, the first wireless terminal can display the image data through a display screen while performing layered coding processing on the incoming data.

[0065] Furthermore, in an embodiment of the present application, the display screen configured by the first wireless terminal can perform layered coding processing on the image data while displaying the target video or image data to obtain different data components after layered coding. The first wireless terminal can be configured with a layered encoder for performing layered coding processing, so that the layered encoder can be used to perform layered coding processing on the image data.

[0066] It should be noted that, in the embodiment of the present application, the above-mentioned image data may be image data of an image signal being displayed by the first wireless terminal, or may be image data of a video signal being played by the first wireless terminal.

[0067] It can be understood that in the embodiments of the present application, the non-passed data components obtained after the image data is layered encoded can be used to characterize different features in the image data, wherein the first data component can characterize the contour data in the image data; and the second data component can characterize the detail data in the image data.

[0068] Exemplarily, in an embodiment of the present application, the layered encoder configured in the first wireless terminal may be a conventional JSCC encoder, or a wavelet transform encoder, or other types of encoders, which are not specifically limited in the present application.

[0069] The JSCC encoder adopts a joint coding technology, which can comprehensively consider source coding and channel coding. The first wireless terminal can be configured with a JSCC encoder, and after the first wireless terminal uses the JSCC encoder to perform layered coding processing on the image data, it can obtain a first data component Coarse for representing contour data in the image data, and can also obtain a second data component Fine for representing detail data in the image data.

[0070] The wavelet transform encoder is a video encoder based on wavelet transform. Specifically, the first wireless terminal may be configured with a wavelet transform encoder, and after the first wireless terminal uses the wavelet transform encoder to perform layered encoding processing on the image data, it can generate data of different resolutions, which may include a first data component Coarse for representing contour data in the image data, and may also include a second data component Fine for representing detail data in the image data.

[0071] Accordingly, after performing hierarchical encoding processing on the image data using other types of encoders configured with hierarchical encoding functions, the first wireless terminal can also generate data of different resolutions, which may include a first data component Coarse for representing contour data in the image data, and may also include a second data component Fin for representing detail data in the image data. e.

[0072] Step 102, modulate the first data component according to the first modulation order to obtain first processed data; modulate the second data component according to the second modulation order to obtain second processed data; wherein the first modulation order is smaller than the second modulation order.

[0073] In an embodiment of the present application, after the first wireless terminal performs layered coding processing on the image data to obtain the first data component and the second data component corresponding to the image data, the first data component can be modulated according to a first modulation order to obtain first processed data; and the second data component can be modulated according to a second modulation order to obtain second processed data.

[0074] It should be noted that in the embodiments of the present application, different modulation and coding schemes (MCS) can be applied to modulate different data components, that is, the first modulation order is different from the second modulation order, wherein the first modulation order is used to modulate the first data component representing the contour data in the image data, and the second modulation order is used to modulate the second data component representing the detail data in the image data.

[0075] The modulation scheme may include QPSK, 16QAM, 64QAM, 256QAM, 1024QAM, 4096QAM, etc., which are not specifically limited in this application. Preferably, the first wireless terminal may modulate the first data component according to the modulation scheme of QPSK, 16QAM or 64QAM; preferably, the first wireless terminal may modulate the second data component according to the modulation scheme of 256QAM, 1024QAM or 4096QAM.

[0076] It is understandable that in the embodiments of the present application, in order to ensure the real-time and effectiveness of data transmission, the criticality of the outline data is often higher than that of the detail data. Therefore, a low-order MCS can be used for the first data component, so as to ensure that a high transmission robustness can be maintained even in a non-ideal environment. Accordingly, a high-order MCS can be used for the second data component, so that the detail data in the image data can be restored in an ideal environment, and the transmission effect is good. In a non-ideal environment, even if an error occurs, it is only the direct data in the image data that has an error, and it will not cause a distorted screen or freeze phenomenon.

[0077] It can be seen that in the embodiment of the present application, when the first data component and the second data component are modulated respectively, the first modulation order used can be smaller than the second adjustment order. The first modulation order and the second modulation order can include 4, 16, 64, 256, 1024, 4096, etc., which are not specifically limited in the present application.

[0078] Furthermore, in an embodiment of the present application, a first data component is modulated using a first modulation order to produce first processed data corresponding to contour data in the image data, and a second data component is modulated using a second modulation order to produce second processed data corresponding to the contour data in the image data.

[0079] Step 103: Generate a data packet corresponding to the image data according to the first processed data and the second processed data, and send the data packet to the second wireless terminal.

[0080] In an embodiment of the present application, the first wireless terminal modulates the first data component according to a first modulation order to obtain first processed data; at the same time, it can modulate the second data component according to a second modulation order to obtain the second processed data, and then further generate a data packet corresponding to the image data based on the first processed data and the second processed data, and then send the data packet to the second wireless terminal.

[0081] Furthermore, in an embodiment of the present application, after the first wireless terminal obtains the first data component and the second data component corresponding to the image data through layered coding processing, the first data component and the second data component can be respectively allocated to resource units (RU) corresponding to two users (User) in the same orthogonal frequency division multiple access (OFDMA) packet for subsequent processing.

[0082] Among them, OFDMA divides the entire frequency band into many subcarriers, converting the frequency selective fading channel into several flat fading subchannels, so as to effectively resist the frequency selective fading in the wireless mobile environment. Since the subcarriers overlap and occupy the spectrum, OFDM can provide higher spectrum utilization and higher information transmission rate. By allocating different subcarriers to different users, OFDMA provides a natural multiple access method, and since different subcarriers are occupied, the users are mutually orthogonal and there is no interference within the cell. At the same time, OFDMA can support two subcarrier allocation modes: distributed and centralized. In the subcarrier distributed allocation mode, the independence of frequency selective fading of different subcarriers can be used to obtain diversity gain.

[0083] OFDMA subdivides the channel into smaller RUs. Through OFDMA resource subdivision, multiple clients can perform parallel transmission by occupying different RU resources.

[0084] It can be seen that based on the same OFDMA packet, the first wireless terminal can use different resource units RU to perform parallel transmission of the first processed data and the second processed data.

[0085] Exemplarily, in the present application, when a first wireless terminal sends a data packet to a second wireless terminal, the first processed data can be sent to the second wireless terminal through a first resource unit; and at the same time, the second processed data can be sent to the second wireless terminal through a second resource unit.

[0086] It can be understood that, in the present application, the first resource unit and the second resource unit may include different time-frequency resource blocks.

[0087] Optionally, in an embodiment of the present application, the method for sending and receiving image data proposed in the present application is implemented, and the first wireless terminal can generate and send the first processed data and the second processed data based on the Wi-Fi 6 protocol. That is, the first wireless terminal modulates the first data component and the second data component based on the Wi-Fi 6 protocol; and sends the first processed data and the second processed data based on the Wi-Fi 6 protocol.

[0088] Optionally, in an embodiment of the present application, the method for sending and receiving image data proposed in the present application is implemented, and the first wireless terminal can generate and send the first processed data and the second processed data based on the Wi-Fi 7 protocol. That is, the first wireless terminal modulates the first data component and the second data component based on the Wi-Fi 7 protocol; and sends the first processed data and the second processed data based on the Wi-Fi 7 protocol.

[0089] Among them, Wi-Fi 6, the sixth generation of wireless network technology, is the name of the Wi-Fi standard. It is a wireless LAN technology created by the Wi-Fi Alliance based on the IEEE802.11 standard. Wi-Fi 6 mainly uses technologies such as OFDMA and Multi-User Multiple-Input Multiple-Output (MU-MIMO). MU-MIMO technology allows routers to communicate with multiple devices at the same time instead of communicating one by one. MU-MIMO allows routers to communicate with four devices at a time, and Wi-Fi 6 will allow communication with up to 8 devices. Wi-Fi 6 also uses OFDMA (Orthogonal Frequency Division Multiple Access) and transmit beamforming, both of which improve efficiency and network capacity respectively. Wi-Fi 6 can reach a maximum rate of 9.6Gbps.

[0090] A new technology in Wi-Fi 6 allows devices to plan their communications with routers, reducing the time needed to keep antennas powered on to transmit and search for signals, which means less battery drain and improved battery life.

[0091] Since both the Wi-Fi 6 protocol and the Wi-Fi 7 protocol support OFDMA and support different users to use different MCSs, in the present application, based on the Wi-Fi 6 protocol or the Wi-Fi 7 protocol, the first wireless terminal can use a low-order modulation mode for the first resource unit corresponding to the first data component, and use a high-order modulation mode for the second resource unit corresponding to the second data component.

[0092] It should be noted that, in an embodiment of the present application, the first wireless terminal may also configure the resource size of the first resource unit and the second resource unit respectively.

[0093] Correspondingly, in the present application, the first wireless terminal may also configure and adjust the MCS corresponding to the first data component and the second data component, that is, set the first modulation order and the second modulation order.

[0094] That is to say, in the present application, the first wireless terminal can flexibly allocate bandwidth to the first data component and the second data component by adjusting the resource size of the RU and adjusting the MCS corresponding to different RUs.

[0095] It can be understood that in an embodiment of the present application, the first wireless terminal generates a data packet corresponding to the image data based on the first processed data and the second processed data, and then directly sends the data packet to the second wireless terminal, so that different data components of the image data can be sent in the same frame, thereby ensuring the synchronous transmission of the contour data and detail data in the image data.

[0096] It should be noted that in an embodiment of the present application, the second wireless terminal may be a screen projection device, that is, after receiving a data packet corresponding to the image data, the second wireless terminal may display the same image data synchronously with the first wireless terminal.

[0097] Furthermore, in the embodiments of the present application, Figure 3 Schematic diagram of the implementation process of the method for sending image data Figure 2 ,like Figure 3 As shown, before the first wireless terminal generates a data packet corresponding to the image data according to the first processed data and the second processed data, that is, before step 103, the method for the first wireless terminal to send image data may further include the following steps:

[0098] Step 104: Calculate a check value corresponding to the first data component.

[0099] Step 105: Generate a frame check sequence according to the check value, and add the frame check sequence to the first processed data.

[0100] In an embodiment of the present application, before generating a data packet based on the first processed data and the second processed data, the first wireless terminal can calculate a check value for the first data component, and then generate a frame check sequence based on the check value, so that the frame check sequence can be added to the first processed data, so that the second wireless terminal can perform check processing on the first data component.

[0101] It should be noted that, in the embodiments of the present application, the first wireless terminal may use a variety of different methods to calculate the check value of the first data component. For example, the first wireless terminal may use a cyclic redundancy check (CRC) to calculate the check value.

[0102] Among them, CRC is a kind of checksum, and the check value obtained by the first wireless terminal using CRC calculation is the remainder obtained by dividing two byte data streams using binary division (without carry, using XOR instead of subtraction). Among them, the dividend is the binary representation of the information data stream for which the checksum needs to be calculated, that is, the first processed data, and the divisor is a predefined (short) binary number of length, which is usually represented by the coefficients of a polynomial.

[0103] Accordingly, in the present application, the first wireless terminal may use the remainder obtained by CRC calculation as a frame check sequence FCS, and directly add the FCS to the first processed data.

[0104] It is understandable that in the embodiments of the present application, the first wireless terminal may also use other verification methods to generate the verification value, and the present application does not make specific limitations.

[0105] It should be noted that, in an embodiment of the present application, in order to reduce delay, the second wireless terminal may only perform FCS check and reply on the first processed data corresponding to the first data component. Correspondingly, the first wireless terminal may only generate and add FCS to the first processed data before generating the data packet corresponding to the image data.

[0106] It can be understood that in the present application, after the first wireless terminal sends a data packet generated based on the first processed data and the second processed data to the second wireless terminal, the second wireless terminal can use the frame check sequence added in the first processed data to perform verification processing. After the verification is successful, the first wireless terminal can receive a confirmation response sent by the second wireless terminal.

[0107] In summary, in the embodiments of the present application, according to the method for sending and receiving image data proposed in steps 101 to 105, on the one hand, since the more important contour data is modulated using a low-order MCS, the transmission robustness can be greatly improved under non-ideal conditions; on the other hand, the contour data and detail data are sent simultaneously in the same packet, which effectively reduces the frequency of air interface contention; on the other hand, only the first processed data corresponding to the contour data is checked for FCS, so the retransmission rate can be effectively reduced.

[0108] An embodiment of the present application provides a method for sending and receiving image data, which separates the outline data and detail data in the image data through layered coding processing, and uses a low-order MCS to modulate the more important outline data, thereby improving transmission robustness. At the same time, the resource units in the same OFDMA packet are used to transmit the outline data and the detail data, and only the first processed data corresponding to the outline data is checked by FCS. On the basis of effectively reducing the retransmission rate, the frequency of air interface contention can also be reduced. In other words, the method for sending and receiving image data proposed in the present application has high transmission robustness, low retransmission rate, and less air interface contention, which can greatly reduce transmission delay, thereby improving the screen projection effect and effectively expanding the application scenarios of screen projection.

[0109] Another embodiment of the present application provides a method for sending and receiving image data, which can be applied to a second wireless terminal, wherein the second wireless terminal can be any terminal device that supports the Wi-Fi 6 protocol, such as: a tablet computer, a mobile phone, an e-reader, a personal computer PC, a laptop computer, a vehicle-mounted device, an Internet TV, a wearable device, a personal digital assistant PDA, a portable media player PMP, a navigation device, etc.

[0110] Figure 4 Schematic diagram of the implementation process of the method for receiving image data Figure 1 ,like Figure 4 As shown, in an embodiment of the present application, the method for the second wireless terminal to receive image data may include the following steps:

[0111] Step 201: Receive a data packet corresponding to image data sent by a first wireless terminal; wherein the data packet includes first processed data and second processed data.

[0112] In an embodiment of the present application, the second wireless terminal may first receive a data packet corresponding to the image data sent by the first wireless terminal, the data packet carrying the first processed data and the second processed data, wherein the first processed data and the second processed data are modulated data.

[0113] It should be noted that, in the embodiment of the present application, the above-mentioned image data may be image data of an image signal being displayed by the first wireless terminal, or may be image data of a video signal being played by the first wireless terminal.

[0114] Further, in an embodiment of the present application, when the second wireless terminal receives a data packet including the first processed data and the second processed data sent by the first wireless terminal, different resource units may be used to receive the first processed data and the second processed data at the same time. For example, the second wireless terminal may receive the first processed data sent by the first wireless terminal through the first resource unit; at the same time, the second wireless terminal may receive the second processed data sent by the first wireless terminal through the second resource unit.

[0115] It should be noted that, in the present application, the first wireless terminal allocates the first processed data and the second processed data to two different RUs corresponding to two users of the same OFDMA packet for transmission processing, and accordingly, the second wireless terminal also receives the data packets through two different RUs. In other words, based on the same OFDMA packet, the second wireless terminal can use the first resource unit and the second resource unit to receive the first processed data and the second processed data in parallel.

[0116] It should be noted that, in the embodiment of the present application, the first resource unit and the second resource unit may include different time-frequency resource blocks.

[0117] Further, in an embodiment of the present application, the first processed data and the second processed data can be generated by modulation processing based on different MCSs. Specifically, the MCS corresponding to the first processed data and the MCS corresponding to the second processed data are different modulation schemes. Among them, the modulation scheme may include QPSK, 16QAM, 64QAM, 256QAM, 1024QAM, 4096QAM, etc., which are not specifically limited in this application. Preferably, the first processed data can use an MCS of QPSK, 16QAM or 64QAM; the second processed data can use an MCS of 256QAM, 1024QAM or 4096QAM.

[0118] Exemplarily, in an embodiment of the present application, when generating the first processed data, the first wireless terminal may use a low-order modulation mode, and when generating the second processed data, the first wireless terminal may use a high-order modulation mode. That is, the first modulation order used by the first wireless terminal when generating the first processed data may be less than the second modulation order used when generating the second processed data. The first modulation order and the second modulation order may include 4, 16, 64, 256, 1024, 4096, etc., which are not specifically limited in the present application.

[0119] Furthermore, in an embodiment of the present application, to implement the method for sending and receiving image data proposed in the present application, the second wireless terminal is required to receive the first processed data and the second processed data based on the Wi-Fi 6 protocol or the Wi-Fi 7 protocol.

[0120] Among them, Wi-Fi 6 mainly uses technologies such as OFDMA and MU-MIMO. It is precisely because both the Wi-Fi 6 protocol and the Wi-Fi 7 protocol support OFDMA and support different users to use different MCSs. Therefore, in this application, based on the Wi-Fi 6 protocol or the Wi-Fi 7 protocol, the second wireless terminal can receive the first processed data and the second processed data modulated by different MCSs through the first resource unit and the second resource unit.

[0121] Step 202: Demodulate the first processed data to obtain a first data component; wherein the first data component represents contour data in the image data.

[0122] In an embodiment of the present application, after receiving a data packet including first processed data and second processed data sent by the first wireless terminal, the second wireless terminal may first demodulate the first processed data to obtain a first data component corresponding to the image data.

[0123] Further, in an embodiment of the present application, since the first processed data corresponds to the contour data in the image data, the first data component obtained after the second wireless terminal demodulates the first processed data can represent the contour data in the image data.

[0124] That is to say, in the present application, the second wireless terminal can obtain different data components corresponding to the image data and representing different features by parsing the data packet.

[0125] Step 203: Perform verification processing on the first data component to obtain a verification result.

[0126] In an embodiment of the present application, after the second wireless terminal demodulates the first processed data to obtain the first data component, it may perform verification processing on the first data component to obtain a verification result.

[0127] Further, in an embodiment of the present application, after acquiring the first data component, the second wireless terminal may first perform verification processing on the first data component, thereby determining whether the data transmission is correct according to the generated verification result.

[0128] Exemplarily, in an embodiment of the present application, when the second wireless terminal performs verification processing on the first data component, it can first calculate the verification value corresponding to the first data component; and then determine the verification result based on the verification value and the frame check sequence of the first processed data.

[0129] It is understandable that, in the embodiment of the present application, the method by which the first wireless terminal calculates the check value of the first data component is the same as the method by which the second wireless terminal calculates the check value of the first data component. For example, if the first wireless terminal uses CRC to calculate the check value, then the second wireless terminal can use CRC to calculate the check value.

[0130] Further, in the embodiment of the present application, after the second wireless terminal calculates and obtains the check value, it can determine the check result in combination with the frame check sequence FCS included in the first processed data. Specifically, since the first wireless terminal directly determines the check value as the FCS, the second wireless terminal can directly compare the check value and the FCS. If the check value and the FCS are the same, the check result is determined to be a successful check; if the check value and the FCS are different, the check result is determined to be a failed check.

[0131] It is understandable that in the embodiments of the present application, the first wireless terminal and the second wireless terminal may also use other verification methods to generate verification values, and the present application does not make specific limitations.

[0132] It should be noted that, in the embodiments of the present application, on the one hand, the first processed data corresponds to the contour data in the image data, and the second processed data corresponds to the detail data in the image data. In order to ensure the real-time and effectiveness of data transmission, the criticality of the contour data is often higher than that of the detail data. On the other hand, a low-order modulation mode is used when generating the first processed data, and a high-order modulation mode is used when generating the second processed data. Therefore, the second wireless terminal can choose to perform verification processing only on the first data component, and determine whether retransmission is required based on the obtained verification result, and no longer perform verification processing on the second data component, that is, regardless of whether there is a transmission error in the second processed data, as long as the verification result corresponding to the first data component is a successful verification, the second processed data is demodulated, thereby reducing the probability of retransmission, and further achieving the purpose of reducing delay.

[0133] That is to say, in the present application, in order to reduce delay, the second wireless terminal may only perform FCS check and reply on the received first processed data. Correspondingly, the first wireless terminal may only generate and add FCS to the first processed data before generating the data packet corresponding to the image data.

[0134] Step 204: If the verification result is successful, demodulate the second processed data to obtain a second data component; wherein the second data component represents detail data in the image data.

[0135] In an embodiment of the present application, after the second wireless terminal performs verification processing on the first data component to obtain a verification result, if the verification result is successful, the second wireless terminal can demodulate the second processed data to obtain a corresponding second data component.

[0136] Furthermore, in an embodiment of the present application, if the second wireless terminal determines that the verification result corresponding to the first data component is a successful verification, then it can be considered that the first processed data has not been damaged during the transmission process. Therefore, the second wireless terminal can directly demodulate the second processed data, thereby obtaining the second data component corresponding to the image data.

[0137] It can be understood that in the present application, the basis for the second wireless terminal to determine whether to demodulate the second processed data is only the verification result corresponding to the first data component, that is, regardless of whether the second processed data is damaged during the transmission process, as long as the verification result of the first data component is successful, the second wireless terminal will perform demodulation processing.

[0138] Further, in an embodiment of the present application, since the first processed data corresponds to contour data in the image data, the first data component obtained after the second wireless terminal demodulates the first processed data can represent the contour data in the image data; since the second processed data corresponds to the detail data in the image data, the second data component obtained after the second wireless terminal demodulates the second processed data can represent the detail data in the image data.

[0139] That is to say, in the present application, the second wireless terminal can obtain different data components corresponding to the image data and representing different features by parsing the data packet.

[0140] Furthermore, in the embodiments of the present application, Figure 5 Schematic diagram of the implementation process of the method for receiving image data Figure 2 ,like Figure 5 As shown, after the second wireless terminal performs verification processing on the first data component and obtains the verification result, that is, after step 203, the method for the second wireless terminal to send image data may further include the following steps:

[0141] Step 206: If the verification result is successful, a confirmation response is sent to the first wireless terminal.

[0142] In an embodiment of the present application, after the second wireless terminal performs verification processing on the first data component to obtain a verification result, if the verification result is successful, then it can be considered that the first processed data has not been damaged during the sending process, and the second wireless terminal can send a confirmation response to the first wireless terminal.

[0143] It can be seen that in the present application, the basis for the second wireless terminal to determine whether to send a confirmation response to the first wireless terminal is only the verification result corresponding to the first data component, that is, no matter whether the second processed data is damaged during the transmission process, as long as the verification result of the first data component is successful, the second wireless terminal will send a confirmation response.

[0144] It can be understood that in an embodiment of the present application, after the second wireless terminal performs verification processing on the first data component to obtain a verification result, if the verification result is a successful verification, then the second wireless terminal can send an acknowledgement (Acknowledgement, ACK) to the first wireless terminal; if the verification result is a verification failure, then the second wireless terminal can send a negative acknowledgement (Negative-Acknowledgment, NACK) to the first wireless terminal, and discard the data packet corresponding to the image data, and do not demodulate the second processed data.

[0145] Among them, the ACK character is used as a confirmation message in some communication protocols, and some communication protocols use other characters; the NACK protocol message is used in digital communication. Its function is to serve as a response to confirm the receipt of data, but it is a message signal indicating that there is a small error.

[0146] Step 205: Combine and decode the first data component and the second data component to obtain image data.

[0147] In an embodiment of the present application, after the second wireless terminal demodulates the first processed data and the second processed data respectively to obtain the first data component representing the contour data and the second data component representing the detail data, it can merge and decode the first data component and the second data component to obtain image data.

[0148] Furthermore, in an embodiment of the present application, a layered decoder for performing combined decoding processing may be configured in the second wireless terminal, so that the layered decoder may be used to perform combined decoding processing on the first data component and the second data component.

[0149] Exemplarily, in an embodiment of the present application, the layered decoder configured in the second wireless terminal may be a conventional JSCC decoder, or a wavelet transform decoder, or other types of decoders, which are not specifically limited in the present application.

[0150] Among them, the second wireless terminal can be configured with a JSCC decoder. After the second wireless terminal simultaneously inputs the first data component Coarse representing the contour data and the second data component Fine representing the detail data into the JSCC decoder for combined decoding processing, the second wireless terminal can obtain the corresponding image data.

[0151] The second wireless terminal may be configured with a wavelet transform decoder. After simultaneously inputting the first data component Coarse representing the contour data and the second data component Fine representing the detail data into the wavelet transform decoder for combined decoding processing, the second wireless terminal may obtain corresponding image data.

[0152] Correspondingly, the second wireless terminal can be configured with other types of decoders with layered decoding functions, and the decoder can also simultaneously merge and decode data of different resolutions. For example, by decoding the first data component Coarse representing the contour data and the second data component Fine representing the detail data, the corresponding image data can be obtained.

[0153] Further, in the embodiments of the present application, based on the above Figure 5After the first data component and the second data component are combined and decoded to obtain the image data, that is, after step 205, the method for the second wireless terminal to send image data may further include the following steps:

[0154] Step 207: Display the image data.

[0155] In an embodiment of the present application, after the second wireless terminal completes the analysis and acquisition of the image data, it can display the image data synchronously with the first wireless terminal, thereby completing the screen projection processing of the image data from the first wireless terminal to the second wireless terminal. The first wireless terminal is the screen projection device, and the second wireless terminal is the screen projection device.

[0156] In summary, in the embodiments of the present application, according to the method for sending and receiving image data proposed in steps 201 to 206, on the one hand, since the more important contour data is modulated using a low-order MCS, the transmission robustness can be greatly improved under non-ideal conditions; on the other hand, the contour data and detail data are sent simultaneously in the same packet, which effectively reduces the frequency of air interface contention; on the other hand, only the first processed data corresponding to the contour data is checked for FCS, so the retransmission rate can be effectively reduced.

[0157] An embodiment of the present application provides a method for sending and receiving image data, which separates the outline data and detail data in the image data through layered coding processing, and uses a low-order MCS to modulate the more important outline data, thereby improving transmission robustness. At the same time, the resource units in the same OFDMA packet are used to transmit the outline data and the detail data, and only the first processed data corresponding to the outline data is checked by FCS. On the basis of effectively reducing the retransmission rate, the frequency of air interface contention can also be reduced. In other words, the method for sending and receiving image data proposed in the present application has high transmission robustness, low retransmission rate, and less air interface contention, which can greatly reduce transmission delay, thereby improving the screen projection effect and effectively expanding the application scenarios of screen projection.

[0158] Based on the above embodiments, another embodiment of the present application provides a method for sending and receiving image data, which can be applied to a first wireless terminal and a second wireless terminal, wherein the first wireless terminal can be any terminal device configured with a display screen and supporting the Wi-Fi 6 protocol, the second wireless terminal can be any terminal device supporting the Wi-Fi 6 protocol, the first wireless terminal is a screen projection device, and the second wireless terminal is a screen projected device.

[0159] Figure 6 FIG. 1 is a schematic diagram of the implementation flow of the method for sending and receiving image data, such as Figure 6As shown, in an embodiment of the present application, a method for a first wireless terminal and a second wireless terminal to send and receive image data may include the following steps:

[0160] Step 301: The first wireless terminal performs layered coding processing on image data to obtain a first data component and a second data component.

[0161] In an embodiment of the present application, the first wireless terminal can perform layered coding processing on the image data, so as to obtain the first data component and the second data component corresponding to the image data. The first wireless terminal can be configured with a layered encoder for performing layered coding processing, so that the layered encoder can be used to perform layered coding processing on the image data.

[0162] It should be noted that, in the embodiment of the present application, the above-mentioned image data may be image data of an image signal being displayed by the first wireless terminal, or image data of a video signal being played by the first wireless terminal. The first data component may represent contour data in the image data; and the second data component may represent detail data in the image data.

[0163] Step 302: The first wireless terminal modulates the first data component according to the first modulation order to obtain first processed data; and modulates the second data component according to the second modulation order to obtain second processed data.

[0164] In an embodiment of the present application, after the first wireless terminal performs layered coding processing on the image data to obtain the first data component and the second data component corresponding to the image data, it can modulate the first data component according to the first modulation order to obtain the first processed data; at the same time, it can modulate the second data component according to the second modulation order to obtain the second processed data.

[0165] It is understandable that in the embodiments of the present application, in order to ensure the real-time and effectiveness of data transmission, the criticality of the outline data is often higher than that of the detail data. Therefore, a low-order MCS can be used for the first data component, so as to ensure that a high transmission robustness can be maintained even in a non-ideal environment. Accordingly, a high-order MCS can be used for the second data component, so that the detail data in the image data can be restored in an ideal environment, and the transmission effect is good. In a non-ideal environment, even if an error occurs, it is only the direct data in the image data that has an error, and it will not cause a distorted screen or freeze phenomenon.

[0166] Step 303: The first wireless terminal calculates a check value corresponding to the first data component.

[0167] Step 304: The first wireless terminal generates a frame check sequence according to the check value, and adds the frame check sequence to the first processed data.

[0168] In an embodiment of the present application, the first wireless terminal can calculate a check value for the first processed data, and then generate a frame check sequence based on the check value, so that the frame check sequence can be added to the first processed data, so that the second wireless terminal can perform check processing on the first data component.

[0169] Step 305: The first wireless terminal sends the first processed data and the second processed data to the second wireless terminal.

[0170] In an embodiment of the present application, after obtaining the first processed data and the second processed data, the first wireless terminal may further generate a data packet corresponding to the image data according to the first processed data and the second processed data, and then send the data packet to the second wireless terminal.

[0171] Exemplarily, in the present application, based on the same OFDMA packet, the first wireless terminal can use different RUs to send the first processed data and the second processed data in parallel. For example, when the first wireless terminal sends a data packet to the second wireless terminal, it can send the first processed data to the second wireless terminal through the first resource unit; and at the same time, it can send the second processed data to the second wireless terminal through the second resource unit.

[0172] Accordingly, in the present application, when the second wireless terminal receives a data packet including the first processed data and the second processed data sent by the first wireless terminal, different resource units may be used to receive the first processed data and the second processed data at the same time. For example, the second wireless terminal may receive the first processed data sent by the first wireless terminal through the first resource unit; at the same time, the second wireless terminal may receive the second processed data sent by the first wireless terminal through the second resource unit.

[0173] Step 306: The second wireless terminal demodulates the first processed data to obtain a first data component.

[0174] In an embodiment of the present application, after receiving a data packet including first processed data and second processed data sent by the first wireless terminal, the second wireless terminal may first demodulate the first processed data to obtain a first data component corresponding to the image data, wherein the first data component represents contour data in the image data.

[0175] Step 307: The second wireless terminal performs verification processing on the first data component to obtain a verification result.

[0176] In an embodiment of the present application, after the second wireless terminal demodulates the first processed data to obtain the first data component, it can verify the first data component to obtain a verification result, and then determine whether the data transmission is correct based on the generated verification result.

[0177] It should be noted that, in the embodiments of the present application, on the one hand, the first processed data corresponds to the contour data in the image data, and the second processed data corresponds to the detail data in the image data. In order to ensure the real-time and effectiveness of data transmission, the criticality of the contour data is often higher than that of the detail data. On the other hand, a low-order modulation mode is used when generating the first processed data, and a high-order modulation mode is used when generating the second processed data. Therefore, the second wireless terminal can choose to perform verification processing only on the first data component, and determine whether retransmission is required based on the obtained verification result, and no longer perform verification processing on the second data component, that is, regardless of whether there is a transmission error in the second processed data, as long as the verification result corresponding to the first data component is a successful verification, the second processed data is demodulated, thereby reducing the probability of retransmission, and further achieving the purpose of reducing delay.

[0178] Step 308: If the verification result is successful, the second wireless terminal sends an ACK to the first wireless terminal.

[0179] Step 309: The second wireless terminal demodulates the second processed data to obtain a second data component.

[0180] In an embodiment of the present application, if it is determined that the verification result corresponding to the first data component is a successful verification, the second wireless terminal can send an ACK to the first wireless terminal, and at the same time, the second wireless terminal can demodulate the second processed data to obtain the second data component. The order of executing step 308 and step 309 is not limited.

[0181] Step 310: The second wireless terminal performs combined decoding processing on the first data component and the second data component to obtain image data.

[0182] In an embodiment of the present application, a layered decoder for performing combined decoding processing may be configured in the second wireless terminal, so that the layered decoder may be used to perform combined decoding processing on the first data component and the second data component to obtain image data.

[0183] Step 311: The second wireless terminal displays image data.

[0184] In an embodiment of the present application, after completing the analysis and acquisition of the image data, the second wireless terminal can display the image data synchronously with the first wireless terminal, thereby completing the screen projection processing of the image data from the first wireless terminal to the second wireless terminal.

[0185] An embodiment of the present application provides a method for sending and receiving image data, which separates the outline data and detail data in the image data through layered coding processing, and uses a low-order MCS to modulate the more important outline data, thereby improving transmission robustness. At the same time, the resource units in the same OFDMA packet are used to transmit the outline data and the detail data, and only the first processed data corresponding to the outline data is checked by FCS. On the basis of effectively reducing the retransmission rate, the frequency of air interface contention can also be reduced. In other words, the method for sending and receiving image data proposed in the present application has high transmission robustness, low retransmission rate, and less air interface contention, which can greatly reduce transmission delay, thereby improving the screen projection effect and effectively expanding the application scenarios of screen projection.

[0186] Based on the above embodiment, in another embodiment of the present application, Figure 7 A schematic diagram of a structure for performing screen projection processing of image data on a first wireless terminal, such as Figure 7 As shown, the first wireless terminal can be configured with a display, a hierarchical encoder and a Wi-Fi transmitting module, wherein, for the input image data, the first wireless terminal can use the hierarchical encoder to perform hierarchical encoding processing on the image data while using the display to display the image data, thereby obtaining the Coarse component (the first data component for characterizing the contour data) and the Fine component (the second data component for characterizing the detail data), and then, the Coarse component and the Fine component are sent together to the Wi-Fi transmitting module, and the Wi-Fi transmitting module allocates the Coarse component and the Fine component to two different resource units RU (first resource unit RU1 and second resource unit RU2) corresponding to the User (first user User1 and second user User2) of the same OFDMA packet for transmission. Among them, both the Wi-Fi 6 protocol and the Wi-Fi 7 protocol support OFDMA, and support different Users to use different MCS. Therefore, the RU1 corresponding to the Coarse component can adopt a low-order modulation mode, corresponding to the generation of data 1 (first processed data), and the RU2 corresponding to the Fine component can adopt a high-order modulation mode, corresponding to the generation of data 2 (second processed data).

[0187] Specifically, in the present application, the layered encoder can be a conventional JSCC encoder (used to generate Coarse components and Fine components), or a wavelet transform encoder, or other types of encoders (generating multi-resolution data corresponding to the contour and detail parts of the image, respectively).

[0188] It can be understood that in the embodiments of the present application, the Coarse component represents the contour part of the image, which is key data. The Coarse component can be modulated by low-order MCS, and can maintain high transmission robustness even in non-ideal environments; the Fine component represents the microscopic detail part of the image, and is sent using high-order MCS modulation. When the channel is good, the receiver can decode all the detail data, and the image quality is good; when the channel is not ideal, the decoded data contains some erroneous bit information, and the corresponding image quality is reduced. When there are not many erroneous bits, although the QAM demodulation constellation decision has a certain error, it will not deviate too far, so the image quality degradation is not obvious, and there will be no serious freezes or screen distortion caused by retransmission.

[0189] Further, in an embodiment of the present application, the first wireless terminal can achieve flexible bandwidth allocation for the Coarse component and the Fine component by adjusting the size of RU1 and RU2, and the MCS mode used by different components. In addition, data 1 corresponding to the Coarse component and data 2 corresponding to the Fine component are sent to the second wireless terminal in the same frame, which can also ensure the synchronous transmission of the Coarse component and the Fine component.

[0190] Figure 8 A schematic diagram of a structure for performing screen projection processing of image data for a second wireless terminal, such as Figure 8 As shown, the second wireless terminal can be configured with a layered decoder and a Wi-Fi receiving module, wherein after the Wi-Fi receiving module receives the data packet including data 1 and data 2 sent by the first wireless terminal through the first resource unit RU1 and the second resource unit RU2 of two users User (the first user User1 and the second user User2), the data 1 and the data 2 will be parsed to obtain the Coarse component corresponding to the data 1 and the Fine component corresponding to the data 2. Then, the second wireless terminal inputs the Coarse component (the first data component for characterizing the contour data) and the Fine component (the second data component for characterizing the detail data) into the layered decoder for combined decoding processing, so that the corresponding image data can be restored and the image data can be displayed to complete the screen projection processing of the image data from the first wireless terminal to the second wireless terminal.

[0191] Among them, since the existing port physical layer (Physical, PHY) layer data format is borrowed, the time domain and frequency domain parts of the circuit can be multiplexed, and only the decoding circuit needs to be set up separately for two users.

[0192] Furthermore, in an embodiment of the present application, the second wireless terminal may also make certain adaptations to the Wi-Fi response mechanism to achieve the purpose of reducing delay. Specifically, the Wi-Fi receiving module in the second wireless terminal may only perform an FCS check on the Coarse component data and send an ACK, and does not perform an FCS check on the Fine component data, thereby reducing the probability of retransmission and reducing delay.

[0193] For example, Fig. 9 This is a schematic diagram of the verification process, such as Fig. 9 As shown, the first wireless terminal sends a data packet including data 1 and data 2 to the second wireless terminal, wherein the first wireless terminal transmits data 1 through the first resource unit RU1 corresponding to the first user User1, and transmits data 2 through the second resource unit RU2 corresponding to the second user User2.

[0194] Specifically, in the present application, the Require To Send (RTS) is an output signal, which is used to indicate that the device is ready to receive; the Clear To Send (CTS) is an input signal, which stops sending when it is valid. For example, the RTS of the first wireless terminal is connected to the CTS of the second wireless terminal; the CTS of the first wireless terminal is connected to the RTS of the second wireless terminal. The former signal controls the sending of the second wireless terminal, and the latter signal controls the sending of the first wireless terminal. For the sending of the second wireless terminal (the first wireless terminal receives), if the first wireless terminal sends an RTS signal when the receiving buffer is almost full (meaning to notify the second wireless terminal to stop sending), the second wireless terminal detects the signal through CTS and stops sending; after a period of time, the first wireless terminal has free space in the receiving buffer and sends an RTS signal to instruct the second wireless terminal to start sending data. The first wireless terminal sends (the second wireless terminal receives) similarly.

[0195] It should be noted that in the present application, after the second wireless terminal receives a data packet including data 1 and data 2 sent by the second wireless terminal, it can perform an FCS check on data 1 in the data packet and send an ACK, that is, only ACK is performed on the data corresponding to the Coarse component.

[0196] Specifically, in the present application, the ACK implementation scheme includes but is not limited to the following forms: the second wireless terminal only sends a single-packet ACK; or, the second wireless terminal sends an ACK in MU format and ACKs the data of two Users at the same time.

[0197] It can be understood that in the embodiment of the present application, in point-to-point data transmission, although the actual receiving party is one user, the data format at the PHY layer and the MAC layer borrows the data format of multiple users for transmission. Different users' data (Coarse component and Fine component) use different MCS modes: the Coarse component has a small amount of data, but requires high reliability, that is, the ACK mechanism; the Fine component has a large amount of data, but because it is detailed data, it is allowed to lose some data, so there is no need for an ACK mechanism. Accordingly, the second wireless terminal only performs FCS check and response on the Coarse component.

[0198] Specifically, in the present application, after the second wireless terminal receives the data of the Coarse component and verifies that the FCS passes, it will respond with ACK / BA; the second wireless terminal can send ACKs in various formats, which are all considered equivalent behaviors because in fact only ACK is performed for the Coarse component.

[0199] It can be understood that the method for sending and receiving image data proposed in the present application can capture air interface packets for confirmation in the Wi-Fi screen projection scenario of point-to-point communication, that is, the present application uses a multi-user data frame format based on point-to-point communication; and the receiver side replies with a single packet ACK (if the receiver replies with MU-ACK, it is considered equivalent).

[0200] An embodiment of the present application provides a method for sending and receiving image data, which separates the outline data and detail data in the image data through layered coding processing, and uses a low-order MCS to modulate the more important outline data, thereby improving transmission robustness. At the same time, the resource units in the same OFDMA packet are used to transmit the outline data and the detail data, and only the first processed data corresponding to the outline data is checked by FCS. On the basis of effectively reducing the retransmission rate, the frequency of air interface contention can also be reduced. In other words, the method for sending and receiving image data proposed in the present application has high transmission robustness, low retransmission rate, and less air interface contention, which can greatly reduce transmission delay, thereby improving the screen projection effect and effectively expanding the application scenarios of screen projection.

[0201] Based on the above embodiment, in another embodiment of the present application, Fig.10 The structure diagram of the first wireless terminal is shown in FIG. Figure 1 ,like Fig.10 As shown, the first wireless terminal 10 proposed in the embodiment of the present application may include a coding unit 11, a modulation unit 12, a generation unit 13, a sending unit 14,

[0202] The encoding unit 11 is used to perform hierarchical encoding processing on the image data to obtain a first data component and a second data component; wherein the first data component represents contour data in the image data; and the second data component represents detail data in the image data;

[0203] The modulation unit 12 is used to modulate the first data component according to a first modulation order to obtain first processed data; and modulate the second data component according to a second modulation order to obtain second processed data; wherein the first modulation order is smaller than the second modulation order;

[0204] The generating unit 13 is configured to generate a data packet corresponding to the image data according to the first processed data and the second processed data;

[0205] The sending unit 14 is configured to send the data packet to the second wireless terminal.

[0206] In the embodiments of the present application, further, Fig.11 The structure diagram of the first wireless terminal is shown in FIG. Figure 2 ,like Fig.11 As shown, the first wireless terminal 10 proposed in the embodiment of the present application may also include a first processor 15, a first memory 16 storing executable instructions of the first processor 15, and further, the first wireless terminal 10 may also include a first communication interface 17, and a first bus 18 for connecting the first processor 15, the first memory 16 and the first communication interface 17.

[0207] Further, in an embodiment of the present application, a first processor 15 is used to perform hierarchical coding processing on the image data to obtain a first data component and a second data component; wherein the first data component represents contour data in the image data; the second data component represents detail data in the image data; the first data component is modulated according to a first modulation order to obtain first processed data; the second data component is modulated according to a second modulation order to obtain second processed data; wherein the first modulation order is smaller than the second modulation order; a data packet corresponding to the image data is generated according to the first processed data and the second processed data, and the data packet is sent to a second wireless terminal.

[0208] Further, in the embodiments of the present application, Fig.12 The structure diagram of the second wireless terminal is shown in FIG. Figure 1 ,like Fig.12 As shown, the second wireless terminal 20 proposed in the embodiment of the present application may include a receiving unit 21, a checking unit 22, a demodulation unit 23, a decoding unit 24,

[0209] The receiving unit 21 is used to receive a data packet corresponding to the image data sent by the first wireless terminal; wherein the data packet includes the first processed data and the second processed data;

[0210] The demodulation unit 23 is used to demodulate the first processed data to obtain a first data component; wherein the first data component represents contour data in the image data;

[0211] The verification unit 22 is used to perform verification processing on the first data component to obtain a verification result;

[0212] The demodulation unit 23 is further configured to demodulate the second processed data to obtain a second data component if the verification result is successful; wherein the second data component represents detail data in the image data;

[0213] The decoding unit 24 is used to perform combined decoding processing on the first data component and the second data component to obtain the image data.

[0214] In the embodiments of the present application, further, Fig.13 The structure diagram of the second wireless terminal is shown in FIG. Figure 2 ,like Fig.13 As shown, the second wireless terminal 20 proposed in the embodiment of the present application may also include a second processor 25 and a second memory 26 storing executable instructions of the second processor 25. Further, the second wireless terminal 20 may also include a second communication interface 27, and a second bus 28 for connecting the second processor 25, the second memory 26 and the second communication interface 27.

[0215] Further, in an embodiment of the present application, a second processor 25 is used to receive a data packet corresponding to the image data sent by a first wireless terminal; wherein the data packet includes first processed data and second processed data; the first processed data is demodulated to obtain a first data component; wherein the first data component represents contour data in the image data; the first data component is verified to obtain a verification result; if the verification result is a successful verification, the second processed data is demodulated to obtain a second data component; wherein the second data component represents detail data in the image data; the first data component and the second data component are combined and decoded to obtain the image data.

[0216] In an embodiment of the present application, the above-mentioned processor can be at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a Central Processing Unit (CPU), a controller, a microcontroller, and a microprocessor. It is understandable that for different devices, the electronic device used to realize the above-mentioned processor function can also be other, and the embodiment of the present application is not specifically limited. The memory can be connected to the processor, wherein the memory is used to store executable program code, and the program code includes computer operation instructions, and the memory may include a high-speed RAM memory, and may also include a non-volatile memory, for example, at least two disk memories.

[0217] In the embodiment of the present application, the bus is used to connect the communication interface, the processor and the memory, as well as the mutual communication between these devices.

[0218] In the embodiment of the present application, the memory is used to store instructions and data.

[0219] In practical applications, the above-mentioned memory can be a volatile memory (volatile memory), such as a random access memory (Random-Access Memory, RAM); or a non-volatile memory (non-volatile memory), such as a read-only memory (Read-Only Memory, ROM), a flash memory (flash memory), a hard disk (Hard Disk Drive, HDD) or a solid-state drive (Solid-State Drive, SSD); or a combination of the above types of memory, and provide instructions and data to the processor.

[0220] In addition, each functional module in this embodiment can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or software functional modules.

[0221] If the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this embodiment is essentially or the part that contributes to the prior art or the whole or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) or a processor to perform all or part of the steps of the method of this embodiment. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc., various media that can store program codes.

[0222] An embodiment of the present application provides a first wireless terminal and a second wireless terminal, which separate the contour data and detail data in the image data through layered coding processing, and use a low-order MCS to modulate the more important contour data, thereby improving transmission robustness. At the same time, the resource units in the same OFDMA packet are used to transmit the contour data and the detail data, and only the first processed data corresponding to the contour data is checked for FCS. On the basis of effectively reducing the retransmission rate, the frequency of air interface contention can also be reduced. In other words, the method for sending and receiving image data proposed in the present application has high transmission robustness, low retransmission rate, and less air interface contention, which can greatly reduce transmission delay, thereby improving the screen projection effect and effectively expanding the application scenarios of screen projection.

[0223] An embodiment of the present application provides a computer-readable storage medium having a program stored thereon, which, when executed by a processor, implements the method for sending and receiving image data as described above.

[0224] Specifically, the program instructions corresponding to the method for sending and receiving image data in this embodiment may be stored on a storage medium such as a CD, a hard disk, or a USB flash drive. When the program instructions corresponding to the method for sending and receiving image data in the storage medium are read or executed by the first wireless terminal, the following steps are included:

[0225] Performing layered coding processing on the image data to obtain a first data component and a second data component; wherein the first data component represents contour data in the image data; and the second data component represents detail data in the image data;

[0226] Modulating the first data component according to a first modulation order to obtain first processed data; modulating the second data component according to a second modulation order to obtain second processed data; wherein the first modulation order is smaller than the second modulation order;

[0227] A data packet corresponding to the image data is generated according to the first processed data and the second processed data, and the data packet is sent to a second wireless terminal.

[0228] When the program instructions corresponding to a method for sending and receiving image data in the storage medium are read or executed by the second wireless terminal, the method includes the following steps:

[0229] receiving a data packet corresponding to the image data sent by a first wireless terminal; wherein the data packet includes first processed data and second processed data;

[0230] Demodulating the first processed data to obtain a first data component; wherein the first data component represents contour data in the image data;

[0231] Performing verification processing on the first data component to obtain a verification result;

[0232] If the verification result is successful, demodulating the second processed data to obtain a second data component; wherein the second data component represents detail data in the image data;

[0233] The first data component and the second data component are combined and decoded to obtain the image data.

[0234] An embodiment of the present application provides a chip, which includes a processor and an interface. The processor obtains program instructions through the interface, and the processor is used to run the program instructions to implement the above-mentioned method for sending and receiving image data.

[0235] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of hardware embodiments, software embodiments, or embodiments in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) that contain computer-usable program code.

[0236] The present application is described with reference to implementation flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the process in the flowchart. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0237] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which is implemented in the implementation flow diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0238] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for executing the steps in the flowchart. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0239] The above description is only a preferred embodiment of the present application and is not intended to limit the protection scope of the present application.

Claims

1. A method for sending image data in a first wireless terminal, characterized in that: include: Performing layered coding processing on the image data to obtain a first data component and a second data component; wherein the first data component represents contour data in the image data; and the second data component represents detail data in the image data; Modulating the first data component according to a first modulation order to obtain first processed data; modulating the second data component according to a second modulation order to obtain second processed data; wherein the first modulation order is smaller than the second modulation order; generating a data packet corresponding to the image data according to the first processed data and the second processed data, and sending the data packet to a second wireless terminal; receiving a confirmation response of the first data component sent by the second wireless terminal; After obtaining the first data component and the second data component, the method further includes: The first data component and the second data component are respectively allocated to resource units RU corresponding to two users of the same orthogonal frequency division multiple access (OFDMA) packet.

2. The method according to claim 1, characterized in that The sending the data packet to the second wireless terminal includes: sending the first processed data to the second wireless terminal through a first resource unit; The second processed data is sent to the second wireless terminal via a second resource unit.

3. The method according to claim 2, characterized in that The first resource unit and the second resource unit include different time-frequency resource blocks.

4. The method according to claim 3, characterized in that The method further comprises: The resource sizes of the first resource unit and the second resource unit are configured respectively.

5. The method according to claim 1, characterized in that Before generating a data packet corresponding to the image data according to the first processed data and the second processed data, the method further includes: Calculating a check value corresponding to the first data component; A frame check sequence is generated according to the check value, and the frame check sequence is added to the first processed data.

6. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: Performing modulation processing on the first data component and the second data component based on the Wi-Fi 6 protocol; The first processed data and the second processed data are sent based on the Wi-Fi 6 protocol.

7. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: Modulating the first data component and the second data component based on the Wi-Fi 7 protocol; The first processed data and the second processed data are sent based on the Wi-Fi 7 protocol.

8. A method for receiving image data in a second wireless terminal, characterized in that: The method comprises: Receive a data packet corresponding to the image data sent by a first wireless terminal; wherein the data packet includes first processed data and second processed data, and the first processed data and the second processed data are respectively allocated to resource units RU corresponding to two users of the same orthogonal frequency division multiple access (OFDMA) packet; Demodulating the first processed data to obtain a first data component; wherein the first data component represents contour data in the image data; Performing verification processing on the first data component to obtain a verification result; If the verification result is successful, sending a confirmation response to the first wireless terminal, and demodulating the second processed data to obtain a second data component; wherein the second data component represents detail data in the image data; The first data component and the second data component are combined and decoded to obtain the image data.

9. The method according to claim 8, characterized in that The receiving a data packet corresponding to the image data sent by the first wireless terminal includes: Receiving, through a first resource unit, the first processed data sent by the first wireless terminal; The second processed data sent by the first wireless terminal is received through a second resource unit.

10. The method according to claim 9, characterized in that The first resource unit and the second resource unit include different time-frequency resource blocks.

11. The method according to claim 8, characterized in that The performing verification processing on the first data component to obtain a verification result includes: Calculating a check value corresponding to the first data component; The check result is determined according to the check value and a frame check sequence of the first processed data.

12. The method according to claim 11, characterized in that The step of determining the check result according to the check value and the frame check sequence of the first processed data includes: If the check value is the same as the frame check sequence, determining that the check result is a successful check; If the check value is different from the frame check sequence, the check result is determined to be a check failure.

13. The method according to claim 8, characterized in that After the first data component and the second data component are combined and decoded to obtain the image data, the method further includes: The image data is displayed.

14. The method according to any one of claims 8 to 13, characterized in that The method further comprises: The first processed data and the second processed data are received based on the Wi-Fi 6 protocol or the Wi-Fi 7 protocol.

15. A first wireless terminal, characterized in that: The first wireless terminal includes: a coding unit, a modulation unit, a generation unit, a transmission unit, and a first processor. The encoding unit is used to perform hierarchical encoding processing on the image data to obtain a first data component and a second data component; wherein the first data component represents contour data in the image data; and the second data component represents detail data in the image data; The modulation unit is used to modulate the first data component according to a first modulation order to obtain first processed data; and modulate the second data component according to a second modulation order to obtain second processed data; wherein the first modulation order is smaller than the second modulation order; The generating unit is configured to generate a data packet corresponding to the image data according to the first processed data and the second processed data; The sending unit is used to send the data packet to the second wireless terminal; The first processor is used to receive a confirmation response of the first data component sent by the second wireless terminal; and is also used to allocate the first data component and the second data component to resource units RU corresponding to two users of the same orthogonal frequency division multiple access OFDMA packet respectively.

16. A second wireless terminal, characterized in that: The second wireless terminal includes: a receiving unit, a checking unit, a demodulation unit, and a decoding unit. The receiving unit is used to receive a data packet corresponding to the image data sent by the first wireless terminal; wherein the data packet includes first processed data and second processed data, and the first processed data and the second processed data are respectively allocated to resource units RU corresponding to two users of the same orthogonal frequency division multiple access OFDMA packet; The demodulation unit is used to demodulate the first processed data to obtain a first data component; wherein the first data component represents contour data in the image data; The verification unit is used to perform verification processing on the first data component to obtain a verification result; The demodulation unit is further configured to send a confirmation response to the first wireless terminal if the verification result is successful, and demodulate the second processed data to obtain a second data component; wherein the second data component represents detail data in the image data; The decoding unit is used to perform combined decoding processing on the first data component and the second data component to obtain the image data.

17. A first wireless terminal, characterized in that: The first wireless terminal includes a first processor and a first memory storing instructions executable by the first processor. When the instructions are executed by the first processor, the method according to any one of claims 1 to 7 is implemented.

18. A second wireless terminal, characterized in that: The second wireless terminal includes a second processor and a second memory storing instructions executable by the second processor. When the instructions are executed by the second processor, the method according to any one of claims 8 to 14 is implemented.

19. A chip, characterized in that: The chip includes a processor and an interface, the processor obtains program instructions through the interface, and the processor is used to run the program instructions to execute the method according to any one of claims 1-7 or 8-14.

Images