Data processing method and electronic device

Abstract

Embodiments of the present application provide a data processing method and an electronic device. The method comprises: in a process of data interaction between a first electronic device and a second electronic device through wireless connection, the first electronic device can detect its own state, wherein the state of the first electronic device comprises a motion state or a stationary state. The first electronic device can adjust the wireless connection configuration parameter and / or the coding and decoding strategy when interacting with the second electronic device based on its own state. Thus, a method of adaptively adjusting the configuration parameter of data interaction based on the motion state of the electronic device is provided, which meets the needs of different interaction scenarios.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the field of terminal devices, and in particular to a data processing method and an electronic device. BACKGROUND

[0002] With the development of screen projection technology, the application scenarios of screen projection technology are more and more. For example, a user can use a mobile phone to project to a tablet or a car screen while walking. Therefore, in a screen projection scenario, the sending end (for example, a mobile phone) and the receiving end (for example, a tablet) of screen projection can be in a motion state. Due to the motion of the screen projection devices, the wireless channel conditions between the screen projection devices will change rapidly, resulting in time delay and jitter of screen projection data transmission, and further causing frame loss and lag of the screen projection picture. SUMMARY

[0003] To solve the above technical problems, the present application provides a data processing method and an electronic device. In the method, the electronic device adjusts the configuration parameters during data interaction with other electronic devices based on the motion state of the electronic device, so as to adaptively adjust the configuration parameters for different motion states.

[0004] In a first aspect, embodiments of the present application provide a data processing method. The method comprises: a first electronic device establishes a wireless connection with a second electronic device, and performs data interaction with the second electronic device through the wireless connection. The first electronic device detects a state of the first electronic device, and the state of the first electronic device is a motion state or a stationary state. The first electronic device determines a target configuration parameter based on the state of the first electronic device, wherein the target configuration parameter comprises a wireless connection configuration parameter between the first electronic device and the second electronic device, and / or a coding and decoding strategy of the first electronic device. The first electronic device performs data interaction with the second electronic device based on the target configuration parameter. In this way, the first electronic device can adaptively adjust the corresponding target configuration parameter based on the motion state of the first electronic device, and can configure the corresponding configuration parameter according to different motion states, for example, the motion state corresponds to the configuration parameter of the motion state, and the stationary state corresponds to the configuration parameter of the stationary state. Thus, different screen projection effects can be achieved based on different motion states.

[0005] For example, the first electronic device can determine the motion state of the first electronic device based on the parameters detected by the IMU module.

[0006] For example, the first electronic device can determine the motion state of the first electronic device based on the IMU module and the communication state of the wireless connection.

[0007] For example, the wireless connection between the first electronic device and the second electronic device can be a Wi-Fi connection.

[0008] According to a first aspect, a first electronic device establishes a wireless connection with a second electronic device and performs data interaction with the second electronic device through the wireless connection, including: the first electronic device sends a connection request message to the second electronic device in response to a received first user operation. The first electronic device establishes the wireless connection with the second electronic device in response to a response message sent by the second electronic device. The first electronic device sends a data packet containing an image frame to the second electronic device through the wireless connection. In this way, the first electronic device acts as a sending end, and in the process of sending the data packet containing the image frame to the second electronic device, it can adjust the configuration parameters of the sending end based on the motion state of the first electronic device to improve the stability of image frame transmission.

[0009] According to the first aspect, or any one of the implementation forms of the first aspect, if the state of the first electronic device is the motion state, the wireless connection configuration parameters include at least one of the following: the number of retransmissions of the data packet is N, and the multiple-input multiple-output (MIMO) mode is a diversity mode; N is an integer greater than 0. In this way, in the process of screen projection, if the first electronic device is in the motion state, it can increase the number of retransmissions of the data packet and adjust the MIMO mode to the diversity mode to improve the robustness of the wireless transmission channel and reduce the occurrence of image frame loss, lag, and other problems.

[0010] According to the first aspect, or any one of the implementation forms of the first aspect, if the state of the first electronic device is the motion state, the wireless connection configuration parameters include at least one of the following: the number of retransmissions of the data packet is N, and the multiple-input multiple-output (MIMO) mode is a diversity mode; N is an integer greater than 0. In this way, in the process of screen projection, if the first electronic device is in the motion state, it can increase the number of retransmissions of the data packet and adjust the MIMO mode to the diversity mode to improve the robustness of the wireless transmission channel and reduce the occurrence of image frame loss, lag, and other problems.

[0011] According to the first aspect, or any one of the implementation forms of the first aspect, if the state of the first electronic device is the motion state, the coding strategy of the first electronic device includes at least one of the following: the code rate of the image frame is A1; the resolution of the image frame is B1; and the coding dependency relationship of the image frame is adjusted. In this way, in the process of screen projection, when the first electronic device is in the motion state, the first electronic device can reduce the code rate and resolution of the image frame to reduce the amount of data during data transmission and reduce the use of wireless bandwidth. In addition, the first electronic device can also adjust the coding dependency relationship of the image frame through a feedback mechanism to provide a better low-latency screen projection effect.

[0012] According to a first aspect, or any possible implementation mode of the first aspect, if the state of the first electronic device is the static state, the coding strategy of the first electronic device comprises at least one of the following: the code rate of the image frame is A2; the resolution of the image frame is B2; adjusting the coding dependency of the image frame; wherein A2 is greater than A1, and B2 is greater than B1. In this way, when the first electronic device is in the process of screen projection and the first electronic device is in the static state, the first electronic device can increase the code rate and the resolution of the image frame to improve the display quality of the receiving end. In addition, the first electronic device can also use the feedback mechanism to adjust the coding dependency of the image frame in the case of image frame loss, so as to reduce the influence of image frame loss on the decoding of the receiving end, thereby providing a better low-latency screen projection effect.

[0013] According to the first aspect, or any possible implementation mode of the first aspect, the first electronic device establishes a wireless connection with the second electronic device and performs data interaction with the second electronic device through the wireless connection, comprising: the first electronic device sends a response message to the second electronic device in response to a connection request message sent by the second electronic device; the first electronic device establishes a wireless connection with the second electronic device; and the first electronic device receives a data packet containing an image frame sent by the second electronic device through the wireless connection. In this way, the first electronic device as the receiving end can adjust the configuration parameters of the sending end based on the motion state of the first electronic device to improve the stability of image frame display during the process of receiving the data packet containing the image frame sent by the second electronic device.

[0014] According to the first aspect, or any possible implementation mode of the first aspect, if the state of the first electronic device is the static state, the wireless connection configuration parameter comprises: the MIMO mode is a diversity mode. In this way, during the screen projection process of the first electronic device, and in the case that the first electronic device is in the motion state, the first electronic device can adjust the MIMO mode to the diversity mode to improve the success rate of image frame reception.

[0015] According to the first aspect, or any possible implementation mode of the first aspect, if the state of the first electronic device is the static state, the wireless connection configuration parameter comprises: the MIMO mode is a diversity mode. In this way, during the screen projection process of the first electronic device, and in the case that the first electronic device is in the motion state, the first electronic device can adjust the MIMO mode to the diversity mode to improve the success rate of image frame reception.

[0016] According to the first aspect, or any one of the implementations of the first aspect, if the state of the first electronic device is the motion state, the coding strategy of the first electronic device includes: setting the image buffer size as C1. In this way, in the process of screen projection of the first electronic device, and in the case that the first electronic device is in the motion state, the first electronic device can increase the image buffer size to reduce the frame loss caused by the unstable frame transmission arrival time.

[0017] According to the first aspect, or any one of the implementations of the first aspect, if the state of the first electronic device is the motion state, the coding strategy of the first electronic device includes: setting the image buffer size as C1. In this way, in the process of screen projection of the first electronic device, and in the case that the first electronic device is in the motion state, the first electronic device can increase the image buffer size to reduce the frame loss caused by the unstable frame transmission arrival time.

[0018] According to the first aspect, or any one of the implementations of the first aspect, the method further includes: the first electronic device sending the state of the first electronic device to the second electronic device. In this way, the first electronic device and the second electronic device can notify the state of themselves to the opposite end, so that the opposite end can adjust the configuration parameter accordingly.

[0019] According to the first aspect, or any one of the implementations of the first aspect, the method further includes: the first electronic device receiving the state of the second electronic device sent by the second electronic device; the state of the second electronic device is the motion state or the stationary state; if the state of the second electronic device is the motion state, the first electronic device adjusts the configuration parameter of the first electronic device to the target configuration parameter corresponding to the motion state. In this way, in the case that any one of the first electronic device and the second electronic device is in the motion state, the other end also adjusts the configuration parameter to the configuration parameter corresponding to the motion state.

[0020] According to the first aspect, or any one of the implementations of the first aspect, the method further includes: the first electronic device sending the state of the first electronic device to the second electronic device. In this way, the first electronic device and the second electronic device can notify the state of themselves to the opposite end, so that the opposite end can adjust the configuration parameter accordingly.

[0021] According to a second aspect, when the program instructions are executed by the processor, the first electronic device is caused to perform the following steps: in response to the received first user operation, sending a connection request message to the second electronic device; in response to a response message sent by the second electronic device, establishing a wireless connection with the second electronic device; and sending a data packet containing an image frame to the second electronic device through the wireless connection.

[0022] According to the second aspect, or any one of the implementations of the second aspect, if the state of the first electronic device is the motion state, the wireless connection configuration parameter comprises at least one of the following: the number of retransmissions of the data packet is N, and the MIMO mode is a diversity mode; N is an integer greater than 0.

[0023] According to the second aspect, or any one of the implementations of the second aspect, if the state of the first electronic device is the motion state, the wireless connection configuration parameter comprises at least one of the following: the number of retransmissions of the data packet is N, and the MIMO mode is a diversity mode; N is an integer greater than 0.

[0024] According to the second aspect, or any one of the implementations of the second aspect, if the state of the first electronic device is the motion state, the wireless connection configuration parameter comprises at least one of the following: the number of retransmissions of the data packet is N, and the MIMO mode is a diversity mode; N is an integer greater than 0.

[0025] According to the second aspect, or any one of the implementations of the second aspect, if the state of the first electronic device is the motion state, the wireless connection configuration parameter comprises at least one of the following: the number of retransmissions of the data packet is N, and the MIMO mode is a diversity mode; N is an integer greater than 0.

[0026] According to the second aspect, or any one of the implementations of the second aspect, when the program instructions are executed by the processor, the first electronic device is caused to perform the following steps: in response to the received first user operation, sending a connection request message to the second electronic device; in response to a response message sent by the second electronic device, establishing a wireless connection with the second electronic device; and sending a data packet containing an image frame to the second electronic device through the wireless connection.

[0027] According to the second aspect, or any one of the implementations of the second aspect, if the state of the first electronic device is the motion state, the wireless connection configuration parameter comprises at least one of the following: the number of retransmissions of the data packet is N, and the MIMO mode is a diversity mode; N is an integer greater than 0.

[0028] According to the second aspect, or any one of the implementations of the second aspect, if the state of the first electronic device is the motion state, the wireless connection configuration parameter comprises at least one of the following: the number of retransmissions of the data packet is N, and the MIMO mode is a diversity mode; N is an integer greater than 0.

[0029] According to a second aspect, or any possible implementation mode of the second aspect, if the state of the first electronic device is the motion state, the coding strategy of the first electronic device comprises: setting the image buffer size as C1.

[0030] According to the second aspect, or any possible implementation mode of the second aspect, if the state of the first electronic device is the static state, the coding strategy of the first electronic device comprises: setting the image buffer size as C2; wherein C2 is less than C1.

[0031] According to the second aspect, or any possible implementation mode of the second aspect, when the program instruction is executed by the processor, the first electronic device performs the following steps: sending the state of the first electronic device to the second electronic device.

[0032] According to the second aspect, or any possible implementation mode of the second aspect, when the program instruction is executed by the processor, the first electronic device performs the following steps: receiving the state of the second electronic device sent by the second electronic device; wherein the state of the second electronic device is the motion state or the static state; if the state of the second electronic device is the motion state, adjusting the configuration parameter of the first electronic device to the target configuration parameter corresponding to the motion state.

[0033] The second aspect and any possible implementation mode of the second aspect correspond to the first aspect and any possible implementation mode of the first aspect respectively. The technical effects corresponding to the second aspect and any possible implementation mode of the second aspect can refer to the technical effects corresponding to the first aspect and any possible implementation mode of the first aspect, which will not be described here.

[0034] The third aspect, the embodiments of the present application provide a computer readable medium for storing a computer program, the computer program comprising instructions for executing the method in the second aspect or any possible implementation mode of the second aspect.

[0035] The third aspect and any possible implementation mode of the third aspect correspond to the first aspect and any possible implementation mode of the first aspect respectively. The technical effects corresponding to the third aspect and any possible implementation mode of the third aspect can refer to the technical effects corresponding to the first aspect and any possible implementation mode of the first aspect, which will not be described here.

[0036] The fourth aspect, the embodiments of the present application provide a computer program, the computer program comprising instructions for executing the method in the second aspect or any possible implementation mode of the second aspect.

[0037] The fourth aspect and any kind of implementation manner of the fourth aspect correspond to the first aspect and any kind of implementation manner of the first aspect respectively. The technical effects corresponding to the fourth aspect and any kind of implementation manner of the fourth aspect can refer to the technical effects corresponding to the first aspect and any kind of implementation manner of the first aspect, which will not be described herein again.

[0038] In the fifth aspect, an embodiment of the present application provides a chip, which comprises processing circuitry and transceiver pins. The transceiver pins and the processing circuitry communicate with each other through internal connection paths. The processing circuitry executes the method in the first aspect or any possible implementation manner of the first aspect to control the receiving pins to receive signals and control the sending pins to send signals.

[0039] In the sixth aspect, an embodiment of the present application provides a communication system, which comprises the first electronic device and the second electronic device in the first aspect and any kind of implementation manner of the first aspect. BRIEF DESCRIPTION OF DRAWINGS

[0040] Figure 1a An application scenario schematic diagram is exemplarily shown;

[0041] Figure 1b A multi-screen cooperation scenario schematic diagram is exemplarily shown;

[0042] Figure 2 A hardware structure schematic diagram of an electronic device is exemplarily shown;

[0043] Figure 3 A connection schematic diagram of a mobile phone and a tablet is exemplarily shown;

[0044] Figure 4 A connection schematic diagram of a mobile phone and a tablet is exemplarily shown;

[0045] Figure 5 A user interface schematic diagram is exemplarily shown;

[0046] Figure 6 A flowchart of data interaction between a mobile phone and a tablet is exemplarily shown;

[0047] Figure 7 A GOP schematic diagram is exemplarily shown;

[0048] Figure 8 A data packet format schematic diagram is exemplarily shown;

[0049] Figure 9 A data transmission schematic diagram of a mobile phone and a tablet is shown;

[0050] Figure 10 A software structure schematic diagram of an electronic device is exemplarily shown;

[0051] Figure 11 An exemplary diagram of module interaction is shown.

[0052] Figure 12 An exemplary diagram of configuration flow of the sending end is shown.

[0053] Figure 13 An exemplary diagram of communication in diversity mode is shown.

[0054] Figure 14a An exemplary diagram of feedback frame loss statistics is shown.

[0055] Figure 14b An exemplary diagram of adjusting encoding strategy is shown.

[0056] Figure 15a An exemplary diagram of another feedback frame loss statistics is shown.

[0057] Figure 15b An exemplary diagram of data packet transmission is shown.

[0058] Figure 16 An exemplary diagram of configuration flow of the sending end is shown.

[0059] Figure 17 An exemplary diagram of communication in multiplex mode is shown.

[0060] Figure 18 An exemplary diagram of configuration flow of the receiving end is shown.

[0061] Figure 19 An exemplary diagram of module interaction flow is shown.

[0062] Figure 20 An exemplary diagram of configuration flow of the receiving end is shown.

[0063] Figures 21a-21b An exemplary diagram of interaction between the mobile phone and the tablet is shown.

[0064] Figure 22 An exemplary diagram of structure of the device is shown. DETAILED DESCRIPTION

[0065] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all the embodiments of the present application. Based on the embodiments in the present application, all the other embodiments obtained by those skilled in the art without creative work fall within the scope of protection of the present application.

[0066] The term "and / or", as used herein, merely describes association between associated objects, and can exist in three forms: for example, A and / or B can mean: A alone, both A and B, or B alone.

[0067] The terms "first" and "second" and the like in the specification and claims of the present application are used to distinguish different objects, and are not used to describe a specific order of the objects. For example, the first target object and the second target object are used to distinguish different target objects, and are not used to describe a specific order of the target objects.

[0068] In the embodiments of the present application, the words "exemplary" or "for example" are used to mean serving as an example, instance, or illustration. Any embodiment or design presented as "exemplary" or "for example" in the embodiments of the present application should not be construed as being superior or more advantageous than other embodiments or design solutions. Rather, the use of "exemplary" or "for example" is intended to present concepts in a concrete manner.

[0069] In the description of the embodiments of the present application, unless otherwise specified, "a plurality of" means two or more. For example, a plurality of processing units means two or more processing units; a plurality of systems means two or more systems.

[0070] Before the technical solutions of the embodiments of the present application are described, the application scenarios of the embodiments of the present application will first be described in conjunction with the accompanying drawings. Figure 1a An application scenario is shown by way of example. The application scenario includes a mobile phone and a tablet. It should be noted that, Figure 1a The number of electronic devices (mobile phone and tablet) in the application scenario is only illustrative, and the present application does not limit this.

[0071] In the description of the embodiments of the present application, the screen projection scenario between the mobile phone and the tablet is taken as an example for description. Exemplarily, in the screen projection scenario, the communication connection between the mobile phone and the tablet can be a P2P (peer-to-peer) connection. In other embodiments, the technical solutions in the embodiments of the present application can also be applied to other application scenarios between the mobile phone and the tablet, for example, can be Huawei Share, multi-screen collaboration scenario, etc., and the present application does not limit this. Correspondingly, for different scenarios, the connection between the mobile phone and the tablet can be based on different protocols. As described above, in the embodiments of the present application, the communication connection between the mobile phone and the tablet is maintained through the P2P protocol. In other embodiments, the communication connection between the mobile phone and the tablet can also be maintained based on other wireless communication protocols, and the present application does not limit this. Exemplarily, in the screen projection scenario based on the P2P connection, the mobile phone and the tablet can also be referred to as the sending end and the receiving end in the screen projection scenario, or can also be referred to as P2P devices.

[0072] Exemplary, Figure 1b The schematic diagram of the multi-screen cooperation scene is shown by way of example. Please refer to Figure 1b Exemplary, the mobile phone and the notebook computer perform multi-screen cooperation, and the communication connection between the mobile phone and the notebook computer can be maintained based on a wireless communication protocol, for example, can be a P2P protocol. The mobile phone can serve as a sending end and send an image frame to the notebook computer, the image in the image frame corresponding to the interface currently displayed by the mobile phone. So that the image corresponding to the interface currently displayed by the mobile phone can be displayed in the multi-screen cooperation interface on the notebook computer.

[0073] It should be noted that, Figure 1a and Figure 1b The scene shown in the figure is only illustrative. In other embodiments, the technical solutions in the embodiments of the present application can also be applied to the screen projection scene, sharing scene, multi-screen cooperation scene, etc. between the mobile phone, tablet computer, notebook computer, wearable device, etc. and the television, vehicle-mounted device, etc.

[0074] Figure 2 The structural schematic diagram of the electronic device 100 is shown. It should be understood that, Figure 2 The electronic device 100 shown in the figure is only an example of the electronic device, and the electronic device 100 can have more or fewer components than those shown in the figure, can combine two or more components, or can have a different component configuration. Figure 2 The various components shown in the figure can be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and / or application specific integrated circuits. It should be noted that, Figure 2 The electronic device in the embodiment can be Figure 1a The mobile phone or tablet computer in the embodiment, or Figure 1b The mobile phone or notebook computer in the embodiment, of course, can also be an electronic device involved in other application scenarios, which is not limited in the present application.

[0075] The electronic device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, an IMU (Inertial measurement unit) module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0076] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices, or can be integrated in one or more processors.

[0077] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of fetching and executing instructions.

[0078] The processor 110 can also include a memory that stores instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The cache memory can hold instructions or data that the processor 110 has recently used or is likely to use again. If the processor 110 needs to use the instructions or data again, it can be retrieved directly from the cache memory. This avoids repeated accesses to the main memory, reducing the latency of the processor 110 and thus improving the efficiency of the system.

[0079] In some embodiments, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0080] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 can include multiple sets of I2C buses. The processor 110 can be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example, the processor 110 can be coupled to the touch sensor 180K through an I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface and implement the touch function of the electronic device 100.

[0081] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple sets of I2S buses. The processor 110 can be coupled to the audio module 170 through the I2S bus, enabling communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can deliver audio signals to the wireless communication module 160 through the I2S interface, enabling the function of answering a phone call through a Bluetooth headset.

[0082] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 can be coupled with the wireless communication module 160 through a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 through the PCM interface, realizing the function of answering a phone call through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0083] The UART interface is a universal serial bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is usually used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface, realizing the Bluetooth function. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface, realizing the function of playing music through a Bluetooth headset.

[0084] The MIPI interface can be used to connect the processor 110 and peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes the camera serial interface (CSI), the display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface, realizing the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate through the DSI interface, realizing the display function of the electronic device 100.

[0085] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 and the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0086] The USB interface 130 is an interface that meets the USB standard specification, which can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transmit data between the electronic device 100 and peripheral devices. It can also be used to connect a headset to play audio through the headset. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0087] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a structural limitation of the electronic device 100. In some other embodiments of the present application, the electronic device 100 can also use different interface connection modes or a combination of multiple interface connection modes in the above embodiments.

[0088] The charging management module 140 is configured to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input through a wireless charging coil of the electronic device 100. The charging management module 140 can charge the battery 142 and also supply power to the electronic device through the power management module 141.

[0089] The power management module 141 is configured to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to supply power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be configured to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), and the like. In some other embodiments, the power management module 141 can also be arranged in the processor 110. In some other embodiments, the power management module 141 and the charging management module 140 can also be arranged in the same device.

[0090] The wireless communication function of the electronic device 100 can be realized through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.

[0091] The antenna 1 and the antenna 2 are configured to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0092] The mobile communication module 150 can provide a solution for wireless communication including 2G / 3G / 4G / 5G, etc. applied to the electronic device 100. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform filtering, amplification, etc. on the received electromagnetic waves, and transfer to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor, and radiate as electromagnetic waves through the antenna 1. In some embodiments, at least part of the function modules of the mobile communication module 150 can be disposed in the processor 110. In some embodiments, at least part of the function modules of the mobile communication module 150 can be disposed in the same device as at least part of the modules of the processor 110.

[0093] The modem processor can include a modulator and a demodulator. The modulator is configured to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is configured to demodulate a received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal processed by the baseband processor is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the microphone 170B, etc.), or displays an image or a video through the display screen 194. In some embodiments, the modem processor can be a separate device. In other embodiments, the modem processor can be independent of the processor 110, and disposed in the same device as the mobile communication module 150 or other function modules.

[0094] The wireless communication module 160 can provide a solution for wireless communication including wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc. applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives an electromagnetic wave via the antenna 2, frequency-modulates and filters the electromagnetic wave signal, and transmits the processed signal to the processor 110. The wireless communication module 160 can also receive a signal to be transmitted from the processor 110, frequency-modulate it, amplify it, and radiate it as an electromagnetic wave via the antenna 2.

[0095] In some embodiments, the antenna 1 and the mobile communication module 150 of the electronic device 100 are coupled, and the antenna 2 and the wireless communication module 160 are coupled, so that the electronic device 100 can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include a global positioning system (GPS), a global navigation satellite system (GLONASS), a beidu navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and / or a satellite based augmentation systems (SBAS).

[0096] The electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs, which execute program instructions to generate or change display information.

[0097] The display screen 194 is configured to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diodes (QLED), or the like. In some embodiments, the electronic device 100 can include one or N display screens 194, where N is a positive integer greater than 1.

[0098] The electronic device 100 can implement the photographing function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor.

[0099] The ISP is configured to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing to convert it into an image visible to the naked eye. The ISP can also optimize the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature, and other parameters of the shooting scene. In some embodiments, the ISP can be disposed in the camera 193.

[0100] The camera 193 is configured to capture still images or videos. An object generates an optical image through a lens and projects it onto a photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then transmitted to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, the electronic device 100 can include one or N cameras 193, where N is a positive integer greater than 1.

[0101] The digital signal processor is used to process digital signals, in addition to being able to process digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0102] The video codec is used to compress or decompress digital video. The electronic device 100 can support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.

[0103] The NPU is a neural-network (NN) calculation processor, which can quickly process input information by drawing on the structure of a biological neural network, such as drawing on the transmission mode between human brain neurons, and can also constantly self-learn. Through the NPU, the electronic device 100 can realize intelligent cognition applications such as image recognition, face recognition, voice recognition, text understanding, etc.

[0104] The external memory interface 120 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external storage card communicates with the processor 110 through the external memory interface 120 to realize data storage functions. For example, music, video, etc. Files are saved in the external storage card.

[0105] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various function applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0106] The electronic device 100 can realize audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor, etc. For example, music playing, recording, etc.

[0107] The audio module 170 is configured to convert digital audio information into an analog audio signal output, and to convert an analog audio input into a digital audio signal. The audio module 170 can also be configured to encode and decode audio signals. In some embodiments, the audio module 170 can be disposed in the processor 110, or some of the functional modules of the audio module 170 can be disposed in the processor 110.

[0108] The speaker 170A, also referred to as a "loudspeaker", is configured to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0109] The receiver 170B, also referred to as a "earpiece", is configured to convert an audio electrical signal into a sound signal. When the electronic device 100 receives a call or a voice message, the user can listen to the voice by holding the receiver 170B close to the ear.

[0110] The microphone 170C, also referred to as a "microphone", "transducer", is configured to convert a sound signal into an electrical signal. When making a call or sending a voice message, the user can speak into the microphone 170C by holding the mouth close to the microphone 170C, and input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, in addition to collecting sound signals, the noise reduction function can also be realized. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C, in addition to collecting sound signals, noise reduction, it can also identify the source of the sound, realize the function of directional recording, etc.

[0111] The earphone interface 170D is configured to connect a wired earphone. The earphone interface 170D can be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0112] The IMU module 180 is configured to acquire IMU pose information of the electronic device. For example, the IMU module 180 can include an acceleration sensor and a gyroscope sensor. For example, the gyroscope sensor can be configured to determine a motion pose of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y and z axes) can be determined by the gyroscope sensor. The acceleration sensor can detect the magnitude of the acceleration of the electronic device 100 in three axes (i.e., x, y and z axes). The magnitude and direction of gravity can be detected when the electronic device 100 is stationary. It should be noted that in the embodiments of the present application, the IMU module integrated in the electronic device can be a 6-axis IMU module. In other embodiments, the electronic device can also integrate a 9-axis IMU module, which includes a gyroscope sensor (which can acquire angular velocity in x, y and z axes), an acceleration sensor (which can acquire acceleration in x, y and z axes) and a magnetometer (which can acquire direction in x, y and z axes). The present application does not make any limitation.

[0113] In combination with the application scenarios shown in the foregoing embodiments, Figure 1a Figure 3 The connection between the mobile phone and the tablet is schematically shown. Please refer to Figure 3 For example, the mobile phone and the tablet establish a Wi-Fi connection to exchange data through the Wi-Fi connection. As described above, the Wi-Fi connection between the mobile phone and the tablet is taken as an example to illustrate the maintenance of the P2P protocol in the embodiments of the present application. For example, the process of establishing a P2P connection between the mobile phone and the tablet can be divided into three parts:

[0114] The first part is device discovery. Specifically, in the device discovery stage, the mobile phone and the tablet can discover other P2P-enabled devices around them through searching. For example, the mobile phone can discover a P2P-enabled tablet around it through searching. Similarly, the tablet can also discover a P2P-enabled mobile phone around it through searching.

[0115] The second part is the establishment of a group between the mobile phone and the tablet. Specifically, taking the mobile phone as an example, after discovering a P2P-enabled tablet around it, the mobile phone can establish a P2P group with the tablet and negotiate who will play the role of GO (Group Owner) and who will play the role of Client (member, which can also be referred to as group member).

[0116] ​For example, the GO functions like an access point (AP), also known as a base station, in a basic service set (BSS), and the client functions like a station (STA) in the BSS. The station refers to a terminal device (electronic device) with Wi-Fi communication function and connected to a wireless network, such as a mobile phone, a tablet computer, a notebook computer, and the like. The station can support multiple wireless local area network (WLAN) standards of the 802.11 family, such as 802.11be, 802.11ax, 802.11ac, 802.11n, 802.11g, 802.11b, and 802.11a.

[0117] The access point can be a terminal device (such as a mobile phone) or a network device (such as a router) with a Wi-Fi chip. For example, the access point can be a device supporting the 802.11be standard. The access point can also be a device supporting multiple WLAN standards of the 802.11 family, such as 802.11be, 802.11ax, 802.11ac, 802.11n, 802.11g, 802.11b, and 802.11a.

[0118] It should be noted that the electronic devices in the embodiments of the present application are generally terminal products supporting the 802.11 series standards. In the evolution process from 802.11a to 802.11g, 802.11n, 802.11ac, and 802.11ax, the available frequency bands include 2.4 gigahertz (GHz) and 5 GHz. With more and more open frequency bands, the maximum channel bandwidth supported by 802.11 has been expanded from 20 megahertz (MHz) to 40 MHz and then to 160 MHz. In 2017, the federal communications commission (FCC) opened a new free frequency band of 6 GHz (5925-7125 MHz), and the 802.11ax standard workers extended the working range of 802.11ax devices from 2.4 GHz and 5 GHz to 2.4 GHz, 5 GHz, and 6 GHz in the project authorization requests (PAR) of the 802.11ax project. In the embodiments of the present application, only the working of the electronic devices at 2.4 GHz and 5 GHz is taken as an example for description, and the embodiments of the present application are also applicable to the screen projection scenario between devices supporting the next generation communication protocol (such as 802.11be).

[0119] The third part, the mobile phone and the tablet establish a P2P connection path. Specifically, after the GO and the Client are determined by the mobile phone and the tablet, the GO (for example, the tablet) can initiate a P2P connection path establishment process to the Client (for example, the mobile phone), and the tablet and the mobile phone can successfully establish a P2P connection path, and data interaction can be performed on the path. It should be noted that the GO can be a sending end (for example, a mobile phone) in a screen projection scene, or a receiving end (for example, a tablet) in a screen projection scene, which is not limited by the present application.

[0120] The P2P connection establishment process between the mobile phone and the tablet will be briefly described below in conjunction with the flowchart shown in the figure. Please refer to Figure 4 Figure 4 , specifically including:

[0121] S401, the mobile phone starts a screen projection application.

[0122] Exemplarily, Figure 5 The user interface shown in the figure is exemplary, please refer to Figure 5 (1), the display interface of the mobile phone can include one or more controls, including but not limited to: application icon control, power control, network control, etc. The user can click the setting icon control to enter the setting interface. Please refer to Figure 5 (2), the mobile phone displays the setting interface in response to the received user operation. Exemplarily, the setting interface includes one or more options, including but not limited to: WLAN setting option, Bluetooth setting option, mobile network setting option, and more connection setting option, etc. Exemplarily, the user can click the more connection setting option. Please refer to Figure 5 (3), exemplarily, the mobile phone displays the more connection setting interface in response to the user operation. Exemplarily, the more connection setting interface includes one or more options, including but not limited to: NFC setting option, HUAWEI Beam setting option, Huawei Share setting option, and mobile phone projection option, etc. Exemplarily, the user can click the mobile phone projection setting option. Please refer to Figure 5 (4), exemplarily, the mobile phone displays the mobile phone projection setting interface in response to the received user operation. The mobile phone projection setting interface includes one or more controls, including but not limited to: unlimited projection setting option and available device list. Exemplarily, in the case where the unlimited projection setting option is not started, the user can manually click to start, after starting, the mobile phone can automatically search for available P2P devices around, and display the device name of the searched P2P device in the available device list, for example Figure 5 (4) shown in the figure. The user can click the P2P device displayed in the available device list to instruct the mobile phone to project to the selected tablet.

[0123] ​S402, the mobile phone sends a probe request message to the tablet.

[0124] For example, the mobile phone sends a probe request message to the tablet to request communication with the tablet. For example, the mobile phone can send a probe request message on the 1st, 6th, and 11th channels of the 2.4 GHz frequency band, respectively. It should be noted that the P2P connection establishment process in the 2.4 GHz frequency band is taken as an example for description in the embodiments of the present application. In other embodiments, the P2P connection can also work in other frequency bands, which is not limited in the present application.

[0125] S403, the tablet sends a probe response message to the mobile phone.

[0126] For example, the tablet receives a probe request message on any one of the 1st, 6th, and 11th channels, and selects one of the channels on which the probe request message is received, and sends a probe response message to the mobile phone on the selected channel (for example, the 6th channel).

[0127] S404, the mobile phone sends a GO negotiation request message to the tablet.

[0128] For example, the mobile phone sends a GO negotiation request message to the tablet on the 6th channel in response to the received probe response message from the tablet.

[0129] S405, the tablet sends a GO negotiation response message to the mobile phone.

[0130] For example, the tablet sends a GO negotiation response message to the mobile phone on the 6th channel in response to the received GO negotiation request message from the mobile phone.

[0131] S406, the mobile phone sends a GO confirm message to the tablet.

[0132] It should be noted that the three frame exchanges of S404-S406 are used to interact information to determine the GO and the Client, and the information interacted in the three frame exchanges includes but is not limited to the MAC address of the GO, the Group ID, and the like. In the description of the embodiments of the present application, the tablet is taken as the GO and the mobile phone is taken as the Client as an example for description.

[0133] S407, the tablet sends a Beacon message to the mobile phone.

[0134] For example, after the tablet and the mobile phone complete group establishment, the tablet as a GO terminal can send a Beacon message (broadcast message) (also referred to as a Beacon frame) to establish a screen projection channel with other devices on a 2.4 GHz frequency band.

[0135] For example, the tablet sends a Beacon message on channel 3 of the 2.4 GHz frequency band.

[0136] S408, the mobile phone and the tablet perform link authentication association.

[0137] For example, after the mobile phone listens to the Beacon message sent by the tablet on channel 3, the mobile phone and the tablet perform a link authentication association process, in which multiple frame exchanges are required to exchange MAC address information, encryption methods, and supported channel sets.

[0138] S409, the mobile phone and the tablet perform a 4-way handshake.

[0139] For example, after the mobile phone and the tablet perform the 4-way handshake, a 2.4 GHz channel (i.e., a P2P connection) is successfully established on channel 3. It should be noted that Figure 5 S402-S409 in the above are only illustrative examples, and the process of establishing a 2.4 GHz channel between the mobile phone and the tablet can include fewer or more frame interaction processes than Figure 5 in the above, the information, format, and role of each frame can be referred to the description in the existing standard, and will not be described herein.

[0140] S410, the mobile phone and the tablet perform data transmission.

[0141] For example, as described above, after the mobile phone and the tablet establish a P2P connection, the mobile phone can project a screen to the tablet, i.e., send an image frame to the tablet to display a corresponding image on the tablet.

[0142] Figure 6 For example, the above is a flowchart of data interaction between the mobile phone and the tablet. Please refer to Figure 6For example, the screen projection application of the mobile phone can generate an image that needs to be projected onto the tablet and output the image to an image processing module in the application framework layer for processing. The image processing module can perform rendering, cropping, and other processing on the image and output the processed image to a codec (also referred to as a coding module). The codec encodes the image to generate an image frame. The kernel can perform data processing on the image frame, for example, the processing process includes but is not limited to: data packet encapsulation, encryption, TCP (Transmission Control Protocol) / UDP (User Datagram Protocol) protocol layer encapsulation, IP (Internet Protocol) protocol layer encapsulation, to obtain an encapsulated data packet. For example, the Wi-Fi driver can send the data packet to the tablet based on a P2P connection between the mobile phone and the tablet.

[0143] Please continue to refer to Figure 6 For example, the Wi-Fi driver of the tablet processes the received data packet by the kernel, and the kernel performs data processing on the data packet, including but not limited to: IP protocol layer decapsulation, TCP / UDP protocol layer decapsulation, decryption, data packet decapsulation, and other processing. The codec decodes the data obtained after decapsulation (i.e., the image frame described above) to obtain a corresponding image. The codec outputs the image to the image processing module, and the image processing module performs image processing on the image, for example, rendering and other operations can be performed, and the processed image is output to the screen projection application. The screen projection application can display the corresponding image in the display interface of the tablet. It should be noted that, Figure 6 The specific details of each step in Figure 6 The specific details of each step in

[0144] As described above, in the screen projection process, the mobile phone transmits an image frame to the tablet to enable the tablet to display a corresponding image. To enable those skilled in the art to better understand the image frame transmission method in the embodiments of the present application, before describing the specific transmission method, first, the related concepts of the image frame are briefly introduced. As described above, after the codec obtains an image, the image can be encoded to improve the compression ratio. The encoding method can include but is not limited to: H.264 or HEVC (High Efficiency Video Coding) and the like.

[0145] The encoded multiple image frames can constitute a GOP (Group of Pictures). Alternatively, the GOP can include one or more I frames, and one or more B frames and P frames. Figure 7A schematic diagram of a GOP is shown as an example, refer to Figure 7 For example, a GOP includes frames I1, B1, B2, P1, B3, B4, P2, B5, B6, I2, B7, B8, and P3. It should be noted that... Figure 7 The types, number, and order of image frames in a GOP are merely illustrative examples and are not intended to limit the scope of this application.

[0146] Continue to refer to Figure 7 For example, an I-frame can be called a complete frame or an independently decoded frame, meaning that an I-frame can be decoded independently without relying on other frames. Typically, the first frame of a Group of Pictures (GOP) is an I-frame. B-frames and P-frames can be called inter-frame prediction frames. Decoding a B-frame depends on its nearest preceding or following I-frame or P-frame. For example, B1 requires I1 and P1 frames for decoding. Similarly, P-frames depend on their nearest preceding I-frame or P-frame for decoding. For example, P1 requires I1, and P2 requires P1. Since inter-frame prediction frames all depend on preceding or following frames for decoding, if an I-frame or P-frame in a GOP is lost during transmission, frames that depend on I-frames and P-frames for decoding, as well as subsequent frames, will not be decoded correctly, resulting in a distorted or degraded picture quality on the television screen. If a B-frame in a GOP is lost, the corresponding image will be missing, causing the screen to freeze.

[0147] For example, as described above, after the codec encodes the image to obtain image frames, the kernel can encapsulate the image frames to obtain data packets. For example, during the kernel's encapsulation of image frames, multiple image frames can be encapsulated into one data packet. It should be noted that in other embodiments, the mobile phone can encapsulate one image frame into one data packet, or it can encapsulate one image frame into multiple data packets; this application does not limit this.

[0148] Figure 8 This is a schematic diagram illustrating the format of a data packet as an example. Please refer to... Figure 8 For example, a data packet includes fields such as a frame control field, a frame body field, and a CRC (Cyclic Redundancy Check) field. The control field may include indication information, such as address information and data packet type information. The frame body field may include data such as image frames. It should be noted that... Figure 8 The names and positions of the fields in this application are merely illustrative examples and are not intended to limit the scope of the application.

[0149] Figure 9 The diagram shown illustrates data transfer between a mobile phone and a tablet. Figure 9, exemplary, the process of the mobile phone sending data packets containing image frames to the tablet through P2P connection, assuming that the image frames sent by the mobile phone to the tablet include: I frame, P frame, P frame, P frame and I frame, and each frame is encapsulated into a data packet. Exemplary, in the application scenario of the embodiments of the present application, for example, mobile phone and tablet or mobile phone, if the user walks with the mobile phone and tablet, the mobile phone and tablet are in a motion state. Due to the motion of the device, the wireless channel condition between the mobile phone and the tablet will change rapidly, resulting in delay and jitter of screen projection data transmission, resulting in frame loss. For example, as shown in Figure 9 , in the process of the mobile phone sending multiple data packets to the tablet, one of the data packets carrying the P frame is lost, and the image frames received by the tablet are: I frame, P frame, P frame, I frame. Exemplary, if the lost P frame is lost, since the tablet does not receive the P frame, the decoding of the subsequent P frame will fail (for details, please refer to Figure 7 the related description of image frame decoding), the tablet will have problems such as freezing or reduced picture quality (such as screen flashing).

[0150] The embodiments of the present application provide a communication method, which can effectively enhance the stability of data transmission. The robustness of data transmission of the device in a motion state during data interaction can be improved, the probability of screen projection frame loss, freezing and other problems can be reduced, the picture display quality of the receiving end can be improved, and the user experience can be further improved. Figure 10 The software structure of the electronic device is exemplarily shown. Please refer to Figure 10 , exemplary, the software system of the electronic device can adopt layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. The embodiments of the present application take the Android system with layered architecture as an example to exemplarily explain the software structure of the electronic device.

[0151] The layered architecture of the electronic device divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, the application layer, the application framework layer, the Android runtime and the system library, and the kernel layer.

[0152] The application layer can include a series of application packages. For example, Figure 10As shown, the application package can include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, screen projection, identification, arbitration, and the like. In an example embodiment, the screen projection application can support screen projection of the electronic device. The identification application (also referred to as an identification module) can be used to call parameters detected by the IMU module to identify whether the electronic device is in a motion state or a stationary state. The arbitration application (also referred to as an arbitration module) can be used to adjust configuration parameters based on the identification result of the identification module.

[0153] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications of the application layer. The application framework layer includes some pre-defined functions.

[0154] As shown, the application framework layer can include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, a codec module (also referred to as a codec), and the like. Figure 10

[0155] The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, and take a screenshot, and the like.

[0156] The content provider is used to store and obtain data, and make the data accessible to the applications. The data can include videos, images, audios, dialed and received calls, browsing history and bookmarks, phone books, and the like.

[0157] The view system includes visual controls, such as a control for displaying text, a control for displaying pictures, and the like. The view system can be used to build an application. A display interface can be composed of one or more views. For example, a display interface including a short message notification icon can include a view for displaying text and a view for displaying pictures.

[0158] The phone manager is used to provide communication functions of the electronic device. For example, management of call states (including call connection, call hang-up, and the like).

[0159] The resource manager provides various resources for the applications, such as localized strings, icons, pictures, layout files, video files, and the like.

[0160] ​The notification manager enables applications to display notification information in the status bar, which can be used to convey a message of the notification type, which can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify the completion of the download, message reminders, etc. The notification manager can also be a notification that appears in the form of a chart or a scroll bar text in the top status bar of the system, such as a notification of an application running in the background, and can also be a notification that appears in the form of a dialog window on the screen. For example, the status bar prompts text information, emits a prompt sound, the electronic device vibrates, the indicator light flashes, etc.

[0161] The codec can support one or more video codecs that can encode or decode images. In this way, the electronic device can play or record videos in multiple encoding formats.

[0162] The Android Runtime includes a core library and a virtual machine. The Android runtime is responsible for scheduling and managing the Android system.

[0163] The core library contains two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.

[0164] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the java file of the application layer and the application framework layer into a binary file. The virtual machine is used to perform the management of the object life cycle, the management of the stack, the management of the thread, the management of the security and the exception, and the garbage collection, etc.

[0165] The system library can include multiple functional modules. For example: surface manager, media library, three-dimensional graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc.

[0166] The surface manager is used to manage the display subsystem, and provides a fusion of 2D and 3D layers for multiple applications.

[0167] The media library supports multiple commonly used audio, video format playback and recording, and static image files, etc. The media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0168] The three-dimensional graphics processing library is used to realize three-dimensional graphics drawing, image rendering, synthesis, and layer processing, etc.

[0169] The 2D graphics engine is a drawing engine for 2D drawing.

[0170] The kernel layer is the layer between hardware and software. The kernel layer includes at least display drivers, camera drivers, audio drivers, Wi-Fi drivers, Bluetooth drivers, and IMU drivers.

[0171] Understandable Figure 10 The components included in the system framework layer, system library, and runtime layer shown do not constitute a specific limitation on the electronic device. In other embodiments of this application, the electronic device may include more or fewer components than shown, or combine some components, or split some components, or have different component arrangements.

[0172] Combination Figure 1a The following describes the technical solutions in this application embodiment using the screen mirroring scenario between a mobile phone and a tablet as an example. Figure 11 This is a schematic diagram illustrating module interaction as an example. Please refer to... Figure 11 For example, after the mobile phone establishes a P2P connection with the tablet in response to a user's operation, the mobile phone, as the sender, sends image data to the tablet (i.e., the receiver), that is, it sends data packets containing image frames. A detailed description can be found above, and will not be repeated here.

[0173] The following is combined with Figure 11 This section explains the processing flow on the mobile device (i.e., the sending end). Please refer to [link / reference]. Figure 11 For example, after the screen mirroring application starts, it can start (i.e., call) the arbitration module and the recognition module. After the recognition module starts, it obtains the IMU module (e.g., from the IMU driver) from the IMU driver. Figure 2 The IMU module 180 detects parameters (or information). The identification module can detect the state of the electronic device based on the acquired parameters. The state includes: a moving state or a stationary state. For example, the identification module can set a corresponding motion state threshold. For instance, if the parameters acquired by the identification module are greater than or equal to the motion state threshold, it can be determined that the electronic device is in motion. If the parameters acquired by the identification module are less than the motion state threshold, it can be determined that the electronic device is in a stationary state.

[0174] For example, the IMU driver can acquire parameters detected by the IMU module in real time. Optionally, the IMU driver can periodically send the acquired parameters to the recognition module. Optionally, the recognition module can periodically request parameters acquired by the IMU driver from the IMU driver.

[0175] Optionally, the identification module can further obtain the MIMO condition number from the Wi-Fi driver. The identification module can determine the state of the electronic device based on the parameters detected by the IMU module and the MIMO condition number, to prevent misjudgment. For example, the jitter range of the MIMO condition number can be used to indicate the motion state of the electronic device. For example, if the jitter range of the MIMO condition number (which can be set according to actual needs, and is not limited in the present application) is small, the identification module can determine that the electronic device is in a motion state. If the jitter range of the MIMO condition number is small, it can be determined that the electronic device is in a stationary state. For example, the identification module can combine the determination result based on the parameters input by the IMU module and the determination result based on the MIMO condition number to determine whether the electronic device is in a motion state. Optionally, in the embodiment of the present application, if the identification module determines that the electronic device is in a motion state based on any parameter, it can be determined that the electronic device is in a motion state. For example, if the identification module determines that the electronic device is in a stationary state based on the parameters input by the IMU module, and determines that the electronic device is in a motion state based on the MIMO condition number, the identification module determines that the electronic device is in a motion state.

[0176] Please continue to refer to Figure 11 For example, the identification module outputs the identification result (including the motion state or the stationary state) to the arbitration module. The arbitration module can determine whether the current electronic device is in a motion state or a stationary state based on the identification result input by the identification module.

[0177] Optionally, the arbitration module can continue to monitor the identification result input by the identification module in one or more subsequent cycles to determine the state of the electronic device when the state of the electronic device changes, for example, the identification result obtained from the identification module in the previous cycle indicates that the electronic device is in a motion state, and the identification result obtained from the identification module in the current cycle indicates that the electronic device is in a stationary state. For example, after the arbitration module obtains the identification result in the current cycle indicating that the electronic device is in a stationary state, the arbitration module can further obtain the identification result input by the identification module in the next cycle. If the identification result input by the identification module in the next cycle indicates that the electronic device is in a stationary state, the arbitration module can determine that the electronic device is in a stationary state. If the identification result input by the identification module in the next cycle indicates that the electronic device is in a motion state, the arbitration module can determine that the electronic device is still in a motion state.

[0178] Still referring to Figure 11 For example, after the arbitration result determines the current state of the electronic device (including the motion state or the stationary state), the configuration information of the codec module and / or the configuration information of the Wi-Fi driver can be adjusted based on the current state of the electronic device.

[0179] Figure 12The configuration flowchart of the sending terminal (i.e., the mobile phone) is shown as an example. Please refer to Figure 12 For example, the user holds the mobile phone and walks upstairs (or rides a bike, runs, drives (for example, in a car or on a high-speed train), and the like). The identification module identifies that the mobile phone is in a motion state. After the identification module identifies that the mobile phone is in a motion state, the identification module outputs the identification result (i.e., the motion state) to the arbitration module. The arbitration module determines that the mobile phone is in a motion state in response to the identification result received from the identification module. The arbitration module pre-stores configuration information corresponding to the motion state and configuration information corresponding to a static state. The arbitration module can obtain the pre-stored configuration information corresponding to the motion state and adjust the configuration information corresponding to the configuration of the codec module and / or the Wi-Fi driver.

[0180] For example, in the embodiment of the present application, the configuration information corresponding to the motion state includes but is not limited to:

[0181] 1. Increase the number of MAC layer retransmissions.

[0182] 2. Switch the MIMO (multiple input multiple output) mode to a diversity mode.

[0183] 3. Feedback frame loss statistics.

[0184] 4. Reduce the screen projection resolution and / or code rate.

[0185] For example, the mobile phone can select at least one of the above configuration modes for configuration.

[0186] The above configuration information is described as follows:

[0187] 1. Increase the number of MAC layer retransmissions.

[0188] For example, based on the MAC layer protocol, the mobile phone can set the number of MAC layer retransmissions during data transmission. For example, the number of MAC layer retransmissions corresponding to the motion state can be 100 times. That is, the arbitration module can configure the Wi-Fi driver, for example, send an instruction signal to the Wi-Fi driver, to instruct the Wi-Fi driver to set the number of MAC layer retransmissions to 100 times.

[0189] Optionally, the arbitration module can also set a plurality of retransmission times in advance, and set a corresponding relationship between different motion state intensities and the retransmission times. The arbitration module can determine the corresponding retransmission times based on the intensity of the motion state. For example, the identification module can output the identification result, and the identification result can include information indicating that the electronic device is in a motion state, and can also include information indicating the intensity of the motion state of the electronic device. For example, the identification module can set a corresponding relationship between different parameters and the intensity of the motion state, and the identification module can determine the corresponding intensity of the motion state based on the parameters obtained from the IMU driver. The identification module can provide the detected intensity of the motion state and the motion state to the arbitration module. Correspondingly, the arbitration module can determine the corresponding retransmission times based on the obtained intensity of the motion state.

[0190] For example, the Wi-Fi driver can send the data packets according to the obtained retransmission times in response to the received retransmission times (for example, 100 times) indicated by the arbitration module. For example, the Wi-Fi driver sends a data packet, and if the Wi-Fi driver receives an ACK (acknowledge character) message fed back by the opposite end, the Wi-Fi driver continues to send the next data packet. If the Wi-Fi driver does not receive the ACK message fed back by the opposite end within a predetermined time, the Wi-Fi driver will resend the data packet. That is, the Wi-Fi driver can resend the data packet at most 100 times before receiving the ACK message fed back by the opposite end.

[0191] Optionally, in the embodiment of the present application, the Wi-Fi driver can also send the data packets in the form of data packet aggregation when sending the data packets. For example, the Wi-Fi driver can send 64 data packets (which can be set based on actual needs, and the present application does not make any limitation) at the same time when sending the data packets. After sending the 64 data packets, the Wi-Fi driver will receive the ACK messages fed back by the opposite end for each data packet. When the Wi-Fi driver detects that at least one data packet does not receive the corresponding ACK message, the Wi-Fi driver resends the at least one data packet.

[0192] 2. Switch the MIMO mode to the diversity mode.

[0193] In the embodiment of the present application, the mobile phone and the tablet both use MIMO communication. For example, the arbitration module can send an indication signal to the Wi-Fi driver to indicate that the Wi-Fi driver adjusts the MIMO mode to the diversity mode.

[0194] Figure 13 The communication schematic diagram of the diversity mode is shown for example. Please refer to Figure 13For example, the mobile phone includes antennas 1, 2, 3, and 4, each corresponding to physical channel 1, physical channel 2, physical channel 3, and physical channel 4, respectively. The mobile phone can transmit the same data packets on each physical channel. For instance, the image frames sent by the mobile phone include frame I1, frame B2, frame B2, frame P1, frame B3, frame B4, and frame P2. Each image frame can be contained in one or more data packets. When the mobile phone uses diversity mode, it can transmit the same data packets on each channel; that is, the aforementioned image frames are transmitted on each channel, thereby resisting channel fading and reducing the bit error rate. Correspondingly, the tablet will receive the same data packets on antennas 5, 6, 7, and 8. It should be noted that... Figure 13 The length of each image frame shown indicates the amount of data in the image frame and can also be used to identify the transmission duration. That is, the larger the amount of data in an image frame, the longer its transmission duration.

[0195] 3. Feedback on frame drop statistics.

[0196] For example, the arbitration module can send an indication signal to the Wi-Fi driver to instruct the Wi-Fi driver to start feedback frame drop statistics.

[0197] In one example, Figure 14a This is a schematic diagram illustrating feedback frame drop statistics as an example. Please refer to... Figure 14a For example, if the Wi-Fi driver fails to receive an ACK message from the peer after a set number of retransmissions for a data packet, it can confirm that the data packet transmission has failed, meaning the image frame carried by the data packet has failed to transmit. The Wi-Fi driver can then report the lost image frame to the arbitration module. For example, in response to the lost image frame reported by the Wi-Fi driver, the arbitration module sends an indication message to the encoding / decoding module, instructing the module to adjust its encoding strategy.

[0198] For example, Figure 14b This is an illustrative diagram illustrating an adjusted encoding strategy. For example, using... Figure 7 For example, in GOP, please refer to Figure 14b (1) Assume that frame P1 is lost during transmission. The Wi-Fi driver reports the loss of frame P1 to the arbitration module. The arbitration module instructs the codec module to adjust the encoding strategy of image frames that depend on frame P1. As mentioned above, the decoding of frame P2 depends on frame P1. Therefore, in the event of frame P1 loss, the codec can adjust the encoding strategy of frame P2 during encoding based on the instruction of the arbitration module, so that frame P2 is encoded based on frame I1, such as... Figure 14bAs shown in (2), each image frame includes image frame description information, which can include information indicating the encoding dependency (also referred to as inter-frame prediction relationship). Accordingly, the codec at the receiving end can determine, based on the image frame description information in the image frame, that the P2 frame can be decoded based on the I1 frame, thereby avoiding the problem of P2 frame decoding failure caused by P1 frame loss.

[0199] In another example, Figure 15a Another schematic diagram of feedback loss frame statistics is shown by way of example. Referring to Figure 15a By way of example, the Wi-Fi driver feeds back image frame loss to the arbitration module (details can be referred to the foregoing, which will not be described herein again). The arbitration module adjusts the retransmission number of the Wi-Fi driver in response to the feedback received from the Wi-Fi driver. By way of example, referring to Figure 15b By way of example, the mobile phone sends data packet 1 to the tablet, and after repeated transmission for n times, an ACK message fed back by the tablet is received. Here, n is an integer greater than 0 and less than the maximum transmission number corresponding to the current state (which can be a motion state or a static state). By way of example, the Wi-Fi driver sends data packet 2. The Wi-Fi driver repeatedly sends data packet 2 for m times, and m is the maximum transmission number corresponding to the current state, for example, the maximum transmission number corresponding to the motion state (for example, 100 times). The Wi-Fi driver confirms that data packet 2 fails to be sent, and the Wi-Fi driver feeds back image frame loss to the arbitration module, for example, data packet 2 carries image frame P2, and the Wi-Fi driver feeds back image frame P2 loss to the arbitration module. By way of example, the arbitration module instructs the Wi-Fi driver to adjust the retransmission number, that is, the arbitration module instructs the Wi-Fi driver to retransmit data packet 2 again, for example, the arbitration module can instruct the Wi-Fi driver to adjust the retransmission number to 200 times, that is, the Wi-Fi driver adjusts the original retransmission number (for example, 100 times) to 200 times. That is, the Wi-Fi driver can retransmit data packet 2, and the retransmission number can reach 100 times at most. By way of example, if the Wi-Fi driver retransmits data packet 2 again, and still does not receive an ACK message. In one example, the Wi-Fi driver can feed back to the arbitration module again, and the arbitration module can instruct the Wi-Fi driver to retransmit again. In another example, the Wi-Fi driver confirms that data packet 2 is lost, and can continue to transmit the next data packet. In yet another example, the Wi-Fi driver can feed back image frame loss to the arbitration module, and the arbitration module can adjust the encoding strategy of the encoder (details can be referred to the foregoing, which will not be described herein again).

[0200] 4. Reduce the screen projection resolution and / or code rate.

[0201] For example, the arbitration module can send an instruction signal to the codec module to instruct the codec module to reduce the resolution and / or code rate of the image frame when encoding. For example, the code rate can be any one of 5 Mbps, 10 Mbps, 30 Mbps, and the resolution can be any one of 1080p, 2K, and 4K. That is, in the case of time-varying of the communication channel that can be encountered in the motion state, the amount of data transmitted by the sending end can be reduced by reducing the resolution and / or code rate of the image frame to reduce the use of wireless bandwidth.

[0202] Figure 16 The configuration flowchart of the exemplary sending end (i.e., the mobile phone) is shown. For example, the mobile phone and the tablet are in a stationary state on the desktop. It should be noted that in the embodiments of the present application, a single scenario is taken as an example, and in other embodiments, the technical solutions of the embodiments of the present application can be applied to different state transitions. For example, the user holds the mobile phone and the tablet during running, and the mobile phone can identify that the mobile phone is currently in a motion state (the tablet is the same). When the user holds the mobile phone and the tablet changes from running to stationary, the mobile phone can identify that the mobile phone is currently in a stationary state.

[0203] Please refer to Figure 16 The identification module can identify that the mobile phone is currently in a stationary state. The identification module identifies that the mobile phone is in a stationary state, and the identification module outputs the identification result (i.e., the stationary state) to the arbitration module. The arbitration module determines that the mobile phone is in a stationary state in response to the identification result input by the identification module. As described above, the arbitration module pre-stores configuration information corresponding to the stationary state. The arbitration module can obtain the pre-stored configuration information corresponding to the stationary state, and adjust the configuration information corresponding to the configuration of the codec module and / or the Wi-Fi driver.

[0204] For example, in the embodiments of the present application, the configuration information corresponding to the stationary state includes but is not limited to:

[0205] 1. Reduce the number of MAC layer retransmissions.

[0206] 2. Switch the MIMO mode to the multiplexing mode.

[0207] 3. Feedback frame loss statistics.

[0208] 4. Increase the screen projection resolution and / or code rate.

[0209] For example, the mobile phone can select at least one of the above configuration modes for configuration. The above configuration information will be described below:

[0210] 1. Reduce the number of MAC layer retransmissions.

[0211] For example, according to the MAC layer protocol, the mobile phone can set the number of retransmissions of the MAC layer during data transmission. For example, the number of retransmissions of the MAC layer corresponding to the stationary state can be 20 times, i.e., the maximum number of transmissions is less than that of the moving state, so as to reduce the data transmission delay by reducing the number of retransmissions of the MAC layer corresponding to the stationary state. The arbitration module can configure the Wi-Fi driver, for example, send an indication signal to the Wi-Fi driver, to instruct the Wi-Fi driver to set the number of retransmissions of the MAC layer to 20 times.

[0212] For example, the Wi-Fi driver can transmit the data packet according to the obtained number of retransmissions in response to the received number of retransmissions (for example, 20 times) indicated by the arbitration module. For example, the Wi-Fi driver transmits a data packet, and if the Wi-Fi driver receives an ACK (Acknowledge character) message fed back by the opposite end, the Wi-Fi driver continues to transmit the next data packet. If the Wi-Fi driver does not receive the ACK message fed back by the opposite end within a predetermined time, the Wi-Fi driver will resend the data packet, i.e., the Wi-Fi driver can repeat the transmission of the data packet at most 20 times before receiving the ACK message fed back by the opposite end.

[0213] 2. Switch the MIMO mode to the multiplexing mode.

[0214] For example, the arbitration module can send an indication signal to the Wi-Fi driver to instruct the Wi-Fi driver to adjust the MIMO mode to the multiplexing mode.

[0215] Figure 17 The communication schematic diagram of the multiplexing mode is shown for example. Please refer to Figure 17 For example, the mobile phone includes an antenna 1, an antenna 2, an antenna 3, and an antenna 4, each of which corresponds to a physical channel 1, a physical channel 2, a physical channel 3, and a physical channel 4. The mobile phone can transmit different data packets on each physical channel. For example, the data packets transmitted by the mobile phone include a data packet 1 carrying an I1 frame, a data packet 2 carrying a B2 frame and a B2 frame, a data packet 3 carrying a P1 frame, a data packet 4 carrying a B3 frame and a B4 frame, and a data packet 5 carrying a P2 frame. When the mobile phone uses the multiplexing mode, different data packets can be transmitted on each channel, for example, the data packet 1 is transmitted on the physical channel 1, the data packet 2 and the data packet 3 are transmitted on the physical channel 2, the data packet 4 is transmitted on the physical channel 3, and the data packet 5 is transmitted on the physical channel 4. Thus, the system capacity is improved.

[0216] 3. Feedback frame loss statistics.

[0217] The feedback frame loss statistics can refer to the moving state, i.e. Figures 14a-15bThe related description of the sending end is not repeated here.

[0218] 4. Increase the screen projection resolution and / or code rate.

[0219] For example, the arbitration module can send an instruction signal to the codec module to instruct the codec module to increase the resolution and / or code rate of the image frame when encoding, so as to improve the picture quality of the receiving end.

[0220] Please continue to refer to Figure 11 , the processing flow of the receiving end (for example, a tablet) is described below. For example, after the tablet screen projection application is started, the arbitration module and the identification module of the tablet can be started (that is, called). After the identification module is started, the identification module obtains the parameters (or information) detected by the IMU module (for example, the IMU module 180 in Figure 2 ). The identification module can detect the state of the electronic device based on the obtained parameters. The state includes a motion state or a stationary state. The identification module can output the identification result to the arbitration module. The part not described can refer to the related content of the sending end (that is, the mobile phone), and is not repeated here.

[0221] Please continue to refer to Figure 11 , for example, the identification module outputs the identification result (including the motion state or the stationary state) to the arbitration module. The arbitration module can determine that the current electronic device is in a motion state or a stationary state based on the identification result input by the identification module.

[0222] Still referring to Figure 11 , for example, after the arbitration result determines the current state (including the motion state or the stationary state) of the electronic device, the configuration parameters of the codec module and / or the configuration information of the Wi-Fi driver can be adjusted based on the current state of the electronic device. The part not described can refer to the related content of the sending end, and is not repeated here.

[0223] Figure 18 The configuration flow diagram of the receiving end (that is, the tablet) is shown for example. Please refer to Figure 18 , for example, taking the user holding the mobile phone and going upstairs (or riding a bike, running, etc.) as an example, the identification module identifies that the tablet is currently in a motion state. The identification module identifies that the tablet is in a motion state, and outputs the identification result (that is, the motion state) to the arbitration module. The arbitration module determines that the tablet is in a motion state in response to receiving the identification result input by the identification module. The arbitration module pre-stores configuration information corresponding to the motion state and configuration information corresponding to the stationary state. The arbitration module can obtain the pre-stored configuration information corresponding to the motion state, and adjust the configuration information corresponding to the configuration of the codec module and / or the Wi-Fi driver.

[0224] Exemplarily, in the embodiments of the present application, the configuration information corresponding to the motion state includes but is not limited to:

[0225] 1. Switching the MIMO mode to a diversity mode.

[0226] 2. Increasing the image frame buffer.

[0227] Exemplarily, the tablet can be configured in at least one of the above-mentioned configuration modes. The above-mentioned configuration information will be described respectively as follows:

[0228] 1. Switching the MIMO mode to a diversity mode.

[0229] Exemplarily, the arbitration module can instruct the Wi-Fi driver to switch the MIMO mode to a diversity mode. The Wi-Fi driver performs diversity reception on the data packets sent by the sending end (i.e. the mobile phone). The implementation of the diversity reception can refer to the prior art, and will not be described herein again.

[0230] 2. Increasing the image frame buffer.

[0231] Exemplarily, the arbitration module can send an instruction signal to the codec module to instruct the codec module to increase the image buffer. For example, the current image buffer of the codec module can buffer images corresponding to 3 image frames. The arbitration module can instruct the codec module to increase the image buffer to images corresponding to 30 image frames (which can be set according to actual needs, and the present application does not make any limitation), so as to reduce the frame loss caused by the unstable image frame transmission arrival time.

[0232] For example, Figure 19 The module interaction flowchart shown is exemplary. Please refer to Figure 19 Exemplarily, due to the influence of channel interference and the like, the time delay of the data packets sent by the sending end during transmission can be increased, which can cause the receiving end (e.g. the tablet) to possibly receive multiple data packets at the same time. For example, Figure 19 The Wi-Fi driver of the tablet receives data packet 1, data packet 2 and data packet 3. After the Wi-Fi driver processes data packet 1 to data packet 3, the image frames (including the image frames of data packet 1, the image frames of data packet 2 and the image frames of data packet 3) carried in data packet 1 to data packet 3 are output to the codec module. For example, the image frames of data packet 1 are 10 image frames, the image frames of data packet 2 include 10 image frames, and the image frames of data packet 3 include 10 image frames. That is, the codec module receives a total of 30 image frames.

[0233] Please continue to refer to Figure 19, the coding module can decode the image frames of the received data packet 1 to data packet 3 (i.e. 30 image frames) to obtain 30 images corresponding to the 30 image frames. As described above, the coding module has increased the image buffer to be able to buffer 30 images, and the coding module can place the 30 images corresponding to the 30 image frames in the image buffer. The image processing module (which can be referred to in Figure 6 ) can sequentially extract the images from the image buffer of the coding module, process the images, and output the processed images to the screen projection application. The screen projection application can display the images.

[0234] Figure 20 The configuration flowchart of the exemplary receiving end (i.e. tablet) is shown. The tablet and the mobile phone are in a stationary state on the table, for example. Referring to Figure 20 , the identification module can identify that the tablet is currently in a stationary state. The identification module identifies that the tablet is in a stationary state, and the identification module outputs the identification result (i.e. stationary state) to the arbitration module. The arbitration module determines that the tablet is in a stationary state in response to the identification result received from the identification module. As described above, the arbitration module has pre-stored configuration information corresponding to the stationary state. The arbitration module can obtain the pre-stored configuration information corresponding to the stationary state, and adjust the configuration information corresponding to the configuration of the coding module and / or the Wi-Fi driver.

[0235] Exemplarily, in the embodiments of the present application, the configuration information corresponding to the stationary state includes but is not limited to:

[0236] 1. Switching the MIMO mode to the multiplexing mode.

[0237] 2. Reducing the image frame buffer.

[0238] Exemplarily, the tablet can select at least one of the above-mentioned configuration modes for configuration. The above-mentioned configuration information is described as follows:

[0239] 1. Switching the MIMO mode to the multiplexing mode.

[0240] Exemplarily, the arbitration module can instruct the Wi-Fi driver to switch the MIMO mode to the multiplexing mode. The Wi-Fi driver receives the data packets sent by the sending end (i.e. mobile phone) in a multiplexing manner. The implementation of the multiplexing reception can refer to the prior art, and the present application will not be described in detail.

[0241] 2. Reducing the image frame buffer.

[0242] For example, the arbitration module can send an instruction signal to the codec module to instruct the codec module to reduce the image buffer. For example, the current size of the image buffer of the codec module corresponds to the motion state, for example, 30 image frames can be buffered. The arbitration module can instruct the codec module to reduce the image buffer to 3 image frames (which can be set according to actual needs, and the present application is not limited) corresponding to the image, so that the screen projection application can display the image in time, and reduce the screen projection display delay. The undiscussed part can refer to the related content in the foregoing, and will not be described here.

[0243] It should be noted that the "increase" or "decrease" in the embodiments of the present application is a relative transformation of the configuration information. It can be understood that the configuration information of the stationary state is reduced relative to the configuration information of the motion state, or in other words, the configuration information of the motion state is increased relative to the configuration information of the stationary state. For example, if the arbitration module of the mobile phone does not configure the MAC layer retransmission times when configuring the configuration information, that is, the MAC layer retransmission times are still transmitted according to the retransmission times of the stationary state (for example, 20 times), then in the next period, if the arbitration module determines that the mobile phone is in the stationary state, the retransmission times do not need to be configured again because the retransmission times are already the retransmission times corresponding to the stationary state.

[0244] Please continue to refer to Figure 11 For example, after the arbitration module of the mobile phone determines the current state of the device (including the motion state and the stationary state), the arbitration module can send the identification result (that is, including the motion state or the stationary state) to the tablet through the P2P connection between the mobile phone and the tablet. The same applies to the tablet side, which will not be described here.

[0245] For example, in the embodiments of the present application, if one end of the electronic device in the screen projection scene is in the motion state, the other end will be configured to correspond to the motion state. For example, only when both ends are in the stationary state, the mobile phone and the tablet will be configured based on the configuration information of the stationary state.

[0246] For example, please refer to Figures 21a For example, the arbitration module of the mobile phone determines that the mobile phone is in the motion state, and the arbitration module configures based on the configuration parameters corresponding to the motion state. In addition, the arbitration module sends an indication information to the tablet, and the indication information includes the identification result to indicate that the mobile phone is currently in the motion state. The tablet determines that the mobile phone is in the motion state in response to the received indication information, and the arbitration module of the tablet configures based on the configuration parameters corresponding to the motion state. That is, even if the arbitration module of the tablet determines that the tablet is currently in the stationary state and is configured to correspond to the configuration of the stationary state, if the tablet receives the indication information indicating that the mobile phone is in the motion state, the arbitration module of the tablet will change the configuration to correspond to the configuration of the motion state. The same applies to the tablet side, which will not be described here.

[0247] In a possible implementation, the arbitration module of the mobile phone can send the changed state to the tablet in the case that the state of the mobile phone changes. For example, the arbitration module of the mobile phone determines that the mobile phone changes from the stationary state to the motion state, and the mobile phone sends the indication information to the tablet, where the indication information includes the identification result to indicate that the mobile phone is currently in the motion state. The tablet determines that the mobile phone is in the motion state in response to the received indication information, and the arbitration module in the tablet performs configuration based on the configuration parameter corresponding to the motion state. For example, the mobile phone detects that the mobile phone is still in the motion state in the next period, and the mobile phone can not send the indication information to reduce the resource occupation of the wireless channel. Correspondingly, the tablet confirms that the mobile phone is in the motion state before receiving the indication information indicating that the mobile phone changes to the stationary state. The same is true on the tablet side, which is not described herein again.

[0248] In a possible implementation, as described above, the mobile phone can switch the MIMO mode during the configuration. It should be noted that if the mobile phone side selects to switch the MIMO mode during the configuration process, the opposite end (i.e., the tablet) also needs to switch to the corresponding mode to ensure that the opposite end can correctly receive. The same is true on the tablet side, which is not described herein again. Correspondingly, to ensure that the opposite end can switch to the same mode to correctly receive the data packet sent by the mobile phone, please refer to Figures 21b For example, the mobile phone sends the identification result to the tablet, and also needs to send the arbitration result, where the arbitration result is used to indicate that the mobile phone determines the MIMO mode (including the diversity mode or the multiplexing mode) to be switched based on the identification result. After the tablet receives the identification result and the arbitration result sent by the mobile phone, the tablet switches the MIMO mode. For example, if the mobile phone determines that the MIMO mode needs to be switched to the diversity mode based on the motion state, the tablet also needs to be configured to the diversity mode. The tablet sends the confirmation message to the mobile phone to indicate that the tablet has switched to the corresponding MIMO mode (for example, the diversity mode). After the mobile phone receives the confirmation message sent by the tablet, the mobile phone switches the MIMO mode to the diversity mode.

[0249] The above implementation is exemplified by a specific example in combination with Figure 11 For example, the initial state of the mobile phone and the tablet can be the stationary state by default after the mobile phone and the tablet establish the P2P connection. As described above, the arbitration module can select at least one configuration manner corresponding to the stationary state to perform configuration after determining the stationary state. For example, the arbitration module of the mobile phone can indicate that the MIMO mode of the Wi-Fi driver is the multiplexing mode, and the retransmission number of the MAC layer is 20. The arbitration module in the tablet indicates that the MIMO mode of the Wi-Fi driver is the multiplexing mode, and the image buffer can buffer three image sizes.

[0250] For example, the Wi-Fi driver of the mobile phone and the Wi-Fi driver of the tablet can perform data interaction based on the current configuration. For example, the user holds the mobile phone and goes upstairs with the tablet. The identification module in the mobile phone and the identification module in the tablet both detect that the current device is in a motion state. Taking the mobile phone as an example, the identification module in the mobile phone outputs an identification result to the arbitration module, which is used to indicate that the mobile phone is in a motion state. Similarly, the arbitration module of the mobile phone can configure at least one configuration information corresponding to the motion state. For example, if the current MIMO mode of the Wi-Fi driver is a multiplexing mode, the arbitration module can instruct the Wi-Fi driver to switch the MIMO mode to a diversity mode after determining that the mobile phone is in a motion state. Alternatively, the arbitration module can also not instruct the Wi-Fi driver to switch the MIMO mode, but select to increase the number of MAC layer retransmissions. That is, the mobile phone can still use the multiplexing mode for communication in the motion state.

[0251] For example, after the arbitration module confirms that the mobile phone is in a motion state, it selects "increasing the number of MAC layer retransmissions" and "feedback frame loss statistics". The arbitration module instructs the Wi-Fi driver to perform corresponding configuration, which can be referred to in the foregoing, and will not be described here again. The Wi-Fi driver can perform data transmission based on the changed configuration. In addition, the mobile phone sends an identification result to the tablet, which is used to indicate that the mobile phone switches to a motion state. The tablet side and the mobile phone side are processed similarly, and will not be described here again.

[0252] For example, in the embodiments of the present application, only the screen projection scenario is taken as an example for description. The data processing manner in the embodiments of the present application can also be applied to other data transmission scenarios. For example, the technical solutions in the embodiments of the present application can be applied to the online scenario of the mobile phone (which can also be other devices). That is, when the mobile phone sends data to the server, the mode of sending data can also be switched based on the motion state of the mobile phone. It should be noted that if the data sent by the mobile phone is an image frame, the mobile phone side can execute the processes in the embodiments of the present application. If the data sent by the mobile phone is a non-image frame, the configuration manner of adjusting the coding and decoding parameters is removed.

[0253] It can be understood that, in order to implement the above functions, the electronic device contains hardware and / or software modules corresponding to each function. The algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is implemented in hardware or computer software driven hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered beyond the scope of the present application.

[0254] In one example, Figure 22A schematic block diagram of an apparatus 2200 of an embodiment of the present application is shown. The apparatus 2200 can include a processor 2201 and a transceiver / transceiver pin 2202, and optionally further include a memory 2203.

[0255] The various components of the apparatus 2200 are coupled together by a bus 2204, which can include a data bus, a power bus, a control bus, and a state signal bus. For the sake of clarity, the various buses are illustrated in Figure 2 as the bus 2204.

[0256] Optionally, the memory 2203 can be used for storing instructions of the foregoing method embodiments. The processor 2201 can be used for executing the instructions in the memory 2203, and controlling the receiving pin to receive signals and the sending pin to send signals.

[0257] The apparatus 2200 can be an electronic device or a chip of an electronic device in the foregoing method embodiments.

[0258] Wherein, all the related contents of the steps involved in the foregoing method embodiments can be referred to the function description of the corresponding function modules, which will not be repeated here.

[0259] The embodiment further provides a computer storage medium, which stores computer instructions. When the computer instructions are run on an electronic device, the electronic device executes the related method steps described above to implement the data processing method in the foregoing embodiments.

[0260] The embodiment further provides a computer program product. When the computer program product is run on a computer, the computer executes the related steps described above to implement the data processing method in the foregoing embodiments.

[0261] In addition, the embodiment of the present application further provides an apparatus, which can be a chip, a component or a module. The apparatus can include a processor and a memory connected to each other. The memory is used for storing computer execution instructions. When the apparatus is running, the processor can execute the computer execution instructions stored in the memory to enable the chip to execute the data processing method in the foregoing method embodiments.

[0262] Wherein, the electronic device, the computer storage medium, the computer program product or the chip provided by the embodiment are used for executing the corresponding method provided above, and thus the beneficial effects that can be achieved are referred to the beneficial effects of the corresponding method provided above, which will not be repeated here.

[0263] Through the description of the above embodiments, those skilled in the art can understand that, for the convenience and brevity of description, only the division of the above functional modules is exemplified, and in actual application, the above functions can be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

[0264] In several embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative. For example, the division of modules or units is only a logical function division, and actual implementation can have another division manner. For example, a plurality of units or components can be combined or integrated into another device, or some features can be omitted or not executed. In addition, the coupling or direct coupling or communication connection between the units or components shown or discussed can be indirect coupling or communication connection through some interface, device or unit, and can be electrical, mechanical or other forms.

[0265] The units described as separate components can or can not be physically separate, and the components shown as units can be one physical unit or multiple physical units, that is, can be located in one place or distributed to multiple different places. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment scheme.

[0266] In addition, the functional units in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present alone, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0267] Any content of each embodiment of the present application, and any content of the same embodiment, can be freely combined. Any combination of the above is within the scope of the present application.

[0268] If the integrated unit is implemented in the form of a software function unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application essentially or say the parts that make contributions to the prior art or the whole or part of the technical solutions can be embodied in the form of a software product, which is stored in a storage medium, includes several instructions to make a device (which can be a single-chip microcomputer, a chip, etc.) or a processor execute all or part of the steps of the various embodiments of the method of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0269] The embodiments of the present application are described above in combination with the drawings, but the present application is not limited to the above-described specific embodiments, and the above-described specific embodiments are only illustrative but not restrictive. Those skilled in the art can make many forms under the inspiration of the present application without departing from the scope of the present application and the scope of protection of the claims, and all of them belong to the protection of the present application.

[0270] The steps of the method or algorithm described in combination with the disclosure of the embodiments of the present application can be implemented in hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in a random access memory (RAM), a flash memory, a read-only memory (ROM), an erasable programmable ROM (EPROM), an electrically EPROM (EEPROM), a register, a hard disk, a mobile hard disk, a compact disc (CD-ROM), or any other form of storage medium well known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be an integral part of the processor.

[0271] Those skilled in the art can understand that the functions described in the embodiments of the present application in the one or more examples above can be implemented in hardware, software, firmware or any combination thereof. When implemented in software, the functions can be stored in a computer readable medium or transmitted as one or more instructions or codes on a computer readable medium. The computer readable medium includes computer storage medium and communication medium, wherein the communication medium includes any medium that facilitates the transfer of computer program from one place to another. The storage medium can be any available medium that can be accessed by a general or special purpose computer.

[0272] The embodiments of the present application are described above in combination with the drawings, but the present application is not limited to the specific embodiments described above, which are merely illustrative rather than restrictive, and those of ordinary skill in the art can make many forms under the inspiration of the present application without departing from the purpose of the present application and the scope protected by the claims.

Claims

1. A data processing method, characterized by, The method comprises: A first electronic device establishes a wireless connection with a second electronic device, and performs data interaction with the second electronic device through the wireless connection; The first electronic device detects a state of the first electronic device, the state of the first electronic device being a motion state or a stationary state; The first electronic device determines a target configuration parameter based on the state of the first electronic device; the target configuration parameter comprises a wireless connection configuration parameter between the first electronic device and the second electronic device, and / or a coding strategy of the first electronic device; The first electronic device performs data interaction with the second electronic device based on the target configuration parameter; The first electronic device receives a state of the second electronic device sent by the second electronic device; the state of the second electronic device is a motion state or a stationary state; If the state of the first electronic device is a stationary state and the state of the second electronic device is a motion state, the first electronic device adjusts the configuration parameter of the first electronic device to a target configuration parameter corresponding to the motion state.

2. The method of claim 1, wherein, The method comprises: The first electronic device sends a connection request message to the second electronic device in response to a received first user operation; The first electronic device establishes the wireless connection with the second electronic device in response to a received response message sent by the second electronic device; The first electronic device sends a data packet containing an image frame to the second electronic device through the wireless connection.

3. The method of claim 2, wherein, If the state of the first electronic device is a motion state, the wireless connection configuration parameter comprises at least one of the following: The number of retransmissions of the data packet is N, and a multiple-input multiple-output (MIMO) mode is a diversity mode; N is an integer greater than 0.

4. The method of claim 3, wherein, If the state of the first electronic device is a stationary state, the wireless connection configuration parameter comprises at least one of the following: The number of retransmissions of the data packet is M, and the MIMO mode is a multiplexing mode; M is an integer greater than 0 and less than N. If the state of the first electronic device is a motion state, the coding strategy of the first electronic device comprises at least one of the following:

5. The method of claim 2, wherein, The code rate of the image frame is A1; The resolution of the image frame is B1; The coding dependency of the image frame is adjusted. If the state of the first electronic device is a stationary state, the coding strategy of the first electronic device comprises at least one of the following:

6. The method of claim 5, wherein, The code rate of the image frame is A2; The resolution of the image frame is B2; The coding dependency of the image frame is adjusted; Wherein, A2 is greater than A1, and B2 is greater than B1. The method comprises:

7. The method of claim 1, wherein, The first electronic device sends a response message to the second electronic device in response to a received connection request message sent by the second electronic device; The first electronic device establishes the wireless connection with the second electronic device; ​ The first electronic device receives a data packet containing an image frame sent by the second electronic device through the wireless connection.

8. The method of claim 7, wherein, If the state of the first electronic device is a motion state, the wireless connection configuration parameter includes: The MIMO mode is a diversity mode.

9. The method of claim 7, wherein, If the state of the first electronic device is a static state, the wireless connection configuration parameter includes: The MIMO mode is a multiplexing mode.

10. The method of claim 7, wherein, If the state of the first electronic device is a motion state, the codec strategy of the first electronic device includes: The image buffer size is set to C1.

11. The method of claim 10, wherein, If the state of the first electronic device is a static state, the codec strategy of the first electronic device includes: The image buffer size is set to C2; wherein C2 is less than C1.

12. The method of claim 1, wherein, The method further includes: The first electronic device sends the state of the first electronic device to the second electronic device.

13. A first electronic device, comprising: It includes: A memory and a processor, the memory is coupled with the processor; The memory stores program instructions, when the program instructions are executed by the processor, the first electronic device executes the following steps: Establish a wireless connection with a second electronic device, and interact with the second electronic device through the wireless connection; Detect the state of the first electronic device, the state of the first electronic device is a motion state or a static state; Based on the state of the first electronic device, determine the target configuration parameter; the target configuration parameter includes the wireless connection configuration parameter between the first electronic device and the second electronic device, and / or the codec strategy of the first electronic device; Based on the target configuration parameter, interact with the second electronic device; When the program instructions are executed by the processor, the first electronic device executes the following steps: Receive the state of the second electronic device sent by the second electronic device; wherein the state of the second electronic device is a motion state or a static state; If the state of the first electronic device is a static state, and the state of the second electronic device is a motion state, adjust the configuration parameter of the first electronic device to the target configuration parameter corresponding to the motion state.

14. The electronic device of claim 13, wherein, When the program instructions are executed by the processor, the first electronic device executes the following steps: In response to the received first user operation, send a connection request message to the second electronic device; In response to the received response message sent by the second electronic device, establish the wireless connection with the second electronic device; Send a data packet containing an image frame to the second electronic device through the wireless connection.

15. The electronic device of claim 14, wherein, If the state of the first electronic device is a motion state, the wireless connection configuration parameter includes at least one of the following: The number of retransmissions of the data packet is N, and the MIMO mode is a diversity mode; N is an integer greater than 0.

16. The electronic device of claim 15, wherein, If the state of the first electronic device is a static state, the wireless connection configuration parameter includes at least one of the following: The number of retransmissions of the data packet is M, and the MIMO mode is a multiplexing mode; Wherein, M is an integer greater than 0 and less than N.

17. The electronic device of claim 14, wherein, If the state of the first electronic device is a motion state, the coding strategy of the first electronic device comprises at least one of the following: The code rate of the image frame is A1; The resolution of the image frame is B1; Adjusting the coding dependency of the image frame.

18. The electronic device of claim 17, wherein, If the state of the first electronic device is a static state, the coding strategy of the first electronic device comprises at least one of the following: The code rate of the image frame is A2; The resolution of the image frame is B2; Adjusting the coding dependency of the image frame; Wherein, A2 is greater than A1, and B2 is greater than B1.

19. The electronic device of claim 13, wherein, When the program instructions are executed by the processor, the first electronic device executes the following steps: In response to the received connection request message sent by the second electronic device, a response message is sent to the second electronic device; The wireless connection is established with the second electronic device; The data packet containing the image frame sent by the second electronic device is received through the wireless connection.

20. The electronic device of claim 19, wherein, If the state of the first electronic device is a motion state, the wireless connection configuration parameters comprise: The MIMO mode is a diversity mode.

21. The electronic device of claim 19, wherein, If the state of the first electronic device is a static state, the wireless connection configuration parameters comprise: The MIMO mode is a multiplexing mode.

22. The electronic device of claim 19, wherein, If the state of the first electronic device is a motion state, the coding strategy of the first electronic device comprises: The image buffer size is set to C1.

23. The electronic device of claim 22, wherein, If the state of the first electronic device is a static state, the coding strategy of the first electronic device comprises: The image buffer size is set to C2; wherein, C2 is less than C1.

24. The electronic device of claim 13, wherein, When the program instructions are executed by the processor, the first electronic device executes the following steps: The state of the first electronic device is sent to the second electronic device.

25. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program, and the computer program is executed by the electronic device to execute the method in any one of claims 1-12.

26. A computer program product, characterised in that, When the computer program product runs on the computer, the computer executes the method in any one of claims 1-12.

Images