Data transmission apparatus and system

Abstract

The application relates to the technical field of screen projection, and discloses a data transmission device and system. The data transmission device is connected to a sending end through an HDMI interface, and sends configuration information to the sending end through the HDMI interface. The sending end feeds back first audio and video data matched with the configuration information to the data transmission device through the HDMI interface. The data transmission device processes the first audio and video data to obtain second audio and video data adapted to transmission configuration. The data transmission device transmits the second audio and video data to a receiving end through a wireless transmission module, so that the receiving end displays the second audio and video data. In the screen projection process, the sending end does not need to install a screen projection application, the situation that the screen projection application cannot be compatible with the operating system of the sending end is avoided, the occurrence of screen projection abnormal situations is reduced, and the stability of screen projection is ensured.

Description

Technical Field

[0001] This application relates to the field of screen projection technology, such as a data transmission device and system. Background Technology

[0002] Currently, in scenarios such as meetings, users typically use wireless screen sharing devices to project the meeting content displayed on the sending end (such as a personal computer) onto the receiving end (such as a conference tablet) for easy display or sharing of meeting content.

[0003] In related technologies, the process of screen projection from the sending end to the receiving end is typically implemented using a USB (Universal Serial Bus) wireless screen projector. When the USB wireless screen projector is connected to the sending end, the screen projection application installed on the sending end acquires the screen displayed on the sending end and sends the screen to the USB wireless screen projector via the USB interface. The USB wireless screen projector then wirelessly transmits the screen to the receiving end for display.

[0004] However, in related technologies, the process of the sending end projecting screen to the receiving end using a USB wireless screen sharing device relies on the installed screen sharing application. Because different sending ends use different operating systems, and due to compatibility issues between the screen sharing application and the operating system, the screen sharing application may not be compatible with different sending ends, leading to screen sharing anomalies and reducing screen sharing stability. Summary of the Invention

[0005] To provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. This summary is not intended as a general commentary, nor is it intended to identify key / important components or describe the scope of protection of these embodiments, but rather as a prelude to the detailed description that follows.

[0006] This application provides a data transmission device and system that enables application-free screen mirroring, thereby reducing screen mirroring anomalies and ensuring screen mirroring stability.

[0007] In a first aspect, embodiments of this application provide a data transmission device, including: an HDMI interface (High Definition Multimedia Interface), a conversion module, a control module, and a wireless transmission module; wherein:

[0008] The HDMI interface is connected to the transmitting end via an HDMI cable. The configuration information of the data transmission device is sent to the transmitting end via the HDMI interface, so that the transmitting end sends the first audio and video data that matches the configuration information to the data transmission device via the HDMI interface.

[0009] The conversion module is connected to the HDMI interface and is used to convert the first audio and video data sent by the transmitter through the HDMI interface into first audio data and first video data; the conversion module is also connected to the control module and is used to send the first audio data and first video data to the control module.

[0010] The control module is connected to the wireless transmission module and is used to process the first audio data and the first video data to obtain second audio and video data adapted to the transmission configuration, and send the second audio and video data to the wireless transmission module; wherein, the transmission configuration is negotiated between the data transmission device and the receiving end;

[0011] The wireless transmission module establishes a wireless connection with the receiving end to transmit the second audio and video data to the receiving end via the wireless connection, so that the receiving end can display the second audio and video data.

[0012] Optionally, the control module includes an audio module, a video module, an audio encoder, a video encoder, and a multiplexer; wherein: the audio module, connected to the conversion module and the audio encoder, is used to convert the first audio data sent by the conversion module into second audio data adapted to the transmission configuration according to the transmission configuration, and transmit the second audio data to the audio encoder; the audio encoder is used to encode and compress the second audio data into an audio stream; the video module, connected to the conversion module and the video encoder, is used to convert the first video data sent by the conversion module into second video data adapted to the transmission configuration according to the transmission configuration, and transmit the second video data to the video encoder; the video encoder is used to encode and compress the second video data into a video stream; the multiplexer, connected to the audio encoder, the video encoder, and the wireless transmission module respectively, is used to process the audio stream and the video stream to obtain second audio and video data, and transmit the second audio and video data to the wireless transmission module.

[0013] Optionally, the control module further includes a detection module, which is used to detect the type of the first video data sent by the conversion module, so as to adjust the screen projection mode of the data transmission device according to the type of the first video data; wherein the screen projection mode includes a mirror mode and an extended mode.

[0014] Optionally, the control module further includes a shared clock module; wherein the shared clock module is connected to the audio encoder and the video encoder respectively, and is configured to provide clock signals to the audio encoder and the video encoder respectively, so that the audio encoder and the video encoder synchronize the audio stream and the video stream based on the clock signal.

[0015] Optionally, the control module further includes a shared clock module; wherein: the shared clock module is connected to the audio encoder and the video encoder respectively, and is used to provide clock signals to the audio encoder and the video encoder respectively, so that the audio encoder and the video encoder synchronize the audio stream and the video stream based on the clock signal.

[0016] Optionally, the wireless transmission module includes a transmission feedback module; wherein: the transmission feedback module is connected to the control module and is configured to, during the transmission of the second audio and video data by the wireless transmission module, when fluctuations in transmission parameters are detected, feed back fluctuation information to the control module so that the control module can adjust the transmission configuration according to the fluctuation information.

[0017] Optionally, the first audio and video data is in RGB or YUV format, the first audio data is in I2S or USB format, and the first video data is in MIPI, DVP, or USB format.

[0018] Optionally, the data transmission device further includes a power supply interface; wherein: the power supply interface is connected to the transmitting end via a power supply line; the transmitting end supplies electrical energy to the power supply interface via the power supply line to power the data transmission device. The power supply interface includes a USB interface and / or a Type-C interface.

[0019] Optionally, the data transmission device further includes a power management module; wherein: the power management module is connected to the power supply interface and is also connected to the conversion module, the control module and the wireless transmission module, and is configured to distribute the power of the power supply interface to the conversion module, the control module and the wireless transmission module.

[0020] Secondly, embodiments of this application provide a data transmission system, including: a transmitting end, a receiving end, and the data transmission device described in the first aspect; wherein, the data transmission device is connected to the transmitting end, a wireless connection is established between the data transmission device and the receiving end, and the transmitting end projects a screen to the receiving end through the data transmission device.

[0021] The data transmission device and system provided in this application can achieve the following technical effects:

[0022] When a data transmission device equipped with an HDMI interface is connected to a transmitting end via an HDMI cable, the data transmission device can send configuration information to the transmitting end through the HDMI interface. This allows the transmitting end to send first audio and video data matching the configuration information to the data transmission device. A conversion module in the data transmission device converts the first audio and video data into first audio data and first video data, and sends this data to a control module within the data transmission device. The control module processes the first audio and video data to obtain second audio and video data adapted to the transmission configuration, and then sends this second audio and video data to a wireless transmission module within the data transmission device. The wireless transmission module transmits the second audio and video data to the receiving end based on a wireless connection with the receiving end. Since the transmission configuration is pre-negotiated between the data transmission device and the receiving end, it characterizes the processing capabilities of the receiving end. Therefore, after receiving the second audio and video data adapted to the transmission configuration, the receiving end can process the second audio and video data and perform screen projection display. In this application, after a data transmission device with an HDMI interface is connected to the transmitting end, the transmitting end can project the screen to the receiving end. During the projection process, the transmitting end does not need to install a projection application, thus avoiding the situation where the projection application is incompatible with the transmitting end's operating system, thereby reducing the occurrence of projection abnormalities and ensuring the stability of projection.

[0023] The above general description and the description below are exemplary and illustrative only and are not intended to limit this application. Attached Figure Description

[0024] One or more embodiments are illustrated by way of example with reference to the accompanying drawings. These illustrations and drawings do not constitute a limitation on the embodiments. Elements having the same reference numerals in the drawings are considered similar elements. The drawings do not constitute a limitation of scale, and wherein:

[0025] Figure 1 This is a schematic diagram of a screen mirroring system;

[0026] Figure 2 This is a schematic diagram of a data transmission system provided in an embodiment of this application. Detailed Implementation

[0027] The terms "first," "second," etc., used in the specification, claims, and drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate for the embodiments of this application described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion.

[0028] Unless otherwise stated, the term "multiple" means two or more.

[0029] In this embodiment, the character " / " indicates that the objects before and after it are in an "or" relationship. For example, A / B means: A or B.

[0030] The term "and / or" describes an association between objects, indicating that three relationships can exist. For example, A and / or B means: A or B, or A and B.

[0031] The term "correspondence" can refer to an association or binding relationship. The correspondence between A and B means that there is an association or binding relationship between A and B.

[0032] To provide a more detailed understanding of the features and technical content of the embodiments of this application, the implementation of the embodiments of this application will be described in detail below with reference to the accompanying drawings. The accompanying drawings are for illustrative purposes only and are not intended to limit the embodiments of this application. In the following technical description, for ease of explanation, several details are used to provide a full understanding of the disclosed embodiments. However, one or more embodiments may still be implemented without these details. In other cases, well-known structures and devices may be simplified in their depiction to simplify the drawings.

[0033] Before providing a further detailed description of the embodiments of this application, the nouns and terms involved in the embodiments of this application will be explained, and the nouns and terms involved in the embodiments of this application shall be interpreted as follows.

[0034] Sender and Receiver: In screen mirroring, the sender refers to the electronic device that projects audio and video data onto the screen, while the receiver refers to the electronic device that receives, processes, and displays the audio and video data. The sender typically needs both a screen and wireless network capabilities to transmit the audio and video data from the screen to the receiver via the wireless network. The receiver also needs both a screen and wireless network capabilities to receive the audio and video data from the sender via the wireless network and display it on the screen.

[0035] Audio and video data: In the process of screen mirroring, audio and video data refers to the data obtained after digital processing of audio and video images.

[0036] RGB format: A color space model based on the three primary colors of red, green, and blue, used for representing digital images and videos. In RGB format audio and video data, the color of each pixel in a video frame is determined by the values ​​of the three components: red, green, and blue. For example, the RGB value of a white pixel is (255, 255, 255), while the RGB value of a black pixel is (0, 0, 0).

[0037] YUV format consists of three components: luminance (Y), chrominance (U, Cb), and chrominance (V, Cr). The Y component typically ranges from 0 to 255, while the U and V components also typically range from 0 to 255. In YUV format audio and video data, image information for a video frame is represented by the luminance (Y) and chrominance (U, V) components. Furthermore, YUV and RGB formats can be converted between each other.

[0038] I2S (Inter-IC Sound) format: A serial interface standard for digital audio data transmission. The I2S protocol defines the transmission format of audio data.

[0039] USB (Universal Serial Bus) format: used to define the transmission method of audio or video data in data transmission devices.

[0040] MIPI (Mobile Industry Processor Interface) format: used to define the transmission method of video data in data transmission devices.

[0041] DVP (Digital Video Port) format: used to define the transmission method of video data.

[0042] Multiplexer (MUX): During screen mirroring, when processing audio and video data, the multiplexer integrates the audio and video streams so that the wireless transmission module can send them to the receiving end via the wireless network.

[0043] Mirroring mode: During screen mirroring, the screen content of the sending end is synchronized to the receiving end in real time for display.

[0044] Extended Mode: During screen mirroring, extended mode refers to extending the content of the sending end's screen to be displayed on the receiving end. In extended mode, the sending and receiving end screens can display different content independently. Users can operate on the sending end screen and drag and drop the content they want to share or mirror onto the receiving end screen for display.

[0045] Screen resolution refers to the number of pixels displayed on a screen, expressed as "horizontal pixels × vertical pixels." Screen resolution is an indicator of screen clarity and detail; the higher the screen resolution, the clearer and more detailed the displayed image. For example: 1920×1080: means the screen has 1920 pixels horizontally and 1080 pixels vertically. 3840×2160 (4K resolution): means the screen has 3840 pixels horizontally and 2160 pixels vertically.

[0046] Aspect ratio: This refers to the ratio between the width and height of the screen, represented by two numbers. The aspect ratio determines the shape of the screen and how content is displayed. For example: 16:9 means the screen width is 16 units and the height is 9 units. 4:3 means the screen width is 4 units and the height is 3 units.

[0047] USB interface: A universal serial bus interface used to connect a data transmission device and a transmitter, so that the transmitter can transmit data to the data transmission device via the USB interface, and provide power to the data transmission device.

[0048] Type-C interface: The full name is USB Type-C interface, which is used to connect the data transmission device and the transmitter, so that the transmitter can transmit data to the data transmission device through the USB interface, and provide power to the data transmission device.

[0049] The embodiments of this application will now be described.

[0050] In scenarios such as meetings or teaching, in order to facilitate the display or sharing of meeting or teaching content, users typically use wireless screen sharing devices to project the meeting or teaching content displayed on the sending end (such as a personal computer) onto the receiving end (such as a conference tablet) for display, so as to facilitate meeting communication based on the meeting content or teaching based on the teaching content.

[0051] Combination Figure 1 As shown, a screen mirroring system is provided in the related technology, including a transmitter 11 and a receiver 12. Screen mirroring between the transmitter 11 and the receiver 12 is achieved based on a USB wireless screen mirroring device 13. The transmitter 11 is equipped with a screen mirroring application 111. When the USB wireless screen mirroring device 13 is connected to the transmitter 11, the screen mirroring application 111 can acquire the screen displayed on the transmitter 11 and send the screen to the USB wireless screen mirroring device 13 through the USB interface of the transmitter 11. The USB wireless screen mirroring device 13 then wirelessly transmits the screen to the receiver 12 so that the receiver 12 can display the screen, thereby realizing screen mirroring from the transmitter 11 to the receiver 12.

[0052] However, in related technologies, during the process of the transmitter 11 projecting its screen to the receiver 12 via the USB wireless screen mirroring device 13, it relies on the installed screen mirroring application 111. Because different transmitters 11 have different operating systems, and due to compatibility issues between the screen mirroring application 111 and the operating system, the screen mirroring application 111 may not be compatible with different transmitters 11, causing the transmitter 11 to fail to project its screen to the receiver 12, thus triggering screen mirroring anomalies and reducing the stability of screen mirroring.

[0053] Therefore, this application provides a data transmission device and system. The data transmission device has an HDMI interface, which is connected to a transmitting end. Configuration information is sent to the transmitting end via the HDMI interface. The transmitting end sends audio and video data to the data transmission device via the HDMI interface according to the configuration information. The data transmission device then sends the audio and video data to a receiving end to achieve screen mirroring. During screen mirroring, the transmitting end does not need to install a screen mirroring application, avoiding situations where the screen mirroring application is incompatible with the transmitting end's operating system, thereby reducing the occurrence of screen mirroring anomalies and ensuring screen mirroring stability.

[0054] The data transmission system provided in the embodiments of this application will now be described.

[0055] Combination Figure 2 As shown, this application embodiment provides a data transmission system, including a transmitter 21, a receiver 22, and a data transmission device 23. The data transmission device 23 is connected to the transmitter 21, and a wireless connection is established between the data transmission device 23 and the receiver 22. The transmitter 21 projects its screen to the receiver 22 through the data transmission device 23.

[0056] In this embodiment, the data transmission device 23 can be a wireless screen sharing device with an HDMI interface, and the data transmission device 23 is connected to the transmitting end 21 through the HDMI interface. The transmitting end 21 can be an electronic device with audio and video transmission and display functions, such as a tablet computer or desktop computer, or it can be an electronic device with only audio and video transmission functions, such as a scanner or game console. The receiving end 22 can be a display device with audio and video display functions, such as a smart interactive flat panel, a conference flat panel, a smart blackboard, or a commercial display screen.

[0057] In this embodiment, after a wireless connection is established between the data transmission device 23 and the receiving end 22, the data transmission device 23 exchanges information with the receiving end 22 based on the wireless connection and negotiates a transmission configuration according to the exchanged information. The exchanged information reflects the data processing capability of the receiving end 22. Thus, the transmission configuration negotiated according to the exchanged information meets the data processing capability requirements of the receiving end 22. That is, after the data sent by the sending end 21 is processed according to the transmission configuration and transmitted to the receiving end 22, it can be guaranteed that the data sent by the sending end 21 can be processed normally by the receiving end 22.

[0058] The data transmission device 23 in the data transmission system will now be described.

[0059] The data transmission device 23 includes an HDMI interface, a conversion module, a control module, and a wireless transmission module.

[0060] After the HDMI interface is connected to the transmitter 21 via an HDMI cable, the data transmission device 23 sends configuration information to the transmitter 21 through the HDMI interface. The configuration information includes at least the resolutions supported by the data transmission device 23, the supported video formats, and the supported audio formats. After receiving the configuration information, the transmitter 21 sends first audio and video data matching the configuration information to the data transmission device 23 through the HDMI interface. For example, if the configuration information indicates that the data transmission device 23 supports RGB or YUV format video, the transmitter 21 can send first audio and video data in RGB or YUV format to the data transmission device 23.

[0061] The conversion module is connected to both the HDMI interface and the control module. It converts the first audio and video data sent by the transmitter 21 via the HDMI interface into first audio data and first video data, and then sends the first audio data and first video data to the control module. Specifically, the conversion module can convert the first audio and video data into first audio data and first video data in different formats. For example, the first audio data can be in I2S or USB format, and the first video data can be in MIPI, DVP, or USB format.

[0062] The control module is connected to the wireless transmission module and processes the first audio data and first video data output by the conversion module according to the transmission configuration to obtain second audio and video data adapted to the transmission configuration, and then sends the second audio and video data to the wireless transmission module. Since a wireless connection is established between the wireless transmission module and the receiver 22, the wireless transmission module, under the control of the control module, can transmit the second audio and video data to the receiver 22 via the wireless connection, enabling the receiver 22 to decode and display the second audio and video data. For example, the control module can be a system-on-a-chip (SoC).

[0063] In the data transmission system provided in this application embodiment, when a data transmission device 23 with an HDMI interface is connected to a transmitter 21 via an HDMI cable, the data transmission device 23 can send configuration information to the transmitter 21 through the HDMI interface, so that the transmitter 21 sends first audio and video data matching the configuration information to the data transmission device 23. The conversion module in the data transmission device 23 converts the first audio and video data into first audio data and first video data, and sends them to the control module in the data transmission device 23. The control module processes the first audio data and first video data to obtain second audio and video data adapted to the transmission configuration, and sends the second audio and video data to the wireless transmission module in the data transmission device 23. The wireless transmission module transmits the second audio and video data to the receiver 22 based on a wireless connection with the receiver 22. Since the transmission configuration is pre-negotiated between the data transmission device 23 and the receiver 22, the transmission configuration can characterize the processing capability of the receiver 22. Thus, after receiving the second audio data adapted to the transmission configuration, the receiver 22 can process the second audio and video data and perform screen projection display. In this application, after the data transmission device 23 with an HDMI interface is connected to the transmitter 21, the transmitter 21 can project the screen to the receiver 22. During the projection process, the transmitter 21 does not need to install a projection application, thus avoiding the situation where the projection application is incompatible with the operating system of the transmitter 21, thereby reducing the occurrence of projection abnormalities and ensuring the stability of projection.

[0064] Optionally, the control module of the data transmission device 23 includes an audio module, a video module, an audio encoder, a video encoder, and a multiplexer. Wherein:

[0065] The audio module is connected to both the conversion module and the audio encoder. It converts the first audio data sent by the conversion module into second audio data adapted to the transmission configuration, and then transmits the second audio data to the audio encoder. The audio encoder then encodes and compresses the second audio data into an audio stream. In this embodiment, the audio encoder compresses the second audio data into a smaller audio stream, thereby reducing the amount of second audio data transmitted and thus reducing network bandwidth during screen projection. Encoding and compressing the second audio data with the audio encoder reduces sound quality loss, ensuring that the second audio data can be clearly and accurately reproduced by the receiving end 22.

[0066] The video encoder is connected to both the conversion module and the video encoder. It converts the first video data sent by the conversion module into second video data adapted to the transmission configuration, and then transmits the second video data to the video encoder. The video encoder then encodes and compresses the second video data into a video stream. In this embodiment, the video encoder can compress the second video data into a smaller video stream, thereby reducing the amount of second video data transmitted and thus reducing network bandwidth during screen projection. Encoding and compressing the first video data through the video encoder can preserve as much key information as possible, thus ensuring the quality of the video data decoded by the receiving end 22.

[0067] The process of the audio module processing the first audio data and the process of the video module processing the first video data are illustrated with examples below:

[0068] For example, if the receiver 22, as characterized by the transmission configuration, supports an audio sampling rate of 48kHz, while the audio data output by the conversion module has a sampling rate of 96kHz, the audio module can convert the first audio data sampling rate from 96kHz to 48kHz to adapt to the transmission configuration, i.e., to the audio sampling rate of 48kHz supported by the receiver 22. As another example, if the receiver 22, as characterized by the transmission configuration, supports a video format of YUV420, while the video data output by the conversion module is in YUV444 format, the video module can convert the first video data format from YUV444 to YUV420 to adapt to the transmission configuration, i.e., to the video data format of YUV420 supported by the receiver 22. In this embodiment, by processing the first audio data into the second audio data through the audio module and the first video data into the second video data through the video module, the second audio data and the second video data can be adapted to the transmission configuration that characterizes the processing capability of the receiving end 22, so as to ensure that the second audio data and the second video data can be processed and played normally by the receiving end 22, thereby ensuring the normal progress of the screen projection process.

[0069] A multiplexer, connected to an audio encoder, a video encoder, and a wireless transmission module, processes the audio and video streams to obtain second audio and video data, which is then sent to the wireless transmission module. For example, the multiplexer can merge the audio and video streams into second audio and video data in MPEG-TS (MPEG Transport Stream) format.

[0070] In this embodiment, the audio stream and video stream can be combined into a second audio and video data for transmission by a multiplexer, thereby reducing interference and loss during data transmission and improving the efficiency and stability of data transmission during screen projection.

[0071] Optionally, the screen projection mode of the data transmission device 23 includes a mirror mode and an extended mode. The following describes how the screen projection mode of the data transmission device 23 is adjusted during the screen projection process.

[0072] Specifically, the control module of the data transmission device 23 also includes a detection module, which is used to detect the type of the first video data sent by the conversion module and adjust the screen projection mode of the data transmission device 23 according to the type of the first video data.

[0073] For example, when the type of the first video data is PPT (PowerPoint presentation) data, the PPT data may only be displayed and viewed on the receiving end 22. At this time, the data transmission device 23 can be controlled to be an extended projection model, so that the user can continue to operate the sending end 21 device without affecting the projection effect.

[0074] Specifically, the control module of the data transmission device 23 also includes an adjustment module, which is used to adjust the screen projection mode according to the transmission configuration negotiated between the data transmission device 23 and the receiving end 22. The transmission configuration records not only the content negotiated between the data transmission device 23 and the receiving end 22, such as the screen resolution and screen ratio of the receiving end 22, but also the parameter information of the sending end 21, such as the screen resolution and screen ratio of the sending end 21. The parameter information of the sending end 21 can be actively sent by the sending end 21 to the data transmission device 23, or it can be actively obtained by the data transmission device 23 from the sending end 21; this embodiment does not limit this.

[0075] The adjustment module can adjust the projection mode of the data transmission device 23 according to the screen resolution of the sending end 21 and the screen resolution of the receiving end 22. For example, when the screen resolution of the sending end 21 is 1920x1080 and the screen resolution of the receiving end 22 is 4K, the projection mode of the data transmission device 23 can be adjusted to extended projection to extend the content on the screen of the sending end 21 to the screen of the receiving end 22 for display.

[0076] The adjustment module can also adjust the projection mode of the data transmission device 23 according to the screen display ratio of the sending end 21 and the receiving end 22. For example, when the display ratio of the sending end screen 21 is 16:10 and the display ratio of the receiving end screen 22 is 16:9, the projection mode of the data transmission device 23 can be adjusted to extended projection to extend the content in the sending end 21 screen to the receiving end screen 22 and display it according to the display ratio of the receiving end screen 22.

[0077] In this embodiment, by adjusting the projection mode through the detection module or the adjustment module, the content on the screen of the sending end 21 can be better displayed on the screen of the receiving end 22, thereby ensuring the projection effect.

[0078] Optionally, the control module of the data transmission device 23 further includes a shared clock module, which is connected to the audio encoder and the video encoder respectively. The function of the shared clock module is to provide clock signals to the audio encoder and the video encoder respectively, so that the audio encoder and the video encoder can synchronize the audio stream and the video stream based on the clock signal.

[0079] In this embodiment, the shared clock module provides clock signals to the audio encoder and video encoder, enabling them to encode with reference to the same time base. This ensures that the second audio data and the second video data are time-aligned during the encoding process, thereby avoiding audio-visual asynchrony in the second audio and video data, improving the quality of the second audio and video data, and thus guaranteeing the screen projection effect.

[0080] Optionally, the wireless transmission module of the data transmission device 23 further includes a transmission feedback module. The transmission feedback module is connected to the control module and is used to monitor whether the transmission parameters fluctuate during the transmission of the second audio and video data by the wireless transmission module. When the transmission parameters fluctuate, the feedback module provides feedback on the fluctuation information to the control module so that the control module can adjust the transmission configuration according to the fluctuation information.

[0081] In this embodiment, since the data transmission device 23 and the receiving end 22 are wirelessly connected, the wireless transmission module is susceptible to interference during the transmission of the second audio and video data to the receiving end 22, causing fluctuations in transmission parameters. These transmission parameters include at least the packet loss rate and latency during data transmission. When transmission parameters fluctuate, it indicates that packet loss or transmission delay has occurred during the transmission of the second audio and video data. This can lead to stuttering or delays in screen mirroring, thus affecting the screen mirroring effect.

[0082] The transmission feedback module monitors transmission parameters during the transmission of the second audio and video data from the wireless transmission module to the receiver 22. In the event of fluctuations, it feeds back fluctuation information to the control module. This fluctuation information characterizes the degree of fluctuation in transmission parameters, specifically the packet loss rate and latency. Based on this fluctuation information, the control module adjusts the transmission configuration (e.g., reducing the encoding rate), thereby reducing the amount of data transmitted from the wireless transmission module to the receiver 22. This reduces the packet loss rate and latency, ultimately improving data transmission quality and ensuring optimal screen projection.

[0083] Optionally, the data transmission device 23 also includes a power supply interface, which is connected to the transmitter 21 via a power supply line. The transmitter 21 supplies power to the data transmission device 23 by supplying electrical energy to the power supply interface.

[0084] It is understood that, in addition to being powered by connecting the data transmission device 23 to the transmitter 21 via a power supply interface, it can also be powered by an external power adapter. In this embodiment, the data transmission device 23 is powered by a power supply interface, which is more convenient than using an external power adapter and improves the user experience.

[0085] Furthermore, the power supply interface of the data transmission device 23 may include a USB interface and / or a Type-C interface. Since USB and Type-C interfaces are the mainstream interfaces for electronic devices, setting the power supply interface of the data transmission device 23 to a USB interface and / or a Type-C interface allows the data transmission device 23 to be compatible with most electronic devices, thereby ensuring the universality of the data transmission device 23 when powered and improving the user experience.

[0086] In this embodiment, the data transmission device 23 has both an HDMI interface and a power supply interface. When the data transmission device 23 is connected to the transmitting end 21 through the HDMI interface and the power supply interface, the transmitting end 21 supplies power to the data transmission device 23 through the power supply interface, and transmits data to the data transmission device 23 through the HDMI interface. This enables the transmitting end 21 to wirelessly connect to the receiving end 22 via the data transmission device 23 and project its screen to the receiving end 22. It is worth noting that when the data transmission device 23 is only connected to the transmitting end 21 through the power supply interface, and the HDMI interface of the data transmission device 23 is not connected to the transmitting end 21, the power supply interface of the data transmission device 23 can serve as both a power supply interface and a data transmission interface. In this case, the data transmission device 23 can implement the wireless screen mirroring scheme in related technologies to achieve screen mirroring from the transmitting end 21 to the receiving end 22. Specific schemes can be found in the aforementioned wireless screen mirroring schemes in related technologies, and will not be elaborated upon here.

[0087] Optionally, the data transmission device 23 further includes a power management module, which is connected to the power interface and also to the conversion module, control module, and wireless transmission module, respectively, for distributing the electrical energy delivered by the transmitter 21 to the power interface to the conversion module, control module, and wireless transmission module.

[0088] In this embodiment, the power management module provides a stable power supply to each module in the data transmission device 23, thereby ensuring the stable operation of the data transmission device 23 and improving the stability of screen projection.

[0089] The foregoing description and accompanying drawings fully illustrate embodiments of this disclosure to enable those skilled in the art to practice them. Other embodiments may include structural, logical, electrical, procedural, and other changes. The embodiments represent only possible variations. Individual components and functions are optional unless explicitly required, and the order of operation may vary. Parts and features of some embodiments may be included in or replace parts and features of other embodiments. Moreover, the terminology used in this application is for describing embodiments only and is not intended to limit the claims. As used in the description of embodiments and claims, the singular forms “a,” “an,” and “the” are intended to equally include the plural forms unless the context clearly indicates otherwise. Similarly, the term “and / or” as used in this application means including one or more of the associated listed items and all possible combinations thereof. Additionally, when used in this application, the term "comprise" and its variations "comprises" and / or "comprising" refer to the presence of stated features, integrals, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components, and / or groups thereof. Without further limitations, an element defined by the phrase "comprises a..." does not exclude the presence of other identical elements in the process, method, or apparatus that includes said element. In this document, each embodiment may focus on the differences from other embodiments, and similar or identical parts between embodiments can be referred to mutually. For methods, products, etc., disclosed in the embodiments, if they correspond to the method section disclosed in the embodiments, the relevant parts can be referred to the description of the method section.

[0090] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of this application. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0091] The methods and products (including but not limited to devices and equipment) disclosed in the embodiments herein can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For instance, the division of units may be merely a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to implement this embodiment according to actual needs. In addition, the functional units in the embodiments of this application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0092] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than that shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. In the descriptions corresponding to the flowcharts and block diagrams in the accompanying drawings, the operations or steps corresponding to different blocks may also occur in a different order than disclosed in the description; sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. Each block in a block diagram and / or flowchart, and combinations of blocks in a block diagram and / or flowchart, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

Claims

1. A data transmission device, characterized in that, include: HDMI interface, conversion module, control module, and wireless transmission module; among which: The HDMI interface is connected to the transmitting end via an HDMI cable. The configuration information of the data transmission device is sent to the transmitting end via the HDMI interface, so that the transmitting end sends first audio and video data matching the configuration information to the data transmission device via the HDMI interface. The conversion module is connected to the HDMI interface and is used to convert the first audio and video data sent by the transmitting end through the HDMI interface into first audio data and first video data; the conversion module is also connected to the control module and is used to send the first audio data and the first video data to the control module. The control module, connected to the wireless transmission module, is used to process the first audio data and the first video data to obtain second audio and video data adapted to the transmission configuration, and to send the second audio and video data to the wireless transmission module; wherein, the transmission configuration is negotiated between the data transmission device and the receiving end; The wireless transmission module establishes a wireless connection with the receiving end and is used to send the second audio and video data to the receiving end based on the wireless connection, so that the receiving end can display the second audio and video data.

2. The apparatus according to claim 1, characterized in that, The control module includes an audio module, a video module, an audio encoder, a video encoder, and a multiplexer; wherein: The audio module, connected to the conversion module and the audio encoder, is used to convert the first audio data sent by the conversion module into second audio data adapted to the transmission configuration according to the transmission configuration, and transmit the second audio data to the audio encoder. The audio encoder is used to encode and compress the second audio data into an audio stream; The video module, connected to the conversion module and the video encoder, is used to convert the first video data sent by the conversion module into second video data adapted to the transmission configuration according to the transmission configuration, and transmit the second video data to the video encoder. The video encoder is used to encode and compress the second video data into a video stream; The multiplexer is connected to the audio encoder, the video encoder, and the wireless transmission module, respectively, and is used to process the audio stream and the video stream to obtain the second audio and video data, and send the second audio and video data to the wireless transmission module.

3. The apparatus according to claim 1, characterized in that, The control module includes a detection module, which is used to detect the type of the first video data sent by the conversion module, so as to adjust the screen projection mode of the data transmission device according to the type of the first video data. The screen projection modes include mirror mode and extended mode.

4. The apparatus according to claim 1, characterized in that, The transmission configuration includes the screen resolution and screen display ratio of the sending end, and the screen resolution and screen display ratio of the receiving end; The control module includes an adjustment module, which is used to adjust the screen projection mode of the data transmission device according to the screen resolution of the transmitting end and the screen resolution of the receiving end; the adjustment module is also used to adjust the screen projection mode of the data transmission device according to the screen display ratio of the transmitting end and the screen display ratio of the receiving end. The screen projection modes include mirror mode and extended mode.

5. The apparatus according to claim 2, characterized in that, The control module further includes a shared clock module; wherein: The shared clock module is connected to the audio encoder and the video encoder respectively, and is used to provide clock signals to the audio encoder and the video encoder respectively, so that the audio encoder and the video encoder synchronize the audio stream and the video stream based on the clock signal.

6. The apparatus according to claim 1, characterized in that, The wireless transmission module includes a transmission feedback module; wherein: The transmission feedback module, connected to the control module, is used to feed back fluctuation information to the control module when fluctuations in transmission parameters are detected during the transmission of the second audio and video data by the wireless transmission module, so that the control module can adjust the transmission configuration according to the fluctuation information.

7. The apparatus according to claim 1, characterized in that, The first audio and video data is in RGB or YUV format, the first audio data is in I2S or USB format, and the first video data is in MIPI, DVP or USB format.

8. The apparatus according to claim 1, characterized in that, The device further includes a power supply interface; wherein: The power supply interface is connected to the transmitting end via a power supply line; the transmitting end supplies power to the power supply interface via the power supply line to power the data transmission device; the power supply interface is a USB interface or a Type-C interface.

9. The apparatus according to claim 8, characterized in that, The device further includes a power management module; wherein: The power management module is connected to the power supply interface and is also connected to the conversion module, the control module, and the wireless transmission module, respectively, for distributing the power from the power supply interface to the conversion module, the control module, and the wireless transmission module.

10. A data transmission system, characterized in that, include: The device comprises a transmitter, a receiver, and a data transmission apparatus as described in any one of claims 1 to 9; wherein the data transmission apparatus is connected to the transmitter, a wireless connection is established between the data transmission apparatus and the receiver, and the transmitter projects a screen to the receiver through the data transmission apparatus.

Images