Wireless screen projection method and screen projection auxiliary device

Abstract

The application discloses a wireless screen projection method and a screen projection auxiliary device, and is applied to the field of communication. In the method, an I2S format audio data is converted into target format audio data by a preprocessing module, and the target format audio data is sent to an SoC, and the SoC does not need to provide an I2S interface. Therefore, the selection of the SoC can ignore the limitation that the SoC must have the I2S function, so that some SoCs without the I2S function but with low cost can be selected, and the total cost and the selection difficulty of the SoC are reduced.

Description

Technical Field

[0001] This application relates to the field of communication technology, and in particular to a wireless screen projection method and screen projection auxiliary device. Background Technology

[0002] In daily life and work, we often encounter scenarios where we need to transmit the screen and audio of devices such as laptops, tablets, and mobile phones to a large screen for public display, such as meetings, speeches, and reports. This is where screen projection technology comes in. Early on, people mainly used wired connections to connect mobile devices to large screens. This method was limited by cable length and couldn't achieve flexible connections between mobile devices and the screen. Using screen projection aids based on WiFi wireless transmission can overcome the constraints of cables, enabling flexible connections between mobile devices and screens over a wider area. Furthermore, people are now very price-sensitive when it comes to consumer products, which requires cost reduction from the initial product design stage.

[0003] In existing technologies, the audio / video conversion chip (referred to as the conversion chip) inside the screen projection auxiliary device directly connects to the SoC (System-on-a-Chip) via MIPI (Mobile Industry Processor Interface) and I2S (Inter-ICSound or Integrated Interchip Sound) interfaces to transmit video and audio data to the SoC respectively. The SoC then processes the data and transmits it to the large screen via WiFi, realizing the wireless screen projection function. However, some low-cost SoCs do not have I2S functionality. Over-reliance on the direct connection between the SoC's I2S interface and the conversion chip's I2S interface to process audio data would significantly increase costs and complicate SoC selection.

[0004] In view of this, we currently hope to provide a low-cost wireless screen projection product. Summary of the Invention

[0005] The purpose of this invention is to provide a low-cost wireless screen projection method and screen projection auxiliary device.

[0006] In a first aspect, the present invention provides a wireless screen projection method, wherein the method is executed by a screen projection auxiliary device, the screen projection auxiliary device comprising an audio / video conversion chip, a preprocessing module, and a System-on-a-Chip (SoC). The method includes: S1, the audio / video conversion chip receiving raw video data and raw audio data of the content to be projected from a mobile device; S2, the audio / video conversion chip converting the raw video data into MIPI format video data and sending the MIPI format video data to the SoC; S3, the audio / video conversion chip converting the raw audio data into I2S format audio data and sending the I2S format audio data to the preprocessing module; S4, the preprocessing module converting the I2S format audio data into a target format audio data and sending the target format audio data to the SoC; S5, the SoC processing the MIPI format video data and the target format audio data, and wirelessly transmitting the processed video data and processed audio data to a display device.

[0007] In some embodiments, the preprocessing module is a digital-to-analog converter (DAC). Accordingly, in step S4, the I2S format audio data is a digital signal, and the target format audio data is an analog signal. In some embodiments, the SoC includes an audio codec, which includes an audio input interface, an DAC, and a digital signal processor. Based on this, step S5 further includes: S51, receiving analog audio data through the audio input interface; S52, converting the analog audio data from an analog signal to a digital signal through the DAC to obtain audio data to be processed; S53, processing the audio data to be processed by the digital signal processor to obtain processed audio data; S54, processing MIPI format video data by the SoC to obtain processed video data; S55, transmitting the processed video data and processed audio data wirelessly to a display device by the SoC.

[0008] In some embodiments, the preprocessing module is an MCU, and correspondingly, in step S4, the target format is a UART format.

[0009] In some embodiments, in step S1, the audio / video conversion chip connects to the mobile device via a Type-C interface and receives raw video data and raw audio data via the Type-C interface.

[0010] In some embodiments, in step S5, the wireless transmission method is WiFi transmission.

[0011] Secondly, this invention provides a screen projection auxiliary device, including an audio / video conversion chip, a preprocessing module, and a System-on-Chips (SoC). The audio / video conversion chip is used to: receive raw video data and raw audio data of the content to be projected from a mobile device; convert the raw video data into MIPI format video data and send the MIPI format video data to the SoC; convert the raw audio data into I2S format audio data and send the I2S format audio data to the preprocessing module. The preprocessing module is used to: convert the I2S format audio data into a target format audio data and send the target format audio data to the SoC. The SoC is used to: process the MIPI format video data and the target format audio data, and wirelessly transmit the processed video data and processed audio data to a display device.

[0012] In some embodiments, the SoC includes an audio codec, which includes an audio input interface, an analog-to-digital converter (ADC), and a digital signal processor (DSP). The audio input interface is used to receive analog audio data. The ADC converts the analog audio data from analog signals to digital signals to obtain audio data to be processed. The DSP processes the audio data to obtain processed audio data.

[0013] In some embodiments, the preprocessing module is a digital-to-analog converter, where the I2S format audio data is a digital signal and the target format audio data is an analog signal. In some embodiments, the preprocessing module is an MCU, and correspondingly, the target format is UART format.

[0014] This invention uses a preprocessing module (e.g., a digital-to-analog converter or an MCU) to process the audio data output by the conversion chip, eliminating the need for the SoC to provide an I2S interface. This eliminates the requirement for I2S functionality in SoC selection, allowing the choice of low-cost SoCs without I2S capabilities. Although a preprocessing module (e.g., a digital-to-analog converter or an MCU) is added, the overall cost is significantly reduced compared to existing technologies, achieving a dual reduction in both overall cost and SoC selection complexity. Attached Figure Description

[0015] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the accompanying drawings used in the description of the embodiments or related technologies will be briefly introduced below.

[0016] Figure 1 This is a schematic diagram of a wireless screen mirroring scenario.

[0017] Figure 2 This is a schematic diagram of the screen projection auxiliary device provided in the embodiments of this application.

[0018] Figure 3This is a schematic diagram of a projection auxiliary device with a DAC as the preprocessing module.

[0019] Figure 4 This is a schematic diagram of a screen projection auxiliary device with an MCU as the preprocessing module.

[0020] Figure 5 This is a schematic diagram of an exemplary audio / video conversion chip.

[0021] Figure 6 This is a schematic diagram of an exemplary DAC.

[0022] Figure 7 This is a schematic diagram of an exemplary MCU.

[0023] Figure 8 This is an exemplary flowchart of the wireless screen projection method provided in the embodiments of this application.

[0024] Figure 9 This is an exemplary flowchart of a specific implementation of step S5. Detailed Implementation

[0025] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be described in detail below with reference to the accompanying drawings.

[0026] Figure 1 This is a schematic diagram illustrating a wireless screen mirroring scenario. For example... Figure 1 As shown, scenario 100 includes a mobile device 110, a projection assist device 120, and a display device 130. The projection assist device 120 is connected between the mobile device 110 and the display device 130.

[0027] Mobile device 110 includes laptops, tablets, smartphones, etc. The audio and video data played by the display device 130 terminal originates from mobile device 110. Mobile device 110 is connected to screen mirroring auxiliary device 120 to transmit the audio and video data to be mirrored to display device 130 with the help of screen mirroring auxiliary device 120.

[0028] The screen mirroring auxiliary device 120 performs a series of processes on the audio and video data from the mobile device 110 so that the display device 130 can play the audio and video data. More details about the screen mirroring auxiliary device 120 can be found on [website / platform name - likely a website or service]. Figures 2-5 The relevant descriptions can be found here, but will not be elaborated upon here.

[0029] Display device 130 can be any type of device with display capabilities, such as a television, a large screen, or a display array. Typically, display device 130 has a larger display area than mobile device 110. For example, display device 130 has a main control chip that drives the display components (screen), and also features WiFi functionality and an audio processing module. It can process video and audio data sent from the SoC and drive the screen and speakers to play the data, thereby enabling wireless screen projection.

[0030] Figure 2 This is an exemplary block diagram of the screen projection auxiliary device provided in the embodiments of this application. Figure 2 As shown, the screen projection auxiliary device 120 includes an audio / video conversion chip 122, a preprocessing module 124, and a SoC 126. The preprocessing module 124 is connected between the audio / video conversion chip 122 and the SoC 126.

[0031] The audio / video conversion chip 122 is used to: receive raw video data and raw audio data of the content to be projected from the mobile device 110; convert the raw video data into MIPI format video data and send the MIPI format video data to the SoC 126; convert the raw audio data into I2S format audio data and send the I2S format audio data to the preprocessing module 124.

[0032] The preprocessing module 124 is used to convert I2S format audio data into target format audio data and send the target format audio data to SoC 126.

[0033] SoC 126 is used to process MIPI format video data and target format audio data, and then wirelessly transmit the processed video and audio data to display device 130. SoC (System on Chip) is a low-cost main control chip, such as the Beijing Junzheng T23 chip, which is equipped with a MIPI interface, a wireless communication interface (e.g., a WiFi interface), a built-in audio codec, and a UART interface.

[0034] In some embodiments, such as Figure 3 As shown, the preprocessing module 124 is a digital-to-analog converter (DAC). Correspondingly, the I2S format audio data is a digital signal, while the target format audio data is an analog signal. A DAC is a device that converts digital signals into analog signals. In this embodiment, the DAC is used to convert digital audio data into analog audio data and output the analog audio data to the SoC. The audio conversion via the DAC is equivalent to connecting a microphone to the SoC.

[0035] In some embodiments, such as Figure 4 As shown, the preprocessing module 124 is an MCU (Microcontroller Unit, also known as a single-chip microcomputer or microcontroller), and correspondingly, the target format is UART (Universal Asynchronous Receiver / Transmitter). UART is a commonly used serial communication protocol.

[0036] For more details about the screen mirroring auxiliary device 120 and its modules, please refer to [link / reference]. Figure 8 And its related descriptions.

[0037] Figure 5 This is a schematic diagram of an exemplary audio / video conversion chip. (For example...) Figure 5 As shown, the converter chip is equipped with a USB interface (consisting of pins in the red box), a MIPI interface (consisting of pins in the blue box), and an I2S interface (consisting of pins in the green box).

[0038] Figure 6 This is a schematic diagram of an exemplary DAC. (Example:) Figure 6 As shown, the DAC is configured with an I2S interface (consisting of the pins in the red box) and an analog audio data output interface (consisting of the pins in the blue box).

[0039] Figure 7 This is a schematic diagram of an exemplary MCU. (e.g.) Figure 7 As shown, the MCU is configured with a UART interface (consisting of the pins in the red box) and an I2S interface (consisting of the pins in the blue box).

[0040] Figure 8 This is an exemplary flowchart of the wireless screen projection method provided in the embodiments of this application. Figure 8 As shown, the method includes steps S1 to S5.

[0041] S1, the audio-video conversion chip receives the raw video data and raw audio data of the content to be projected from the mobile device.

[0042] S2, the audio / video conversion chip converts the raw video data into MIPI format video data, and sends the MIPI format video data to the SoC.

[0043] S3, the audio-video conversion chip converts the raw audio data into I2S format audio data, and sends the I2S format audio data to the preprocessing module.

[0044] S4, the preprocessing module converts the I2S format audio data into the target format audio data, and sends the target format audio data to the SoC.

[0045] It should be understood that the target format can be any audio format other than I2S, as long as the audio format helps reduce the cost of the SoC.

[0046] The S5, powered by the SoC, processes MIPI format video data and target format audio data, and then wirelessly transmits the processed video and audio data to the display device.

[0047] For example, the SoC can process MIPI format video data and target format audio data according to any suitable screen mirroring protocol. The relevant processing logic of the screen mirroring protocol can be pre-stored in the screen mirroring auxiliary device.

[0048] After receiving the data transmitted from the SoC, the main control chip of the display device transmits the video data to the display screen through the display driver interface for playback, and drives the speaker (loudspeaker) through the audio processing module for playback.

[0049] In some embodiments, the preprocessing module is a digital-to-analog converter. Accordingly, in step S4, the I2S format audio data is a digital signal, and the target format audio data is an analog signal.

[0050] In some embodiments, the SoC includes an audio codec, which includes an audio input interface, an analog-to-digital converter (ADC), and a digital signal processor. Accordingly, step S5 further includes... Figure 9 The steps S51 to S55 are shown.

[0051] S51 receives analog audio data via the audio input interface.

[0052] S52 uses an analog-to-digital converter to convert analog audio data from analog signals into digital signals, thus obtaining the audio data to be processed.

[0053] S53 is a digital signal processor that processes the audio data to be processed to obtain the processed audio data.

[0054] Referring to the foregoing, the digital processor can process the audio data to be processed according to any suitable screen mirroring protocol.

[0055] S54 is used by the SoC to process MIPI format video data to obtain processed video data.

[0056] As mentioned earlier, the SoC can process MIPI format video data according to any suitable screen mirroring protocol.

[0057] The S55, powered by the SoC, wirelessly transmits the processed video and audio data to the display device.

[0058] In some embodiments, the preprocessing module is an MCU. Accordingly, in step S4, the target format is UART format. The difference between the MCU and the DAC in their operation is that the MCU and the SOC are connected via a UART interface, converting I2S format data into UART format data without going through the digital-to-analog-to-digital conversion, making the workflow simpler.

[0059] In some embodiments, in step S1, the audio / video conversion chip connects to the mobile device via a Type-C interface and receives raw video and audio data via the Type-C interface. Since most mobile devices on the market, such as tablets and mobile phones, do not have HDMI (High-Definition Multimedia Interface) or USB Type-A interfaces and primarily use USB Type-C interfaces, using a Type-C interface expands the application scope of wireless screen projection technology compared to using HDMI or USB Type-A interfaces to connect mobile devices and projection auxiliary devices.

[0060] In some embodiments, the wireless transmission method in step S5 is WiFi transmission. Specifically, the SoC can connect to a WiFi module via a WiFi interface, and the projection auxiliary device and the display device are interconnected via their respective WiFi modules. Based on this, the SoC can send the processed video data and processed audio data to the display device via the WiFi module.

[0061] It should be noted that the above description of the process is for illustrative purposes only and does not limit the scope of this application. Those skilled in the art can make various modifications and changes to the process under the guidance of this application.

[0062] More details about the wireless screen projection method and its steps can be found on [website / platform name]. Figure 8 The relevant descriptions can be found here, so I will not repeat them here.

[0063] Unless otherwise defined, the terms used herein should have the ordinary meaning as understood by those skilled in the art. Unless otherwise specified, the terms "first," "second," "third," and similar words used herein do not indicate any order, quantity, or importance, but are merely used to distinguish different entities. The terms "comprising," "including," or any variations thereof are intended to cover non-exclusive inclusion, such that a process, method, product, or apparatus that comprises a list of elements may include not only the elements expressly listed, but also other elements not expressly listed, such as elements inherent to such process, method, product, or apparatus.

[0064] Finally, it should be noted that the above embodiments are only some embodiments of this application and not all embodiments; in the various embodiments of this application, unless otherwise specified or logically conflicting, the terms and / or descriptions between different embodiments are consistent and can be referenced by each other, and the technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationship; although the technical solutions of this application have been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the foregoing embodiments or make equivalent substitutions for some of the technical features, and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the protection scope of the technical solutions of the various embodiments of this application.

Claims

1. A wireless screen projection method, characterized in that, The method is executed by a screen projection auxiliary device, which includes an audio / video conversion chip, a preprocessing module, and a SoC. The method includes: S1, the audio-video conversion chip receives the raw video data and raw audio data of the content to be projected from the mobile device; S2, the audio / video conversion chip converts the raw video data into MIPI format video data, and sends the MIPI format video data to the SoC; S3, the audio-video conversion chip converts the raw audio data into I2S format audio data, and sends the I2S format audio data to the preprocessing module; S4, the preprocessing module converts the I2S format audio data into the target format audio data and sends the target format audio data to the SoC; The S5, powered by the SoC, processes MIPI format video data and target format audio data, and then wirelessly transmits the processed video and audio data to the display device.

2. The wireless screen projection method as described in claim 1, characterized in that, The preprocessing module is a digital-to-analog converter; in step S4, the audio data in I2S format is a digital signal, and the audio data in the target format is an analog signal.

3. The wireless screen projection method as described in claim 1, characterized in that, The SoC includes an audio codec, which includes an audio input interface, an analog-to-digital converter, and a digital signal processor; Step S5 further includes: S51 receives analog audio data via the audio input interface; S52 uses an analog-to-digital converter to convert analog audio data from analog signals into digital signals, thus obtaining the audio data to be processed; S53 is a digital signal processor that processes the audio data to be processed to obtain the processed audio data. S54, the SoC processes the MIPI format video data to obtain the processed video data; The S55, powered by the SoC, wirelessly transmits the processed video and audio data to the display device.

4. The wireless screen projection method as described in claim 1, characterized in that, The preprocessing module is an MCU; in step S4, the target format is UART format.

5. The wireless screen projection method as described in claim 1, characterized in that, In step S1, the audio / video conversion chip connects to the mobile device via a Type-C interface and receives raw video and audio data via the Type-C interface.

6. The wireless screen projection method as described in claim 1, characterized in that, In step S5, the wireless transmission method is WiFi transmission.

7. A screen projection auxiliary device, characterized in that, include: Audio-video conversion chip, used to: receive raw video data and raw audio data of the content to be projected from the mobile device; The raw video data is converted into MIPI format video data and sent to the SoC; the raw audio data is converted into I2S format audio data and sent to the preprocessing module. The preprocessing module is used to convert I2S format audio data into target format audio data and send the target format audio data to the SoC. The SoC is used to process MIPI format video data and target format audio data, and to transmit the processed video data and processed audio data wirelessly to the display device.

8. The screen projection auxiliary device as described in claim 7, characterized in that, The preprocessing module is a digital-to-analog converter; I2S format audio data is a digital signal, while the target format audio data is an analog signal.

9. A screen projection auxiliary device as described in claim 7, characterized in that, The SoC includes an audio codec, which comprises an audio input interface, an analog-to-digital converter, and a digital signal processor, wherein: The audio input interface is used to receive analog audio data; Analog-to-digital converters are used to convert analog audio data from analog signals to digital signals to obtain the audio data to be processed; A digital signal processor is used to process audio data to obtain processed audio data.

10. A screen projection auxiliary device as described in claim 7, characterized in that, The preprocessing module is an MCU, and the target format is UART.

Images