Screen projection devices, screen projection methods, chip modules, electronic devices and storage media

By physically connecting to the terminal device via the Type-C interface, and directly outputting DP signals to the display screen using the main control chip and signal converter, the problems of high latency, poor image quality and compatibility of terminal device screen projection are solved, and stable screen projection and control with low latency and high image quality are achieved.

CN117082279BActive Publication Date: 2026-11-10UNIGROUP SPREADTRUM COMM HUIZHOU CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202311101084.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-08-29
Publication Date
2026-11-10
Estimated Expiration
2043-08-29

AI Technical Summary

Technical Problem

Current terminal devices require third-party software for data transmission when casting, resulting in high latency, poor image quality, and severe impact from wireless network fluctuations. Compatibility issues also lead to casting failures.

Method used

It physically connects to the terminal device via a Type-C interface, uses a main control chip and signal converter to achieve signal conversion, and directly outputs DP signal to the display screen, avoiding the involvement of the central processing unit and the impact of network fluctuations.

Benefits of technology

Reduce screen casting latency, improve image quality, enhance compatibility, and achieve stable screen casting and control operation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117082279B_ABST
    Figure CN117082279B_ABST
Patent Text Reader

Abstract

This application proposes a screen projection device, screen projection method, chip module, electronic device, and storage medium, which can reduce the latency of projected content and improve the quality of projected content while ensuring the compatibility of terminal devices, thereby enhancing the user experience. The screen projection device includes: a main control chip for acquiring the descriptor of the terminal device; the main control chip is also used to disconnect from the terminal device in response to the device type indicated by the descriptor matching a preset device type; the main control chip is also used to send a line switching signal to a line selector; the line selector is used to connect a first path and disconnect a second path; the main control chip is also used to send a working mode signal to the terminal device through a fourth path until reconnection is completed; a signal converter is used to receive a DP signal from a receiving pin and send a MIPI signal and an audio signal to the main control chip; the main control chip is also used to output the MIPI signal and the audio signal to a display screen.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] This application relates to the field of terminal technology, and in particular to a screen projection device, screen projection method, chip module, electronic device and storage medium. [Background Technology]

[0002] Currently, when a terminal device needs to project its content, it typically places both the terminal device and the projection device on the same local area network (LAN). Then, third-party software on the terminal device projects the desired content onto the projection device. This projection method has two main problems: First, the terminal device needs to use third-party software to retrieve the necessary data from its graphics card, package it, and send it. When the CPU load is high, the latency of this process becomes high, and the reliability of data transmission deteriorates, resulting in high latency and poor image quality. Simultaneously, the projected content needs to be transmitted wirelessly; fluctuations in the LAN can also lead to high latency and poor image quality. Second, if the third-party software is incompatible with the terminal device, projection will fail. [Summary of the Invention]

[0003] This application provides a screen projection device, screen projection method, chip module, electronic device, and storage medium, which can reduce the latency of projected content and improve the quality of projected content while ensuring the compatibility of terminal devices, thereby enhancing the user experience.

[0004] In a first aspect, embodiments of this application provide a screen projection device, which includes: a Type-C interface, a line selector, a signal converter, a main control chip, and a display screen. The Type-C interface, the line selector, the signal converter, and the main control chip are sequentially connected to form a first path. The Type-C interface, the line selector, and the main control chip are sequentially connected to form a second path. The Type-C interface and the main control chip are connected to form a third path and a fourth path. The first path is normally open, and the second, third, and fourth paths are normally closed. The main control chip is in host mode.

[0005] The main control chip is used to obtain the descriptor of the terminal device through the second path and the third path in response to the terminal device connecting to the Type-C interface.

[0006] The main control chip is also configured to disconnect itself from the terminal device in response to the device type indicated by the descriptor matching a preset device type.

[0007] The main control chip is also used to send a line switching signal to the line selector;

[0008] The line selector is used to activate the first path and deactivate the second path in response to the line switching signal;

[0009] The main control chip is also used to send a working mode signal to the terminal device through the fourth channel when the terminal devices are reconnected until the reconnection is completed. The working mode signal is used to indicate that the screen projection device supports receiving the display port DP signal and the target receiving pin in the Type-C interface for receiving the DP signal.

[0010] The signal converter is used to receive a target DP signal from the terminal device from the target receiving pin, convert the target DP signal into a Mobile Industry Processor Interface (MIPI) signal and an audio signal, and send the MIPI signal and the audio signal to the main control chip.

[0011] The main control chip is also used to output the MIPI signal and the audio signal to the display screen;

[0012] The display screen is used to play the audio signal according to the MIPI signal and the audio signal.

[0013] In this embodiment, the terminal device is connected to the Type-C interface of the projection device, which can be considered as establishing a physical connection between the terminal device and the projection device based on the Type-C interface. First, the main control chip in the projection device needs to obtain the descriptor of the terminal device through the established physical connection to determine the device type of the terminal device. If the device type of the terminal device matches the preset device type, it can be considered that the content played by the terminal device needs to be projected. At this time, the main control chip can disconnect the physical connection with the terminal device, control the line selector to switch from directly connecting to the main control chip to directly connecting to the signal converter and then indirectly connecting to the main control chip, thereby preparing for subsequent signal conversion of the DP signal from the terminal device; then re-establish the connection with the terminal device, informing the terminal device that the projection device currently supports DP signal input and the target receiving pin for receiving DP signal input, so that the terminal device sends the target DP signal to the target receiving pin. After the reconnection is completed, the target DP signal sent by the terminal device can enter the signal converter through the line selector, and the signal converter converts the target DP signal into a MIPI signal and an audio signal. The signal converter, upon receiving the MIPI and audio signals, sends them to the main control chip. The main control chip then sends these signals to the display screen, which can then play content based on the MIPI and audio signals. This is equivalent to projecting the content from the terminal device onto the projection device. In other words, the terminal device physically connects to the projection device via a Type-C interface, and projection is performed based on this physical connection. Firstly, most terminal devices support the Type-C interface, ensuring good compatibility for the projection device. Secondly, based on the physical connection, the terminal device can directly output the DP signal carrying image and audio information without the need for a central processing unit. Furthermore, the DP signal can be stably transmitted via this physical connection, unaffected by external network fluctuations. This results in low latency and high image quality when the projection device plays the projected content.

[0014] Optionally, the main control chip is also used to configure the device mode as a human-machine interface device;

[0015] The main control chip is also used to switch the host mode to the device mode configured as the human-machine interface device.

[0016] In this embodiment of the application, before the main control chip disconnects the physical connection with the terminal device, the main control chip can configure the device mode as a human-machine interface device and switch from the host mode to the aforementioned device mode, thereby preparing for the subsequent implementation of the screen projection device's control operation on the terminal device.

[0017] Optionally, the human-machine interface device includes at least one or more combinations of the following: mouse, keyboard, touchpad, trackball.

[0018] In this embodiment, the projection device can simulate one or more of a mouse, keyboard, touchpad, and trackball, thereby enhancing the user experience during control operations.

[0019] Optionally, the main control chip is further configured to, in response to detecting a control operation targeting a projection object in the projection interface, send a corresponding control command to the terminal device through the third channel, wherein the control command is used to control the terminal device to perform a corresponding target operation on the projection object.

[0020] In this embodiment, when the main control chip detects a control operation on the projection interface targeting the projection object, it sends a corresponding control command to the terminal device based on the physical connection between the projection device and the terminal device. This improves the transmission stability of the control command and reduces the latency when the projection device controls the terminal device. Simultaneously, it can control any projection object on the terminal device, thereby enhancing the user experience.

[0021] Optionally, the main control chip is also used to send an interconnection prompt message to the display screen, the interconnection prompt message being used to prompt the user whether screen projection / return control is permitted;

[0022] The display screen is also used to display the interconnection notification message.

[0023] In this embodiment, before the main control chip configures the device mode as a human-machine interface device, the main control chip can output an interconnection prompt message through the display screen. This interconnection prompt message is used to prompt the user whether to allow the screen projection device to perform screen projection / return control operation. Only when the user confirms that screen projection / return control operation is allowed will the line selector be controlled to switch the path, and the main control chip will be controlled to switch to device mode. This avoids the normal use of other functions between the screen projection device and the terminal device when the terminal device is physically connected to the screen projection device but does not perform screen projection.

[0024] Secondly, embodiments of this application provide a screen projection method, applied to the screen projection device described in the first aspect, the method comprising:

[0025] In response to the terminal device connecting to the Type-C interface, the main control chip obtains the descriptor of the terminal device through the second and third paths;

[0026] In response to the device type indicated by the descriptor matching a preset device type, the main control chip controls itself to disconnect from the terminal device;

[0027] The main control chip sends a line switching signal to the line selector, and the line switching signal is used to control the line selector to turn on the first path and disconnect the second path.

[0028] When reconnecting between the terminal devices, the main control chip sends a working mode signal to the terminal device through the fourth channel until the reconnection is completed. The working mode signal is used to indicate that the screen projection device supports receiving the display port DP signal and the target receiving pin in the Type-C interface for receiving the DP signal.

[0029] The main control chip receives MIPI signals and audio signals from the signal converter. The MIPI signals and audio signals are obtained by the signal converter after converting the target DP signal received by the target receiving pin.

[0030] The main control chip outputs the MIPI signal and the audio signal to the display screen, and the MIPI signal and the audio signal are used for playback on the display screen.

[0031] Optionally, before the main control chip disconnects itself from the terminal device, the method further includes:

[0032] The main control chip configures the device mode as a human-machine interface device.

[0033] The main control chip switches the host mode to the device mode configured as the human-machine interface device.

[0034] Optionally, the human-machine interface device includes at least one or more combinations of the following: mouse, keyboard, touchpad, trackball.

[0035] Optionally, after the main control chip outputs the MIPI signal and the audio signal to the display screen, the method further includes:

[0036] In response to detecting a control operation targeting the projection object in the device mode, the main control chip sends a corresponding control command to the terminal device through the third channel. The control command is used to control the terminal device to perform a corresponding target operation on the projection object.

[0037] Optionally, before the main control chip configures the device mode to a human-machine interface device, the method further includes:

[0038] The main control chip sends an interconnection prompt message to the display screen, which is used to prompt the user whether screen mirroring / return control is allowed;

[0039] In response to the interconnection confirmation message, the main control chip configures the device mode as the human-machine interface device.

[0040] Thirdly, embodiments of this application provide a chip module, the chip module being used for a memory for storing computer program instructions and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the chip module is triggered to execute the steps of the method as described in any embodiment of the second aspect.

[0041] Fourthly, embodiments of this application provide an electronic device, the electronic device including a memory for storing computer program instructions and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to perform the steps of the method as described in any embodiment of the second aspect.

[0042] Fifthly, embodiments of this application provide a computer-readable storage medium for storing computer instructions that, when a computer is run, cause the computer to perform the steps of the method as described in any embodiment of the second aspect.

[0043] It should be understood that the second to fifth aspects of the embodiments of the present invention are consistent with the technical solutions of the first aspect of the embodiments of the present invention, and the beneficial effects achieved by each aspect and the corresponding feasible implementation are similar, and will not be described again. [Attached Image Description]

[0044] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this specification. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0045] Figure 1 This is a schematic diagram of the structure of a screen projection device provided in an embodiment of this application;

[0046] Figure 2 A flowchart illustrating a screen mirroring method provided in an embodiment of this application;

[0047] Figure 3 A schematic diagram illustrating a process for configuring and switching to device mode according to an embodiment of this application;

[0048] Figure 4 A flowchart illustrating a feedback control method provided in an embodiment of this application;

[0049] Figure 5 A schematic diagram illustrating a process for confirming screen mirroring / control return, provided as an embodiment of this application;

[0050] Figure 6 A flowchart illustrating a screen projection / control method provided in an embodiment of this application;

[0051] Figure 7 This is a schematic diagram of the structure of a chip module provided in an embodiment of this application;

[0052] Figure 8 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application.

Detailed Implementation Methods

[0053] To better understand the technical solutions in this specification, the embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0054] It should be understood that the described embodiments are merely some, not all, of the embodiments in this specification. All other embodiments obtained by those skilled in the art based on the embodiments in this specification without inventive effort are within the scope of protection of this specification.

[0055] The terminology used in the embodiments of this application is for the purpose of describing particular embodiments only and is not intended to be limiting of this specification. The singular forms “a,” “the,” and “the” used in the embodiments of this application and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise.

[0056] The following is a description of each pin of the Type-C interface.

[0057] The Type-C interface is an implementation of the Universal Serial Bus (USB) standard. The Type-C interface has a total of 24 pins, including 4 pairs of TX / RX lines, 2 pairs of USB D+ / D- lines, one pair of SBU (Sideband Use) pins, 2 CC (Configuration Channel) pins, 4 VBUS (Voltage Bus) pins, and 4 ground pins.

[0058] The four TX / RX pairs are primarily used to support multi-functional and high-speed data transmission. Their functions include: First, data transmission. The TX / RX pairs are used for bidirectional data transmission, supporting high-speed data transfer protocols such as USB 3.0, USB 3.1, DisplayPort (DP), and High-Definition Multimedia Interface (HDMI). These pairs enable fast and stable data transmission, meeting the demands of high bandwidth and large data capacity. Second, video output. The TX pairs are used to transmit video signals, supporting video output functions such as connecting and outputting to devices like video monitors and displays. This allows the Type-C interface to function as both a data and video transmission interface, providing greater flexibility and functionality. Third, power delivery. Two pairs of TX / RX pairs are dedicated to power delivery and charging. They negotiate via communication with a power delivery protocol to achieve high-power output and fast charging. Fourth, audio transmission. One pair of TX / RX pairs can be used for audio transmission, supporting both digital and analog audio transmission. This pair allows connection of audio devices such as speakers and headphones, enabling audio input and output functions. In summary, by properly configuring these four pairs of TX / RX connectors, the Type-C interface can meet multiple functions such as high-speed data transmission, video output, power transmission, and audio transmission, making it a very versatile and universal interface type.

[0059] The two USB D+ / D- pairs are used for USB data transfer and charging. Their main functions include: First, USB data transfer. The D+ and D- lines are responsible for transmitting USB data signals. Through these lines, the Type-C interface can achieve high-speed USB data transfer, such as USB 3.0 and USB 3.1 protocols. Users can connect various USB devices, such as printers, mobile storage devices, keyboards, and mice, to the Type-C port for data transfer and exchange. Second, USB charging. The D+ and D- lines are also used for USB charging. By detecting the voltage and current characteristics on the lines, fast and intelligent charging can be performed on the Type-C interface. The Type-C interface supports multiple charging protocols and modes, such as USB Power Delivery (USB PD), enabling higher power charging and faster charging speeds. In short, the D+ / D- lines play a crucial role in the Type-C interface, enabling both USB data transfer and charging. This makes the Type-C interface a versatile interface, meeting various needs beyond just data transfer, including power support and charging.

[0060] A pair of SBUs primarily support power management and audio / video signal transmission. Specifically, this includes the following aspects: First, USB PD power management. The Type-C interface can send control signals through the SBU to implement the power management function of the USB PD protocol. For example, when the battery power is low, the Type-C interface can send control signals through the SBU to allow the power supply device to automatically adjust the output voltage and current for charging or fast charging. Second, HDMI and DP video signal conversion. The Type-C interface can convert HDMI or DP video signals to the Type-C interface through the SBU. This enables high-resolution, high-bitrate video transmission, supports various screen resolutions and color depths, and allows the Type-C interface to provide a better visual experience for different users. Third, audio transmission. The Type-C interface can provide audio transmission functionality through the SBU to connect audio devices to the Type-C interface. For example, headphones and other audio devices can be connected to the Type-C interface for audio output and input.

[0061] The two CC pins, CC1 and CC2, primarily function as follows: First, insertion and removal detection. CC1 and CC2 pins detect the insertion and removal of Type-C devices, helping devices promptly detect and switch connection states to improve user experience. Second, role switching and power definition. CC1 and CC2 pins identify and switch device roles, such as Power Provider (DFP) and Power Receiver (UFP), through specific voltage and resistance combinations. They also negotiate and define relevant power transmission information, such as voltage and current, enabling role switching and power definition between devices to provide flexible power supply for different usage scenarios. Third, PD protocol communication. CC1 and CC2 pins support the USB D protocol for signal transmission, negotiating appropriate voltage and current to achieve higher power charging and data transfer capabilities. This allows the Type-C interface to support fast charging, reverse power, and bidirectional power transfer. Fourth, device identification and communication. CC1 and CC2 pins enable device identification and communication. Through specific combinations of electrical and resistive components, devices can identify each other and conduct appropriate communication negotiations, enabling the Type-C interface to optimize power and data transmission settings based on the type and capabilities of the connected device.

[0062] The four VBUS lines primarily serve the following functions: First, power supply. These four VBUS lines provide the necessary voltage and current to power connected devices for normal operation, electrical functions, and data transmission. Second, power detection and negotiation. The VBUS lines detect the power requirements of connected devices and negotiate appropriate voltage and current through power negotiation protocols (such as USB PD) to meet the device's power needs. Third, fast charging. The VBUS lines support high-power fast charging, providing higher charging speeds and efficiency, saving users' charging time. Fourth, safety protection. The VBUS lines monitor the current and voltage status between the connected and charging devices, detecting short circuits, overcurrent, and other conditions to protect the safety of both the devices and the user.

[0063] The four ground wires primarily serve the following functions: First, providing electrical connection. The ground wires provide a physical connection, forming an electrical connection with other ground wires to ensure stable and reliable signal transmission between devices. Second, ensuring safe grounding. The ground wires enable devices to be safely grounded, maintaining a stable potential and preventing voltage fluctuations and static electricity buildup. Third, noise suppression and shielding. As a path for noise conduction, the ground wires suppress and shield noise, ensuring signal quality and reliability during data transmission. Fourth, providing a signal reference. These ground wires serve as a reference potential for signal transmission, ensuring that the signal can be correctly grounded and guaranteeing accurate and reliable data transmission.

[0064] Currently, since terminal devices typically have small screens, such as smartphones or tablets, in order to facilitate users' viewing of the content played on the terminal device, the terminal device can be projected onto a projection device with a larger screen, such as an in-vehicle entertainment system or a television.

[0065] The researchers in this application discovered that in related technologies, when a terminal device needs to project its content, it must be on the same Wi-Fi network as the projection device. For example, both the terminal device and the projection device are connected to the same Wireless Fidelity (WiFi) network. The terminal device then projects the content onto the projection device using its installed third-party software. This method has two main problems: First, the terminal device needs to use third-party software to obtain the necessary data from its graphics card, package it, and send it. When the CPU load is high, the latency of each process—obtaining, packaging, and sending data—increases. Furthermore, packet loss or erroneous data transmission may occur during data transmission, reducing the reliability of data transmission and resulting in high latency and poor image quality. Simultaneously, since the projected content needs to be transmitted wirelessly, fluctuations in the Wi-Fi network quality also lead to high latency and poor image quality. Second, incompatibility between the third-party software and the terminal device can cause projection failure.

[0066] In view of this, this application provides a screen projection device. On the one hand, the screen projection device achieves screen projection by physically connecting to the terminal device through its own Type-C interface. Since most terminal devices support the Type-C interface, the above-mentioned screen projection device has good compatibility. On the other hand, based on the physical connection with the screen projection device, the terminal device can directly output the DP signal carrying image and audio information without the participation of the central processing unit. At the same time, the DP signal can be stably transmitted based on the above-mentioned physical connection, so that it is not affected by external network fluctuations. As a result, the screen projection device has low latency and high playback quality when playing the screen projection content.

[0067] The technical solutions provided in the embodiments of this application will now be described in conjunction with the accompanying drawings.

[0068] Please see Figure 1 This is a schematic diagram of a screen projection device provided in an embodiment of this application. Figure 1 As shown, the projection device includes: a Type-C interface 101, a line selector 102, a signal converter 103, a main control chip 104, and a display screen 105. The Type-C interface 101, line selector 102, signal converter 103, and main control chip 104 are connected in sequence to form a first channel. The Type-C interface 101, line selector 102, and main control chip 104 are connected in sequence to form a second channel. The Type-C interface 101 and the main control chip 104 are connected to form a third channel and a fourth channel. The first channel is normally open, and the second, third, and fourth channels are normally closed. The main control chip 104 is in host mode.

[0069] The main control chip 104 is used to obtain the descriptor of the terminal device through the second and third paths in response to the terminal device connecting to the Type-C interface 101.

[0070] The main control chip 104 is also used to control itself to disconnect from the terminal device in response to the device type indicated by the descriptor matching the preset device type.

[0071] The main control chip 104 is also used to send line switching signals to the line selector 102;

[0072] Line selector 102 is used to turn on the first path and turn off the second path in response to a line switching signal;

[0073] The main control chip 104 is also used to send a working mode signal to the terminal device through the fourth channel when reconnecting between terminal devices until the reconnection is completed. The working mode signal is used to indicate that the projection device supports receiving the display port DP signal and the target receiving pin in the Type-C interface 101 for receiving the DP signal.

[0074] Signal converter 103 is used to receive target DP signal from terminal device from target receiving pin, convert target DP signal into mobile industry processor interface MIPI signal and audio signal, and send MIPI signal and audio signal to main control chip 104.

[0075] The main control chip 104 is also used to output MIPI signals and audio signals to the display screen 105;

[0076] Display screen 105 is used for playback based on MIPI signals and audio signals.

[0077] In this embodiment, the first channel of the projection device can be considered as being used to implement the projection function (i.e., receiving and converting DP signals), the second and third channels can be considered as being used to transmit USB signals, and the fourth channel corresponds to the channel formed by the CC line. In the initial state of the projection device, projection is not required by default; therefore, the first channel is normally off, the second channel is normally closed, and the third and fourth channels are normally closed regardless of whether projection is required. It should be understood that... Figure 1 The diagram only shows the connection relationships between the modules, while the modules in the first, second, third, and fourth channels are all based on two sets of differential signal lines for signal transmission (not shown).

[0078] When a terminal device connects to the Type-C interface 101 of the screen mirroring device, a physical connection is established between the terminal device and the screen mirroring device via the Type-C interface 101. The screen mirroring device is currently in host mode, while the terminal device is in device mode. First, the main control chip 104 in the screen mirroring device needs to obtain the terminal device's descriptor through the second and third channels to determine the device type. If the terminal device's device type matches a preset device type, the content being played on the terminal device is considered to require screen mirroring. For example, if the main control chip 104 identifies the terminal device as a mobile phone or tablet, it can be assumed that the mobile phone or tablet is physically connected to the current screen mirroring device for screen mirroring, thus triggering subsequent steps.

[0079] Based on this, the main control chip 104 can disconnect the physical connection with the terminal device. For example, the main control chip 104 can control its own USB interface to disconnect from the Type-C interface 101, thereby achieving the purpose of disconnecting the physical connection with the terminal device. Of course, other methods can also be used to disconnect the physical connection between the main control chip 104 and the terminal device; no particular limitation is made here. It should be understood that the main control chip 104 needs to disconnect the physical connection with the terminal device here to facilitate the subsequent reconnection process by informing the terminal device that a DP signal needs to be sent, thereby realizing the screen projection function.

[0080] After the main control chip 104 disconnects the physical connection with the terminal device, it can control the line selector 102 to disconnect the second path and close the first path. This means the line selector 102 switches from being directly connected to the main control chip 104 to being directly connected to the signal converter 103, and then indirectly connected to the main control chip 104 through the signal converter 103. This prepares the device for subsequent signal conversion of the DP signal from the terminal device. Then, the main control chip 104 re-establishes a connection with the terminal device. During this re-establishment process, it informs the terminal device through the fourth channel that the projection device currently supports DP signal input and the target receiving pin for receiving DP signal input. Here, the main control chip can use the fourth channel to inform the terminal device that the projection device is currently in 2-line DP+2-line USB mode, indicating that the projection device supports DP signal input. Other methods can also be used, and no specific restrictions are placed here. The terminal device can then determine which of its pins are connected to the target receiving pin and use these pins as target transmitting pins to send DP signals carrying image and audio data to the projection device. After reconnection, the terminal device sends a target DP signal via its graphics card and outputs it to the target transmit pin. The target receive pin in the Type-C interface 101 receives the target DP signal, which then enters the signal converter 103 via the line selector 102. The signal converter 103 converts the target DP signal into a MIPI signal and an audio signal; for example, the signal converter 103 can be a DP-to-MIPI chip. The signal converter 103, upon receiving the MIPI and audio signals, sends them to the main control chip 104. The main control chip 104 then sends the MIPI and audio signals to the display screen 105, which can then play content based on the MIPI and audio signals, effectively projecting the content from the terminal device onto a projection device.

[0081] In the above embodiments, the terminal device physically connects to the screen projection device via a Type-C interface, and performs screen projection based on this physical connection. On the one hand, most terminal devices support the Type-C interface, thus ensuring good compatibility of the screen projection device. On the other hand, based on the physical connection with the screen projection device, the terminal device can directly output DP signals carrying image and audio information without the need for a central processing unit. Simultaneously, the DP signal can be stably transmitted based on this physical connection, preventing it from being affected by external network fluctuations. This results in low latency and high playback quality when the screen projection device plays the projected content.

[0082] It should be understood that the other pins in the Type-C interface 101 of the projection device operate according to the existing mechanism, which will not be described in detail in this application.

[0083] In some embodiments, after the terminal device projects content onto the projection device, the terminal device can be controlled directly by operating the projection device, i.e., reverse control. However, in related technologies, the projection device's control of the terminal device is still based on third-party software. Once the wireless local area network fluctuates, the control delay will be high, and control can only be performed within the scope of the third-party software itself.

[0084] Therefore, in this embodiment, the main control chip 104 can be configured to simulate an input device based on hardware, thereby enabling feedback control of the terminal device. This results in low latency in the feedback operation, is not limited by third-party software, and can provide feedback control to any screen-projected object. Prior to this, the main control chip 104 needs to configure the interface device used for feedback control.

[0085] In one possible implementation, the main control chip 104 is also used to configure the device mode as a human-machine interface device; the main control chip 104 is also used to switch the host mode to the device mode configured as a human-machine interface device.

[0086] In this embodiment, before the main control chip 104 disconnects the physical connection with the terminal device, the main control chip 104 can configure the device mode as a human-machine interface device. Here, the human-machine interface device can be considered as one of several sub-modes within the device mode. For example, a human-machine interface device includes, but is not limited to, one or more of a mouse, keyboard, touchpad, and trackball. Which human-machine interface devices the main control chip 104 configures the device mode to depends on which external inputs the projection device supports. For example, if the projection device is a television, the configurable human-machine interface devices can be a mouse and keyboard; if the projection device is an in-vehicle entertainment system, the configurable human-machine interface devices can be a touchpad and keyboard. After configuration, the main control chip 104 switches the host mode to the device mode configured as a human-machine interface device, thus preparing for subsequent control operations from the projection device to the terminal device.

[0087] It should be understood that in order to achieve back control, the projection device switches to device mode configured as a human-machine interface device. Therefore, when reconnecting with the terminal device, the terminal device will switch to host mode accordingly.

[0088] Furthermore, the main control chip 104 is also used to send corresponding control commands to the terminal device through the third channel in response to the detection of control operations on the screen-projection object in the screen-projection interface.

[0089] In this embodiment, when the main control chip 104 detects a control operation on the projection interface targeting the projection object, it sends a corresponding control command to the terminal device based on the physical connection between the projection device and the terminal device. This improves the transmission stability of the control command and reduces the latency when the projection device controls the terminal device. Simultaneously, it can control any projection object on the terminal device, thereby enhancing the user experience. After receiving the control command, the terminal device performs the corresponding target operation on the projection object based on the control command.

[0090] For example, when the main control chip 104 is configured with a touchpad as the human-machine interface device, the control instructions sent by the main control chip 104 to the terminal device through the third channel include at least the absolute coordinates when performing touch operations on the touchpad; when the main control chip 104 is configured with a mouse as the human-machine interface device, the control instructions sent by the main control chip 104 to the terminal device through the third channel include at least the relative coordinates when performing movement operations on the mouse; when the main control chip 104 is configured with a keyboard as the human-machine interface device, the control instructions sent by the main control chip 104 to the terminal device through the third channel include at least the predefined instruction types of the keyboard.

[0091] In some embodiments, when a terminal device is connected to the Type-C interface 101 of a screen mirroring device, and the device type of the terminal device matches a preset device type, the terminal device may not be used for screen mirroring / controlling operations, but rather for other non-screen mirroring functions. For example, the terminal device may be connected to the Type-C interface 101 of the screen mirroring device for charging. Therefore, in this embodiment, the main control chip 104 can remind the user whether screen mirroring / controlling operations are needed before performing actions related to screen mirroring / controlling operations.

[0092] As one possible implementation, the main control chip 104 is also used to send an interconnection prompt message to the display screen 105, which is used to prompt the user whether screen projection / return control is allowed; the display screen 105 is also used to display the interconnection prompt message.

[0093] In this embodiment, before the main control chip 104 configures the device mode as a human-machine interface device, the main control chip 104 can output an interconnection prompt message through the display screen 105. This interconnection prompt message is used to prompt the user whether to allow the screen projection device to perform screen projection / return control operation. Only when the main control chip 104 detects an interconnection confirmation message indicating that the user allows screen projection / return control operation will the main control chip 104 be triggered to perform actions related to the screen projection / return control function. This avoids the situation where the terminal device is physically connected to the screen projection device but does not perform screen projection, which would affect the normal use of other functions between the screen projection device and the terminal device.

[0094] It should be understood that when users cast content played on a terminal device to the screen for the first time using the screen casting device, they can be prompted to set usage preferences for the screen casting device. For example, if the user sets the usage preference to use the screen casting device by default for screen casting / return control, then when the same terminal device connects to the screen casting device again, the screen casting device will assume that the terminal device needs to perform screen casting / return control, and will no longer output the above-mentioned interconnection prompt message.

[0095] Please see Figure 2 Based on the same inventive concept, this application provides a screen mirroring method, which is applied to... Figure 1 The process of this method in the screen projection device shown is described as follows:

[0096] Step 201: In response to the terminal device connecting to the Type-C interface, the main control chip 104 obtains the descriptor of the terminal device through the second and third paths.

[0097] Step 202: In response to the device type indicated by the descriptor matching the preset device type, the main control chip 104 controls itself to disconnect from the terminal device.

[0098] Step 203: The main control chip 104 sends a line switching signal to the line selector 103. The line switching signal is used to control the line selector 103 to turn on the first path and turn off the second path.

[0099] Step 204: When reconnecting between terminal devices, the main control chip 104 sends a working mode signal to the terminal device through the fourth channel until the reconnection is completed. The working mode signal is used to indicate that the projection device supports receiving the display port DP signal and the target receiving pin in the Type-C interface for receiving the DP signal.

[0100] Step 205: The main control chip 104 receives the MIPI signal and audio signal from the signal converter 103. The MIPI signal and audio signal are obtained by the signal converter 103 after converting the target DP signal received by the target receiving pin.

[0101] Step 206: The main control chip outputs the MIPI signal and audio signal to the display screen 105. The MIPI signal and audio signal are used for playback on the display screen 105.

[0102] Please see Figure 3 This is a schematic diagram illustrating a process for configuring and switching to device mode according to an embodiment of this application. Before executing step 202, step 301 can also be executed:

[0103] Step 301: The main control chip 104 configures the device mode as a human-machine interface device.

[0104] After performing step 202, step 302 can also be performed:

[0105] Step 302: The main control chip 104 switches the host mode to the device mode configured as a human-machine interface device.

[0106] Please see Figure 4 This is a flowchart illustrating a feedback control method provided in an embodiment of this application. After executing step 206, step 207 can also be executed:

[0107] Step 207: In response to the control operation for the projection object, the main control chip 104 sends the corresponding control command to the terminal device through the third channel. The control command is used to control the terminal device to perform the corresponding target operation on the projection object.

[0108] Please see Figure 5 This is a schematic diagram illustrating a process for confirming screen projection / control return according to an embodiment of this application. Before executing step 301, steps 401 and 402 can also be executed:

[0109] Step 401: The main control chip 104 sends an interconnection prompt message to the display screen 105. The interconnection prompt message is used to prompt the user whether screen projection / return control is allowed.

[0110] Step 402: In response to the interconnection confirmation message, the main control chip 104 configures the device mode as a human-machine interface device.

[0111] Please see Figure 6 This is a flowchart illustrating a screen projection / control method provided in an embodiment of this application. Figure 6 As shown below, the overall process of screen projection based on the projection device is explained.

[0112] Step 501: In response to the terminal device connecting to the Type-C interface, the main control chip 104 obtains the descriptor of the terminal device through the second and third paths.

[0113] Step 502: In response to the device type indicated by the descriptor matching the preset device type, the main control chip 104 sends an interconnection prompt message to the display screen 105. The interconnection prompt message is used to prompt the user whether screen projection / return control is allowed.

[0114] Step 503: In response to the interconnection confirmation message, the main control chip 104 configures the device mode as a human-machine interface device.

[0115] Step 504: The main control chip 104 disconnects itself from the terminal device.

[0116] Step 505: The main control chip 104 switches the host mode to the device mode configured as a human-machine interface device.

[0117] Step 506: The main control chip 104 sends a line switching signal to the line selector 103. The line switching signal is used to control the line selector 103 to turn on the first path and turn off the second path.

[0118] Step 507: When reconnecting between terminal devices, the main control chip 104 sends a working mode signal to the terminal device through the fourth channel until the reconnection is completed. The working mode signal is used to indicate that the projection device supports receiving the display port DP signal and the target receiving pin in the Type-C interface for receiving the DP signal.

[0119] Step 508: The main control chip 104 receives the MIPI signal and audio signal from the signal converter 103. The MIPI signal and audio signal are obtained by the signal converter 103 after converting the target DP signal received by the target receiving pin.

[0120] Step 509: The main control chip 104 outputs the MIPI signal and audio signal to the display screen 105. The MIPI signal and audio signal are used for playback on the display screen 105.

[0121] Please see Figure 7 This application also provides a chip module, which includes at least one processor 601. The processor 601 is used to execute a computer program stored in a memory to implement the implementation provided in this application embodiment. Figure 2-6 The flowchart shown illustrates the steps of the screen mirroring method.

[0122] Optionally, the processor 601 may be a central processing unit, a specific ASIC, or one or more integrated circuits used to control program execution.

[0123] Optionally, the chip module may further include a memory 602 connected to at least one processor 601. The memory 602 may include ROM, RAM, and disk storage. The memory 602 stores data required for the processor 601 to run, i.e., it stores instructions that can be executed by at least one processor 601. The at least one processor 601 executes instructions stored in the storage medium 602 to perform tasks such as... Figure 2-6 The method is shown. The number of storage media 602 is one or more. The number of memories 602 is one or more.

[0124] Please see Figure 8 This application also provides an electronic device that can be used for... Figure 1The screen projection device shown includes at least one processor 701, which executes a computer program stored in a memory to implement the functions provided in the embodiments of this application. Figure 2-6 The flowchart shown illustrates the steps of the screen mirroring method.

[0125] Optionally, the processor 701 may be a central processing unit, a specific ASIC, or one or more integrated circuits used to control program execution.

[0126] Optionally, the electronic device may further include a memory 702 connected to at least one processor 701. The memory 702 may include ROM, RAM, and disk storage. The memory 702 stores data required for the processor 701 to run, i.e., it stores instructions executable by at least one processor 701. The at least one processor 701 executes instructions stored in the storage medium 702 to perform tasks such as... Figure 2-6 The method is shown. The number of storage media 702 is one or more. The number of memories 702 is one or more.

[0127] This application embodiment also provides a computer storage medium, wherein the computer storage medium stores computer instructions, which, when executed on a computer, cause the computer to perform actions such as... Figure 2-6 The method.

[0128] The above description is merely a preferred embodiment of this specification and is not intended to limit this specification. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this specification should be included within the scope of protection of this specification.

Claims

1. A screen projection device, characterized in that, The screen projection device includes: a Type-C interface, a line selector, a signal converter, a main control chip, and a display screen. The Type-C interface, the line selector, the signal converter, and the main control chip are connected in sequence to form a first path. The Type-C interface, the line selector, and the main control chip are connected in sequence to form a second path. The Type-C interface and the main control chip are connected to form a third path and a fourth path. The first path is normally open, and the second, third, and fourth paths are normally closed. The main control chip is in host mode. The main control chip is used to obtain the descriptor of the terminal device through the second path and the third path in response to the terminal device connecting to the Type-C interface. The main control chip is also configured to disconnect itself from the terminal device in response to the device type indicated by the descriptor matching a preset device type. The main control chip is also used to send a line switching signal to the line selector; The line selector is used to activate the first path and deactivate the second path in response to the line switching signal; The main control chip is also used to send a working mode signal to the terminal device through the fourth channel when the terminal devices are reconnected until the reconnection is completed. The working mode signal is used to indicate that the screen projection device supports receiving the display port DP signal and the target receiving pin in the Type-C interface for receiving the DP signal. The signal converter is used to receive a target DP signal from the terminal device from the target receiving pin, convert the target DP signal into a Mobile Industry Processor Interface (MIPI) signal and an audio signal, and send the MIPI signal and the audio signal to the main control chip. The main control chip is also used to output the MIPI signal and the audio signal to the display screen; The display screen is used to play the audio signal according to the MIPI signal and the audio signal.

2. The apparatus according to claim 1, characterized in that, The main control chip is also used to configure the device mode as a human-machine interface device; The main control chip is also used to switch the host mode to the device mode configured as the human-machine interface device.

3. The apparatus according to claim 2, characterized in that, The human-machine interface device includes at least one or more of the following combinations: mouse, keyboard, touchpad, trackball.

4. The apparatus according to claim 3, characterized in that, The main control chip is also used to respond to the detection of a control operation on the projection object in the projection interface in the device mode, and send a corresponding control command to the terminal device through the third channel. The control command is used to control the terminal device to perform a corresponding target operation on the projection object.

5. The apparatus according to any one of claims 2-4, characterized in that, The main control chip is also used to send an interconnection prompt message to the display screen, which is used to prompt the user whether screen projection / return control is allowed; The display screen is also used to display the interconnection notification message.

6. A screen projection method, characterized in that, Applied to the projection device according to any one of claims 1-5, the method includes: In response to the terminal device connecting to the Type-C interface, the main control chip obtains the descriptor of the terminal device through the second and third paths; In response to the device type indicated by the descriptor matching a preset device type, the main control chip controls itself to disconnect from the terminal device; The main control chip sends a line switching signal to the line selector, and the line switching signal is used to control the line selector to turn on the first path and disconnect the second path. When reconnecting between the terminal devices, the main control chip sends a working mode signal to the terminal device through the fourth channel until the reconnection is completed. The working mode signal is used to indicate that the screen projection device supports receiving the display port DP signal and the target receiving pin in the Type-C interface for receiving the DP signal. The main control chip receives MIPI signals and audio signals from the signal converter. The MIPI signals and audio signals are obtained by the signal converter after converting the target DP signal received by the target receiving pin. The main control chip outputs the MIPI signal and the audio signal to the display screen, and the MIPI signal and the audio signal are used for playback on the display screen.

7. The method according to claim 6, characterized in that, Before the main control chip disconnects itself from the terminal device, the method further includes: The main control chip configures the device mode as a human-machine interface device. After the main control chip disconnects itself from the terminal device, the method further includes: The main control chip switches the host mode to the device mode configured as the human-machine interface device.

8. The method according to claim 7, characterized in that, The human-machine interface device includes at least one or more of the following combinations: mouse, keyboard, touchpad, trackball.

9. The method according to claim 8, characterized in that, After the main control chip outputs the MIPI signal and the audio signal to the display screen, the method further includes: In response to detecting a control operation targeting the projection object in the device mode, the main control chip sends a corresponding control command to the terminal device through the third channel. The control command is used to control the terminal device to perform a corresponding target operation on the projection object.

10. The method according to any one of claims 7-9, characterized in that, Before the main control chip configures the device mode to a human-machine interface device, the method further includes: The main control chip sends an interconnection prompt message to the display screen, which is used to prompt the user whether screen mirroring / return control is allowed; In response to the interconnection confirmation message, the main control chip configures the device mode as the human-machine interface device.

11. A chip module, characterized in that, The chip module includes a memory for storing computer program instructions and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the chip module is triggered to perform the steps of the method as described in any one of claims 6-10.

12. An electronic device, characterized in that, The electronic device includes a memory for storing computer program instructions and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to perform the steps of the method as described in any one of claims 6-10.

13. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store computer instructions that, when executed in a computer, cause the computer to perform the steps of the method as described in any one of claims 6-10.

Citation Information

Patent Citations

  • Signal switching system and signal switching method

    CN114157898A

  • Method for controlling signal input or output based on Type-c circuit

    CN115474015A