Screen projector and screen projection system

Abstract

The invention provides a screen projector and a screen projection system. The screen projector comprises a first interface, a main control unit and a switch unit, the first interface is configured with a first sending / receiving pin and a second sending / receiving pin, and the first interface is used for being connected with external equipment; the main control unit is connected with the first transmitting / receiving pin and the second transmitting / receiving pin through the switch unit, and the main control unit is used for controlling the state of the switch unit according to the working mode of the screen projector so as to select the first transmitting / receiving pin and the second transmitting / receiving pin, and is connected with an interface for transmitting video input signals in the main control unit; or the first sending / receiving pin and the second sending / receiving pin are selected to be connected with the interface for transmitting the video output signal in the main control unit. According to the screen projector, switching between the transmitting end and the receiving end can be realized through the switch unit, and the use flexibility of the screen projector is improved.

Description

Technical Field

[0001] This application relates to the technical field of wireless screen mirroring, and more specifically, to a screen mirroring device and a screen mirroring system. Background Art

[0002] With the popularization of smart devices and the growth in the number of high-definition video contents, users' demand for a large-screen viewing experience has been increasing day by day. Although the traditional wired connection method can achieve screen sharing, it is not flexible enough due to the limitations of cable length and device compatibility. To solve this problem, wireless screen mirroring technology has emerged, promoting the development of screen mirroring devices.

[0003] Currently, a screen mirroring device includes a sending end and a receiving end. Among them, the sending end is connected to an external device (such as a mobile phone and a computer) through a multimedia interface (for example, a high definition multimedia interface (HDMI), a displayport (DP), or a universal serial bus (USB) interface) to achieve the transmission of a video stream, and sends the video signal to the receiving end through a wireless communication module. The receiving end receives the video signal through the wireless communication module and outputs the video signal to a display device through the multimedia interface.

[0004] However, since the sending end and the receiving end need to be used in pairs and need to be paired before use, when the sending end or the receiving end is lost or damaged, the screen mirroring device cannot be used, or when the wireless signal sent by the sending end is interfered, the screen mirroring device cannot achieve screen mirroring either, thus affecting the user experience of using the screen mirroring device. Summary of the Invention

[0005] This application provides a screen mirroring device and a screen mirroring system, which can help users adjust the screen mirroring method and control the playing content more freely, thereby improving the operation convenience of the screen mirroring device and the overall user experience.

[0006] In a first aspect, a screen mirroring device is provided. The screen mirroring device includes: a first interface, a main control unit, and a switch unit; the first interface is configured with a first transmit / receive pin and a second transmit / receive pin, and the first interface is used to connect to an external device; the main control unit is connected to the first transmit / receive pin and the second transmit / receive pin through the switch unit, and the main control unit is configured to control the state of the switch unit according to the working mode of the screen mirroring device to select the first transmit / receive pin and the second transmit / receive pin to be connected to the interface for transmitting a video input signal in the main control unit, or to select the first transmit / receive pin and the second transmit / receive pin to be connected to the interface for transmitting a video output signal in the main control unit.

[0007] In the embodiments of the present application, the screen mirroring device can realize the switching between the sending end and the receiving end through the switch unit, avoiding the situation where screen mirroring cannot be performed when one of the paired screen mirroring devices (the receiving end or the sending end) is lost or damaged, improving the flexibility of using the screen mirroring device, enabling the user to adjust the screen mirroring method and control the playing content more freely, thereby enhancing the operation convenience and overall usage experience of the screen mirroring device.

[0008] In combination with the first aspect, in some implementation manners of the first aspect, the switch unit includes: a first switch and a second switch; one end of the first switch is connected to the first sending / receiving pin, and the other end is connected to the interface for transmitting the video input signal or the interface for transmitting the video output signal; one end of the second switch is connected to the second sending / receiving pin, and the other end is connected to the interface for transmitting the video input signal or the interface for transmitting the video output signal.

[0009] In the embodiments of the present application, by using the first switch and the second switch, it is convenient to control the connection between the first sending / receiving pin and the second sending / receiving pin and the interfaces for transmitting video signals with different functions, thereby facilitating improving the switching efficiency and accuracy of the screen mirroring device between the receiving end and the sending end.

[0010] In combination with the first aspect, in some implementation manners of the first aspect, the main control unit is specifically configured to: when the working mode of the screen mirroring device is in the first mode, control the other end of the first switch to be connected to the interface for transmitting the video output signal, and control the other end of the second switch to be connected to the interface for transmitting the video output signal.

[0011] In the embodiments of the present application, by connecting the other end of the first switch to the interface for transmitting the video output signal and connecting the other end of the second switch to the interface for transmitting the video output signal, the screen mirroring device can be used as a receiving end, thereby facilitating the screen mirroring device to output the locally stored video data or the received video data.

[0012] In combination with the first aspect, in some implementation manners of the first aspect, the first interface is further configured with USB D+ / D- pins, and the USB D+ / D- pins are connected to the USB OTG (On-The-Go) interface in the main control unit; the main control unit is further configured to configure the USB OTG interface as a USB storage device interface or configure the USB OTG interface as a Host host interface.

[0013] In an embodiment of the present application, when the USB OTG is configured as a USB storage device interface, it is convenient for an external device to read the data stored in the screen mirroring device. On the other hand, when the USB OTG is configured as a Host host interface, the screen mirroring device can connect to and manage external USB devices, such as USB flash drives, keyboards, mice, or cameras, to implement functions such as file access, input control, or video capture, thereby expanding the application scenarios and interaction capabilities of the screen mirroring device.

[0014] In combination with the first aspect, in some implementation manners of the first aspect, the external device includes a first terminal device, and the screen mirroring device further includes: a storage module; the main control unit is further configured to read the data stored in the storage module and send first video information to the first terminal device through the interface for transmitting a video output signal, or the main control unit is further configured to send the data stored in the storage module to the first terminal device through the interface for transmitting a video output signal.

[0015] In an embodiment of the present application, when the first terminal device is a non-smart display, the screen mirroring device can read the data stored in the storage module and provide video information (processed data) to the non-smart display; when the first terminal device is a smart display, the screen mirroring device can provide the locally stored data to the smart display for the smart display to read the data. In this way, the screen mirroring device can be applicable to different types of first terminal devices, further expanding the application scenarios of the screen mirroring device. In addition, even when the screen mirroring device is in a scenario where it is disconnected from the sending end or has poor communication quality, the screen mirroring device can perform screen mirroring based on the data stored in the storage module, thereby further improving the user experience of using the screen mirroring device.

[0016] In combination with the first aspect, in some implementation manners of the first aspect, the external device includes a first terminal device, and the main control unit is further configured to: receive second video information and / or video control information, where the video control information is used to indicate the video display mode and playback state of the first terminal device; send the second video information and / or the video control information to the first terminal device.

[0017] In an embodiment of the present application, the screen mirroring device can forward the second video information and video control information to the first terminal device, facilitating the first terminal device to be able to display video content from other devices, and at the same time, the first terminal device can implement control operations such as playing, pausing, fast forwarding, rewinding, and full screen based on the video control information, thereby achieving a smoother multi-device collaboration and interaction experience.

[0018] In combination with the first aspect, in certain implementations of the first aspect, the main control unit is specifically used to: when the working mode of the projector is in the second mode, control the other end of the first switch to be connected to the interface for transmitting the video input signal, and control the other end of the second switch to be connected to the interface for transmitting the video input signal.

[0019] In an embodiment of the present application, by connecting the other end of the first switch to an interface for transmitting a video input signal, and connecting the other end of the second switch to an interface for transmitting a video input signal, the projector can be used as a transmitting end, thereby facilitating the projector to output video data to other devices.

[0020] In combination with the first aspect, in certain implementations of the first aspect, the external device includes a second terminal device; the first interface is also configured with a USB D+ / D- pin, and the USB D+ / D- pin is connected to the USB OTG interface in the main control unit; the main control unit is also used to: receive second video information and / or video control information sent by the second terminal device through the USB OTG interface, and the video control information is used to indicate the video display mode and playback status of the first terminal device; and send the second video information and / or the video control information.

[0021] In an embodiment of the present application, the screen projector can forward the second video information and / or video control information to the receiving end, so that the receiving end can synchronously display the video content, and it is also convenient to control the receiving end to implement video playback, pause, fast forward, fast rewind, full screen and other control operations, thereby enhancing the collaborative experience between multiple devices and ensuring efficient transmission and flexible control of video content.

[0022] In combination with the first aspect, in certain implementations of the first aspect, the external device includes a second terminal device; the main control unit is further used to: receive second video information and / or video control information sent by the second terminal device through the interface for transmitting the video input signal, the video control information being used to indicate the video display mode and playback status of the first terminal device; and send the second video information and / or the video control information.

[0023] In the embodiment of the present application, the screen projector can forward the second video information and / or video control information to the receiving end, so that the receiving end can synchronously display the video content, and it is also convenient to control the receiving end to realize the video playback, pause, fast forward, fast rewind, full screen and other control operations, thereby improving the collaborative experience between multiple devices and ensuring the efficient transmission and flexible control of video content. In addition, the screen projector receives the above information through the interface for transmitting the video input signal, which can save the step of installing the driver on the second terminal device, and can improve the quality and efficiency of the transmission of the above information.

[0024] In combination with the first aspect, in certain implementations of the first aspect, the screen mirroring device further includes a button and an indicator light; the main control unit is further configured to: when detecting that the button is clicked, switch the working mode of the screen mirroring device and the blinking state and color of the indicator light.

[0025] In the embodiments of the present application, the working mode of the screen mirroring device, as well as the blinking state and color of the indicator light, can be switched through the button. In this way, the current state of the screen mirroring device can be intuitively feedback, helping users quickly identify and operate, and improving the convenience of use and interaction experience of the screen mirroring device.

[0026] In a second aspect, a screen mirroring system is provided. The screen mirroring system includes: a first screen mirroring device and a second screen mirroring device. The first screen mirroring device is connected to a first terminal device through a first interface, and the second screen mirroring device is connected to a second terminal device through a second interface. Wherein, the first transmit / receive pin and the second transmit / receive pin in the first interface are connected to the interface for transmitting video output signals of the first screen mirroring device through a first switch unit, and the first transmit / receive pin and the second transmit / receive pin in the second interface are connected to the interface for transmitting video input signals of the second screen mirroring device through a second switch unit; the second screen mirroring device receives second video information and / or video control information sent by the second terminal device, and the video control information is used to indicate the video display mode and playing state of the first terminal device; the second screen mirroring device sends the second video information and / or the video control information to the first screen mirroring device; the first screen mirroring device sends the second video information and / or the video control information to the first terminal device.

[0027] In the embodiments of the present application, by using the first screen mirroring device and the second screen mirroring device in cooperation, the screen synchronization between the first terminal device and the second terminal device can be achieved, enabling the first terminal device to receive and display the screen content of the second terminal device in real time, thereby supporting functions such as remote collaboration, multi-person shared viewing, or multi-screen display, and improving the collaborative work efficiency and user experience between devices. Description of the Drawings

[0028] Figure 1 is a schematic architecture diagram of a screen mirroring device provided by an embodiment of the present application;

[0029] Figure 2 is a schematic diagram of a screen mirroring device connected to a display provided by an embodiment of the present application;

[0030] Figure 3 is a schematic flowchart of data transmission of a screen mirroring device in host mode provided by an embodiment of the present application;

[0031] Figure 4It is a schematic diagram provided by an embodiment of the present application, showing two screen mirroring devices respectively connected to a PC and a display;

[0032] Figure 5 It is a schematic diagram provided by an embodiment of the present application, showing the second screen mirroring device as a sender for data transmission;

[0033] Figure 6 It is a schematic diagram provided by an embodiment of the present application, showing the first screen mirroring device as a receiver for data transmission;

[0034] Figure 7 It is another schematic diagram provided by an embodiment of the present application, showing the second screen mirroring device as a sender for data transmission;

[0035] Figure 8 It is another schematic diagram provided by an embodiment of the present application, showing the first screen mirroring device as a receiver for data transmission;

[0036] Figure 9 It is a schematic flowchart showing the data transmission of the screen mirroring device in the synchronous mode provided by an embodiment of the present application;

[0037] Figure 10 It is a schematic diagram of the external structure of a screen mirroring device provided by an embodiment of the present application;

[0038] Figure 11 It is a schematic diagram showing the switching of the screen mirroring device in different modes provided by an embodiment of the present application;

[0039] Figure 12 It is a schematic flowchart for modifying the working mode of the screen mirroring device provided by an embodiment of the present application. Detailed implementation manners

[0040] In the description of the embodiments of the present application, unless otherwise specified, " / " means "or". For example, A / B may represent A or B. Herein, "and / or" is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B may represent: A exists alone, A and B exist simultaneously, and B exists alone. In the present application, "at least one" means one or more, and "a plurality" means two or more. "At least one of the following" or its similar expressions refer to any combination of these items, including any combination of single item or plural items. For example, at least one of a, b, or c may represent: a, b, c, a - b, a - c, b - c, or a - b - c, where a, b, c may be single or multiple.

[0041] In the embodiments of the present application, prefix words such as "first" and "second" are only used to distinguish different described objects, and have no restrictive effect on the position, order, priority, quantity, content, etc. of the described objects. The use of prefix words such as ordinal numbers for distinguishing described objects in the embodiments of the present application does not constitute a restriction on the described objects. For the statements of the described objects, refer to the descriptions in the claims or the context of the embodiments. Unnecessary restrictions should not be formed due to the use of such prefix words.

[0042] The following further describes the implementation manners of the present application in detail with reference to the drawings and embodiments. The detailed descriptions and drawings of the following embodiments are used to exemplarily illustrate the principles of the present application, but cannot be used to limit the scope of the present application, that is, the present application is not limited to the described embodiments.

[0043] As described in the background art, currently, the transmitter and receiver of a screen mirroring device need to be used in pairs and need to be paired before use. When the transmitter or receiver is lost or damaged, the screen mirroring device cannot be used. Or when the wireless signal sent by the transmitter is interfered, the screen mirroring device cannot achieve screen mirroring either, which affects the user experience of using the screen mirroring device.

[0044] The embodiments of the present application provide a screen mirroring device and a screen mirroring system, which can help users adjust the screen mirroring method and control the playing content more freely, thereby improving the operation convenience of the screen mirroring device and the overall use experience.

[0045] Figure 1 It is a schematic structural diagram of a screen mirroring device provided by an embodiment of the present application.

[0046] As Figure 1 shown, the screen mirroring device may include: a main control unit, a storage module, a wireless communication module, an input / output module, and a power supply module.

[0047] The main control chip is used to implement computing and control functions, and it can be a central processing unit (CPU), a field-programmable gate array (FPGA), or a system on chip (SoC). Optionally, the DP input (DP IN), DP output (DP OUT), USB OTG, and configuration channel (CC) controllers in the main control module can be connected to the Type-C interface to implement the screen mirroring function. Among them, the DP IN and DP OUT interfaces can be connected to the Type-C interface through a switch unit (Ctrl).

[0048] The Type-C interface includes USB function, DP function, and power supply function. Among them, when the USB D+ and USB D- pins are connected to the USB2.0 OTG signal, it means that the interface supports the OTG function, and the supported screen mirroring device can switch between different modes to adapt to different usage scenarios and connection requirements. The TX1 and RX1 pins, and the TX2 and RX2 pins are connected to DPIN, DP OUT, or USB3.0 signal to achieve high-speed data transmission or high-definition audio and video output. The CC1 and CC2 pins can complete functions such as plug orientation recognition and PD power supply communication. The sideband use (SBU) pins can implement the pin function of the auxiliary channel (AUX) of the DP protocol in the DP mode, which is used to support two-way communication between the screen mirroring device and external devices.

[0049] The storage module is used to implement the data storage function, which can be a random access memory DDR (RAM), an embedded multimedia card (eMMC), or a universal flash storage UFS (Flash ROM).

[0050] The wireless communication module is used to implement the wireless communication function. For example, a circuit and its software using WiFi, Bluetooth, or other standard wireless communication protocols, by combining the hardware circuit and the software protocol stack, realize the wireless transmission and exchange of data between different devices.

[0051] The input / output module is used to implement the human-computer interaction function. The input / output module can include buttons, indicator lights, or displays, etc., which are used to implement functions such as displaying information and feedbacking the status of the screen mirroring device to enhance the user experience.

[0052] The power module is used to implement the voltage change and power supply control of the power domains of the above-mentioned modules, ensuring that the screen mirroring device obtains a stable and suitable voltage supply under different working states, and meets the power requirements of each module.

[0053] It should be noted that Figure 1 The architecture of the shown screen mirroring device is only exemplary and does not constitute any limitation to the screen mirroring device involved in the present application. Those skilled in the art can flexibly adjust the Figure 1 shown architecture according to specific actual needs. For example, new modules can be added to support more complex function requirements, some modules can be reduced to simplify the function design of the screen mirroring device, or existing modules can be replaced with updated modules or hardware implementations. In addition, in different application scenarios, the architecture of the screen mirroring device may vary due to different requirements, resources, or constraints.

[0054] According to some embodiments, the screen mirroring device provided by the embodiments of the present application includes: a first interface, a main control unit, and a switch unit; the first interface is configured with a first transmit / receive pin and a second transmit / receive pin, and the first interface is used to connect to an external device; the main control unit is connected to the first transmit / receive pin and the second transmit / receive pin through the switch unit, and the main control unit is used to control the state of the switch unit according to the working mode of the screen mirroring device, so as to select the first transmit / receive pin and the second transmit / receive pin to be connected to the interface for transmitting the video input signal in the main control unit, or select the first transmit / receive pin and the second transmit / receive pin to be connected to the interface for transmitting the video output signal in the main control unit.

[0055] Based on the above screen mirroring device, the screen mirroring device can realize the switching between the transmitter and the receiver through the switch unit, avoiding the situation where screen mirroring cannot be performed when one of the paired screen mirroring devices (the receiver or the transmitter) is lost or damaged, improving the flexibility of using the screen mirroring device, enabling the user to adjust the screen mirroring method and control the playing content more freely, thereby enhancing the operation convenience and overall user experience of the screen mirroring device.

[0056] Optionally, the switch unit may include an electronic switch, a mechanical switch, a relay, and other elements for controlling the on / off of the circuit to achieve different circuit control functions. Further optionally, one or more switches may be provided in the switch unit to control the connection of the first transmit / receive pin and the second transmit / receive pin to the interface for transmitting the video input signal or the interface for transmitting the video output signal.

[0057] Optionally, the external device may be a terminal device connected to the screen mirroring device, including: a display, a personal computer (PC), an audio device, and other devices for input, output, or data transmission.

[0058] Optionally, the first interface may include: a Type-C interface, a USB interface, an HDMI interface, and other standard interface forms with data transmission, power transmission, or audio / video output capabilities.

[0059] Optionally, the interface for transmitting the video output signal may be Figure 1 the DP OUT interface in Figure 1 correspondingly, the interface for transmitting the video input signal may be

[0060] the DP IN interface in Figure 1 i.e., at this time, the video input signal and the video output signal may be DP signals. Figure 1 the TX2 / RX2 pin in

[0061] According to some embodiments, the switch unit includes: a first switch and a second switch; one end of the first switch is connected to a first transmit / receive pin, and the other end is connected to an interface for transmitting a video input signal or an interface for transmitting a video output signal; one end of the second switch is connected to a second transmit / receive pin, and the other end is connected to an interface for transmitting a video input signal or an interface for transmitting a video output signal.

[0062] Based on the above-mentioned screen mirroring device, by using the first switch and the second switch, it is convenient to control the connection between the first transmit / receive pin and the second transmit / receive pin and the video transmission interfaces with different functions, which is beneficial to improving the efficiency and accuracy of switching between the receiving end and the transmitting end of the screen mirroring device.

[0063] Exemplarily, the first switch may be Figure 1 the electronic switch Ctrl1 in Figure 1 and the second switch may be

[0064] According to some embodiments, the main control unit is specifically configured to: when the working mode of the screen mirroring device is in the first mode, control the other end of the first switch to be connected to the interface for transmitting the video output signal, and control the other end of the second switch to be connected to the interface for transmitting the video output signal.

[0065] Based on the above-mentioned screen mirroring device, by connecting the other end of the first switch to the interface for transmitting the video output signal and connecting the other end of the second switch to the interface for transmitting the video output signal, the screen mirroring device can be used as a receiving end, which is convenient for the screen mirroring device to output the video data stored locally or the received video data.

[0066] Optionally, the first mode may include: a host mode, or a screen mirroring mode or a synchronization mode when the screen mirroring device is used as a receiving end.

[0067] According to some embodiments, the first interface is further configured with USB D+ / D- pins, and the USB D+ / D- pins are connected to the USB OTG interface in the main control unit; the main control unit is further configured to configure the USB OTG interface as a USB storage device interface, or configure the USB OTG interface as a Host host interface.

[0068] Based on the above-mentioned screen mirroring device, when the USB OTG is configured as a USB storage device interface, it is convenient for external devices to read the data stored in the screen mirroring device. On the other hand, when the USB OTG is configured as a Host host interface, the screen mirroring device can connect and manage external USB devices, such as USB flash drives, keyboards, mice, or cameras, to implement functions such as file access, input control, or video capture, thereby expanding the application scenarios and interaction capabilities of the screen mirroring device.

[0069] According to some embodiments, the external device includes a first terminal device, and the screen mirroring device further includes: a storage module; a main control unit, which is further configured to read the data stored in the storage module and send the first video information to the first terminal device through the interface for transmitting the video output signal, or the main control unit is further configured to send the data stored in the storage module to the first terminal device through the interface for transmitting the video output signal.

[0070] Based on the above screen mirroring device, when the first terminal device is a non-smart display, the screen mirroring device can read the data stored in the storage module and provide video information (processed data) to the non-smart display; when the first terminal device is a smart display, the screen mirroring device can provide the locally stored data to the smart display for the smart display to read the data. In this way, the screen mirroring device can be applicable to different types of first terminal devices, further expanding the application scenarios of the screen mirroring device. In addition, even in the scenario where the screen mirroring device is disconnected from the sending end or has poor communication quality, the screen mirroring device can perform screen mirroring based on the data stored in the storage module, thereby further improving the user experience of using the screen mirroring device.

[0071] According to some embodiments, the main control unit is further configured to: receive the second video information and / or video control information, where the video control information is used to indicate the video display mode and playback state of the first terminal device; send the second video information and / or video control information to the first terminal device.

[0072] Based on the above screen mirroring device, the second video information and video control information can be forwarded to the first terminal device, facilitating the first terminal device to be able to display the video content from other devices. At the same time, the first terminal device can perform control operations such as playing, pausing, fast-forwarding, rewinding, and full-screening of the video based on the video control information, thereby achieving a smoother multi-device collaboration and interaction experience.

[0073] Optionally, the above screen mirroring device can receive the second video information and / or video control information sent by other screen mirroring devices through wireless communication, or the screen mirroring device receives the second video information and / or video control information sent by the second terminal device through wireless communication.

[0074] Exemplarily, when the screen mirroring device only forwards the video control information, the first terminal device can control the playback progress of the file to be played based on the video control information, and the playback file can be pre-stored in the screen mirroring device. When the screen mirroring device only forwards the second video information, the first terminal device can display the content of the video information; when the screen mirroring device forwards the second video information and video control information, the display can display specific content in the second video information based on the video control information.

[0075] According to some embodiments, the main control unit is specifically used to: when the working mode of the projector is in the second mode, control the other end of the first switch to be connected to the interface for transmitting the video input signal, and control the other end of the second switch to be connected to the interface for transmitting the video input signal.

[0076] Based on the above-mentioned screen projector, by connecting the other end of the first switch to the interface for transmitting the video input signal, and connecting the other end of the second switch to the interface for transmitting the video input signal, the screen projector can be used as a transmitting end, thereby facilitating the screen projector to output video data to other devices.

[0077] Optionally, the second mode may include: a projection mode or a synchronization mode when the screen projector is used as a transmitter.

[0078] According to some embodiments, the first interface is also configured with USB D+ / D- pins, and the USB D+ / D- pins are connected to the USB OTG interface in the main control unit; the main control unit is also used to: receive second video information and / or video control information sent by the second terminal device through the USB OTG interface, the video control information is used to indicate the video display mode and playback status of the first terminal device; and send second video information and / or video control information.

[0079] Based on the above-mentioned screen projector, the second video information and / or video control information can be forwarded to the receiving end, so that the receiving end can synchronously display the video content. It is also convenient to control the receiving end to implement video playback, pause, fast forward, fast rewind, full screen and other control operations, thereby enhancing the collaborative experience between multiple devices and ensuring efficient transmission and flexible control of video content.

[0080] According to some embodiments, the external device includes a second terminal device; the main control unit is also used to: receive second video information and / or video control information sent by the second terminal device through an interface for transmitting a video input signal, the video control information being used to indicate a video display mode and playback status of the first terminal device; and send second video information and / or video control information.

[0081] Based on the above-mentioned screen projector, the second video information and / or video control information can be forwarded to the receiving end, so that the receiving end can synchronously display the video content, and it is also convenient to control the receiving end to realize the video playback, pause, fast forward, fast rewind, full screen and other control operations, thereby improving the collaborative experience between multiple devices and ensuring the efficient transmission and flexible control of video content. In addition, the screen projector receives the above information through the interface for transmitting the video input signal, which can save the step of installing the driver on the second terminal device and improve the quality and efficiency of the transmission of the above information.

[0082] According to some embodiments, the screen mirroring device further includes a button and an indicator light; the main control unit is further configured to: when detecting that the button is clicked, switch the working mode of the screen mirroring device and the blinking state and color of the indicator light.

[0083] Based on the above screen mirroring device, the working mode of the screen mirroring device and the blinking state and color of the indicator light can be switched through the button. In this way, the current state of the screen mirroring device can be intuitively feedback, helping the user to quickly identify and operate, and improving the convenience of use and the interaction experience of the screen mirroring device.

[0084] The following Figure 2 and Figure 3 will introduce in detail the data transmission method of the screen mirroring device in the host mode.

[0085] Figure 2 is a schematic diagram of the connection between the screen mirroring device provided by the embodiment of the present application and the display.

[0086] As Figure 2 shown, the screen mirroring device is connected to the display through a Type-C interface. When the screen mirroring device is in the host mode, the screen mirroring device can be used as a receiving end to transmit video data to the display. Among them, the host mode of the screen mirroring device can specifically include the following two implementation methods.

[0087] (1) Host mode 1:

[0088] When the screen mirroring device is in host mode 1, the main control unit in the screen mirroring device can control the states of the first switch and the second switch, so that the TX1 / RX1 pins and TX2 / RX2 pins in the Type-C interface are connected to the DP OUT interface in the main control unit. And, the USB D+ / D- pins in the Type-C interface are connected to the main control unit through the USB OTG interface, and the main control unit can configure the USB OTG interface as a USB storage device. At this time, the main control unit can output the system UI interface of the screen mirroring device to the display through the DP OUT interface, and output part or all of the space in the storage module of the screen mirroring device as an external USB storage device, that is, the display can recognize the screen mirroring device as a USB storage device, so as to realize the writing and reading of data or files. At the same time, the screen mirroring device can also read the files in the storage module.

[0089] (2) Host mode 2:

[0090] When the screen mirroring device is in host mode 2, the hardware connection method is the same as that in host mode 1. The difference is that the screen mirroring device configures the USB OTG interface as a Host host interface, that is, other USB devices can establish a connection with the screen mirroring device, and the screen mirroring device can recognize and process the display signals or control signals from other USB devices.

[0091] It should be noted that when the screen mirroring device configures the USB OTG as a Host host interface, the screen mirroring device can actively control and manage other USB devices, such as connecting external devices like USB flash drives, keyboards, or mice. When the USB OTG is configured as a USB storage device, the screen mirroring device is a passive device and is only used to provide data storage functions, and needs to be accessed and managed by a host (such as a computer, a display, or other OTG-supported devices).

[0092] Figure 3 It is a schematic flowchart of data transmission by a screen mirroring device provided by an embodiment of the present application in the host mode. The method 300 may include the following steps.

[0093] S301, The PC establishes a connection with the screen mirroring device, and the PC recognizes the screen mirroring device as a USB storage device.

[0094] Exemplarily, the screen mirroring device can establish a connection with the PC through a Type-C interface, and the PC can be the second terminal device described above.

[0095] S302, The PC copies the file to be played to the storage module of the screen mirroring device.

[0096] Optionally, the file to be played may include video data.

[0097] S303, The display establishes a connection with the screen mirroring device, and the display recognizes the screen mirroring device as a video output source and an external storage device.

[0098] Exemplarily, the screen mirroring device can establish a connection with the display device through a Type-C interface, and the display can be the first terminal device described above.

[0099] Among them, when the display shows the video picture output by the screen mirroring device, there are two implementation methods, which are to sequentially execute steps S304a and S305a, and to sequentially execute steps S304b and S305b respectively.

[0100] S304a, The screen mirroring device reads the file to be played and outputs a video signal to the display through the Type-C interface.

[0101] Optionally, in this step, the USB OTG of the screen mirroring device can be set as a Host host interface, that is, the screen mirroring device can recognize external devices, such as USB devices like touch screens, cameras, and microphones, to control the screen mirroring device.

[0102] S304b, The display reads the file to be played in the screen mirroring device.

[0103] S305a, The display receives the video signal and displays the video picture.

[0104] In S305b, the display shows a video picture.

[0105] In the embodiments of the present application, when the display is a non-intelligent display or other display devices that cannot read USB files, the screen mirroring device can read the data stored in the storage module and provide a video signal to the non-intelligent display; when the first terminal device is an intelligent display, the screen mirroring device can provide the data stored locally to the intelligent display, and the intelligent display reads the data and displays the video picture. In this way, the screen mirroring device can be applied to different types of displays, further expanding the application scenarios of the screen mirroring device. In addition, even when the screen mirroring device is in a scenario where it is disconnected from the sending end or has poor communication quality, it can perform screen mirroring based on the data stored in the storage module, thereby further improving the user experience of using the screen mirroring device.

[0106] The following combines Figures 4 to 8 to introduce in detail the data transmission method of the screen mirroring device in the screen mirroring mode.

[0107] Figure 4 is a schematic diagram showing two screen mirroring devices respectively connected to a PC and a display provided by the embodiments of the present application.

[0108] As Figure 4 shown, the first screen mirroring device can be used as a receiving end and connected to the display through a Type-C interface, and the second screen mirroring device can be used as a sending end and connected to the PC through a Type-C interface. The first screen mirroring device and the second screen mirroring device can be paired and establish a wireless connection. Among them, both the first screen mirroring device and the second screen mirroring device can adopt the Figure 1 shown architecture. The PC can be the second terminal device described above, and the display can be the first terminal device described above.

[0109] Among them, both the first screen mirroring device and the second screen mirroring device can switch among multiple screen mirroring modes. The detailed content of multiple screen mirroring modes can be referred to Table 1.

[0110] Table 1

[0111] Screen mirroring mode Type of screen mirroring device Interface selection Screen mirroring mode 1 Transmitter DP IN + USB Video IN Screen mirroring mode 2 Receiver DP OUT + USB Video OUT Screen mirroring mode 3 Transmitter DP IN + USB storage Screen mirroring mode 4 Receiver DP OUT + USB storage Screen mirroring mode 5 Transmitter DP IN + USB Video IN + USB storage Screen mirroring mode 6 Receiver DP OUT + USB Video OUT + USB storage Screen mirroring mode 7 Transmitter USB Video IN + USB storage Screen mirroring mode 8 Receiver USB Video OUT + USB storage

[0112] Among them, screen mirroring mode 5 combines the interface selections of screen mirroring mode 1 and screen mirroring mode 3, and screen mirroring mode 6 combines the interface selections of screen mirroring mode 2 and screen mirroring mode 4. Since using the USD Video mode requires installing driver programs on the PC and the display, the PCs and displays corresponding to screen mirroring mode 5 and screen mirroring mode 6 also need to install driver programs. On the other hand, removing the DP interface or turning off the DP signal based on screen mirroring mode 5 and screen mirroring mode 6 can implement screen mirroring mode 7 and screen mirroring mode 8. Similarly, the PCs and displays corresponding to screen mirroring mode 7 and screen mirroring mode 8 also need to install driver programs.

[0113] Exemplarily, taking the second screen mirroring device adopting screen mirroring mode 3 and the first screen mirroring device adopting screen mirroring mode 4 as an example, as Figure 5 shown, the main control unit in the second screen mirroring device can control the states of the first switch and the second switch, so that the TX1 / RX1 pins and TX2 / RX2 pins in the Type-C interface are connected to the DP IN interface in the main control unit. In this mode, the PC host can send video information to the second screen mirroring device through the DP protocol, and the second screen mirroring device can transmit the video information to the first screen mirroring device wirelessly. Correspondingly, as Figure 6 shown, the main control unit in the first screen mirroring device can control the states of the first switch and the second switch, so that the TX1 / RX1 pins and TX2 / RX2 pins in the Type-C interface are connected to the DP OUT interface in the main control unit. In this mode, after receiving the video information wirelessly, the first screen mirroring device can send the video information to the display through the DP protocol, so that the display shows the video picture.

[0114] As another example, taking the second screen mirroring device adopting screen mirroring mode 7 and the first screen mirroring device adopting screen mirroring mode 8 as an example, as Figure 7 shown, a driver program can be installed on the PC host to identify the screen mirroring device. When the second screen mirroring device is connected to the PC, the screen mirroring device can work as a USB display device (USB graphics card). The PC host can send video information to the second screen mirroring device through the USB protocol, and the second screen mirroring device can receive the video information through the USB OTG interface, and after performing communication encoding, send the video information to the first screen mirroring device wirelessly. Correspondingly, a driver program can be installed in the display to identify the first screen mirroring device, as Figure 8 shown, after receiving the video information wirelessly, the first screen mirroring device can first perform communication decoding, and then send the decoded video information to the display through the USB protocol. After receiving the video information, the display can show the video picture.

[0115] In the embodiments of the present application, by using the first screen mirroring device and the second screen mirroring device in cooperation, the screen synchronization between the PC and the display can be achieved, so that the display can receive and display the screen content of the PC in real time, thereby supporting functions such as remote collaboration, multi-person shared viewing, or multi-screen display, improving the collaborative work efficiency and user experience between devices.

[0116] It should be noted that Figures 4 to 8The scenario shown is illustrated by taking the paired use of two screen mirroring devices as an example. In some scenarios, a screen mirroring device can also be used alone as a sender or a receiver. That is, at this time, the PC transmits video information to the screen mirroring device, and the screen mirroring device acts as a sender to send the video information, while the display acts as a receiver to receive the video information sent by the screen mirroring device. Or, the PC acts as a sender and transmits the video information to the screen mirroring device wirelessly. The screen mirroring device acts as a receiver to receive the video information and transmits the video information to the display.

[0117] Figure 9 FIG. 4 is a schematic flowchart of data transmission by the screen mirroring device provided in an embodiment of the present application in the synchronization mode. The method 900 may include steps S901 to S903.

[0118] S901, the screen mirroring device and the PC complete pairing, with the PC as the sender and the screen mirroring device as the receiver.

[0119] S902, the screen mirroring device establishes a connection with the display, and the screen mirroring device receives the video information and / or video control information sent by the PC wirelessly.

[0120] Among them, the video information may include a file to be played or video data to be played.

[0121] Optionally, the video control information may be used to indicate the video display mode and playback status of the display. For example, it indicates control operations such as playing, pausing, fast forwarding, rewinding, and full screen of the video.

[0122] S903, the screen mirroring device sends the video information and / or video control information to the display.

[0123] Optionally, when the screen mirroring device only forwards video control information, the display can control the playback progress of the file to be played based on the video control information, and the playback file can be pre-stored in the screen mirroring device; when the screen mirroring device only forwards video information, the display can display the content of the video information; when the screen mirroring device forwards both video information and video control information, the display can display specific content in the video information based on the video control information.

[0124] Based on the above screen mirroring device, it can forward video information and / or video control information to the display, facilitating the display to be able to display the video content from the PC, and at the same time, the display screen can implement control operations such as playing, pausing, fast forwarding, rewinding, and full screen of the video based on the video control information, thereby achieving a smoother multi-device collaboration and interaction experience.

[0125] The following Figures 10 to 12 will introduce in detail the process of the screen mirroring device switching between various modes.

[0126] Figure 10It is a schematic diagram of the external structure of a screen mirroring device provided by an embodiment of the present application. Figure 11 It is a schematic diagram of a screen mirroring device provided by an embodiment of the present application switching between different modes. Figure 12 It is a schematic flow diagram of modifying the working mode of a screen mirroring device provided by an embodiment of the present application.

[0127] As Figure 10 shown, the screen mirroring device further includes: a button and an indicator light. When the main control unit detects that the button is clicked, the main control unit can switch the working mode of the screen mirroring device, as well as the flashing state and color of the indicator light.

[0128] Exemplarily, the yellow indicator light is the DP OUT and DP IN indicator lights. When the yellow light is on, it can represent that the DP OUT interface is enabled. When the yellow light is flashing, it can represent that the DP IN interface is enabled. The blue indicator light is the USB Video indicator light. When the blue light is on, it can represent that the USB Video OUT interface is enabled. When the blue light is flashing, it can represent that the USB Video IN interface is enabled. The red indicator light is the power supply indicator light. When the red light is on, it can represent that the power supply function of the screen mirroring device is normal. When the red light is flashing, it can indicate that the USBHOST host mode is enabled. When the red light is off, it can represent that the screen mirroring device has no power supply. The green indicator light is the storage function and synchronization function indicator light. When the green light is on, it can represent that the USB storage function is enabled. When the green light is flashing, it can represent that the wireless synchronization function is enabled.

[0129] As another example, as Figure 11 shown, the working mode of the screen mirroring device can be switched between host mode 1 to 2, screen mirroring mode 1 to 6, and synchronization mode. For example, when the current screen mirroring device is in host mode 1 and the interface is selected as DP OUT + USB storage, when the screen mirroring device detects that the button is clicked once, the screen mirroring device can switch host mode 1 to host mode 2. That is, at this time, the interface selection of the screen mirroring device is DP OUT + USB Host host mode.

[0130] In the embodiments of the present application, the working mode of the screen mirroring device, as well as the flashing state and color of the indicator light, can be switched through the button. In this way, the current state of the screen mirroring device can be intuitively feedback, helping users to quickly identify and operate, and improving the convenience of use and interaction experience of the screen mirroring device.

[0131] It should be noted that the corresponding relationship between the flashing state and color of the above indicator light and the working mode of the screen mirroring device is only an example, and does not constitute any limitation to the screen mirroring device involved in the present application. Those skilled in the art can design or adjust the display method of the indicator light according to specific actual needs, including but not limited to setting different colors, flashing frequencies or brightness changes, to correspond to different working modes and user interaction requirements of the screen mirroring device.

[0132] According to some embodiments, in Figure 11 if certain working modes of the screen mirroring device need to be deleted, reference can be made to the flowchart shown in Figure 12 As shown in Figure 12 Method 1200 includes the following steps.

[0133] S1201, the screen mirroring device is in the synchronization mode.

[0134] S1202, the PC detects the connection with the screen mirroring device.

[0135] S1203, the host computer software in the PC deletes at least one working mode in the screen mirroring device and saves it.

[0136] Exemplarily, after the PC deletes screen mirroring mode 3 and screen mirroring mode 4 in the screen mirroring device based on the user's instruction and saves them, when the screen mirroring device switches modes, it will not be able to switch to screen mirroring mode 3 and screen mirroring mode 4.

[0137] According to some embodiments, an embodiment of the present application further provides a screen mirroring system, which includes: a first screen mirroring device and a second screen mirroring device. The first screen mirroring device is connected to a first terminal device through a first interface, and the second screen mirroring device is connected to a second terminal device through a second interface. Among them, the first transmission / reception pin and the second transmission / reception pin in the first interface are connected to the interface for transmitting the video output signal of the first screen mirroring device through a first switch unit, and the first transmission / reception pin and the second transmission / reception pin in the second interface are connected to the interface for transmitting the video input signal of the second screen mirroring device through a second switch unit; the second screen mirroring device receives second video information and / or video control information sent by the second terminal device, and the video control information is used to indicate the video display mode and playback state of the first terminal device; the second screen mirroring device sends the second video information and / or video control information to the first screen mirroring device; the first screen mirroring device sends the second video information and / or video control information to the first terminal device.

[0138] Based on the above screen mirroring system, by using the first screen mirroring device and the second screen mirroring device in cooperation, it is possible to achieve the screen synchronization between the first terminal device and the second terminal device, so that the first terminal device can receive and display the screen content of the second terminal device in real time, thereby supporting functions such as remote collaboration, multi-person shared viewing, or multi-screen display, improving the collaborative work efficiency and user experience between devices.

[0139] Exemplarily, for a specific example of the above screen mirroring system, reference can be made to Figure 4 .

[0140] Although the present application has been described with reference to the preferred embodiments, various modifications can be made thereto and components thereof can be replaced with equivalents without departing from the scope of the present application. In particular, as long as there is no structural conflict, the technical features mentioned in each embodiment can be combined in any manner. The present application is not limited to the specific embodiments disclosed herein, but includes all technical solutions falling within the scope of the claims.

[0141] As described above, the above are only the specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present application can easily think of changes or substitutions, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A screen mirroring device, characterized in that, The screen mirroring device includes: a first interface, a main control unit, and a switch unit; The first interface is configured with a first transmit / receive pin and a second transmit / receive pin, and the first interface is used to connect to an external device; The main control unit is connected to the first transmit / receive pin and the second transmit / receive pin through the switch unit. The main control unit is used to control the state of the switch unit according to the working mode of the screen mirroring device, so as to select the first transmit / receive pin and the second transmit / receive pin to be connected to the interface for transmitting video input signals in the main control unit, or select the first transmit / receive pin and the second transmit / receive pin to be connected to the interface for transmitting video output signals in the main control unit.

2. The screen mirroring device according to claim 1, wherein The switch unit includes: a first switch and a second switch; One end of the first switch is connected to the first transmit / receive pin, and the other end is connected to the interface for transmitting video input signals or the interface for transmitting video output signals; One end of the second switch is connected to the second transmit / receive pin, and the other end is connected to the interface for transmitting video input signals or the interface for transmitting video output signals.

3. The screen mirroring device according to claim 2, wherein The main control unit is specifically used for: When the working mode of the screen mirroring device is in the first mode, control the other end of the first switch to be connected to the interface for transmitting video output signals, and control the other end of the second switch to be connected to the interface for transmitting video output signals.

4. The screen mirroring device according to claim 3, wherein The first interface is further configured with USB D+ / D- pins, and the USB D+ / D- pins are connected to the USB OTG interface in the main control unit; The main control unit is further used to configure the USB OTG interface as a USB storage device interface, or configure the USB OTG interface as a Host host interface.

5. The screen mirroring device according to claim 4, wherein, The external device includes a first terminal device, and the screen mirroring device further includes a storage module; The main control unit is further used to read the data stored in the storage module, and send the first video information to the first terminal device through the interface for transmitting video output signals, or The main control unit is further used to send the data stored in the storage module to the first terminal device through the interface for transmitting video output signals.

6. The screen mirroring device according to claim 3, wherein The external device includes a first terminal device; The main control unit is further used to: Receive second video information and / or video control information, where the video control information is used to indicate the video display mode and playback state of the first terminal device; Send the second video information and / or the video control information to the first terminal device.

7. The screen mirroring device according to claim 3, wherein The main control unit is specifically used for: When the working mode of the screen mirroring device is in the second mode, control the other end of the first switch to be connected to the interface for transmitting video input signals, and control the other end of the second switch to be connected to the interface for transmitting video input signals.

8. The screen mirroring device according to claim 7, wherein, The external device includes a second terminal device; The main control unit is further used to: Receive the second video information and / or video control information sent by the second terminal device through the interface for transmitting the video input signal, where the video control information is used to indicate the video display mode and playback state of the first terminal device; Send the second video information and / or the video control information.

9. The screen mirroring device according to claim 7, characterized in that, The external device includes a second terminal device, and the first interface is further configured with USB D+ / D- pins, and the USB D+ / D- pins are connected to the USB OTG interface in the main control unit; The main control unit is further configured to: Receive the second video information and / or video control information sent by the second terminal device through the USB OTG interface, where the video control information is used to indicate the video display mode and playback state of the first terminal device; Send the second video information and / or the video control information.

10. The screen mirroring device according to any one of claims 1 to 9, characterized in that The screen mirroring device further includes a button and an indicator light; The main control unit is further configured to: When it is detected that the button is clicked, switch the working mode of the screen mirroring device and the blinking state and color of the indicator light.

11. A screen mirroring system, characterized in that, The screen mirroring system includes: a first screen mirroring device and a second screen mirroring device. The first screen mirroring device is connected to the first terminal device through a first interface, and the second screen mirroring device is connected to the second terminal device through a second interface. Among them, the first transmit / receive pins and the second transmit / receive pins in the first interface are connected to the interface for transmitting the video output signal of the first screen mirroring device through a first switch unit, and the first transmit / receive pins and the second transmit / receive pins in the second interface are connected to the interface for transmitting the video input signal of the second screen mirroring device through the second switch unit; The second screen mirroring device receives the second video information and / or video control information sent by the second terminal device, where the video control information is used to indicate the video display mode and playback state of the first terminal device; The second screen mirroring device sends the second video information and / or the video control information to the first screen mirroring device; The first screen mirroring device sends the second video information and / or the video control information to the first terminal device.

Images