Screen transmission device, screen projection method, screen projection system, storage medium and program product

Abstract

The embodiment of the invention belongs to the screen projection technology, and provides a screen transmission device, a screen projection method, a screen projection system, a storage medium and a program product, the screen transmission device is inserted into terminal equipment to be powered on and started, and the screen transmission device communicates with the terminal equipment; the screen transmission device comprises a processor, an input interface and a WIFI module; the processor is respectively connected with the input interface and the WIFI module, and is used for loading a virtual keyboard driving program to generate a virtual keyboard, inputting a screen projection key value through the virtual keyboard, and sending the screen projection key value to the terminal equipment, so that the terminal equipment loads a screen projection interface based on the screen projection key value; the input interface is connected with terminal equipment and used for receiving data sent by the terminal equipment and sending the data to the processor, and the processor sends the data to the display equipment through the WIFI module to be displayed. The virtual keyboard function is added on the screen transmission device, the screen projection key value is automatically input through the virtual keyboard, a drive program does not need to be installed on the terminal equipment in advance, convenience and rapidness are achieved, and the screen projection efficiency is improved.

Description

Technical Field

[0001] The embodiments of the present application relate to screen projection technology, and more specifically, to a screen transmitter, a screen projection method, a screen projection system, a storage medium, and a program product. Background Art

[0002] Miracast is a wireless display standard based on Wi-Fi Direct. 3C devices that support this standard can share video images wirelessly. For example, a mobile phone can use Miracast to play videos or photos directly on a TV or other device without any connection cables or wireless hotspots (AP, Access Point).

[0003] Currently, computers running Windows 10 and later can use the shortcut key Win+K to bring up the system's built-in Miracast screen projection interface. Users can easily select a large screen for directional projection.

[0004] However, some users may not be used to using the shortcut key Win+K or may not be able to remember it, resulting in low screen projection efficiency. Summary of the invention

[0005] The embodiments of the present application provide a screen transmitter, a screen projection method, a screen projection system, a storage medium and a program product, which are used to solve the problem of low screen projection efficiency when the user inputs the shortcut key Win+K to project the screen.

[0006] In a first aspect, an embodiment of the present application provides a screen transmitter, which is inserted into a terminal device and powered on to start, and the screen transmitter communicates with the terminal device; the screen transmitter includes: a processor, an input interface, and a WIFI module;

[0007] The processor is connected to the input interface and the WIFI module respectively, and is used to load a virtual keyboard driver to generate a virtual keyboard, input a screen projection key value through the virtual keyboard, and send the screen projection key value to the terminal device, so that the terminal device loads the screen projection interface based on the screen projection key value;

[0008] The input interface is connected to the terminal device, and is used for receiving data sent by the terminal device, and sending the data to the processor, so that the processor sends the data to the display device for display through the WIFI module.

[0009] In some embodiments of the present application, when the processor is used to load a virtual keyboard driver to generate a virtual keyboard, it is specifically used to:

[0010] By calling the USB controller core and the slave device controller driver, the input interface virtualizes a virtual keyboard;

[0011] Create a device file corresponding to the virtual keyboard to control the virtual keyboard according to the device file.

[0012] In some embodiments of the present application, the input interface includes at least one of the following interfaces: a USB interface and a Type-C interface.

[0013] In some embodiments of the present application, the processor is further used to: encode the data sent by the terminal device to send the processed data to the display device.

[0014] In some embodiments of the present application, the screen transmitter also includes a control button, which is connected to the processor and is used to control the screen transmitting function of the screen transmitter.

[0015] In some embodiments of the present application, the screen transmitter also includes a light board, which is connected to the processor and includes at least one indicator light for indicating the working status of the screen transmitter.

[0016] In a second aspect, an embodiment of the present application provides a screen projection method, which is applied to the screen transmitter of any one of the first aspects, the screen transmitter is inserted into a terminal device and powered on, and the screen transmitter communicates with the terminal device; the method includes:

[0017] Load a virtual keyboard driver to generate a virtual keyboard, input a screen projection key value through the virtual keyboard, and send the screen projection key value to the terminal device, so that the terminal device loads the screen projection interface based on the screen projection key value;

[0018] Receive data sent by the terminal device and send the data to the display device for display.

[0019] In a third aspect, an embodiment of the present application provides a screen projection system, comprising a terminal device, a display device, and the screen transmitter of any one of the first aspects, wherein the display device is used to display the information to be projected by the terminal device.

[0020] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which computer execution instructions are stored. When the computer execution instructions are executed by a processor, the method of the second aspect is implemented.

[0021] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program, which implements the method of the second aspect when executed by a processor.

[0022] The present application provides a screen transmitter, a screen projection method, a screen projection system, a storage medium and a program product. The screen transmitter is inserted into a terminal device, powered on and started, and establishes communication with the terminal device. The screen transmitter may include a processor, an input interface and a WIFI module, wherein the processor can generate a virtual keyboard by loading a virtual keyboard driver, so that the screen projection key value can be automatically input through the virtual keyboard, so that the terminal device can recognize the input screen projection key value and load the corresponding screen projection interface. The user can select a display device in the screen projection interface, and the terminal device can send data to the display device through the screen transmitter for display to realize screen projection. Since the screen transmitter of the present application has the function of a virtual keyboard, the screen projection key value can be automatically input based on the virtual keyboard without manual input, and there is no need to install a driver on the terminal device, which is convenient and fast, and simplifies the screen projection process, thereby improving the screen projection efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the implementation methods in the embodiments of the present application or the related technologies, the following is a brief introduction to the drawings required for use in the embodiments or the related technology descriptions. Obviously, the drawings described below are some embodiments of the present application, and a person skilled in the art can also obtain other drawings based on these drawings.

[0024] Figure 1 A schematic diagram of a screen projection scenario provided in an embodiment of the present application;

[0025] Figure 2 A schematic diagram of the structure of a display device provided in an embodiment of the present application;

[0026] Figure 3 A schematic diagram of the structure of a screen transmitter provided in an embodiment of the present application Figure 1 ;

[0027] Figure 4 A schematic diagram of a screen projection interface of a terminal device provided in an embodiment of the present application;

[0028] Figure 5 A schematic diagram of the architecture of a Linux USB protocol stack provided in an embodiment of the present application;

[0029] Figure 6 A schematic diagram of the structure of a screen transmitter provided in an embodiment of the present application Figure 2 ;

[0030] Figure 7 A schematic diagram of a screen transmitter provided in an embodiment of the present application;

[0031] Figure 8 A flow chart of a screen projection method provided in an embodiment of the present application;

[0032] Fig. 9A schematic diagram of the interaction process between a screen transmitter and a computer provided in an embodiment of the present application;

[0033] Fig.10 A schematic diagram of the architecture of a screen projection system provided in an embodiment of the present application;

[0034] Fig.11 A schematic diagram of the structure of another screen transmitter provided in an embodiment of the present application. DETAILED DESCRIPTION

[0035] In order to make the purpose, implementation mode and advantages of the present application clearer, the exemplary implementation mode of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, rather than all the embodiments.

[0036] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0037] In addition, the terms "include" and "have" and any variations thereof are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to those components expressly listed but may include other components not expressly listed or inherent to such products or devices.

[0038] Miracast is a wireless display standard based on Wi-Fi Direct developed by the Wi-Fi Alliance in 2012. 3C devices that support this standard can share video images wirelessly. For example, a mobile phone can use Miracast to play videos or photos directly on a TV or other device without any connection cables or wireless hotspots (AP, Access Point).

[0039] Miracast's underlying layer completes the establishment of a communication link based on WIFIP2P networking. After the Miracast application is started, it will enter the P2P scanning state. When the mobile phone is connected to the Sink end as the Source end, the driver layer first conducts networking. After the networking is successful, the framework layer sends a broadcast of successful networking, which will include the MAC address and device name of the mobile device. If the TV end is the GO (Group Owner) end, the IP of the mobile end is obtained through the ARP (Address Resolution Protocol) protocol. After obtaining the IP, the RTSP (Real Time Streaming Protocol) protocol can be used to complete communication with the mobile end, obtain the port for the mobile end to send video data, and use the port to obtain the RTP (Real-time Transport Protocol) video data sent by the mobile end. After receiving the data, it undergoes RTP packet header analysis and data integrity detection, and is buffered to the cache area for storage. After receiving the video data, the application layer playback interface is started and the player is called to play the video.

[0040] Currently, computers running Windows 10 and later can use the shortcut key Win+K to bring up the system's built-in Miracast screen projection interface. Users can easily select a large screen for directional projection. However, some users may not be used to using Win+K, and may not remember it, resulting in low screen projection efficiency and poor user experience.

[0041] At the same time, the computer screen can be a touch screen or a non-touch screen. In some application scenarios such as teaching scenarios, the computer is usually a touch screen and cannot be connected to an external mouse or keyboard. At this time, it is not possible to call screen projection through shortcut keys.

[0042] Some users are more accustomed to using hardware such as wireless screen transmitters to achieve the screen projection function. Ordinary USB screen transmitters require the installation of driver software on the personal computer. Some users do not click on the driver installation without knowing it, resulting in the inability to project the screen.

[0043] Based on the above problems, the present application provides a screen transmitter, a screen projection method, a screen projection system, a storage medium and a program product. In the screen transmission process, the screen transmitter, as a USB (Universal Serial Bus) device end, can increase the virtual keyboard function of the screen transmitter. After the screen transmitter is powered on and the initialization process is completed, by inputting the screen projection key value into the virtual keyboard, such as Win+K, the terminal device automatically loads and displays the Miracast function interface. The Miracast function interface is the screen projection interface. The user can select the display device to be projected on the screen projection interface, thereby realizing screen projection. There is no need to manually input the screen projection key value, and there is no need to install the driver software of the screen transmitter on the terminal device. It is convenient and fast, effectively improving the screen projection efficiency and enhancing the user experience.

[0044] The screen transmitter, screen projection method, screen projection system, storage medium and program product of the present application can be applied to screen projection technology and can also be applied to the field of conference tablets, which is not limited by the present application.

[0045] Figure 1 A schematic diagram of a screen projection scenario provided in an embodiment of the present application, such as Figure 1 As shown, the screen transmitter 10 can be inserted into the terminal device 20 to realize the connection between the two. The terminal device 20 can complete the communication establishment with the screen transmitter 10 based on the underlying driver to realize communication. The screen transmitter 10 and the display device 30 can be connected wirelessly. When screen projection is required, the terminal device 20 can send the data to be projected to the display device 30 through the screen transmitter 10, and the display device 30 can display the data to be projected.

[0046] Figure 2 A schematic diagram of a display device provided in an embodiment of the present application is shown in FIG. Figure 2 As shown, the display device 30 may include at least one of a tuner 310, a communicator 320, a detector 330, an external device interface 340, a controller 350, a display 360, an audio output interface 370, a memory, a power supply, and a user interface.

[0047] In some embodiments, the controller includes a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and a first interface to an nth interface for input / output.

[0048] The display 360 includes a display screen component for presenting images, and a driving component for driving image display, a component for receiving image signals output from a controller, and a component for displaying video content, image content, and a menu control interface, as well as a user control UI interface.

[0049] The display 360 may be a liquid crystal display, an OLED display, or a projection display, and may also be a projection device and a projection screen.

[0050] The communicator 320 is a component for communicating with an external device or server according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, and other network communication protocol chips or a near field communication protocol chip, and an infrared receiver. The display device 30 can establish transmission and reception of control signals and data signals with the external control device or server 400 through the communicator 320.

[0051] The user interface can be used to receive control signals from a control device (such as an infrared remote controller, etc.).

[0052] The detector 330 is used to collect signals from the external environment or the external interaction. For example, the detector 330 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 330 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 330 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0053] The external device interface 340 may include, but is not limited to, any one or more of the following: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It may also be a composite input / output interface formed by the above multiple interfaces.

[0054] The tuner-demodulator 310 receives broadcast television signals via wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

[0055] In some embodiments, the controller 350 and the tuner-demodulator 310 may be located in different separate devices, that is, the tuner-demodulator 310 may also be located in an external device of the main device where the controller 350 is located, such as an external set-top box.

[0056] The controller 350 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 350 controls the overall operation of the display device 30. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 360, the controller 350 can perform operations related to the object selected by the user command.

[0057] In some embodiments, the controller includes a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM Random Access Memory (RAM), ROM (Read-Only Memory, ROM), a first interface to an nth interface for input / output, a communication bus (Bus), etc.

[0058] The technical solution of the present application is described in detail below in conjunction with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0059] Figure 3 A schematic diagram of the structure of a screen transmitter provided in an embodiment of the present application Figure 1 , the screen sharing device 10 is inserted into the terminal device 20 and powered on, and the screen sharing device 10 communicates with the terminal device 20; Figure 3 As shown, the screen transmitter 10 includes: a processor 101, an input interface 102 and a WIFI module 103;

[0060] The processor 101 is connected to the input interface 102 and the WIFI module 103 respectively, and is used to load a virtual keyboard driver to generate a virtual keyboard, input a screen projection key value through the virtual keyboard, and send the screen projection key value to the terminal device 20, so that the terminal device 20 loads a screen projection interface based on the screen projection key value;

[0061] The input interface 102 is connected to the terminal device 20 and is used to receive data sent by the terminal device 20 and send the data to the processor 101, so that the processor 101 sends the data to the display device 30 for display through the WIFI module 103.

[0062] The terminal device 20 shown above is a device to be projected, which usually has a small display screen and can be a touch screen device or a non-touch screen device, including but not limited to a personal computer, a laptop computer, a tablet computer, a mobile phone, a portable wearable device, etc. The screen to be projected on the terminal device 20 is sent to the display device 30 for display through the screen transmitter 10. The display device 30 is a device with a large display screen, including but not limited to a conference tablet, a television, a smart TV, a laser projection device, an electronic whiteboard, an electronic desktop, etc.

[0063] In some embodiments, the screen transmitter 10 can be wirelessly connected to the display device 30 via the WIFI module 103 and wiredly connected to the terminal device 20 via the input interface 102 . Specifically, it can be directly inserted into the terminal device 20 via the input interface 102 .

[0064] The input interface 102 may include at least one of the following interfaces: a USB interface and a Type-C interface, and may support data input from interfaces such as USB and Type-C. The present application does not impose any specific restrictions on the type of the input interface 102.

[0065] In some embodiments, when the processor 101 is used to load a virtual keyboard driver to generate a virtual keyboard, it can be implemented based on a Gadget driver.

[0066] The screen projection key value is a shortcut key used by the terminal device 20 to display the screen projection interface, which can be an independent key value or a combination key value. Taking the terminal device 20 running the Windows operating system as an example, a shortcut key used to display the screen projection interface is the combination key value Win+K.

[0067] In one implementation scenario, after receiving the projection key value, the terminal device 20 identifies the projection key value to load the corresponding projection interface. Figure 4 A schematic diagram of a screen projection interface of a terminal device provided in an embodiment of the present application, with reference to Figure 4 As shown, the screen projection interface can display the device names of one or more display devices 30 capable of screen projection, and the user can select one or more display devices 30 to implement screen projection. It should be noted that the screen projection interface is a functional interface displayed by the terminal device 20 based on Miracast.

[0068] In some embodiments, during the screen projection process, the terminal device 20 sends the data to be projected to the processor 101 through the input interface 102, and the processor 101 is also used to: encode the data sent by the terminal device 20 to send the processed data to the display device 30. Among them, the processor 101 can be a main control chip, and the data to be projected can be text, images, or audio and video data, etc., which is not limited in this application.

[0069] It should be noted that based on the Miracast protocol, screen projection is usually one-to-one, that is, one terminal device 20 corresponds to one display device 30. In another implementation scenario, the protocol for screen projection can also be customized to achieve one-to-many screen projection, that is, one terminal device 20 corresponds to multiple display devices 30.

[0070] The embodiment of the present application provides a screen transmitter 10, and the processor 101 generates a virtual keyboard by loading a virtual keyboard driver. The projection key value can be input through the virtual keyboard, and the projection key value is sent to the terminal device 20, so that the terminal device 20 can recognize the projection key value, load and display the projection interface. The user can select the display device 30 to be projected in the projection interface to realize the projection. The present application adds a virtual keyboard function to the screen transmitter 10, and automatically inputs the projection key value used to load the projection interface of the terminal device 20 through the virtual keyboard, without manual input, and at the same time, it can be realized without pre-installing the driver of the screen transmitter 10 on the terminal device 20. It simplifies the process of using the projection key value of Miracast, is convenient and fast, shortens the projection time, effectively improves the projection efficiency, and enhances the user experience.

[0071] In one or more embodiments of the present application, when the processor 101 is used to load the virtual keyboard driver to generate a virtual keyboard, it is specifically used to:

[0072] By calling the USB controller core and the slave device controller driver, the input interface 102 virtualizes a virtual keyboard;

[0073] Create a device file corresponding to the virtual keyboard to control the virtual keyboard according to the device file.

[0074] In some embodiments, USB devices can be divided into HOST (master device) and SLAVE (slave device), and data transmission can be achieved by connecting a master device to a slave device.

[0075] USB can be divided into three modes: HOST mode, Device mode and USB OTG mode. Among them, HOST mode is the host mode, Device mode is the device mode, and USB OTG mode means that the device can act as both a host and a device.

[0076] In the embodiment of the present application, the screen transmitter 10 works in the device mode, that is, the screen transmitter 10 acts as a slave device, and the terminal device 20 works in the host mode, that is, as a host. Taking the Linux operating system as an example, the USB driver of Linux can be divided into a host driver and a gadget driver. The host driver is a mechanism by which the device, as a host, can identify and control a general USB peripheral through the driver. The gadget driver is a mechanism by which the device itself provides functions as a type of USB peripheral. Figure 5 A schematic diagram of the architecture of a Linux USB protocol stack provided in an embodiment of the present application, refer to Figure 5As shown, the Linux USB protocol stack is a layered architecture, with the USB Device driver on the left, the USB Host driver on the right, and the bottom layer being the drivers for different USB controllers and PHY (Port Physical Layer) on the chip.

[0077] refer to Figure 5 The USB Device driver process shown on the left, the UDC (USB Device Controller) driver can directly access the hardware, control the underlying communication between the USB device and the host, and provide callback functions for hardware-related operations to the upper layer. The Gadget API (Application Programming Interface) is a simple wrapper of the UDC driver callback function, and this part of the program kernel has been written. The Gadget driver specifically controls the implementation of the USB device function, allowing the device to exhibit features such as "U disk" and "virtual serial port".

[0078] In an embodiment of the present application, a virtual keyboard is realized by developing a Gadget driver on the USB device side, i.e., the screen transmitter side. Specifically, the Gadget driver interacts with the Linux kernel based on the API interface provided by the Gadget core, and then combines with the Linux system framework to virtualize a virtual keyboard using a USB port, wherein the Gadget core is part of the functions supported by the USB controller core (UDC core). Specifically, the Gadget function driver can enable a USB device working in Device mode to implement a variety of virtual device functions, including but not limited to video devices, audio devices, etc., and can also implement the virtual keyboard function shown in this application. Based on the Gadget function driver, a virtual keyboard driver capable of virtualizing a virtual keyboard function can be obtained. When the virtual keyboard driver is loaded, the input interface 102 can virtualize a virtual keyboard by calling the USB controller core and the slave device controller driver (ControllerDevice driver). Among them, the USB controller core can also be Figure 5 The composite Gadget shown in .

[0079] In Linux, hardware devices can be viewed as files to facilitate process control of hardware devices. Therefore, after obtaining the virtual keyboard, a corresponding device file can be created to control the virtual keyboard by processing the device file.

[0080] Figure 5The USB Host driver shown on the right is the USB driver process on the host side, which may include the host controller driver (Controller Host driver), the host core (hub driver), the host driver (Host Class driver), the file system / audio / video / framework, the USB Devio driver, libusb, etc. The USB driver process on the host side is not the focus of this application, and relevant public information or documents may be referred to, and this application will not repeat it here.

[0081] In summary, the present application obtains the virtual keyboard driver through the Gadget driver, and by loading the virtual keyboard driver, the input interface 102 of the screen transmitter 10 has the function of a virtual keyboard, so that the projection key value can be automatically input to the terminal device 20 according to the virtual keyboard. After the terminal device 20 recognizes the projection key value, it can load and pop up the corresponding projection interface. The user can realize the projection by selecting the display device 30 to be projected, which effectively improves the projection efficiency.

[0082] Figure 6 A schematic diagram of the structure of a screen transmitter provided in an embodiment of the present application Figure 2 In one or more embodiments of the present application, the processor 101 is used as the main control chip for illustration. In one implementation scenario, refer to Figure 6 As shown, the main control chip and the WIFI module 103 can be connected via SDIO (Secure Digital Input and Output).

[0083] The input interface 102 is a USB interface or a Type-C interface, through which the terminal device 20 can be inserted to realize a wired connection between the main control chip and the terminal device 20. It should be noted that if the input interface 102 is a Type-C interface, a signal conversion unit needs to be added between the input interface 102 and the main control chip to convert the DP signal into a MIPI signal that the main control chip can support.

[0084] like Figure 6 As shown, the main control chip may include a USB controller 1011, and the USB controller 1011 may be connected to the input interface 102 via a USB cable. The input interface 102 receives data sent by the terminal device 20, and may first send the data to the USB controller 1011, and the USB controller 1011 sends the data to the main control chip for processing, and sends the processed data to the display device 30 through the WIFI module 103 for display.

[0085] In some embodiments, the screen transmitter 10 further includes a control button 104 , which is connected to the processor 101 and is used to control the screen transmission function of the screen transmitter 10 .

[0086] In some embodiments, the screen transmission function of the screen transmitter 10 can be turned on or off by controlling the control button 104. The number of the control buttons 104 can be one or more. In one implementation scenario, if there is one control button 104, the screen transmission can be started by pressing the control button, and the screen transmission can be ended by pressing the control button again.

[0087] In another implementation scenario, if there are two control buttons 104, specifically, they may include a start control button and an end control button. By pressing the start control button, the screen transmitter 10 can be controlled to start screen transmission, and by pressing the end control button, the screen transmitter 10 can be controlled to end screen transmission.

[0088] In another implementation scenario, there may also be an abort control button and a continue control button. The current screen transmission can be paused by the abort control button, and the current screen transmission process can be resumed by the continue control button.

[0089] The configuration of the control button 104 can be adjusted according to actual needs, and this application does not impose any restrictions on this.

[0090] In some embodiments, the screen transmitter 10 further includes a light board 105 , which is connected to the processor 101 and includes at least one indicator light for indicating the working status of the screen transmitter 10 .

[0091] In one implementation scenario, the indicator light can indicate the working status of the screen transmitter 10 by flashing state and / or color, and the number of the indicator light can be one or more and can be set according to actual needs.

[0092] The working state of the screen sharing device 10 may include whether communication is established with the terminal device 20. For example, after the screen sharing device 10 is inserted into the terminal device 20, if it is not ready, that is, if communication is not established with the terminal device 20, the indicator light may be in a flashing state. When the screen sharing device 10 is ready, the indicator light may be in a constant on state.

[0093] In one implementation scenario, the on or off of the screen transmission function of the screen transmission device 10 can also be represented by different flashing states and colors of indicator lights. For example, when the screen transmission function of the screen transmission device 10 is on, the indicator light is always green; when the screen transmission function is off, the indicator light is always red, etc.

[0094] Figure 7 A schematic diagram of a screen transmitter provided in an embodiment of the present application, such as Figure 7 As shown, the screen transmitter includes a control button, an indicator light and an input interface. The input interface can be a USB interface or a Type-C interface. The processor included in the screen transmitter is Figure 7 Not reflected in.

[0095] Figure 7 The screen transmitter shown in the figure is only an exemplary implementation method, and this application does not limit it.

[0096] In summary, the user can control the screen transmission function of the screen transmission device 10 through the control button 104, which is convenient and quick. At the same time, the user can timely understand the current working status of the screen transmission device 10 according to the status of the indicator light of the current light board 105, which is clear and helps to improve the user experience.

[0097] Figure 8 A flow chart of a screen projection method provided in an embodiment of the present application is applied to the above-mentioned screen transmitter 10. The screen transmitter 10 is inserted into a terminal device and powered on, and the screen transmitter 10 communicates with the terminal device 20. The method includes:

[0098] S801: Load a virtual keyboard driver to generate a virtual keyboard, input a screen projection key value through the virtual keyboard, and send the screen projection key value to the terminal device, so that the terminal device loads a screen projection interface based on the screen projection key value.

[0099] In some embodiments, an application is deployed on the screen transmitter end, and the application can detect that the virtual keyboard and the terminal device have completed the underlying communication, that is, the screen transmitter and the terminal device can communicate normally. At this time, the application can input the screen projection key value into the virtual keyboard and send the screen projection key value to the terminal device. The terminal device recognizes the screen projection key value and can load the screen projection interface corresponding to the screen projection key value to display one or more display devices that can be projected to the user.

[0100] In some embodiments, the virtual keyboard driver can be implemented based on the Gadget driver. Specifically, the virtual keyboard driver can be obtained based on the Gadget function driver, and the virtual keyboard function of the input interface can be implemented by calling the USB controller core and the slave device controller driver.

[0101] The projection key value is a shortcut key for the terminal device to display the projection interface. The operating system of the terminal device can recognize the projection key value entered on the virtual keyboard, load the system's own projection interface, and automatically call out the projection interface to display it to the user.

[0102] S802: Receive data sent by the terminal device, and send the data to the display device for display.

[0103] In the process of screen projection, the terminal device sends the data to be projected to the display device through the screen transmitter so that the display device can display the data to achieve screen projection. The data to be projected can be text, images, or audio and video data.

[0104] In some embodiments, the terminal device can send the data to be projected to the input interface of the screen transmitter, the input interface sends the data to the processor for processing, and the processor sends the processed data remotely to the display device through the WiFi module. The display device can display the text, image or audio and video information corresponding to the data.

[0105] The screen projection method provided in the embodiment of the present application adds a virtual keyboard function of the screen transmitter. Based on the virtual keyboard, the projection key value can be automatically input into the terminal device, so that the terminal device automatically pops up the Miracast projection interface. The user can directly select the display device to project the screen to achieve screen projection, without the need to manually input the projection key value. At the same time, there is no need to install the driver software of the screen transmitter on the terminal device. It is convenient and portable, simplifies the screen projection process, and effectively improves the screen projection efficiency.

[0106] Based on the above embodiments, a specific embodiment is provided below to describe the screen projection process using a terminal device as a computer.

[0107] Fig. 9 A schematic diagram of the interaction process between a screen transmitter and a computer provided in an embodiment of the present application, referring to Figure 8 As shown in the figure, the method of implementing screen projection is as follows:

[0108] S901: Plug the screen transmitter into the computer's USB port and power it on.

[0109] S902: The USB driver that comes with the computer's Windows system recognizes the screen transmitter and completes handshake and protocol negotiation with the screen transmitter through the underlying driver.

[0110] Completing handshake and protocol negotiation with the screen transmitter through the underlying driver is a standard behavior of the Windows system and is not the research focus of this application. Please refer to relevant public information or literature. This application will not go into details here.

[0111] S903: The screen transmitter loads a virtual keyboard driver to obtain a virtual keyboard device.

[0112] S904: The screen transmitter application enters the Win+K key combination value into the virtual keyboard in sequence.

[0113] S905: The computer's Windows system recognizes that the Win+K key combination is input by an external keyboard, loads the system's built-in screen projection interface, and the computer automatically calls the screen projection interface.

[0114] The method of the embodiment of the present application simplifies the Win+K steps of using Miracast. In the scenario where the driver application does not need to be installed, the screen projection interface can be popped up on the computer by using the screen transmitter. The user only needs to select the screen projection object, that is, the display device, to realize the screen projection, which is convenient and fast. The specific process and implementation principle of the method of this embodiment can be referred to the above embodiment, and will not be repeated here.

[0115] Fig.10 The present invention provides an architectural diagram of a screen projection system provided in an embodiment of the present application. The screen projection system includes a terminal device 20, a display device 30 and the above-mentioned screen transmitter 10. The display device 30 is used to display the information to be projected by the terminal device 20.

[0116] Among them, the specific working principles of the terminal device 20 and the screen transmitter 10 can be referred to the above embodiments and will not be repeated here.

[0117] The screen transmitter 10 provided in the embodiment of the present application may further include: a memory 1101 which is communicatively connected to the processor 101. Fig.11 As shown, Fig.11 A schematic diagram of the structure of another screen transmitter provided in an embodiment of the present application.

[0118] The memory 1101 is used to store programs. Specifically, the programs may include program codes, and the program codes include computer operation instructions.

[0119] The memory 1101 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0120] The processor 101 is used to execute the computer-executable instructions stored in the memory 1101 to implement the method described in the above method embodiment. The processor 101 may be a central processing unit 101 (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application.

[0121] In some embodiments, the display device may further include a communication interface 1102. In a specific implementation, if the communication interface 1102, the memory 1101 and the processor 101 are implemented independently, the communication interface 1102, the memory 1101 and the processor 101 may be interconnected through a bus and communicate with each other. The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc., but it does not mean that there is only one bus or one type of bus.

[0122] In some embodiments, in a specific implementation, if the communication interface 1102, the memory 1101 and the processor 101 are integrated on a chip, the communication interface 1102, the memory 1101 and the processor 101 can complete communication through an internal interface.

[0123] The screen transmitter provided in this embodiment is used to execute the method executed in the aforementioned embodiment. Its implementation principle and technical effect are similar and will not be described in detail.

[0124] The present application also provides a computer-readable storage medium, on which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, the above method is implemented.

[0125] The computer-readable storage medium may include: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes.

[0126] The present application also provides a computer program product, including a computer program, which implements the above method when executed by a processor.

[0127] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0128] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A screen transmission device, characterized in that: The screen transmitter is inserted into the terminal device and powered on to start, and the screen transmitter communicates with the terminal device; the screen transmitter includes: a processor, an input interface and a WIFI module; The processor is connected to the input interface and the WIFI module respectively, and is used to load a virtual keyboard driver to generate a virtual keyboard, input a screen projection key value through the virtual keyboard, and send the screen projection key value to the terminal device, so that the terminal device loads a screen projection interface based on the screen projection key value; The input interface is connected to the terminal device, and is used for receiving data sent by the terminal device, and sending the data to the processor, so that the processor sends the data to the display device for display through the WIFI module.

2. The screen transmission device according to claim 1, characterized in that: When the processor is used to load the virtual keyboard driver to generate a virtual keyboard, the processor is specifically used to: By calling the USB controller core and the slave device controller driver, the input interface virtualizes a virtual keyboard; A device file corresponding to the virtual keyboard is created to control the virtual keyboard according to the device file.

3. The screen sharing device according to claim 1, characterized in that: The input interface includes at least one of the following interfaces: a USB interface and a Type-C interface.

4. The screen transmitter according to claim 1, characterized in that: The processor is further configured to: encode the data sent by the terminal device, so as to send the processed data to the display device.

5. The screen sharing device according to claim 1, characterized in that: The screen transmitter also includes a control button, which is connected to the processor and is used to control the screen transmission function of the screen transmitter.

6. The screen sharing device according to any one of claims 1 to 5, characterized in that: The screen transmitter also includes a light board, which is connected to the processor and includes at least one indicator light for indicating the working status of the screen transmitter.

7. A screen projection method, characterized in that: The screen transmitting device according to any one of claims 1 to 6 is applied, the screen transmitting device is inserted into a terminal device and powered on to start, and the screen transmitting device communicates with the terminal device; the method comprises: Loading a virtual keyboard driver to generate a virtual keyboard, inputting a screen projection key value through the virtual keyboard, and sending the screen projection key value to a terminal device, so that the terminal device loads a screen projection interface based on the screen projection key value; Receive data sent by the terminal device, and send the data to a display device for display.

8. A screen projection system, characterized in that: It comprises a terminal device, a display device and a screen transmitter as described in any one of claims 1 to 6, wherein the display device is used to display the information to be projected by the terminal device.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, the method of claim 7 is implemented.

10. A computer program product, characterized in that The invention comprises a computer program, which implements the method of claim 7 when being executed by a processor.

Images