Relay-based projection screen display method and device

Abstract

The invention discloses a Relay-based screen projection display method and device, and the method comprises the steps: obtaining screen display data, and carrying out the packaging and compression of the screen display data; acquiring USB node information of the Relay chip, and determining a USB device type of the Relay chip according to the USB node information; determining a working mode according to the type of the USB equipment; transmitting the compressed screen display data to a PC (Personal Computer) end according to a USB (Universal Serial Bus) port of the Relay chip, so that the PC end displays the screen display data; and receiving control information transmitted by the PC terminal, and responding to a control operation on a control interface according to the control information to realize screen projection interaction. According to the invention, communication between the education all-in-one machine and the two USB Host ports of the PC terminal is established through the Relay chip, so that the education all-in-one machine and the main chip of the PC terminal do not need to be connected through a wire.

Description

Technical Field

[0001] The present invention relates to the field of screen projection of an all-in-one educational machine, and in particular to a screen projection display method and device based on Relay. Background Art

[0002] The teaching all-in-one machine is an intelligent teaching terminal device that integrates multiple functions such as projection, television, and computer. It can be directly connected to the teacher's computer to realize various teaching methods such as projection, video playback, PPT production, interactive answering, etc., and has functions such as real-time interaction, data statistics, and supervision and management. At present, the education all-in-one machine is widely used in multimedia classrooms, training classrooms, recording and broadcasting classrooms and other educational scenarios.

[0003] When the current all-in-one education machine is connected to a computer for data exchange, a one-way connection is made via HDMI. Although the computer can project the screen to the all-in-one education machine, the reverse projection cannot be achieved. Summary of the invention

[0004] The present invention provides a screen projection display method and device based on Relay, so as to solve the problem that the existing educational all-in-one machine is connected unidirectionally via HDMI and cannot realize reverse screen projection because it has no OTG port.

[0005] In order to solve the above technical problems, an embodiment of the present invention provides a screen projection display method based on Relay, including:

[0006] Acquiring screen display data, and packaging and compressing the screen display data;

[0007] Obtaining USB node information of the Relay chip, determining the USB device type of the Relay chip according to the USB node information; and determining the working mode according to the USB device type;

[0008] Transmitting the compressed screen display data to the PC through the USB port of the Relay chip, so that the PC displays the screen display data;

[0009] Receive the control information transmitted by the PC, respond to the control operation of the control interface according to the control information, and realize screen projection interaction.

[0010] The present invention establishes communication between the two USB Host ports of the educational all-in-one machine and the PC through a Relay chip, so that the main chip of the educational all-in-one machine and the PC does not need to be connected by wires. The USB device type is obtained through the Relay chip, and the working mode is selected according to the USB device type. The screen display data is projected and displayed, and the control information of the control interface is obtained through the USB port of the Relay chip to realize screen projection interaction.

[0011] Further, the USB node information of the Relay chip is obtained, and the USB device type of the Relay chip is determined according to the USB node information; and the working mode is determined according to the USB device type, specifically:

[0012] Obtain node information of the data transmission channel inside the USB device of the Relay chip, and obtain a device descriptor according to the node information;

[0013] The USB device type of the Relay chip is determined according to the device descriptor, and the resolution and frame rate are selected according to the USB device type to determine the working mode.

[0014] Further, the resolution and frame rate are selected according to the USB device type to determine the working mode, specifically:

[0015] The USB device type includes USB2.0 and USB3.0. If the USB device type is USB2.0, the working mode is smooth mode, at which the resolution is 1920*1080 and the frame rate is 30Hz;

[0016] If the USB device type is USB3.0, the working mode is high-definition mode, at which time the resolution is 3840*2160 and the frame rate is 24Hz.

[0017] Furthermore, the screen display data is obtained and the screen display data is packaged and compressed, specifically:

[0018] The main chip of the educational all-in-one machine calls the system screenshot interface to obtain screen display data;

[0019] The screen display data is compressed according to a video encoding algorithm.

[0020] Furthermore, the receiving of control information transmitted by the PC terminal and the responding of control operations on the control interface according to the control information to achieve screen projection interaction are specifically as follows:

[0021] Acquire control information transmitted by the PC end according to the USB port of the Relay chip, wherein the control information includes mouse click position information and touch position information;

[0022] The control information is parsed according to the main chip of the educational all-in-one machine, and the control operation of the control interface is responded to according to the parsed control information to realize screen projection interaction.

[0023] In a second aspect, the present invention provides a screen projection display device based on Relay, comprising: a data acquisition module, a mode determination module, a data transmission module and a response control module;

[0024] The data acquisition module is used to acquire screen display data and package and compress the screen display data;

[0025] The mode determination module is used to obtain the USB node information of the Relay chip, determine the USB device type of the Relay chip according to the USB node information; and determine the working mode according to the USB device type;

[0026] The data transmission module is used to transmit the compressed screen display data to the PC end through the USB port of the Relay chip, so that the PC end displays the screen display data;

[0027] The response control module is used to receive the control information transmitted by the PC end, respond to the control operation of the control interface according to the control information, and realize screen projection interaction.

[0028] Furthermore, the acquisition mode determination module is specifically used to:

[0029] Obtain node information of the data transmission channel inside the USB device of the Relay chip, and obtain a device descriptor according to the node information;

[0030] The USB device type of the Relay chip is determined according to the device descriptor, and the resolution and frame rate are selected according to the USB device type to determine the working mode.

[0031] Furthermore, the mode determination module is further configured to:

[0032] The USB device type includes USB2.0 and USB3.0. If the USB device type is USB2.0, the working mode is smooth mode, at which the resolution is 1920*1080 and the frame rate is 30Hz;

[0033] If the USB device type is USB3.0, the working mode is high-definition mode, at which time the resolution is 3840*2160 and the frame rate is 24Hz.

[0034] Furthermore, the data acquisition module is specifically used for:

[0035] The main chip of the educational all-in-one machine calls the system screenshot interface to obtain screen display data;

[0036] The screen display data is compressed according to a video encoding algorithm.

[0037] Furthermore, the response control module is specifically used to:

[0038] Acquire control information transmitted by the PC end according to the USB port of the Relay chip, wherein the control information includes mouse click position information and touch position information;

[0039] The control information is parsed according to the main chip of the educational all-in-one machine, and the control operation of the control interface is responded to according to the parsed control information to realize screen projection interaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 A schematic diagram of a flow chart of a screen projection display method based on Relay provided in an embodiment of the present invention;

[0041] Figure 2 A schematic diagram of the structure of a screen projection display system provided by an embodiment of the present invention;

[0042] Figure 3 A schematic diagram of the structure of a Relay-based screen projection display device provided in an embodiment of the present invention;

[0043] Figure 4 A data transmission schematic diagram of a Relay-based screen projection display method provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0044] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0045] Embodiment 1

[0046] Please refer to Figure 1 , Figure 1 A flowchart of a screen projection display method based on Relay provided in an embodiment of the present invention includes steps 101 to 104, which are specifically as follows:

[0047] Step 101: obtaining screen display data, and packaging and compressing the screen display data;

[0048] Please refer to Figure 2 , Figure 2 A structural schematic diagram of a screen projection display system provided in an embodiment of the present invention.

[0049] In this embodiment, the projection display system is controlled by the projection display method based on Relay, and the projection display system includes an all-in-one education machine main chip, a Relay chip and a PC end. The all-in-one education machine is connected to the USB port of the Relay chip, and the PC end is connected to the USB port of the Relay.

[0050] In this embodiment, the communication between the two USB Host ports of the educational all-in-one machine and the PC is realized according to the Relay chip, so that the main chip and the computer do not need to communicate with each other through a USB cable.

[0051] In this embodiment, the screen display data is obtained and the screen display data is packaged and compressed, specifically:

[0052] The main chip of the educational all-in-one machine calls the system screenshot interface to obtain screen display data;

[0053] The screen display data is compressed according to a video encoding algorithm.

[0054] In this embodiment, the main chip of the educational all-in-one machine calls the system screenshot interface to capture the screen display data, and compresses and packages the screen display data according to the video encoding algorithm.

[0055] In this embodiment, the screen display data is compressed using the H264 algorithm.

[0056] Step 102: Obtain USB node information of the Relay chip, determine the USB device type of the Relay chip according to the USB node information; and determine the working mode according to the USB device type;

[0057] In this embodiment, the USB node information of the Relay chip is obtained, and the USB device type of the Relay chip is determined according to the USB node information; and the working mode is determined according to the USB device type, specifically:

[0058] Obtain node information of the data transmission channel inside the USB device of the Relay chip, and obtain a device descriptor according to the node information;

[0059] The USB device type of the Relay chip is determined according to the device descriptor, and the resolution and frame rate are selected according to the USB device type to determine the working mode.

[0060] In this embodiment, the main chip reads the USB node information in the driver and checks the USB device type of the Relay chip to determine whether the current one is USB2.0 or USB3.0. The USB node refers to the USB endpoint, which is the data transmission channel inside the USB device and the interface for data exchange between the host and the device. The USB endpoint information is information used to describe the USB device and is set by the USB device, that is, the Relay information. The information contains a device descriptor, where bcdUSB represents the version number of the USB specification, for example, 0x0200 represents the USB 2.0 version, and 0x0300 represents the USB 3.0 version.

[0061] In this embodiment, the resolution and frame rate are selected according to the USB device type to determine the working mode, specifically:

[0062] The USB device type includes USB2.0 and USB3.0. If the USB device type is USB2.0, the working mode is smooth mode, at which the resolution is 1920*1080 and the frame rate is 30Hz;

[0063] If the USB device type is USB3.0, the working mode is high-definition mode, at which time the resolution is 3840*2160 and the frame rate is 24Hz.

[0064] In this embodiment, after determining the device type of the USB device, the resolution and frame rate are selected. In USB2.0, to ensure the smoothness of the video, the 1920*1080@30Hz working mode is used, and in USB3.0, the 3840*2160@24Hz working mode is used.

[0065] In this embodiment, the working mode of data transmission is determined by previously confirming the device type of the USB device, thereby avoiding the resolution and bit rate of the video not matching the compatibility of the device, resulting in subsequent unsmooth video playback.

[0066] Step 103: Transmitting the compressed screen display data to the PC end through the USB port of the Relay chip, so that the PC end displays the screen display data;

[0067] In this embodiment, the main chip of the educational all-in-one machine transmits the compressed screen display data to the PC through the USB port of the Relay chip. After receiving the screen display data, the PC decodes the compressed data to obtain the decoded screen display data.

[0068] In this embodiment, the PC decodes the compressed data using the H264 decoding format.

[0069] In this embodiment, after the PC decodes and obtains the screen display data, it creates streaming media to play the screen display data, monitors the mouse click information and touch position information, and packages the mouse click information and touch position information for transmission to the main chip of the education all-in-one machine.

[0070] Step 104: Receive the control information transmitted by the PC, respond to the control operation of the control interface according to the control information, and realize screen projection interaction.

[0071] In this embodiment, the receiving of control information transmitted by the PC end and the response to the control operation of the control interface according to the control information to realize screen projection interaction are specifically as follows:

[0072] Acquire control information transmitted by the PC end according to the USB port of the Relay chip, wherein the control information includes mouse click position information and touch position information;

[0073] The control information is parsed according to the main chip of the educational all-in-one machine, and the control operation of the control interface is responded to according to the parsed control information to realize screen projection interaction.

[0074] In this embodiment, the all-in-one educational machine receives and parses the control information, responds to the control operation of the control interface through the parsed mouse click position information and touch position information, and realizes the screen projection interactive operation.

[0075] In this embodiment, communication between the two USB Host ports of the educational all-in-one machine and the PC is established through the Relay chip, so that the main chip of the educational all-in-one machine and the PC does not need to be connected by wires. The USB device type is obtained through the Relay chip, and the working mode is selected according to the USB device type. The screen display data is projected and displayed, and the control information of the control interface is obtained through the USB port of the Relay chip to realize screen projection interaction.

[0076] Please refer to Figure 3 , Figure 3 A schematic diagram of a structure of a screen projection display device based on Relay provided in an embodiment of the present invention, comprising: a data acquisition module 301, a mode determination module 302, a data transmission module 303 and a response control module 304;

[0077] The data acquisition module 301 is used to acquire screen display data and package and compress the screen display data;

[0078] The mode determination module 302 is used to obtain the USB node information of the Relay chip, determine the USB device type of the Relay chip according to the USB node information; and determine the working mode according to the USB device type;

[0079] The data transmission module 303 is used to transmit the compressed screen display data to the PC end through the USB port of the Relay chip, so that the PC end displays the screen display data;

[0080] The response control module 304 is used to receive the control information transmitted by the PC end, respond to the control operation of the control interface according to the control information, and realize screen projection interaction.

[0081] In this embodiment, the mode determination module is specifically used to:

[0082] Obtain node information of the data transmission channel inside the USB device of the Relay chip, and obtain a device descriptor according to the node information;

[0083] The USB device type of the Relay chip is determined according to the device descriptor, and the resolution and frame rate are selected according to the USB device type to determine the working mode.

[0084] In this embodiment, the mode determination module is further configured to:

[0085] The USB device type includes USB2.0 and USB3.0. If the USB device type is USB2.0, the working mode is smooth mode, at which the resolution is 1920*1080 and the frame rate is 30Hz;

[0086] If the USB device type is USB3.0, the working mode is high-definition mode, at which time the resolution is 3840*2160 and the frame rate is 24Hz.

[0087] In this embodiment, the data acquisition module is specifically used to:

[0088] The main chip of the educational all-in-one machine calls the system screenshot interface to obtain screen display data;

[0089] The screen display data is compressed according to a video encoding algorithm.

[0090] In this embodiment, the response control module is specifically used to:

[0091] Acquire control information transmitted by the PC end according to the USB port of the Relay chip, wherein the control information includes mouse click position information and touch position information;

[0092] The control information is parsed according to the main chip of the educational all-in-one machine, and the control operation of the control interface is responded to according to the parsed control information to realize screen projection interaction.

[0093] In this embodiment, communication between the two USB Host ports of the educational all-in-one machine and the PC is established through the Relay chip, so that the main chip of the educational all-in-one machine and the PC does not need to be connected by wires. The USB device type is obtained through the Relay chip, and the working mode is selected according to the USB device type. The screen display data is projected and displayed, and the control information of the control interface is obtained through the USB port of the Relay chip to realize screen projection interaction.

[0094] Please refer to Figure 4 , Figure 4 A data transmission schematic diagram of a Relay-based screen projection display method provided in an embodiment of the present invention.

[0095] In this embodiment, the main chip side calls the system screenshot interface to capture the screen display data, and compresses the data through the H264 algorithm; the main chip side reads the USB node information in the driver, checks the Relay USB device type to determine whether it is currently USB2.0 or USB3.0, and then selects the resolution and frame rate. When USB2.0, in order to ensure the smoothness of the video, the 1920*1080@30Hz working mode is used, and in the case of USB3.0, the 3840*2160@24Hz working mode is used; after the data is compressed, the data is transmitted to the computer side via USB; after the computer side receives the data, H264 is also used to decode the data; after decoding, streaming media playback is created to display the image information projected from the all-in-one main chip; at the same time, the computer side transmits the mouse click or touch position information to the all-in-one main chip side; after the all-in-one main chip receives the touch data, it performs data analysis; the response of the interface is controlled by the analyzed touch data, thereby realizing the interaction of screen projection.

[0096] In this embodiment, communication between the two USB Host ports of the educational all-in-one machine and the PC is established through the Relay chip, so that the main chip of the educational all-in-one machine and the PC does not need to be connected by wires. The USB device type is obtained through the Relay chip, and the working mode is selected according to the USB device type. The screen display data is projected for display, thereby improving the adaptability of the video stream data and the data transmission port, and avoiding unsmooth video transmission and video playback. The control information of the control interface is also obtained through the USB port of the Relay chip to realize screen projection interaction.

[0097] The specific embodiments described above further illustrate the purpose, technical solutions and beneficial effects of the present invention. It should be understood that the above description is only a specific embodiment of the present invention and is not intended to limit the scope of protection of the present invention. It is particularly pointed out that for those skilled in the art, any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the scope of protection of the present invention.

Claims

1. A screen projection display method based on Relay, It is characterized in that include: Acquiring screen display data, and packaging and compressing the screen display data; Obtaining USB node information of the Relay chip, and determining the USB device type of the Relay chip according to the USB node information; And determining the working mode according to the USB device type; Transmitting the compressed screen display data to the PC through the USB port of the Relay chip, so that the PC displays the screen display data; Receive the control information transmitted by the PC, respond to the control operation of the control interface according to the control information, and realize screen projection interaction.

2. A screen projection display method based on Relay as claimed in claim 1, It is characterized in that The USB node information of the Relay chip is obtained, and the USB device type of the Relay chip is determined according to the USB node information; and the working mode is determined according to the USB device type, specifically: Obtain node information of the data transmission channel inside the USB device of the Relay chip, and obtain a device descriptor according to the node information; The USB device type of the Relay chip is determined according to the device descriptor, and the resolution and frame rate are selected according to the USB device type to determine the working mode.

3. A screen projection display method based on Relay as claimed in claim 2, It is characterized in that The resolution and frame rate are selected according to the USB device type to determine the working mode, specifically: The USB device type includes USB2.0 and USB3.

0. If the USB device type is USB2.0, the working mode is smooth mode, at which the resolution is 1920*1080 and the frame rate is 30Hz; If the USB device type is USB3.0, the working mode is high-definition mode, at which time the resolution is 3840*2160 and the frame rate is 24Hz.

4. A screen projection display method based on Relay as claimed in claim 1, It is characterized in that The obtaining of screen display data and packaging and compressing the screen display data is specifically as follows: The main chip of the educational all-in-one machine calls the system screenshot interface to obtain screen display data; The screen display data is compressed according to a video encoding algorithm.

5. A screen projection display method based on Relay as claimed in claim 1, It is characterized in that The receiving control information transmitted by the PC end, and responding to the control operation of the control interface according to the control information to realize the screen projection interaction, specifically comprises: Acquire control information transmitted by the PC end according to the USB port of the Relay chip, wherein the control information includes mouse click position information and touch position information; The control information is parsed according to the main chip of the educational all-in-one machine, and the control operation of the control interface is responded to according to the parsed control information to realize screen projection interaction.

6. A screen projection display device based on Relay, It is characterized in that include: Data acquisition module, mode determination module, data transmission module and response control module; The data acquisition module is used to acquire screen display data and package and compress the screen display data; The mode determination module is used to obtain the USB node information of the Relay chip and determine the USB device type of the Relay chip according to the USB node information; And determining the working mode according to the USB device type; The data transmission module is used to transmit the compressed screen display data to the PC end through the USB port of the Relay chip, so that the PC end displays the screen display data; The response control module is used to receive the control information transmitted by the PC end, respond to the control operation of the control interface according to the control information, and realize screen projection interaction.

7. A screen projection display device based on Relay as claimed in claim 6, It is characterized in that The mode determination module is specifically used for: Obtain node information of the data transmission channel inside the USB device of the Relay chip, and obtain a device descriptor according to the node information; The USB device type of the Relay chip is determined according to the device descriptor, and the resolution and frame rate are selected according to the USB device type to determine the working mode.

8. A screen projection display device based on Relay as claimed in claim 7, It is characterized in that The mode determination module is further specifically used for: The USB device type includes USB2.0 and USB3.

0. If the USB device type is USB2.0, the working mode is smooth mode, at which the resolution is 1920*1080 and the frame rate is 30Hz; If the USB device type is USB3.0, the working mode is high-definition mode, at which time the resolution is 3840*2160 and the frame rate is 24Hz.

9. A screen projection display device based on Relay as claimed in claim 6, It is characterized in that The data acquisition module is specifically used for: The main chip of the educational all-in-one machine calls the system screenshot interface to obtain screen display data; The screen display data is compressed according to a video encoding algorithm.

10. A screen projection display device based on Relay as claimed in claim 6, It is characterized in that The response control module is specifically used for: Acquire control information transmitted by the PC end according to the USB port of the Relay chip, wherein the control information includes mouse click position information and touch position information; The control information is parsed according to the main chip of the educational all-in-one machine, and the control operation of the control interface is responded to according to the parsed control information to realize screen projection interaction.

Images