Screen projection method, screen projection device and screen projection system

Abstract

The present invention provides a screen projection method, a screen projection device and a screen projection system, which relate to the field of display technology. According to an embodiment of the present invention, the screen projection method is applied to a screen projection device, the screen projection device is communicatively connected with a terminal device, and an image to be processed is received through the screen projection device. When the image to be processed is a display image from the terminal device, the display image is sent to a display screen to be displayed on the display screen, and the display screen is connected to the screen projection device through an image transmission interface; when the image to be processed is a projection image displayed on the display screen, the projection image is sent to the terminal device to be displayed on the screen of the terminal device; and a control instruction from the terminal device is received, and the image to be processed on the display screen is controlled to be displayed through the control instruction sent by the terminal device, thereby improving the convenience of controlling the display screen connected to the screen projection device.

Description

Technical Field

[0001] The present invention relates to the field of display technology, and in particular to a screen projection method, a screen projection device and a screen projection system. Background Art

[0002] The projection device can send the image to be displayed to the display screen connected to the projection device for projection display, and the user can use the touch film on the display screen to perform touch operations on the image. However, touch operations are not convenient in some application scenarios. For example, when the user performs touch operations on the display screen, the viewing experience of other users is affected due to the obstruction of the display screen by the body, or when the display screen is relatively large, there is a blind spot that the user cannot touch. Summary of the invention

[0003] The present invention provides a screen projection method, a screen projection device and a screen projection system to solve the deficiencies in the related art.

[0004] According to a first aspect of an embodiment of the present invention, a screen projection method is provided, which is applied to a screen projection device, wherein the screen projection device is communicatively connected with a terminal device, and the method includes:

[0005] receiving an image to be processed;

[0006] In the case where the image to be processed is a display image from the terminal device, the display image is sent to a display screen for display on the display screen, and the display screen is connected to the screen projection device via an image transmission interface;

[0007] In a case where the image to be processed is a projection image displayed on the display screen, sending the projection image to the terminal device to be displayed on the screen of the terminal device;

[0008] A control instruction is received from the terminal device, and the image to be processed is controlled to be displayed according to the control instruction.

[0009] In some embodiments, the screen projection device is communicatively connected with a plurality of terminal devices;

[0010] When the image to be processed is a display image from the terminal device, sending the display image to a display screen includes:

[0011] Determine a display area in the display screen corresponding to the terminal device that sends the display image, and display the display image in the display area, wherein the display area is obtained by dividing the display screen according to the number of terminal devices and has a corresponding relationship with the terminal devices;

[0012] When the image to be processed is a projection image displayed on the display screen, sending the projection image to the terminal device includes:

[0013] Determine a terminal device corresponding to a display area displaying the projected image, and send the projected image to the terminal device.

[0014] In some embodiments, a plurality of screen projection devices are communicatively connected with the terminal device;

[0015] When the image to be processed is a projection image displayed on the display screen, sending the projection image to the terminal device includes:

[0016] The projected screen image displayed on the display screen is sent to the terminal device, so that the terminal device determines the screen area corresponding to the projection device, and displays the projected screen image in the screen area, wherein the screen area is obtained by dividing the screen of the terminal device according to the number of projection devices, and has a corresponding relationship with the projection device.

[0017] In some embodiments, the screen projection device includes a control module and an image processing module;

[0018] The receiving a control instruction from the terminal device and controlling the image to be processed to display according to the control instruction includes:

[0019] The control module is used to receive control instructions from the terminal device, and the control instructions are sent to the image processing module, so that the image processing module processes the image to be processed according to the control instructions, and sends the processed image to the display screen for display.

[0020] In some embodiments, the control instruction is used to instruct to increase the resolution of the image to be processed;

[0021] The step of causing the image processing module to process the image to be processed according to the control instruction and sending the processed image to a display screen for display includes:

[0022] The image processing module is enabled to improve the resolution of the image to be processed according to the instruction of the control instruction, and send the image with improved resolution to the display screen for display.

[0023] In some embodiments, the display screen includes a vehicle window provided with a display module.

[0024] According to a second aspect of an embodiment of the present invention, there is provided a screen projection device, which is applied to a screen projection device, wherein the screen projection device is communicatively connected with a terminal device, and the device comprises:

[0025] A receiving unit, used for receiving an image to be processed;

[0026] A forward screen projection unit, used for sending the display image to a display screen to display the display screen when the image to be processed is a display image from the terminal device, and the display screen is connected to the screen projection device via an image transmission interface;

[0027] a reverse screen projection unit, configured to send the projected screen image to the terminal device so as to display it on the screen of the terminal device when the image to be processed is a projected screen image displayed on the display screen;

[0028] The control unit is used to receive a control instruction from the terminal device and control the image to be processed to display according to the control instruction.

[0029] According to a third aspect of an embodiment of the present invention, there is provided a screen projection system, the screen projection system comprising a screen projection device and a terminal device, the screen projection device being communicatively connected with the terminal device;

[0030] The screen projection device is used to receive the image to be processed;

[0031] When the image to be processed received by the screen projection device is a display image from the terminal device, the display image is sent to a display screen for display on the display screen, and the display screen is connected to the screen projection device via an image transmission interface;

[0032] When the image to be processed received by the screen projection device is a projection image displayed on the display screen, the projection image is sent to the terminal device to be displayed on the screen of the terminal device;

[0033] The screen projection device is used to receive control instructions from the terminal device and control the display of the image to be processed according to the control instructions.

[0034] In some embodiments, the screen projection system includes a screen projection device and a plurality of terminal devices;

[0035] When the image to be processed received by the projection device is a display image from the terminal device, a display area in the display screen corresponding to the terminal device that sends the display image is determined, and the display image is displayed in the display area, wherein the display area is obtained by dividing the display screen according to the number of terminal devices and has a corresponding relationship with the terminal devices;

[0036] When the projection device receives a projection image displayed on the display area, it determines a terminal device corresponding to the display area displaying the projection image, and sends the projection image to the terminal device.

[0037] In some embodiments, the screen projection system includes a terminal device and a plurality of screen projection devices;

[0038] When receiving the projection image displayed on the display screen, the projection device sends the projection image displayed on the display screen to the terminal device;

[0039] The terminal device is used to determine a screen area corresponding to the projection device and display the projection image in the screen area, wherein the screen area is obtained by dividing the screen of the terminal device according to the number of projection devices and has a corresponding relationship with the projection device.

[0040] According to the above embodiments, the present invention receives the image to be processed through the screen projection device, and when the image to be processed is a display image from the terminal device, sends the display image to the display screen for display on the display screen, and the display screen is connected to the screen projection device through an image transmission interface; when the image to be processed is a projected image displayed on the display screen, sends the projected image to the terminal device for display on the screen of the terminal device; and receives control instructions from the terminal device, and controls the display screen to display the image to be processed through the control instructions sent by the terminal device, thereby improving the convenience of controlling the display screen connected to the screen projection device.

[0041] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0043] Figure 1 It is a flowchart of a screen projection method according to an embodiment of the present invention.

[0044] Figure 2 It is a schematic diagram of the connection between the screen projection device and the terminal device according to an embodiment of the present invention.

[0045] Figure 3 is a schematic diagram of reverse screen projection according to an embodiment of the present invention.

[0046] Figure 4It is a schematic diagram showing the connection between a screen projection device and multiple terminal devices according to an embodiment of the present invention.

[0047] Figure 5 It is a schematic diagram showing the connection between a terminal device and multiple screen projection devices according to an embodiment of the present invention.

[0048] Figure 6 is a schematic diagram of a screen projection device according to an embodiment of the present invention.

[0049] Figure 7 It is a schematic diagram showing the interaction between a screen projection device and a terminal device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0050] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0051] The projection device can send the image to be displayed to the display screen connected to the projection device for projection display, and the user can use the touch film on the display screen to achieve touch operation on the image. For example, the display screen may include a car window with a display module, and the projection device sends the image to be displayed to the car window for display. The car window may be provided with a touch film, and the user can send control instructions by touching the touch film.

[0052] However, touch operation is not convenient in some application scenarios. For example, when a user performs touch operation on the display screen, the viewing experience of other users is affected by the user's body blocking the display screen. For another example, when the display screen is relatively large, there is a blind area that the user cannot touch, and the toucher cannot be at a suitable distance to observe the state of the entire display area, resulting in inconvenient touch. For another example, the display screen is far away from the user's position or the display screen is not convenient for the user to reach out and touch. For example, in a scenario where the car window is used as a display screen, the car window is far away from the user's seat. In this case, it is inconvenient for the user to control the information displayed on the car window.

[0053] In view of this, the present invention provides a screen projection method, which can be applied to a screen projection device, wherein the screen projection device is communicatively connected with a terminal device, that is, the terminal device and the screen projection device in the present invention can be network-connected devices with their own operating systems, for example, the screen projection device and the terminal device can be connected to the same network segment via a wireless network built by a router. The screen projection device is connected to the display screen via an image transmission interface, in which case the image displayed on the display screen can be controlled via the terminal device.

[0054] The following embodiments will illustrate the screen projection method provided by the embodiments of the present invention in conjunction with the accompanying drawings.

[0055] Figure 1 is a flow chart of a screen projection method according to an embodiment of the present invention. Figure 1 As shown, the screen projection method includes the following steps 101 to 103.

[0056] In step 101, an image to be processed is received.

[0057] In an embodiment of the present invention, the image to be processed may include a display image sent by a terminal device or a projection image displayed on a display screen.

[0058] That is to say, the image to be processed received by the projection device may include the display image sent by the terminal device, and may also include the projection image displayed on the display screen.

[0059] Among them, the projection image displayed on the display screen may include an image stored in the projection device.

[0060] In step 102a, when the image to be processed is a display image from the terminal device, the display image is sent to a display screen to be displayed on the display screen.

[0061] When the image to be processed received by the projection device is a display image sent from a terminal device, the display image is sent to a display screen so that the display screen displays the display image, thereby realizing projection of the display image in the terminal device onto a display screen connected to the projection device for display.

[0062] In step 102b, when the image to be processed is a projection image displayed on the display screen, the projection image is sent to the terminal device to be displayed on the screen of the terminal device.

[0063] When the image to be processed received by the projection device is a projection image displayed on a display screen, the projection image is sent to the terminal device so that the screen of the terminal device displays the projection image, thereby realizing the projection of the projection image on the display screen to the terminal device for display.

[0064] In this embodiment, the screen projection device can obtain the projected image displayed on the display screen according to the set time interval, that is, the screen projection device can send the latest projected image displayed on the display screen to the terminal. In this case, the user's operation on the projected image on the display screen can be synchronized to the terminal device for display.

[0065] In an embodiment of the present invention, the process of projecting the display image in the terminal device onto a display screen connected to the projection device for display is called forward projection, and the process of projecting the projection image on the display screen onto the terminal device for display is called reverse projection.

[0066] That is, when the projection device and the terminal device are connected in communication, forward projection and reverse projection can be achieved through interaction.

[0067] In step 103, a control instruction from the terminal device is received, and the image to be processed is controlled to be displayed according to the control instruction.

[0068] When receiving the control instruction from the terminal device, the projection device can control the image to be processed displayed on the display screen according to the control instruction. That is, when the image to be processed is a display image from the terminal device, the display control of the display image can be achieved by receiving the control instruction from the terminal device; when the image to be processed is a projection image stored in the projection device, the display control of the projection image can also be achieved by receiving the control instruction from the terminal device.

[0069] The present invention receives an image to be processed through a screen projection device, and when the image to be processed is a display image from the terminal device, sends the display image to a display screen for display on the display screen, and the display screen is connected to the screen projection device through an image transmission interface; when the image to be processed is a projected image displayed on the display screen, sends the projected image to the terminal device for display on the screen of the terminal device; and receives control instructions from the terminal device, and controls the display screen to display the image to be processed through the control instructions sent by the terminal device, thereby improving the convenience of controlling the display screen connected to the screen projection device.

[0070] In other words, the present invention can utilize the communication connection between the screen projection device and the terminal device to realize a two-way screen projection function and the transmission of control instructions. Under this control mode, the user can select the distance from the display screen and remotely control the screen projection device through the terminal device. Usually, the size of the display screen connected to the screen projection device is larger than the screen size on the terminal device, so the user can project the image and video information on the terminal device onto the display screen to complete real-time information sharing. The present invention can also solve the problem that some areas cannot be reached when the size of the display screen is large by remotely controlling the screen projection device through the terminal device.

[0071] In some embodiments, the screen projection device may include a control module and an image processing module. In this case, receiving the control instruction from the terminal device and controlling the image to be processed for display according to the control instruction includes: using the control module to receive the control instruction from the terminal device, and sending the control instruction to the image processing module, so that the image processing module processes the image to be processed according to the control instruction, and sends the processed image to the display screen for display.

[0072] Among them, the image processing module can be used for video image processing and image information format processing.

[0073] Those skilled in the art should understand that, in addition to including a control module and an image processing module, the screen projection device may also be a combination of the two or other forms, and this embodiment does not limit this.

[0074] Figure 2 is a schematic diagram showing the connection between a screen projection device and a terminal device according to an embodiment of the present invention. Figure 2 As shown, the screen projection device 20 includes a control module 201 and an image processing module 202. The control module 201 and the image processing module 202 transmit control instructions via a serial communication interface. The serial communication interface may include RS232. The control module 201 sends the display image to the image processing module 202 via a fully digital video and sound transmission interface. The fully digital video and sound transmission interface may be (High Definition Multimedia Interface, HDMI). The control module 201 is connected to the terminal device 22 for communication, and the image processing module 202 is connected to the display screen via a digital interface for image transmission, for example, the digital interface may be V-By-1.

[0075] For example, when the control module is a SOC core board and the image processing module is a Scaler board, the SOC core board is connected to the Scaler board through an RS232 interface, the SOC core board sends a control instruction to the Scaler board through the RS232 interface, the SOC core board sends a display image to the Scaler board through an HDMI interface, the Scaler board processes the display image according to the control instruction, and sends the processed image to the display screen for display.

[0076] For example, in the case of forward projection, the terminal device sends the display image to the SOC core board via Wi-Fi. The SOC core board decodes and re-encodes the display image to form an HDMI signal and transmits it to the Scaler board. The Scaler board processes the received display image and sends the processed display image to the display screen in the form of V-By-1. The display image may include the image in the video, and the image processing includes but is not limited to: resolution enhancement, brightness, contrast, display direction and other parameter adjustments.

[0077] The control instructions of the Scaler board can be sent by the SOC core board through the RS-232 bus, or sent by the terminal device to the SOC core board through the wireless network, so that the user can only operate the terminal device to complete the screen projection and image processing control operations.

[0078] In another example, reverse projection refers to sending the projection image displayed on the display screen to the terminal device. Figure 3 As shown, in the case of reverse screen projection, the projection image displayed on the display screen comes from the projection device 30. During reverse screen projection, the projection device sends the projection image to the terminal device 32 via Wi-Fi, and displays the projection image on the screen of the terminal device 32.

[0079] The user can control the display screen 31 through the touch terminal device 32. The control logic includes: the user touches the screen of the terminal device 32 to generate a touch coordinate signal. The terminal device 32 obtains the touch coordinate signal and sends it to the screen projection device 30 through the wireless network. The screen projection device 30 converts the touch coordinates according to the screen display size of the terminal device 32 and the display size of the display screen 31. The screen projection device 30 executes the corresponding control instructions according to the converted coordinates. Through reverse projection, the user can reversely project the projection image displayed on the display screen 31 to the terminal device 32, and control the projection device 30 through the touch terminal device 32 to achieve synchronous display of the display screen 31 and the terminal device screen.

[0080] In some embodiments, the number of terminal devices can be expanded to multiple according to actual needs, that is, the projection device can be connected to multiple terminal devices, and the display screen can be split according to the number of terminal devices to obtain multiple display areas, and the display areas correspond to the terminal devices one by one. The working relationship corresponding to each display area is relatively independent, and the working logic of forward projection or reverse projection can be set separately according to the specific application. In other words, the projection image displayed on the display area can be sent to the corresponding terminal device, and the display images sent by each terminal device can be summarized and displayed on the display area corresponding to the terminal device.

[0081] In the case of forward screen projection, that is, when the image to be processed is a display image from the terminal device, the display image is sent to the display screen, including: determining a display area in the display screen corresponding to the terminal device that sends the display image, and displaying the display image in the display area, wherein the display area is obtained by dividing the display screen according to the number of terminal devices, and has a corresponding relationship with the terminal device.

[0082] In the case of reverse screen projection, that is, when the image to be processed is a projected image displayed on the display screen, the projected image is sent to the terminal device, including: determining the terminal device corresponding to the display area displaying the projected image, and sending the projected image to the terminal device.

[0083] Figure 4 is a schematic diagram showing the connection between a screen projection device and multiple terminal devices according to an embodiment of the present invention, such as Figure 4 As shown, there may be three terminal devices, in which case the display screen can be set to 4 split screens. Those skilled in the art should understand that the display screen can also be set to 3 split screens or more split screens, and this embodiment does not limit this. In this embodiment, taking 4 split screens as an example, the display screen 41 is divided into a display area 410, a display area 411, and a display area 412, wherein there is a corresponding relationship between the display area 410 and the terminal device 420, there is a corresponding relationship between the display area 411 and the terminal device 421, and there is a corresponding relationship between the display area 412 and the terminal device 422. Taking the display area 411 and the terminal device 421 as an example, the terminal device 421 sends a display image to the projection device 40, and the projection device 40 sends the display image to the display area 411 for display; when the display area 411 sends a projection image to the projection device 40, the projection device 40 sends the projection image to the terminal device 421 for display. In other words, the display content of the display area can be summarized and distributed by the projection device.

[0084] In some embodiments, the screen projection device can also identify the current partition mode, divide the touch film feedback coordinates into four partitions, and return the touch instructions generated in the corresponding display area to the corresponding terminal device.

[0085] In some embodiments, the number of projection devices can be expanded to multiple according to actual needs, and the projection devices correspond to the display screens one-to-one. In this case, the screen of the terminal device can be split according to the number of projection devices to obtain multiple screen areas, and the screen areas have a one-to-one correspondence with the display screens. When the terminal device is connected to multiple projection devices, the working relationship corresponding to each projection device is relatively independent, and the forward projection or reverse projection can be set separately according to the specific application.

[0086] In the case of forward screen projection, when sending a display image, the terminal device can specify the projection device to which it sends the display image. The projection device receives the display image sent from the terminal device and sends the display image to the display screen connected to the projection device for display.

[0087] In the specific implementation of forward screen projection, each screen projection device corresponds to a device identifier. The terminal device can carry the device identifier of the target screen projection device when sending the display image. When the screen projection device receives the display image, it determines whether the device identifier carried by the display image is consistent with its own device identifier. If they are consistent, the display image is sent to the display screen connected to the screen projection device for display. Otherwise, no processing is performed.

[0088] In the case of reverse screen projection, that is, when the image to be processed is the projected image displayed on the display screen, sending the projected image to the terminal device may include: sending the projected image displayed on the display screen to the terminal device, so that the terminal device determines the screen area corresponding to the projection device, and displays the projected image in the screen area, wherein the screen area is obtained by dividing the screen of the terminal device according to the number of projection devices, and has a corresponding relationship with the projection device.

[0089] When implementing reverse screen projection, the projection device can carry a device identifier when sending the projection image displayed on the display screen to the terminal device, so that the terminal device determines the screen area corresponding to the projection device according to the device identifier and displays the projection image in the screen area.

[0090] Figure 5 is a schematic diagram showing the connection between a terminal device and multiple screen projection devices according to an embodiment of the present invention, such as Figure 5As shown, three screen projection devices are taken as examples, namely screen projection device 500, screen projection device 501 and screen projection device 502, each of which is connected to a corresponding display screen, screen projection device 500 is connected to display screen 510, screen projection device 501 is connected to display screen 511, and screen projection device 502 is connected to display screen 512. In the above case, the screen of terminal device 52 can be divided into three screen areas, namely screen area 520, screen area 521 and screen area 522, and screen area 520 has a corresponding relationship with screen projection device 500, screen area 521 has a corresponding relationship with screen projection device 501, and screen area 522 has a corresponding relationship with screen projection device 502. According to the above corresponding relationship, forward screen projection and reverse screen projection are realized. Taking the screen area 522 and the screen projection device 502 as an example, in the forward screen projection, the terminal device 52 sends the display image on the screen area 522 to the screen projection device 502, and the screen projection device 502 sends the display image sent by the terminal device 52 to the display screen 512 for display; in the reverse screen projection, the display screen 512 sends the displayed projection image to the screen projection device 502, the screen projection device 502 sends the projection image sent by the display screen 512 to the terminal device 52, and the terminal device 52 sends the projection image to the screen area 522 for display. Similarly, the terminal device 52 sends the control instruction generated on the screen area 522 to the screen projection device 502, and the screen projection device 502 controls the image displayed on the display screen 512 according to the control instruction, thereby realizing two-way control of touch interaction.

[0091] At present, the commonly used 2.4G wireless network has a theoretical maximum bandwidth of 300Mbps (unit), which is theoretically equivalent to a download speed of 37.5MB / s (unit). However, in actual applications, it is limited by factors such as the signal strength of the router itself, network speed fluctuations, and the performance of mobile device models. Therefore, the download speed cannot reach the theoretical value, and the maximum transmission speed is usually around 3 to 6M / s. In addition, the emerging 5G wireless network can reach 1000Mbps, which is theoretically equivalent to a download speed of 125MB / s, and can actually reach about 40M / s. Compared with the two wireless networks, 2.4G is slower, but has good wall penetration performance and a long transmission distance; 5G performs just the opposite. In some specific scenarios, the 5G wireless network has certain usage restrictions, and when the signal is not good, the speed will drop significantly or even packet loss will occur. Therefore, in the present invention, the 2.4G wireless network connection can be given priority between the projection device and the terminal device.

[0092] When the image to be processed is video information, 1080p@60Hz (unit) video is often used to transmit the video information, and its real-time code stream transmission speed can be calculated according to Formula 1.

[0093] (1920+280)*(1080+45)*60=148.5Mbps Formula 1

[0094] The real-time code stream transmission speed calculated by formula 1 is equivalent to 18.56MB / s. Using the commonly used mpeg-2 encoding format, the code rate can be reduced by about half, to about 9MB / s; using the H.264 encoding format for high-definition video, the code rate can be reduced by about 60% to about 4MB / s, which is already at the actual maximum transmission speed limit of 2.4G Wi-Fi. When facing higher-resolution video streams, such as 4K@60Hz, the real-time code stream transmission speed is required to be increased by about 4 times, which obviously exceeds the transmission capacity of 2.4G Wi-Fi.

[0095] Therefore, during the screen projection process of some high-resolution videos, their resolution can be compressed to a lower resolution (such as 1080p@60Hz or lower) for transmission. In this case, the resolution enhancement operation can be completed through the screen projection device, and the video with completed resolution enhancement can be sent to the display for display.

[0096] In the case where the screen projection device includes a control module and an image processing module, and the control instruction is used to instruct the improvement of the resolution of the image to be processed, causing the image processing module to process the image to be processed according to the control instruction and sending the processed image to the display screen for display may include: causing the image processing module to improve the resolution of the image to be processed according to the instruction of the control instruction, and sending the image with improved resolution to the display screen for display.

[0097] In the case where the image processing module is a scaler board, the scaler board completes the resolution enhancement operation, and then sends the image with the enhanced resolution to the display screen for display.

[0098] In some embodiments, the operation of compressing a high-resolution image to a low-resolution image may be implemented in a down-sampling manner during the image encoding process; and the operation of increasing the resolution may be implemented in an up-sampling manner.

[0099] In some embodiments, when the original image resolution is low, the visual effect is poor when projected on a large screen with high resolution, and the image graininess is obvious. Upsampling can be used to improve the resolution. The upsampling process is not a simple copy of the original pixels. The image processing algorithm can be used to predict and calculate the value of the filled pixels to restore the image details and achieve a better display effect.

[0100] For example, when the original four image values ​​are known to be f(i, j), f(i+1, j), f(i, j+1), and f(i+1, j+1), respectively, assuming that the value change of the image pixels is linear, the predicted value of f(i+u, j+v) can be calculated, and interpolation can be completed through prediction to achieve resolution improvement.

[0101] In some embodiments, the display screen in the present invention can be a vehicle window, on which a display module is provided, for example, an organic light-emitting diode (OLED) can be provided on the vehicle window. For example, when information is shared in a vehicle with multiple passengers, the display image in the terminal device of the sharer can be projected onto the vehicle window to achieve information sharing, and the projection image on the projection device can also be shared to the terminal device, and the sharer can control the content displayed on the display screen through the terminal device, thereby improving the convenience of control.

[0102] In some embodiments, a router can be used to connect the screen projection device and the terminal device to the same wireless network segment. For example, the wireless module AW-CM358SM can be used to connect the screen projection device and the terminal device to the same wireless network segment. Those skilled in the art should understand that the screen projection device and the terminal device can also be connected in communication by other means, and the screen projection function implemented by other wired or wireless communication methods should also be within the scope of protection of the present invention.

[0103] In the present invention, the terminal device may have the following functions: being connected to the Internet in any form, having interactive capabilities, having a display screen, and supporting the installation of control applications. The interactive capabilities may include touch functions, voice control functions, etc. The terminal device may be a remote (handheld) device, such as a tablet device. Those skilled in the art should understand that the terminal device may also be other devices that meet the above requirements, and this embodiment does not limit this.

[0104] Figure 6 is a schematic diagram of a screen projection device according to an embodiment of the present invention. The present invention provides a screen projection device, which is applied to a screen projection device, and the screen projection device is connected to a terminal device for communication, such as Figure 6 As shown, the device comprises:

[0105] A receiving unit 601, configured to receive an image to be processed;

[0106] A forward screen projection unit 602a is used for sending the display image to a display screen to display the display screen when the image to be processed is a display image from the terminal device, and the display screen is connected to the screen projection device via an image transmission interface;

[0107] A reverse screen projection unit 602b is used for sending the projected screen image to the terminal device to display it on the screen of the terminal device when the image to be processed is the projected screen image displayed on the display screen;

[0108] The control unit 603 is used to receive a control instruction from the terminal device, and control the image to be processed to be displayed according to the control instruction.

[0109] The present invention receives an image to be processed through a screen projection device, and when the image to be processed is a display image from the terminal device, sends the display image to a display screen for display on the display screen, and the display screen is connected to the screen projection device through an image transmission interface; when the image to be processed is a projected image displayed on the display screen, sends the projected image to the terminal device for display on the screen of the terminal device; and receives control instructions from the terminal device, and controls the display screen to display the image to be processed through the control instructions sent by the terminal device, thereby improving the convenience of controlling the display screen connected to the screen projection device.

[0110] The working principles of the receiving unit 601, the forward projection unit 602a, the reverse projection unit 602b, and the control unit 603 can be found in the aforementioned embodiments and will not be repeated here.

[0111] The present invention also provides a screen projection system, the screen projection system comprising a screen projection device and a terminal device, the screen projection device being communicatively connected with the terminal device;

[0112] The screen projection device is used to receive the image to be processed;

[0113] When the image to be processed received by the screen projection device is a display image from the terminal device, the display image is sent to a display screen for display on the display screen, and the display screen is connected to the screen projection device via an image transmission interface;

[0114] When the image to be processed received by the screen projection device is a projection image displayed on the display screen, the projection image is sent to the terminal device to be displayed on the screen of the terminal device;

[0115] The screen projection device is used to receive control instructions from the terminal device and control the display of the image to be processed according to the control instructions.

[0116] Figure 7 is a schematic diagram showing the interaction between a screen projection device and a terminal device according to an embodiment of the present invention, such as Figure 7As shown, the screen projection device 71 and the terminal device 72 are communicatively connected, and the screen projection device 71 and the display screen 73 are connected via an image transmission interface.

[0117] In step 701a, the display screen 73 sends the projection image displayed on the display screen to the projection device 71.

[0118] In step 701b, the terminal device 72 sends a display image to the screen projection device 71.

[0119] In step 702, the screen projection device 71 receives the image to be processed, wherein the image to be processed includes a screen projection image or a display image.

[0120] In step 703a, when the image to be processed received by the projection device 71 is a display image from the terminal device 72, step 704a is executed.

[0121] In step 703b, when the image to be processed received by the projection device 71 is the projection image displayed on the display screen 73, step 704b is executed.

[0122] In step 704 a , the display image is sent to the display screen 73 to be displayed on the display screen 73 .

[0123] In step 704b, the projection image is sent to the terminal device 72 to be displayed on the screen of the terminal device.

[0124] In step 705 , the terminal device 72 sends a control instruction to the screen projection device 71 .

[0125] In step 706 , the screen projection device 71 receives the control instruction from the terminal device 72 and executes step 707 .

[0126] In step 707, the image to be processed is controlled to be displayed according to the control instruction.

[0127] In some embodiments, the screen projection system includes a screen projection device and a plurality of terminal devices;

[0128] When the image to be processed received by the projection device is a display image from the terminal device, a display area in the display screen corresponding to the terminal device that sends the display image is determined, and the display image is displayed in the display area, wherein the display area is obtained by dividing the display screen according to the number of terminal devices and has a corresponding relationship with the terminal devices;

[0129] When the projection device receives a projection image displayed on the display area, it determines a terminal device corresponding to the display area displaying the projection image, and sends the projection image to the terminal device.

[0130] In some embodiments, the screen projection system includes a terminal device and a plurality of screen projection devices;

[0131] When receiving the projection image displayed on the display screen, the projection device sends the projection image displayed on the display screen to the terminal device;

[0132] The terminal device is used to determine a screen area corresponding to the projection device and display the projection image in the screen area, wherein the screen area is obtained by dividing the screen of the terminal device according to the number of projection devices and has a corresponding relationship with the projection device.

[0133] The terminal device in this embodiment may be a display device including a screen. The display device in this embodiment may be: electronic paper, a mobile phone, a tablet computer, a television, a laptop computer, a digital photo frame, a navigator, or any other product or component with a display function.

[0134] It should be noted that in the accompanying drawings, the sizes of layers and regions may be exaggerated for clarity of illustration. It is also understood that when an element or layer is referred to as being "on" another element or layer, it may be directly on the other element, or there may be an intermediate layer. In addition, it is understood that when an element or layer is referred to as being "under" another element or layer, it may be directly under the other element, or there may be more than one intermediate layer or element. In addition, it is also understood that when a layer or element is referred to as being "between" two layers or two elements, it may be the only layer between the two layers or two elements, or there may also be more than one intermediate layer or element. Similar reference numerals throughout the text indicate similar elements.

[0135] In the present invention, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance. The term "plurality" refers to two or more than two, unless otherwise clearly defined.

[0136] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the disclosure disclosed herein. The present invention is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art that are not disclosed by the present invention. The description and examples are to be considered exemplary only, and the true scope and spirit of the present invention are indicated by the following claims.

[0137] It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. A screen projection method, characterized in that: Applied to a screen projection device, the screen projection device is communicatively connected with a terminal device, and the method includes: The screen projection device receives the image to be processed; In the case where the image to be processed is a display image from the terminal device, the screen projection device sends the display image to a display screen for display on the display screen, and the display screen is connected to the screen projection device via an image transmission interface; In a case where the image to be processed is a projection image displayed on the display screen, the projection device sends the projection image to the terminal device so as to display it on the screen of the terminal device; The screen projection device receives a control instruction from the terminal device, and controls the image to be processed to be displayed according to the control instruction; In the case where the screen projection device includes a control module and an image processing module, and the control instruction is used to instruct to improve the resolution of the image to be processed, the screen projection device receives the control instruction from the terminal device, and controls the image to be processed for display according to the control instruction, including: using the control module to receive the control instruction from the terminal device, and sending the control instruction to the image processing module, so that the image processing module improves the resolution of the image to be processed according to the instruction of the control instruction, and sends the image with improved resolution to the display screen for display.

2. The method according to claim 1, characterized in that The screen projection device is communicatively connected with a plurality of terminal devices; When the image to be processed is a display image from the terminal device, sending the display image to a display screen includes: Determine a display area in the display screen corresponding to the terminal device that sends the display image, and display the display image in the display area, wherein the display area is obtained by dividing the display screen according to the number of terminal devices and has a corresponding relationship with the terminal devices; When the image to be processed is a projection image displayed on the display screen, sending the projection image to the terminal device includes: Determine a terminal device corresponding to a display area displaying the projected image, and send the projected image to the terminal device.

3. The method according to claim 1, characterized in that Multiple projection devices are connected to the terminal device for communication; When the image to be processed is a projection image displayed on the display screen, sending the projection image to the terminal device includes: The projected screen image displayed on the display screen is sent to the terminal device, so that the terminal device determines the screen area corresponding to the projection device, and displays the projected screen image in the screen area, wherein the screen area is obtained by dividing the screen of the terminal device according to the number of projection devices, and has a corresponding relationship with the projection device.

4. The method according to any one of claims 1 to 3, characterized in that The display screen includes a vehicle window provided with a display module.

5. A screen projection device, characterized in that: Applied to a screen projection device, the screen projection device is communicatively connected with a terminal device, and the device comprises: A receiving unit, used for receiving an image to be processed; A forward screen projection unit, used for sending the display image to a display screen to display the display screen when the image to be processed is a display image from the terminal device, and the display screen is connected to the screen projection device via an image transmission interface; a reverse screen projection unit, configured to send the projected screen image to the terminal device so as to display it on the screen of the terminal device when the image to be processed is a projected screen image displayed on the display screen; A control unit, configured to receive a control instruction from the terminal device and control the image to be processed to be displayed according to the control instruction; In the case where the screen projection device includes a control module and an image processing module, and the control instruction is used to instruct to improve the resolution of the image to be processed, the control unit is specifically used to use the control module to receive the control instruction from the terminal device, and send the control instruction to the image processing module, so that the image processing module improves the resolution of the image to be processed according to the instruction of the control instruction, and sends the image with improved resolution to the display screen for display.

6. A screen projection system, characterized in that: The screen projection system includes a screen projection device and a terminal device, and the screen projection device is communicatively connected with the terminal device; The screen projection device is used to receive the image to be processed; When the image to be processed received by the screen projection device is a display image from the terminal device, the display image is sent to a display screen for display on the display screen, and the display screen is connected to the screen projection device via an image transmission interface; When the image to be processed received by the screen projection device is a projection image displayed on the display screen, the projection image is sent to the terminal device to be displayed on the screen of the terminal device; The screen projection device is used to receive a control instruction from the terminal device, and control the image to be processed to be displayed according to the control instruction; In the case where the screen projection device includes a control module and an image processing module, and the control instruction is used to instruct to improve the resolution of the image to be processed, the screen projection device is specifically used to use the control module to receive the control instruction from the terminal device, and send the control instruction to the image processing module, so that the image processing module improves the resolution of the image to be processed according to the instruction of the control instruction, and sends the image with improved resolution to the display screen for display.

7. The screen projection system according to claim 6, characterized in that: The screen projection system includes a screen projection device and multiple terminal devices; When the image to be processed received by the projection device is a display image from the terminal device, a display area in the display screen corresponding to the terminal device that sends the display image is determined, and the display image is displayed in the display area, wherein the display area is obtained by dividing the display screen according to the number of terminal devices and has a corresponding relationship with the terminal devices; When the projection device receives a projection image displayed on the display area, it determines a terminal device corresponding to the display area displaying the projection image, and sends the projection image to the terminal device.

8. The screen projection system according to claim 7, characterized in that: The screen projection system includes a terminal device and multiple screen projection devices; When receiving the projection image displayed on the display screen, the projection device sends the projection image displayed on the display screen to the terminal device; The terminal device is used to determine a screen area corresponding to the projection device and display the projection image in the screen area, wherein the screen area is obtained by dividing the screen of the terminal device according to the number of projection devices and has a corresponding relationship with the projection device.

Images