Screen transmission control method and device, equipment and storage medium

Abstract

The embodiment of the invention discloses a screen transmission control method and device, equipment and a storage medium. According to the technical scheme provided by the embodiment of the invention, the method comprises the steps: obtaining a screen picture parameter of a display screen sent by receiving equipment, and obtaining a window picture parameter of a to-be-transmitted screen picture; according to the screen picture parameter and the window picture parameter, obtaining an appearance parameter difference value of the display screen and the picture to be transmitted; when the appearance parameter difference value is within a preset picture change range, performing aspect ratio change processing on the picture to be subjected to screen transmission according to the screen picture parameter to obtain a target screen transmission picture; and transmitting the target screen transmission picture to a receiving device, so that the receiving device performs rendering according to the screen picture parameters. According to the technical scheme provided by the embodiment of the invention, the problem of relatively poor watching experience in a screen projection process can be solved, the situation of black edges is reduced, and the watching experience of a user is improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of screen transmission control technology, and more particularly to a screen transmission control method, device, equipment and storage medium. Background Art

[0002] With the development of Internet technology and computer technology, different electronic devices can share screen images of multiple electronic devices through screen transmission technology. Among them, the device that initiates screen transmission is called a sending device, and the device that receives the screen transmission is called a receiving device.

[0003] The display screen of each electronic device has corresponding display attribute information. The display attribute information of different electronic devices may be different. When screens are transmitted between electronic devices with different display attribute information, black edges may appear when the corresponding transmitted screen is displayed on the receiving device.

[0004] In the prior art, in order to avoid the appearance of black edges, the screen image is usually stretched by the receiving device so that the stretched image can fill the display screen of the receiving device. This method of eliminating black edges by stretching may cause serious deformation of the projected image, affecting the user's viewing experience. Summary of the invention

[0005] The screen transmission control method, device, equipment and storage medium provided in the embodiments of the present application can solve the problem of poor viewing experience during the screen projection process, reduce the occurrence of black edges, and improve the user's viewing experience.

[0006] In a first aspect, an embodiment of the present application provides a screen transmission control method, which is used for a sending device, including:

[0007] Obtain the screen image parameters of the display screen sent by the receiving device, and obtain the window image parameters of the screen image to be transmitted;

[0008] According to the screen picture parameters and the window picture parameters, the difference in appearance parameters between the display screen and the picture to be transmitted is obtained;

[0009] When the difference in the appearance parameters is within the preset image change range, the aspect ratio of the image to be transmitted is changed according to the screen image parameters to obtain the target screen transmission image;

[0010] The target screen image is transmitted to the receiving device so that the receiving device can render it according to the screen image parameters.

[0011] In a second aspect, an embodiment of the present application provides a screen transmission control method, which is used for a receiving device, including:

[0012] Sending screen image parameters of the display screen to the sending device;

[0013] The target screen image sent by the receiving and sending device is obtained by changing the aspect ratio of the screen image to be transmitted according to the screen image parameters when the difference in the appearance parameters is within the preset image change range, and the difference in the appearance parameters is obtained according to the window image parameters and the screen image parameters of the screen image to be transmitted;

[0014] Render the target screen image according to the screen image parameters.

[0015] In a third aspect, an embodiment of the present application provides a screen transmission control method, for a receiving device, including:

[0016] Receive the screen image sent by the sending device, and obtain the window image parameters according to the screen image;

[0017] According to the window picture parameters and the screen picture parameters of the display screen, the difference in the appearance parameters of the display screen and the transmitted screen picture is obtained;

[0018] When the difference in the appearance parameters is within the preset image change range, the aspect ratio of the transmitted screen image is changed according to the screen image parameters to obtain the target transmitted screen image;

[0019] Render the target screen image according to the screen image parameters.

[0020] In a fourth aspect, an embodiment of the present application provides a screen transmission control device, which is used for a sending device, including:

[0021] A first parameter acquisition unit, used to acquire screen image parameters of the display screen sent by the receiving device, and acquire window image parameters of the screen image to be transmitted;

[0022] A first calculation unit, used for obtaining a difference in appearance parameters between the display screen and the screen to be transmitted according to the screen picture parameters and the window picture parameters;

[0023] A first change processing unit is used to change the aspect ratio of the screen image to be transmitted according to the screen image parameters to obtain a target screen image when the difference in the appearance parameters is within a preset image change range;

[0024] The first data transmission unit is used to transmit the target screen transmission image to the receiving device so that the receiving device can render it according to the screen image parameters.

[0025] In a fifth aspect, an embodiment of the present application provides a screen transmission control device, which is used for a receiving device, including:

[0026] A second data sending unit, used for sending screen image parameters of the display screen to a sending device;

[0027] The second data receiving unit is used to receive a target screen transmission picture sent by the sending device, the target screen transmission picture is obtained by changing the aspect ratio of the screen transmission picture according to the screen picture parameters when the shape parameter difference is within a preset picture change range, and the shape parameter difference is obtained according to the window picture parameters and the screen picture parameters of the screen transmission picture;

[0028] The second rendering unit is used to render the target screen transmission picture according to the screen picture parameters.

[0029] In a sixth aspect, an embodiment of the present application provides a screen transmission control device, for a receiving device, including:

[0030] A third data receiving unit is used to receive the screen transmission picture sent by the sending device, and obtain the window picture parameters according to the screen transmission picture;

[0031] A third calculation unit, used for obtaining a difference in appearance parameters according to the window image parameters and the screen image parameters of the display screen;

[0032] A third change processing unit is used to change the aspect ratio of the screen transmission picture according to the screen picture parameters to obtain a target screen transmission picture when the difference of the appearance parameters is within a preset picture change range;

[0033] The third rendering unit is used to render the target screen transmission picture according to the screen picture parameters.

[0034] In a seventh aspect, an embodiment of the present application provides a screen transmission control device, including:

[0035] memory and one or more processors;

[0036] A memory for storing one or more programs;

[0037] When one or more programs are executed by one or more processors, the one or more processors implement the method as described in the first aspect, the second aspect, or the third aspect.

[0038] In an eighth aspect, an embodiment of the present application provides a storage medium storing computer executable instructions, which, when executed by a computer processor, are used to execute the screen transmission control method as described in the first aspect, the second aspect, or the third aspect.

[0039] In an embodiment of the present application, by obtaining the screen image parameters of the display screen sent by the receiving device and obtaining the window image parameters of the image to be transmitted, the difference in appearance parameters between the display screen and the image to be transmitted is obtained according to the screen image parameters and the window image parameters, and when the difference in appearance parameters is within a preset image change range, the aspect ratio of the image to be transmitted is changed according to the screen image parameters to obtain the target screen transmission image and transmit the target screen transmission image to the receiving device. This technical means solves the technical problem of poor viewing experience caused by severe image deformation due to elimination of black edges in the existing screen projection process. During the screen transmission process, the difference in appearance parameters between the display screen and the image to be transmitted is obtained from the screen image parameters and the window image parameters. When the difference in appearance parameters is within a preset image change range, the aspect ratio of the image to be transmitted is changed according to the screen image parameters to obtain the target screen transmission image, so that the receiving device can render the target screen transmission image according to the screen image parameters of the display screen to eliminate the black and white situation caused by different aspect ratios, thereby improving the user experience. In addition, when the difference in appearance parameters is within the preset range of picture change, the aspect ratio of the picture to be transmitted is changed according to the screen picture parameters, so that after the aspect ratio change, the target screen transmission picture has a smaller corresponding deformation than the picture to be transmitted. Therefore, when the receiving device renders according to the screen parameters of the display screen, the corresponding picture displayed after rendering is also smaller than the picture to be transmitted, which does not affect the user's viewing experience, thereby eliminating the black border and improving the user's viewing experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 A flowchart of a screen transmission control method provided in one embodiment of the present application;

[0041] Figure 2 A schematic diagram of a window screen of a screen to be transmitted provided by an embodiment of the present application;

[0042] Figure 3 A schematic diagram of a screen image of a display screen provided by an embodiment of the present application;

[0043] Figure 4 A schematic diagram of a target screen transmission image provided by an embodiment of the present application;

[0044] Figure 5 A flowchart of another screen transmission control method provided by an embodiment of the present application;

[0045] Figure 6 A flowchart of another screen transmission control method provided by an embodiment of the present application;

[0046] Figure 7 A schematic diagram of the structure of a screen transmission control device provided in one embodiment of the present application;

[0047] Figure 8 A schematic diagram of the structure of another screen transmission control device provided by an embodiment of the present application;

[0048] Fig. 9 A schematic diagram of the structure of another screen transmission control device provided in one embodiment of the present application;

[0049] Fig.10 A schematic diagram of the structure of a screen transmission control device provided for one embodiment of the present application. DETAILED DESCRIPTION

[0050] In order to make the purpose, technical scheme and advantages of the present application clearer, the specific embodiments of the present application are further described in detail below in conjunction with the accompanying drawings. It is understood that the specific embodiments described herein are only used to explain the present application, rather than to limit the present application. It should also be noted that, for the convenience of description, only the part related to the present application but not all the contents are shown in the accompanying drawings. Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flow charts. Although the flow chart describes each operation (or step) as a sequential process, many of the operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of each operation can be rearranged. The process can be terminated when its operation is completed, but it can also have additional steps not included in the accompanying drawings. The process can correspond to a method, a function, a procedure, a subroutine, a subprogram, etc.

[0051] Screen transmission can be understood as the use of network technology to transmit the display contents of different electronic devices to each other to achieve display synchronization. It is often used in conference office, centralized teaching and daily movie watching. Among them, the device that initiates screen transmission is called the sending device, and the device that receives the screen transmission is called the receiving device. The display screen of each electronic device has corresponding display attribute information. The display attribute information of different electronic devices may be different. When screen transmission is performed between electronic devices with different display attribute information, black edges may appear when the corresponding screen transmission picture is displayed on the receiving device. For example, in the process of wireless screen transmission, the aspect ratio of the screen transmission picture of the sending device will not change during the process of acquisition, encoding, transmission and decryption. After the receiving device receives the screen transmission picture, when rendering, it can choose to render with a rendering strategy that maintains the aspect ratio or a rendering strategy that does not maintain the aspect ratio. When the rendering strategy that maintains the aspect ratio is selected, the screen transmission picture is proportionally scaled to the rendering area. At this time, if the aspect ratio of the screen transmission picture is inconsistent with the aspect ratio of the rendering area, black edges will be generated on the left or right or up and down, affecting the viewing experience. In the prior art, in order to avoid the appearance of black edges, a rendering strategy that does not maintain the aspect ratio is usually selected for rendering, that is, the transmitted screen is stretched by the receiving device so that the stretched screen can fill the display screen of the receiving device. This method of eliminating black edges by stretching may cause serious deformation of the projection screen when the aspect ratio of the transmitted screen is significantly different from that of the rendering area, affecting the user's viewing experience.

[0052] Based on this, the embodiments of the present application provide a screen transmission control method, device, equipment and storage medium, which aims to change the aspect ratio of the screen to be transmitted only when the difference in appearance parameters between the display screen and the screen to be transmitted is within a preset screen change range during screen transmission control, thereby reducing the occurrence of black edges and improving the user's viewing experience.

[0053] The screen transmission control method provided in the embodiment of the present application can be executed by a screen transmission control device, which can be implemented by software and / or hardware, and the screen transmission control device can be composed of two or more physical entities, or can be composed of one physical entity. Currently, the screen transmission control device can be an electronic device such as an interactive tablet, a tablet computer, a smart TV, a learning machine, or a mobile phone.

[0054] In one embodiment, the screen transmission control device is installed with at least one type of operating system, and the operating system may be an Android system, a Windows system, a Linux system, a macOS system, an IOS system, etc. The screen transmission control device may install at least one application under the operating system. Among them, the application may be an application that comes with the operating system, or an application that is downloaded from a third-party device or a server. The screen transmission control device is also configured with at least one display screen (also referred to as a display). When the display screen has a touch function, the display screen may be a capacitive touch display screen, a resistive touch display screen, an infrared touch display screen, and / or an electromagnetic touch display screen. The user may control the screen transmission control device by touching the display screen with a finger or a stylus. In addition, the screen transmission control device may also be connected to external devices such as a mouse, a keyboard, a camera, an audio input device (such as a microphone), and an audio playback device (such as a speaker), and the user may also control the screen transmission control device by operating the external device. The screen transmission control device is also configured with a communication module, which is used to implement a communication function.

[0055] Figure 1 A flowchart of a screen transmission control method provided in one embodiment of the present application, referring to Figure 1 The screen transmission control method is used for sending a device, and specifically includes:

[0056] S101. Obtain screen image parameters of a display screen sent by a receiving device, and obtain window image parameters of a screen image to be transmitted.

[0057] The screen image parameters of the display screen are the screen image parameters of the display screen of the receiving device, including parameters such as the size, aspect ratio, height-to-width ratio, and pixels of the screen image. The window image parameters include parameters such as the size, aspect ratio, height-to-width ratio, and pixels of the screen image to be transmitted. Before transmitting the screen, the receiving device sends the screen image parameters of its own display screen to the sending device. The sending device obtains the screen image parameters of the display screen sent by the receiving device, and obtains the window image parameters of the screen image to be transmitted. By obtaining the screen image parameters of the display screen of the receiving device and the window image parameters of the screen image to be transmitted, the corresponding parameters can be compared to determine whether to process the screen image to be transmitted.

[0058] S102: Obtain the difference in appearance parameters between the display screen and the screen image to be transmitted according to the screen image parameters and the window image parameters.

[0059] According to the screen image parameters and window image parameters of the display screen of the receiving device, the difference in appearance parameters between the display screen and the screen image to be transmitted is obtained, and based on the difference in appearance parameters, a judgment is made as to whether to change the screen image to be transmitted. Exemplarily, the screen image parameters and window image parameters of the display screen of the receiving device can be calculated to obtain the difference in appearance parameters between the display screen and the screen image to be transmitted. For example, the difference in appearance parameters between the display screen and the screen image to be transmitted is obtained by subtracting the window image parameters from the screen image parameters.

[0060] The screen image parameters of the display screen include parameters such as the size, aspect ratio, height-to-width ratio, and pixels of the screen image. The window image parameters include parameters such as the size, aspect ratio, height-to-width ratio, and pixels of the screen image to be transmitted. The first aspect ratio or the first height-to-width ratio of the receiving device can be obtained based on the acquired screen image parameters of the display screen of the receiving device. The second aspect ratio or the second height-to-width ratio of the sending device can be obtained based on the window image parameters of the screen image to be projected corresponding to the sending device. Exemplarily, the aspect ratio is used as an example for explanation, and calculation processing is performed based on the first aspect ratio and the second aspect ratio, for example, the second aspect ratio is subtracted from the first aspect ratio to obtain the difference in appearance parameters between the display screen of the receiving device and the screen image to be transmitted in the sending device.

[0061] Figure 2 A schematic diagram of a window screen to be transmitted provided by an embodiment of the present application, referring to Figure 2 , the user selects an application window on the sending device as the screen to be transmitted. Assuming that the window screen of the screen to be transmitted is 950 pixels wide and 540 pixels high, its aspect ratio is 95:54, which is about 1.759, and its aspect ratio is 54:95. The window screen parameters can be obtained as 950 pixels wide, 540 pixels high, 95:54 aspect ratio, and 54:95 aspect ratio, that is, the second aspect ratio can be obtained as 95:54 or the second aspect ratio can be obtained as 54:95. Taking the aspect ratio as an example, if the screen to be transmitted is directly transmitted, after the screen to be transmitted is collected, encoded, sent and decoded, the aspect ratio of the decoded screen is also 95:54. Figure 3 A schematic diagram of a screen image of a display screen provided by an embodiment of the present application, referring to Figure 3, assuming that the display screen of the receiving device is 3840 pixels wide and 2160 pixels high, its aspect ratio is 16:9, which is about 1.778, that is, the screen image parameters of the display screen are 3840 pixels wide, 2160 pixels high, and an aspect ratio of 16:9, and other parameter information, that is, the first aspect ratio can be obtained as 16:9. The receiving device sends the screen image parameters of its display screen to the sending device, and the sending device receives the screen image parameters and obtains the window image parameters of the screen to be transmitted of its corresponding application window. Calculation and processing are performed based on the screen image parameters and window image parameters of the display screen of the receiving device. Taking the aspect ratio as an example, the first aspect ratio of the display screen of the receiving device is subtracted from the second aspect ratio of the screen to be transmitted of the corresponding projection window of the sending device to obtain the difference in the appearance parameters of the display screen and the screen to be transmitted. For example, from the above, it can be seen that the screen image parameters of the display screen of the receiving device are an aspect ratio of 16:9, that is, the first aspect ratio is 16:9, and the window image parameters are an aspect ratio of 95:54, that is, the second aspect ratio is 95:54. The first aspect ratio can be subtracted from the second aspect ratio to obtain an appearance parameter difference of approximately 0.02 between the display screen of the receiving device and the screen image to be transmitted in the sending device.

[0062] As described above, the difference in appearance parameters between the display screen and the screen to be transmitted is obtained through the screen image parameters and the window image parameters. Therefore, it is possible to judge whether black edges will appear on the displayed image after direct screen transmission based on the difference in appearance parameters. Subsequent black edge elimination processing can be performed based on the judgment result to reduce the black edge situation and improve the viewing experience.

[0063] S103. When the difference in the appearance parameters is within a preset image change range, the aspect ratio of the image to be transmitted is changed according to the screen image parameters to obtain a target screen transmission image.

[0064] When there is a difference in appearance parameters between the display screen of the receiving device and the screen to be transmitted, if the rendering strategy of the receiving device is to maintain the aspect ratio rendering, the screen to be transmitted is rendered by maintaining the aspect ratio rendering strategy, and black edges will appear in the rendered displayed screen. In order to reduce the occurrence of black edges, when the difference in appearance parameters is within the preset screen change range, the screen to be transmitted is processed with an aspect ratio change according to the screen picture parameters of the display screen of the receiving device to obtain the target screen to be transmitted, so that the aspect ratio of the target screen to be transmitted after the change is the same as the aspect ratio corresponding to the screen picture parameters, that is, the aspect ratio of the target screen to be transmitted is the same as the aspect ratio of the display screen of the receiving device. After the receiving device subsequently receives the target screen, it is rendered according to the rendering strategy of maintaining the aspect ratio, and the displayed screen does not have black edges. Based on the fact that the aspect ratio change processing of the screen to be transmitted is performed when the difference in appearance parameters is within the preset screen change range, since the difference in appearance parameters is within the preset screen change range, the aspect ratio change processing of the screen to be transmitted does not cause too much deformation, does not affect the user's viewing experience, and eliminates the black edges, thereby improving the user's overall viewing experience.

[0065] It should be noted that when the difference in the appearance parameters is not within the preset image change range, that is, when the display screen of the receiving device and the window image parameters of the image to be transmitted are greatly different, if the aspect ratio of the image to be transmitted is changed at this time, it may cause serious deformation of the image. Although the image displayed after the screen transmission can eliminate the black edges, the serious deformation of the image will affect the user's viewing experience. Therefore, the aspect ratio of the image to be transmitted can be changed only when the difference in the appearance parameters is within the preset image change range, so as to eliminate the black edges while maintaining the image's appearance.

[0066] In one embodiment, when the absolute value of the appearance parameter difference is less than or equal to a preset threshold, that is, the appearance parameter difference is within a preset image change range, the aspect ratio of the screen to be transmitted is changed according to the screen image parameters of the display screen of the receiving device to obtain the target screen transmission image.

[0067] It should be noted that the preset threshold can be set according to actual conditions and is not limited in this embodiment. For example, assuming that the preset threshold is 0.1, the difference in appearance parameters between the display screen of the receiving device and the screen image to be transmitted in the sending device is about 0.02, which is less than the preset threshold 0.1, and the difference in appearance parameters is within the preset image change range.

[0068] Exemplarily, before the screen projection begins, the receiving device obtains the first aspect ratio A of the rendering area of ​​its own display screen, and sends it to the sending device through the existing screen projection protocol. The sending device receives the first aspect ratio A, and obtains its own second aspect ratio B corresponding to the screen to be transmitted. The difference in appearance parameters between the display screen and the screen to be transmitted is calculated to be C, where C=AB. The difference in appearance parameters can be understood as the difference in aspect ratio between the display screen and the screen to be transmitted. When the difference in appearance parameter C is 0, it means that the aspect ratio of the display screen and the screen to be transmitted is equal. At this time, no processing is performed on the screen to be transmitted, and no black edges will appear when the receiving device renders. When the difference in appearance parameter C is not within the preset screen change range, that is, the absolute value of the difference in appearance parameter C is greater than the preset threshold k, it means that there is a large difference in the aspect ratio of the display screen and the screen to be transmitted. At this time, stretching the screen to be transmitted to eliminate the black edges may cause the picture to be deformed and affect the viewing experience. When the shape parameter difference C is within the preset image change range, that is, the absolute value of the shape parameter difference C is less than or equal to the preset threshold k, it means that the aspect ratio of the display screen and the image to be transmitted are relatively close. At this time, the aspect ratio of the image to be transmitted can be changed according to the screen image parameters of the display screen of the receiving device to obtain the target screen transmission image, so that the aspect ratio of the target screen transmission image is the same as the aspect ratio of the rendering area of ​​the display screen of the receiving device. After the receiving device receives the target screen transmission image, the target screen transmission image can be rendered according to the aspect ratio maintaining rendering strategy. The resulting image deformation is very small and is not easily perceived by the human eye, thereby achieving the goal of not having black edges and not affecting the user's viewing experience.

[0069] As described above, when the sending device determines that the difference in appearance parameters between the display screen of the receiving device and the screen image to be transmitted is within a preset image change range, the aspect ratio of the screen image to be transmitted is changed according to the screen image parameters of the display screen of the receiving device to obtain the target screen image. Only the aspect ratio is changed, and the change is minor, which will not increase the data transmission pressure, thereby maintaining the original transmission efficiency.

[0070] In one embodiment, the screen image parameter is the first aspect ratio and the window image parameter is the second aspect ratio. At this time, the difference in the appearance parameters is the difference in the aspect ratio between the display screen and the screen image to be transmitted. When the difference in the appearance parameters is within the preset screen change range and the difference in the appearance parameters is a negative number, the width of the screen image to be transmitted is kept unchanged, and the screen image to be transmitted is vertically scaled with the first aspect ratio to obtain the target screen image, so that the aspect ratio of the target screen image is the same as the first aspect ratio. Exemplarily, when the difference in the appearance parameters C is within the preset screen change range and the difference in the appearance parameters C is less than 0, the width of the screen image to be transmitted is kept unchanged, and the screen image to be transmitted is vertically changed according to the first aspect ratio A in the screen image parameters, which can be to multiply the width of the screen image to be transmitted by the first aspect ratio to obtain the height of the corresponding target screen image, and the screen image to be transmitted is vertically stretched or shrunk to the same height as the height of the target screen image. For example, the width of the screen to be transmitted is W, and the height is H. After the change processing, the width of the target screen to be transmitted is WS, and the height is HS, wherein WS=W, HS=W*A.

[0071] In one embodiment, the screen image parameter is the first aspect ratio, and the window image parameter is the second aspect ratio. In this case, the difference in the appearance parameters is the difference in the aspect ratio between the display screen and the image to be transmitted. When the difference in the appearance parameters is within the preset image change range, and the difference in the appearance parameters is a positive number, the height of the image to be transmitted is kept unchanged, and the image to be transmitted is horizontally scaled with the first aspect ratio to obtain the target transmitted image, so that the aspect ratio of the target transmitted image is the same as the first aspect ratio. Exemplarily, when the difference in the appearance parameters C is within the preset image change range, and the difference in the appearance parameters C is greater than 0, the height of the image to be transmitted is kept unchanged, and the image to be transmitted is horizontally changed according to the first aspect ratio A in the screen image parameters, which can be to multiply the height of the image to be transmitted by the first aspect ratio to obtain the width of the corresponding target transmitted image, and the image to be transmitted is horizontally stretched or shrunk to the same width as the width of the target transmitted image. For example, the width of the screen to be transmitted is W, and the height is H. After the change processing, the width of the target screen to be transmitted is WS, and the height is HS, wherein WS=H*A, HS=H.

[0072] Figure 4 A schematic diagram of a target screen transmission screen provided by an embodiment of the present application, referring to Figure 4, taking the screen image parameter as the first aspect ratio and the window image parameter as the second aspect ratio as an example, the difference in appearance parameters is the difference in aspect ratio between the display screen and the screen image to be transmitted. As can be seen from the above, the screen image parameter of the display screen of the receiving device is an aspect ratio of 16:9, which is approximately 1.778, that is, the first aspect ratio is 16:9, which is approximately 1.778. The screen image to be transmitted is 950 pixels wide and 540 pixels high, and the window image parameter is an aspect ratio of 95:54, which is approximately 1.759, that is, the second aspect ratio is 95:54, which is approximately 1.759. The second aspect ratio can be subtracted from the first aspect ratio to obtain the difference C in appearance parameters between the display screen of the receiving device and the screen image to be transmitted in the sending device, which is approximately 0.02, which is less than the preset threshold value of 0.1. Based on the absolute value of the shape parameter difference C being less than the preset threshold value 0.1, and the shape parameter difference C being about 0.02, which is greater than 0, according to the above change processing, the height of the screen image to be transmitted is kept unchanged, that is, the height is kept at 540 pixels, and the screen image to be transmitted is horizontally scaled with the first aspect ratio (about 1.778), and the width after scaling is about 540*1.778, which is about 960 pixels, so that the width of the target screen image obtained after the change processing is 960 pixels and the height is 540 pixels. Based on the screen image to be transmitted with a width of 950 pixels and a height of 540 pixels, the difference between the target screen image obtained after the change processing and the screen image to be transmitted is that the width is stretched by 10 pixels, and this stretching change is difficult to detect in human eye observation, so that when the target screen image is subsequently rendered and displayed, it is the same as the screen image in human eye observation, and will not affect the user's viewing experience. In addition, based on the fact that the width ratio of the target screen image obtained after stretching is the same as that of the display screen, the black edges can be eliminated after rendering, thereby improving the user's viewing experience as a whole.

[0073] As described above, when the difference in the appearance parameters between the display screen of the receiving device and the image to be transmitted is within the preset image change range, the image to be transmitted is processed with an aspect ratio change according to the screen image parameters to obtain a target transmitted image with the same aspect ratio as the display screen of the receiving device, so that black edges will not appear when the receiving device renders, thereby improving the user's viewing experience. In addition, based on the fact that the difference in the appearance parameters is within the preset image change range, the image to be transmitted is processed with an aspect ratio change according to the screen image parameters, which will not cause a large deformation, and the human eye perception is similar to the image to be transmitted, thereby ensuring the user's viewing experience on the basis of eliminating the black edges, thereby improving the user's overall viewing experience.

[0074] S104: Transmit the target screen image to a receiving device, so that the receiving device can render the target screen image according to the screen image parameters.

[0075] After the sending device encodes the target screen image, it obtains the encoded data and transmits the encoded data to the receiving device. After the receiving device receives the encoded data corresponding to the target screen image, it decodes the encoded data to obtain the target screen image, and renders the target screen image through a preset rendering strategy that maintains the aspect ratio. Based on the aspect ratio of the target screen image being consistent with the aspect ratio of the rendering area of ​​the display screen of the receiving device, the displayed image after rendering according to the rendering strategy that maintains the aspect ratio will not have black edges, thereby improving the user's viewing experience. Exemplarily, it can be seen from the above that the width of the target screen image is 960 pixels and the height is 540 pixels, and the width of the rendering area of ​​the display screen of the receiving device is 3840 pixels and the height is 2160 pixels. The aspect ratios of the two are consistent, so the displayed image after the receiving device renders according to the rendering strategy that maintains the aspect ratio will not have black edges, thereby improving the user's viewing experience.

[0076] As described above, during the screen transmission process, the difference in the appearance parameters of the display screen and the screen to be transmitted is obtained from the screen picture parameters and the window picture parameters. When the difference in the appearance parameters is within the preset picture change range, the screen to be transmitted is subjected to aspect ratio change processing according to the screen picture parameters to obtain the target screen to be transmitted, so that the receiving device can render the target screen to be transmitted according to the screen picture parameters of the display screen to eliminate the black and white situation caused by the different aspect ratios, thereby improving the user experience. In addition, when the difference in the appearance parameters is within the preset picture change range, the screen to be transmitted is subjected to aspect ratio change processing according to the screen picture parameters, so that the target screen to be transmitted is less deformed after the aspect ratio change processing than the screen to be transmitted, so that when the receiving device renders according to the screen parameters of the display screen, the corresponding picture displayed after rendering is less deformed than the screen to be transmitted, which does not affect the user's perception, thereby achieving the elimination of the black border situation while improving the user's viewing experience.

[0077] Figure 5 A flowchart of another screen transmission control method provided by an embodiment of the present application, the screen transmission control method is used for a receiving device, and specifically includes:

[0078] S201. Send screen image parameters of a display screen to a sending device.

[0079] The receiving device obtains the screen image parameters of the rendering area of ​​its own display screen, including the screen image size, aspect ratio, height-to-width ratio, and pixels. Before screen transmission, the receiving device sends the screen image parameters of its own display screen to the sending device, so that the sending device can use the screen image parameters as a reference to determine whether the screen image to be transmitted needs to be changed accordingly, thereby improving the flexibility of screen transmission control.

[0080] S202. Receive a target screen image sent by a sending device. The target screen image is obtained by changing the aspect ratio of the screen image according to the screen image parameters when the appearance parameter difference is within a preset image change range. The appearance parameter difference is obtained based on the window image parameters and the screen image parameters of the screen image to be transmitted.

[0081] After the sending device receives the screen image parameters sent by the receiving device, during screen transmission control, the sending device performs corresponding image processing according to the above S101-S104 to obtain the corresponding target screen transmission image, and transmits the target screen transmission image to the receiving device. The receiving device receives the target screen transmission image sent by the sending device. It can be seen from the above S101-S104 that the target screen transmission image is obtained by changing the aspect ratio of the screen transmission image according to the screen image parameters when the difference in the appearance parameters between the display screen and the screen to be transmitted is within the preset image change range. The specific change processing steps are the same as the above S103 and are not repeated here. The difference in appearance parameters is obtained based on the parameters of the screen to be transmitted and the screen image parameters. The specific steps are the same as the above S102 and are not repeated here.

[0082] S203, rendering the target screen image according to the screen image parameters.

[0083] After the sending device encodes the target screen image, it obtains the encoded data and transmits the encoded data to the receiving device. After the receiving device receives the encoded data corresponding to the target screen image, it decodes the encoded data to obtain the target screen image, and renders the target screen image through a preset rendering strategy that maintains the aspect ratio. Based on the aspect ratio of the target screen image being consistent with the aspect ratio of the rendering area of ​​the display screen of the receiving device, the displayed image after rendering according to the rendering strategy that maintains the aspect ratio will not have black edges, thereby improving the user's viewing experience. Exemplarily, it can be seen from the above that the width of the target screen image is 960 pixels and the height is 540 pixels, and the width of the rendering area of ​​the display screen of the receiving device is 3840 pixels and the height is 2160 pixels. The aspect ratios of the two are consistent, so the displayed image after the receiving device renders according to the rendering strategy that maintains the aspect ratio will not have black edges, thereby improving the user's viewing experience.

[0084] In one embodiment, after receiving the target screen transmission image, the receiving device renders the target screen transmission image with a first aspect ratio so that the size of the image displayed after rendering is the same as the size of the rendering area of ​​the display screen, so that the image displayed after rendering does not have black edges, thereby improving the user's viewing experience.

[0085] As described above, during the screen transmission process, the difference in the appearance parameters of the display screen and the screen to be transmitted is obtained from the screen picture parameters and the window picture parameters. When the difference in the appearance parameters is within the preset picture change range, the screen to be transmitted is subjected to aspect ratio change processing according to the screen picture parameters to obtain the target screen to be transmitted, so that the receiving device can render the target screen to be transmitted according to the screen picture parameters of the display screen to eliminate the black and white situation caused by the different aspect ratios, thereby improving the user experience. In addition, when the difference in the appearance parameters is within the preset picture change range, the screen to be transmitted is subjected to aspect ratio change processing according to the screen picture parameters, so that the target screen to be transmitted is less deformed after the aspect ratio change processing than the screen to be transmitted, so that when the receiving device renders according to the screen parameters of the display screen, the corresponding picture displayed after rendering is less deformed than the screen to be transmitted, which does not affect the user's perception, thereby achieving the elimination of the black border situation while improving the user's viewing experience.

[0086] Figure 6 A flowchart of another screen transmission control method provided by an embodiment of the present application, referring to Figure 6 The screen transmission control method is used for a receiving device and specifically includes:

[0087] S301, receiving a screen transmission image sent by a sending device, and obtaining window image parameters according to the screen transmission image.

[0088] The screen transmission picture can be understood as the picture of an application window corresponding to the sending device. The user selects an application window on the sending device as the picture to be transmitted. After the sending device collects and encodes the picture to be transmitted, it obtains the encoded data corresponding to the screen transmission picture and transmits the encoded data to the receiving device. After receiving the encoded data, the receiving device decodes it to obtain the screen transmission picture. According to the screen transmission picture, the window picture parameters of the screen transmission picture can be obtained, and the window picture parameters include parameter information such as the size, aspect ratio, height-to-width ratio and pixels of the screen transmission picture.

[0089] Reference Figure 2 , the user selects an application window on the sending device as the screen to be transmitted. Assuming that the window screen of the screen to be transmitted is 950 pixels wide and 540 pixels high, its aspect ratio is 95:54, which is approximately 1.759. After the screen to be transmitted is transmitted to the receiving device, the receiving device receives the transmitted screen. The screen to be transmitted is 950 pixels wide and 540 pixels high, so its aspect ratio is 95:54, which is approximately 1.759. Based on the received screen, the receiving device can obtain parameter information such as the window screen parameters corresponding to the screen, which are 950 pixels wide, 540 pixels high, and 95:54 aspect ratio.

[0090] S302: Obtain the difference in appearance parameters between the display screen and the transmitted screen according to the window screen parameters and the screen screen parameters of the display screen.

[0091] The screen image parameters of the display screen are the screen image parameters of the display screen of the receiving device, including parameters such as the size, aspect ratio, height-to-width ratio, and pixels of the screen image. The receiving device can obtain the screen image parameters of the rendering area of ​​its own display screen. According to the screen image parameters of the display screen of the receiving device and the window image parameters of the received screen transmission image, the difference in the appearance parameters of the display screen and the screen transmission image is obtained, and a judgment is made based on the difference in the appearance parameters whether to change the screen transmission image. Exemplarily, the screen image parameters of the display screen of the receiving device and the window image parameters of the screen transmission image can be calculated and processed to obtain the difference in the appearance parameters of the display screen and the screen transmission image. For example, the screen image parameters are subtracted from the window image parameters to obtain the difference in the appearance parameters of the display screen and the screen transmission image.

[0092] The screen image parameters of the display screen of the receiving device include parameters such as the size, aspect ratio, and pixels of the screen image. The window image parameters of the screen transmission image include parameters such as the size, aspect ratio, and pixels of the screen image to be transmitted. The first aspect ratio of the receiving device can be obtained based on the screen image parameters of the display screen of the receiving device itself. The second aspect ratio of the sending device can be obtained based on the window image parameters of the received projection screen. Calculation is performed based on the first aspect ratio and the second aspect ratio, for example, the second aspect ratio is subtracted from the first aspect ratio to obtain the difference in the appearance parameters between the display screen of the receiving device and the received screen transmission image.

[0093] Reference Figure 3 , assuming that the display screen of the receiving device is 3840 pixels wide and 2160 pixels high, its aspect ratio is 16:9, which is about 1.778, that is, the screen image parameters of the display screen are 3840 pixels wide and 2160 pixels high, and the aspect ratio is 16:9, that is, the first aspect ratio can be obtained as 16:9. Figure 2, the user selects an application window on the sending device as the screen to be transmitted. Assuming that the window screen of the screen to be transmitted is 950 pixels wide and 540 pixels high, its aspect ratio is 95:54, which is about 1.759. After the screen to be transmitted is transmitted to the receiving device, the receiving device receives the transmitted screen. According to the transmitted screen, the window screen parameters can be obtained as 950 pixels wide, 540 pixels high and 95:54 aspect ratio and other parameter information, that is, the second aspect ratio of 95:54 can be obtained. Calculation and processing are performed based on the screen image parameters and window image parameters of the display screen of the receiving device. Taking the aspect ratio as an example, the first aspect ratio of the display screen of the receiving device is subtracted from the second aspect ratio of the screen to be transmitted of the corresponding projection window of the sending device to obtain the difference in the appearance parameters of the display screen and the screen to be transmitted. For example, from the above, it can be seen that the screen image parameters of the display screen of the receiving device are an aspect ratio of 16:9, that is, the first aspect ratio is 16:9, and the window image parameters are an aspect ratio of 95:54, that is, the second aspect ratio is 95:54. The first aspect ratio can be subtracted from the second aspect ratio to obtain an appearance parameter difference of approximately 0.02 between the display screen of the receiving device and the screen image to be transmitted in the sending device.

[0094] As described above, the difference in appearance parameters between the display screen and the screen to be transmitted is obtained through the screen image parameters and the window image parameters. Therefore, it is possible to judge whether black edges will appear on the displayed image after direct screen transmission based on the difference in appearance parameters. Subsequent black edge elimination processing can be performed based on the judgment result to reduce the black edge situation and improve the viewing experience.

[0095] S303. When the difference in the appearance parameters is within a preset image change range, the aspect ratio of the transmitted screen image is changed according to the screen image parameters to obtain a target transmitted screen image.

[0096] When there is a difference in appearance parameters between the display screen of the receiving device and the screen transmission picture, if the rendering strategy of the receiving device is to maintain the aspect ratio rendering, the screen transmission picture is rendered by maintaining the aspect ratio rendering strategy, and black edges will appear in the picture displayed after rendering. In order to reduce the occurrence of black edges, when the difference in appearance parameters is within the preset picture change range, the screen transmission picture is subjected to aspect ratio change processing according to the screen picture parameters of the display screen of the receiving device to obtain the target screen transmission picture, so that the aspect ratio of the target screen transmission picture after the change processing is the same as the aspect ratio corresponding to the screen picture parameters, that is, the aspect ratio of the target screen transmission picture is the same as the aspect ratio of the display screen of the receiving device, and then the receiving device subsequently renders the target screen transmission picture according to the rendering strategy of maintaining the aspect ratio, so that there is no black edge in the picture displayed after rendering. Based on the fact that the aspect ratio change processing of the screen transmission picture is performed when the difference in appearance parameters is within the preset picture change range, since the difference in appearance parameters is within the preset picture change range, the aspect ratio change processing of the screen transmission picture does not cause too much deformation, does not affect the user's viewing experience, and eliminates the black edge situation, thereby improving the user's overall viewing experience.

[0097] It should be noted that when the difference in the appearance parameters is not within the preset image change range, that is, when the display screen of the receiving device and the window image parameters of the transmitted screen are greatly different, if the aspect ratio of the transmitted screen is changed at this time, it may cause serious deformation of the screen. Although the black edges can be eliminated after rendering, the serious deformation of the screen will affect the user's viewing experience. Therefore, the aspect ratio of the transmitted screen can only be changed when the difference in the appearance parameters is within the preset image change range, so as to eliminate the black edges while maintaining the look and feel of the screen.

[0098] In one embodiment, when the absolute value of the appearance parameter difference is less than or equal to a preset threshold, that is, the appearance parameter difference is within a preset image change range, the aspect ratio of the transmitted image is changed according to the screen image parameters of the display screen to obtain the target transmitted image.

[0099] It should be noted that the preset threshold can be set according to actual conditions and is not limited in this embodiment. For example, assuming that the preset threshold is 0.1, the difference in appearance parameters between the display screen and the transmitted screen obtained above is about 0.02, which is less than the preset threshold 0.1, and the difference in appearance parameters is within the preset screen change range.

[0100] Exemplarily, after receiving the screen transmission image sent by the sending device, the receiving device obtains the first aspect ratio A of the rendering area of ​​its own display screen, and obtains the second aspect ratio B of the screen transmission image based on the screen transmission image. The difference in appearance parameters between the display screen and the screen transmission image is calculated to be C, where C=AB. The difference in appearance parameters can be understood as the difference in aspect ratios between the display screen and the screen transmission image. When the difference in appearance parameter C is 0, it means that the aspect ratios of the display screen and the screen transmission image are equal. At this time, the screen transmission image is not processed in any way, and the receiving device directly renders the screen transmission image. After rendering, the displayed image will not have black edges. When the difference in appearance parameter C is not within the preset image change range, that is, the absolute value of the difference in appearance parameter C is greater than the preset threshold k, it means that there is a large difference in the aspect ratios of the display screen and the screen transmission image. At this time, stretching the screen transmission image to eliminate the black edges may cause serious deformation of the image and affect the viewing experience. When the shape parameter difference C is within the preset image change range, that is, the absolute value of the shape parameter difference C is less than or equal to the preset threshold k, it means that the aspect ratio of the display screen and the transmitted screen are relatively close. At this time, the aspect ratio of the transmitted screen can be changed according to the screen image parameters of the display screen to obtain the target transmitted screen, so that the aspect ratio of the target transmitted screen is the same as the aspect ratio of the rendering area of ​​the display screen. After the receiving device changes the processing to obtain the target transmitted screen, the target transmitted screen can be rendered according to the aspect ratio maintaining rendering strategy. The resulting image deformation is very small and is not easily perceived by the human eye, thereby achieving the goal of not having black edges and not affecting the user's viewing experience.

[0101] In one embodiment, the screen image parameter is a first aspect ratio, and the window image parameter is a second aspect ratio. At this time, the difference in the appearance parameter is the difference in the aspect ratio between the display screen and the screen image to be transmitted. When the difference in the appearance parameter is within the preset image change range, and the difference in the appearance parameter is a negative number, the width of the transmitted screen image is kept unchanged, and the transmitted screen image is vertically scaled with the first aspect ratio to obtain the target transmitted screen image, so that the aspect ratio of the target transmitted screen image is the same as the first aspect ratio. Exemplarily, when the difference in the appearance parameter C is within the preset image change range, and the difference in the appearance parameter C is less than 0, the width of the transmitted screen image is kept unchanged, and the transmitted screen image is vertically changed according to the first aspect ratio A in the screen image parameter, which can be to multiply the width of the transmitted screen image by the first aspect ratio to obtain the height of the corresponding target transmitted screen image, and the transmitted screen image is vertically stretched or shrunk to the same height as the height of the target transmitted screen image. For example, the width of the screen transmission image is W, and the height is H. After the change processing, the width of the target screen transmission image is WS, and the height is HS, wherein WS=W, HS=W*A.

[0102] In one embodiment, when the screen image parameter is the first aspect ratio and the window image parameter is the second aspect ratio, the appearance parameter difference is the difference between the aspect ratios of the display screen and the screen image to be transmitted. When the appearance parameter difference is within the preset image change range and the appearance parameter difference is a positive number, the height of the transmitted screen image is kept unchanged, and the transmitted screen image is horizontally scaled with the first aspect ratio to obtain the target transmitted screen image, so that the aspect ratio of the target transmitted screen image is the same as the first aspect ratio. Exemplarily, when the appearance parameter difference C is within the preset image change range and the appearance parameter difference C is greater than 0, the height of the transmitted screen image is kept unchanged, and the transmitted screen image is horizontally changed according to the first aspect ratio A in the screen image parameter, which can be to multiply the height of the transmitted screen image by the first aspect ratio to obtain the width of the corresponding target transmitted screen image, and the transmitted screen image is horizontally stretched or shrunk to the same width as the target transmitted screen image. For example, the width of the screen transmission image is W, and the height is H. After the change processing, the width of the target screen transmission image is WS, and the height is HS, wherein WS=H*A, HS=H.

[0103] Reference Figure 4 , taking the screen image parameter as the first aspect ratio and the window image parameter as the second aspect ratio as an example, the difference in appearance parameters is the difference in aspect ratio between the display screen and the screen image to be transmitted. As can be seen from the above, the screen image parameter of the display screen of the receiving device is an aspect ratio of 16:9, which is approximately 1.778, that is, the first aspect ratio is 16:9, which is approximately 1.778. The screen image is 950 pixels wide and 540 pixels high, and the window image parameter is an aspect ratio of 95:54, which is approximately 1.759, that is, the second aspect ratio is 95:54, which is approximately 1.759. The second aspect ratio can be subtracted from the first aspect ratio to obtain the difference C in appearance parameters between the display screen of the receiving device and the screen image sent by the sending device, which is approximately 0.02, which is less than the preset threshold value of 0.1. Based on the absolute value of the shape parameter difference C being less than the preset threshold value 0.1, and the shape parameter difference C being approximately 0.02, which is greater than 0, according to the above-mentioned change processing, the height of the screen transmission picture is kept unchanged, that is, the height is kept at 540 pixels, and the screen transmission picture is horizontally scaled with the first aspect ratio (approximately 1.778). The width after scaling is approximately 540*1.778, which is approximately equal to 960 pixels, so that the width of the target screen transmission picture obtained after the change processing is 960 pixels and the height is 540 pixels. Based on the screen transmission picture with a width of 950 pixels and a height of 540 pixels, the difference between the target screen transmission picture obtained after the change processing and the screen transmission picture is that the width of the picture is stretched by 10 pixels. This stretching change is relatively difficult to detect in human eye observation, so that when the target screen transmission picture is subsequently rendered and displayed, it is the same as the screen transmission picture in human eye observation, and will not affect the user's viewing experience. In addition, based on the fact that the width ratio of the target screen transmission picture obtained after stretching is the same as that of the display screen, the black edges can be eliminated after rendering, thereby improving the user's viewing experience as a whole.

[0104] As described above, when the difference in the appearance parameters between the display screen of the receiving device and the transmitted screen image is within the preset image change range, the transmitted screen image is processed with an aspect ratio change according to the screen image parameters to obtain a target transmitted screen image with the same aspect ratio as the display screen of the receiving device, so that black edges will not appear when the receiving device renders, thereby improving the user's viewing experience. In addition, based on the fact that the difference in the appearance parameters is within the preset image change range, the aspect ratio of the transmitted screen image is changed according to the screen image parameters, which will not cause a large deformation, and the human eye perception is similar to the transmitted screen image, thereby ensuring the user's viewing experience on the basis of eliminating the black edges, thereby improving the user's overall viewing experience.

[0105] S304, rendering the target screen image according to the screen image parameters.

[0106] After the receiving device obtains the target screen image through the above processing, it renders the target screen image through the preset rendering strategy of maintaining the aspect ratio. Based on the aspect ratio of the target screen image being consistent with the aspect ratio of the rendering area of ​​the display screen of the receiving device, the displayed image after rendering according to the rendering strategy of maintaining the aspect ratio will not have black edges, thereby improving the user's viewing experience. Exemplarily, it can be seen from the above that the width of the target screen image is 960 pixels and the height is 540 pixels, and the width of the rendering area of ​​the display screen of the receiving device is 3840 pixels and the height is 2160 pixels. The aspect ratio of the two is consistent, so the displayed image after the receiving device is rendered according to the rendering strategy of maintaining the aspect ratio will not have black edges, thereby improving the user's viewing experience.

[0107] In one embodiment, after the receiving device obtains the target screen transmission image through the above processing, the target screen transmission image is rendered with a first aspect ratio so that the size of the image displayed after rendering is the same as the size of the rendering area of ​​the display screen, so that the image displayed after rendering does not have black edges, thereby improving the user's viewing experience.

[0108] As described above, during the screen transmission process, the difference in the appearance parameters of the display screen and the transmitted screen is obtained from the screen picture parameters and the window picture parameters. When the difference in the appearance parameters is within the preset picture change range, the transmitted screen picture is subjected to aspect ratio change processing according to the screen picture parameters to obtain the target transmitted screen picture. The receiving device can render the target transmitted screen picture according to the screen picture parameters to eliminate the black and white situation caused by the different aspect ratios and improve the user experience. In addition, when the difference in the appearance parameters is within the preset picture change range, the transmitted screen picture is subjected to aspect ratio change processing according to the screen picture parameters, so that the target transmitted screen picture after the aspect ratio change processing is smaller than the transmitted screen picture, so that when the receiving device renders according to the screen parameters of the display screen, the corresponding picture displayed after rendering is smaller than the transmitted screen picture, and does not affect the user's perception, thereby achieving the elimination of the black border situation while improving the user's viewing experience.

[0109] Figure 7 A schematic diagram of the structure of a screen transmission control device provided by an embodiment of the present application. Figure 7 The screen transmission control device provided in this embodiment is used for sending equipment, and specifically includes: a first parameter acquisition unit 21, a first calculation unit 22, a first change processing unit 23 and a first data transmission unit 24.

[0110] The first parameter acquisition unit 21 is used to acquire the screen image parameters of the display screen sent by the receiving device, and acquire the window image parameters of the screen image to be transmitted;

[0111] A first calculation unit 22, used to obtain a difference in appearance parameters between the display screen and the screen to be transmitted according to the screen picture parameters and the window picture parameters;

[0112] The first change processing unit 23 is used to change the aspect ratio of the screen image to be transmitted according to the screen image parameters to obtain the target screen image when the difference of the appearance parameters is within the preset image change range;

[0113] The first data transmission unit 24 is used to transmit the target screen transmission image to the receiving device so that the receiving device can render it according to the screen image parameters.

[0114] In one embodiment, the first change processing unit 23 includes a first change subunit and a second change subunit;

[0115] The screen image parameters include a first aspect ratio of a rendering area of ​​a display screen of the receiving device;

[0116] The first changing subunit is used for keeping the width of the screen to be transmitted unchanged and performing vertical scaling processing on the screen to be transmitted with a first aspect ratio to obtain a target screen to be transmitted, when the difference in the appearance parameters is within a preset screen change range and the difference in the appearance parameters is a negative number, and obtaining a target screen to be transmitted, wherein the aspect ratio of the target screen to be transmitted is the first aspect ratio;

[0117] The second change subunit is used to keep the height of the picture to be transmitted unchanged and horizontally scale the picture to be transmitted with a first aspect ratio to obtain a target screen transmission picture when the shape parameter difference is within a preset picture change range and the shape parameter difference is a positive number, and obtain a target screen transmission picture with an aspect ratio of the first aspect ratio.

[0118] In one embodiment, the first calculation unit 22 includes a first parameter acquisition subunit and a first calculation subunit;

[0119] A first parameter acquisition subunit, configured to obtain a first aspect ratio of a receiving device according to a screen picture parameter, and obtain a second aspect ratio of a sending device according to a window picture parameter;

[0120] The first calculation subunit is used to obtain the difference in appearance parameters between the display screen and the image to be transmitted according to the first aspect ratio and the second aspect ratio.

[0121] The screen transmission control device provided in the embodiment of the present application can be used to execute the screen transmission control method provided in the above embodiment, and has corresponding functions and beneficial effects.

[0122] Figure 8 A schematic diagram of the structure of another screen transmission control device provided by an embodiment of the present application. Figure 8 The screen transmission control device provided in this embodiment is used for a receiving device, and specifically includes: a second data sending unit 31, a second data receiving unit 32 and a second rendering unit 33.

[0123] The second data sending unit 31 is used to send the screen image parameters of the display screen to the sending device;

[0124] The second data receiving unit 32 is used to receive a target screen transmission picture sent by the sending device, the target screen transmission picture is obtained by changing the aspect ratio of the screen transmission picture according to the screen picture parameters when the shape parameter difference is within the preset picture change range, and the shape parameter difference is obtained according to the window picture parameters and the screen picture parameters of the screen transmission picture;

[0125] The second rendering unit 33 is used to render the target screen transmission picture according to the screen picture parameters.

[0126] In one embodiment, the screen image parameters include a first aspect ratio of a rendering area of ​​a display screen of the receiving device;

[0127] The second rendering unit 33 is further used to render the target screen transmission image with a first aspect ratio, so that the size of the image displayed after rendering is the same as the size of the rendering area.

[0128] The screen transmission control device provided in the embodiment of the present application can be used to execute the screen transmission control method provided in the above embodiment, and has corresponding functions and beneficial effects.

[0129] Fig. 9 A schematic diagram of the structure of another screen transmission control device provided by an embodiment of the present application. Fig. 9 The screen transmission control device provided in this embodiment is used for a receiving device, and specifically includes: a third data receiving unit 41, a third calculation unit 42, a third change processing unit 43 and a third rendering unit 44.

[0130] The third data receiving unit 41 is used to receive the screen transmission picture sent by the sending device, and obtain the window picture parameters according to the screen transmission picture;

[0131] A third calculation unit 42 is used to obtain a difference in appearance parameters according to the window image parameters and the screen image parameters of the display screen;

[0132] The third change processing unit 43 is used to change the aspect ratio of the screen transmission picture according to the screen picture parameters to obtain the target screen transmission picture when the difference of the appearance parameters is within the preset picture change range;

[0133] The third rendering unit 44 is used to render the target screen transmission picture according to the screen picture parameters.

[0134] In one embodiment, the third change processing unit 43 includes a third change subunit and a fourth change subunit;

[0135] The screen image parameters include a first aspect ratio of a rendering area of ​​a display screen of the receiving device;

[0136] The third changing subunit is used for keeping the width of the screen transmission picture unchanged and performing vertical scaling processing on the screen transmission picture with a first aspect ratio to obtain a target screen transmission picture when the difference of the appearance parameters is within a preset screen change range and the difference of the appearance parameters is a negative number, and obtaining the target screen transmission picture with an aspect ratio of the first aspect ratio;

[0137] The fourth change subunit is used to keep the height of the screen transmission picture unchanged and horizontally scale the screen transmission picture with a first aspect ratio to obtain a target screen transmission picture when the shape parameter difference is within a preset picture change range and the shape parameter difference is a positive number, and obtain a target screen transmission picture with an aspect ratio of the first aspect ratio.

[0138] In one embodiment, the third calculation unit 42 includes a third parameter acquisition subunit and a third calculation subunit;

[0139] A third parameter acquisition subunit is used to obtain a first aspect ratio of the receiving device according to the screen picture parameters of the display screen, and obtain a second aspect ratio of the sending device according to the window picture parameters;

[0140] The third calculation subunit is used to obtain a shape parameter difference according to the first aspect ratio and the second aspect ratio.

[0141] In one embodiment, the screen image parameters include a first aspect ratio of a rendering area of ​​a display screen of the receiving device;

[0142] The third rendering unit 44 is further used to render the target screen transmission image with a first aspect ratio, so that the size of the image displayed after rendering is the same as the size of the rendering area.

[0143] The screen transmission control device provided in the embodiment of the present application can be used to execute the screen transmission control method provided in the above embodiment, and has corresponding functions and beneficial effects.

[0144] It is worth noting that in the embodiment of the above-mentioned screen transmission control device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.

[0145] Fig.10 A schematic diagram of a screen transmission control device provided by an embodiment of the present application is shown in FIG. Fig.10 The screen transmission control device includes: a processor 51, a memory 52, a communication module 53, an input device 54 and an output device 55. The number of processors in the screen transmission control device can be one or more, and the number of memories in the screen transmission control device can be one or more. The processor, memory, communication module, input device and output device of the screen transmission control device can be connected through a bus or other methods.

[0146] The memory 52, as a computer-readable storage medium, can be used to store software programs, computer executable programs and modules, such as the program instructions / modules corresponding to the screen transmission control method described in any embodiment of the present application (for example, the first parameter acquisition unit, the first calculation unit, the first change processing unit and the first data transmission unit in the screen transmission control device). The memory 52 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the device, etc. In addition, the memory may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device or other non-volatile solid-state storage device. In some instances, the memory may further include a memory remotely arranged relative to the processor, and these remote memories may be connected to the screen transmission control device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network and a combination thereof.

[0147] The processor 51 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory, that is, implements the above-mentioned screen transmission control method.

[0148] The communication module 53 is used for data transmission. The input device 54 can be used to receive input digital or character information, and generate key signal input related to user settings and function control of the device, and can also include an audio input device or a video input device. The output device 55 can include an audio output device or a video output device (such as a display screen). The output device 55 can display according to the instructions of the processor 51.

[0149] The screen transmission control device provided above can be used to execute the screen transmission control method provided in the above embodiment, and has corresponding functions and beneficial effects.

[0150] One embodiment of the present application also provides a storage medium containing computer executable instructions, which, when executed by a computer processor, are used to perform relevant operations in the screen transmission control method provided in any embodiment of the present application, and have corresponding functions and beneficial effects.

[0151] Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems or computer program products.

[0152] Therefore, the present application may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code. The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram and the combination of the processes and / or boxes in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the process Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the functions specified in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide for implementing the process in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0153] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory. The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0154] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0155] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0156] Note that the above are only preferred embodiments of the present application and the technical principles used. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present application. Therefore, although the present application is described in more detail through the above embodiments, the present application is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the appended claims.

Claims

1. A screen transmission control method, characterized in that: For sending equipment, including: Obtain the screen image parameters of the display screen sent by the receiving device, and obtain the window image parameters of the screen image to be transmitted; According to the screen picture parameters and the window picture parameters, a difference value of the appearance parameters of the display screen and the picture to be transmitted is obtained; When the difference in the appearance parameters is within a preset image change range, the aspect ratio of the image to be transmitted is changed according to the screen image parameters to obtain a target transmitted image; The target screen image is transmitted to the receiving device so that the receiving device can render it according to the screen image parameters.

2. The method according to claim 1, characterized in that The screen image parameters include a first aspect ratio of a rendering area of ​​a display screen of the receiving device; When the difference of the appearance parameters is within a preset picture change range, the aspect ratio of the picture to be transmitted is changed according to the screen picture parameters to obtain a target screen transmission picture, including: When the difference in the appearance parameters is within the preset range of picture changes and the difference in the appearance parameters is a negative number, the width of the picture to be transmitted is kept unchanged, and the picture to be transmitted is vertically scaled with the first aspect ratio to obtain the target transmitted picture, and the aspect ratio of the target transmitted picture is the first aspect ratio; When the shape parameter difference is within the preset screen change range and the shape parameter difference is a positive number, the height of the screen to be transmitted is kept unchanged, and the screen to be transmitted is horizontally scaled with the first aspect ratio to obtain the target screen transmission picture, and the aspect ratio of the target screen transmission picture is the first aspect ratio.

3. The method according to claim 1, characterized in that The obtaining, according to the screen picture parameters and the window picture parameters, a difference in appearance parameters between the display screen and the picture to be transmitted includes: Obtaining a first aspect ratio of the receiving device according to the screen picture parameters, and obtaining a second aspect ratio of the sending device according to the window picture parameters; According to the first aspect ratio and the second aspect ratio, a difference in appearance parameters between the display screen and the image to be transmitted is obtained.

4. A screen transmission control method, characterized in that: For receiving equipment, including: Sending screen image parameters of the display screen to the sending device; Receive a target screen image sent by the sending device, wherein the target screen image is obtained by changing the aspect ratio of the screen image to be transmitted according to the screen image parameters when the shape parameter difference is within a preset image change range, and the shape parameter difference is obtained according to the window image parameters of the screen image to be transmitted and the screen image parameters; The target screen image is rendered using the screen image parameters.

5. The method according to claim 4, characterized in that The screen image parameters include a first aspect ratio of a rendering area of ​​a display screen of the receiving device; The step of rendering the target screen image with the screen image parameters includes: The target screen transmission image is rendered with the first aspect ratio so that the size of the image displayed after rendering is the same as the size of the rendering area.

6. A screen transmission control method, characterized in that: For receiving equipment, including: Receiving a screen transmission image sent by a sending device, and obtaining window image parameters according to the screen transmission image; According to the window picture parameters and the screen picture parameters of the display screen, a difference value of the appearance parameters of the display screen and the transmitted screen picture is obtained; When the difference in the appearance parameters is within a preset image change range, the aspect ratio of the screen transmission image is changed according to the screen image parameters to obtain a target screen transmission image; The target screen image is rendered using the screen image parameters.

7. The method according to claim 6, characterized in that The screen image parameters include a first aspect ratio of a rendering area of ​​a display screen of the receiving device; When the difference of the appearance parameters is within a preset picture change range, the aspect ratio of the screen transmission picture is changed according to the screen picture parameters to obtain a target screen transmission picture, including: When the shape parameter difference is within a preset image change range and the shape parameter difference is a negative number, the width of the screen transmission image is kept unchanged, and the screen transmission image is vertically scaled with the first aspect ratio to obtain the target screen transmission image, and the aspect ratio of the target screen transmission image is the first aspect ratio; When the shape parameter difference is within the preset image change range and the shape parameter difference is a positive number, the height of the screen transmission image is kept unchanged, and the screen transmission image is horizontally scaled with the first aspect ratio to obtain the target screen transmission image, and the aspect ratio of the target screen transmission image is the first aspect ratio.

8. The method according to claim 6, characterized in that The step of obtaining the difference of the appearance parameters according to the window picture parameters and the screen picture parameters of the display screen includes: Obtaining a first aspect ratio of the receiving device according to screen picture parameters of the display screen, and obtaining a second aspect ratio of the sending device according to the window picture parameters; The shape parameter difference is obtained according to the first aspect ratio and the second aspect ratio.

9. The method according to any one of claims 6 to 8, characterized in that: The screen image parameters include a first aspect ratio of a rendering area of ​​a display screen of the receiving device; The step of rendering the target screen image with the screen image parameters includes: The target screen transmission image is rendered with the first aspect ratio so that the size of the image displayed after rendering is the same as the size of the rendering area.

10. A screen transmission control device, characterized in that: For sending equipment, including: A first parameter acquisition unit, used to acquire screen image parameters of the display screen sent by the receiving device, and acquire window image parameters of the screen image to be transmitted; A first calculation unit, used for obtaining a difference in appearance parameters between the display screen and the screen image to be transmitted according to the screen image parameters and the window image parameters; A first change processing unit is used to change the aspect ratio of the to-be-transmitted screen image according to the screen image parameters to obtain a target transmitted screen image when the difference in the appearance parameters is within a preset screen change range; The first data transmission unit is used to transmit the target screen image to the receiving device so that the receiving device can render it according to the screen image parameters.

11. A screen transmission control device, characterized in that: For receiving equipment, including: A second data sending unit, used for sending screen image parameters of the display screen to a sending device; A second data receiving unit is used to receive a target screen transmission picture sent by the sending device, wherein the target screen transmission picture is obtained by changing the aspect ratio of the screen transmission picture according to the screen picture parameters when the shape parameter difference is within a preset picture change range, and the shape parameter difference is obtained according to the window picture parameters of the screen transmission picture and the screen picture parameters; The second rendering unit is used to render the target screen transmission image according to the screen image parameters.

12. A screen transmission control device, characterized in that: For receiving equipment, including: A third data receiving unit is used to receive a screen transmission picture sent by a sending device, and obtain window picture parameters according to the screen transmission picture; A third calculation unit, used for obtaining a difference in appearance parameters according to the window image parameters and the screen image parameters of the display screen; A third change processing unit is used to change the aspect ratio of the screen transmission picture according to the screen picture parameters to obtain a target screen transmission picture when the difference of the appearance parameters is within a preset picture change range; The third rendering unit is used to render the target screen transmission image according to the screen image parameters.

13. A screen transmission control device, characterized in that: include: memory and one or more processors; The memory is used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 9.

14. A storage medium storing computer executable instructions, characterized in that: When the computer executable instructions are executed by a processor, they are used to perform the method according to any one of claims 1 to 9.

Images